2024-09-10T23:04:01.050 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T23:04:01.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T23:04:01.160 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899779 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/sessionmap} email: hyelloji@redhat.com first_in_suite: false job_id: '7899779' kernel: client: sha1: distro flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - client session with non-allowable root sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 kclient: syntax: v1 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi090.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzaLeaBmBT9hKY/v0MrteRTZNHd/sousv1hsy1GUVQYYKE6d+7vPBXOE3+hYXKSAs/bnRKHeZWWGv58SveVVhM= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBqUeyt8ejMHsJ4jtjGF5LapA09lMBU2b0uhqssb19fsCPM/EvxyarQM+kAk3xp1kid1Jx+hqbdpwv6RNabkmpE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_sessionmap teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T23:04:01.161 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T23:04:01.161 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T23:04:01.162 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T23:04:01.163 INFO:teuthology.task.internal:Checking packages... 2024-09-10T23:04:01.183 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T23:04:01.183 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T23:04:01.183 INFO:teuthology.packaging:ref: None 2024-09-10T23:04:01.184 INFO:teuthology.packaging:tag: None 2024-09-10T23:04:01.184 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:04:01.184 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:04:01.184 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:04:01.338 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-10T23:04:01.340 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T23:04:01.347 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T23:04:01.347 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T23:04:01.360 INFO:teuthology.task.internal:Saving configuration 2024-09-10T23:04:01.376 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T23:04:01.383 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T23:04:01.416 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899779', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 22:58:18.478699', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzaLeaBmBT9hKY/v0MrteRTZNHd/sousv1hsy1GUVQYYKE6d+7vPBXOE3+hYXKSAs/bnRKHeZWWGv58SveVVhM='} 2024-09-10T23:04:01.446 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899779', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 22:58:18.480661', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBqUeyt8ejMHsJ4jtjGF5LapA09lMBU2b0uhqssb19fsCPM/EvxyarQM+kAk3xp1kid1Jx+hqbdpwv6RNabkmpE='} 2024-09-10T23:04:01.446 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T23:04:01.453 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-10T23:04:01.453 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-10T23:04:01.453 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T23:04:01.526 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe363a1fbe0>, signals=[15]) 2024-09-10T23:04:01.526 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T23:04:01.533 INFO:teuthology.task.internal:Opening connections... 2024-09-10T23:04:01.533 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:04:01.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:04:01.618 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:04:01.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:04:01.709 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T23:04:01.717 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2024-09-10T23:04:01.735 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2024-09-10T23:04:01.736 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-09-10T23:04:01.794 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-09-10T23:04:01.794 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9" 2024-09-10T23:04:01.794 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-09-10T23:04:01.794 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:04:01.794 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9" 2024-09-10T23:04:01.794 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:04:01.795 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:04:01.795 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-09-10T23:04:01.795 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:04:01.795 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:04:01.795 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:04:01.795 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:04:01.795 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:04:01.795 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:04:01.796 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-09-10T23:04:01.824 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-09-10T23:04:01.843 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-09-10T23:04:01.844 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-09-10T23:04:01.902 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream" 2024-09-10T23:04:01.902 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9" 2024-09-10T23:04:01.902 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2024-09-10T23:04:01.902 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:04:01.902 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9" 2024-09-10T23:04:01.903 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:04:01.903 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:04:01.903 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2024-09-10T23:04:01.903 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:04:01.903 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:04:01.903 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:04:01.903 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:04:01.903 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:04:01.904 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:04:01.904 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-09-10T23:04:01.933 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T23:04:01.942 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T23:04:02.014 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T23:04:02.014 DEBUG:teuthology.orchestra.run.smithi090:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:04:02.017 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:04:02.034 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T23:04:02.041 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T23:04:02.041 DEBUG:teuthology.orchestra.run.smithi090:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:04:02.074 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:04:02.155 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T23:04:02.234 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T23:04:02.249 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T23:04:02.249 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-10T23:04:02.249 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-10T23:04:02.249 DEBUG:teuthology.orchestra.run.smithi090:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:04:02.250 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:04:02.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:04:02.267 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2024-09-10T23:04:02.268 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:04:02.268 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-09-10T23:04:02.325 INFO:teuthology.orchestra.run.smithi090.stdout:5.14.0-503.el9.x86_64 2024-09-10T23:04:02.325 INFO:teuthology.task.kernel:Running kernel on smithi090: 5.14.0-503.el9.x86_64 2024-09-10T23:04:02.326 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum install -y kernel 2024-09-10T23:04:02.327 INFO:teuthology.orchestra.run.smithi171.stdout:5.14.0-503.el9.x86_64 2024-09-10T23:04:02.327 INFO:teuthology.task.kernel:Running kernel on smithi171: 5.14.0-503.el9.x86_64 2024-09-10T23:04:02.327 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum install -y kernel 2024-09-10T23:04:05.339 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-10T23:04:05.564 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.2 MB 00:01 2024-09-10T23:04:08.657 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 20 MB 00:02 2024-09-10T23:04:09.590 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 7.0 MB/s | 20 MB 00:02 2024-09-10T23:04:14.058 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-10T23:04:14.190 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.5 MB 00:00 2024-09-10T23:04:15.576 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-10T23:04:15.724 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 19 kB 00:00 2024-09-10T23:04:16.858 INFO:teuthology.orchestra.run.smithi090.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-10T23:04:16.895 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-10T23:04:22.262 INFO:teuthology.orchestra.run.smithi090.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-10T23:04:22.367 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-10T23:04:24.303 INFO:teuthology.orchestra.run.smithi090.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T23:04:24.304 INFO:teuthology.orchestra.run.smithi090.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T23:04:24.340 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T23:04:24.340 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T23:04:24.411 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2024-09-10T23:04:24.424 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-09-10T23:04:24.424 INFO:teuthology.orchestra.run.smithi090.stdout: Package Architecture Version Repository Size 2024-09-10T23:04:24.424 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-09-10T23:04:24.424 INFO:teuthology.orchestra.run.smithi090.stdout:Installing: 2024-09-10T23:04:24.425 INFO:teuthology.orchestra.run.smithi090.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T23:04:24.425 INFO:teuthology.orchestra.run.smithi090.stdout:Installing dependencies: 2024-09-10T23:04:24.425 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T23:04:24.425 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T23:04:24.425 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T23:04:24.425 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:04:24.425 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction Summary 2024-09-10T23:04:24.425 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-09-10T23:04:24.425 INFO:teuthology.orchestra.run.smithi090.stdout:Install 4 Packages 2024-09-10T23:04:24.425 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:04:24.426 INFO:teuthology.orchestra.run.smithi090.stdout:Total download size: 79 M 2024-09-10T23:04:24.426 INFO:teuthology.orchestra.run.smithi090.stdout:Installed size: 126 M 2024-09-10T23:04:24.426 INFO:teuthology.orchestra.run.smithi090.stdout:Downloading Packages: 2024-09-10T23:04:24.433 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-09-10T23:04:24.439 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-09-10T23:04:24.439 INFO:teuthology.orchestra.run.smithi171.stdout: Package Architecture Version Repository Size 2024-09-10T23:04:24.440 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-09-10T23:04:24.440 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-09-10T23:04:24.440 INFO:teuthology.orchestra.run.smithi171.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T23:04:24.440 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-09-10T23:04:24.440 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T23:04:24.440 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T23:04:24.440 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T23:04:24.440 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:04:24.440 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-09-10T23:04:24.440 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-09-10T23:04:24.440 INFO:teuthology.orchestra.run.smithi171.stdout:Install 4 Packages 2024-09-10T23:04:24.440 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:04:24.441 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 79 M 2024-09-10T23:04:24.441 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 126 M 2024-09-10T23:04:24.441 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-09-10T23:04:24.557 INFO:teuthology.orchestra.run.smithi090.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 290 kB/s | 23 kB 00:00 2024-09-10T23:04:24.560 INFO:teuthology.orchestra.run.smithi171.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 310 kB/s | 23 kB 00:00 2024-09-10T23:04:25.152 INFO:teuthology.orchestra.run.smithi171.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-10T23:04:26.132 INFO:teuthology.orchestra.run.smithi090.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 9.5 MB/s | 16 MB 00:01 2024-09-10T23:04:26.294 INFO:teuthology.orchestra.run.smithi171.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 19 MB/s | 35 MB 00:01 2024-09-10T23:04:26.508 INFO:teuthology.orchestra.run.smithi090.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-10T23:04:26.611 INFO:teuthology.orchestra.run.smithi171.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 14 MB/s | 29 MB 00:02 2024-09-10T23:04:26.611 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:04:26.611 INFO:teuthology.orchestra.run.smithi171.stdout:Total 36 MB/s | 79 MB 00:02 2024-09-10T23:04:27.175 INFO:teuthology.orchestra.run.smithi090.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 11 MB/s | 29 MB 00:02 2024-09-10T23:04:27.175 INFO:teuthology.orchestra.run.smithi090.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:04:27.175 INFO:teuthology.orchestra.run.smithi090.stdout:Total 29 MB/s | 79 MB 00:02 2024-09-10T23:04:27.291 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-09-10T23:04:27.641 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-09-10T23:04:27.641 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-09-10T23:04:27.855 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction check 2024-09-10T23:04:28.228 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction check succeeded. 2024-09-10T23:04:28.228 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction test 2024-09-10T23:04:28.600 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-09-10T23:04:28.600 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-09-10T23:04:29.263 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction test succeeded. 2024-09-10T23:04:29.264 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction 2024-09-10T23:04:31.044 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-09-10T23:04:31.686 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T23:04:31.779 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:04:31.829 INFO:teuthology.orchestra.run.smithi090.stdout: Preparing : 1/1 2024-09-10T23:04:32.589 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T23:04:32.672 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:04:34.568 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:04:34.697 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:04:35.441 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:04:35.584 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:04:39.521 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:04:39.564 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:04:40.405 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:04:40.453 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:04:44.425 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:04:45.290 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:05:22.626 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:05:22.676 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:05:23.027 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:05:23.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T23:05:23.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:05:23.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:05:23.908 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:05:23.908 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:05:23.908 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-09-10T23:05:23.908 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T23:05:23.908 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T23:05:23.909 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T23:05:23.909 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T23:05:23.909 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:05:23.909 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-09-10T23:05:24.247 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T23:05:24.327 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T23:05:24.327 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T23:05:24.327 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T23:05:24.327 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T23:05:24.327 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T23:05:24.328 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-10T23:05:24.328 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi171.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T23:05:24.328 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T23:05:24.386 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T23:05:24.386 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T23:05:24.386 DEBUG:teuthology.orchestra.run.smithi171:> sudo rpm -qi grub2-tools 2024-09-10T23:05:24.418 INFO:teuthology.orchestra.run.smithi171.stdout:Name : grub2-tools 2024-09-10T23:05:24.418 INFO:teuthology.orchestra.run.smithi171.stdout:Epoch : 1 2024-09-10T23:05:24.419 INFO:teuthology.orchestra.run.smithi171.stdout:Version : 2.06 2024-09-10T23:05:24.419 INFO:teuthology.orchestra.run.smithi171.stdout:Release : 82.el9 2024-09-10T23:05:24.419 INFO:teuthology.orchestra.run.smithi171.stdout:Architecture: x86_64 2024-09-10T23:05:24.419 INFO:teuthology.orchestra.run.smithi171.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T23:05:24.419 INFO:teuthology.orchestra.run.smithi171.stdout:Group : Unspecified 2024-09-10T23:05:24.419 INFO:teuthology.orchestra.run.smithi171.stdout:Size : 8274670 2024-09-10T23:05:24.419 INFO:teuthology.orchestra.run.smithi171.stdout:License : GPLv3+ 2024-09-10T23:05:24.419 INFO:teuthology.orchestra.run.smithi171.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T23:05:24.419 INFO:teuthology.orchestra.run.smithi171.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T23:05:24.419 INFO:teuthology.orchestra.run.smithi171.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T23:05:24.419 INFO:teuthology.orchestra.run.smithi171.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T23:05:24.419 INFO:teuthology.orchestra.run.smithi171.stdout:Packager : builder@centos.org 2024-09-10T23:05:24.419 INFO:teuthology.orchestra.run.smithi171.stdout:Vendor : CentOS 2024-09-10T23:05:24.420 INFO:teuthology.orchestra.run.smithi171.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T23:05:24.420 INFO:teuthology.orchestra.run.smithi171.stdout:Summary : Support tools for GRUB. 2024-09-10T23:05:24.420 INFO:teuthology.orchestra.run.smithi171.stdout:Description : 2024-09-10T23:05:24.420 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:05:24.420 INFO:teuthology.orchestra.run.smithi171.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T23:05:24.420 INFO:teuthology.orchestra.run.smithi171.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T23:05:24.420 INFO:teuthology.orchestra.run.smithi171.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T23:05:24.420 INFO:teuthology.orchestra.run.smithi171.stdout:hardware devices. 2024-09-10T23:05:24.420 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:05:24.420 INFO:teuthology.orchestra.run.smithi171.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T23:05:24.421 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T23:05:24.421 INFO:teuthology.task.kernel:Updating grub on smithi171 to boot 5.14.0-505.el9.x86_64 2024-09-10T23:05:24.421 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T23:05:25.041 INFO:teuthology.orchestra.run.smithi171.stderr:Generating grub configuration file ... 2024-09-10T23:05:25.149 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:05:25.188 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:05:25.511 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:05:25.511 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T23:05:25.511 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:05:25.511 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:05:26.440 INFO:teuthology.orchestra.run.smithi171.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T23:05:26.469 INFO:teuthology.orchestra.run.smithi171.stderr:done 2024-09-10T23:05:26.471 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-09-10T23:05:26.473 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:05:26.473 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:05:26.473 INFO:teuthology.orchestra.run.smithi090.stdout:Installed: 2024-09-10T23:05:26.473 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T23:05:26.473 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T23:05:26.473 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T23:05:26.473 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T23:05:26.473 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:05:26.473 INFO:teuthology.orchestra.run.smithi090.stdout:Complete! 2024-09-10T23:05:26.486 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.nUw4LdmSCJ 2024-09-10T23:05:26.487 DEBUG:teuthology.orchestra.run.smithi171:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nUw4LdmSCJ 2024-09-10T23:05:26.560 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.nUw4LdmSCJ 2024-09-10T23:05:26.698 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.nUw4LdmSCJ is 6KB 2024-09-10T23:05:26.746 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.nUw4LdmSCJ 2024-09-10T23:05:26.761 DEBUG:teuthology.orchestra.run.smithi171:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T23:05:26.824 DEBUG:teuthology.orchestra.run.smithi090:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T23:05:26.825 INFO:teuthology.orchestra.run.smithi171.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T23:05:26.825 INFO:teuthology.orchestra.run.smithi171.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T23:05:26.825 INFO:teuthology.orchestra.run.smithi171.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T23:05:26.825 INFO:teuthology.orchestra.run.smithi171.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T23:05:26.826 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T23:05:26.933 INFO:teuthology.orchestra.run.smithi090.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T23:05:26.934 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T23:05:26.934 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T23:05:26.934 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T23:05:26.934 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T23:05:26.934 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-10T23:05:26.934 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi090.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T23:05:26.935 DEBUG:teuthology.orchestra.run.smithi090:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T23:05:26.978 DEBUG:teuthology.orchestra.run.smithi171:> sudo shutdown -r now 2024-09-10T23:05:26.993 INFO:teuthology.orchestra.run.smithi090.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T23:05:26.993 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T23:05:26.993 DEBUG:teuthology.orchestra.run.smithi090:> sudo rpm -qi grub2-tools 2024-09-10T23:05:27.025 INFO:teuthology.orchestra.run.smithi090.stdout:Name : grub2-tools 2024-09-10T23:05:27.025 INFO:teuthology.orchestra.run.smithi090.stdout:Epoch : 1 2024-09-10T23:05:27.025 INFO:teuthology.orchestra.run.smithi090.stdout:Version : 2.06 2024-09-10T23:05:27.025 INFO:teuthology.orchestra.run.smithi090.stdout:Release : 82.el9 2024-09-10T23:05:27.025 INFO:teuthology.orchestra.run.smithi090.stdout:Architecture: x86_64 2024-09-10T23:05:27.025 INFO:teuthology.orchestra.run.smithi090.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T23:05:27.025 INFO:teuthology.orchestra.run.smithi090.stdout:Group : Unspecified 2024-09-10T23:05:27.025 INFO:teuthology.orchestra.run.smithi090.stdout:Size : 8274670 2024-09-10T23:05:27.025 INFO:teuthology.orchestra.run.smithi090.stdout:License : GPLv3+ 2024-09-10T23:05:27.025 INFO:teuthology.orchestra.run.smithi090.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T23:05:27.025 INFO:teuthology.orchestra.run.smithi090.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T23:05:27.025 INFO:teuthology.orchestra.run.smithi090.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T23:05:27.026 INFO:teuthology.orchestra.run.smithi090.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T23:05:27.026 INFO:teuthology.orchestra.run.smithi090.stdout:Packager : builder@centos.org 2024-09-10T23:05:27.026 INFO:teuthology.orchestra.run.smithi090.stdout:Vendor : CentOS 2024-09-10T23:05:27.026 INFO:teuthology.orchestra.run.smithi090.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T23:05:27.026 INFO:teuthology.orchestra.run.smithi090.stdout:Summary : Support tools for GRUB. 2024-09-10T23:05:27.026 INFO:teuthology.orchestra.run.smithi090.stdout:Description : 2024-09-10T23:05:27.026 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:05:27.026 INFO:teuthology.orchestra.run.smithi090.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T23:05:27.026 INFO:teuthology.orchestra.run.smithi090.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T23:05:27.026 INFO:teuthology.orchestra.run.smithi090.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T23:05:27.026 INFO:teuthology.orchestra.run.smithi090.stdout:hardware devices. 2024-09-10T23:05:27.026 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:05:27.026 INFO:teuthology.orchestra.run.smithi090.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T23:05:27.027 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T23:05:27.027 INFO:teuthology.task.kernel:Updating grub on smithi090 to boot 5.14.0-505.el9.x86_64 2024-09-10T23:05:27.027 DEBUG:teuthology.orchestra.run.smithi090:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T23:05:27.664 INFO:teuthology.orchestra.run.smithi090.stderr:Generating grub configuration file ... 2024-09-10T23:05:29.388 INFO:teuthology.orchestra.run.smithi090.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T23:05:29.414 INFO:teuthology.orchestra.run.smithi090.stderr:done 2024-09-10T23:05:29.417 DEBUG:teuthology.orchestra.run.smithi090:> mktemp 2024-09-10T23:05:29.440 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.V3m8WADrKB 2024-09-10T23:05:29.440 DEBUG:teuthology.orchestra.run.smithi090:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.V3m8WADrKB 2024-09-10T23:05:29.508 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0666 /tmp/tmp.V3m8WADrKB 2024-09-10T23:05:29.652 DEBUG:teuthology.orchestra.remote:smithi090:/tmp/tmp.V3m8WADrKB is 6KB 2024-09-10T23:05:29.700 DEBUG:teuthology.orchestra.run.smithi090:> rm -fr /tmp/tmp.V3m8WADrKB 2024-09-10T23:05:29.714 DEBUG:teuthology.orchestra.run.smithi090:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T23:05:29.786 INFO:teuthology.orchestra.run.smithi090.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T23:05:29.786 INFO:teuthology.orchestra.run.smithi090.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T23:05:29.786 INFO:teuthology.orchestra.run.smithi090.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T23:05:29.786 INFO:teuthology.orchestra.run.smithi090.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T23:05:29.787 DEBUG:teuthology.orchestra.run.smithi090:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T23:05:29.946 DEBUG:teuthology.orchestra.run.smithi090:> sudo shutdown -r now 2024-09-10T23:05:56.993 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-10T23:05:56.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-10T23:05:56.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:05:59.949 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T23:05:59.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-10T23:05:59.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:06:15.485 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-09-10T23:06:18.301 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-10T23:06:24.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-10T23:06:24.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:06:27.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-10T23:06:27.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:06:27.581 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-09-10T23:06:30.365 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-10T23:06:39.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-10T23:06:39.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:06:42.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-10T23:06:42.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:06:45.565 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-10T23:06:57.981 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-09-10T23:07:00.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-10T23:07:00.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:07:12.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-10T23:07:12.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:07:13.390 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-09-10T23:07:13.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-10T23:07:13.824 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-505.el9.x86_64"... 2024-09-10T23:07:13.824 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-09-10T23:07:13.839 INFO:teuthology.orchestra.run.smithi171.stdout:5.14.0-505.el9.x86_64 2024-09-10T23:07:13.839 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T23:07:13.839 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T23:07:13.839 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T23:07:14.840 DEBUG:teuthology.parallel:result is None 2024-09-10T23:07:32.634 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-09-10T23:07:33.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-10T23:07:33.091 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-10T23:07:33.091 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2024-09-10T23:07:33.105 INFO:teuthology.orchestra.run.smithi090.stdout:5.14.0-505.el9.x86_64 2024-09-10T23:07:33.105 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T23:07:33.105 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T23:07:33.106 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T23:07:34.106 DEBUG:teuthology.parallel:result is None 2024-09-10T23:07:34.106 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T23:07:34.115 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T23:07:34.115 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:07:34.118 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:07:34.139 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T23:07:34.145 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T23:07:34.152 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T23:07:34.152 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:07:34.176 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:07:34.256 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T23:07:34.262 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T23:07:34.262 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:07:34.265 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:07:34.357 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:07:34.387 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:07:34.463 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:07:34.478 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:07:34.479 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T23:07:34.486 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T23:07:34.486 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:07:34.488 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:07:34.517 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T23:07:34.529 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T23:07:34.529 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:07:34.553 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:07:34.574 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:07:34.656 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:07:34.706 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:07:34.794 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:07:34.827 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:07:34.827 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:07:34.892 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:07:34.947 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:07:34.997 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:07:35.090 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:07:35.127 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:07:35.127 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:07:35.198 DEBUG:teuthology.orchestra.run.smithi090:> sudo service rsyslog restart 2024-09-10T23:07:35.200 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2024-09-10T23:07:35.250 INFO:teuthology.orchestra.run.smithi090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:07:35.288 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:07:35.718 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T23:07:35.727 INFO:teuthology.task.internal:Starting timer... 2024-09-10T23:07:35.727 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T23:07:35.737 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T23:07:35.746 DEBUG:teuthology.orchestra.run.smithi090:> sudo service auditd rotate 2024-09-10T23:07:35.856 INFO:teuthology.orchestra.run.smithi090.stdout:Rotating logs: 2024-09-10T23:07:35.858 DEBUG:teuthology.orchestra.run.smithi171:> sudo service auditd rotate 2024-09-10T23:07:35.916 INFO:teuthology.orchestra.run.smithi171.stdout:Rotating logs: 2024-09-10T23:07:35.918 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T23:07:35.918 DEBUG:teuthology.orchestra.run.smithi090:> /usr/sbin/getenforce 2024-09-10T23:07:35.945 INFO:teuthology.orchestra.run.smithi090.stdout:Permissive 2024-09-10T23:07:35.945 DEBUG:teuthology.orchestra.run.smithi171:> /usr/sbin/getenforce 2024-09-10T23:07:35.971 INFO:teuthology.orchestra.run.smithi171.stdout:Permissive 2024-09-10T23:07:35.971 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi090.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi171.front.sepia.ceph.com': 'permissive'} 2024-09-10T23:07:35.971 DEBUG:teuthology.orchestra.run.smithi090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T23:07:36.011 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:07:36.012 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T23:07:36.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:07:36.040 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T23:07:36.040 DEBUG:teuthology.orchestra.run.smithi090:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:07:36.101 DEBUG:teuthology.orchestra.run.smithi171:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:07:36.136 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T23:07:36.146 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T23:07:36.157 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T23:07:36.158 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi090.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T23:11:21.774 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi090.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2024-09-10T23:11:21.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-10T23:11:21.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:11:21.863 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-09-10T23:11:21.940 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-10T23:11:21.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-10T23:11:21.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:11:22.061 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-09-10T23:11:22.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-10T23:11:22.140 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T23:11:22.150 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T23:11:22.150 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:11:22.151 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:11:22.153 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:11:22.153 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:11:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:11:22.194 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:11:22.208 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:11:22.218 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: ntpd: command not found 2024-09-10T23:11:22.222 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:11:22.229 INFO:teuthology.orchestra.run.smithi090.stdout:506 Cannot talk to daemon 2024-09-10T23:11:22.243 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:11:22.248 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: ntpd: command not found 2024-09-10T23:11:22.256 INFO:teuthology.orchestra.run.smithi171.stdout:506 Cannot talk to daemon 2024-09-10T23:11:22.257 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:11:22.271 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:11:22.285 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:11:22.313 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:11:22.316 INFO:teuthology.orchestra.run.smithi090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:11:22.316 INFO:teuthology.orchestra.run.smithi090.stdout:=============================================================================== 2024-09-10T23:11:22.316 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:22.317 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:22.317 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:22.317 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:22.342 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:11:22.345 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:11:22.345 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-09-10T23:11:22.346 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:22.346 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:22.346 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:22.346 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:11:22.347 INFO:teuthology.run_tasks:Running task install... 2024-09-10T23:11:22.355 DEBUG:teuthology.task.install:project ceph 2024-09-10T23:11:22.355 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T23:11:22.355 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T23:11:22.355 INFO:teuthology.task.install:Using flavor: default 2024-09-10T23:11:22.361 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T23:11:22.361 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T23:11:22.361 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T23:11:22.362 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:11:22.364 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T23:11:22.364 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:11:22.521 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T23:11:22.521 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T23:11:22.522 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T23:11:22.523 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T23:11:22.715 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:11:22.715 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:11:22.715 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:11:22.741 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T23:11:22.742 DEBUG:teuthology.orchestra.run.smithi090:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:11:22.758 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:11:22.758 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:11:22.758 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:11:22.784 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T23:11:22.784 DEBUG:teuthology.orchestra.run.smithi171:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:11:22.808 DEBUG:teuthology.orchestra.run.smithi090:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:11:22.849 DEBUG:teuthology.orchestra.run.smithi171:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:11:22.884 DEBUG:teuthology.orchestra.run.smithi090:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:11:22.925 DEBUG:teuthology.orchestra.run.smithi171:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:11:22.949 INFO:teuthology.orchestra.run.smithi090.stdout:check_obsoletes = 1 2024-09-10T23:11:22.950 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum clean all 2024-09-10T23:11:22.988 INFO:teuthology.orchestra.run.smithi171.stdout:check_obsoletes = 1 2024-09-10T23:11:22.990 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum clean all 2024-09-10T23:11:23.179 INFO:teuthology.orchestra.run.smithi090.stdout:45 files removed 2024-09-10T23:11:23.206 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T23:11:23.218 INFO:teuthology.orchestra.run.smithi171.stdout:45 files removed 2024-09-10T23:11:23.245 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T23:11:23.937 INFO:teuthology.orchestra.run.smithi090.stdout:ceph packages for x86_64 189 kB/s | 84 kB 00:00 2024-09-10T23:11:24.010 INFO:teuthology.orchestra.run.smithi171.stdout:ceph packages for x86_64 177 kB/s | 84 kB 00:00 2024-09-10T23:11:24.370 INFO:teuthology.orchestra.run.smithi090.stdout:ceph noarch packages 62 kB/s | 24 kB 00:00 2024-09-10T23:11:24.427 INFO:teuthology.orchestra.run.smithi171.stdout:ceph noarch packages 64 kB/s | 24 kB 00:00 2024-09-10T23:11:24.646 INFO:teuthology.orchestra.run.smithi090.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-10T23:11:24.703 INFO:teuthology.orchestra.run.smithi171.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-10T23:11:25.189 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-09-10T23:11:26.448 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-10T23:11:27.129 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-10T23:11:28.375 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-10T23:11:31.966 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 6.4 MB/s | 6.5 MB 00:01 2024-09-10T23:11:32.752 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-10T23:11:33.426 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 85 kB/s | 19 kB 00:00 2024-09-10T23:11:34.411 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-10T23:11:34.880 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-10T23:11:35.759 INFO:teuthology.orchestra.run.smithi090.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-10T23:11:40.337 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-10T23:11:41.182 INFO:teuthology.orchestra.run.smithi090.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-10T23:11:42.740 INFO:teuthology.orchestra.run.smithi171.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:11:42.740 INFO:teuthology.orchestra.run.smithi171.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:11:42.751 INFO:teuthology.orchestra.run.smithi171.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T23:11:42.752 INFO:teuthology.orchestra.run.smithi171.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T23:11:42.753 INFO:teuthology.orchestra.run.smithi171.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T23:11:42.754 INFO:teuthology.orchestra.run.smithi171.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T23:11:42.756 INFO:teuthology.orchestra.run.smithi171.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T23:11:42.758 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T23:11:42.759 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T23:11:42.824 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-09-10T23:11:42.834 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-09-10T23:11:42.834 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-09-10T23:11:42.834 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-09-10T23:11:42.835 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-09-10T23:11:42.835 INFO:teuthology.orchestra.run.smithi171.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T23:11:42.835 INFO:teuthology.orchestra.run.smithi171.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T23:11:42.835 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:11:42.835 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T23:11:42.835 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T23:11:42.835 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T23:11:42.835 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T23:11:42.835 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T23:11:42.835 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T23:11:42.835 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T23:11:42.835 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T23:11:42.836 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T23:11:42.836 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T23:11:42.836 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T23:11:42.836 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T23:11:42.836 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T23:11:42.836 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T23:11:42.836 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T23:11:42.836 INFO:teuthology.orchestra.run.smithi171.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T23:11:42.836 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T23:11:42.836 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T23:11:42.836 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T23:11:42.837 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T23:11:42.837 INFO:teuthology.orchestra.run.smithi171.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T23:11:42.837 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T23:11:42.837 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T23:11:42.837 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T23:11:42.837 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T23:11:42.837 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T23:11:42.837 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T23:11:42.837 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T23:11:42.837 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T23:11:42.837 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T23:11:42.837 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T23:11:42.838 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:11:42.838 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T23:11:42.838 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T23:11:42.838 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading: 2024-09-10T23:11:42.838 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T23:11:42.838 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T23:11:42.838 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T23:11:42.838 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T23:11:42.838 INFO:teuthology.orchestra.run.smithi171.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T23:11:42.838 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:11:42.838 INFO:teuthology.orchestra.run.smithi171.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T23:11:42.838 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T23:11:42.839 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-09-10T23:11:42.839 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T23:11:42.839 INFO:teuthology.orchestra.run.smithi171.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T23:11:42.839 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:11:42.839 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T23:11:42.839 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T23:11:42.839 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T23:11:42.839 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T23:11:42.839 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T23:11:42.839 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T23:11:42.839 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T23:11:42.839 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T23:11:42.839 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:11:42.840 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:11:42.840 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:11:42.840 INFO:teuthology.orchestra.run.smithi171.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:11:42.840 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:11:42.840 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T23:11:42.840 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:11:42.840 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:11:42.840 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T23:11:42.840 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:11:42.840 INFO:teuthology.orchestra.run.smithi171.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T23:11:42.840 INFO:teuthology.orchestra.run.smithi171.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:11:42.840 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:11:42.840 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:11:42.841 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:11:42.841 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T23:11:42.841 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:11:42.841 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:11:42.841 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:11:42.841 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T23:11:42.841 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:11:42.841 INFO:teuthology.orchestra.run.smithi171.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T23:11:42.841 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T23:11:42.841 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T23:11:42.841 INFO:teuthology.orchestra.run.smithi171.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:11:42.841 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:11:42.841 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:11:42.842 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T23:11:42.842 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T23:11:42.842 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T23:11:42.842 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:11:42.842 INFO:teuthology.orchestra.run.smithi171.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T23:11:42.842 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:11:42.842 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:11:42.842 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:11:42.842 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T23:11:42.842 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T23:11:42.842 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:11:42.842 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:11:42.842 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:11:42.843 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:11:42.843 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T23:11:42.843 INFO:teuthology.orchestra.run.smithi171.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T23:11:42.843 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:11:42.843 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:11:42.843 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:11:42.843 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T23:11:42.843 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T23:11:42.843 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:11:42.843 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:11:42.843 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:11:42.843 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:11:42.843 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:11:42.844 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:11:42.844 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:11:42.844 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:11:42.844 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:11:42.844 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:11:42.844 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:11:42.844 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:11:42.844 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:11:42.844 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:11:42.844 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:11:42.844 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:11:42.844 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:11:42.844 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T23:11:42.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:11:42.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:11:42.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:11:42.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:11:42.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T23:11:42.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:11:42.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:11:42.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:11:42.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:11:42.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T23:11:42.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:11:42.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:11:42.845 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:11:42.846 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:11:42.846 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:11:42.846 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:11:42.846 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:11:42.846 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:11:42.846 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:11:42.846 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:11:42.846 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:11:42.846 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T23:11:42.846 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:11:42.846 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:11:42.846 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:11:42.846 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:11:42.846 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T23:11:42.846 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T23:11:42.846 INFO:teuthology.orchestra.run.smithi171.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:11:42.847 INFO:teuthology.orchestra.run.smithi171.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:11:42.847 INFO:teuthology.orchestra.run.smithi171.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:11:42.847 INFO:teuthology.orchestra.run.smithi171.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T23:11:42.847 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:11:42.847 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T23:11:42.847 INFO:teuthology.orchestra.run.smithi171.stdout:Installing weak dependencies: 2024-09-10T23:11:42.847 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T23:11:42.847 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:11:42.847 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-09-10T23:11:42.847 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-09-10T23:11:42.847 INFO:teuthology.orchestra.run.smithi171.stdout:Install 149 Packages 2024-09-10T23:11:42.847 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade 8 Packages 2024-09-10T23:11:42.847 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:11:42.848 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 240 M 2024-09-10T23:11:42.848 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-09-10T23:11:43.455 INFO:teuthology.orchestra.run.smithi171.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 45 kB/s | 6.6 kB 00:00 2024-09-10T23:11:43.576 INFO:teuthology.orchestra.run.smithi090.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:11:43.577 INFO:teuthology.orchestra.run.smithi090.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:11:43.589 INFO:teuthology.orchestra.run.smithi090.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T23:11:43.590 INFO:teuthology.orchestra.run.smithi090.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T23:11:43.590 INFO:teuthology.orchestra.run.smithi090.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T23:11:43.591 INFO:teuthology.orchestra.run.smithi090.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T23:11:43.593 INFO:teuthology.orchestra.run.smithi090.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T23:11:43.595 INFO:teuthology.orchestra.run.smithi090.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T23:11:43.596 INFO:teuthology.orchestra.run.smithi090.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T23:11:43.660 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2024-09-10T23:11:43.683 INFO:teuthology.orchestra.run.smithi090.stdout:======================================================================================= 2024-09-10T23:11:43.683 INFO:teuthology.orchestra.run.smithi090.stdout: Package Arch Version Repository Size 2024-09-10T23:11:43.683 INFO:teuthology.orchestra.run.smithi090.stdout:======================================================================================= 2024-09-10T23:11:43.683 INFO:teuthology.orchestra.run.smithi090.stdout:Installing: 2024-09-10T23:11:43.683 INFO:teuthology.orchestra.run.smithi090.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T23:11:43.683 INFO:teuthology.orchestra.run.smithi090.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T23:11:43.684 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:11:43.684 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T23:11:43.684 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T23:11:43.684 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T23:11:43.684 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T23:11:43.684 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T23:11:43.684 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T23:11:43.684 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T23:11:43.684 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T23:11:43.684 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T23:11:43.684 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T23:11:43.684 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T23:11:43.684 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T23:11:43.685 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T23:11:43.685 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T23:11:43.685 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T23:11:43.685 INFO:teuthology.orchestra.run.smithi090.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T23:11:43.685 INFO:teuthology.orchestra.run.smithi090.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T23:11:43.685 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T23:11:43.685 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T23:11:43.685 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T23:11:43.685 INFO:teuthology.orchestra.run.smithi090.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T23:11:43.685 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T23:11:43.685 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T23:11:43.685 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T23:11:43.685 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T23:11:43.686 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T23:11:43.686 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T23:11:43.686 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T23:11:43.686 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T23:11:43.686 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T23:11:43.686 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T23:11:43.686 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:11:43.686 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T23:11:43.686 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T23:11:43.686 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrading: 2024-09-10T23:11:43.686 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T23:11:43.686 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T23:11:43.686 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T23:11:43.686 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T23:11:43.687 INFO:teuthology.orchestra.run.smithi090.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T23:11:43.687 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:11:43.687 INFO:teuthology.orchestra.run.smithi090.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T23:11:43.687 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T23:11:43.687 INFO:teuthology.orchestra.run.smithi090.stdout:Installing dependencies: 2024-09-10T23:11:43.687 INFO:teuthology.orchestra.run.smithi090.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T23:11:43.687 INFO:teuthology.orchestra.run.smithi090.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T23:11:43.687 INFO:teuthology.orchestra.run.smithi090.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:11:43.687 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T23:11:43.687 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T23:11:43.687 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T23:11:43.687 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T23:11:43.687 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T23:11:43.687 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T23:11:43.687 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T23:11:43.688 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T23:11:43.688 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:11:43.688 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:11:43.688 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:11:43.688 INFO:teuthology.orchestra.run.smithi090.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:11:43.688 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:11:43.688 INFO:teuthology.orchestra.run.smithi090.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T23:11:43.688 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:11:43.688 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:11:43.688 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T23:11:43.688 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:11:43.688 INFO:teuthology.orchestra.run.smithi090.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T23:11:43.688 INFO:teuthology.orchestra.run.smithi090.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:11:43.689 INFO:teuthology.orchestra.run.smithi090.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:11:43.689 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:11:43.689 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:11:43.689 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T23:11:43.689 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:11:43.689 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:11:43.689 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:11:43.689 INFO:teuthology.orchestra.run.smithi090.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T23:11:43.689 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:11:43.689 INFO:teuthology.orchestra.run.smithi090.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T23:11:43.689 INFO:teuthology.orchestra.run.smithi090.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T23:11:43.689 INFO:teuthology.orchestra.run.smithi090.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T23:11:43.689 INFO:teuthology.orchestra.run.smithi090.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:11:43.690 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:11:43.690 INFO:teuthology.orchestra.run.smithi090.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:11:43.690 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T23:11:43.690 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T23:11:43.690 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T23:11:43.690 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:11:43.690 INFO:teuthology.orchestra.run.smithi090.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T23:11:43.690 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:11:43.690 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:11:43.690 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:11:43.690 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T23:11:43.690 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T23:11:43.690 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:11:43.691 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:11:43.691 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:11:43.691 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:11:43.691 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T23:11:43.691 INFO:teuthology.orchestra.run.smithi090.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T23:11:43.691 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:11:43.691 INFO:teuthology.orchestra.run.smithi090.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:11:43.691 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:11:43.691 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T23:11:43.691 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T23:11:43.691 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:11:43.691 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:11:43.691 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:11:43.691 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:11:43.692 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:11:43.692 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:11:43.692 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:11:43.692 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:11:43.692 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:11:43.692 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:11:43.692 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:11:43.692 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:11:43.692 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:11:43.692 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:11:43.692 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:11:43.692 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:11:43.692 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:11:43.693 INFO:teuthology.orchestra.run.smithi090.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T23:11:43.693 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:11:43.693 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:11:43.693 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:11:43.693 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:11:43.693 INFO:teuthology.orchestra.run.smithi090.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T23:11:43.693 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:11:43.693 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:11:43.693 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:11:43.693 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:11:43.693 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T23:11:43.693 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:11:43.693 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:11:43.693 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:11:43.694 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:11:43.694 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:11:43.694 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:11:43.694 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:11:43.694 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:11:43.694 INFO:teuthology.orchestra.run.smithi090.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:11:43.694 INFO:teuthology.orchestra.run.smithi090.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:11:43.694 INFO:teuthology.orchestra.run.smithi090.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:11:43.694 INFO:teuthology.orchestra.run.smithi090.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T23:11:43.694 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:11:43.694 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:11:43.694 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:11:43.694 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:11:43.694 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T23:11:43.695 INFO:teuthology.orchestra.run.smithi090.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T23:11:43.695 INFO:teuthology.orchestra.run.smithi090.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:11:43.695 INFO:teuthology.orchestra.run.smithi090.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:11:43.695 INFO:teuthology.orchestra.run.smithi090.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:11:43.695 INFO:teuthology.orchestra.run.smithi090.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T23:11:43.695 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:11:43.695 INFO:teuthology.orchestra.run.smithi090.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T23:11:43.695 INFO:teuthology.orchestra.run.smithi090.stdout:Installing weak dependencies: 2024-09-10T23:11:43.695 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T23:11:43.695 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:11:43.695 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction Summary 2024-09-10T23:11:43.695 INFO:teuthology.orchestra.run.smithi090.stdout:======================================================================================= 2024-09-10T23:11:43.695 INFO:teuthology.orchestra.run.smithi090.stdout:Install 149 Packages 2024-09-10T23:11:43.695 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrade 8 Packages 2024-09-10T23:11:43.696 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:11:43.696 INFO:teuthology.orchestra.run.smithi090.stdout:Total download size: 240 M 2024-09-10T23:11:43.696 INFO:teuthology.orchestra.run.smithi090.stdout:Downloading Packages: 2024-09-10T23:11:43.697 INFO:teuthology.orchestra.run.smithi171.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 3.6 MB/s | 900 kB 00:00 2024-09-10T23:11:43.797 INFO:teuthology.orchestra.run.smithi171.stdout:(3/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-10T23:11:43.822 INFO:teuthology.orchestra.run.smithi171.stdout:(4/157): ceph-immutable-object-cache-19.3.0-485 1.1 MB/s | 145 kB 00:00 2024-09-10T23:11:43.915 INFO:teuthology.orchestra.run.smithi171.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 20 MB/s | 2.4 MB 00:00 2024-09-10T23:11:44.048 INFO:teuthology.orchestra.run.smithi171.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 6.8 MB/s | 1.5 MB 00:00 2024-09-10T23:11:44.174 INFO:teuthology.orchestra.run.smithi171.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 19 MB/s | 4.8 MB 00:00 2024-09-10T23:11:44.242 INFO:teuthology.orchestra.run.smithi090.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 29 kB/s | 6.6 kB 00:00 2024-09-10T23:11:44.449 INFO:teuthology.orchestra.run.smithi171.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 19 MB/s | 22 MB 00:01 2024-09-10T23:11:44.459 INFO:teuthology.orchestra.run.smithi090.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 4.1 MB/s | 900 kB 00:00 2024-09-10T23:11:44.499 INFO:teuthology.orchestra.run.smithi171.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 505 kB/s | 25 kB 00:00 2024-09-10T23:11:44.543 INFO:teuthology.orchestra.run.smithi090.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.7 MB/s | 145 kB 00:00 2024-09-10T23:11:44.643 INFO:teuthology.orchestra.run.smithi090.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 8.8 MB/s | 5.5 MB 00:00 2024-09-10T23:11:44.852 INFO:teuthology.orchestra.run.smithi090.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 7.7 MB/s | 2.4 MB 00:00 2024-09-10T23:11:44.900 INFO:teuthology.orchestra.run.smithi171.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 15 MB/s | 11 MB 00:00 2024-09-10T23:11:44.966 INFO:teuthology.orchestra.run.smithi171.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 3.3 MB/s | 225 kB 00:00 2024-09-10T23:11:45.058 INFO:teuthology.orchestra.run.smithi171.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 295 kB/s | 27 kB 00:00 2024-09-10T23:11:45.142 INFO:teuthology.orchestra.run.smithi171.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 380 kB/s | 32 kB 00:00 2024-09-10T23:11:45.292 INFO:teuthology.orchestra.run.smithi171.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 4.9 MB/s | 755 kB 00:00 2024-09-10T23:11:45.319 INFO:teuthology.orchestra.run.smithi090.stdout:(6/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 10 MB/s | 4.8 MB 00:00 2024-09-10T23:11:45.368 INFO:teuthology.orchestra.run.smithi171.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.1 MB/s | 162 kB 00:00 2024-09-10T23:11:45.460 INFO:teuthology.orchestra.run.smithi171.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 1.4 MB/s | 127 kB 00:00 2024-09-10T23:11:45.560 INFO:teuthology.orchestra.run.smithi171.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 5.0 MB/s | 507 kB 00:00 2024-09-10T23:11:45.927 INFO:teuthology.orchestra.run.smithi171.stdout:(18/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 9.1 MB/s | 17 MB 00:01 2024-09-10T23:11:46.028 INFO:teuthology.orchestra.run.smithi171.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 451 kB/s | 45 kB 00:00 2024-09-10T23:11:46.095 INFO:teuthology.orchestra.run.smithi171.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 2.1 MB/s | 143 kB 00:00 2024-09-10T23:11:46.195 INFO:teuthology.orchestra.run.smithi171.stdout:(21/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 8.7 MB/s | 5.5 MB 00:00 2024-09-10T23:11:46.221 INFO:teuthology.orchestra.run.smithi171.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.3 MB/s | 161 kB 00:00 2024-09-10T23:11:46.263 INFO:teuthology.orchestra.run.smithi171.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 4.7 MB/s | 321 kB 00:00 2024-09-10T23:11:46.269 INFO:teuthology.orchestra.run.smithi090.stdout:(7/157): ceph-common-19.3.0-4854.g8f219c47.el9. 9.6 MB/s | 22 MB 00:02 2024-09-10T23:11:46.288 INFO:teuthology.orchestra.run.smithi171.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 4.5 MB/s | 306 kB 00:00 2024-09-10T23:11:46.311 INFO:teuthology.orchestra.run.smithi090.stdout:(8/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 937 kB/s | 1.5 MB 00:01 2024-09-10T23:11:46.330 INFO:teuthology.orchestra.run.smithi171.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.5 MB/s | 99 kB 00:00 2024-09-10T23:11:46.355 INFO:teuthology.orchestra.run.smithi171.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.2 MB/s | 85 kB 00:00 2024-09-10T23:11:46.456 INFO:teuthology.orchestra.run.smithi171.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 1.7 MB/s | 171 kB 00:00 2024-09-10T23:11:46.462 INFO:teuthology.orchestra.run.smithi090.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 167 kB/s | 25 kB 00:00 2024-09-10T23:11:46.588 INFO:teuthology.orchestra.run.smithi171.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 260 kB/s | 34 kB 00:00 2024-09-10T23:11:46.723 INFO:teuthology.orchestra.run.smithi171.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.1 MB/s | 154 kB 00:00 2024-09-10T23:11:46.782 INFO:teuthology.orchestra.run.smithi171.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 7.0 MB/s | 3.2 MB 00:00 2024-09-10T23:11:47.020 INFO:teuthology.orchestra.run.smithi090.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 15 MB/s | 11 MB 00:00 2024-09-10T23:11:47.229 INFO:teuthology.orchestra.run.smithi090.stdout:(11/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 9.0 MB/s | 17 MB 00:01 2024-09-10T23:11:47.262 INFO:teuthology.orchestra.run.smithi090.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 930 kB/s | 225 kB 00:00 2024-09-10T23:11:47.288 INFO:teuthology.orchestra.run.smithi090.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 463 kB/s | 27 kB 00:00 2024-09-10T23:11:47.313 INFO:teuthology.orchestra.run.smithi090.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 634 kB/s | 32 kB 00:00 2024-09-10T23:11:47.372 INFO:teuthology.orchestra.run.smithi090.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 8.8 MB/s | 755 kB 00:00 2024-09-10T23:11:47.397 INFO:teuthology.orchestra.run.smithi090.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 1.9 MB/s | 162 kB 00:00 2024-09-10T23:11:47.440 INFO:teuthology.orchestra.run.smithi090.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 2.9 MB/s | 127 kB 00:00 2024-09-10T23:11:47.474 INFO:teuthology.orchestra.run.smithi090.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 6.5 MB/s | 507 kB 00:00 2024-09-10T23:11:47.524 INFO:teuthology.orchestra.run.smithi090.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 903 kB/s | 45 kB 00:00 2024-09-10T23:11:47.557 INFO:teuthology.orchestra.run.smithi171.stdout:(31/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 16 MB/s | 50 MB 00:03 2024-09-10T23:11:47.575 INFO:teuthology.orchestra.run.smithi090.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 2.8 MB/s | 143 kB 00:00 2024-09-10T23:11:47.625 INFO:teuthology.orchestra.run.smithi090.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 3.2 MB/s | 161 kB 00:00 2024-09-10T23:11:47.632 INFO:teuthology.orchestra.run.smithi171.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 3.8 MB/s | 291 kB 00:00 2024-09-10T23:11:47.675 INFO:teuthology.orchestra.run.smithi090.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 6.3 MB/s | 321 kB 00:00 2024-09-10T23:11:47.691 INFO:teuthology.orchestra.run.smithi171.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 847 kB/s | 49 kB 00:00 2024-09-10T23:11:47.734 INFO:teuthology.orchestra.run.smithi090.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 5.1 MB/s | 306 kB 00:00 2024-09-10T23:11:47.800 INFO:teuthology.orchestra.run.smithi171.stdout:(34/157): ceph-mgr-diskprediction-local-19.3.0- 7.2 MB/s | 7.4 MB 00:01 2024-09-10T23:11:47.825 INFO:teuthology.orchestra.run.smithi171.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 123 kB/s | 16 kB 00:00 2024-09-10T23:11:47.850 INFO:teuthology.orchestra.run.smithi171.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 5.6 MB/s | 285 kB 00:00 2024-09-10T23:11:47.851 INFO:teuthology.orchestra.run.smithi090.stdout:(24/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 13 MB/s | 5.5 MB 00:00 2024-09-10T23:11:47.876 INFO:teuthology.orchestra.run.smithi090.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 700 kB/s | 99 kB 00:00 2024-09-10T23:11:47.901 INFO:teuthology.orchestra.run.smithi171.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 10 MB/s | 783 kB 00:00 2024-09-10T23:11:47.902 INFO:teuthology.orchestra.run.smithi090.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-10T23:11:47.927 INFO:teuthology.orchestra.run.smithi171.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 241 kB/s | 18 kB 00:00 2024-09-10T23:11:47.969 INFO:teuthology.orchestra.run.smithi090.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 2.5 MB/s | 171 kB 00:00 2024-09-10T23:11:48.019 INFO:teuthology.orchestra.run.smithi171.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 682 kB/s | 80 kB 00:00 2024-09-10T23:11:48.086 INFO:teuthology.orchestra.run.smithi171.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-10T23:11:48.091 INFO:teuthology.orchestra.run.smithi090.stdout:(28/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 15 MB/s | 3.2 MB 00:00 2024-09-10T23:11:48.111 INFO:teuthology.orchestra.run.smithi171.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-10T23:11:48.112 INFO:teuthology.orchestra.run.smithi090.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 241 kB/s | 34 kB 00:00 2024-09-10T23:11:48.145 INFO:teuthology.orchestra.run.smithi090.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.8 MB/s | 154 kB 00:00 2024-09-10T23:11:48.253 INFO:teuthology.orchestra.run.smithi171.stdout:(42/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 9.3 MB/s | 14 MB 00:01 2024-09-10T23:11:48.278 INFO:teuthology.orchestra.run.smithi171.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-10T23:11:48.321 INFO:teuthology.orchestra.run.smithi171.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 5.9 MB/s | 1.2 MB 00:00 2024-09-10T23:11:48.346 INFO:teuthology.orchestra.run.smithi171.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-10T23:11:48.371 INFO:teuthology.orchestra.run.smithi171.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-10T23:11:48.422 INFO:teuthology.orchestra.run.smithi171.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-10T23:11:48.447 INFO:teuthology.orchestra.run.smithi171.stdout:(48/157): python3-ply-3.11-14.el9.noarch.rpm 551 kB/s | 106 kB 00:00 2024-09-10T23:11:48.462 INFO:teuthology.orchestra.run.smithi090.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 23 MB/s | 7.4 MB 00:00 2024-09-10T23:11:48.480 INFO:teuthology.orchestra.run.smithi171.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 6.2 MB/s | 689 kB 00:00 2024-09-10T23:11:48.521 INFO:teuthology.orchestra.run.smithi090.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 4.9 MB/s | 291 kB 00:00 2024-09-10T23:11:48.539 INFO:teuthology.orchestra.run.smithi171.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-09-10T23:11:48.564 INFO:teuthology.orchestra.run.smithi171.stdout:(51/157): boost-program-options-1.75.0-8.el9.x8 913 kB/s | 107 kB 00:00 2024-09-10T23:11:48.571 INFO:teuthology.orchestra.run.smithi090.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 992 kB/s | 49 kB 00:00 2024-09-10T23:11:48.598 INFO:teuthology.orchestra.run.smithi171.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 5.2 MB/s | 943 kB 00:00 2024-09-10T23:11:48.613 INFO:teuthology.orchestra.run.smithi090.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 396 kB/s | 16 kB 00:00 2024-09-10T23:11:48.623 INFO:teuthology.orchestra.run.smithi171.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 555 kB/s | 33 kB 00:00 2024-09-10T23:11:48.657 INFO:teuthology.orchestra.run.smithi171.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-10T23:11:48.671 INFO:teuthology.orchestra.run.smithi090.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.8 MB/s | 285 kB 00:00 2024-09-10T23:11:48.683 INFO:teuthology.orchestra.run.smithi171.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-09-10T23:11:48.717 INFO:teuthology.orchestra.run.smithi171.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-10T23:11:48.747 INFO:teuthology.orchestra.run.smithi090.stdout:(36/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 10 MB/s | 783 kB 00:00 2024-09-10T23:11:48.750 INFO:teuthology.orchestra.run.smithi171.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-10T23:11:48.775 INFO:teuthology.orchestra.run.smithi171.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-10T23:11:48.797 INFO:teuthology.orchestra.run.smithi090.stdout:(37/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 364 kB/s | 18 kB 00:00 2024-09-10T23:11:48.801 INFO:teuthology.orchestra.run.smithi171.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-10T23:11:48.836 INFO:teuthology.orchestra.run.smithi171.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-10T23:11:48.877 INFO:teuthology.orchestra.run.smithi171.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-10T23:11:48.902 INFO:teuthology.orchestra.run.smithi171.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 365 kB/s | 24 kB 00:00 2024-09-10T23:11:48.927 INFO:teuthology.orchestra.run.smithi171.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-10T23:11:48.947 INFO:teuthology.orchestra.run.smithi090.stdout:(38/157): fuse-2.9.9-16.el9.x86_64.rpm 532 kB/s | 80 kB 00:00 2024-09-10T23:11:48.953 INFO:teuthology.orchestra.run.smithi171.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-10T23:11:48.970 INFO:teuthology.orchestra.run.smithi171.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-09-10T23:11:48.995 INFO:teuthology.orchestra.run.smithi171.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 916 kB/s | 38 kB 00:00 2024-09-10T23:11:49.045 INFO:teuthology.orchestra.run.smithi171.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.7 MB/s | 3.0 MB 00:00 2024-09-10T23:11:49.115 INFO:teuthology.orchestra.run.smithi090.stdout:(39/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 14 MB/s | 14 MB 00:01 2024-09-10T23:11:49.145 INFO:teuthology.orchestra.run.smithi171.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T23:11:49.213 INFO:teuthology.orchestra.run.smithi171.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 20 MB/s | 4.9 MB 00:00 2024-09-10T23:11:49.255 INFO:teuthology.orchestra.run.smithi171.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-10T23:11:49.280 INFO:teuthology.orchestra.run.smithi171.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-10T23:11:49.290 INFO:teuthology.orchestra.run.smithi090.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-10T23:11:49.341 INFO:teuthology.orchestra.run.smithi090.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 845 kB/s | 191 kB 00:00 2024-09-10T23:11:49.347 INFO:teuthology.orchestra.run.smithi171.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-10T23:11:49.389 INFO:teuthology.orchestra.run.smithi171.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-10T23:11:49.392 INFO:teuthology.orchestra.run.smithi090.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.4 MB/s | 253 kB 00:00 2024-09-10T23:11:49.414 INFO:teuthology.orchestra.run.smithi171.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-10T23:11:49.467 INFO:teuthology.orchestra.run.smithi090.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-10T23:11:49.482 INFO:teuthology.orchestra.run.smithi171.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 917 kB/s | 61 kB 00:00 2024-09-10T23:11:49.526 INFO:teuthology.orchestra.run.smithi090.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-10T23:11:49.565 INFO:teuthology.orchestra.run.smithi171.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-09-10T23:11:49.576 INFO:teuthology.orchestra.run.smithi090.stdout:(45/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-10T23:11:49.590 INFO:teuthology.orchestra.run.smithi171.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-10T23:11:49.616 INFO:teuthology.orchestra.run.smithi171.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-10T23:11:49.641 INFO:teuthology.orchestra.run.smithi171.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 508 kB/s | 26 kB 00:00 2024-09-10T23:11:49.666 INFO:teuthology.orchestra.run.smithi171.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-10T23:11:49.668 INFO:teuthology.orchestra.run.smithi090.stdout:(46/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-10T23:11:49.692 INFO:teuthology.orchestra.run.smithi171.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-10T23:11:49.710 INFO:teuthology.orchestra.run.smithi090.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 3.3 MB/s | 1.2 MB 00:00 2024-09-10T23:11:49.717 INFO:teuthology.orchestra.run.smithi171.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 690 kB/s | 35 kB 00:00 2024-09-10T23:11:49.801 INFO:teuthology.orchestra.run.smithi171.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-10T23:11:49.826 INFO:teuthology.orchestra.run.smithi171.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.2 MB/s | 250 kB 00:00 2024-09-10T23:11:49.910 INFO:teuthology.orchestra.run.smithi171.stdout:(85/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-09-10T23:11:49.936 INFO:teuthology.orchestra.run.smithi171.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 709 kB/s | 77 kB 00:00 2024-09-10T23:11:49.961 INFO:teuthology.orchestra.run.smithi171.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-10T23:11:49.986 INFO:teuthology.orchestra.run.smithi171.stdout:(88/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 222 kB 00:00 2024-09-10T23:11:50.003 INFO:teuthology.orchestra.run.smithi171.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.7 MB/s | 159 kB 00:00 2024-09-10T23:11:50.029 INFO:teuthology.orchestra.run.smithi171.stdout:(90/157): python3-protobuf-3.14.0-13.el9.noarch 2.8 MB/s | 269 kB 00:00 2024-09-10T23:11:50.054 INFO:teuthology.orchestra.run.smithi171.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.0 MB/s | 279 kB 00:00 2024-09-10T23:11:50.079 INFO:teuthology.orchestra.run.smithi171.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 674 kB/s | 51 kB 00:00 2024-09-10T23:11:50.105 INFO:teuthology.orchestra.run.smithi171.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 708 kB/s | 54 kB 00:00 2024-09-10T23:11:50.147 INFO:teuthology.orchestra.run.smithi171.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-10T23:11:50.172 INFO:teuthology.orchestra.run.smithi171.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 662 kB/s | 44 kB 00:00 2024-09-10T23:11:50.197 INFO:teuthology.orchestra.run.smithi171.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T23:11:50.222 INFO:teuthology.orchestra.run.smithi171.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 712 kB/s | 36 kB 00:00 2024-09-10T23:11:50.248 INFO:teuthology.orchestra.run.smithi171.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 939 kB/s | 47 kB 00:00 2024-09-10T23:11:50.282 INFO:teuthology.orchestra.run.smithi171.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-10T23:11:50.315 INFO:teuthology.orchestra.run.smithi171.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 863 kB/s | 58 kB 00:00 2024-09-10T23:11:50.341 INFO:teuthology.orchestra.run.smithi171.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-10T23:11:50.366 INFO:teuthology.orchestra.run.smithi171.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T23:11:50.391 INFO:teuthology.orchestra.run.smithi171.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-10T23:11:50.475 INFO:teuthology.orchestra.run.smithi171.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-10T23:11:50.542 INFO:teuthology.orchestra.run.smithi171.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-10T23:11:50.576 INFO:teuthology.orchestra.run.smithi171.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T23:11:50.602 INFO:teuthology.orchestra.run.smithi090.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 738 kB/s | 689 kB 00:00 2024-09-10T23:11:50.644 INFO:teuthology.orchestra.run.smithi090.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-10T23:11:50.727 INFO:teuthology.orchestra.run.smithi171.stdout:(107/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-10T23:11:50.752 INFO:teuthology.orchestra.run.smithi171.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 110 kB/s | 19 kB 00:00 2024-09-10T23:11:50.794 INFO:teuthology.orchestra.run.smithi171.stdout:(109/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-09-10T23:11:50.819 INFO:teuthology.orchestra.run.smithi171.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 432 kB/s | 26 kB 00:00 2024-09-10T23:11:50.853 INFO:teuthology.orchestra.run.smithi171.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2024-09-10T23:11:50.887 INFO:teuthology.orchestra.run.smithi171.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.7 MB/s | 151 kB 00:00 2024-09-10T23:11:50.912 INFO:teuthology.orchestra.run.smithi171.stdout:(113/157): liboath-2.6.7-2.el9.x86_64.rpm 419 kB/s | 49 kB 00:00 2024-09-10T23:11:50.962 INFO:teuthology.orchestra.run.smithi171.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-10T23:11:50.987 INFO:teuthology.orchestra.run.smithi171.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T23:11:51.013 INFO:teuthology.orchestra.run.smithi171.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.2 MB/s | 32 kB 00:00 2024-09-10T23:11:51.038 INFO:teuthology.orchestra.run.smithi171.stdout:(117/157): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-10T23:11:51.063 INFO:teuthology.orchestra.run.smithi171.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-10T23:11:51.089 INFO:teuthology.orchestra.run.smithi171.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-10T23:11:51.123 INFO:teuthology.orchestra.run.smithi171.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.9 MB/s | 358 kB 00:00 2024-09-10T23:11:51.156 INFO:teuthology.orchestra.run.smithi171.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-10T23:11:51.182 INFO:teuthology.orchestra.run.smithi171.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T23:11:51.207 INFO:teuthology.orchestra.run.smithi171.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-10T23:11:51.236 INFO:teuthology.orchestra.run.smithi090.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 37 kB/s | 22 kB 00:00 2024-09-10T23:11:51.270 INFO:teuthology.orchestra.run.smithi090.stdout:(51/157): boost-program-options-1.75.0-8.el9.x8 160 kB/s | 107 kB 00:00 2024-09-10T23:11:51.274 INFO:teuthology.orchestra.run.smithi171.stdout:(124/157): libarrow-9.0.0-11.el9.x86_64.rpm 8.1 MB/s | 4.4 MB 00:00 2024-09-10T23:11:51.299 INFO:teuthology.orchestra.run.smithi171.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-09-10T23:11:51.325 INFO:teuthology.orchestra.run.smithi171.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-10T23:11:51.350 INFO:teuthology.orchestra.run.smithi171.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-09-10T23:11:51.367 INFO:teuthology.orchestra.run.smithi171.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 463 kB/s | 19 kB 00:00 2024-09-10T23:11:51.384 INFO:teuthology.orchestra.run.smithi171.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 584 kB/s | 20 kB 00:00 2024-09-10T23:11:51.410 INFO:teuthology.orchestra.run.smithi171.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T23:11:51.443 INFO:teuthology.orchestra.run.smithi171.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T23:11:51.477 INFO:teuthology.orchestra.run.smithi171.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 9.3 MB/s | 1.0 MB 00:00 2024-09-10T23:11:51.503 INFO:teuthology.orchestra.run.smithi171.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 981 kB/s | 58 kB 00:00 2024-09-10T23:11:51.528 INFO:teuthology.orchestra.run.smithi171.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-10T23:11:51.553 INFO:teuthology.orchestra.run.smithi171.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-10T23:11:51.578 INFO:teuthology.orchestra.run.smithi171.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-10T23:11:51.604 INFO:teuthology.orchestra.run.smithi171.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 560 kB/s | 28 kB 00:00 2024-09-10T23:11:51.629 INFO:teuthology.orchestra.run.smithi171.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 609 kB/s | 31 kB 00:00 2024-09-10T23:11:51.655 INFO:teuthology.orchestra.run.smithi171.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T23:11:51.680 INFO:teuthology.orchestra.run.smithi171.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-10T23:11:51.731 INFO:teuthology.orchestra.run.smithi171.stdout:(141/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-09-10T23:11:51.756 INFO:teuthology.orchestra.run.smithi171.stdout:(142/157): python3-tempora-5.0.0-2.el9.noarch.r 355 kB/s | 36 kB 00:00 2024-09-10T23:11:51.781 INFO:teuthology.orchestra.run.smithi171.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 740 kB/s | 74 kB 00:00 2024-09-10T23:11:51.806 INFO:teuthology.orchestra.run.smithi171.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T23:11:51.829 INFO:teuthology.orchestra.run.smithi090.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-09-10T23:11:51.832 INFO:teuthology.orchestra.run.smithi171.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-10T23:11:51.857 INFO:teuthology.orchestra.run.smithi171.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 396 kB/s | 20 kB 00:00 2024-09-10T23:11:51.883 INFO:teuthology.orchestra.run.smithi171.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T23:11:51.908 INFO:teuthology.orchestra.run.smithi171.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T23:11:51.958 INFO:teuthology.orchestra.run.smithi171.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T23:11:52.087 INFO:teuthology.orchestra.run.smithi090.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 369 kB/s | 313 kB 00:00 2024-09-10T23:11:52.108 INFO:teuthology.orchestra.run.smithi171.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 15 MB/s | 2.3 MB 00:00 2024-09-10T23:11:52.176 INFO:teuthology.orchestra.run.smithi171.stdout:(151/157): NetworkManager-libnm-1.49.90-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-09-10T23:11:52.217 INFO:teuthology.orchestra.run.smithi171.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 978 kB/s | 41 kB 00:00 2024-09-10T23:11:52.260 INFO:teuthology.orchestra.run.smithi171.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 5.8 MB/s | 249 kB 00:00 2024-09-10T23:11:52.335 INFO:teuthology.orchestra.run.smithi171.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-10T23:11:52.419 INFO:teuthology.orchestra.run.smithi171.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-10T23:11:52.478 INFO:teuthology.orchestra.run.smithi171.stdout:(156/157): librados2-19.3.0-4854.g8f219c47.el9. 5.8 MB/s | 3.5 MB 00:00 2024-09-10T23:11:52.528 INFO:teuthology.orchestra.run.smithi171.stdout:(157/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 5.2 MB/s | 3.2 MB 00:00 2024-09-10T23:11:52.533 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:11:52.533 INFO:teuthology.orchestra.run.smithi171.stdout:Total 25 MB/s | 240 MB 00:09 2024-09-10T23:11:52.596 INFO:teuthology.orchestra.run.smithi090.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-09-10T23:11:52.963 INFO:teuthology.orchestra.run.smithi090.stdout:(55/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-09-10T23:11:53.291 INFO:teuthology.orchestra.run.smithi090.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 22 kB/s | 11 kB 00:00 2024-09-10T23:11:53.697 INFO:teuthology.orchestra.run.smithi090.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 232 kB/s | 171 kB 00:00 2024-09-10T23:11:53.786 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-09-10T23:11:53.797 INFO:teuthology.orchestra.run.smithi090.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 229 kB/s | 160 kB 00:00 2024-09-10T23:11:53.938 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-09-10T23:11:53.939 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-09-10T23:11:54.298 INFO:teuthology.orchestra.run.smithi090.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 75 kB/s | 45 kB 00:00 2024-09-10T23:11:54.707 INFO:teuthology.orchestra.run.smithi090.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 729 kB/s | 662 kB 00:00 2024-09-10T23:11:55.257 INFO:teuthology.orchestra.run.smithi090.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 44 kB/s | 24 kB 00:00 2024-09-10T23:11:55.541 INFO:teuthology.orchestra.run.smithi090.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 468 kB/s | 581 kB 00:01 2024-09-10T23:11:55.833 INFO:teuthology.orchestra.run.smithi090.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-10T23:11:56.209 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-09-10T23:11:56.211 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-09-10T23:11:56.818 INFO:teuthology.orchestra.run.smithi090.stdout:(64/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 4.9 MB/s | 50 MB 00:10 2024-09-10T23:11:56.843 INFO:teuthology.orchestra.run.smithi090.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 225 kB/s | 292 kB 00:01 2024-09-10T23:11:57.143 INFO:teuthology.orchestra.run.smithi090.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 144 kB/s | 188 kB 00:01 2024-09-10T23:11:57.435 INFO:teuthology.orchestra.run.smithi090.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 62 kB/s | 38 kB 00:00 2024-09-10T23:11:57.969 INFO:teuthology.orchestra.run.smithi090.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 4.4 MB/s | 4.9 MB 00:01 2024-09-10T23:11:58.319 INFO:teuthology.orchestra.run.smithi090.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-09-10T23:11:58.453 INFO:teuthology.orchestra.run.smithi090.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:01 2024-09-10T23:11:58.928 INFO:teuthology.orchestra.run.smithi090.stdout:(71/157): postgresql-contrib-13.16-1.el9.x86_64 949 kB/s | 910 kB 00:00 2024-09-10T23:11:59.021 INFO:teuthology.orchestra.run.smithi090.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 196 kB/s | 137 kB 00:00 2024-09-10T23:11:59.671 INFO:teuthology.orchestra.run.smithi090.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 135 kB/s | 87 kB 00:00 2024-09-10T23:12:00.929 INFO:teuthology.orchestra.run.smithi090.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 516 kB/s | 1.0 MB 00:02 2024-09-10T23:12:01.021 INFO:teuthology.orchestra.run.smithi090.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 2.2 MB/s | 5.8 MB 00:02 2024-09-10T23:12:01.263 INFO:teuthology.orchestra.run.smithi090.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 3.7 MB/s | 6.0 MB 00:01 2024-09-10T23:12:01.589 INFO:teuthology.orchestra.run.smithi090.stdout:(77/157): python3-colorama-0.4.6-3.el9.noarch.r 93 kB/s | 61 kB 00:00 2024-09-10T23:12:01.989 INFO:teuthology.orchestra.run.smithi090.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 253 kB/s | 245 kB 00:00 2024-09-10T23:12:02.123 INFO:teuthology.orchestra.run.smithi090.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 289 kB/s | 248 kB 00:00 2024-09-10T23:12:02.148 INFO:teuthology.orchestra.run.smithi090.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 46 kB/s | 26 kB 00:00 2024-09-10T23:12:02.490 INFO:teuthology.orchestra.run.smithi090.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 38 kB/s | 19 kB 00:00 2024-09-10T23:12:02.698 INFO:teuthology.orchestra.run.smithi090.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 63 kB/s | 35 kB 00:00 2024-09-10T23:12:02.736 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-09-10T23:12:02.841 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T23:12:02.879 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T23:12:02.907 INFO:teuthology.orchestra.run.smithi090.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 220 kB/s | 172 kB 00:00 2024-09-10T23:12:02.942 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T23:12:02.984 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T23:12:03.009 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T23:12:03.059 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T23:12:03.397 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T23:12:03.519 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:12:03.616 INFO:teuthology.orchestra.run.smithi090.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 273 kB/s | 250 kB 00:00 2024-09-10T23:12:03.642 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:12:03.671 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:12:03.724 INFO:teuthology.orchestra.run.smithi090.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 272 kB/s | 222 kB 00:00 2024-09-10T23:12:03.764 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:12:03.792 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:12:03.822 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T23:12:04.000 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T23:12:04.058 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T23:12:04.086 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:12:04.174 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:12:04.204 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:12:04.250 INFO:teuthology.orchestra.run.smithi090.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 122 kB/s | 77 kB 00:00 2024-09-10T23:12:04.251 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:12:04.280 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:12:04.304 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:12:04.351 INFO:teuthology.orchestra.run.smithi090.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 67 kB/s | 42 kB 00:00 2024-09-10T23:12:04.498 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:12:04.665 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:12:04.821 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T23:12:04.955 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:12:05.014 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:12:05.169 INFO:teuthology.orchestra.run.smithi090.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 194 kB/s | 159 kB 00:00 2024-09-10T23:12:05.194 INFO:teuthology.orchestra.run.smithi090.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 285 kB/s | 269 kB 00:00 2024-09-10T23:12:05.250 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:12:05.365 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T23:12:05.394 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T23:12:05.429 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T23:12:05.503 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T23:12:05.547 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T23:12:05.588 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T23:12:05.631 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T23:12:05.673 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T23:12:05.700 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T23:12:05.762 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T23:12:05.823 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T23:12:05.844 INFO:teuthology.orchestra.run.smithi090.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 78 kB/s | 51 kB 00:00 2024-09-10T23:12:05.854 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T23:12:05.897 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T23:12:05.975 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T23:12:05.995 INFO:teuthology.orchestra.run.smithi090.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 338 kB/s | 279 kB 00:00 2024-09-10T23:12:06.008 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T23:12:06.051 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T23:12:06.081 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T23:12:06.151 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T23:12:06.196 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T23:12:06.270 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T23:12:06.404 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T23:12:06.466 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T23:12:06.520 INFO:teuthology.orchestra.run.smithi090.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 79 kB/s | 54 kB 00:00 2024-09-10T23:12:06.997 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T23:12:07.078 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T23:12:07.079 INFO:teuthology.orchestra.run.smithi090.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 75 kB/s | 42 kB 00:00 2024-09-10T23:12:07.108 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T23:12:07.151 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T23:12:07.181 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T23:12:07.224 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T23:12:07.386 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T23:12:07.452 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T23:12:07.552 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T23:12:07.608 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T23:12:07.646 INFO:teuthology.orchestra.run.smithi090.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 78 kB/s | 44 kB 00:00 2024-09-10T23:12:07.681 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T23:12:07.713 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T23:12:07.749 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T23:12:07.796 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T23:12:07.832 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T23:12:07.875 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T23:12:07.917 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T23:12:08.054 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T23:12:08.297 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T23:12:08.504 INFO:teuthology.orchestra.run.smithi090.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 257 kB/s | 221 kB 00:00 2024-09-10T23:12:08.506 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T23:12:08.615 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T23:12:08.647 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T23:12:08.688 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T23:12:08.729 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T23:12:08.754 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T23:12:08.859 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T23:12:08.991 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T23:12:09.029 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T23:12:09.058 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T23:12:09.079 INFO:teuthology.orchestra.run.smithi090.stdout:(96/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 792 kB/s | 5.1 MB 00:06 2024-09-10T23:12:09.094 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T23:12:09.105 INFO:teuthology.orchestra.run.smithi090.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 60 kB/s | 36 kB 00:00 2024-09-10T23:12:09.131 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T23:12:09.163 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T23:12:09.193 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T23:12:09.228 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T23:12:09.261 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T23:12:09.303 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T23:12:09.337 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T23:12:09.424 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T23:12:09.476 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T23:12:09.508 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T23:12:09.612 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T23:12:09.677 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T23:12:09.764 INFO:teuthology.orchestra.run.smithi090.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 69 kB/s | 47 kB 00:00 2024-09-10T23:12:09.989 INFO:teuthology.orchestra.run.smithi090.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 344 kB/s | 304 kB 00:00 2024-09-10T23:12:10.381 INFO:teuthology.orchestra.run.smithi090.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 94 kB/s | 58 kB 00:00 2024-09-10T23:12:10.393 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T23:12:10.441 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T23:12:10.475 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T23:12:10.574 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T23:12:10.626 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T23:12:10.672 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T23:12:10.673 INFO:teuthology.orchestra.run.smithi090.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 142 kB/s | 96 kB 00:00 2024-09-10T23:12:10.759 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T23:12:10.804 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T23:12:10.994 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T23:12:11.006 INFO:teuthology.orchestra.run.smithi090.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2024-09-10T23:12:11.023 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T23:12:11.101 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T23:12:11.123 INFO:teuthology.orchestra.run.smithi090.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-10T23:12:11.240 INFO:teuthology.orchestra.run.smithi090.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 79 kB/s | 45 kB 00:00 2024-09-10T23:12:11.324 INFO:teuthology.orchestra.run.smithi090.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 6.5 MB/s | 548 kB 00:00 2024-09-10T23:12:11.366 INFO:teuthology.orchestra.run.smithi090.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-09-10T23:12:11.391 INFO:teuthology.orchestra.run.smithi090.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-10T23:12:11.433 INFO:teuthology.orchestra.run.smithi090.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.7 MB/s | 863 kB 00:00 2024-09-10T23:12:11.642 INFO:teuthology.orchestra.run.smithi090.stdout:(109/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.9 MB/s | 16 MB 00:05 2024-09-10T23:12:11.684 INFO:teuthology.orchestra.run.smithi090.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 104 kB/s | 26 kB 00:00 2024-09-10T23:12:11.719 INFO:teuthology.orchestra.run.smithi090.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 654 kB/s | 49 kB 00:00 2024-09-10T23:12:11.744 INFO:teuthology.orchestra.run.smithi090.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-10T23:12:11.750 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T23:12:11.778 INFO:teuthology.orchestra.run.smithi090.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-10T23:12:11.862 INFO:teuthology.orchestra.run.smithi090.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-10T23:12:11.865 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T23:12:11.895 INFO:teuthology.orchestra.run.smithi090.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-10T23:12:11.929 INFO:teuthology.orchestra.run.smithi090.stdout:(116/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.4 MB/s | 839 kB 00:00 2024-09-10T23:12:11.954 INFO:teuthology.orchestra.run.smithi090.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 549 kB/s | 32 kB 00:00 2024-09-10T23:12:11.980 INFO:teuthology.orchestra.run.smithi090.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-10T23:12:12.013 INFO:teuthology.orchestra.run.smithi090.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-10T23:12:12.106 INFO:teuthology.orchestra.run.smithi090.stdout:(120/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.2 MB/s | 4.4 MB 00:00 2024-09-10T23:12:12.139 INFO:teuthology.orchestra.run.smithi090.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 2.2 MB/s | 358 kB 00:00 2024-09-10T23:12:12.173 INFO:teuthology.orchestra.run.smithi090.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.9 MB/s | 303 kB 00:00 2024-09-10T23:12:12.207 INFO:teuthology.orchestra.run.smithi090.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.1 MB/s | 220 kB 00:00 2024-09-10T23:12:12.240 INFO:teuthology.orchestra.run.smithi090.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-09-10T23:12:12.265 INFO:teuthology.orchestra.run.smithi090.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-09-10T23:12:12.291 INFO:teuthology.orchestra.run.smithi090.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-10T23:12:12.316 INFO:teuthology.orchestra.run.smithi090.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-10T23:12:12.341 INFO:teuthology.orchestra.run.smithi090.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-10T23:12:12.367 INFO:teuthology.orchestra.run.smithi090.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-10T23:12:12.392 INFO:teuthology.orchestra.run.smithi090.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T23:12:12.426 INFO:teuthology.orchestra.run.smithi090.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T23:12:12.459 INFO:teuthology.orchestra.run.smithi090.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-10T23:12:12.526 INFO:teuthology.orchestra.run.smithi090.stdout:(133/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.3 MB/s | 2.0 MB 00:00 2024-09-10T23:12:12.560 INFO:teuthology.orchestra.run.smithi090.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-09-10T23:12:12.585 INFO:teuthology.orchestra.run.smithi090.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-10T23:12:12.629 INFO:teuthology.orchestra.run.smithi090.stdout:(136/157): python3-kubernetes-26.1.0-2.el9.noar 3.6 MB/s | 1.0 MB 00:00 2024-09-10T23:12:12.654 INFO:teuthology.orchestra.run.smithi090.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 961 kB/s | 90 kB 00:00 2024-09-10T23:12:12.679 INFO:teuthology.orchestra.run.smithi090.stdout:(138/157): python3-pyperclip-1.8.2-2.el9.noarch 302 kB/s | 28 kB 00:00 2024-09-10T23:12:12.705 INFO:teuthology.orchestra.run.smithi090.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 406 kB/s | 31 kB 00:00 2024-09-10T23:12:12.730 INFO:teuthology.orchestra.run.smithi090.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-10T23:12:12.755 INFO:teuthology.orchestra.run.smithi090.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-10T23:12:12.780 INFO:teuthology.orchestra.run.smithi090.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-10T23:12:12.806 INFO:teuthology.orchestra.run.smithi090.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-10T23:12:12.831 INFO:teuthology.orchestra.run.smithi090.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T23:12:12.865 INFO:teuthology.orchestra.run.smithi090.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-10T23:12:12.890 INFO:teuthology.orchestra.run.smithi090.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-09-10T23:12:12.924 INFO:teuthology.orchestra.run.smithi090.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-09-10T23:12:12.949 INFO:teuthology.orchestra.run.smithi090.stdout:(148/157): re2-20211101-20.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-10T23:12:13.050 INFO:teuthology.orchestra.run.smithi090.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-10T23:12:13.114 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T23:12:13.231 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T23:12:13.261 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T23:12:13.275 INFO:teuthology.orchestra.run.smithi090.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 9.9 MB/s | 3.5 MB 00:00 2024-09-10T23:12:13.294 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T23:12:13.392 INFO:teuthology.orchestra.run.smithi090.stdout:(151/157): NetworkManager-1.49.90-1.el9.x86_64. 6.8 MB/s | 2.3 MB 00:00 2024-09-10T23:12:13.459 INFO:teuthology.orchestra.run.smithi090.stdout:(152/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 6.4 MB/s | 3.2 MB 00:00 2024-09-10T23:12:13.484 INFO:teuthology.orchestra.run.smithi090.stdout:(153/157): NetworkManager-team-1.49.90-1.el9.x8 443 kB/s | 41 kB 00:00 2024-09-10T23:12:13.601 INFO:teuthology.orchestra.run.smithi090.stdout:(154/157): NetworkManager-libnm-1.49.90-1.el9.x 5.5 MB/s | 1.8 MB 00:00 2024-09-10T23:12:13.626 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T23:12:13.674 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:12:13.694 INFO:teuthology.orchestra.run.smithi090.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 6.5 MB/s | 1.4 MB 00:00 2024-09-10T23:12:13.718 INFO:teuthology.orchestra.run.smithi090.stdout:(156/157): NetworkManager-tui-1.49.90-1.el9.x86 959 kB/s | 249 kB 00:00 2024-09-10T23:12:13.802 INFO:teuthology.orchestra.run.smithi090.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-09-10T23:12:13.810 INFO:teuthology.orchestra.run.smithi090.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:12:13.810 INFO:teuthology.orchestra.run.smithi090.stdout:Total 8.0 MB/s | 240 MB 00:30 2024-09-10T23:12:13.882 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:12:13.913 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T23:12:13.950 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T23:12:14.445 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T23:12:14.478 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:12:14.549 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:12:14.572 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T23:12:15.027 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction check 2024-09-10T23:12:15.180 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction check succeeded. 2024-09-10T23:12:15.180 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction test 2024-09-10T23:12:17.243 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:17.278 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:17.598 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction test succeeded. 2024-09-10T23:12:17.599 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction 2024-09-10T23:12:17.842 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:17.891 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:12:17.967 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:12:17.967 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:12:17.968 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:12:17.968 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:12:18.009 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:12:24.024 INFO:teuthology.orchestra.run.smithi090.stdout: Preparing : 1/1 2024-09-10T23:12:24.193 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T23:12:24.248 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T23:12:24.309 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T23:12:24.351 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T23:12:24.386 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T23:12:24.438 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T23:12:24.779 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T23:12:24.929 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:12:25.061 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:12:25.098 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:12:25.190 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:12:25.228 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:12:25.266 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T23:12:25.453 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T23:12:25.510 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T23:12:25.538 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:12:25.642 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:12:25.666 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:12:25.728 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:12:25.750 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:12:25.774 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:12:25.983 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:12:26.178 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:12:26.368 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T23:12:26.494 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:12:26.595 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:12:26.805 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:12:26.927 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T23:12:26.972 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T23:12:27.017 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T23:12:27.099 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T23:12:27.153 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T23:12:27.201 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T23:12:27.245 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T23:12:27.279 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T23:12:27.315 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T23:12:27.383 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T23:12:27.437 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T23:12:27.553 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T23:12:27.775 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T23:12:28.006 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T23:12:28.048 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T23:12:28.091 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T23:12:28.121 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T23:12:28.199 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T23:12:28.253 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T23:12:28.326 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T23:12:28.457 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T23:12:28.513 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T23:12:29.039 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T23:12:29.127 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T23:12:29.165 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T23:12:29.214 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T23:12:29.246 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T23:12:29.299 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T23:12:29.518 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T23:12:29.567 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T23:12:29.667 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T23:12:29.733 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T23:12:29.805 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T23:12:29.837 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T23:12:29.882 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T23:12:29.937 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T23:12:29.973 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T23:12:30.017 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T23:12:30.059 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T23:12:30.179 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:12:30.179 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /sys 2024-09-10T23:12:30.179 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /proc 2024-09-10T23:12:30.179 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /mnt 2024-09-10T23:12:30.179 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /var/tmp 2024-09-10T23:12:30.179 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /home 2024-09-10T23:12:30.179 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /root 2024-09-10T23:12:30.179 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /tmp 2024-09-10T23:12:30.179 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:12:30.194 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T23:12:30.237 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T23:12:30.278 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T23:12:30.358 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:12:30.378 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:12:30.379 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:30.379 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T23:12:30.379 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:12:30.381 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T23:12:30.422 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T23:12:30.469 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T23:12:30.495 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T23:12:30.520 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T23:12:30.622 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T23:12:30.748 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T23:12:30.796 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T23:12:30.833 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T23:12:30.877 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T23:12:30.914 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T23:12:30.955 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T23:12:30.993 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T23:12:31.027 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T23:12:31.061 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T23:12:31.104 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T23:12:31.138 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T23:12:31.225 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T23:12:31.269 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T23:12:31.309 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T23:12:31.411 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T23:12:31.469 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T23:12:31.904 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:12:31.931 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:12:31.931 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:31.931 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:12:31.932 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:12:31.932 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:12:31.932 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:12:32.154 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:12:32.179 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:12:32.179 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:32.179 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:12:32.179 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:12:32.179 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:12:32.179 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:12:32.180 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T23:12:32.296 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T23:12:32.330 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T23:12:32.436 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T23:12:32.487 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T23:12:32.539 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T23:12:32.627 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T23:12:32.630 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:12:32.655 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:12:32.655 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:32.655 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:12:32.655 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:12:32.655 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:12:32.655 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:12:32.668 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T23:12:32.761 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T23:12:32.819 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T23:12:32.851 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T23:12:32.874 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T23:12:32.883 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T23:12:32.978 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T23:12:33.060 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T23:12:33.136 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T23:12:33.211 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T23:12:33.301 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T23:12:33.450 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T23:12:33.504 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T23:12:33.541 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T23:12:33.578 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T23:12:33.643 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T23:12:33.749 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T23:12:34.034 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:12:34.061 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:12:34.093 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T23:12:34.161 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T23:12:34.185 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:12:35.029 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T23:12:35.154 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T23:12:35.190 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T23:12:35.223 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T23:12:35.550 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T23:12:35.603 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:12:35.695 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:12:35.726 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T23:12:35.771 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T23:12:36.261 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T23:12:36.308 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:12:36.378 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:12:36.409 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T23:12:37.419 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:12:37.484 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:12:38.463 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:12:38.493 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:12:38.609 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:12:38.772 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:38.773 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T23:12:38.808 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:38.821 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:12:38.846 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:12:38.897 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:12:38.909 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:12:39.007 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T23:12:39.060 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T23:12:39.389 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:12:39.429 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:12:39.513 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:12:39.513 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:12:39.513 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:12:39.513 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:12:39.548 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:12:40.023 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T23:12:40.059 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:12:40.082 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:12:40.083 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:40.083 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:12:40.083 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:12:40.083 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:12:40.083 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:12:40.126 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:12:40.150 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:12:40.150 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:40.150 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:12:40.150 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:12:40.202 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:12:40.225 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:12:40.225 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:40.225 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T23:12:40.226 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:12:40.226 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:12:40.226 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:12:40.536 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:12:40.560 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:12:40.561 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:40.561 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:12:40.561 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:12:40.561 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:12:40.561 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:12:45.275 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T23:12:45.317 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T23:12:45.357 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T23:12:45.390 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T23:12:45.417 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T23:12:45.605 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T23:12:45.666 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T23:12:45.697 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T23:12:45.726 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T23:12:45.764 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T23:12:46.341 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:46.389 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:46.409 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:12:47.256 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T23:12:47.356 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T23:12:47.409 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T23:12:47.499 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T23:12:47.527 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T23:12:47.561 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T23:12:47.587 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T23:12:47.587 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:12:47.663 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:12:47.663 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:12:47.756 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:12:47.781 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T23:12:47.787 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:47.787 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:47.967 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:12:47.967 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:12:48.051 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:12:48.116 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:53.101 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:12:53.101 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /sys 2024-09-10T23:12:53.101 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /proc 2024-09-10T23:12:53.101 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /mnt 2024-09-10T23:12:53.101 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /var/tmp 2024-09-10T23:12:53.101 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /home 2024-09-10T23:12:53.101 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /root 2024-09-10T23:12:53.101 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /tmp 2024-09-10T23:12:53.101 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:12:53.276 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:12:53.293 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:12:53.293 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:53.293 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T23:12:53.293 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:12:54.480 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:54.481 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T23:12:54.481 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T23:12:54.481 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T23:12:54.481 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T23:12:54.481 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T23:12:54.481 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T23:12:54.481 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T23:12:54.481 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:12:54.481 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:12:54.482 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:12:54.482 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T23:12:54.482 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T23:12:54.482 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T23:12:54.482 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:12:54.482 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T23:12:54.482 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T23:12:54.482 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T23:12:54.482 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T23:12:54.482 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T23:12:54.482 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T23:12:54.482 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T23:12:54.482 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T23:12:54.483 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T23:12:54.483 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T23:12:54.483 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T23:12:54.483 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T23:12:54.483 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T23:12:54.483 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T23:12:54.483 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T23:12:54.483 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T23:12:54.495 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T23:12:54.496 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T23:12:54.496 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T23:12:54.496 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T23:12:54.496 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T23:12:54.496 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T23:12:54.496 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T23:12:54.497 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T23:12:54.497 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T23:12:54.497 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T23:12:54.497 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T23:12:54.497 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T23:12:54.497 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T23:12:54.497 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T23:12:54.497 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T23:12:54.497 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T23:12:54.498 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T23:12:54.498 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T23:12:54.498 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T23:12:54.498 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T23:12:54.498 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T23:12:54.498 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T23:12:54.498 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T23:12:54.498 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T23:12:54.498 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T23:12:54.498 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T23:12:54.498 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T23:12:54.498 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T23:12:54.498 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T23:12:54.499 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T23:12:54.499 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T23:12:54.499 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T23:12:54.499 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T23:12:54.499 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T23:12:54.499 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T23:12:54.499 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T23:12:54.499 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T23:12:54.499 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T23:12:54.499 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T23:12:54.499 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T23:12:54.500 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T23:12:54.500 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T23:12:54.500 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T23:12:54.500 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T23:12:54.500 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T23:12:54.500 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T23:12:54.500 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T23:12:54.500 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T23:12:54.500 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T23:12:54.501 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T23:12:54.501 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T23:12:54.501 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T23:12:54.501 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T23:12:54.501 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T23:12:54.501 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T23:12:54.501 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T23:12:54.501 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T23:12:54.501 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T23:12:54.501 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T23:12:54.501 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T23:12:54.501 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T23:12:54.501 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T23:12:54.501 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T23:12:54.502 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T23:12:54.502 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T23:12:54.502 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T23:12:54.502 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T23:12:54.502 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T23:12:54.502 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T23:12:54.502 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T23:12:54.502 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T23:12:54.502 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T23:12:54.502 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T23:12:54.502 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T23:12:54.502 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T23:12:54.502 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T23:12:54.502 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T23:12:54.503 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T23:12:54.503 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T23:12:54.503 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T23:12:54.503 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T23:12:54.503 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T23:12:54.503 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T23:12:54.503 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T23:12:54.503 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T23:12:54.503 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T23:12:54.503 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T23:12:54.504 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T23:12:54.504 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T23:12:54.504 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T23:12:54.504 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T23:12:54.504 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T23:12:54.504 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T23:12:54.504 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T23:12:54.504 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T23:12:54.504 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T23:12:54.504 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T23:12:54.504 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T23:12:54.504 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T23:12:54.505 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T23:12:54.505 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T23:12:54.505 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T23:12:54.506 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T23:12:54.506 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T23:12:54.506 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T23:12:54.506 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T23:12:54.506 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T23:12:54.507 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T23:12:54.507 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T23:12:54.507 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T23:12:54.507 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T23:12:54.507 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T23:12:54.507 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T23:12:54.507 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T23:12:54.507 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T23:12:54.507 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T23:12:54.507 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T23:12:54.507 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T23:12:54.507 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T23:12:54.507 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T23:12:54.508 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T23:12:54.508 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T23:12:54.508 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T23:12:54.508 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T23:12:54.508 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T23:12:54.508 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T23:12:54.508 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T23:12:54.508 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T23:12:54.508 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T23:12:54.508 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T23:12:54.508 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T23:12:54.508 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T23:12:54.508 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T23:12:54.508 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T23:12:54.798 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:12:54.824 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:12:54.825 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:54.825 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:12:54.825 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:12:54.825 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:12:54.825 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:12:55.049 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:12:55.072 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:12:55.072 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:55.072 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:12:55.072 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:12:55.072 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:12:55.072 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:12:55.525 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:12:55.548 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:12:55.548 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:12:55.548 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:12:55.549 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:12:55.549 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:12:55.549 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:12:55.655 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T23:12:55.712 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T23:12:55.767 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T23:12:55.962 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T23:12:56.019 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T23:12:56.096 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T23:12:56.192 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T23:12:56.343 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T23:12:56.387 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T23:12:56.427 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T23:12:56.455 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T23:12:56.887 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:12:56.914 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:12:56.946 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T23:12:57.011 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T23:12:57.046 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:12:57.107 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:12:57.107 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:12:57.107 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded: 2024-09-10T23:12:57.107 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:57.107 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:57.107 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:57.107 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T23:12:57.107 INFO:teuthology.orchestra.run.smithi171.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.107 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.108 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T23:12:57.108 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T23:12:57.108 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-09-10T23:12:57.108 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T23:12:57.108 INFO:teuthology.orchestra.run.smithi171.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T23:12:57.108 INFO:teuthology.orchestra.run.smithi171.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T23:12:57.108 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:12:57.108 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.108 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.108 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.108 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.108 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:57.109 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.109 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.109 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.109 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:57.109 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:57.109 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:57.109 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:57.109 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:57.109 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.109 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.109 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:57.109 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.109 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.110 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.110 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:57.110 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:57.110 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.110 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.110 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:12:57.110 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T23:12:57.110 INFO:teuthology.orchestra.run.smithi171.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T23:12:57.110 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:12:57.110 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:12:57.110 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:12:57.110 INFO:teuthology.orchestra.run.smithi171.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T23:12:57.110 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:12:57.110 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T23:12:57.111 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T23:12:57.111 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:12:57.111 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:12:57.111 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.111 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.111 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.111 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:12:57.111 INFO:teuthology.orchestra.run.smithi171.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T23:12:57.111 INFO:teuthology.orchestra.run.smithi171.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:12:57.111 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:12:57.111 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:12:57.111 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:12:57.111 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.112 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.112 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:12:57.112 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.112 INFO:teuthology.orchestra.run.smithi171.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T23:12:57.112 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:12:57.112 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T23:12:57.112 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T23:12:57.112 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:12:57.112 INFO:teuthology.orchestra.run.smithi171.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T23:12:57.112 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T23:12:57.112 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T23:12:57.112 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:12:57.112 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:12:57.112 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T23:12:57.113 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:12:57.113 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T23:12:57.113 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T23:12:57.113 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T23:12:57.113 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T23:12:57.113 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T23:12:57.113 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T23:12:57.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:12:57.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T23:12:57.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:12:57.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:12:57.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:12:57.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.114 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.114 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.114 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:12:57.114 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:12:57.114 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:12:57.114 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:12:57.114 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T23:12:57.114 INFO:teuthology.orchestra.run.smithi171.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T23:12:57.114 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:12:57.114 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:12:57.114 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:12:57.114 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T23:12:57.114 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T23:12:57.114 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:12:57.115 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:12:57.115 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:12:57.115 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:12:57.115 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:12:57.115 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:12:57.115 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:12:57.115 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:12:57.115 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:12:57.115 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:12:57.115 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:12:57.115 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:12:57.115 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:12:57.115 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:12:57.116 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:12:57.116 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:12:57.116 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:12:57.116 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T23:12:57.116 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:12:57.116 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:12:57.116 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:12:57.116 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:12:57.116 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T23:12:57.116 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:12:57.116 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:12:57.116 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:12:57.116 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:12:57.117 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T23:12:57.117 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:12:57.117 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.117 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.117 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:12:57.117 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:12:57.117 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:12:57.117 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.117 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:12:57.117 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:12:57.117 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:12:57.117 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:12:57.117 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:12:57.117 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:12:57.118 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:12:57.118 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T23:12:57.118 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:12:57.118 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:12:57.118 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:12:57.118 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:12:57.118 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T23:12:57.118 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T23:12:57.118 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T23:12:57.118 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.118 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.118 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:12:57.118 INFO:teuthology.orchestra.run.smithi171.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:12:57.118 INFO:teuthology.orchestra.run.smithi171.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T23:12:57.119 INFO:teuthology.orchestra.run.smithi171.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:12:57.119 INFO:teuthology.orchestra.run.smithi171.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T23:12:57.119 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T23:12:57.119 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:12:57.119 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T23:12:57.119 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:12:57.119 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-09-10T23:12:57.509 DEBUG:teuthology.parallel:result is None 2024-09-10T23:13:00.195 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:13:00.263 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:13:01.221 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:13:01.271 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:13:01.384 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:13:01.542 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T23:13:01.565 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:13:01.590 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:13:01.590 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:13:01.590 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:13:01.590 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:13:01.590 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:13:01.590 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:01.641 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:13:01.653 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:13:01.762 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T23:13:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T23:13:02.793 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T23:13:02.821 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:13:02.845 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:13:02.845 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:13:02.845 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:13:02.845 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:13:02.845 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:13:02.845 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:02.888 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:13:02.912 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:13:02.912 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:13:02.912 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:13:02.912 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:02.955 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:13:02.979 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:13:02.979 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:13:02.979 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T23:13:02.979 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:13:02.979 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:13:02.979 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:03.298 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:13:03.322 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:13:03.322 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:13:03.322 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:13:03.322 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:13:03.322 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:13:03.322 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:08.063 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T23:13:08.112 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T23:13:08.153 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T23:13:08.186 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T23:13:08.213 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T23:13:08.405 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T23:13:08.454 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T23:13:08.476 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T23:13:08.514 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T23:13:08.569 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T23:13:09.199 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:13:09.244 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:13:09.265 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:13:10.102 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T23:13:10.187 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T23:13:10.257 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T23:13:10.352 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T23:13:10.391 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T23:13:10.416 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T23:13:10.451 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T23:13:10.451 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:13:10.536 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:13:10.537 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:13:10.629 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:13:10.662 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T23:13:10.668 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:13:10.668 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:13:10.848 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:13:10.848 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:13:10.940 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:13:11.013 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:13:19.638 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:13:19.638 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T23:13:19.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T23:13:19.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T23:13:19.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T23:13:19.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T23:13:19.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T23:13:19.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T23:13:19.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:13:19.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:13:19.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:13:19.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T23:13:19.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T23:13:19.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T23:13:19.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:13:19.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T23:13:19.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T23:13:19.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T23:13:19.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T23:13:19.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T23:13:19.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T23:13:19.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T23:13:19.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T23:13:19.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T23:13:19.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T23:13:19.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T23:13:19.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T23:13:19.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T23:13:19.641 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T23:13:19.641 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T23:13:19.641 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T23:13:19.652 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T23:13:19.652 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T23:13:19.652 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T23:13:19.652 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T23:13:19.652 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T23:13:19.652 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T23:13:19.653 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T23:13:19.653 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T23:13:19.653 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T23:13:19.653 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T23:13:19.653 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T23:13:19.653 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T23:13:19.653 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T23:13:19.653 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T23:13:19.653 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T23:13:19.653 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T23:13:19.653 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T23:13:19.653 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T23:13:19.653 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T23:13:19.654 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T23:13:19.654 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T23:13:19.654 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T23:13:19.654 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T23:13:19.654 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T23:13:19.654 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T23:13:19.654 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T23:13:19.654 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T23:13:19.654 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T23:13:19.654 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T23:13:19.654 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T23:13:19.654 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T23:13:19.654 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T23:13:19.654 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T23:13:19.655 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T23:13:19.655 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T23:13:19.655 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T23:13:19.655 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T23:13:19.655 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T23:13:19.655 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T23:13:19.655 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T23:13:19.655 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T23:13:19.655 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T23:13:19.655 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T23:13:19.655 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T23:13:19.655 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T23:13:19.655 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T23:13:19.655 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T23:13:19.656 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T23:13:19.656 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T23:13:19.656 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T23:13:19.656 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T23:13:19.656 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T23:13:19.656 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T23:13:19.656 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T23:13:19.656 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T23:13:19.656 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T23:13:19.656 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T23:13:19.656 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T23:13:19.656 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T23:13:19.656 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T23:13:19.656 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T23:13:19.656 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T23:13:19.657 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T23:13:19.657 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T23:13:19.657 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T23:13:19.657 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T23:13:19.657 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T23:13:19.657 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T23:13:19.657 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T23:13:19.657 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T23:13:19.657 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T23:13:19.657 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T23:13:19.657 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T23:13:19.657 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T23:13:19.658 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T23:13:19.658 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T23:13:19.658 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T23:13:19.658 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T23:13:19.658 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T23:13:19.658 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T23:13:19.658 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T23:13:19.658 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T23:13:19.658 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T23:13:19.658 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T23:13:19.658 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T23:13:19.658 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T23:13:19.658 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T23:13:19.659 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T23:13:19.659 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T23:13:19.659 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T23:13:19.659 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T23:13:19.659 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T23:13:19.659 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T23:13:19.659 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T23:13:19.659 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T23:13:19.659 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T23:13:19.659 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T23:13:19.659 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T23:13:19.659 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T23:13:19.659 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T23:13:19.659 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T23:13:19.659 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T23:13:19.660 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T23:13:19.660 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T23:13:19.660 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T23:13:19.660 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T23:13:19.660 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T23:13:19.660 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T23:13:19.660 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T23:13:19.660 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T23:13:19.660 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T23:13:19.660 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T23:13:19.660 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T23:13:19.660 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T23:13:19.661 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T23:13:19.661 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T23:13:19.661 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T23:13:19.661 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T23:13:19.661 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T23:13:19.661 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T23:13:19.661 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T23:13:19.661 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T23:13:19.661 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T23:13:19.661 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T23:13:19.661 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T23:13:19.661 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T23:13:19.661 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T23:13:19.661 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T23:13:19.662 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T23:13:19.662 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T23:13:19.662 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T23:13:19.662 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T23:13:19.662 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T23:13:19.662 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T23:13:22.160 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:13:22.160 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:22.160 INFO:teuthology.orchestra.run.smithi090.stdout:Upgraded: 2024-09-10T23:13:22.160 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T23:13:22.160 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T23:13:22.161 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T23:13:22.161 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T23:13:22.161 INFO:teuthology.orchestra.run.smithi090.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.161 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.161 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T23:13:22.161 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T23:13:22.161 INFO:teuthology.orchestra.run.smithi090.stdout:Installed: 2024-09-10T23:13:22.161 INFO:teuthology.orchestra.run.smithi090.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T23:13:22.161 INFO:teuthology.orchestra.run.smithi090.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T23:13:22.161 INFO:teuthology.orchestra.run.smithi090.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T23:13:22.161 INFO:teuthology.orchestra.run.smithi090.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:13:22.161 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.161 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.162 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.162 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.162 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:22.162 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.162 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.162 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.162 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:22.162 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:22.162 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:22.162 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:22.162 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:22.162 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.162 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.163 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:22.163 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.163 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.163 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.163 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:22.163 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:22.163 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.163 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.163 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:13:22.163 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T23:13:22.163 INFO:teuthology.orchestra.run.smithi090.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T23:13:22.163 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:13:22.163 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:13:22.163 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:13:22.164 INFO:teuthology.orchestra.run.smithi090.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T23:13:22.164 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:13:22.164 INFO:teuthology.orchestra.run.smithi090.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T23:13:22.164 INFO:teuthology.orchestra.run.smithi090.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T23:13:22.164 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:13:22.164 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:13:22.164 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.164 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.164 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.164 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:13:22.164 INFO:teuthology.orchestra.run.smithi090.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T23:13:22.164 INFO:teuthology.orchestra.run.smithi090.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:13:22.165 INFO:teuthology.orchestra.run.smithi090.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:13:22.165 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:13:22.165 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:13:22.165 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.165 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.165 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:13:22.165 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.165 INFO:teuthology.orchestra.run.smithi090.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T23:13:22.165 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:13:22.165 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T23:13:22.165 INFO:teuthology.orchestra.run.smithi090.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T23:13:22.165 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:13:22.165 INFO:teuthology.orchestra.run.smithi090.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T23:13:22.165 INFO:teuthology.orchestra.run.smithi090.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T23:13:22.166 INFO:teuthology.orchestra.run.smithi090.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T23:13:22.166 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:13:22.166 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:13:22.166 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T23:13:22.166 INFO:teuthology.orchestra.run.smithi090.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:13:22.166 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T23:13:22.166 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T23:13:22.166 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T23:13:22.166 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T23:13:22.166 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T23:13:22.166 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T23:13:22.166 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:13:22.166 INFO:teuthology.orchestra.run.smithi090.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T23:13:22.167 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:13:22.167 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:13:22.167 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:13:22.167 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.167 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.167 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.167 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:13:22.167 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:13:22.167 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:13:22.167 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:13:22.167 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T23:13:22.167 INFO:teuthology.orchestra.run.smithi090.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T23:13:22.167 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:13:22.168 INFO:teuthology.orchestra.run.smithi090.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:13:22.168 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:13:22.168 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T23:13:22.168 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T23:13:22.168 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:13:22.168 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:13:22.168 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:13:22.168 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:13:22.168 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:13:22.168 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:13:22.168 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:13:22.168 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:13:22.168 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:13:22.169 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:13:22.169 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:13:22.169 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:13:22.169 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:13:22.169 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:13:22.169 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:13:22.169 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:13:22.169 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:13:22.169 INFO:teuthology.orchestra.run.smithi090.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T23:13:22.169 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:13:22.169 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:13:22.169 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:13:22.169 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:13:22.169 INFO:teuthology.orchestra.run.smithi090.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T23:13:22.170 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:13:22.170 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:13:22.170 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:13:22.170 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:13:22.170 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T23:13:22.170 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:13:22.170 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.170 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.170 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:13:22.170 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:13:22.170 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:13:22.170 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.170 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:13:22.170 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:13:22.171 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:13:22.171 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:13:22.171 INFO:teuthology.orchestra.run.smithi090.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:13:22.171 INFO:teuthology.orchestra.run.smithi090.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:13:22.171 INFO:teuthology.orchestra.run.smithi090.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:13:22.171 INFO:teuthology.orchestra.run.smithi090.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T23:13:22.171 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:13:22.171 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:13:22.171 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:13:22.171 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:13:22.171 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T23:13:22.171 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T23:13:22.171 INFO:teuthology.orchestra.run.smithi090.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T23:13:22.171 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.172 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.172 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:13:22.172 INFO:teuthology.orchestra.run.smithi090.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:13:22.172 INFO:teuthology.orchestra.run.smithi090.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T23:13:22.172 INFO:teuthology.orchestra.run.smithi090.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:13:22.172 INFO:teuthology.orchestra.run.smithi090.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T23:13:22.172 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T23:13:22.172 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:13:22.173 INFO:teuthology.orchestra.run.smithi090.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T23:13:22.173 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:22.173 INFO:teuthology.orchestra.run.smithi090.stdout:Complete! 2024-09-10T23:13:22.638 DEBUG:teuthology.parallel:result is None 2024-09-10T23:13:22.639 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:13:22.787 DEBUG:teuthology.orchestra.run.smithi090:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:13:22.811 INFO:teuthology.orchestra.run.smithi090.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T23:13:22.812 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T23:13:22.812 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T23:13:22.814 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:13:22.955 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:13:22.982 INFO:teuthology.orchestra.run.smithi171.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T23:13:22.983 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T23:13:22.983 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T23:13:22.985 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T23:13:22.985 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:22.985 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:13:23.016 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:13:23.016 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:13:23.056 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T23:13:23.057 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:23.057 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:13:23.084 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:13:23.148 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:13:23.148 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:13:23.176 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:13:23.241 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T23:13:23.242 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:23.242 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:13:23.267 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:13:23.333 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:13:23.333 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:13:23.360 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:13:23.425 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T23:13:23.425 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:23.425 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:13:23.449 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:13:23.514 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:13:23.515 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:13:23.540 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:13:23.605 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T23:13:23.682 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T23:13:23.682 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 777 /var/log/ceph 2024-09-10T23:13:23.684 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /var/log/ceph 2024-09-10T23:13:23.709 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T23:13:23.710 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T23:13:23.749 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T23:13:23.774 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T23:13:23.775 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T23:13:23.814 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T23:13:23.845 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-10T23:13:23.845 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-10T23:13:23.845 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-10T23:13:23.845 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:23.846 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T23:13:23.890 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T23:13:24.010 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T23:13:24.035 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:13:24.035 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T23:13:24.050 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T23:13:24.168 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T23:13:24.198 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T23:13:24.199 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'client session with non-allowable root'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T23:13:24.199 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899779', 'branch': 'wip-hemanth-testing-2024-09-10-0723', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/sessionmap}', 'email': 'hyelloji@redhat.com', 'first_in_suite': False, 'job_id': '7899779', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-hemanth-testing-2024-09-10-0723'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'client session with non-allowable root'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'kclient': {'syntax': 'v1'}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-hemanth-testing-2024-09-10-0723', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'owner': 'scheduled_hyelloji@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6190, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'sleep_before_teardown': 0, 'subset': '479/1024', 'suite': 'fs', 'suite_branch': 'wip-hemanth-testing-2024-09-10-0723', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi090.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzaLeaBmBT9hKY/v0MrteRTZNHd/sousv1hsy1GUVQYYKE6d+7vPBXOE3+hYXKSAs/bnRKHeZWWGv58SveVVhM=', 'smithi171.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBqUeyt8ejMHsJ4jtjGF5LapA09lMBU2b0uhqssb19fsCPM/EvxyarQM+kAk3xp1kid1Jx+hqbdpwv6RNabkmpE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'client session with non-allowable root'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_sessionmap']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_16:59:47', 'tube': 'smithi', 'user': 'hyelloji', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T23:13:24.199 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T23:13:24.201 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T23:13:24.249 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T23:13:24.257 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T23:13:24.313 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:24.314 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:13:24.335 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:13:24.335 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_1 2024-09-10T23:13:24.391 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:13:24.391 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:13:24.391 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-10T23:13:24.391 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:13:24.391 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:13:24.391 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-10 23:13:11.377814449 +0000 2024-09-10T23:13:24.391 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-10 23:11:01.309397187 +0000 2024-09-10T23:13:24.392 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-10 23:11:01.309397187 +0000 2024-09-10T23:13:24.392 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-10 23:11:01.309397187 +0000 2024-09-10T23:13:24.392 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:13:24.454 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-10T23:13:24.454 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-10T23:13:24.454 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000196241 s, 2.6 MB/s 2024-09-10T23:13:24.456 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:13:24.512 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_2 2024-09-10T23:13:24.567 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:13:24.567 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:13:24.567 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-10T23:13:24.567 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:13:24.567 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:13:24.567 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-10 23:13:11.377814449 +0000 2024-09-10T23:13:24.567 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-10 23:11:01.624392251 +0000 2024-09-10T23:13:24.567 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-10 23:11:01.624392251 +0000 2024-09-10T23:13:24.567 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-10 23:11:01.624392251 +0000 2024-09-10T23:13:24.568 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:13:24.630 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-10T23:13:24.630 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-10T23:13:24.631 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000197758 s, 2.6 MB/s 2024-09-10T23:13:24.632 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:13:24.689 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_3 2024-09-10T23:13:24.745 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:13:24.745 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:13:24.745 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-10T23:13:24.745 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:13:24.745 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:13:24.745 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-10 23:13:11.378814433 +0000 2024-09-10T23:13:24.745 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-10 23:11:01.946387205 +0000 2024-09-10T23:13:24.745 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-10 23:11:01.946387205 +0000 2024-09-10T23:13:24.746 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-10 23:11:01.946387205 +0000 2024-09-10T23:13:24.746 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:13:24.808 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-10T23:13:24.808 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-10T23:13:24.808 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000207422 s, 2.5 MB/s 2024-09-10T23:13:24.809 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:13:24.866 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_4 2024-09-10T23:13:24.921 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:13:24.921 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:13:24.921 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-10T23:13:24.921 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:13:24.921 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:13:24.921 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-10 23:13:11.378814433 +0000 2024-09-10T23:13:24.921 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-10 23:11:02.305381579 +0000 2024-09-10T23:13:24.921 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-10 23:11:02.305381579 +0000 2024-09-10T23:13:24.922 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-10 23:11:02.305381579 +0000 2024-09-10T23:13:24.922 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:13:24.984 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-10T23:13:24.984 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-10T23:13:24.984 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000187098 s, 2.7 MB/s 2024-09-10T23:13:24.985 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:13:25.041 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T23:13:25.041 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:13:25.042 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:13:25.059 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:13:25.059 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 2024-09-10T23:13:25.116 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:13:25.117 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:13:25.117 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-10T23:13:25.117 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:13:25.117 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:13:25.117 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-10 23:12:48.481305187 +0000 2024-09-10T23:13:25.117 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-10 23:11:01.985920513 +0000 2024-09-10T23:13:25.117 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-10 23:11:01.985920513 +0000 2024-09-10T23:13:25.117 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-09-10 23:11:01.985920513 +0000 2024-09-10T23:13:25.117 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:13:25.182 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-10T23:13:25.182 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-10T23:13:25.182 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000267639 s, 1.9 MB/s 2024-09-10T23:13:25.183 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:13:25.241 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 2024-09-10T23:13:25.296 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:13:25.296 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:13:25.297 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-10T23:13:25.297 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:13:25.297 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:13:25.297 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-10 23:12:48.481305187 +0000 2024-09-10T23:13:25.297 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-10 23:11:02.320913556 +0000 2024-09-10T23:13:25.297 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-10 23:11:02.320913556 +0000 2024-09-10T23:13:25.297 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-09-10 23:11:02.320913556 +0000 2024-09-10T23:13:25.297 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:13:25.361 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-10T23:13:25.361 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-10T23:13:25.361 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000180846 s, 2.8 MB/s 2024-09-10T23:13:25.362 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:13:25.420 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 2024-09-10T23:13:25.476 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:13:25.477 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:13:25.477 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T23:13:25.477 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:13:25.477 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:13:25.477 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-10 23:12:48.481305187 +0000 2024-09-10T23:13:25.477 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-10 23:11:02.654906621 +0000 2024-09-10T23:13:25.477 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-10 23:11:02.654906621 +0000 2024-09-10T23:13:25.477 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-09-10 23:11:02.654906621 +0000 2024-09-10T23:13:25.477 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:13:25.540 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-10T23:13:25.540 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-10T23:13:25.540 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000211924 s, 2.4 MB/s 2024-09-10T23:13:25.541 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:13:25.597 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 2024-09-10T23:13:25.653 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:13:25.653 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:13:25.654 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-10T23:13:25.654 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:13:25.654 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:13:25.654 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-10 23:12:48.482305166 +0000 2024-09-10T23:13:25.654 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-10 23:11:02.974899975 +0000 2024-09-10T23:13:25.654 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-10 23:11:02.974899975 +0000 2024-09-10T23:13:25.654 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-09-10 23:11:02.974899975 +0000 2024-09-10T23:13:25.654 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:13:25.717 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-10T23:13:25.717 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-10T23:13:25.717 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000177113 s, 2.9 MB/s 2024-09-10T23:13:25.719 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:13:25.774 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T23:13:25.774 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T23:13:25.775 INFO:tasks.ceph:Generating config... 2024-09-10T23:13:25.776 INFO:tasks.ceph:[client] pid file = 2024-09-10T23:13:25.776 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-10T23:13:25.776 INFO:tasks.ceph:[mgr] client mount timeout = 30 2024-09-10T23:13:25.776 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-10T23:13:25.776 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T23:13:25.776 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T23:13:25.776 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T23:13:25.776 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T23:13:25.776 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T23:13:25.776 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-10T23:13:25.777 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-10T23:13:25.777 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-10T23:13:25.777 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-10T23:13:25.777 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T23:13:25.777 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T23:13:25.777 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-10T23:13:25.777 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-10T23:13:25.777 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T23:13:25.777 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T23:13:25.777 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-10T23:13:25.777 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T23:13:25.777 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T23:13:25.777 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T23:13:25.777 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T23:13:25.778 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T23:13:25.778 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T23:13:25.778 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T23:13:25.839 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T23:13:25.842 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T23:13:25.887 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T23:13:25.912 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.90'), ('mon.b', '172.21.15.171'), ('mon.c', '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]')] 2024-09-10T23:13:25.912 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.90,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'client mount timeout': 30, 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-10T23:13:25.913 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:25.913 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T23:13:25.967 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.90 --add b 172.21.15.171 --addv c '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:13:26.054 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:13:26.054 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: generated fsid 1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd 2024-09-10T23:13:26.055 INFO:teuthology.orchestra.run.smithi090.stdout:setting min_mon_release = quincy 2024-09-10T23:13:26.055 INFO:teuthology.orchestra.run.smithi090.stdout:epoch 0 2024-09-10T23:13:26.055 INFO:teuthology.orchestra.run.smithi090.stdout:fsid 1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd 2024-09-10T23:13:26.055 INFO:teuthology.orchestra.run.smithi090.stdout:last_changed 2024-09-10T23:13:26.054965+0000 2024-09-10T23:13:26.055 INFO:teuthology.orchestra.run.smithi090.stdout:created 2024-09-10T23:13:26.054965+0000 2024-09-10T23:13:26.055 INFO:teuthology.orchestra.run.smithi090.stdout:min_mon_release 17 (quincy) 2024-09-10T23:13:26.055 INFO:teuthology.orchestra.run.smithi090.stdout:election_strategy: 1 2024-09-10T23:13:26.055 INFO:teuthology.orchestra.run.smithi090.stdout:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-09-10T23:13:26.055 INFO:teuthology.orchestra.run.smithi090.stdout:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-10T23:13:26.055 INFO:teuthology.orchestra.run.smithi090.stdout:2: [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] mon.c 2024-09-10T23:13:26.055 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-10T23:13:26.056 DEBUG:teuthology.orchestra.run.smithi090:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T23:13:26.071 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd... 2024-09-10T23:13:26.072 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:13:26.114 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:13:26.154 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2024-09-10T23:13:26.154 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2024-09-10T23:13:26.155 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:13:26.155 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2024-09-10T23:13:26.155 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.155 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2024-09-10T23:13:26.155 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.155 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2024-09-10T23:13:26.155 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.155 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2024-09-10T23:13:26.155 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2024-09-10T23:13:26.155 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.155 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2024-09-10T23:13:26.155 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2024-09-10T23:13:26.155 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.155 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:13:26.156 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2024-09-10T23:13:26.156 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.156 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:13:26.156 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:13:26.156 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.156 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2024-09-10T23:13:26.156 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.156 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2024-09-10T23:13:26.156 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2024-09-10T23:13:26.156 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:13:26.156 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:13:26.156 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2024-09-10T23:13:26.156 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:13:26.156 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2024-09-10T23:13:26.157 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:13:26.157 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:13:26.157 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2024-09-10T23:13:26.157 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.157 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:13:26.157 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.157 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2024-09-10T23:13:26.157 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.157 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2024-09-10T23:13:26.157 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.157 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2024-09-10T23:13:26.157 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2024-09-10T23:13:26.157 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2024-09-10T23:13:26.157 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.90,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-09-10T23:13:26.158 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on skipped message = False 2024-09-10T23:13:26.158 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = 1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd 2024-09-10T23:13:26.158 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.158 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2024-09-10T23:13:26.158 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2024-09-10T23:13:26.158 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.158 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2024-09-10T23:13:26.158 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2024-09-10T23:13:26.158 INFO:teuthology.orchestra.run.smithi090.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:13:26.158 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.158 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2024-09-10T23:13:26.158 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2024-09-10T23:13:26.158 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.158 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2024-09-10T23:13:26.159 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2024-09-10T23:13:26.159 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2024-09-10T23:13:26.159 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug trim objects = true 2024-09-10T23:13:26.159 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.159 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2024-09-10T23:13:26.159 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2024-09-10T23:13:26.159 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.159 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:13:26.159 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.159 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2024-09-10T23:13:26.159 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.159 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2024-09-10T23:13:26.159 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.159 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:13:26.159 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2024-09-10T23:13:26.160 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.160 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2024-09-10T23:13:26.160 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2024-09-10T23:13:26.160 INFO:teuthology.orchestra.run.smithi090.stdout: bdev async discard = True 2024-09-10T23:13:26.160 INFO:teuthology.orchestra.run.smithi090.stdout: bdev enable discard = True 2024-09-10T23:13:26.160 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore allocator = bitmap 2024-09-10T23:13:26.160 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2024-09-10T23:13:26.160 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2024-09-10T23:13:26.160 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 1/20 2024-09-10T23:13:26.160 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 1/20 2024-09-10T23:13:26.160 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-10T23:13:26.160 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2024-09-10T23:13:26.160 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 4/10 2024-09-10T23:13:26.160 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:13:26.160 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2024-09-10T23:13:26.161 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:13:26.161 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:13:26.161 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2024-09-10T23:13:26.161 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.161 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2024-09-10T23:13:26.161 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-10T23:13:26.161 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2024-09-10T23:13:26.161 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-10T23:13:26.161 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-10T23:13:26.161 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:13:26.161 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:13:26.161 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2024-09-10T23:13:26.161 INFO:teuthology.orchestra.run.smithi090.stdout: client mount timeout = 30 2024-09-10T23:13:26.161 INFO:teuthology.orchestra.run.smithi090.stdout: debug client = 20 2024-09-10T23:13:26.162 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.162 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2024-09-10T23:13:26.162 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-10T23:13:26.162 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-10T23:13:26.162 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2024-09-10T23:13:26.162 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-10T23:13:26.162 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2024-09-10T23:13:26.162 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2024-09-10T23:13:26.162 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:13:26.162 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2024-09-10T23:13:26.162 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2024-09-10T23:13:26.162 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:13:26.162 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.162 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:13:26.162 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:13:26.162 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:13:26.163 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.163 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:13:26.163 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:13:26.163 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:13:26.163 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.163 INFO:teuthology.orchestra.run.smithi090.stdout: # 1m isn't quite enough 2024-09-10T23:13:26.163 INFO:teuthology.orchestra.run.smithi090.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:13:26.163 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.163 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:13:26.163 INFO:teuthology.orchestra.run.smithi090.stdout: mon down mkfs grace = 300 2024-09-10T23:13:26.163 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:13:26.163 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2024-09-10T23:13:26.163 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2024-09-10T23:13:26.163 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2024-09-10T23:13:26.164 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2024-09-10T23:13:26.164 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:13:26.164 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:13:26.164 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = "" 2024-09-10T23:13:26.164 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2024-09-10T23:13:26.164 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2024-09-10T23:13:26.164 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2024-09-10T23:13:26.164 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-09-10T23:13:26.164 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2024-09-10T23:13:26.164 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2024-09-10T23:13:26.164 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2024-09-10T23:13:26.165 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2024-09-10T23:13:26.165 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2024-09-10T23:13:26.165 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:13:26.165 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2024-09-10T23:13:26.165 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.165 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2024-09-10T23:13:26.165 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.165 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2024-09-10T23:13:26.165 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.165 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2024-09-10T23:13:26.165 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2024-09-10T23:13:26.166 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.166 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2024-09-10T23:13:26.166 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2024-09-10T23:13:26.166 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.166 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:13:26.166 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2024-09-10T23:13:26.166 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.166 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:13:26.166 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:13:26.166 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.166 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2024-09-10T23:13:26.166 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.166 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2024-09-10T23:13:26.166 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2024-09-10T23:13:26.166 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:13:26.167 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:13:26.167 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2024-09-10T23:13:26.167 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:13:26.167 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2024-09-10T23:13:26.167 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:13:26.167 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:13:26.167 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2024-09-10T23:13:26.167 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.167 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:13:26.167 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.167 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2024-09-10T23:13:26.167 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.167 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2024-09-10T23:13:26.167 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.168 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2024-09-10T23:13:26.168 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2024-09-10T23:13:26.168 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2024-09-10T23:13:26.168 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = "172.21.15.90,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-09-10T23:13:26.168 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on skipped message = False 2024-09-10T23:13:26.168 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = 1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd 2024-09-10T23:13:26.168 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.168 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2024-09-10T23:13:26.168 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2024-09-10T23:13:26.168 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.168 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2024-09-10T23:13:26.168 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2024-09-10T23:13:26.168 INFO:teuthology.orchestra.run.smithi171.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:13:26.168 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.168 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2024-09-10T23:13:26.169 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2024-09-10T23:13:26.169 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.169 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2024-09-10T23:13:26.169 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2024-09-10T23:13:26.169 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2024-09-10T23:13:26.169 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug trim objects = true 2024-09-10T23:13:26.169 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.169 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2024-09-10T23:13:26.169 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2024-09-10T23:13:26.169 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.169 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:13:26.169 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.169 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2024-09-10T23:13:26.170 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.170 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2024-09-10T23:13:26.170 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.170 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:13:26.170 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2024-09-10T23:13:26.170 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.170 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2024-09-10T23:13:26.170 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2024-09-10T23:13:26.170 INFO:teuthology.orchestra.run.smithi171.stdout: bdev async discard = True 2024-09-10T23:13:26.170 INFO:teuthology.orchestra.run.smithi171.stdout: bdev enable discard = True 2024-09-10T23:13:26.170 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore allocator = bitmap 2024-09-10T23:13:26.170 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2024-09-10T23:13:26.170 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2024-09-10T23:13:26.170 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 1/20 2024-09-10T23:13:26.171 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 1/20 2024-09-10T23:13:26.171 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-10T23:13:26.171 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2024-09-10T23:13:26.171 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 4/10 2024-09-10T23:13:26.171 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:13:26.171 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2024-09-10T23:13:26.171 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:13:26.171 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:13:26.171 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2024-09-10T23:13:26.171 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.171 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2024-09-10T23:13:26.171 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-10T23:13:26.172 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2024-09-10T23:13:26.172 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-09-10T23:13:26.172 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-09-10T23:13:26.172 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:13:26.172 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:13:26.172 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2024-09-10T23:13:26.172 INFO:teuthology.orchestra.run.smithi171.stdout: client mount timeout = 30 2024-09-10T23:13:26.172 INFO:teuthology.orchestra.run.smithi171.stdout: debug client = 20 2024-09-10T23:13:26.172 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.172 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2024-09-10T23:13:26.172 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-10T23:13:26.172 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-09-10T23:13:26.172 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2024-09-10T23:13:26.173 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-09-10T23:13:26.173 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2024-09-10T23:13:26.173 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2024-09-10T23:13:26.173 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:13:26.173 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2024-09-10T23:13:26.173 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2024-09-10T23:13:26.173 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:13:26.173 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.173 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:13:26.173 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:13:26.173 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:13:26.173 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.173 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:13:26.173 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:13:26.173 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:13:26.174 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.174 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2024-09-10T23:13:26.174 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:13:26.174 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.174 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:13:26.174 INFO:teuthology.orchestra.run.smithi171.stdout: mon down mkfs grace = 300 2024-09-10T23:13:26.174 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:13:26.174 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2024-09-10T23:13:26.174 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2024-09-10T23:13:26.174 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = true 2024-09-10T23:13:26.174 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2024-09-10T23:13:26.174 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:13:26.174 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:13:26.174 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = "" 2024-09-10T23:13:26.174 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2024-09-10T23:13:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b] 2024-09-10T23:13:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c] 2024-09-10T23:13:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2024-09-10T23:13:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2024-09-10T23:13:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2024-09-10T23:13:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.d] 2024-09-10T23:13:26.176 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T23:13:26.176 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T23:13:26.272 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T23:13:26.272 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:26.272 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T23:13:26.287 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:26.287 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T23:13:26.342 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:13:26.343 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:26.343 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T23:13:26.343 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T23:13:26.417 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:26.417 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:13:26.472 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:13:26.472 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:13:26.472 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T23:13:26.472 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T23:13:26.507 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:13:26.507 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:13:26.563 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T23:13:26.563 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T23:13:26.563 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T23:13:26.614 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T23:13:26.617 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T23:13:26.671 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T23:13:26.674 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T23:13:26.674 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T23:13:26.725 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T23:13:26.727 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-10T23:13:26.751 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T23:13:26.842 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T23:13:26.845 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-10T23:13:26.869 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T23:13:26.920 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T23:13:26.923 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-10T23:13:26.948 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T23:13:27.039 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T23:13:27.042 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-10T23:13:27.066 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T23:13:27.066 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T23:13:27.108 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T23:13:27.120 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-10T23:13:27.201 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-10T23:13:27.214 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T23:13:27.255 INFO:teuthology.orchestra.run.smithi171.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-10T23:13:27.268 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-10T23:13:27.350 INFO:teuthology.orchestra.run.smithi171.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-10T23:13:27.362 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T23:13:27.363 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T23:13:27.363 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T23:13:27.388 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T23:13:27.388 INFO:tasks.ceph:role: osd.0 2024-09-10T23:13:27.388 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:13:27.388 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T23:13:27.460 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T23:13:27.460 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T23:13:27.461 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T23:13:27.461 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T23:13:27.461 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T23:13:27.461 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-09-10T23:13:27.461 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T23:13:27.461 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T23:13:27.461 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T23:13:27.461 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T23:13:27.962 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-09-10T23:13:27.964 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-09-10T23:13:27.964 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T23:13:28.098 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T23:13:28.129 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T23:13:28.195 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T23:13:28.195 INFO:tasks.ceph:role: osd.1 2024-09-10T23:13:28.195 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:13:28.195 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T23:13:28.268 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T23:13:28.268 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T23:13:28.268 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T23:13:28.268 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T23:13:28.268 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T23:13:28.269 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-09-10T23:13:28.269 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T23:13:28.269 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T23:13:28.269 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T23:13:28.269 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T23:13:28.736 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-09-10T23:13:28.739 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-09-10T23:13:28.739 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-10T23:13:28.836 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T23:13:28.866 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T23:13:28.933 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T23:13:28.933 INFO:tasks.ceph:role: osd.2 2024-09-10T23:13:28.933 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:13:28.933 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T23:13:29.006 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T23:13:29.006 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T23:13:29.006 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T23:13:29.006 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T23:13:29.006 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T23:13:29.006 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-09-10T23:13:29.006 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T23:13:29.007 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T23:13:29.007 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T23:13:29.007 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T23:13:29.488 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-09-10T23:13:29.490 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-09-10T23:13:29.490 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-10T23:13:29.643 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T23:13:29.674 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T23:13:29.740 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T23:13:29.740 INFO:tasks.ceph:role: osd.3 2024-09-10T23:13:29.741 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:13:29.741 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T23:13:29.814 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T23:13:29.815 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T23:13:29.815 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T23:13:29.816 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T23:13:29.816 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T23:13:29.816 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-09-10T23:13:29.816 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T23:13:29.816 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T23:13:29.816 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T23:13:29.816 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T23:13:30.334 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-09-10T23:13:30.337 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-09-10T23:13:30.337 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-10T23:13:30.488 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T23:13:30.523 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:13:30.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:13:30.625+0000 7f55e1e12640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T23:13:30.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:13:30.625+0000 7f55e1e12640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T23:13:30.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:13:30.625+0000 7f55e1e12640 -1 bdev(0x5600984e7800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T23:13:30.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:13:30.625+0000 7f55e1e12640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T23:13:33.782 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T23:13:33.812 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:13:33.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:13:33.900+0000 7f4c09e2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T23:13:33.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:13:33.900+0000 7f4c09e2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T23:13:33.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:13:33.900+0000 7f4c09e2c640 -1 bdev(0x563cb4f27800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T23:13:33.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:13:33.901+0000 7f4c09e2c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T23:13:37.076 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T23:13:37.110 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:13:37.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:13:37.202+0000 7f9bf8e0b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T23:13:37.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:13:37.203+0000 7f9bf8e0b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T23:13:37.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:13:37.203+0000 7f9bf8e0b640 -1 bdev(0x564c2c085800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T23:13:37.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:13:37.203+0000 7f9bf8e0b640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T23:13:40.360 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T23:13:40.388 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:13:40.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:13:40.476+0000 7fd502e1a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T23:13:40.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:13:40.477+0000 7fd502e1a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T23:13:40.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:13:40.477+0000 7fd502e1a640 -1 bdev(0x559a44815800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T23:13:40.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:13:40.477+0000 7fd502e1a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T23:13:43.638 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T23:13:43.667 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-10T23:13:43.697 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T23:13:43.697 INFO:tasks.ceph:role: osd.4 2024-09-10T23:13:43.697 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:13:43.698 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T23:13:43.775 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T23:13:43.775 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T23:13:43.775 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T23:13:43.775 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T23:13:43.775 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T23:13:43.775 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-09-10T23:13:43.775 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T23:13:43.776 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T23:13:43.776 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T23:13:43.776 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T23:13:44.291 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-09-10T23:13:44.293 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-09-10T23:13:44.293 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-10T23:13:44.422 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-10T23:13:44.457 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-10T23:13:44.525 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T23:13:44.526 INFO:tasks.ceph:role: osd.5 2024-09-10T23:13:44.526 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:13:44.526 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T23:13:44.600 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T23:13:44.600 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T23:13:44.600 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T23:13:44.600 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T23:13:44.600 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T23:13:44.600 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-09-10T23:13:44.600 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T23:13:44.600 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T23:13:44.600 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T23:13:44.600 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T23:13:45.045 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-09-10T23:13:45.047 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-09-10T23:13:45.047 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-10T23:13:45.137 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-10T23:13:45.166 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-10T23:13:45.231 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T23:13:45.231 INFO:tasks.ceph:role: osd.6 2024-09-10T23:13:45.232 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:13:45.232 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T23:13:45.305 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T23:13:45.305 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T23:13:45.305 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T23:13:45.305 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T23:13:45.305 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T23:13:45.305 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-09-10T23:13:45.306 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T23:13:45.306 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T23:13:45.306 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T23:13:45.306 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T23:13:45.792 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-09-10T23:13:45.802 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-09-10T23:13:45.802 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-10T23:13:45.927 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-10T23:13:45.958 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-10T23:13:46.023 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T23:13:46.023 INFO:tasks.ceph:role: osd.7 2024-09-10T23:13:46.023 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:13:46.023 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T23:13:46.095 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T23:13:46.096 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T23:13:46.096 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T23:13:46.096 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T23:13:46.096 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T23:13:46.096 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-09-10T23:13:46.096 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T23:13:46.096 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T23:13:46.096 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T23:13:46.096 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T23:13:46.598 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-09-10T23:13:46.600 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-09-10T23:13:46.600 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-10T23:13:46.744 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-10T23:13:46.775 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:13:46.873 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:13:46.872+0000 7fe1a77fd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-10T23:13:46.873 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:13:46.872+0000 7fe1a77fd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-10T23:13:46.873 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:13:46.872+0000 7fe1a77fd640 -1 bdev(0x556d3aa2d800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-10T23:13:46.873 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:13:46.872+0000 7fe1a77fd640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-10T23:13:50.030 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T23:13:50.059 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:13:50.149 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:13:50.148+0000 7fb85ba0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-10T23:13:50.150 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:13:50.149+0000 7fb85ba0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-10T23:13:50.150 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:13:50.149+0000 7fb85ba0d640 -1 bdev(0x55d617f0d800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-10T23:13:50.150 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:13:50.149+0000 7fb85ba0d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-10T23:13:53.066 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T23:13:53.094 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:13:53.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:13:53.180+0000 7f11aa412640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-10T23:13:53.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:13:53.180+0000 7f11aa412640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-10T23:13:53.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:13:53.180+0000 7f11aa412640 -1 bdev(0x562485b35800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-10T23:13:53.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:13:53.180+0000 7f11aa412640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-10T23:13:54.201 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:13:54.204 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:13:56.104 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T23:13:56.130 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:13:56.218 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:13:56.216+0000 7f69355c1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-10T23:13:56.218 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:13:56.216+0000 7f69355c1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-10T23:13:56.218 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:13:56.216+0000 7f69355c1640 -1 bdev(0x55651b44b800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-10T23:13:56.218 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:13:56.216+0000 7f69355c1640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-10T23:13:59.131 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T23:13:59.161 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T23:13:59.161 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:59.161 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-10T23:13:59.191 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:59.192 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-10T23:13:59.260 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:59.261 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-10T23:13:59.329 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:59.329 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T23:13:59.396 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:59.397 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T23:13:59.464 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:59.464 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T23:13:59.530 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:13:59.530 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T23:13:59.596 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:13:59.596 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T23:13:59.625 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:13:59.625 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-10T23:13:59.695 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:13:59.695 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-10T23:13:59.762 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:13:59.762 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-10T23:13:59.829 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:13:59.829 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-10T23:13:59.896 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:13:59.896 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-10T23:13:59.962 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:13:59.962 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-10T23:14:00.028 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:14:00.028 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T23:14:00.049 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:14:00.050 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-10T23:14:00.106 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:14:00.107 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-10T23:14:00.122 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:14:00.123 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-10T23:14:00.178 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T23:14:00.178 DEBUG:teuthology.orchestra.run.smithi090:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T23:14:00.180 DEBUG:teuthology.orchestra.run.smithi171:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T23:14:00.222 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.y] 2024-09-10T23:14:00.222 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCW0uBmkRSfJBAAWPpV5e4zeX0Es78Xqh9pYw== 2024-09-10T23:14:00.222 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-09-10T23:14:00.222 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCW0uBm/QY6KxAAKT1mZg/6ZcszcNrPmouZfw== 2024-09-10T23:14:00.222 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2024-09-10T23:14:00.222 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCW0uBmDVE4MhAAHal/PtI10hL4nKdTUO5BiQ== 2024-09-10T23:14:00.222 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.0] 2024-09-10T23:14:00.222 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCa0uBmZKxTJRAAfEBB/vykopmDbmREyy227g== 2024-09-10T23:14:00.222 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.1] 2024-09-10T23:14:00.223 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCd0uBmJHG8NRAAS8QD8Zgrxrxddq7kN4P9Ag== 2024-09-10T23:14:00.223 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.2] 2024-09-10T23:14:00.223 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCh0uBmtUUmDBAAmYRv9P/wjX8HLVkLatoXuQ== 2024-09-10T23:14:00.223 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.3] 2024-09-10T23:14:00.223 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCk0uBm4397HBAAGZK0ktD0ORY/0CPlMprYFg== 2024-09-10T23:14:00.223 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.x] 2024-09-10T23:14:00.223 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCW0uBm4r0EKBAAIZ4VjoTsUpdB6KFbi7EQLQ== 2024-09-10T23:14:00.223 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2024-09-10T23:14:00.223 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCW0uBmSqPhNhAA3flpsOGFszFMeaPUoHAtJg== 2024-09-10T23:14:00.223 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2024-09-10T23:14:00.223 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCX0uBmr3lfAhAAFdZ7zvJmGNFHRwCr+mdY7w== 2024-09-10T23:14:00.223 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.4] 2024-09-10T23:14:00.223 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCq0uBmBaMINBAAkuhNrc4YFAYQfcxMQenCBQ== 2024-09-10T23:14:00.223 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.5] 2024-09-10T23:14:00.224 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCu0uBmLOrnCBAAwZTy+62ZN3g5jfH20jB4qw== 2024-09-10T23:14:00.224 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.6] 2024-09-10T23:14:00.224 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCx0uBmr4bYChAAdWog9uHnYgiiXniefs25DA== 2024-09-10T23:14:00.224 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.7] 2024-09-10T23:14:00.224 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQC00uBmhU7+DBAAEagAuXuCs1v/vDhIkapi+g== 2024-09-10T23:14:00.224 INFO:teuthology.orchestra.run.smithi090.stdout:[client.0] 2024-09-10T23:14:00.224 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCX0uBmiYBwBhAABMV9erpQ+KZlTmf0kDZ0gw== 2024-09-10T23:14:00.224 INFO:teuthology.orchestra.run.smithi090.stdout:[client.2] 2024-09-10T23:14:00.224 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCX0uBmJYcKDBAArXISnuT+R9uzuQnL3V+wSg== 2024-09-10T23:14:00.224 INFO:teuthology.orchestra.run.smithi090.stdout:[client.1] 2024-09-10T23:14:00.224 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCX0uBm+TBDDxAA4o+iZ4PwpBRpY++ATzt+wg== 2024-09-10T23:14:00.224 INFO:teuthology.orchestra.run.smithi090.stdout:[client.3] 2024-09-10T23:14:00.224 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCX0uBmPQvkFBAAaCikPByOvk5xUzTWXdcFPA== 2024-09-10T23:14:00.242 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.y] 2024-09-10T23:14:00.242 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCW0uBmkRSfJBAAWPpV5e4zeX0Es78Xqh9pYw== 2024-09-10T23:14:00.242 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2024-09-10T23:14:00.242 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCW0uBm/QY6KxAAKT1mZg/6ZcszcNrPmouZfw== 2024-09-10T23:14:00.242 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2024-09-10T23:14:00.242 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCW0uBmDVE4MhAAHal/PtI10hL4nKdTUO5BiQ== 2024-09-10T23:14:00.242 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.0] 2024-09-10T23:14:00.242 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCa0uBmZKxTJRAAfEBB/vykopmDbmREyy227g== 2024-09-10T23:14:00.242 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.1] 2024-09-10T23:14:00.242 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCd0uBmJHG8NRAAS8QD8Zgrxrxddq7kN4P9Ag== 2024-09-10T23:14:00.243 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.2] 2024-09-10T23:14:00.243 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCh0uBmtUUmDBAAmYRv9P/wjX8HLVkLatoXuQ== 2024-09-10T23:14:00.243 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.3] 2024-09-10T23:14:00.243 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCk0uBm4397HBAAGZK0ktD0ORY/0CPlMprYFg== 2024-09-10T23:14:00.243 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.x] 2024-09-10T23:14:00.243 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCW0uBm4r0EKBAAIZ4VjoTsUpdB6KFbi7EQLQ== 2024-09-10T23:14:00.243 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2024-09-10T23:14:00.243 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCW0uBmSqPhNhAA3flpsOGFszFMeaPUoHAtJg== 2024-09-10T23:14:00.243 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.d] 2024-09-10T23:14:00.243 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCX0uBmr3lfAhAAFdZ7zvJmGNFHRwCr+mdY7w== 2024-09-10T23:14:00.243 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.4] 2024-09-10T23:14:00.243 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCq0uBmBaMINBAAkuhNrc4YFAYQfcxMQenCBQ== 2024-09-10T23:14:00.243 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.5] 2024-09-10T23:14:00.243 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCu0uBmLOrnCBAAwZTy+62ZN3g5jfH20jB4qw== 2024-09-10T23:14:00.244 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.6] 2024-09-10T23:14:00.244 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCx0uBmr4bYChAAdWog9uHnYgiiXniefs25DA== 2024-09-10T23:14:00.244 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.7] 2024-09-10T23:14:00.244 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQC00uBmhU7+DBAAEagAuXuCs1v/vDhIkapi+g== 2024-09-10T23:14:00.244 INFO:teuthology.orchestra.run.smithi171.stdout:[client.0] 2024-09-10T23:14:00.244 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCX0uBmiYBwBhAABMV9erpQ+KZlTmf0kDZ0gw== 2024-09-10T23:14:00.244 INFO:teuthology.orchestra.run.smithi171.stdout:[client.2] 2024-09-10T23:14:00.244 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCX0uBmJYcKDBAArXISnuT+R9uzuQnL3V+wSg== 2024-09-10T23:14:00.244 INFO:teuthology.orchestra.run.smithi171.stdout:[client.1] 2024-09-10T23:14:00.244 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCX0uBm+TBDDxAA4o+iZ4PwpBRpY++ATzt+wg== 2024-09-10T23:14:00.244 INFO:teuthology.orchestra.run.smithi171.stdout:[client.3] 2024-09-10T23:14:00.244 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCX0uBmPQvkFBAAaCikPByOvk5xUzTWXdcFPA== 2024-09-10T23:14:00.245 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T23:14:00.269 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T23:14:00.337 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T23:14:00.339 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T23:14:00.393 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T23:14:00.396 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T23:14:00.450 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:14:00.452 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:14:00.503 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:14:00.505 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:14:00.557 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:14:00.559 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:14:00.610 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:14:00.613 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:14:00.665 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T23:14:00.667 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T23:14:00.718 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T23:14:00.720 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T23:14:00.774 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T23:14:00.777 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T23:14:00.831 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:14:00.833 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:14:00.884 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:14:00.886 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:14:00.939 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:14:00.941 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:14:00.992 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:14:00.994 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:14:01.045 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T23:14:01.047 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T23:14:01.101 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T23:14:01.103 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T23:14:01.157 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T23:14:01.160 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T23:14:01.213 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T23:14:01.216 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T23:14:01.269 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T23:14:01.270 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T23:14:01.294 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T23:14:01.389 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T23:14:01.414 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-10T23:14:01.440 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T23:14:01.536 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-10T23:14:01.560 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-10T23:14:01.626 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T23:14:01.721 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-10T23:14:01.745 DEBUG:teuthology.orchestra.run.smithi090:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:14:01.748 DEBUG:teuthology.orchestra.run.smithi171:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:14:01.800 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T23:14:01.801 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T23:14:01.801 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T23:14:01.803 INFO:tasks.ceph.mon.a:Started 2024-09-10T23:14:01.803 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T23:14:01.804 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T23:14:01.843 INFO:tasks.ceph.mon.b:Started 2024-09-10T23:14:01.843 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T23:14:01.843 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T23:14:01.845 INFO:tasks.ceph.mon.c:Started 2024-09-10T23:14:01.845 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T23:14:01.845 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-10T23:14:01.846 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-10T23:14:01.848 INFO:tasks.ceph.mgr.y:Started 2024-09-10T23:14:01.848 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T23:14:01.848 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T23:14:01.850 INFO:tasks.ceph.mgr.x:Started 2024-09-10T23:14:01.850 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-10T23:14:01.850 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-10T23:14:01.852 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-10T23:14:01.853 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-10T23:14:01.895 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-10T23:14:01.896 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-10T23:14:01.938 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-10T23:14:01.939 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-10T23:14:01.982 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-10T23:14:01.982 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-10T23:14:02.024 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-10T23:14:02.025 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-10T23:14:02.070 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-10T23:14:02.070 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-10T23:14:02.112 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-10T23:14:02.113 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-10T23:14:02.156 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-10T23:14:02.157 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-10T23:14:02.199 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-10T23:14:02.200 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-10T23:14:02.243 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-10T23:14:02.244 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-10T23:14:02.286 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-10T23:14:02.287 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-10T23:14:02.330 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-10T23:14:02.331 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-10T23:14:02.374 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T23:14:02.375 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-10T23:14:02.418 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T23:14:02.419 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-10T23:14:02.461 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-10T23:14:02.462 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-10T23:14:02.504 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T23:14:02.505 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T23:14:02.548 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-10T23:14:02.548 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-10T23:14:02.590 DEBUG:tasks.ceph:set 18 configs 2024-09-10T23:14:02.591 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.491 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.524 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.544+0000 7fc5cc382640 1 -- 172.21.15.90:0/2060358551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5c40b5260 msgr2=0x7fc5c40b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:12.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.544+0000 7fc5cc382640 1 --2- 172.21.15.90:0/2060358551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5c40b5260 0x7fc5c40b4930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4006cf0 tx=0x7fc5b4013820 comp rx=0 tx=0).stop 2024-09-10T23:14:12.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.544+0000 7fc5cc382640 1 -- 172.21.15.90:0/2060358551 shutdown_connections 2024-09-10T23:14:12.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.544+0000 7fc5cc382640 1 --2- 172.21.15.90:0/2060358551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5c415afc0 0x7fc5c415b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.544+0000 7fc5cc382640 1 --2- 172.21.15.90:0/2060358551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5c40b5260 0x7fc5c40b4930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.544+0000 7fc5cc382640 1 --2- 172.21.15.90:0/2060358551 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5a8004c80 0x7fc5c41f50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.544+0000 7fc5cc382640 1 -- 172.21.15.90:0/2060358551 >> 172.21.15.90:0/2060358551 conn(0x7fc5c40d0dd0 msgr2=0x7fc5c415e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:12.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.544+0000 7fc5cc382640 1 -- 172.21.15.90:0/2060358551 shutdown_connections 2024-09-10T23:14:12.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.544+0000 7fc5cc382640 1 -- 172.21.15.90:0/2060358551 wait complete. 2024-09-10T23:14:12.555 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.556 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.556 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.572+0000 7f91ef840640 1 -- 172.21.15.90:0/4035167494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91cc009840 msgr2=0x7f91cc0112f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:12.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.572+0000 7f91ef840640 1 --2- 172.21.15.90:0/4035167494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91cc009840 0x7f91cc0112f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f91e4005d00 tx=0x7f91e402c390 comp rx=0 tx=0).stop 2024-09-10T23:14:12.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.572+0000 7f91edddd640 1 -- 172.21.15.90:0/4035167494 reap_dead start 2024-09-10T23:14:12.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.572+0000 7f91ef840640 1 -- 172.21.15.90:0/4035167494 shutdown_connections 2024-09-10T23:14:12.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.572+0000 7f91ef840640 1 -- 172.21.15.90:0/4035167494 >> 172.21.15.90:0/4035167494 conn(0x7f91e80d0dd0 msgr2=0x7f91e80d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:12.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.572+0000 7f91ef840640 1 -- 172.21.15.90:0/4035167494 shutdown_connections 2024-09-10T23:14:12.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.572+0000 7f91ef840640 1 -- 172.21.15.90:0/4035167494 wait complete. 2024-09-10T23:14:12.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.573+0000 7f91ef840640 1 Processor -- start 2024-09-10T23:14:12.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.573+0000 7f91ef840640 1 -- start start 2024-09-10T23:14:12.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.574+0000 7f91ef840640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91cc009840 0x7f91e814bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:12.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.574+0000 7f91ef840640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91e80cacf0 0x7f91e80c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:12.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.574+0000 7f91ef840640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91e80c83e0 0x7f91e814e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:12.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.574+0000 7f91ef840640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f91e815e3f0 con 0x7f91e80c83e0 2024-09-10T23:14:12.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.574+0000 7f91ef840640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f91e815e270 con 0x7f91cc009840 2024-09-10T23:14:12.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.574+0000 7f91ef840640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f91e80d06e0 con 0x7f91e80cacf0 2024-09-10T23:14:12.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.574+0000 7f91edddd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91e80c83e0 0x7f91e814e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:12.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.574+0000 7f91edddd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91e80c83e0 0x7f91e814e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48368/0 (socket says 172.21.15.90:48368) 2024-09-10T23:14:12.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.574+0000 7f91edddd640 1 -- 172.21.15.90:0/887611488 learned_addr learned my addr 172.21.15.90:0/887611488 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:12.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.574+0000 7f91ecddb640 1 --2- 172.21.15.90:0/887611488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91e80cacf0 0x7f91e80c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:12.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.574+0000 7f91ed5dc640 1 --2- 172.21.15.90:0/887611488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91cc009840 0x7f91e814bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:12.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.574+0000 7f91ecddb640 1 -- 172.21.15.90:0/887611488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91cc009840 msgr2=0x7f91e814bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:12.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.574+0000 7f91ecddb640 1 --2- 172.21.15.90:0/887611488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91cc009840 0x7f91e814bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.574+0000 7f91ecddb640 1 -- 172.21.15.90:0/887611488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91e80c83e0 msgr2=0x7f91e814e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:12.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.574+0000 7f91ecddb640 1 --2- 172.21.15.90:0/887611488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91e80c83e0 0x7f91e814e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.574+0000 7f91ecddb640 1 -- 172.21.15.90:0/887611488 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e814f490 con 0x7f91e80cacf0 2024-09-10T23:14:12.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.574+0000 7f91edddd640 1 --2- 172.21.15.90:0/887611488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91e80c83e0 0x7f91e814e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:14:12.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.575+0000 7f91ecddb640 1 --2- 172.21.15.90:0/887611488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91e80cacf0 0x7f91e80c7ea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f91d8000c00 tx=0x7f91d8013820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:12.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.575+0000 7f91ddffb640 1 -- 172.21.15.90:0/887611488 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8023020 con 0x7f91e80cacf0 2024-09-10T23:14:12.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.575+0000 7f91ddffb640 1 -- 172.21.15.90:0/887611488 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91d801f710 con 0x7f91e80cacf0 2024-09-10T23:14:12.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.575+0000 7f91ef840640 1 -- 172.21.15.90:0/887611488 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e80ca210 con 0x7f91e80cacf0 2024-09-10T23:14:12.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.575+0000 7f91ddffb640 1 -- 172.21.15.90:0/887611488 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d801fb60 con 0x7f91e80cacf0 2024-09-10T23:14:12.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.575+0000 7f91ef840640 1 -- 172.21.15.90:0/887611488 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e80ca7d0 con 0x7f91e80cacf0 2024-09-10T23:14:12.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.575+0000 7f91ddffb640 1 -- 172.21.15.90:0/887611488 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f91d8012450 con 0x7f91e80cacf0 2024-09-10T23:14:12.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.575+0000 7f91ddffb640 1 -- 172.21.15.90:0/887611488 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f91d8028670 con 0x7f91e80cacf0 2024-09-10T23:14:12.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.576+0000 7f91ef840640 1 -- 172.21.15.90:0/887611488 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e80cc9c0 con 0x7f91e80cacf0 2024-09-10T23:14:12.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.578+0000 7f91ddffb640 1 -- 172.21.15.90:0/887611488 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f91e80cc9c0 con 0x7f91e80cacf0 2024-09-10T23:14:12.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.639+0000 7f91ef840640 1 -- 172.21.15.90:0/887611488 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f91e806a170 con 0x7f91e80cacf0 2024-09-10T23:14:12.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.644+0000 7f91ddffb640 1 -- 172.21.15.90:0/887611488 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v17)=0 v17) ==== 108+0+0 (secure 0 0 0) 0x7f91e806a170 con 0x7f91e80cacf0 2024-09-10T23:14:12.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.645+0000 7f91ef840640 1 -- 172.21.15.90:0/887611488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91e80cacf0 msgr2=0x7f91e80c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:12.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.645+0000 7f91ef840640 1 --2- 172.21.15.90:0/887611488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91e80cacf0 0x7f91e80c7ea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f91d8000c00 tx=0x7f91d8013820 comp rx=0 tx=0).stop 2024-09-10T23:14:12.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.645+0000 7f91ef840640 1 -- 172.21.15.90:0/887611488 shutdown_connections 2024-09-10T23:14:12.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.645+0000 7f91ef840640 1 --2- 172.21.15.90:0/887611488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91e80c83e0 0x7f91e814e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.645+0000 7f91ef840640 1 --2- 172.21.15.90:0/887611488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91e80cacf0 0x7f91e80c7ea0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.645+0000 7f91ef840640 1 --2- 172.21.15.90:0/887611488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91cc009840 0x7f91e814bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.645+0000 7f91ef840640 1 -- 172.21.15.90:0/887611488 >> 172.21.15.90:0/887611488 conn(0x7f91e80d0dd0 msgr2=0x7f91e815bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:12.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.645+0000 7f91ef840640 1 -- 172.21.15.90:0/887611488 shutdown_connections 2024-09-10T23:14:12.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.645+0000 7f91ef840640 1 -- 172.21.15.90:0/887611488 wait complete. 2024-09-10T23:14:12.656 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.656 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.656 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.705+0000 7efd894b8640 1 -- 172.21.15.90:0/3268011233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd6400ebf0 msgr2=0x7efd6400efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:12.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.705+0000 7efd894b8640 1 --2- 172.21.15.90:0/3268011233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd6400ebf0 0x7efd6400efd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd6400fff0 tx=0x7efd6c02d8b0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.705+0000 7efd837fe640 1 -- 172.21.15.90:0/3268011233 reap_dead start 2024-09-10T23:14:12.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.705+0000 7efd894b8640 1 -- 172.21.15.90:0/3268011233 shutdown_connections 2024-09-10T23:14:12.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.705+0000 7efd894b8640 1 --2- 172.21.15.90:0/3268011233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd6400ebf0 0x7efd6400efd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.705+0000 7efd894b8640 1 -- 172.21.15.90:0/3268011233 >> 172.21.15.90:0/3268011233 conn(0x7efd840d0dd0 msgr2=0x7efd840d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:12.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.705+0000 7efd894b8640 1 -- 172.21.15.90:0/3268011233 shutdown_connections 2024-09-10T23:14:12.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.705+0000 7efd894b8640 1 -- 172.21.15.90:0/3268011233 wait complete. 2024-09-10T23:14:12.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.706+0000 7efd894b8640 1 Processor -- start 2024-09-10T23:14:12.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.706+0000 7efd894b8640 1 -- start start 2024-09-10T23:14:12.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.707+0000 7efd894b8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd6400ebf0 0x7efd840c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:12.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.707+0000 7efd894b8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd840b6730 0x7efd841f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:12.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.707+0000 7efd894b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd841f5fe0 0x7efd8415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:12.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.707+0000 7efd894b8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efd84073790 con 0x7efd840b6730 2024-09-10T23:14:12.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.707+0000 7efd894b8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efd840cbb10 con 0x7efd6400ebf0 2024-09-10T23:14:12.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.707+0000 7efd894b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efd84073910 con 0x7efd841f5fe0 2024-09-10T23:14:12.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.707+0000 7efd827fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd840b6730 0x7efd841f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:12.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.707+0000 7efd827fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd840b6730 0x7efd841f5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48390/0 (socket says 172.21.15.90:48390) 2024-09-10T23:14:12.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.707+0000 7efd827fc640 1 -- 172.21.15.90:0/2917819435 learned_addr learned my addr 172.21.15.90:0/2917819435 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:12.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.707+0000 7efd837fe640 1 --2- 172.21.15.90:0/2917819435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd841f5fe0 0x7efd8415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:12.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.707+0000 7efd82ffd640 1 --2- 172.21.15.90:0/2917819435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd6400ebf0 0x7efd840c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:12.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.707+0000 7efd827fc640 1 -- 172.21.15.90:0/2917819435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd841f5fe0 msgr2=0x7efd8415aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:12.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.707+0000 7efd827fc640 1 --2- 172.21.15.90:0/2917819435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd841f5fe0 0x7efd8415aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.707+0000 7efd827fc640 1 -- 172.21.15.90:0/2917819435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd6400ebf0 msgr2=0x7efd840c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:12.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.707+0000 7efd827fc640 1 --2- 172.21.15.90:0/2917819435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd6400ebf0 0x7efd840c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.707+0000 7efd827fc640 1 -- 172.21.15.90:0/2917819435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd840c49a0 con 0x7efd840b6730 2024-09-10T23:14:12.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.708+0000 7efd827fc640 1 --2- 172.21.15.90:0/2917819435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd840b6730 0x7efd841f5aa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efd6c02dea0 tx=0x7efd6c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:12.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.708+0000 7efd7b7fe640 1 -- 172.21.15.90:0/2917819435 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c034ca0 con 0x7efd840b6730 2024-09-10T23:14:12.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.708+0000 7efd7b7fe640 1 -- 172.21.15.90:0/2917819435 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd6c0044e0 con 0x7efd840b6730 2024-09-10T23:14:12.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.708+0000 7efd894b8640 1 -- 172.21.15.90:0/2917819435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd840c4c80 con 0x7efd840b6730 2024-09-10T23:14:12.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.708+0000 7efd7b7fe640 1 -- 172.21.15.90:0/2917819435 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c005260 con 0x7efd840b6730 2024-09-10T23:14:12.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.708+0000 7efd894b8640 1 -- 172.21.15.90:0/2917819435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd840c5240 con 0x7efd840b6730 2024-09-10T23:14:12.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.708+0000 7efd7b7fe640 1 -- 172.21.15.90:0/2917819435 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7efd6c005400 con 0x7efd840b6730 2024-09-10T23:14:12.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.708+0000 7efd7b7fe640 1 -- 172.21.15.90:0/2917819435 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efd6c003690 con 0x7efd840b6730 2024-09-10T23:14:12.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.709+0000 7efd894b8640 1 -- 172.21.15.90:0/2917819435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd840cbe50 con 0x7efd840b6730 2024-09-10T23:14:12.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.711+0000 7efd7b7fe640 1 -- 172.21.15.90:0/2917819435 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7efd6c053070 con 0x7efd840b6730 2024-09-10T23:14:12.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.772+0000 7efd894b8640 1 -- 172.21.15.90:0/2917819435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7efd8406d750 con 0x7efd840b6730 2024-09-10T23:14:12.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.777+0000 7efd7b7fe640 1 -- 172.21.15.90:0/2917819435 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v18)=0 v18) ==== 115+0+0 (secure 0 0 0) 0x7efd6c019040 con 0x7efd840b6730 2024-09-10T23:14:12.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.778+0000 7efd894b8640 1 -- 172.21.15.90:0/2917819435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd840b6730 msgr2=0x7efd841f5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:12.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.778+0000 7efd894b8640 1 --2- 172.21.15.90:0/2917819435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd840b6730 0x7efd841f5aa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efd6c02dea0 tx=0x7efd6c0042f0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.778+0000 7efd894b8640 1 -- 172.21.15.90:0/2917819435 shutdown_connections 2024-09-10T23:14:12.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.778+0000 7efd894b8640 1 --2- 172.21.15.90:0/2917819435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd841f5fe0 0x7efd8415aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.778+0000 7efd894b8640 1 --2- 172.21.15.90:0/2917819435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd840b6730 0x7efd841f5aa0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.778+0000 7efd894b8640 1 --2- 172.21.15.90:0/2917819435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd6400ebf0 0x7efd840c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.778+0000 7efd894b8640 1 -- 172.21.15.90:0/2917819435 >> 172.21.15.90:0/2917819435 conn(0x7efd840d0dd0 msgr2=0x7efd8406cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:12.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.778+0000 7efd894b8640 1 -- 172.21.15.90:0/2917819435 shutdown_connections 2024-09-10T23:14:12.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.778+0000 7efd894b8640 1 -- 172.21.15.90:0/2917819435 wait complete. 2024-09-10T23:14:12.789 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.789 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.794+0000 7efd54752640 1 -- 172.21.15.90:0/1246156023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd3000f6c0 msgr2=0x7efd3000fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:12.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.794+0000 7efd54752640 1 --2- 172.21.15.90:0/1246156023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd3000f6c0 0x7efd3000fad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efd3c005e50 tx=0x7efd3c02d860 comp rx=0 tx=0).stop 2024-09-10T23:14:12.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.795+0000 7efd52cef640 1 -- 172.21.15.90:0/1246156023 reap_dead start 2024-09-10T23:14:12.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.795+0000 7efd54752640 1 -- 172.21.15.90:0/1246156023 shutdown_connections 2024-09-10T23:14:12.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.795+0000 7efd54752640 1 --2- 172.21.15.90:0/1246156023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd3000f6c0 0x7efd3000fad0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.795+0000 7efd54752640 1 -- 172.21.15.90:0/1246156023 >> 172.21.15.90:0/1246156023 conn(0x7efd4c0d1f30 msgr2=0x7efd4c0d2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:12.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.795+0000 7efd54752640 1 -- 172.21.15.90:0/1246156023 shutdown_connections 2024-09-10T23:14:12.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.795+0000 7efd54752640 1 -- 172.21.15.90:0/1246156023 wait complete. 2024-09-10T23:14:12.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.796+0000 7efd54752640 1 Processor -- start 2024-09-10T23:14:12.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.796+0000 7efd54752640 1 -- start start 2024-09-10T23:14:12.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd54752640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd3000f6c0 0x7efd4c0ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd54752640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd4c1f35f0 0x7efd4c15e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd54752640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd4c15e800 0x7efd4c150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd54752640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efd4c0d2dc0 con 0x7efd4c1f35f0 2024-09-10T23:14:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd54752640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efd4c0ce870 con 0x7efd4c15e800 2024-09-10T23:14:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd54752640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efd4c0ce9f0 con 0x7efd3000f6c0 2024-09-10T23:14:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd51ced640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd4c1f35f0 0x7efd4c15e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd51ced640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd4c1f35f0 0x7efd4c15e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48408/0 (socket says 172.21.15.90:48408) 2024-09-10T23:14:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd51ced640 1 -- 172.21.15.90:0/4241192127 learned_addr learned my addr 172.21.15.90:0/4241192127 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd524ee640 1 --2- 172.21.15.90:0/4241192127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd3000f6c0 0x7efd4c0ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd52cef640 1 --2- 172.21.15.90:0/4241192127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd4c15e800 0x7efd4c150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd51ced640 1 -- 172.21.15.90:0/4241192127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd3000f6c0 msgr2=0x7efd4c0ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd51ced640 1 --2- 172.21.15.90:0/4241192127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd3000f6c0 0x7efd4c0ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd51ced640 1 -- 172.21.15.90:0/4241192127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd4c15e800 msgr2=0x7efd4c150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:12.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd51ced640 1 --2- 172.21.15.90:0/4241192127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd4c15e800 0x7efd4c150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd51ced640 1 -- 172.21.15.90:0/4241192127 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4c15cb20 con 0x7efd4c1f35f0 2024-09-10T23:14:12.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd52cef640 1 --2- 172.21.15.90:0/4241192127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd4c15e800 0x7efd4c150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:12.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd51ced640 1 --2- 172.21.15.90:0/4241192127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd4c1f35f0 0x7efd4c15e2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efd3c012d30 tx=0x7efd3c034660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:12.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd42ffd640 1 -- 172.21.15.90:0/4241192127 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c045070 con 0x7efd4c1f35f0 2024-09-10T23:14:12.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd42ffd640 1 -- 172.21.15.90:0/4241192127 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd3c034a60 con 0x7efd4c1f35f0 2024-09-10T23:14:12.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd54752640 1 -- 172.21.15.90:0/4241192127 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd4c15ce00 con 0x7efd4c1f35f0 2024-09-10T23:14:12.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd42ffd640 1 -- 172.21.15.90:0/4241192127 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c03a070 con 0x7efd4c1f35f0 2024-09-10T23:14:12.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.797+0000 7efd54752640 1 -- 172.21.15.90:0/4241192127 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd4c15d3c0 con 0x7efd4c1f35f0 2024-09-10T23:14:12.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.798+0000 7efd42ffd640 1 -- 172.21.15.90:0/4241192127 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7efd3c040460 con 0x7efd4c1f35f0 2024-09-10T23:14:12.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.798+0000 7efd42ffd640 1 -- 172.21.15.90:0/4241192127 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efd3c035410 con 0x7efd4c1f35f0 2024-09-10T23:14:12.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.799+0000 7efd54752640 1 -- 172.21.15.90:0/4241192127 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd4c15ec10 con 0x7efd4c1f35f0 2024-09-10T23:14:12.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.800+0000 7efd42ffd640 1 -- 172.21.15.90:0/4241192127 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7efd4c15ec10 con 0x7efd4c1f35f0 2024-09-10T23:14:12.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.910+0000 7efd54752640 1 -- 172.21.15.90:0/4241192127 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7efd4c0cd7a0 con 0x7efd4c1f35f0 2024-09-10T23:14:12.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.915+0000 7efd42ffd640 1 -- 172.21.15.90:0/4241192127 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7efd3c04f070 con 0x7efd4c1f35f0 2024-09-10T23:14:12.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.916+0000 7efd54752640 1 -- 172.21.15.90:0/4241192127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd4c1f35f0 msgr2=0x7efd4c15e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:12.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.916+0000 7efd54752640 1 --2- 172.21.15.90:0/4241192127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd4c1f35f0 0x7efd4c15e2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efd3c012d30 tx=0x7efd3c034660 comp rx=0 tx=0).stop 2024-09-10T23:14:12.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.916+0000 7efd54752640 1 -- 172.21.15.90:0/4241192127 shutdown_connections 2024-09-10T23:14:12.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.916+0000 7efd54752640 1 --2- 172.21.15.90:0/4241192127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd4c15e800 0x7efd4c150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.916+0000 7efd54752640 1 --2- 172.21.15.90:0/4241192127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd4c1f35f0 0x7efd4c15e2c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.916+0000 7efd54752640 1 --2- 172.21.15.90:0/4241192127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd3000f6c0 0x7efd4c0ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:12.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.916+0000 7efd54752640 1 -- 172.21.15.90:0/4241192127 >> 172.21.15.90:0/4241192127 conn(0x7efd4c0d1f30 msgr2=0x7efd4c0b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:12.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.916+0000 7efd54752640 1 -- 172.21.15.90:0/4241192127 shutdown_connections 2024-09-10T23:14:12.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:12.916+0000 7efd54752640 1 -- 172.21.15.90:0/4241192127 wait complete. 2024-09-10T23:14:12.931 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.931 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.931 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.931 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.932 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.932 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.932 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi090') 2024-09-10T23:14:12.932 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T23:14:12.932 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T23:14:13.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.072+0000 7f526d975640 1 -- 172.21.15.90:0/3039557318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52680cd4f0 msgr2=0x7f52680b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:13.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.072+0000 7f526d975640 1 --2- 172.21.15.90:0/3039557318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52680cd4f0 0x7f52680b01b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5250009830 tx=0x7f525002a4a0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.072+0000 7f526d975640 1 -- 172.21.15.90:0/3039557318 shutdown_connections 2024-09-10T23:14:13.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.072+0000 7f526d975640 1 --2- 172.21.15.90:0/3039557318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52680cd4f0 0x7f52680b01b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.072+0000 7f526d975640 1 -- 172.21.15.90:0/3039557318 >> 172.21.15.90:0/3039557318 conn(0x7f5268073430 msgr2=0x7f52680742e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:13.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.072+0000 7f526d975640 1 -- 172.21.15.90:0/3039557318 shutdown_connections 2024-09-10T23:14:13.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.072+0000 7f526d975640 1 -- 172.21.15.90:0/3039557318 wait complete. 2024-09-10T23:14:13.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.073+0000 7f526d975640 1 Processor -- start 2024-09-10T23:14:13.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.074+0000 7f526d975640 1 -- start start 2024-09-10T23:14:13.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.074+0000 7f526d975640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52680688e0 0x7f52681f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:13.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.074+0000 7f526d975640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52680cd4f0 0x7f52680b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:13.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.074+0000 7f526d975640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f526815f4f0 0x7f526815cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:13.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.074+0000 7f526d975640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f52680cca10 con 0x7f52680688e0 2024-09-10T23:14:13.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.074+0000 7f526d975640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f52680cc890 con 0x7f526815f4f0 2024-09-10T23:14:13.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.074+0000 7f526d975640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f52680b0e00 con 0x7f52680cd4f0 2024-09-10T23:14:13.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.074+0000 7f5266ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52680688e0 0x7f52681f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:13.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.074+0000 7f5266ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52680688e0 0x7f52681f4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48422/0 (socket says 172.21.15.90:48422) 2024-09-10T23:14:13.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.074+0000 7f5266ffd640 1 -- 172.21.15.90:0/1139019330 learned_addr learned my addr 172.21.15.90:0/1139019330 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:13.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.074+0000 7f52677fe640 1 --2- 172.21.15.90:0/1139019330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f526815f4f0 0x7f526815cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:13.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.074+0000 7f525ffff640 1 --2- 172.21.15.90:0/1139019330 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52680cd4f0 0x7f52680b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:13.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.075+0000 7f5266ffd640 1 -- 172.21.15.90:0/1139019330 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52680cd4f0 msgr2=0x7f52680b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:13.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.075+0000 7f5266ffd640 1 --2- 172.21.15.90:0/1139019330 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52680cd4f0 0x7f52680b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.075+0000 7f5266ffd640 1 -- 172.21.15.90:0/1139019330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f526815f4f0 msgr2=0x7f526815cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:13.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.075+0000 7f5266ffd640 1 --2- 172.21.15.90:0/1139019330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f526815f4f0 0x7f526815cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.075+0000 7f5266ffd640 1 -- 172.21.15.90:0/1139019330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52680c43f0 con 0x7f52680688e0 2024-09-10T23:14:13.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.075+0000 7f5266ffd640 1 --2- 172.21.15.90:0/1139019330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52680688e0 0x7f52681f4880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f525800c430 tx=0x7f525800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:13.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.075+0000 7f5264ff9640 1 -- 172.21.15.90:0/1139019330 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258011790 con 0x7f52680688e0 2024-09-10T23:14:13.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.075+0000 7f5264ff9640 1 -- 172.21.15.90:0/1139019330 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5258017070 con 0x7f52680688e0 2024-09-10T23:14:13.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.075+0000 7f5264ff9640 1 -- 172.21.15.90:0/1139019330 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258011ce0 con 0x7f52680688e0 2024-09-10T23:14:13.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.075+0000 7f526d975640 1 -- 172.21.15.90:0/1139019330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52680c46d0 con 0x7f52680688e0 2024-09-10T23:14:13.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.075+0000 7f526d975640 1 -- 172.21.15.90:0/1139019330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52680c4c90 con 0x7f52680688e0 2024-09-10T23:14:13.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.075+0000 7f5264ff9640 1 -- 172.21.15.90:0/1139019330 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f525801c460 con 0x7f52680688e0 2024-09-10T23:14:13.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.075+0000 7f5264ff9640 1 -- 172.21.15.90:0/1139019330 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5258012860 con 0x7f52680688e0 2024-09-10T23:14:13.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.076+0000 7f526d975640 1 -- 172.21.15.90:0/1139019330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52680b12c0 con 0x7f52680688e0 2024-09-10T23:14:13.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.078+0000 7f5264ff9640 1 -- 172.21.15.90:0/1139019330 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f5258012a60 con 0x7f52680688e0 2024-09-10T23:14:13.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.144+0000 7f526d975640 1 -- 172.21.15.90:0/1139019330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f526815e7a0 con 0x7f52680688e0 2024-09-10T23:14:13.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.147+0000 7f5264ff9640 1 -- 172.21.15.90:0/1139019330 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f5258012c40 con 0x7f52680688e0 2024-09-10T23:14:13.148 INFO:teuthology.orchestra.run.smithi090.stderr:adjusted tunables profile to default 2024-09-10T23:14:13.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.148+0000 7f526d975640 1 -- 172.21.15.90:0/1139019330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52680688e0 msgr2=0x7f52681f4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:13.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.148+0000 7f526d975640 1 --2- 172.21.15.90:0/1139019330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52680688e0 0x7f52681f4880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f525800c430 tx=0x7f525800c8f0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.148+0000 7f526d975640 1 -- 172.21.15.90:0/1139019330 shutdown_connections 2024-09-10T23:14:13.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.148+0000 7f526d975640 1 --2- 172.21.15.90:0/1139019330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f526815f4f0 0x7f526815cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.148+0000 7f526d975640 1 --2- 172.21.15.90:0/1139019330 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52680cd4f0 0x7f52680b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.148+0000 7f526d975640 1 --2- 172.21.15.90:0/1139019330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52680688e0 0x7f52681f4880 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.148+0000 7f526d975640 1 -- 172.21.15.90:0/1139019330 >> 172.21.15.90:0/1139019330 conn(0x7f5268073430 msgr2=0x7f5268070880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:13.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.148+0000 7f526d975640 1 -- 172.21.15.90:0/1139019330 shutdown_connections 2024-09-10T23:14:13.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:13.148+0000 7f526d975640 1 -- 172.21.15.90:0/1139019330 wait complete. 2024-09-10T23:14:13.160 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T23:14:13.160 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T23:14:13.160 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:14:13.160 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T23:14:13.184 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:14:13.184 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T23:14:13.249 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:14:13.250 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T23:14:13.314 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:14:13.314 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T23:14:13.379 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:14:13.379 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-10T23:14:13.405 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:14:13.406 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-10T23:14:13.470 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:14:13.471 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-10T23:14:13.535 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:14:13.535 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-10T23:14:13.600 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 5f95b4d0-67bd-402b-b841-f8494438702f 0 2024-09-10T23:14:13.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.740+0000 7fdc26652640 1 -- 172.21.15.171:0/571048411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc200b27f0 msgr2=0x7fdc200b2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:13.742 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.740+0000 7fdc26652640 1 --2- 172.21.15.171:0/571048411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc200b27f0 0x7fdc200b2c80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdc200c47d0 tx=0x7fdc1402a5f0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.742 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.740+0000 7fdc26652640 1 -- 172.21.15.171:0/571048411 shutdown_connections 2024-09-10T23:14:13.742 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.740+0000 7fdc26652640 1 --2- 172.21.15.171:0/571048411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc200b27f0 0x7fdc200b2c80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.742 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.740+0000 7fdc26652640 1 --2- 172.21.15.171:0/571048411 >> v2:172.21.15.90:3300/0 conn(0x7fdc200cf990 0x7fdc200ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.742 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.740+0000 7fdc26652640 1 -- 172.21.15.171:0/571048411 >> 172.21.15.171:0/571048411 conn(0x7fdc200cd7f0 msgr2=0x7fdc200cdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:13.742 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.740+0000 7fdc26652640 1 -- 172.21.15.171:0/571048411 shutdown_connections 2024-09-10T23:14:13.742 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.741+0000 7fdc26652640 1 -- 172.21.15.171:0/571048411 wait complete. 2024-09-10T23:14:13.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.742+0000 7fdc26652640 1 Processor -- start 2024-09-10T23:14:13.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.742+0000 7fdc26652640 1 -- start start 2024-09-10T23:14:13.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc26652640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc200705f0 0x7fdc200b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:13.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc26652640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc200b27f0 0x7fdc200c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:13.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc26652640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc200cf990 0x7fdc200c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:13.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc26652640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdc200cbbb0 con 0x7fdc200705f0 2024-09-10T23:14:13.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc26652640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdc200cba30 con 0x7fdc200cf990 2024-09-10T23:14:13.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc26652640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdc200cbd30 con 0x7fdc200b27f0 2024-09-10T23:14:13.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc24bef640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc200cf990 0x7fdc200c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:13.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc24bef640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc200cf990 0x7fdc200c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:60712/0 (socket says 172.21.15.171:60712) 2024-09-10T23:14:13.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc1f7fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc200b27f0 0x7fdc200c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:13.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc24bef640 1 -- 172.21.15.171:0/581878344 learned_addr learned my addr 172.21.15.171:0/581878344 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-10T23:14:13.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc1ffff640 1 --2- 172.21.15.171:0/581878344 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc200705f0 0x7fdc200b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:13.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc24bef640 1 -- 172.21.15.171:0/581878344 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc200b27f0 msgr2=0x7fdc200c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:13.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc24bef640 1 --2- 172.21.15.171:0/581878344 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc200b27f0 0x7fdc200c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc24bef640 1 -- 172.21.15.171:0/581878344 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc200705f0 msgr2=0x7fdc200b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:13.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc24bef640 1 --2- 172.21.15.171:0/581878344 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc200705f0 0x7fdc200b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc24bef640 1 -- 172.21.15.171:0/581878344 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc201f5830 con 0x7fdc200cf990 2024-09-10T23:14:13.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc1f7fe640 1 --2- 172.21.15.171:0/581878344 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc200b27f0 0x7fdc200c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:14:13.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc24bef640 1 --2- 172.21.15.171:0/581878344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc200cf990 0x7fdc200c9ed0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800c7a0 tx=0x7fdc1800cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:13.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc1cff9640 1 -- 172.21.15.171:0/581878344 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18003b70 con 0x7fdc200cf990 2024-09-10T23:14:13.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc1cff9640 1 -- 172.21.15.171:0/581878344 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc18003d30 con 0x7fdc200cf990 2024-09-10T23:14:13.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc26652640 1 -- 172.21.15.171:0/581878344 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc201f5550 con 0x7fdc200cf990 2024-09-10T23:14:13.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc1cff9640 1 -- 172.21.15.171:0/581878344 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1800aab0 con 0x7fdc200cf990 2024-09-10T23:14:13.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.743+0000 7fdc26652640 1 -- 172.21.15.171:0/581878344 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc200b3f20 con 0x7fdc200cf990 2024-09-10T23:14:13.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.744+0000 7fdc1cff9640 1 -- 172.21.15.171:0/581878344 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fdc1800ac50 con 0x7fdc200cf990 2024-09-10T23:14:13.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.744+0000 7fdc1cff9640 1 -- 172.21.15.171:0/581878344 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fdc18012a30 con 0x7fdc200cf990 2024-09-10T23:14:13.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.744+0000 7fdc26652640 1 -- 172.21.15.171:0/581878344 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc200cc250 con 0x7fdc200cf990 2024-09-10T23:14:13.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.746+0000 7fdc1cff9640 1 -- 172.21.15.171:0/581878344 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fdc180050d0 con 0x7fdc200cf990 2024-09-10T23:14:13.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.817+0000 7fdc26652640 1 -- 172.21.15.171:0/581878344 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5f95b4d0-67bd-402b-b841-f8494438702f", "id": 0} v 0) -- 0x7fdc200b5b60 con 0x7fdc200cf990 2024-09-10T23:14:13.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.820+0000 7fdc1cff9640 1 -- 172.21.15.171:0/581878344 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f95b4d0-67bd-402b-b841-f8494438702f", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fdc18005380 con 0x7fdc200cf990 2024-09-10T23:14:13.821 INFO:teuthology.orchestra.run.smithi171.stdout:0 2024-09-10T23:14:13.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.821+0000 7fdc26652640 1 -- 172.21.15.171:0/581878344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc200cf990 msgr2=0x7fdc200c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:13.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.821+0000 7fdc26652640 1 --2- 172.21.15.171:0/581878344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc200cf990 0x7fdc200c9ed0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800c7a0 tx=0x7fdc1800cc60 comp rx=0 tx=0).stop 2024-09-10T23:14:13.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.821+0000 7fdc26652640 1 -- 172.21.15.171:0/581878344 shutdown_connections 2024-09-10T23:14:13.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.821+0000 7fdc26652640 1 --2- 172.21.15.171:0/581878344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc200cf990 0x7fdc200c9ed0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.821+0000 7fdc26652640 1 --2- 172.21.15.171:0/581878344 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc200b27f0 0x7fdc200c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.821+0000 7fdc26652640 1 --2- 172.21.15.171:0/581878344 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc200705f0 0x7fdc200b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.821+0000 7fdc26652640 1 -- 172.21.15.171:0/581878344 >> 172.21.15.171:0/581878344 conn(0x7fdc200cd7f0 msgr2=0x7fdc200709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:13.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.821+0000 7fdc26652640 1 -- 172.21.15.171:0/581878344 shutdown_connections 2024-09-10T23:14:13.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.821+0000 7fdc26652640 1 -- 172.21.15.171:0/581878344 wait complete. 2024-09-10T23:14:13.832 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a 1 2024-09-10T23:14:13.934 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.933+0000 7fdffcbec640 1 -- 172.21.15.171:0/79023204 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdff80cef80 msgr2=0x7fdff80cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:13.934 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.933+0000 7fdffcbec640 1 --2- 172.21.15.171:0/79023204 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdff80cef80 0x7fdff80cda60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdff0005fd0 tx=0x7fdff002aa10 comp rx=0 tx=0).stop 2024-09-10T23:14:13.934 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.933+0000 7fdffcbec640 1 -- 172.21.15.171:0/79023204 shutdown_connections 2024-09-10T23:14:13.934 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.933+0000 7fdffcbec640 1 --2- 172.21.15.171:0/79023204 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdff80cef80 0x7fdff80cda60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.934 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.933+0000 7fdffcbec640 1 --2- 172.21.15.171:0/79023204 >> v2:172.21.15.171:3300/0 conn(0x7fdff815c020 0x7fdff80d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.934 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.933+0000 7fdffcbec640 1 -- 172.21.15.171:0/79023204 >> 172.21.15.171:0/79023204 conn(0x7fdff80d1f30 msgr2=0x7fdff80d2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:13.934 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.933+0000 7fdffcbec640 1 -- 172.21.15.171:0/79023204 shutdown_connections 2024-09-10T23:14:13.934 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.933+0000 7fdffcbec640 1 -- 172.21.15.171:0/79023204 wait complete. 2024-09-10T23:14:13.935 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.934+0000 7fdffcbec640 1 Processor -- start 2024-09-10T23:14:13.935 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.934+0000 7fdffcbec640 1 -- start start 2024-09-10T23:14:13.937 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.935+0000 7fdffcbec640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdff80cd630 0x7fdff81f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:13.937 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.935+0000 7fdffcbec640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdff80cef80 0x7fdff81f0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:13.937 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.935+0000 7fdffcbec640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdff815c020 0x7fdff80c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:13.937 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.935+0000 7fdffcbec640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdff80b1890 con 0x7fdff815c020 2024-09-10T23:14:13.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.935+0000 7fdffcbec640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdff80b1a10 con 0x7fdff80cef80 2024-09-10T23:14:13.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.935+0000 7fdffcbec640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdff80b1b90 con 0x7fdff80cd630 2024-09-10T23:14:13.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.935+0000 7fdff659c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdff80cd630 0x7fdff81f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:13.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.935+0000 7fdff5d9b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdff80cef80 0x7fdff81f0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:13.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.935+0000 7fdff659c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdff80cd630 0x7fdff81f2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:44698/0 (socket says 172.21.15.171:44698) 2024-09-10T23:14:13.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.935+0000 7fdff659c640 1 -- 172.21.15.171:0/3691215030 learned_addr learned my addr 172.21.15.171:0/3691215030 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-10T23:14:13.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.935+0000 7fdff6d9d640 1 --2- 172.21.15.171:0/3691215030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdff815c020 0x7fdff80c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:13.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.935+0000 7fdff659c640 1 -- 172.21.15.171:0/3691215030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdff80cef80 msgr2=0x7fdff81f0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:13.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.935+0000 7fdff659c640 1 --2- 172.21.15.171:0/3691215030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdff80cef80 0x7fdff81f0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.935+0000 7fdff659c640 1 -- 172.21.15.171:0/3691215030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdff815c020 msgr2=0x7fdff80c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:13.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.935+0000 7fdff659c640 1 --2- 172.21.15.171:0/3691215030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdff815c020 0x7fdff80c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:13.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.935+0000 7fdff659c640 1 -- 172.21.15.171:0/3691215030 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff80c7df0 con 0x7fdff80cd630 2024-09-10T23:14:13.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.935+0000 7fdff659c640 1 --2- 172.21.15.171:0/3691215030 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdff80cd630 0x7fdff81f2c80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800e9f0 tx=0x7fdfe800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:13.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.936+0000 7fdfe6ffd640 1 -- 172.21.15.171:0/3691215030 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe800cd80 con 0x7fdff80cd630 2024-09-10T23:14:13.939 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.936+0000 7fdfe6ffd640 1 -- 172.21.15.171:0/3691215030 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfe8004020 con 0x7fdff80cd630 2024-09-10T23:14:13.939 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.936+0000 7fdfe6ffd640 1 -- 172.21.15.171:0/3691215030 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8004470 con 0x7fdff80cd630 2024-09-10T23:14:13.939 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.936+0000 7fdffcbec640 1 -- 172.21.15.171:0/3691215030 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff80c8090 con 0x7fdff80cd630 2024-09-10T23:14:13.939 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.936+0000 7fdffcbec640 1 -- 172.21.15.171:0/3691215030 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff80c8650 con 0x7fdff80cd630 2024-09-10T23:14:13.939 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.936+0000 7fdfe6ffd640 1 -- 172.21.15.171:0/3691215030 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fdfe8003980 con 0x7fdff80cd630 2024-09-10T23:14:13.939 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.936+0000 7fdfe6ffd640 1 -- 172.21.15.171:0/3691215030 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fdfe8010430 con 0x7fdff80cd630 2024-09-10T23:14:13.939 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.937+0000 7fdffcbec640 1 -- 172.21.15.171:0/3691215030 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff80cda60 con 0x7fdff80cd630 2024-09-10T23:14:13.939 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:13.938+0000 7fdfe6ffd640 1 -- 172.21.15.171:0/3691215030 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fdfe8009490 con 0x7fdff80cd630 2024-09-10T23:14:14.010 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.010+0000 7fdffcbec640 1 -- 172.21.15.171:0/3691215030 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a", "id": 1} v 0) -- 0x7fdff8069580 con 0x7fdff80cd630 2024-09-10T23:14:14.014 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.013+0000 7fdfe6ffd640 1 -- 172.21.15.171:0/3691215030 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fdfe8018430 con 0x7fdff80cd630 2024-09-10T23:14:14.014 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-09-10T23:14:14.015 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.014+0000 7fdffcbec640 1 -- 172.21.15.171:0/3691215030 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdff80cd630 msgr2=0x7fdff81f2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.015 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.014+0000 7fdffcbec640 1 --2- 172.21.15.171:0/3691215030 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdff80cd630 0x7fdff81f2c80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800e9f0 tx=0x7fdfe800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.015 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.014+0000 7fdffcbec640 1 -- 172.21.15.171:0/3691215030 shutdown_connections 2024-09-10T23:14:14.015 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.014+0000 7fdffcbec640 1 --2- 172.21.15.171:0/3691215030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdff80cef80 0x7fdff81f0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.015 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.014+0000 7fdffcbec640 1 --2- 172.21.15.171:0/3691215030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdff815c020 0x7fdff80c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.015 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.014+0000 7fdffcbec640 1 --2- 172.21.15.171:0/3691215030 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdff80cd630 0x7fdff81f2c80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.015 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.014+0000 7fdffcbec640 1 -- 172.21.15.171:0/3691215030 >> 172.21.15.171:0/3691215030 conn(0x7fdff80d1f30 msgr2=0x7fdff80aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:14.016 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.014+0000 7fdffcbec640 1 -- 172.21.15.171:0/3691215030 shutdown_connections 2024-09-10T23:14:14.016 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.014+0000 7fdffcbec640 1 -- 172.21.15.171:0/3691215030 wait complete. 2024-09-10T23:14:14.025 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 7d152a62-8819-4391-a6a2-b300959aaf24 2 2024-09-10T23:14:14.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.127+0000 7fefb5408640 1 -- 172.21.15.171:0/1480511629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fefb015bdf0 msgr2=0x7fefb015c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.127+0000 7fefb5408640 1 --2- 172.21.15.171:0/1480511629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fefb015bdf0 0x7fefb015c280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fefb00cc000 tx=0x7fefa802aa30 comp rx=0 tx=0).stop 2024-09-10T23:14:14.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.128+0000 7fefb5408640 1 -- 172.21.15.171:0/1480511629 shutdown_connections 2024-09-10T23:14:14.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.128+0000 7fefb5408640 1 --2- 172.21.15.171:0/1480511629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fefb015bdf0 0x7fefb015c280 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.128+0000 7fefb5408640 1 --2- 172.21.15.171:0/1480511629 >> v2:172.21.15.171:3300/0 conn(0x7fefb00d0970 0x7fefb00d0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.128+0000 7fefb5408640 1 --2- 172.21.15.171:0/1480511629 >> v2:172.21.15.90:3300/0 conn(0x7fefb015ba10 0x7fefb00731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.128+0000 7fefb5408640 1 -- 172.21.15.171:0/1480511629 >> 172.21.15.171:0/1480511629 conn(0x7fefb006cf50 msgr2=0x7fefb006d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:14.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.128+0000 7fefb5408640 1 -- 172.21.15.171:0/1480511629 shutdown_connections 2024-09-10T23:14:14.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.128+0000 7fefb5408640 1 -- 172.21.15.171:0/1480511629 wait complete. 2024-09-10T23:14:14.130 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.129+0000 7fefb5408640 1 Processor -- start 2024-09-10T23:14:14.130 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.129+0000 7fefb5408640 1 -- start start 2024-09-10T23:14:14.132 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefb5408640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fefb00d0970 0x7fefb014c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:14.132 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefb5408640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefb015ba10 0x7fefb00adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:14.132 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefb5408640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb015bdf0 0x7fefb014e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:14.132 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefb5408640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fefb006f4a0 con 0x7fefb015ba10 2024-09-10T23:14:14.132 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefb5408640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fefb006f320 con 0x7fefb015bdf0 2024-09-10T23:14:14.132 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefb5408640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fefb006f620 con 0x7fefb00d0970 2024-09-10T23:14:14.132 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefaf7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb015bdf0 0x7fefb014e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:14.132 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefaeffd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fefb00d0970 0x7fefb014c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:14.132 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefaf7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb015bdf0 0x7fefb014e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:60754/0 (socket says 172.21.15.171:60754) 2024-09-10T23:14:14.132 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefaf7fe640 1 -- 172.21.15.171:0/2479916798 learned_addr learned my addr 172.21.15.171:0/2479916798 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-10T23:14:14.132 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefa7fff640 1 --2- 172.21.15.171:0/2479916798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefb015ba10 0x7fefb00adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:14.132 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefaf7fe640 1 -- 172.21.15.171:0/2479916798 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fefb00d0970 msgr2=0x7fefb014c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.133 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefaf7fe640 1 --2- 172.21.15.171:0/2479916798 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fefb00d0970 0x7fefb014c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.133 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefaf7fe640 1 -- 172.21.15.171:0/2479916798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefb015ba10 msgr2=0x7fefb00adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.133 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefaf7fe640 1 --2- 172.21.15.171:0/2479916798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefb015ba10 0x7fefb00adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.133 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefaf7fe640 1 -- 172.21.15.171:0/2479916798 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb014ee80 con 0x7fefb015bdf0 2024-09-10T23:14:14.133 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefaf7fe640 1 --2- 172.21.15.171:0/2479916798 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb015bdf0 0x7fefb014e0e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009d60 tx=0x7fefa8003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:14.133 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefa77fe640 1 -- 172.21.15.171:0/2479916798 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8033050 con 0x7fefb015bdf0 2024-09-10T23:14:14.133 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefa77fe640 1 -- 172.21.15.171:0/2479916798 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefa8004450 con 0x7fefb015bdf0 2024-09-10T23:14:14.133 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefb5408640 1 -- 172.21.15.171:0/2479916798 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb00a96b0 con 0x7fefb015bdf0 2024-09-10T23:14:14.133 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefa77fe640 1 -- 172.21.15.171:0/2479916798 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8038450 con 0x7fefb015bdf0 2024-09-10T23:14:14.133 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.130+0000 7fefb5408640 1 -- 172.21.15.171:0/2479916798 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb00ae320 con 0x7fefb015bdf0 2024-09-10T23:14:14.133 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.131+0000 7fefa77fe640 1 -- 172.21.15.171:0/2479916798 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fefa8040070 con 0x7fefb015bdf0 2024-09-10T23:14:14.133 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.131+0000 7fefa77fe640 1 -- 172.21.15.171:0/2479916798 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fefa8042860 con 0x7fefb015bdf0 2024-09-10T23:14:14.134 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.131+0000 7fefb5408640 1 -- 172.21.15.171:0/2479916798 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefb006fb40 con 0x7fefb015bdf0 2024-09-10T23:14:14.135 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.135+0000 7fefa77fe640 1 -- 172.21.15.171:0/2479916798 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fefa8062950 con 0x7fefb015bdf0 2024-09-10T23:14:14.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.205+0000 7fefb5408640 1 -- 172.21.15.171:0/2479916798 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7d152a62-8819-4391-a6a2-b300959aaf24", "id": 2} v 0) -- 0x7fefb0073160 con 0x7fefb015bdf0 2024-09-10T23:14:14.210 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.209+0000 7fefa77fe640 1 -- 172.21.15.171:0/2479916798 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7d152a62-8819-4391-a6a2-b300959aaf24", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fefa8050030 con 0x7fefb015bdf0 2024-09-10T23:14:14.210 INFO:teuthology.orchestra.run.smithi171.stdout:2 2024-09-10T23:14:14.211 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.210+0000 7fefb5408640 1 -- 172.21.15.171:0/2479916798 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb015bdf0 msgr2=0x7fefb014e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.211 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.210+0000 7fefb5408640 1 --2- 172.21.15.171:0/2479916798 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb015bdf0 0x7fefb014e0e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009d60 tx=0x7fefa8003f10 comp rx=0 tx=0).stop 2024-09-10T23:14:14.211 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.210+0000 7fefb5408640 1 -- 172.21.15.171:0/2479916798 shutdown_connections 2024-09-10T23:14:14.211 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.210+0000 7fefb5408640 1 --2- 172.21.15.171:0/2479916798 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb015bdf0 0x7fefb014e0e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.211 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.210+0000 7fefb5408640 1 --2- 172.21.15.171:0/2479916798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fefb015ba10 0x7fefb00adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.211 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.210+0000 7fefb5408640 1 --2- 172.21.15.171:0/2479916798 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fefb00d0970 0x7fefb014c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.211 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.210+0000 7fefb5408640 1 -- 172.21.15.171:0/2479916798 >> 172.21.15.171:0/2479916798 conn(0x7fefb006cf50 msgr2=0x7fefb00ccba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:14.212 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.210+0000 7fefb5408640 1 -- 172.21.15.171:0/2479916798 shutdown_connections 2024-09-10T23:14:14.212 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.210+0000 7fefb5408640 1 -- 172.21.15.171:0/2479916798 wait complete. 2024-09-10T23:14:14.221 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 2892bb8d-dca8-4c77-bc7b-a42090eef419 3 2024-09-10T23:14:14.323 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.322+0000 7f679112b640 1 -- 172.21.15.171:0/2072645906 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f678c0d02d0 msgr2=0x7f678c0ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.324 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.322+0000 7f679112b640 1 --2- 172.21.15.171:0/2072645906 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f678c0d02d0 0x7f678c0ccba0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f678c0cc6e0 tx=0x7f678402aa30 comp rx=0 tx=0).stop 2024-09-10T23:14:14.324 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.322+0000 7f679112b640 1 -- 172.21.15.171:0/2072645906 shutdown_connections 2024-09-10T23:14:14.324 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.322+0000 7f679112b640 1 --2- 172.21.15.171:0/2072645906 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f678c0d02d0 0x7f678c0ccba0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.324 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.322+0000 7f679112b640 1 --2- 172.21.15.171:0/2072645906 >> v2:172.21.15.90:3300/0 conn(0x7f678c156030 0x7f678c073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.324 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.322+0000 7f679112b640 1 -- 172.21.15.171:0/2072645906 >> 172.21.15.171:0/2072645906 conn(0x7f678c0cd7f0 msgr2=0x7f678c0cdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:14.324 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.322+0000 7f679112b640 1 -- 172.21.15.171:0/2072645906 shutdown_connections 2024-09-10T23:14:14.324 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.322+0000 7f679112b640 1 -- 172.21.15.171:0/2072645906 wait complete. 2024-09-10T23:14:14.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.324+0000 7f679112b640 1 Processor -- start 2024-09-10T23:14:14.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.324+0000 7f679112b640 1 -- start start 2024-09-10T23:14:14.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.324+0000 7f679112b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f678c0d02d0 0x7f678c1f7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:14.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.324+0000 7f679112b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f678c156030 0x7f678c0c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:14.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.324+0000 7f679112b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f678c0c6110 0x7f678c0ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:14.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.324+0000 7f679112b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f678c15f940 con 0x7f678c0c6110 2024-09-10T23:14:14.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f679112b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f678c15f7c0 con 0x7f678c0d02d0 2024-09-10T23:14:14.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f679112b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f678c15fac0 con 0x7f678c156030 2024-09-10T23:14:14.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f678ad9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f678c0d02d0 0x7f678c1f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:14.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f6783fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f678c156030 0x7f678c0c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:14.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f678ad9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f678c0d02d0 0x7f678c1f7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:60766/0 (socket says 172.21.15.171:60766) 2024-09-10T23:14:14.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f678ad9d640 1 -- 172.21.15.171:0/3023073073 learned_addr learned my addr 172.21.15.171:0/3023073073 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-10T23:14:14.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f678b59e640 1 --2- 172.21.15.171:0/3023073073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f678c0c6110 0x7f678c0ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:14.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f678ad9d640 1 -- 172.21.15.171:0/3023073073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f678c156030 msgr2=0x7f678c0c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f678ad9d640 1 --2- 172.21.15.171:0/3023073073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f678c156030 0x7f678c0c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f678ad9d640 1 -- 172.21.15.171:0/3023073073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f678c0c6110 msgr2=0x7f678c0ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f678ad9d640 1 --2- 172.21.15.171:0/3023073073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f678c0c6110 0x7f678c0ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f678ad9d640 1 -- 172.21.15.171:0/3023073073 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678c1f4a70 con 0x7f678c0d02d0 2024-09-10T23:14:14.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f6783fff640 1 --2- 172.21.15.171:0/3023073073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f678c156030 0x7f678c0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:14:14.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f678ad9d640 1 --2- 172.21.15.171:0/3023073073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f678c0d02d0 0x7f678c1f7610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f677c00d770 tx=0x7f677c00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:14.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f67837fe640 1 -- 172.21.15.171:0/3023073073 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c017070 con 0x7f678c0d02d0 2024-09-10T23:14:14.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f67837fe640 1 -- 172.21.15.171:0/3023073073 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f677c009d20 con 0x7f678c0d02d0 2024-09-10T23:14:14.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f679112b640 1 -- 172.21.15.171:0/3023073073 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f678c1f4d50 con 0x7f678c0d02d0 2024-09-10T23:14:14.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f67837fe640 1 -- 172.21.15.171:0/3023073073 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c005280 con 0x7f678c0d02d0 2024-09-10T23:14:14.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f679112b640 1 -- 172.21.15.171:0/3023073073 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f678c1f4740 con 0x7f678c0d02d0 2024-09-10T23:14:14.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f67837fe640 1 -- 172.21.15.171:0/3023073073 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f677c005420 con 0x7f678c0d02d0 2024-09-10T23:14:14.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.325+0000 7f67837fe640 1 -- 172.21.15.171:0/3023073073 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f677c010c00 con 0x7f678c0d02d0 2024-09-10T23:14:14.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.326+0000 7f679112b640 1 -- 172.21.15.171:0/3023073073 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f678c15ffe0 con 0x7f678c0d02d0 2024-09-10T23:14:14.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.328+0000 7f67837fe640 1 -- 172.21.15.171:0/3023073073 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f677c010730 con 0x7f678c0d02d0 2024-09-10T23:14:14.398 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.397+0000 7f679112b640 1 -- 172.21.15.171:0/3023073073 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2892bb8d-dca8-4c77-bc7b-a42090eef419", "id": 3} v 0) -- 0x7f678c06da20 con 0x7f678c0d02d0 2024-09-10T23:14:14.401 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.401+0000 7f67837fe640 1 -- 172.21.15.171:0/3023073073 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2892bb8d-dca8-4c77-bc7b-a42090eef419", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f677c0109d0 con 0x7f678c0d02d0 2024-09-10T23:14:14.401 INFO:teuthology.orchestra.run.smithi171.stdout:3 2024-09-10T23:14:14.402 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.401+0000 7f679112b640 1 -- 172.21.15.171:0/3023073073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f678c0d02d0 msgr2=0x7f678c1f7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.402 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.401+0000 7f679112b640 1 --2- 172.21.15.171:0/3023073073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f678c0d02d0 0x7f678c1f7610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f677c00d770 tx=0x7f677c00dc30 comp rx=0 tx=0).stop 2024-09-10T23:14:14.402 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.401+0000 7f679112b640 1 -- 172.21.15.171:0/3023073073 shutdown_connections 2024-09-10T23:14:14.403 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.401+0000 7f679112b640 1 --2- 172.21.15.171:0/3023073073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f678c0c6110 0x7f678c0ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.403 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.401+0000 7f679112b640 1 --2- 172.21.15.171:0/3023073073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f678c156030 0x7f678c0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.403 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.401+0000 7f679112b640 1 --2- 172.21.15.171:0/3023073073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f678c0d02d0 0x7f678c1f7610 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.403 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.401+0000 7f679112b640 1 -- 172.21.15.171:0/3023073073 >> 172.21.15.171:0/3023073073 conn(0x7f678c0cd7f0 msgr2=0x7f678c0ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:14.403 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.402+0000 7f679112b640 1 -- 172.21.15.171:0/3023073073 shutdown_connections 2024-09-10T23:14:14.403 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.402+0000 7f679112b640 1 -- 172.21.15.171:0/3023073073 wait complete. 2024-09-10T23:14:14.413 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 9cd0b021-6803-4c1f-ab6a-04ea69f550ac 4 2024-09-10T23:14:14.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.514+0000 7f23a275a640 1 -- 172.21.15.171:0/1192282039 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f239c073ea0 msgr2=0x7f239c0cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.514+0000 7f23a275a640 1 --2- 172.21.15.171:0/1192282039 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f239c073ea0 0x7f239c0cfb00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2394009be0 tx=0x7f239402a800 comp rx=0 tx=0).stop 2024-09-10T23:14:14.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.514+0000 7f23a275a640 1 -- 172.21.15.171:0/1192282039 shutdown_connections 2024-09-10T23:14:14.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.514+0000 7f23a275a640 1 --2- 172.21.15.171:0/1192282039 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f239c073ea0 0x7f239c0cfb00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.514+0000 7f23a275a640 1 -- 172.21.15.171:0/1192282039 >> 172.21.15.171:0/1192282039 conn(0x7f239c0d0dd0 msgr2=0x7f239c0d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:14.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.514+0000 7f23a275a640 1 -- 172.21.15.171:0/1192282039 shutdown_connections 2024-09-10T23:14:14.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.514+0000 7f23a275a640 1 -- 172.21.15.171:0/1192282039 wait complete. 2024-09-10T23:14:14.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.515+0000 7f23a275a640 1 Processor -- start 2024-09-10T23:14:14.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.515+0000 7f23a275a640 1 -- start start 2024-09-10T23:14:14.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.516+0000 7f23a275a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239c073ea0 0x7f239c1f19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:14.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.516+0000 7f23a275a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f239c0af550 0x7f239c156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:14.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.516+0000 7f23a275a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f239c15e2d0 0x7f239c1f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:14.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.516+0000 7f23a275a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f239c0d01c0 con 0x7f239c073ea0 2024-09-10T23:14:14.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.516+0000 7f23a275a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f239c0d0040 con 0x7f239c15e2d0 2024-09-10T23:14:14.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.516+0000 7f23a275a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f239c0d0340 con 0x7f239c0af550 2024-09-10T23:14:14.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.516+0000 7f23a0cf7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f239c15e2d0 0x7f239c1f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:14.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.516+0000 7f239b7fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f239c0af550 0x7f239c156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:14.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.516+0000 7f23a0cf7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f239c15e2d0 0x7f239c1f5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:60768/0 (socket says 172.21.15.171:60768) 2024-09-10T23:14:14.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.516+0000 7f23a0cf7640 1 -- 172.21.15.171:0/2453864370 learned_addr learned my addr 172.21.15.171:0/2453864370 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-10T23:14:14.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.516+0000 7f239bfff640 1 --2- 172.21.15.171:0/2453864370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239c073ea0 0x7f239c1f19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:14.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.517+0000 7f239b7fe640 1 -- 172.21.15.171:0/2453864370 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f239c15e2d0 msgr2=0x7f239c1f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.517+0000 7f239b7fe640 1 --2- 172.21.15.171:0/2453864370 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f239c15e2d0 0x7f239c1f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.517+0000 7f239b7fe640 1 -- 172.21.15.171:0/2453864370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239c073ea0 msgr2=0x7f239c1f19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.517+0000 7f239b7fe640 1 --2- 172.21.15.171:0/2453864370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239c073ea0 0x7f239c1f19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.517+0000 7f239b7fe640 1 -- 172.21.15.171:0/2453864370 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239c158f20 con 0x7f239c0af550 2024-09-10T23:14:14.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.517+0000 7f23a0cf7640 1 --2- 172.21.15.171:0/2453864370 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f239c15e2d0 0x7f239c1f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:14:14.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.517+0000 7f239bfff640 1 --2- 172.21.15.171:0/2453864370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239c073ea0 0x7f239c1f19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:14:14.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.517+0000 7f239b7fe640 1 --2- 172.21.15.171:0/2453864370 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f239c0af550 0x7f239c156400 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f239c0b6f40 tx=0x7f238400c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:14.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.517+0000 7f2398ff9640 1 -- 172.21.15.171:0/2453864370 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384017070 con 0x7f239c0af550 2024-09-10T23:14:14.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.517+0000 7f2398ff9640 1 -- 172.21.15.171:0/2453864370 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23840053e0 con 0x7f239c0af550 2024-09-10T23:14:14.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.517+0000 7f2398ff9640 1 -- 172.21.15.171:0/2453864370 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384003870 con 0x7f239c0af550 2024-09-10T23:14:14.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.517+0000 7f23a275a640 1 -- 172.21.15.171:0/2453864370 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f239c159200 con 0x7f239c0af550 2024-09-10T23:14:14.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.517+0000 7f23a275a640 1 -- 172.21.15.171:0/2453864370 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f239c0b5390 con 0x7f239c0af550 2024-09-10T23:14:14.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.517+0000 7f2398ff9640 1 -- 172.21.15.171:0/2453864370 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f2384003a10 con 0x7f239c0af550 2024-09-10T23:14:14.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.517+0000 7f2398ff9640 1 -- 172.21.15.171:0/2453864370 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f2384012930 con 0x7f239c0af550 2024-09-10T23:14:14.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.518+0000 7f23a275a640 1 -- 172.21.15.171:0/2453864370 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f239c073790 con 0x7f239c0af550 2024-09-10T23:14:14.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.520+0000 7f2398ff9640 1 -- 172.21.15.171:0/2453864370 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f2384021070 con 0x7f239c0af550 2024-09-10T23:14:14.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.591+0000 7f23a275a640 1 -- 172.21.15.171:0/2453864370 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9cd0b021-6803-4c1f-ab6a-04ea69f550ac", "id": 4} v 0) -- 0x7f239c0b5560 con 0x7f239c0af550 2024-09-10T23:14:14.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.594+0000 7f2398ff9640 1 -- 172.21.15.171:0/2453864370 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9cd0b021-6803-4c1f-ab6a-04ea69f550ac", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f2384012b30 con 0x7f239c0af550 2024-09-10T23:14:14.596 INFO:teuthology.orchestra.run.smithi171.stdout:4 2024-09-10T23:14:14.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.595+0000 7f23a275a640 1 -- 172.21.15.171:0/2453864370 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f239c0af550 msgr2=0x7f239c156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.595+0000 7f23a275a640 1 --2- 172.21.15.171:0/2453864370 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f239c0af550 0x7f239c156400 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f239c0b6f40 tx=0x7f238400c890 comp rx=0 tx=0).stop 2024-09-10T23:14:14.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.595+0000 7f23a275a640 1 -- 172.21.15.171:0/2453864370 shutdown_connections 2024-09-10T23:14:14.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.595+0000 7f23a275a640 1 --2- 172.21.15.171:0/2453864370 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f239c15e2d0 0x7f239c1f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.595+0000 7f23a275a640 1 --2- 172.21.15.171:0/2453864370 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f239c0af550 0x7f239c156400 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.595+0000 7f23a275a640 1 --2- 172.21.15.171:0/2453864370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f239c073ea0 0x7f239c1f19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.595+0000 7f23a275a640 1 -- 172.21.15.171:0/2453864370 >> 172.21.15.171:0/2453864370 conn(0x7f239c0d0dd0 msgr2=0x7f239c06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:14.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.595+0000 7f23a275a640 1 -- 172.21.15.171:0/2453864370 shutdown_connections 2024-09-10T23:14:14.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.595+0000 7f23a275a640 1 -- 172.21.15.171:0/2453864370 wait complete. 2024-09-10T23:14:14.607 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new dd31ec4a-108e-4946-b822-51df539a9218 5 2024-09-10T23:14:14.709 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.708+0000 7fa803ce6640 1 -- 172.21.15.171:0/800900048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7fc15ba10 msgr2=0x7fa7fc0731b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.709 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.708+0000 7fa803ce6640 1 --2- 172.21.15.171:0/800900048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7fc15ba10 0x7fa7fc0731b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8005fd0 tx=0x7fa7f802a5d0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.709 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.708+0000 7fa803ce6640 1 -- 172.21.15.171:0/800900048 shutdown_connections 2024-09-10T23:14:14.709 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.708+0000 7fa803ce6640 1 --2- 172.21.15.171:0/800900048 >> v2:172.21.15.171:3300/0 conn(0x7fa7fc15c500 0x7fa7fc0d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.708+0000 7fa803ce6640 1 --2- 172.21.15.171:0/800900048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7fc15ba10 0x7fa7fc0731b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.708+0000 7fa803ce6640 1 -- 172.21.15.171:0/800900048 >> 172.21.15.171:0/800900048 conn(0x7fa7fc06cf50 msgr2=0x7fa7fc06d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:14.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.708+0000 7fa803ce6640 1 -- 172.21.15.171:0/800900048 shutdown_connections 2024-09-10T23:14:14.710 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.708+0000 7fa803ce6640 1 -- 172.21.15.171:0/800900048 wait complete. 2024-09-10T23:14:14.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.709+0000 7fa803ce6640 1 Processor -- start 2024-09-10T23:14:14.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.709+0000 7fa803ce6640 1 -- start start 2024-09-10T23:14:14.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.710+0000 7fa803ce6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7fc0d0970 0x7fa7fc14b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:14.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.710+0000 7fa803ce6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7fc15ba10 0x7fa7fc0af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:14.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.710+0000 7fa803ce6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc15c500 0x7fa7fc0af970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:14.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.710+0000 7fa803ce6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc0cd300 con 0x7fa7fc15ba10 2024-09-10T23:14:14.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.710+0000 7fa803ce6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc0cd180 con 0x7fa7fc15c500 2024-09-10T23:14:14.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.710+0000 7fa803ce6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa7fc0cd480 con 0x7fa7fc0d0970 2024-09-10T23:14:14.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.710+0000 7fa801a82640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7fc0d0970 0x7fa7fc14b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:14.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.710+0000 7fa801a82640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7fc0d0970 0x7fa7fc14b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:44776/0 (socket says 172.21.15.171:44776) 2024-09-10T23:14:14.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.710+0000 7fa801a82640 1 -- 172.21.15.171:0/1038236381 learned_addr learned my addr 172.21.15.171:0/1038236381 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-10T23:14:14.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.710+0000 7fa802283640 1 --2- 172.21.15.171:0/1038236381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc15c500 0x7fa7fc0af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:14.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.710+0000 7fa801281640 1 --2- 172.21.15.171:0/1038236381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7fc15ba10 0x7fa7fc0af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:14.713 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.710+0000 7fa801a82640 1 -- 172.21.15.171:0/1038236381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc15c500 msgr2=0x7fa7fc0af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.710+0000 7fa801a82640 1 --2- 172.21.15.171:0/1038236381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc15c500 0x7fa7fc0af970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.710+0000 7fa801a82640 1 -- 172.21.15.171:0/1038236381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7fc15ba10 msgr2=0x7fa7fc0af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.710+0000 7fa801a82640 1 --2- 172.21.15.171:0/1038236381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7fc15ba10 0x7fa7fc0af430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.710+0000 7fa801a82640 1 -- 172.21.15.171:0/1038236381 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7fc14c2f0 con 0x7fa7fc0d0970 2024-09-10T23:14:14.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.711+0000 7fa801a82640 1 --2- 172.21.15.171:0/1038236381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7fc0d0970 0x7fa7fc14b9a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009850 tx=0x7fa7f80035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:14.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.711+0000 7fa7ee7fc640 1 -- 172.21.15.171:0/1038236381 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f803f070 con 0x7fa7fc0d0970 2024-09-10T23:14:14.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.711+0000 7fa7ee7fc640 1 -- 172.21.15.171:0/1038236381 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7f8003ce0 con 0x7fa7fc0d0970 2024-09-10T23:14:14.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.711+0000 7fa803ce6640 1 -- 172.21.15.171:0/1038236381 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7fc0abbb0 con 0x7fa7fc0d0970 2024-09-10T23:14:14.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.711+0000 7fa7ee7fc640 1 -- 172.21.15.171:0/1038236381 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8035030 con 0x7fa7fc0d0970 2024-09-10T23:14:14.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.711+0000 7fa803ce6640 1 -- 172.21.15.171:0/1038236381 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7fc14c840 con 0x7fa7fc0d0970 2024-09-10T23:14:14.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.711+0000 7fa7ee7fc640 1 -- 172.21.15.171:0/1038236381 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa7f8004a00 con 0x7fa7fc0d0970 2024-09-10T23:14:14.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.711+0000 7fa7ee7fc640 1 -- 172.21.15.171:0/1038236381 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fa7f803bca0 con 0x7fa7fc0d0970 2024-09-10T23:14:14.714 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.712+0000 7fa803ce6640 1 -- 172.21.15.171:0/1038236381 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7fc0731b0 con 0x7fa7fc0d0970 2024-09-10T23:14:14.715 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.714+0000 7fa7ee7fc640 1 -- 172.21.15.171:0/1038236381 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fa7f803b6e0 con 0x7fa7fc0d0970 2024-09-10T23:14:14.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.784+0000 7fa803ce6640 1 -- 172.21.15.171:0/1038236381 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dd31ec4a-108e-4946-b822-51df539a9218", "id": 5} v 0) -- 0x7fa7fc15c170 con 0x7fa7fc0d0970 2024-09-10T23:14:14.788 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.787+0000 7fa7ee7fc640 1 -- 172.21.15.171:0/1038236381 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dd31ec4a-108e-4946-b822-51df539a9218", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fa7f803b8c0 con 0x7fa7fc0d0970 2024-09-10T23:14:14.788 INFO:teuthology.orchestra.run.smithi171.stdout:5 2024-09-10T23:14:14.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.788+0000 7fa803ce6640 1 -- 172.21.15.171:0/1038236381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7fc0d0970 msgr2=0x7fa7fc14b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.788+0000 7fa803ce6640 1 --2- 172.21.15.171:0/1038236381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7fc0d0970 0x7fa7fc14b9a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009850 tx=0x7fa7f80035f0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.788+0000 7fa803ce6640 1 -- 172.21.15.171:0/1038236381 shutdown_connections 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.788+0000 7fa803ce6640 1 --2- 172.21.15.171:0/1038236381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7fc15c500 0x7fa7fc0af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.788+0000 7fa803ce6640 1 --2- 172.21.15.171:0/1038236381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7fc15ba10 0x7fa7fc0af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.788+0000 7fa803ce6640 1 --2- 172.21.15.171:0/1038236381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7fc0d0970 0x7fa7fc14b9a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.788+0000 7fa803ce6640 1 -- 172.21.15.171:0/1038236381 >> 172.21.15.171:0/1038236381 conn(0x7fa7fc06cf50 msgr2=0x7fa7fc0c9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.788+0000 7fa803ce6640 1 -- 172.21.15.171:0/1038236381 shutdown_connections 2024-09-10T23:14:14.790 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.788+0000 7fa803ce6640 1 -- 172.21.15.171:0/1038236381 wait complete. 2024-09-10T23:14:14.800 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 44f5c9f5-f58d-4587-a645-1a7cd2b3ec43 6 2024-09-10T23:14:14.901 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.900+0000 7f1210ba0640 1 -- 172.21.15.171:0/3119824889 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f120c0af550 msgr2=0x7f120c073cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.901 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.900+0000 7f1210ba0640 1 --2- 172.21.15.171:0/3119824889 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f120c0af550 0x7f120c073cd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f120c0ceb20 tx=0x7f11f402a4a0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.900+0000 7f1210ba0640 1 -- 172.21.15.171:0/3119824889 shutdown_connections 2024-09-10T23:14:14.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.900+0000 7f1210ba0640 1 --2- 172.21.15.171:0/3119824889 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f120c0af550 0x7f120c073cd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.900+0000 7f1210ba0640 1 --2- 172.21.15.171:0/3119824889 >> v2:172.21.15.90:3300/0 conn(0x7f120c15e2d0 0x7f120c073790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.900+0000 7f1210ba0640 1 -- 172.21.15.171:0/3119824889 >> 172.21.15.171:0/3119824889 conn(0x7f120c0d0dd0 msgr2=0x7f120c0d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:14.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.900+0000 7f1210ba0640 1 -- 172.21.15.171:0/3119824889 shutdown_connections 2024-09-10T23:14:14.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.900+0000 7f1210ba0640 1 -- 172.21.15.171:0/3119824889 wait complete. 2024-09-10T23:14:14.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.902+0000 7f1210ba0640 1 Processor -- start 2024-09-10T23:14:14.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.902+0000 7f1210ba0640 1 -- start start 2024-09-10T23:14:14.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.903+0000 7f1210ba0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f120c0af550 0x7f120c1f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:14.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.903+0000 7f1210ba0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f120c0cb4b0 0x7f120c1578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:14.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.903+0000 7f1210ba0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f120c15e2d0 0x7f120c0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:14.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.903+0000 7f1210ba0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f120c0cc560 con 0x7f120c15e2d0 2024-09-10T23:14:14.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.903+0000 7f1210ba0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f120c0cbb10 con 0x7f120c0af550 2024-09-10T23:14:14.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.903+0000 7f1210ba0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f120c0cc6e0 con 0x7f120c0cb4b0 2024-09-10T23:14:14.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.903+0000 7f120a59c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f120c0af550 0x7f120c1f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:14.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.903+0000 7f1203fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f120c0cb4b0 0x7f120c1578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:14.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.903+0000 7f1203fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f120c0cb4b0 0x7f120c1578a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:44798/0 (socket says 172.21.15.171:44798) 2024-09-10T23:14:14.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.903+0000 7f120a59c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f120c0af550 0x7f120c1f3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:60804/0 (socket says 172.21.15.171:60804) 2024-09-10T23:14:14.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.903+0000 7f1203fff640 1 -- 172.21.15.171:0/334344996 learned_addr learned my addr 172.21.15.171:0/334344996 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-10T23:14:14.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.903+0000 7f120ad9d640 1 --2- 172.21.15.171:0/334344996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f120c15e2d0 0x7f120c0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:14.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.904+0000 7f1203fff640 1 -- 172.21.15.171:0/334344996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f120c0af550 msgr2=0x7f120c1f3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.904+0000 7f1203fff640 1 --2- 172.21.15.171:0/334344996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f120c0af550 0x7f120c1f3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.904+0000 7f1203fff640 1 -- 172.21.15.171:0/334344996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f120c15e2d0 msgr2=0x7f120c0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.904+0000 7f1203fff640 1 --2- 172.21.15.171:0/334344996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f120c15e2d0 0x7f120c0cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.904+0000 7f1203fff640 1 -- 172.21.15.171:0/334344996 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f120c158010 con 0x7f120c0cb4b0 2024-09-10T23:14:14.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.904+0000 7f1203fff640 1 --2- 172.21.15.171:0/334344996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f120c0cb4b0 0x7f120c1578a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009850 tx=0x7f11f4003910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:14.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.904+0000 7f1202ffd640 1 -- 172.21.15.171:0/334344996 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f403f070 con 0x7f120c0cb4b0 2024-09-10T23:14:14.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.904+0000 7f1202ffd640 1 -- 172.21.15.171:0/334344996 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11f40047a0 con 0x7f120c0cb4b0 2024-09-10T23:14:14.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.904+0000 7f1210ba0640 1 -- 172.21.15.171:0/334344996 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f120c1582f0 con 0x7f120c0cb4b0 2024-09-10T23:14:14.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.904+0000 7f1202ffd640 1 -- 172.21.15.171:0/334344996 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f4035030 con 0x7f120c0cb4b0 2024-09-10T23:14:14.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.904+0000 7f1210ba0640 1 -- 172.21.15.171:0/334344996 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f120c1f25e0 con 0x7f120c0cb4b0 2024-09-10T23:14:14.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.904+0000 7f1202ffd640 1 -- 172.21.15.171:0/334344996 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f11f4004bb0 con 0x7f120c0cb4b0 2024-09-10T23:14:14.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.904+0000 7f1202ffd640 1 -- 172.21.15.171:0/334344996 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f11f4044450 con 0x7f120c0cb4b0 2024-09-10T23:14:14.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.905+0000 7f1210ba0640 1 -- 172.21.15.171:0/334344996 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f120c0ccb90 con 0x7f120c0cb4b0 2024-09-10T23:14:14.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.909+0000 7f1202ffd640 1 -- 172.21.15.171:0/334344996 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f11f403b460 con 0x7f120c0cb4b0 2024-09-10T23:14:14.980 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.980+0000 7f1210ba0640 1 -- 172.21.15.171:0/334344996 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "44f5c9f5-f58d-4587-a645-1a7cd2b3ec43", "id": 6} v 0) -- 0x7f120c0d1910 con 0x7f120c0cb4b0 2024-09-10T23:14:14.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.983+0000 7f1202ffd640 1 -- 172.21.15.171:0/334344996 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44f5c9f5-f58d-4587-a645-1a7cd2b3ec43", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f11f4005060 con 0x7f120c0cb4b0 2024-09-10T23:14:14.984 INFO:teuthology.orchestra.run.smithi171.stdout:6 2024-09-10T23:14:14.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.984+0000 7f1210ba0640 1 -- 172.21.15.171:0/334344996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f120c0cb4b0 msgr2=0x7f120c1578a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:14.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.984+0000 7f1210ba0640 1 --2- 172.21.15.171:0/334344996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f120c0cb4b0 0x7f120c1578a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009850 tx=0x7f11f4003910 comp rx=0 tx=0).stop 2024-09-10T23:14:14.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.984+0000 7f1210ba0640 1 -- 172.21.15.171:0/334344996 shutdown_connections 2024-09-10T23:14:14.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.984+0000 7f1210ba0640 1 --2- 172.21.15.171:0/334344996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f120c15e2d0 0x7f120c0cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.984+0000 7f1210ba0640 1 --2- 172.21.15.171:0/334344996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f120c0cb4b0 0x7f120c1578a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.984+0000 7f1210ba0640 1 --2- 172.21.15.171:0/334344996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f120c0af550 0x7f120c1f3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:14.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.984+0000 7f1210ba0640 1 -- 172.21.15.171:0/334344996 >> 172.21.15.171:0/334344996 conn(0x7f120c0d0dd0 msgr2=0x7f120c15c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:14.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.984+0000 7f1210ba0640 1 -- 172.21.15.171:0/334344996 shutdown_connections 2024-09-10T23:14:14.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:14.984+0000 7f1210ba0640 1 -- 172.21.15.171:0/334344996 wait complete. 2024-09-10T23:14:14.996 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 82ad74e4-f7ff-4ce3-baf4-d67b438a8876 7 2024-09-10T23:14:15.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.097+0000 7fd7d9247640 1 -- 172.21.15.171:0/2626968937 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7d40cd680 msgr2=0x7fd7d40aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:15.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.097+0000 7fd7d9247640 1 --2- 172.21.15.171:0/2626968937 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7d40cd680 0x7fd7d40aeae0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4005fd0 tx=0x7fd7c402a8b0 comp rx=0 tx=0).stop 2024-09-10T23:14:15.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.097+0000 7fd7d9247640 1 -- 172.21.15.171:0/2626968937 shutdown_connections 2024-09-10T23:14:15.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.097+0000 7fd7d9247640 1 --2- 172.21.15.171:0/2626968937 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7d40cd680 0x7fd7d40aeae0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:15.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.097+0000 7fd7d9247640 1 --2- 172.21.15.171:0/2626968937 >> v2:172.21.15.90:3300/0 conn(0x7fd7d40cfaf0 0x7fd7d40cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:15.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.097+0000 7fd7d9247640 1 -- 172.21.15.171:0/2626968937 >> 172.21.15.171:0/2626968937 conn(0x7fd7d40d1f20 msgr2=0x7fd7d40d2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:15.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.097+0000 7fd7d9247640 1 -- 172.21.15.171:0/2626968937 shutdown_connections 2024-09-10T23:14:15.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.097+0000 7fd7d9247640 1 -- 172.21.15.171:0/2626968937 wait complete. 2024-09-10T23:14:15.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.098+0000 7fd7d9247640 1 Processor -- start 2024-09-10T23:14:15.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.098+0000 7fd7d9247640 1 -- start start 2024-09-10T23:14:15.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.099+0000 7fd7d9247640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7d40cd680 0x7fd7d40b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:15.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.099+0000 7fd7d9247640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7d40cfaf0 0x7fd7d40c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:15.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.099+0000 7fd7d9247640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7d415bde0 0x7fd7d40b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:15.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.099+0000 7fd7d9247640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d40af1a0 con 0x7fd7d415bde0 2024-09-10T23:14:15.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.099+0000 7fd7d9247640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d40af020 con 0x7fd7d40cfaf0 2024-09-10T23:14:15.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.099+0000 7fd7d9247640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d40af320 con 0x7fd7d40cd680 2024-09-10T23:14:15.102 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.099+0000 7fd7d2d9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7d40cd680 0x7fd7d40b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:15.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.099+0000 7fd7d259c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7d40cfaf0 0x7fd7d40c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:15.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.099+0000 7fd7d2d9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7d40cd680 0x7fd7d40b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:44816/0 (socket says 172.21.15.171:44816) 2024-09-10T23:14:15.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.099+0000 7fd7d259c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7d40cfaf0 0x7fd7d40c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:60816/0 (socket says 172.21.15.171:60816) 2024-09-10T23:14:15.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.099+0000 7fd7d2d9d640 1 -- 172.21.15.171:0/1296440502 learned_addr learned my addr 172.21.15.171:0/1296440502 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-09-10T23:14:15.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.099+0000 7fd7d359e640 1 --2- 172.21.15.171:0/1296440502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7d415bde0 0x7fd7d40b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:15.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.100+0000 7fd7d2d9d640 1 -- 172.21.15.171:0/1296440502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7d40cfaf0 msgr2=0x7fd7d40c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:15.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.100+0000 7fd7d2d9d640 1 --2- 172.21.15.171:0/1296440502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7d40cfaf0 0x7fd7d40c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:15.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.100+0000 7fd7d2d9d640 1 -- 172.21.15.171:0/1296440502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7d415bde0 msgr2=0x7fd7d40b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:15.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.100+0000 7fd7d2d9d640 1 --2- 172.21.15.171:0/1296440502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7d415bde0 0x7fd7d40b7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:15.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.100+0000 7fd7d2d9d640 1 -- 172.21.15.171:0/1296440502 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d41e1b10 con 0x7fd7d40cd680 2024-09-10T23:14:15.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.100+0000 7fd7d259c640 1 --2- 172.21.15.171:0/1296440502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7d40cfaf0 0x7fd7d40c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:14:15.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.100+0000 7fd7d359e640 1 --2- 172.21.15.171:0/1296440502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7d415bde0 0x7fd7d40b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:14:15.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.100+0000 7fd7d2d9d640 1 --2- 172.21.15.171:0/1296440502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7d40cd680 0x7fd7d40b1f30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc00c430 tx=0x7fd7cc00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:15.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.100+0000 7fd7cb7fe640 1 -- 172.21.15.171:0/1296440502 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc011790 con 0x7fd7d40cd680 2024-09-10T23:14:15.103 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.100+0000 7fd7cb7fe640 1 -- 172.21.15.171:0/1296440502 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7cc017070 con 0x7fd7d40cd680 2024-09-10T23:14:15.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.100+0000 7fd7cb7fe640 1 -- 172.21.15.171:0/1296440502 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc011ce0 con 0x7fd7d40cd680 2024-09-10T23:14:15.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.100+0000 7fd7d9247640 1 -- 172.21.15.171:0/1296440502 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d40cbb50 con 0x7fd7d40cd680 2024-09-10T23:14:15.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.100+0000 7fd7d9247640 1 -- 172.21.15.171:0/1296440502 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d41e1dd0 con 0x7fd7d40cd680 2024-09-10T23:14:15.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.100+0000 7fd7cb7fe640 1 -- 172.21.15.171:0/1296440502 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fd7cc01c460 con 0x7fd7d40cd680 2024-09-10T23:14:15.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.100+0000 7fd7cb7fe640 1 -- 172.21.15.171:0/1296440502 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fd7cc012790 con 0x7fd7d40cd680 2024-09-10T23:14:15.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.101+0000 7fd7d9247640 1 -- 172.21.15.171:0/1296440502 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d415b990 con 0x7fd7d40cd680 2024-09-10T23:14:15.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.105+0000 7fd7cb7fe640 1 -- 172.21.15.171:0/1296440502 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fd7d415b990 con 0x7fd7d40cd680 2024-09-10T23:14:15.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.176+0000 7fd7d9247640 1 -- 172.21.15.171:0/1296440502 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "82ad74e4-f7ff-4ce3-baf4-d67b438a8876", "id": 7} v 0) -- 0x7fd7d40aeae0 con 0x7fd7d40cd680 2024-09-10T23:14:15.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.180+0000 7fd7cb7fe640 1 -- 172.21.15.171:0/1296440502 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "82ad74e4-f7ff-4ce3-baf4-d67b438a8876", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fd7cc012a60 con 0x7fd7d40cd680 2024-09-10T23:14:15.181 INFO:teuthology.orchestra.run.smithi171.stdout:7 2024-09-10T23:14:15.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.181+0000 7fd7d9247640 1 -- 172.21.15.171:0/1296440502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7d40cd680 msgr2=0x7fd7d40b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:15.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.181+0000 7fd7d9247640 1 --2- 172.21.15.171:0/1296440502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7d40cd680 0x7fd7d40b1f30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc00c430 tx=0x7fd7cc00c8f0 comp rx=0 tx=0).stop 2024-09-10T23:14:15.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.181+0000 7fd7d9247640 1 -- 172.21.15.171:0/1296440502 shutdown_connections 2024-09-10T23:14:15.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.181+0000 7fd7d9247640 1 --2- 172.21.15.171:0/1296440502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7d40cfaf0 0x7fd7d40c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:15.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.181+0000 7fd7d9247640 1 --2- 172.21.15.171:0/1296440502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7d415bde0 0x7fd7d40b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:15.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.181+0000 7fd7d9247640 1 --2- 172.21.15.171:0/1296440502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7d40cd680 0x7fd7d40b1f30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:15.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.181+0000 7fd7d9247640 1 -- 172.21.15.171:0/1296440502 >> 172.21.15.171:0/1296440502 conn(0x7fd7d40d1f20 msgr2=0x7fd7d40708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:15.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.181+0000 7fd7d9247640 1 -- 172.21.15.171:0/1296440502 shutdown_connections 2024-09-10T23:14:15.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:15.181+0000 7fd7d9247640 1 -- 172.21.15.171:0/1296440502 wait complete. 2024-09-10T23:14:15.192 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T23:14:15.192 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T23:14:15.194 INFO:tasks.ceph.osd.0:Started 2024-09-10T23:14:15.195 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T23:14:15.195 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T23:14:15.197 INFO:tasks.ceph.osd.1:Started 2024-09-10T23:14:15.197 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T23:14:15.197 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T23:14:15.199 INFO:tasks.ceph.osd.2:Started 2024-09-10T23:14:15.199 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T23:14:15.200 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T23:14:15.202 INFO:tasks.ceph.osd.3:Started 2024-09-10T23:14:15.202 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-10T23:14:15.202 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-10T23:14:15.204 INFO:tasks.ceph.osd.4:Started 2024-09-10T23:14:15.204 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-10T23:14:15.204 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-10T23:14:15.206 INFO:tasks.ceph.osd.5:Started 2024-09-10T23:14:15.207 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-10T23:14:15.207 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-10T23:14:15.209 INFO:tasks.ceph.osd.6:Started 2024-09-10T23:14:15.209 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-10T23:14:15.209 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-10T23:14:15.211 INFO:tasks.ceph.osd.7:Started 2024-09-10T23:14:15.212 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:14:15.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.352+0000 7fc15b433640 1 -- 172.21.15.90:0/3829444499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1540d2470 msgr2=0x7fc1540b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:15.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.352+0000 7fc15b433640 1 --2- 172.21.15.90:0/3829444499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1540d2470 0x7fc1540b3490 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc144005fd0 tx=0x7fc14402a670 comp rx=0 tx=0).stop 2024-09-10T23:14:15.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.352+0000 7fc15b433640 1 -- 172.21.15.90:0/3829444499 shutdown_connections 2024-09-10T23:14:15.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.352+0000 7fc15b433640 1 --2- 172.21.15.90:0/3829444499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1540d2470 0x7fc1540b3490 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:15.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.352+0000 7fc15b433640 1 -- 172.21.15.90:0/3829444499 >> 172.21.15.90:0/3829444499 conn(0x7fc15409d2a0 msgr2=0x7fc1540d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:15.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.352+0000 7fc15b433640 1 -- 172.21.15.90:0/3829444499 shutdown_connections 2024-09-10T23:14:15.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.352+0000 7fc15b433640 1 -- 172.21.15.90:0/3829444499 wait complete. 2024-09-10T23:14:15.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.353+0000 7fc15b433640 1 Processor -- start 2024-09-10T23:14:15.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.353+0000 7fc15b433640 1 -- start start 2024-09-10T23:14:15.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.354+0000 7fc15b433640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1540b3a00 0x7fc1540ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:15.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.354+0000 7fc15b433640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1540d1c70 0x7fc1540b8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:15.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.354+0000 7fc15b433640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1540d2470 0x7fc1540d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:15.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.354+0000 7fc15b433640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc1540b4740 con 0x7fc1540d2470 2024-09-10T23:14:15.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.354+0000 7fc15b433640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc1540b45c0 con 0x7fc1540d1c70 2024-09-10T23:14:15.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.354+0000 7fc15b433640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc1540b48c0 con 0x7fc1540b3a00 2024-09-10T23:14:15.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.354+0000 7fc1599d0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1540d2470 0x7fc1540d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:15.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.354+0000 7fc1599d0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1540d2470 0x7fc1540d0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48482/0 (socket says 172.21.15.90:48482) 2024-09-10T23:14:15.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.354+0000 7fc1599d0640 1 -- 172.21.15.90:0/2064291563 learned_addr learned my addr 172.21.15.90:0/2064291563 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:15.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.354+0000 7fc1589ce640 1 --2- 172.21.15.90:0/2064291563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1540d1c70 0x7fc1540b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:15.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.354+0000 7fc1591cf640 1 --2- 172.21.15.90:0/2064291563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1540b3a00 0x7fc1540ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:15.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.354+0000 7fc1599d0640 1 -- 172.21.15.90:0/2064291563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1540b3a00 msgr2=0x7fc1540ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:15.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.354+0000 7fc1599d0640 1 --2- 172.21.15.90:0/2064291563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1540b3a00 0x7fc1540ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:15.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.354+0000 7fc1599d0640 1 -- 172.21.15.90:0/2064291563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1540d1c70 msgr2=0x7fc1540b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:15.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.354+0000 7fc1599d0640 1 --2- 172.21.15.90:0/2064291563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1540d1c70 0x7fc1540b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:15.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.354+0000 7fc1599d0640 1 -- 172.21.15.90:0/2064291563 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1540b8c70 con 0x7fc1540d2470 2024-09-10T23:14:15.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.355+0000 7fc1599d0640 1 --2- 172.21.15.90:0/2064291563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1540d2470 0x7fc1540d0ab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00c7a0 tx=0x7fc14c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:15.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.355+0000 7fc149ffb640 1 -- 172.21.15.90:0/2064291563 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c003b70 con 0x7fc1540d2470 2024-09-10T23:14:15.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.355+0000 7fc149ffb640 1 -- 172.21.15.90:0/2064291563 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc14c003d10 con 0x7fc1540d2470 2024-09-10T23:14:15.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.355+0000 7fc15b433640 1 -- 172.21.15.90:0/2064291563 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1540b8f50 con 0x7fc1540d2470 2024-09-10T23:14:15.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.355+0000 7fc149ffb640 1 -- 172.21.15.90:0/2064291563 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c00aab0 con 0x7fc1540d2470 2024-09-10T23:14:15.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.355+0000 7fc149ffb640 1 -- 172.21.15.90:0/2064291563 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc14c00ac50 con 0x7fc1540d2470 2024-09-10T23:14:15.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.355+0000 7fc15b433640 1 -- 172.21.15.90:0/2064291563 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1540b9510 con 0x7fc1540d2470 2024-09-10T23:14:15.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.355+0000 7fc149ffb640 1 -- 172.21.15.90:0/2064291563 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fc14c0126f0 con 0x7fc1540d2470 2024-09-10T23:14:15.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.356+0000 7fc15b433640 1 -- 172.21.15.90:0/2064291563 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1540b3490 con 0x7fc1540d2470 2024-09-10T23:14:15.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.358+0000 7fc149ffb640 1 -- 172.21.15.90:0/2064291563 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fc14c021020 con 0x7fc1540d2470 2024-09-10T23:14:15.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.418+0000 7fc15b433640 1 -- 172.21.15.90:0/2064291563 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1540008d0 con 0x7fc1540d2470 2024-09-10T23:14:15.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.419+0000 7fc149ffb640 1 -- 172.21.15.90:0/2064291563 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fc1540cff60 con 0x7fc1540d2470 2024-09-10T23:14:15.420 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:15.420 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":10,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:14:15.178045+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:14:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.420+0000 7fc15b433640 1 -- 172.21.15.90:0/2064291563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1540d2470 msgr2=0x7fc1540d0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.420+0000 7fc15b433640 1 --2- 172.21.15.90:0/2064291563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1540d2470 0x7fc1540d0ab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00c7a0 tx=0x7fc14c00cc60 comp rx=0 tx=0).stop 2024-09-10T23:14:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.420+0000 7fc15b433640 1 -- 172.21.15.90:0/2064291563 shutdown_connections 2024-09-10T23:14:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.420+0000 7fc15b433640 1 --2- 172.21.15.90:0/2064291563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1540d1c70 0x7fc1540b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.420+0000 7fc15b433640 1 --2- 172.21.15.90:0/2064291563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1540d2470 0x7fc1540d0ab0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.420+0000 7fc15b433640 1 --2- 172.21.15.90:0/2064291563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1540b3a00 0x7fc1540ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.420+0000 7fc15b433640 1 -- 172.21.15.90:0/2064291563 >> 172.21.15.90:0/2064291563 conn(0x7fc15409d2a0 msgr2=0x7fc1540b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.420+0000 7fc15b433640 1 -- 172.21.15.90:0/2064291563 shutdown_connections 2024-09-10T23:14:15.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:15.420+0000 7fc15b433640 1 -- 172.21.15.90:0/2064291563 wait complete. 2024-09-10T23:14:15.431 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T23:14:15.431 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T23:14:16.238 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T23:14:16.331 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.330+0000 7f5a1efad640 1 -- 172.21.15.90:0/3142133012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a18151c40 msgr2=0x7f5a180b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:16.331 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.330+0000 7f5a1efad640 1 --2- 172.21.15.90:0/3142133012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a18151c40 0x7f5a180b3ab0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a180690e0 tx=0x7f5a0c02a530 comp rx=0 tx=0).stop 2024-09-10T23:14:16.331 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.330+0000 7f5a1efad640 1 -- 172.21.15.90:0/3142133012 shutdown_connections 2024-09-10T23:14:16.331 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.330+0000 7f5a1efad640 1 --2- 172.21.15.90:0/3142133012 >> v2:172.21.15.171:3300/0 conn(0x7f5a18074020 0x7f5a1815ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:16.331 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.330+0000 7f5a1efad640 1 --2- 172.21.15.90:0/3142133012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a18151c40 0x7f5a180b3ab0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:16.331 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.330+0000 7f5a1efad640 1 -- 172.21.15.90:0/3142133012 >> 172.21.15.90:0/3142133012 conn(0x7f5a180696e0 msgr2=0x7f5a1806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:16.331 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.330+0000 7f5a1efad640 1 -- 172.21.15.90:0/3142133012 shutdown_connections 2024-09-10T23:14:16.332 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.330+0000 7f5a1efad640 1 -- 172.21.15.90:0/3142133012 wait complete. 2024-09-10T23:14:16.332 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.331+0000 7f5a1efad640 1 Processor -- start 2024-09-10T23:14:16.332 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.331+0000 7f5a1efad640 1 -- start start 2024-09-10T23:14:16.334 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.332+0000 7f5a1efad640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a18074020 0x7f5a18156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:16.334 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.332+0000 7f5a1efad640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a18151c40 0x7f5a181f32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:16.334 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.332+0000 7f5a1efad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a1815e7a0 0x7f5a181f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:16.334 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.332+0000 7f5a1efad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1815bc50 con 0x7f5a1815e7a0 2024-09-10T23:14:16.335 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.332+0000 7f5a1efad640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1815bad0 con 0x7f5a18074020 2024-09-10T23:14:16.335 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.332+0000 7f5a1efad640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5a1815bdd0 con 0x7f5a18151c40 2024-09-10T23:14:16.335 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.332+0000 7f5a1d54a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a1815e7a0 0x7f5a181f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:16.335 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.332+0000 7f5a1d54a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a1815e7a0 0x7f5a181f55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48504/0 (socket says 172.21.15.90:48504) 2024-09-10T23:14:16.335 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.332+0000 7f5a1d54a640 1 -- 172.21.15.90:0/1910162909 learned_addr learned my addr 172.21.15.90:0/1910162909 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:16.335 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.332+0000 7f5a17fff640 1 --2- 172.21.15.90:0/1910162909 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a18151c40 0x7f5a181f32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:16.335 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.332+0000 7f5a1cd49640 1 --2- 172.21.15.90:0/1910162909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a18074020 0x7f5a18156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:16.335 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.332+0000 7f5a1d54a640 1 -- 172.21.15.90:0/1910162909 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a18151c40 msgr2=0x7f5a181f32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:16.335 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.332+0000 7f5a1d54a640 1 --2- 172.21.15.90:0/1910162909 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a18151c40 0x7f5a181f32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:16.335 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.332+0000 7f5a1d54a640 1 -- 172.21.15.90:0/1910162909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a18074020 msgr2=0x7f5a18156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:16.335 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.332+0000 7f5a1d54a640 1 --2- 172.21.15.90:0/1910162909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a18074020 0x7f5a18156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:16.335 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.332+0000 7f5a1d54a640 1 -- 172.21.15.90:0/1910162909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a181f5b00 con 0x7f5a1815e7a0 2024-09-10T23:14:16.335 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.332+0000 7f5a1d54a640 1 --2- 172.21.15.90:0/1910162909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a1815e7a0 0x7f5a181f55c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000eaa0 tx=0x7f5a1000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:16.335 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.333+0000 7f5a157fa640 1 -- 172.21.15.90:0/1910162909 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1000cd50 con 0x7f5a1815e7a0 2024-09-10T23:14:16.336 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.333+0000 7f5a157fa640 1 -- 172.21.15.90:0/1910162909 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a10004b20 con 0x7f5a1815e7a0 2024-09-10T23:14:16.336 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.333+0000 7f5a1efad640 1 -- 172.21.15.90:0/1910162909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a18156980 con 0x7f5a1815e7a0 2024-09-10T23:14:16.336 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.333+0000 7f5a157fa640 1 -- 172.21.15.90:0/1910162909 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a10005020 con 0x7f5a1815e7a0 2024-09-10T23:14:16.336 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.333+0000 7f5a1efad640 1 -- 172.21.15.90:0/1910162909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a18156f40 con 0x7f5a1815e7a0 2024-09-10T23:14:16.336 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.333+0000 7f5a157fa640 1 -- 172.21.15.90:0/1910162909 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f5a1000f040 con 0x7f5a1815e7a0 2024-09-10T23:14:16.336 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.333+0000 7f5a157fa640 1 -- 172.21.15.90:0/1910162909 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f5a1001a400 con 0x7f5a1815e7a0 2024-09-10T23:14:16.336 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.334+0000 7f5a1efad640 1 -- 172.21.15.90:0/1910162909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a1815ec10 con 0x7f5a1815e7a0 2024-09-10T23:14:16.336 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.335+0000 7f5a157fa640 1 -- 172.21.15.90:0/1910162909 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f5a10016030 con 0x7f5a1815e7a0 2024-09-10T23:14:16.397 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.396+0000 7f5a1efad640 1 -- 172.21.15.90:0/1910162909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a180d01c0 con 0x7f5a1815e7a0 2024-09-10T23:14:16.398 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.396+0000 7f5a157fa640 1 -- 172.21.15.90:0/1910162909 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f5a100052b0 con 0x7f5a1815e7a0 2024-09-10T23:14:16.398 INFO:teuthology.misc.health.smithi090.stdout: 2024-09-10T23:14:16.398 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":10,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:14:15.178045+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:14:16.399 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.397+0000 7f5a1efad640 1 -- 172.21.15.90:0/1910162909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a1815e7a0 msgr2=0x7f5a181f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:16.399 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.397+0000 7f5a1efad640 1 --2- 172.21.15.90:0/1910162909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a1815e7a0 0x7f5a181f55c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000eaa0 tx=0x7f5a1000ef60 comp rx=0 tx=0).stop 2024-09-10T23:14:16.399 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.397+0000 7f5a1efad640 1 -- 172.21.15.90:0/1910162909 shutdown_connections 2024-09-10T23:14:16.399 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.397+0000 7f5a1efad640 1 --2- 172.21.15.90:0/1910162909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a1815e7a0 0x7f5a181f55c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:16.399 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.397+0000 7f5a1efad640 1 --2- 172.21.15.90:0/1910162909 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a18151c40 0x7f5a181f32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:16.399 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.397+0000 7f5a1efad640 1 --2- 172.21.15.90:0/1910162909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a18074020 0x7f5a18156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:16.399 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.397+0000 7f5a1efad640 1 -- 172.21.15.90:0/1910162909 >> 172.21.15.90:0/1910162909 conn(0x7f5a180696e0 msgr2=0x7f5a180b2300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:16.399 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.398+0000 7f5a1efad640 1 -- 172.21.15.90:0/1910162909 shutdown_connections 2024-09-10T23:14:16.399 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:16.398+0000 7f5a1efad640 1 -- 172.21.15.90:0/1910162909 wait complete. 2024-09-10T23:14:16.408 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T23:14:16.657 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-09-10T23:14:16.656+0000 7f1484215640 -1 Falling back to public interface 2024-09-10T23:14:16.680 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-09-10T23:14:16.679+0000 7fd20801f640 -1 Falling back to public interface 2024-09-10T23:14:16.684 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-09-10T23:14:16.683+0000 7f954360d640 -1 Falling back to public interface 2024-09-10T23:14:16.684 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-09-10T23:14:16.683+0000 7fb903462640 -1 Falling back to public interface 2024-09-10T23:14:16.915 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-09-10T23:14:16.914+0000 7fd8a9c31640 -1 Falling back to public interface 2024-09-10T23:14:16.926 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-10T23:14:16.925+0000 7f03e7487640 -1 Falling back to public interface 2024-09-10T23:14:16.945 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-09-10T23:14:16.944+0000 7f6a31210640 -1 Falling back to public interface 2024-09-10T23:14:17.191 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-09-10T23:14:17.190+0000 7f0b12e2c640 -1 Falling back to public interface 2024-09-10T23:14:17.438 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-09-10T23:14:17.437+0000 7f43e1595640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T23:14:17.440 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-09-10T23:14:17.439+0000 7f43e1595640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T23:14:20.209 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-09-10T23:14:20.208+0000 7f1484215640 -1 osd.0 0 log_to_monitors true 2024-09-10T23:14:20.719 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-10T23:14:20.719+0000 7f03e7487640 -1 osd.1 0 log_to_monitors true 2024-09-10T23:14:20.782 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-09-10T23:14:20.781+0000 7fb903462640 -1 osd.7 0 log_to_monitors true 2024-09-10T23:14:20.784 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-09-10T23:14:20.783+0000 7fd20801f640 -1 osd.3 0 log_to_monitors true 2024-09-10T23:14:20.936 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-09-10T23:14:20.935+0000 7fd8a9c31640 -1 osd.4 0 log_to_monitors true 2024-09-10T23:14:21.027 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-09-10T23:14:21.026+0000 7f954360d640 -1 osd.2 0 log_to_monitors true 2024-09-10T23:14:21.044 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-09-10T23:14:21.043+0000 7f6a31210640 -1 osd.5 0 log_to_monitors true 2024-09-10T23:14:21.271 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-09-10T23:14:21.270+0000 7f0b12e2c640 -1 osd.6 0 log_to_monitors true 2024-09-10T23:14:22.274 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-09-10T23:14:22.273+0000 7f147faf5640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T23:14:22.284 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-09-10T23:14:22.283+0000 7f1477914640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:14:23.214 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T23:14:23.321 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.320+0000 7fb4b27ad640 1 -- 172.21.15.90:0/2043224101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4ac155260 msgr2=0x7fb4ac0741e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:23.321 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.320+0000 7fb4b27ad640 1 --2- 172.21.15.90:0/2043224101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4ac155260 0x7fb4ac0741e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0d0a60 tx=0x7fb49c02a560 comp rx=0 tx=0).stop 2024-09-10T23:14:23.321 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.320+0000 7fb4b27ad640 1 -- 172.21.15.90:0/2043224101 shutdown_connections 2024-09-10T23:14:23.321 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.320+0000 7fb4b27ad640 1 --2- 172.21.15.90:0/2043224101 >> v2:172.21.15.171:3300/0 conn(0x7fb4ac0b3d90 0x7fb4ac15b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:23.322 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.320+0000 7fb4b27ad640 1 --2- 172.21.15.90:0/2043224101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4ac155260 0x7fb4ac0741e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:23.322 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.320+0000 7fb4b27ad640 1 -- 172.21.15.90:0/2043224101 >> 172.21.15.90:0/2043224101 conn(0x7fb4ac0b6a50 msgr2=0x7fb4ac06dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:23.322 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.320+0000 7fb4b27ad640 1 -- 172.21.15.90:0/2043224101 shutdown_connections 2024-09-10T23:14:23.322 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.320+0000 7fb4b27ad640 1 -- 172.21.15.90:0/2043224101 wait complete. 2024-09-10T23:14:23.324 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.321+0000 7fb4b27ad640 1 Processor -- start 2024-09-10T23:14:23.324 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.321+0000 7fb4b27ad640 1 -- start start 2024-09-10T23:14:23.324 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.322+0000 7fb4b27ad640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb4ac0b3d90 0x7fb4ac156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:23.324 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.322+0000 7fb4b27ad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4ac155260 0x7fb4ac14fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:23.324 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.322+0000 7fb4b27ad640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4ac15b720 0x7fb4ac157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:23.324 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.322+0000 7fb4b27ad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ac070460 con 0x7fb4ac155260 2024-09-10T23:14:23.324 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.322+0000 7fb4b27ad640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ac0702e0 con 0x7fb4ac15b720 2024-09-10T23:14:23.325 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.322+0000 7fb4b27ad640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb4ac0705e0 con 0x7fb4ac0b3d90 2024-09-10T23:14:23.325 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.322+0000 7fb4ab7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4ac155260 0x7fb4ac14fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:23.325 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.322+0000 7fb4ab7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4ac155260 0x7fb4ac14fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50484/0 (socket says 172.21.15.90:50484) 2024-09-10T23:14:23.325 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.322+0000 7fb4ab7fe640 1 -- 172.21.15.90:0/3676974037 learned_addr learned my addr 172.21.15.90:0/3676974037 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:23.325 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.322+0000 7fb4abfff640 1 --2- 172.21.15.90:0/3676974037 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb4ac0b3d90 0x7fb4ac156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:23.325 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.322+0000 7fb4b0d4a640 1 --2- 172.21.15.90:0/3676974037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4ac15b720 0x7fb4ac157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:23.325 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.322+0000 7fb4ab7fe640 1 -- 172.21.15.90:0/3676974037 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb4ac0b3d90 msgr2=0x7fb4ac156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:23.325 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.322+0000 7fb4ab7fe640 1 --2- 172.21.15.90:0/3676974037 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb4ac0b3d90 0x7fb4ac156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:23.325 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.322+0000 7fb4ab7fe640 1 -- 172.21.15.90:0/3676974037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4ac15b720 msgr2=0x7fb4ac157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:23.325 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.322+0000 7fb4ab7fe640 1 --2- 172.21.15.90:0/3676974037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4ac15b720 0x7fb4ac157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:23.325 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.322+0000 7fb4ab7fe640 1 -- 172.21.15.90:0/3676974037 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ac150150 con 0x7fb4ac155260 2024-09-10T23:14:23.325 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.322+0000 7fb4ab7fe640 1 --2- 172.21.15.90:0/3676974037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4ac155260 0x7fb4ac14fc10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000ea20 tx=0x7fb4a000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:23.326 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.323+0000 7fb4a8ff9640 1 -- 172.21.15.90:0/3676974037 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a000cd80 con 0x7fb4ac155260 2024-09-10T23:14:23.326 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.323+0000 7fb4a8ff9640 1 -- 172.21.15.90:0/3676974037 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4a0005020 con 0x7fb4ac155260 2024-09-10T23:14:23.326 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.323+0000 7fb4b27ad640 1 -- 172.21.15.90:0/3676974037 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4ac155d10 con 0x7fb4ac155260 2024-09-10T23:14:23.326 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.323+0000 7fb4a8ff9640 1 -- 172.21.15.90:0/3676974037 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0005450 con 0x7fb4ac155260 2024-09-10T23:14:23.326 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.323+0000 7fb4b27ad640 1 -- 172.21.15.90:0/3676974037 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4ac1562d0 con 0x7fb4ac155260 2024-09-10T23:14:23.327 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.324+0000 7fb4b27ad640 1 -- 172.21.15.90:0/3676974037 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4ac070a90 con 0x7fb4ac155260 2024-09-10T23:14:23.327 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.324+0000 7fb4a8ff9640 1 -- 172.21.15.90:0/3676974037 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) ==== 100545+0+0 (secure 0 0 0) 0x7fb4a00047a0 con 0x7fb4ac155260 2024-09-10T23:14:23.327 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.325+0000 7fb4a8ff9640 1 --2- 172.21.15.90:0/3676974037 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb498077ee0 0x7fb49807a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:23.327 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.325+0000 7fb4a8ff9640 1 -- 172.21.15.90:0/3676974037 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7fb4a0099a10 con 0x7fb4ac155260 2024-09-10T23:14:23.327 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.325+0000 7fb4abfff640 1 --2- 172.21.15.90:0/3676974037 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb498077ee0 0x7fb49807a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:23.327 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.326+0000 7fb4abfff640 1 --2- 172.21.15.90:0/3676974037 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb498077ee0 0x7fb49807a3a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb49c033000 tx=0x7fb49c004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:23.331 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.331+0000 7fb4a8ff9640 1 -- 172.21.15.90:0/3676974037 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb4a0062b90 con 0x7fb4ac155260 2024-09-10T23:14:23.576 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.575+0000 7fb4b27ad640 1 -- 172.21.15.90:0/3676974037 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4ac0cffe0 con 0x7fb4ac155260 2024-09-10T23:14:23.576 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.575+0000 7fb4a8ff9640 1 -- 172.21.15.90:0/3676974037 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7555 (secure 0 0 0) 0x7fb4a00675c0 con 0x7fb4ac155260 2024-09-10T23:14:23.576 INFO:teuthology.misc.health.smithi090.stdout: 2024-09-10T23:14:23.577 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":13,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:14:22.447637+0000","last_up_change":"2024-09-10T23:14:22.447637+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:14:23.579 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.578+0000 7fb4b27ad640 1 -- 172.21.15.90:0/3676974037 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb498077ee0 msgr2=0x7fb49807a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:23.579 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.578+0000 7fb4b27ad640 1 --2- 172.21.15.90:0/3676974037 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb498077ee0 0x7fb49807a3a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb49c033000 tx=0x7fb49c004730 comp rx=0 tx=0).stop 2024-09-10T23:14:23.579 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.578+0000 7fb4b27ad640 1 -- 172.21.15.90:0/3676974037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4ac155260 msgr2=0x7fb4ac14fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:23.579 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.578+0000 7fb4b27ad640 1 --2- 172.21.15.90:0/3676974037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4ac155260 0x7fb4ac14fc10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000ea20 tx=0x7fb4a000ee20 comp rx=0 tx=0).stop 2024-09-10T23:14:23.579 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.578+0000 7fb4b27ad640 1 -- 172.21.15.90:0/3676974037 shutdown_connections 2024-09-10T23:14:23.580 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.578+0000 7fb4b27ad640 1 --2- 172.21.15.90:0/3676974037 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb498077ee0 0x7fb49807a3a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:23.580 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.578+0000 7fb4b27ad640 1 --2- 172.21.15.90:0/3676974037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4ac15b720 0x7fb4ac157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:23.580 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.578+0000 7fb4b27ad640 1 --2- 172.21.15.90:0/3676974037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4ac155260 0x7fb4ac14fc10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:23.580 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.578+0000 7fb4b27ad640 1 --2- 172.21.15.90:0/3676974037 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb4ac0b3d90 0x7fb4ac156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:23.580 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.578+0000 7fb4b27ad640 1 -- 172.21.15.90:0/3676974037 >> 172.21.15.90:0/3676974037 conn(0x7fb4ac0b6a50 msgr2=0x7fb4ac070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:23.580 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.578+0000 7fb4b27ad640 1 -- 172.21.15.90:0/3676974037 shutdown_connections 2024-09-10T23:14:23.580 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:23.578+0000 7fb4b27ad640 1 -- 172.21.15.90:0/3676974037 wait complete. 2024-09-10T23:14:23.591 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-10T23:14:24.071 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-10T23:14:24.070+0000 7f03e3416640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T23:14:24.082 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-10T23:14:24.082+0000 7f03db235640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:14:24.101 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-09-10T23:14:24.100+0000 7fd2039ec640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T23:14:24.113 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-09-10T23:14:24.113+0000 7fd1fb80b640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:14:24.153 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-09-10T23:14:24.152+0000 7f953eefe640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T23:14:24.168 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-09-10T23:14:24.167+0000 7f9536d1d640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:14:24.295 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:14:24.298 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:14:24.331 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-09-10T23:14:24.329+0000 7fb8ff3f1640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T23:14:24.345 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-09-10T23:14:24.343+0000 7fb8f7210640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:14:24.557 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-09-10T23:14:24.556+0000 7fd8a5999640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T23:14:24.563 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-09-10T23:14:24.562+0000 7f6a2cafe640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T23:14:24.570 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-09-10T23:14:24.570+0000 7fd89cfa4640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:14:24.583 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-09-10T23:14:24.583+0000 7f6a2491d640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:14:24.585 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-09-10T23:14:24.584+0000 7f0b0edbb640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T23:14:24.595 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-09-10T23:14:24.595+0000 7f0b06bda640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:14:30.398 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T23:14:30.503 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.501+0000 7f15c963c640 1 -- 172.21.15.90:0/3713936663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15c40b4a90 msgr2=0x7f15c4168fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:30.503 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.501+0000 7f15c963c640 1 --2- 172.21.15.90:0/3713936663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15c40b4a90 0x7f15c4168fb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009830 tx=0x7f15bc02a530 comp rx=0 tx=0).stop 2024-09-10T23:14:30.503 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.501+0000 7f15c963c640 1 -- 172.21.15.90:0/3713936663 shutdown_connections 2024-09-10T23:14:30.503 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.501+0000 7f15c963c640 1 --2- 172.21.15.90:0/3713936663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15c40b4a90 0x7f15c4168fb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:30.503 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.501+0000 7f15c963c640 1 -- 172.21.15.90:0/3713936663 >> 172.21.15.90:0/3713936663 conn(0x7f15c40d3f10 msgr2=0x7f15c40d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:30.504 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.501+0000 7f15c963c640 1 -- 172.21.15.90:0/3713936663 shutdown_connections 2024-09-10T23:14:30.504 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.501+0000 7f15c963c640 1 -- 172.21.15.90:0/3713936663 wait complete. 2024-09-10T23:14:30.508 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.502+0000 7f15c963c640 1 Processor -- start 2024-09-10T23:14:30.508 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.503+0000 7f15c963c640 1 -- start start 2024-09-10T23:14:30.508 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.503+0000 7f15c963c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15c40b4a90 0x7f15c415f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:30.508 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.503+0000 7f15c963c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15c40d1ae0 0x7f15c4158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:30.509 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.503+0000 7f15c963c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15c4161730 0x7f15c4160930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:30.509 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.503+0000 7f15c963c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f15c4169670 con 0x7f15c40b4a90 2024-09-10T23:14:30.509 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.503+0000 7f15c963c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f15c41694f0 con 0x7f15c40d1ae0 2024-09-10T23:14:30.509 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.503+0000 7f15c963c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f15c41697f0 con 0x7f15c4161730 2024-09-10T23:14:30.509 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.503+0000 7f15c2ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15c40b4a90 0x7f15c415f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:30.509 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.503+0000 7f15c2ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15c40b4a90 0x7f15c415f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48680/0 (socket says 172.21.15.90:48680) 2024-09-10T23:14:30.509 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.503+0000 7f15c2ffd640 1 -- 172.21.15.90:0/3272725807 learned_addr learned my addr 172.21.15.90:0/3272725807 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:30.509 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.504+0000 7f15c27fc640 1 --2- 172.21.15.90:0/3272725807 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15c40d1ae0 0x7f15c4158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:30.509 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.504+0000 7f15c37fe640 1 --2- 172.21.15.90:0/3272725807 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15c4161730 0x7f15c4160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:30.509 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.504+0000 7f15c2ffd640 1 -- 172.21.15.90:0/3272725807 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15c4161730 msgr2=0x7f15c4160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:30.509 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.504+0000 7f15c2ffd640 1 --2- 172.21.15.90:0/3272725807 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15c4161730 0x7f15c4160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:30.510 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.504+0000 7f15c2ffd640 1 -- 172.21.15.90:0/3272725807 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15c40d1ae0 msgr2=0x7f15c4158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:30.510 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.504+0000 7f15c2ffd640 1 --2- 172.21.15.90:0/3272725807 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15c40d1ae0 0x7f15c4158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:30.510 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.504+0000 7f15c2ffd640 1 -- 172.21.15.90:0/3272725807 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c415f8b0 con 0x7f15c40b4a90 2024-09-10T23:14:30.510 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.504+0000 7f15c37fe640 1 --2- 172.21.15.90:0/3272725807 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15c4161730 0x7f15c4160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:14:30.510 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.504+0000 7f15c2ffd640 1 --2- 172.21.15.90:0/3272725807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15c40b4a90 0x7f15c415f2d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f15b400cc50 tx=0x7f15b400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:30.510 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.504+0000 7f15bb7fe640 1 -- 172.21.15.90:0/3272725807 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b4016020 con 0x7f15c40b4a90 2024-09-10T23:14:30.510 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.504+0000 7f15bb7fe640 1 -- 172.21.15.90:0/3272725807 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15b4012420 con 0x7f15c40b4a90 2024-09-10T23:14:30.510 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.504+0000 7f15c963c640 1 -- 172.21.15.90:0/3272725807 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c415fb90 con 0x7f15c40b4a90 2024-09-10T23:14:30.510 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.504+0000 7f15bb7fe640 1 -- 172.21.15.90:0/3272725807 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b400ce60 con 0x7f15c40b4a90 2024-09-10T23:14:30.510 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.504+0000 7f15c963c640 1 -- 172.21.15.90:0/3272725807 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c4160150 con 0x7f15c40b4a90 2024-09-10T23:14:30.511 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.505+0000 7f15c963c640 1 -- 172.21.15.90:0/3272725807 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15c40b56d0 con 0x7f15c40b4a90 2024-09-10T23:14:30.511 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.506+0000 7f15bb7fe640 1 -- 172.21.15.90:0/3272725807 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f15b401a3b0 con 0x7f15c40b4a90 2024-09-10T23:14:30.511 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.506+0000 7f15bb7fe640 1 --2- 172.21.15.90:0/3272725807 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f15a4077f70 0x7f15a407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:30.511 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.506+0000 7f15bb7fe640 1 -- 172.21.15.90:0/3272725807 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f15b409a0c0 con 0x7f15c40b4a90 2024-09-10T23:14:30.511 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.506+0000 7f15c27fc640 1 --2- 172.21.15.90:0/3272725807 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f15a4077f70 0x7f15a407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:30.511 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.507+0000 7f15c27fc640 1 --2- 172.21.15.90:0/3272725807 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f15a4077f70 0x7f15a407a430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f15ac001680 tx=0x7f15ac009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:30.511 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.510+0000 7f15bb7fe640 1 -- 172.21.15.90:0/3272725807 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f15c40b56d0 con 0x7f15c40b4a90 2024-09-10T23:14:30.688 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.687+0000 7f15c963c640 1 -- 172.21.15.90:0/3272725807 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15c40d0770 con 0x7f15c40b4a90 2024-09-10T23:14:30.689 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.688+0000 7f15bb7fe640 1 -- 172.21.15.90:0/3272725807 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12896 (secure 0 0 0) 0x7f15b4020030 con 0x7f15c40b4a90 2024-09-10T23:14:30.689 INFO:teuthology.misc.health.smithi090.stdout: 2024-09-10T23:14:30.689 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":19,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:14:29.090637+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:14:30.691 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.690+0000 7f15c963c640 1 -- 172.21.15.90:0/3272725807 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f15a4077f70 msgr2=0x7f15a407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:30.692 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.690+0000 7f15c963c640 1 --2- 172.21.15.90:0/3272725807 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f15a4077f70 0x7f15a407a430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f15ac001680 tx=0x7f15ac009040 comp rx=0 tx=0).stop 2024-09-10T23:14:30.692 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.690+0000 7f15c963c640 1 -- 172.21.15.90:0/3272725807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15c40b4a90 msgr2=0x7f15c415f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:30.692 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.690+0000 7f15c963c640 1 --2- 172.21.15.90:0/3272725807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15c40b4a90 0x7f15c415f2d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f15b400cc50 tx=0x7f15b400a430 comp rx=0 tx=0).stop 2024-09-10T23:14:30.692 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.690+0000 7f15c963c640 1 -- 172.21.15.90:0/3272725807 shutdown_connections 2024-09-10T23:14:30.692 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.690+0000 7f15c963c640 1 --2- 172.21.15.90:0/3272725807 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f15a4077f70 0x7f15a407a430 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:30.692 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.690+0000 7f15c963c640 1 --2- 172.21.15.90:0/3272725807 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15c40d1ae0 0x7f15c4158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:30.692 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.690+0000 7f15c963c640 1 --2- 172.21.15.90:0/3272725807 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15c4161730 0x7f15c4160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:30.692 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.690+0000 7f15c963c640 1 --2- 172.21.15.90:0/3272725807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15c40b4a90 0x7f15c415f2d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:30.692 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.690+0000 7f15c963c640 1 -- 172.21.15.90:0/3272725807 >> 172.21.15.90:0/3272725807 conn(0x7f15c40d3f10 msgr2=0x7f15c415e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:30.692 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.690+0000 7f15c963c640 1 -- 172.21.15.90:0/3272725807 shutdown_connections 2024-09-10T23:14:30.692 INFO:teuthology.misc.health.smithi090.stderr:2024-09-10T23:14:30.690+0000 7f15c963c640 1 -- 172.21.15.90:0/3272725807 wait complete. 2024-09-10T23:14:30.701 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-10T23:14:30.701 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T23:14:30.701 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:14:30.701 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:14:30.704 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:14:30.704 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:14:30.704 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:14:30.706 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:14:30.706 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:14:30.706 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:14:30.709 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:14:30.709 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:14:30.709 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:14:30.711 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:14:30.711 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-10T23:14:30.711 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:14:30.777 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-09-10T23:14:30.777 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-09-10T23:14:30.796 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-09-10T23:14:30.796 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-09-10T23:14:30.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.816+0000 7fae2ed3a640 1 -- 172.21.15.90:0/2016348457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae280d1c70 msgr2=0x7fae280b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.816+0000 7fae2ed3a640 1 --2- 172.21.15.90:0/2016348457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae280d1c70 0x7fae280b3490 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fae10009860 tx=0x7fae1002a530 comp rx=0 tx=0).stop 2024-09-10T23:14:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.816+0000 7fae2ed3a640 1 -- 172.21.15.90:0/2016348457 shutdown_connections 2024-09-10T23:14:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.816+0000 7fae2ed3a640 1 --2- 172.21.15.90:0/2016348457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae280d1c70 0x7fae280b3490 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.816+0000 7fae2ed3a640 1 -- 172.21.15.90:0/2016348457 >> 172.21.15.90:0/2016348457 conn(0x7fae2809d2a0 msgr2=0x7fae280d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.816+0000 7fae2ed3a640 1 -- 172.21.15.90:0/2016348457 shutdown_connections 2024-09-10T23:14:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.816+0000 7fae2ed3a640 1 -- 172.21.15.90:0/2016348457 wait complete. 2024-09-10T23:14:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.817+0000 7fae2ed3a640 1 Processor -- start 2024-09-10T23:14:30.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.818+0000 7fae2ed3a640 1 -- start start 2024-09-10T23:14:30.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.818+0000 7fae2ed3a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae280b3a00 0x7fae2814a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:30.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.818+0000 7fae2ed3a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae280d1c70 0x7fae280b8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:30.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.818+0000 7fae2ed3a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae280d2470 0x7fae280b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:30.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.818+0000 7fae2ed3a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fae280b4740 con 0x7fae280d1c70 2024-09-10T23:14:30.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.818+0000 7fae2ed3a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fae280b45c0 con 0x7fae280d2470 2024-09-10T23:14:30.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.818+0000 7fae2ed3a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fae280b48c0 con 0x7fae280b3a00 2024-09-10T23:14:30.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.819+0000 7fae27fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae280d1c70 0x7fae280b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:30.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.819+0000 7fae27fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae280d1c70 0x7fae280b8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48728/0 (socket says 172.21.15.90:48728) 2024-09-10T23:14:30.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.819+0000 7fae27fff640 1 -- 172.21.15.90:0/4079309809 learned_addr learned my addr 172.21.15.90:0/4079309809 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:30.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.819+0000 7fae2cad6640 1 --2- 172.21.15.90:0/4079309809 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae280b3a00 0x7fae2814a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:30.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.819+0000 7fae2d2d7640 1 --2- 172.21.15.90:0/4079309809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae280d2470 0x7fae280b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:30.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.819+0000 7fae27fff640 1 -- 172.21.15.90:0/4079309809 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae280b3a00 msgr2=0x7fae2814a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:30.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.819+0000 7fae27fff640 1 --2- 172.21.15.90:0/4079309809 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae280b3a00 0x7fae2814a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:30.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.819+0000 7fae27fff640 1 -- 172.21.15.90:0/4079309809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae280d2470 msgr2=0x7fae280b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:30.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.819+0000 7fae27fff640 1 --2- 172.21.15.90:0/4079309809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae280d2470 0x7fae280b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:30.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.819+0000 7fae27fff640 1 -- 172.21.15.90:0/4079309809 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae280ca920 con 0x7fae280d1c70 2024-09-10T23:14:30.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.819+0000 7fae2d2d7640 1 --2- 172.21.15.90:0/4079309809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae280d2470 0x7fae280b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:14:30.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.819+0000 7fae27fff640 1 --2- 172.21.15.90:0/4079309809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae280d1c70 0x7fae280b8640 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fae1002ab20 tx=0x7fae10003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:30.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.819+0000 7fae257fa640 1 -- 172.21.15.90:0/4079309809 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10005c90 con 0x7fae280d1c70 2024-09-10T23:14:30.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.819+0000 7fae257fa640 1 -- 172.21.15.90:0/4079309809 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae10005020 con 0x7fae280d1c70 2024-09-10T23:14:30.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.819+0000 7fae2ed3a640 1 -- 172.21.15.90:0/4079309809 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae280b9460 con 0x7fae280d1c70 2024-09-10T23:14:30.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.819+0000 7fae257fa640 1 -- 172.21.15.90:0/4079309809 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10005410 con 0x7fae280d1c70 2024-09-10T23:14:30.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.819+0000 7fae2ed3a640 1 -- 172.21.15.90:0/4079309809 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae280b90c0 con 0x7fae280d1c70 2024-09-10T23:14:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.820+0000 7fae2ed3a640 1 -- 172.21.15.90:0/4079309809 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae280b6a00 con 0x7fae280d1c70 2024-09-10T23:14:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.821+0000 7fae257fa640 1 -- 172.21.15.90:0/4079309809 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fae100317c0 con 0x7fae280d1c70 2024-09-10T23:14:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.821+0000 7fae257fa640 1 --2- 172.21.15.90:0/4079309809 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fae08077f70 0x7fae0807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.822+0000 7fae257fa640 1 -- 172.21.15.90:0/4079309809 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fae100babd0 con 0x7fae280d1c70 2024-09-10T23:14:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.822+0000 7fae2cad6640 1 --2- 172.21.15.90:0/4079309809 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fae08077f70 0x7fae0807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.822+0000 7fae2cad6640 1 --2- 172.21.15.90:0/4079309809 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fae08077f70 0x7fae0807a430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fae180014a0 tx=0x7fae18009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:30.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:30.826+0000 7fae257fa640 1 -- 172.21.15.90:0/4079309809 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fae280b6a00 con 0x7fae280d1c70 2024-09-10T23:14:31.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:31.036+0000 7fae2ed3a640 1 -- 172.21.15.90:0/4079309809 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae280b2e80 con 0x7fae280d1c70 2024-09-10T23:14:31.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:31.036+0000 7fae257fa640 1 -- 172.21.15.90:0/4079309809 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7fae10040030 con 0x7fae280d1c70 2024-09-10T23:14:31.037 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:31.037 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":2,"btime":"2024-09-10T23:14:30:780944+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/1263661165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1263661165},{"type":"v1","addr":"172.21.15.90:6834","nonce":1263661165}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T23:14:31.037 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 2 2024-09-10T23:14:31.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:31.038+0000 7fae2ed3a640 1 -- 172.21.15.90:0/4079309809 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fae08077f70 msgr2=0x7fae0807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:31.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:31.038+0000 7fae2ed3a640 1 --2- 172.21.15.90:0/4079309809 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fae08077f70 0x7fae0807a430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fae180014a0 tx=0x7fae18009040 comp rx=0 tx=0).stop 2024-09-10T23:14:31.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:31.038+0000 7fae2ed3a640 1 -- 172.21.15.90:0/4079309809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae280d1c70 msgr2=0x7fae280b8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:31.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:31.038+0000 7fae2ed3a640 1 --2- 172.21.15.90:0/4079309809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae280d1c70 0x7fae280b8640 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fae1002ab20 tx=0x7fae10003c10 comp rx=0 tx=0).stop 2024-09-10T23:14:31.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:31.039+0000 7fae2ed3a640 1 -- 172.21.15.90:0/4079309809 shutdown_connections 2024-09-10T23:14:31.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:31.039+0000 7fae2ed3a640 1 --2- 172.21.15.90:0/4079309809 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fae08077f70 0x7fae0807a430 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:31.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:31.039+0000 7fae2ed3a640 1 --2- 172.21.15.90:0/4079309809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae280d2470 0x7fae280b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:31.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:31.039+0000 7fae2ed3a640 1 --2- 172.21.15.90:0/4079309809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae280d1c70 0x7fae280b8640 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:31.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:31.039+0000 7fae2ed3a640 1 --2- 172.21.15.90:0/4079309809 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae280b3a00 0x7fae2814a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:31.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:31.039+0000 7fae2ed3a640 1 -- 172.21.15.90:0/4079309809 >> 172.21.15.90:0/4079309809 conn(0x7fae2809d2a0 msgr2=0x7fae280b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:31.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:31.039+0000 7fae2ed3a640 1 -- 172.21.15.90:0/4079309809 shutdown_connections 2024-09-10T23:14:31.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:31.039+0000 7fae2ed3a640 1 -- 172.21.15.90:0/4079309809 wait complete. 2024-09-10T23:14:33.051 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:14:33.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.164+0000 7f567ae2a640 1 -- 172.21.15.90:0/3219148279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f567406cb30 msgr2=0x7f567406cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:33.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.164+0000 7f567ae2a640 1 --2- 172.21.15.90:0/3219148279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f567406cb30 0x7f567406cfa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f566c005fd0 tx=0x7f566c02a8d0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.165+0000 7f567ae2a640 1 -- 172.21.15.90:0/3219148279 shutdown_connections 2024-09-10T23:14:33.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.165+0000 7f567ae2a640 1 --2- 172.21.15.90:0/3219148279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f567406cb30 0x7f567406cfa0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.165+0000 7f567ae2a640 1 --2- 172.21.15.90:0/3219148279 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f567415f3f0 0x7f5674073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.165+0000 7f567ae2a640 1 -- 172.21.15.90:0/3219148279 >> 172.21.15.90:0/3219148279 conn(0x7f56740cd960 msgr2=0x7f56740cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:33.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.165+0000 7f567ae2a640 1 -- 172.21.15.90:0/3219148279 shutdown_connections 2024-09-10T23:14:33.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.165+0000 7f567ae2a640 1 -- 172.21.15.90:0/3219148279 wait complete. 2024-09-10T23:14:33.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.166+0000 7f567ae2a640 1 Processor -- start 2024-09-10T23:14:33.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.166+0000 7f567ae2a640 1 -- start start 2024-09-10T23:14:33.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.167+0000 7f567ae2a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f567406cb30 0x7f56740b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:33.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.167+0000 7f567ae2a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56740cfe80 0x7f56740c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:33.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.167+0000 7f567ae2a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f567415f3f0 0x7f56740c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:33.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.167+0000 7f567ae2a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56740cf240 con 0x7f567415f3f0 2024-09-10T23:14:33.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.167+0000 7f567ae2a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f56740cf0c0 con 0x7f56740cfe80 2024-09-10T23:14:33.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.167+0000 7f567ae2a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f56740cf3c0 con 0x7f567406cb30 2024-09-10T23:14:33.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.167+0000 7f56793c7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f567415f3f0 0x7f56740c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:33.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.167+0000 7f56793c7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f567415f3f0 0x7f56740c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48740/0 (socket says 172.21.15.90:48740) 2024-09-10T23:14:33.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.167+0000 7f56793c7640 1 -- 172.21.15.90:0/1770959442 learned_addr learned my addr 172.21.15.90:0/1770959442 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:33.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.167+0000 7f5678bc6640 1 --2- 172.21.15.90:0/1770959442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f567406cb30 0x7f56740b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:33.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.167+0000 7f5673fff640 1 --2- 172.21.15.90:0/1770959442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56740cfe80 0x7f56740c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:33.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.167+0000 7f56793c7640 1 -- 172.21.15.90:0/1770959442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f567406cb30 msgr2=0x7f56740b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:33.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.167+0000 7f56793c7640 1 --2- 172.21.15.90:0/1770959442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f567406cb30 0x7f56740b6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.167+0000 7f56793c7640 1 -- 172.21.15.90:0/1770959442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56740cfe80 msgr2=0x7f56740c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:33.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.167+0000 7f56793c7640 1 --2- 172.21.15.90:0/1770959442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56740cfe80 0x7f56740c7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.167+0000 7f56793c7640 1 -- 172.21.15.90:0/1770959442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56741f5ff0 con 0x7f567415f3f0 2024-09-10T23:14:33.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.167+0000 7f56793c7640 1 --2- 172.21.15.90:0/1770959442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f567415f3f0 0x7f56740c7940 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f566c006010 tx=0x7f566c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:33.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.168+0000 7f56717fa640 1 -- 172.21.15.90:0/1770959442 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566c004240 con 0x7f567415f3f0 2024-09-10T23:14:33.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.168+0000 7f56717fa640 1 -- 172.21.15.90:0/1770959442 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f566c0043e0 con 0x7f567415f3f0 2024-09-10T23:14:33.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.168+0000 7f56717fa640 1 -- 172.21.15.90:0/1770959442 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566c0047f0 con 0x7f567415f3f0 2024-09-10T23:14:33.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.168+0000 7f567ae2a640 1 -- 172.21.15.90:0/1770959442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56741f62d0 con 0x7f567415f3f0 2024-09-10T23:14:33.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.168+0000 7f567ae2a640 1 -- 172.21.15.90:0/1770959442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f567409acd0 con 0x7f567415f3f0 2024-09-10T23:14:33.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.169+0000 7f567ae2a640 1 -- 172.21.15.90:0/1770959442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56741f66c0 con 0x7f567415f3f0 2024-09-10T23:14:33.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.169+0000 7f56717fa640 1 -- 172.21.15.90:0/1770959442 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f566c031460 con 0x7f567415f3f0 2024-09-10T23:14:33.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.170+0000 7f56717fa640 1 --2- 172.21.15.90:0/1770959442 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5658077f70 0x7f565807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:33.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.170+0000 7f56717fa640 1 -- 172.21.15.90:0/1770959442 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f566c0bb230 con 0x7f567415f3f0 2024-09-10T23:14:33.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.170+0000 7f5678bc6640 1 --2- 172.21.15.90:0/1770959442 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5658077f70 0x7f565807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:33.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.170+0000 7f5678bc6640 1 --2- 172.21.15.90:0/1770959442 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5658077f70 0x7f565807a430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5668004630 tx=0x7f566800b2e0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:33.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.174+0000 7f56717fa640 1 -- 172.21.15.90:0/1770959442 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f566c083a30 con 0x7f567415f3f0 2024-09-10T23:14:33.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.382+0000 7f567ae2a640 1 -- 172.21.15.90:0/1770959442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56741f64a0 con 0x7f567415f3f0 2024-09-10T23:14:33.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.382+0000 7f56717fa640 1 -- 172.21.15.90:0/1770959442 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3906 (secure 0 0 0) 0x7f566c088460 con 0x7f567415f3f0 2024-09-10T23:14:33.383 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:33.383 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":3,"btime":"2024-09-10T23:14:31:781970+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/286705671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":286705671},{"type":"v1","addr":"172.21.15.171:6837","nonce":286705671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/604738442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":604738442},{"type":"v1","addr":"172.21.15.171:6836","nonce":604738442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/1263661165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1263661165},{"type":"v1","addr":"172.21.15.90:6834","nonce":1263661165}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4368,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1573070489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":1573070489},{"type":"v1","addr":"172.21.15.90:6835","nonce":1573070489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T23:14:33.384 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 3 2024-09-10T23:14:33.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.384+0000 7f567ae2a640 1 -- 172.21.15.90:0/1770959442 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5658077f70 msgr2=0x7f565807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:33.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.384+0000 7f567ae2a640 1 --2- 172.21.15.90:0/1770959442 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5658077f70 0x7f565807a430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5668004630 tx=0x7f566800b2e0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.384+0000 7f567ae2a640 1 -- 172.21.15.90:0/1770959442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f567415f3f0 msgr2=0x7f56740c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:33.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.384+0000 7f567ae2a640 1 --2- 172.21.15.90:0/1770959442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f567415f3f0 0x7f56740c7940 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f566c006010 tx=0x7f566c003c20 comp rx=0 tx=0).stop 2024-09-10T23:14:33.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.384+0000 7f567ae2a640 1 -- 172.21.15.90:0/1770959442 shutdown_connections 2024-09-10T23:14:33.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.384+0000 7f567ae2a640 1 --2- 172.21.15.90:0/1770959442 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5658077f70 0x7f565807a430 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.384+0000 7f567ae2a640 1 --2- 172.21.15.90:0/1770959442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56740cfe80 0x7f56740c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.384+0000 7f567ae2a640 1 --2- 172.21.15.90:0/1770959442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f567415f3f0 0x7f56740c7940 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.384+0000 7f567ae2a640 1 --2- 172.21.15.90:0/1770959442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f567406cb30 0x7f56740b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.384+0000 7f567ae2a640 1 -- 172.21.15.90:0/1770959442 >> 172.21.15.90:0/1770959442 conn(0x7f56740cd960 msgr2=0x7f56740ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:33.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.384+0000 7f567ae2a640 1 -- 172.21.15.90:0/1770959442 shutdown_connections 2024-09-10T23:14:33.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.384+0000 7f567ae2a640 1 -- 172.21.15.90:0/1770959442 wait complete. 2024-09-10T23:14:33.396 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:14:33.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.495+0000 7f08c1e0f640 1 -- 172.21.15.90:0/4088377016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08bc0b3a00 msgr2=0x7f08bc0b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:33.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.495+0000 7f08c1e0f640 1 --2- 172.21.15.90:0/4088377016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08bc0b3a00 0x7f08bc0b3eb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0d3c80 tx=0x7f08b402a560 comp rx=0 tx=0).stop 2024-09-10T23:14:33.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.495+0000 7f08c1e0f640 1 -- 172.21.15.90:0/4088377016 shutdown_connections 2024-09-10T23:14:33.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.495+0000 7f08c1e0f640 1 --2- 172.21.15.90:0/4088377016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08bc0b3a00 0x7f08bc0b3eb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.495+0000 7f08c1e0f640 1 --2- 172.21.15.90:0/4088377016 >> v2:172.21.15.171:3300/0 conn(0x7f08bc0d1c70 0x7f08bc0b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.495+0000 7f08c1e0f640 1 -- 172.21.15.90:0/4088377016 >> 172.21.15.90:0/4088377016 conn(0x7f08bc09d2a0 msgr2=0x7f08bc0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:33.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.495+0000 7f08c1e0f640 1 -- 172.21.15.90:0/4088377016 shutdown_connections 2024-09-10T23:14:33.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.495+0000 7f08c1e0f640 1 -- 172.21.15.90:0/4088377016 wait complete. 2024-09-10T23:14:33.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.496+0000 7f08c1e0f640 1 Processor -- start 2024-09-10T23:14:33.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.497+0000 7f08c1e0f640 1 -- start start 2024-09-10T23:14:33.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.497+0000 7f08c1e0f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08bc0b3a00 0x7f08bc1f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:33.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.497+0000 7f08c1e0f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08bc0d1c70 0x7f08bc1f7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:33.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.497+0000 7f08c1e0f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08bc0d2470 0x7f08bc0b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:33.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.497+0000 7f08c1e0f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f08bc0b4570 con 0x7f08bc0b3a00 2024-09-10T23:14:33.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.497+0000 7f08c1e0f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f08bc0b43f0 con 0x7f08bc0d1c70 2024-09-10T23:14:33.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.497+0000 7f08c1e0f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f08bc0b46f0 con 0x7f08bc0d2470 2024-09-10T23:14:33.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.497+0000 7f08bb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08bc0b3a00 0x7f08bc1f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:33.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.498+0000 7f08bb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08bc0b3a00 0x7f08bc1f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48760/0 (socket says 172.21.15.90:48760) 2024-09-10T23:14:33.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.498+0000 7f08bb7fe640 1 -- 172.21.15.90:0/2400435694 learned_addr learned my addr 172.21.15.90:0/2400435694 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:33.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.498+0000 7f08baffd640 1 --2- 172.21.15.90:0/2400435694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08bc0d1c70 0x7f08bc1f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:33.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.498+0000 7f08bbfff640 1 --2- 172.21.15.90:0/2400435694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08bc0d2470 0x7f08bc0b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:33.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.498+0000 7f08bb7fe640 1 -- 172.21.15.90:0/2400435694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08bc0d2470 msgr2=0x7f08bc0b8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:33.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.498+0000 7f08bb7fe640 1 --2- 172.21.15.90:0/2400435694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08bc0d2470 0x7f08bc0b8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.498+0000 7f08bb7fe640 1 -- 172.21.15.90:0/2400435694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08bc0d1c70 msgr2=0x7f08bc1f7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:33.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.498+0000 7f08bb7fe640 1 --2- 172.21.15.90:0/2400435694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08bc0d1c70 0x7f08bc1f7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.498+0000 7f08bb7fe640 1 -- 172.21.15.90:0/2400435694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08bc15e530 con 0x7f08bc0b3a00 2024-09-10T23:14:33.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.498+0000 7f08bb7fe640 1 --2- 172.21.15.90:0/2400435694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08bc0b3a00 0x7f08bc1f59d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00ba50 tx=0x7f08ac00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:33.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.498+0000 7f08b3fff640 1 -- 172.21.15.90:0/2400435694 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac019070 con 0x7f08bc0b3a00 2024-09-10T23:14:33.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.498+0000 7f08b3fff640 1 -- 172.21.15.90:0/2400435694 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08ac00cd10 con 0x7f08bc0b3a00 2024-09-10T23:14:33.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.498+0000 7f08c1e0f640 1 -- 172.21.15.90:0/2400435694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08bc15e810 con 0x7f08bc0b3a00 2024-09-10T23:14:33.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.498+0000 7f08b3fff640 1 -- 172.21.15.90:0/2400435694 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac0146a0 con 0x7f08bc0b3a00 2024-09-10T23:14:33.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.498+0000 7f08c1e0f640 1 -- 172.21.15.90:0/2400435694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08bc15edd0 con 0x7f08bc0b3a00 2024-09-10T23:14:33.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.499+0000 7f08c1e0f640 1 -- 172.21.15.90:0/2400435694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08bc0b3eb0 con 0x7f08bc0b3a00 2024-09-10T23:14:33.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.500+0000 7f08b3fff640 1 -- 172.21.15.90:0/2400435694 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f08ac014840 con 0x7f08bc0b3a00 2024-09-10T23:14:33.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.500+0000 7f08b3fff640 1 --2- 172.21.15.90:0/2400435694 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f089c077f70 0x7f089c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:33.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.501+0000 7f08b3fff640 1 -- 172.21.15.90:0/2400435694 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f08ac099a70 con 0x7f08bc0b3a00 2024-09-10T23:14:33.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.501+0000 7f08baffd640 1 --2- 172.21.15.90:0/2400435694 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f089c077f70 0x7f089c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:33.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.501+0000 7f08baffd640 1 --2- 172.21.15.90:0/2400435694 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f089c077f70 0x7f089c07a430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0b8850 tx=0x7f08a400b390 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:33.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.505+0000 7f08b3fff640 1 -- 172.21.15.90:0/2400435694 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f08ac0621f0 con 0x7f08bc0b3a00 2024-09-10T23:14:33.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.682+0000 7f08c1e0f640 1 -- 172.21.15.90:0/2400435694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f08bc1f47a0 con 0x7f08bc0b3a00 2024-09-10T23:14:33.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.683+0000 7f08b3fff640 1 -- 172.21.15.90:0/2400435694 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f08ac066c20 con 0x7f08bc0b3a00 2024-09-10T23:14:33.684 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:33.684 INFO:teuthology.orchestra.run.smithi090.stdout:[ 2024-09-10T23:14:33.684 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:14:33.684 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 1, 2024-09-10T23:14:33.684 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": ".mgr" 2024-09-10T23:14:33.684 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:14:33.684 INFO:teuthology.orchestra.run.smithi090.stdout:] 2024-09-10T23:14:33.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.685+0000 7f08c1e0f640 1 -- 172.21.15.90:0/2400435694 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f089c077f70 msgr2=0x7f089c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:33.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.685+0000 7f08c1e0f640 1 --2- 172.21.15.90:0/2400435694 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f089c077f70 0x7f089c07a430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0b8850 tx=0x7f08a400b390 comp rx=0 tx=0).stop 2024-09-10T23:14:33.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.685+0000 7f08c1e0f640 1 -- 172.21.15.90:0/2400435694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08bc0b3a00 msgr2=0x7f08bc1f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:33.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.685+0000 7f08c1e0f640 1 --2- 172.21.15.90:0/2400435694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08bc0b3a00 0x7f08bc1f59d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00ba50 tx=0x7f08ac00bf10 comp rx=0 tx=0).stop 2024-09-10T23:14:33.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.685+0000 7f08c1e0f640 1 -- 172.21.15.90:0/2400435694 shutdown_connections 2024-09-10T23:14:33.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.685+0000 7f08c1e0f640 1 --2- 172.21.15.90:0/2400435694 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f089c077f70 0x7f089c07a430 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.685+0000 7f08c1e0f640 1 --2- 172.21.15.90:0/2400435694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08bc0d1c70 0x7f08bc1f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.685+0000 7f08c1e0f640 1 --2- 172.21.15.90:0/2400435694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08bc0d2470 0x7f08bc0b8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.685+0000 7f08c1e0f640 1 --2- 172.21.15.90:0/2400435694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08bc0b3a00 0x7f08bc1f59d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.685+0000 7f08c1e0f640 1 -- 172.21.15.90:0/2400435694 >> 172.21.15.90:0/2400435694 conn(0x7f08bc09d2a0 msgr2=0x7f08bc0b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:33.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.685+0000 7f08c1e0f640 1 -- 172.21.15.90:0/2400435694 shutdown_connections 2024-09-10T23:14:33.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.685+0000 7f08c1e0f640 1 -- 172.21.15.90:0/2400435694 wait complete. 2024-09-10T23:14:33.697 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:14:33.697 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:14:33.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.800+0000 7f8ddc96b640 1 -- 172.21.15.90:0/2280414604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8dd80d0ac0 msgr2=0x7f8dd815b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:33.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.800+0000 7f8ddc96b640 1 --2- 172.21.15.90:0/2280414604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8dd80d0ac0 0x7f8dd815b4f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0005fd0 tx=0x7f8dd002a8b0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.800+0000 7f8ddc96b640 1 -- 172.21.15.90:0/2280414604 shutdown_connections 2024-09-10T23:14:33.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.800+0000 7f8ddc96b640 1 --2- 172.21.15.90:0/2280414604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8dd80d0ac0 0x7f8dd815b4f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.800+0000 7f8ddc96b640 1 --2- 172.21.15.90:0/2280414604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd815f0b0 0x7f8dd80cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.800+0000 7f8ddc96b640 1 -- 172.21.15.90:0/2280414604 >> 172.21.15.90:0/2280414604 conn(0x7f8dd806cf20 msgr2=0x7f8dd806d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:33.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.800+0000 7f8ddc96b640 1 -- 172.21.15.90:0/2280414604 shutdown_connections 2024-09-10T23:14:33.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.800+0000 7f8ddc96b640 1 -- 172.21.15.90:0/2280414604 wait complete. 2024-09-10T23:14:33.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.802+0000 7f8ddc96b640 1 Processor -- start 2024-09-10T23:14:33.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.802+0000 7f8ddc96b640 1 -- start start 2024-09-10T23:14:33.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.802+0000 7f8ddc96b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8dd80d0ac0 0x7f8dd8153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:33.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.802+0000 7f8ddc96b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd815b0b0 0x7f8dd80b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:33.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.802+0000 7f8ddc96b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dd815f0b0 0x7f8dd80cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:33.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.802+0000 7f8ddc96b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd80735b0 con 0x7f8dd80d0ac0 2024-09-10T23:14:33.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.802+0000 7f8ddc96b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd8073430 con 0x7f8dd815f0b0 2024-09-10T23:14:33.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.802+0000 7f8ddc96b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8dd8073730 con 0x7f8dd815b0b0 2024-09-10T23:14:33.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.802+0000 7f8dd659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8dd80d0ac0 0x7f8dd8153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:33.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.803+0000 7f8dd659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8dd80d0ac0 0x7f8dd8153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48776/0 (socket says 172.21.15.90:48776) 2024-09-10T23:14:33.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.803+0000 7f8dd659c640 1 -- 172.21.15.90:0/3781718984 learned_addr learned my addr 172.21.15.90:0/3781718984 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:33.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.803+0000 7f8dcffff640 1 --2- 172.21.15.90:0/3781718984 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd815b0b0 0x7f8dd80b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:33.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.803+0000 7f8dd6d9d640 1 --2- 172.21.15.90:0/3781718984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dd815f0b0 0x7f8dd80cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:33.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.803+0000 7f8dd659c640 1 -- 172.21.15.90:0/3781718984 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd815b0b0 msgr2=0x7f8dd80b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:33.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.803+0000 7f8dd659c640 1 --2- 172.21.15.90:0/3781718984 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd815b0b0 0x7f8dd80b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.803+0000 7f8dd659c640 1 -- 172.21.15.90:0/3781718984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dd815f0b0 msgr2=0x7f8dd80cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:33.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.803+0000 7f8dd659c640 1 --2- 172.21.15.90:0/3781718984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dd815f0b0 0x7f8dd80cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:33.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.803+0000 7f8dd659c640 1 -- 172.21.15.90:0/3781718984 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd8153a60 con 0x7f8dd80d0ac0 2024-09-10T23:14:33.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.803+0000 7f8dcffff640 1 --2- 172.21.15.90:0/3781718984 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd815b0b0 0x7f8dd80b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:14:33.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.803+0000 7f8dd659c640 1 --2- 172.21.15.90:0/3781718984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8dd80d0ac0 0x7f8dd8153520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800c970 tx=0x7f8dc800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:33.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.803+0000 7f8dceffd640 1 -- 172.21.15.90:0/3781718984 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8007bb0 con 0x7f8dd80d0ac0 2024-09-10T23:14:33.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.803+0000 7f8dceffd640 1 -- 172.21.15.90:0/3781718984 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8dc8007e40 con 0x7f8dd80d0ac0 2024-09-10T23:14:33.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.803+0000 7f8ddc96b640 1 -- 172.21.15.90:0/3781718984 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dd80b5450 con 0x7f8dd80d0ac0 2024-09-10T23:14:33.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.803+0000 7f8dceffd640 1 -- 172.21.15.90:0/3781718984 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8005280 con 0x7f8dd80d0ac0 2024-09-10T23:14:33.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.803+0000 7f8ddc96b640 1 -- 172.21.15.90:0/3781718984 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dd81f4f70 con 0x7f8dd80d0ac0 2024-09-10T23:14:33.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.804+0000 7f8ddc96b640 1 -- 172.21.15.90:0/3781718984 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dd81f53b0 con 0x7f8dd80d0ac0 2024-09-10T23:14:33.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.805+0000 7f8dceffd640 1 -- 172.21.15.90:0/3781718984 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8dc8005420 con 0x7f8dd80d0ac0 2024-09-10T23:14:33.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.805+0000 7f8dceffd640 1 --2- 172.21.15.90:0/3781718984 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8db8077fa0 0x7f8db807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:33.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.805+0000 7f8dceffd640 1 -- 172.21.15.90:0/3781718984 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f8dc8099db0 con 0x7f8dd80d0ac0 2024-09-10T23:14:33.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.805+0000 7f8dcffff640 1 --2- 172.21.15.90:0/3781718984 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8db8077fa0 0x7f8db807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:33.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.806+0000 7f8dcffff640 1 --2- 172.21.15.90:0/3781718984 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8db8077fa0 0x7f8db807a460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80b4610 tx=0x7f8dc0009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:33.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.809+0000 7f8dceffd640 1 -- 172.21.15.90:0/3781718984 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8dd8153a60 con 0x7f8dd80d0ac0 2024-09-10T23:14:33.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:33.981+0000 7f8ddc96b640 1 -- 172.21.15.90:0/3781718984 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8dd8073c50 con 0x7f8dd80d0ac0 2024-09-10T23:14:34.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.105+0000 7f8dceffd640 1 -- 172.21.15.90:0/3781718984 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f8dc8014030 con 0x7f8dd80d0ac0 2024-09-10T23:14:34.106 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' created 2024-09-10T23:14:34.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.107+0000 7f8ddc96b640 1 -- 172.21.15.90:0/3781718984 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8db8077fa0 msgr2=0x7f8db807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:34.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.107+0000 7f8ddc96b640 1 --2- 172.21.15.90:0/3781718984 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8db8077fa0 0x7f8db807a460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80b4610 tx=0x7f8dc0009040 comp rx=0 tx=0).stop 2024-09-10T23:14:34.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.107+0000 7f8ddc96b640 1 -- 172.21.15.90:0/3781718984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8dd80d0ac0 msgr2=0x7f8dd8153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:34.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.107+0000 7f8ddc96b640 1 --2- 172.21.15.90:0/3781718984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8dd80d0ac0 0x7f8dd8153520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800c970 tx=0x7f8dc800ce30 comp rx=0 tx=0).stop 2024-09-10T23:14:34.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.107+0000 7f8ddc96b640 1 -- 172.21.15.90:0/3781718984 shutdown_connections 2024-09-10T23:14:34.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.107+0000 7f8ddc96b640 1 --2- 172.21.15.90:0/3781718984 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8db8077fa0 0x7f8db807a460 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:34.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.107+0000 7f8ddc96b640 1 --2- 172.21.15.90:0/3781718984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dd815f0b0 0x7f8dd80cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:34.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.107+0000 7f8ddc96b640 1 --2- 172.21.15.90:0/3781718984 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd815b0b0 0x7f8dd80b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:34.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.107+0000 7f8ddc96b640 1 --2- 172.21.15.90:0/3781718984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8dd80d0ac0 0x7f8dd8153520 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:34.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.107+0000 7f8ddc96b640 1 -- 172.21.15.90:0/3781718984 >> 172.21.15.90:0/3781718984 conn(0x7f8dd806cf20 msgr2=0x7f8dd80d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:34.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.108+0000 7f8ddc96b640 1 -- 172.21.15.90:0/3781718984 shutdown_connections 2024-09-10T23:14:34.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.108+0000 7f8ddc96b640 1 -- 172.21.15.90:0/3781718984 wait complete. 2024-09-10T23:14:34.124 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:14:34.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.231+0000 7f6dff652640 1 -- 172.21.15.90:0/1207643146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4007330 msgr2=0x7f6de4009780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:34.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.231+0000 7f6dff652640 1 --2- 172.21.15.90:0/1207643146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4007330 0x7f6de4009780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6de80016c0 tx=0x7f6de4003810 comp rx=0 tx=0).stop 2024-09-10T23:14:34.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.231+0000 7f6dfdbef640 1 -- 172.21.15.90:0/1207643146 reap_dead start 2024-09-10T23:14:34.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.231+0000 7f6dff652640 1 -- 172.21.15.90:0/1207643146 shutdown_connections 2024-09-10T23:14:34.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.231+0000 7f6dff652640 1 -- 172.21.15.90:0/1207643146 >> 172.21.15.90:0/1207643146 conn(0x7f6df80cfbc0 msgr2=0x7f6df80cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:34.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.231+0000 7f6dff652640 1 -- 172.21.15.90:0/1207643146 shutdown_connections 2024-09-10T23:14:34.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.231+0000 7f6dff652640 1 -- 172.21.15.90:0/1207643146 wait complete. 2024-09-10T23:14:34.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.232+0000 7f6dff652640 1 Processor -- start 2024-09-10T23:14:34.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.232+0000 7f6dff652640 1 -- start start 2024-09-10T23:14:34.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dff652640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6de4007330 0x7f6df81e8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:34.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dff652640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df8152ea0 0x7f6df8159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:34.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dff652640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df813fcc0 0x7f6df8140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:34.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dff652640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6df815b150 con 0x7f6df8152ea0 2024-09-10T23:14:34.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dff652640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6df815afd0 con 0x7f6de4007330 2024-09-10T23:14:34.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dff652640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6df815b2d0 con 0x7f6df813fcc0 2024-09-10T23:14:34.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dfcbed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df8152ea0 0x7f6df8159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:34.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dfcbed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df8152ea0 0x7f6df8159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48788/0 (socket says 172.21.15.90:48788) 2024-09-10T23:14:34.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dfcbed640 1 -- 172.21.15.90:0/2353370894 learned_addr learned my addr 172.21.15.90:0/2353370894 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:34.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dfdbef640 1 --2- 172.21.15.90:0/2353370894 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df813fcc0 0x7f6df8140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:34.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dfd3ee640 1 --2- 172.21.15.90:0/2353370894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6de4007330 0x7f6df81e8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:34.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dfcbed640 1 -- 172.21.15.90:0/2353370894 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df813fcc0 msgr2=0x7f6df8140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:34.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dfcbed640 1 --2- 172.21.15.90:0/2353370894 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df813fcc0 0x7f6df8140170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:34.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dfcbed640 1 -- 172.21.15.90:0/2353370894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6de4007330 msgr2=0x7f6df81e8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:34.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dfcbed640 1 --2- 172.21.15.90:0/2353370894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6de4007330 0x7f6df81e8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:34.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dfcbed640 1 -- 172.21.15.90:0/2353370894 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df81e76f0 con 0x7f6df8152ea0 2024-09-10T23:14:34.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dfdbef640 1 --2- 172.21.15.90:0/2353370894 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df813fcc0 0x7f6df8140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:34.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dfd3ee640 1 --2- 172.21.15.90:0/2353370894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6de4007330 0x7f6df81e8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:34.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dfcbed640 1 --2- 172.21.15.90:0/2353370894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df8152ea0 0x7f6df8159b90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6de8000c00 tx=0x7f6de8006380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:34.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.233+0000 7f6dedffb640 1 -- 172.21.15.90:0/2353370894 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de8038070 con 0x7f6df8152ea0 2024-09-10T23:14:34.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.234+0000 7f6dedffb640 1 -- 172.21.15.90:0/2353370894 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6de8003af0 con 0x7f6df8152ea0 2024-09-10T23:14:34.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.234+0000 7f6dff652640 1 -- 172.21.15.90:0/2353370894 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df81e79d0 con 0x7f6df8152ea0 2024-09-10T23:14:34.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.234+0000 7f6dedffb640 1 -- 172.21.15.90:0/2353370894 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de8033420 con 0x7f6df8152ea0 2024-09-10T23:14:34.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.234+0000 7f6dff652640 1 -- 172.21.15.90:0/2353370894 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df81e7f90 con 0x7f6df8152ea0 2024-09-10T23:14:34.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.235+0000 7f6dff652640 1 -- 172.21.15.90:0/2353370894 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df806e3e0 con 0x7f6df8152ea0 2024-09-10T23:14:34.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.236+0000 7f6dedffb640 1 -- 172.21.15.90:0/2353370894 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6de8043030 con 0x7f6df8152ea0 2024-09-10T23:14:34.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.236+0000 7f6dedffb640 1 --2- 172.21.15.90:0/2353370894 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6ddc077f70 0x7f6ddc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:34.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.236+0000 7f6dedffb640 1 -- 172.21.15.90:0/2353370894 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f6de80b8ae0 con 0x7f6df8152ea0 2024-09-10T23:14:34.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.236+0000 7f6dfd3ee640 1 --2- 172.21.15.90:0/2353370894 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6ddc077f70 0x7f6ddc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:34.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.237+0000 7f6dfd3ee640 1 --2- 172.21.15.90:0/2353370894 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6ddc077f70 0x7f6ddc07a430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6df8154400 tx=0x7f6df4005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:34.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.241+0000 7f6dedffb640 1 -- 172.21.15.90:0/2353370894 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6de8081850 con 0x7f6df8152ea0 2024-09-10T23:14:34.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:34.416+0000 7f6dff652640 1 -- 172.21.15.90:0/2353370894 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6df8070140 con 0x7f6df8152ea0 2024-09-10T23:14:35.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.107+0000 7f6dedffb640 1 -- 172.21.15.90:0/2353370894 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7f6de8081150 con 0x7f6df8152ea0 2024-09-10T23:14:35.108 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' created 2024-09-10T23:14:35.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.109+0000 7f6dff652640 1 -- 172.21.15.90:0/2353370894 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6ddc077f70 msgr2=0x7f6ddc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:35.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.109+0000 7f6dff652640 1 --2- 172.21.15.90:0/2353370894 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6ddc077f70 0x7f6ddc07a430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6df8154400 tx=0x7f6df4005f90 comp rx=0 tx=0).stop 2024-09-10T23:14:35.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.109+0000 7f6dff652640 1 -- 172.21.15.90:0/2353370894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df8152ea0 msgr2=0x7f6df8159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:35.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.109+0000 7f6dff652640 1 --2- 172.21.15.90:0/2353370894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df8152ea0 0x7f6df8159b90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6de8000c00 tx=0x7f6de8006380 comp rx=0 tx=0).stop 2024-09-10T23:14:35.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.110+0000 7f6dff652640 1 -- 172.21.15.90:0/2353370894 shutdown_connections 2024-09-10T23:14:35.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.110+0000 7f6dff652640 1 --2- 172.21.15.90:0/2353370894 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6ddc077f70 0x7f6ddc07a430 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:35.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.110+0000 7f6dff652640 1 --2- 172.21.15.90:0/2353370894 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df813fcc0 0x7f6df8140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:35.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.110+0000 7f6dff652640 1 --2- 172.21.15.90:0/2353370894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df8152ea0 0x7f6df8159b90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:35.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.110+0000 7f6dff652640 1 --2- 172.21.15.90:0/2353370894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6de4007330 0x7f6df81e8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:35.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.110+0000 7f6dff652640 1 -- 172.21.15.90:0/2353370894 >> 172.21.15.90:0/2353370894 conn(0x7f6df80cfbc0 msgr2=0x7f6df80c96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:35.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.110+0000 7f6dff652640 1 -- 172.21.15.90:0/2353370894 shutdown_connections 2024-09-10T23:14:35.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.110+0000 7f6dff652640 1 -- 172.21.15.90:0/2353370894 wait complete. 2024-09-10T23:14:35.134 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:14:35.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.237+0000 7fc9a3085640 1 -- 172.21.15.90:0/1290625322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c15c060 msgr2=0x7fc99c15fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:35.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.237+0000 7fc9a3085640 1 --2- 172.21.15.90:0/1290625322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c15c060 0x7fc99c15fa20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc99c0cf8b0 tx=0x7fc99402a4d0 comp rx=0 tx=0).stop 2024-09-10T23:14:35.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.237+0000 7fc9a3085640 1 -- 172.21.15.90:0/1290625322 shutdown_connections 2024-09-10T23:14:35.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.237+0000 7fc9a3085640 1 --2- 172.21.15.90:0/1290625322 >> v2:172.21.15.171:3300/0 conn(0x7fc99c0cc880 0x7fc99c15ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:35.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.237+0000 7fc9a3085640 1 --2- 172.21.15.90:0/1290625322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c15c060 0x7fc99c15fa20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:35.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.237+0000 7fc9a3085640 1 -- 172.21.15.90:0/1290625322 >> 172.21.15.90:0/1290625322 conn(0x7fc99c09a9f0 msgr2=0x7fc99c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:35.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.237+0000 7fc9a3085640 1 -- 172.21.15.90:0/1290625322 shutdown_connections 2024-09-10T23:14:35.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.237+0000 7fc9a3085640 1 -- 172.21.15.90:0/1290625322 wait complete. 2024-09-10T23:14:35.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.239+0000 7fc9a3085640 1 Processor -- start 2024-09-10T23:14:35.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.239+0000 7fc9a3085640 1 -- start start 2024-09-10T23:14:35.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.239+0000 7fc9a3085640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c0cc880 0x7fc99c1f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:35.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.239+0000 7fc9a3085640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc99c0d1cd0 0x7fc99c1f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:35.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.239+0000 7fc9a3085640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99c15c060 0x7fc99c1f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:35.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.239+0000 7fc9a3085640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c0721c0 con 0x7fc99c0cc880 2024-09-10T23:14:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.239+0000 7fc9a3085640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c072040 con 0x7fc99c0d1cd0 2024-09-10T23:14:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.239+0000 7fc9a3085640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc99c072340 con 0x7fc99c15c060 2024-09-10T23:14:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.240+0000 7fc9a0e21640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c0cc880 0x7fc99c1f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.240+0000 7fc9a0e21640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c0cc880 0x7fc99c1f5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48796/0 (socket says 172.21.15.90:48796) 2024-09-10T23:14:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.240+0000 7fc9a0e21640 1 -- 172.21.15.90:0/2139028028 learned_addr learned my addr 172.21.15.90:0/2139028028 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.240+0000 7fc99bfff640 1 --2- 172.21.15.90:0/2139028028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc99c0d1cd0 0x7fc99c1f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.240+0000 7fc9a1622640 1 --2- 172.21.15.90:0/2139028028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99c15c060 0x7fc99c1f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.240+0000 7fc9a0e21640 1 -- 172.21.15.90:0/2139028028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99c15c060 msgr2=0x7fc99c1f6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.240+0000 7fc9a0e21640 1 --2- 172.21.15.90:0/2139028028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99c15c060 0x7fc99c1f6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.240+0000 7fc9a0e21640 1 -- 172.21.15.90:0/2139028028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc99c0d1cd0 msgr2=0x7fc99c1f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.240+0000 7fc9a0e21640 1 --2- 172.21.15.90:0/2139028028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc99c0d1cd0 0x7fc99c1f63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.240+0000 7fc9a0e21640 1 -- 172.21.15.90:0/2139028028 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99c15cf90 con 0x7fc99c0cc880 2024-09-10T23:14:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.240+0000 7fc9a1622640 1 --2- 172.21.15.90:0/2139028028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99c15c060 0x7fc99c1f6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:35.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.240+0000 7fc9a0e21640 1 --2- 172.21.15.90:0/2139028028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c0cc880 0x7fc99c1f5e90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc994034040 tx=0x7fc9940039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:35.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.240+0000 7fc9997fa640 1 -- 172.21.15.90:0/2139028028 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99403e030 con 0x7fc99c0cc880 2024-09-10T23:14:35.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.240+0000 7fc9997fa640 1 -- 172.21.15.90:0/2139028028 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9940047a0 con 0x7fc99c0cc880 2024-09-10T23:14:35.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.240+0000 7fc9997fa640 1 -- 172.21.15.90:0/2139028028 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc994035040 con 0x7fc99c0cc880 2024-09-10T23:14:35.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.240+0000 7fc9a3085640 1 -- 172.21.15.90:0/2139028028 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc99c15d270 con 0x7fc99c0cc880 2024-09-10T23:14:35.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.240+0000 7fc9a3085640 1 -- 172.21.15.90:0/2139028028 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc99c15d830 con 0x7fc99c0cc880 2024-09-10T23:14:35.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.241+0000 7fc9a3085640 1 -- 172.21.15.90:0/2139028028 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc99c072860 con 0x7fc99c0cc880 2024-09-10T23:14:35.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.242+0000 7fc9997fa640 1 -- 172.21.15.90:0/2139028028 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc994004bf0 con 0x7fc99c0cc880 2024-09-10T23:14:35.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.242+0000 7fc9997fa640 1 --2- 172.21.15.90:0/2139028028 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc97c077f70 0x7fc97c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:35.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.242+0000 7fc9997fa640 1 -- 172.21.15.90:0/2139028028 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7fc9940ba4d0 con 0x7fc99c0cc880 2024-09-10T23:14:35.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.242+0000 7fc99bfff640 1 --2- 172.21.15.90:0/2139028028 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc97c077f70 0x7fc97c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:35.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.243+0000 7fc99bfff640 1 --2- 172.21.15.90:0/2139028028 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc97c077f70 0x7fc97c07a430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc99c0c8ed0 tx=0x7fc98c009680 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:35.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.247+0000 7fc9997fa640 1 -- 172.21.15.90:0/2139028028 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc994082a70 con 0x7fc99c0cc880 2024-09-10T23:14:35.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:35.456+0000 7fc9a3085640 1 -- 172.21.15.90:0/2139028028 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc99c0b7600 con 0x7fc99c0cc880 2024-09-10T23:14:36.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.144+0000 7fc9997fa640 1 -- 172.21.15.90:0/2139028028 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fc9940874a0 con 0x7fc99c0cc880 2024-09-10T23:14:36.145 INFO:teuthology.orchestra.run.smithi090.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T23:14:36.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.152+0000 7fc9a3085640 1 -- 172.21.15.90:0/2139028028 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc97c077f70 msgr2=0x7fc97c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:36.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.152+0000 7fc9a3085640 1 --2- 172.21.15.90:0/2139028028 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc97c077f70 0x7fc97c07a430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc99c0c8ed0 tx=0x7fc98c009680 comp rx=0 tx=0).stop 2024-09-10T23:14:36.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.152+0000 7fc9a3085640 1 -- 172.21.15.90:0/2139028028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c0cc880 msgr2=0x7fc99c1f5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:36.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.152+0000 7fc9a3085640 1 --2- 172.21.15.90:0/2139028028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c0cc880 0x7fc99c1f5e90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc994034040 tx=0x7fc9940039e0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.153+0000 7fc9a3085640 1 -- 172.21.15.90:0/2139028028 shutdown_connections 2024-09-10T23:14:36.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.153+0000 7fc9a3085640 1 --2- 172.21.15.90:0/2139028028 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc97c077f70 0x7fc97c07a430 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.153+0000 7fc9a3085640 1 --2- 172.21.15.90:0/2139028028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc99c0d1cd0 0x7fc99c1f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.153+0000 7fc9a3085640 1 --2- 172.21.15.90:0/2139028028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc99c15c060 0x7fc99c1f6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.153+0000 7fc9a3085640 1 --2- 172.21.15.90:0/2139028028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc99c0cc880 0x7fc99c1f5e90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.153+0000 7fc9a3085640 1 -- 172.21.15.90:0/2139028028 >> 172.21.15.90:0/2139028028 conn(0x7fc99c09a9f0 msgr2=0x7fc99c0b5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:36.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.153+0000 7fc9a3085640 1 -- 172.21.15.90:0/2139028028 shutdown_connections 2024-09-10T23:14:36.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.153+0000 7fc9a3085640 1 -- 172.21.15.90:0/2139028028 wait complete. 2024-09-10T23:14:36.171 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:14:36.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.270+0000 7fdbc68bd640 1 -- 172.21.15.90:0/1745290574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbac004800 msgr2=0x7fdbac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:36.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.270+0000 7fdbc68bd640 1 --2- 172.21.15.90:0/1745290574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbac004800 0x7fdbac004c80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009b50 tx=0x7fdbac005830 comp rx=0 tx=0).stop 2024-09-10T23:14:36.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.270+0000 7fdbc4e5a640 1 -- 172.21.15.90:0/1745290574 reap_dead start 2024-09-10T23:14:36.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.270+0000 7fdbc68bd640 1 -- 172.21.15.90:0/1745290574 shutdown_connections 2024-09-10T23:14:36.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.270+0000 7fdbc68bd640 1 -- 172.21.15.90:0/1745290574 >> 172.21.15.90:0/1745290574 conn(0x7fdbc00cc850 msgr2=0x7fdbc00ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:36.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.270+0000 7fdbc68bd640 1 -- 172.21.15.90:0/1745290574 shutdown_connections 2024-09-10T23:14:36.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.270+0000 7fdbc68bd640 1 -- 172.21.15.90:0/1745290574 wait complete. 2024-09-10T23:14:36.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.271+0000 7fdbc68bd640 1 Processor -- start 2024-09-10T23:14:36.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.272+0000 7fdbc68bd640 1 -- start start 2024-09-10T23:14:36.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.272+0000 7fdbc68bd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbac004800 0x7fdbc009b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:36.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.272+0000 7fdbc68bd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbc009dde0 0x7fdbc00c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:36.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.272+0000 7fdbc68bd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbc015a380 0x7fdbc00c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:36.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.272+0000 7fdbc68bd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc00b20e0 con 0x7fdbc015a380 2024-09-10T23:14:36.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.272+0000 7fdbc68bd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc00b1f60 con 0x7fdbc009dde0 2024-09-10T23:14:36.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.272+0000 7fdbc68bd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc006f850 con 0x7fdbac004800 2024-09-10T23:14:36.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.272+0000 7fdbc4e5a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbc015a380 0x7fdbc00c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:36.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.272+0000 7fdbc4e5a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbc015a380 0x7fdbc00c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48806/0 (socket says 172.21.15.90:48806) 2024-09-10T23:14:36.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.272+0000 7fdbc4e5a640 1 -- 172.21.15.90:0/2104563694 learned_addr learned my addr 172.21.15.90:0/2104563694 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:36.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.272+0000 7fdbbffff640 1 --2- 172.21.15.90:0/2104563694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbac004800 0x7fdbc009b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:36.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.272+0000 7fdbb7fff640 1 --2- 172.21.15.90:0/2104563694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbc009dde0 0x7fdbc00c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:36.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.273+0000 7fdbc4e5a640 1 -- 172.21.15.90:0/2104563694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbac004800 msgr2=0x7fdbc009b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:36.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.273+0000 7fdbc4e5a640 1 --2- 172.21.15.90:0/2104563694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbac004800 0x7fdbc009b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.273+0000 7fdbc4e5a640 1 -- 172.21.15.90:0/2104563694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbc009dde0 msgr2=0x7fdbc00c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:36.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.273+0000 7fdbc4e5a640 1 --2- 172.21.15.90:0/2104563694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbc009dde0 0x7fdbc00c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.273+0000 7fdbc4e5a640 1 -- 172.21.15.90:0/2104563694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc00c4890 con 0x7fdbc015a380 2024-09-10T23:14:36.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.273+0000 7fdbc4e5a640 1 --2- 172.21.15.90:0/2104563694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbc015a380 0x7fdbc00c7ef0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdbc006ff50 tx=0x7fdbb8001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:36.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.273+0000 7fdbbd7fa640 1 -- 172.21.15.90:0/2104563694 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8015020 con 0x7fdbc015a380 2024-09-10T23:14:36.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.273+0000 7fdbbd7fa640 1 -- 172.21.15.90:0/2104563694 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbb8011960 con 0x7fdbc015a380 2024-09-10T23:14:36.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.273+0000 7fdbbd7fa640 1 -- 172.21.15.90:0/2104563694 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8011db0 con 0x7fdbc015a380 2024-09-10T23:14:36.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.273+0000 7fdbc68bd640 1 -- 172.21.15.90:0/2104563694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc009b970 con 0x7fdbc015a380 2024-09-10T23:14:36.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.273+0000 7fdbc68bd640 1 -- 172.21.15.90:0/2104563694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc00c3b50 con 0x7fdbc015a380 2024-09-10T23:14:36.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.274+0000 7fdbc68bd640 1 -- 172.21.15.90:0/2104563694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc00ca850 con 0x7fdbc015a380 2024-09-10T23:14:36.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.275+0000 7fdbbd7fa640 1 -- 172.21.15.90:0/2104563694 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdbb801a400 con 0x7fdbc015a380 2024-09-10T23:14:36.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.275+0000 7fdbbd7fa640 1 --2- 172.21.15.90:0/2104563694 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdba0077f70 0x7fdba007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:36.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.275+0000 7fdbbd7fa640 1 -- 172.21.15.90:0/2104563694 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdbb809a9e0 con 0x7fdbc015a380 2024-09-10T23:14:36.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.275+0000 7fdbbffff640 1 --2- 172.21.15.90:0/2104563694 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdba0077f70 0x7fdba007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:36.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.276+0000 7fdbbffff640 1 --2- 172.21.15.90:0/2104563694 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdba0077f70 0x7fdba007a430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0000c00 tx=0x7fdbb0006040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:36.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.279+0000 7fdbbd7fa640 1 -- 172.21.15.90:0/2104563694 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdbb801f020 con 0x7fdbc015a380 2024-09-10T23:14:36.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.456+0000 7fdbc68bd640 1 -- 172.21.15.90:0/2104563694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdbc00aea20 con 0x7fdbc015a380 2024-09-10T23:14:36.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.457+0000 7fdbbd7fa640 1 -- 172.21.15.90:0/2104563694 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16678 (secure 0 0 0) 0x7fdbb8062f20 con 0x7fdbc015a380 2024-09-10T23:14:36.458 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:36.458 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":22,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:14:35.458022+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:14:33.985657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:14:34.420690+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:14:36.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.459+0000 7fdbc68bd640 1 -- 172.21.15.90:0/2104563694 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdba0077f70 msgr2=0x7fdba007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:36.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.459+0000 7fdbc68bd640 1 --2- 172.21.15.90:0/2104563694 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdba0077f70 0x7fdba007a430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0000c00 tx=0x7fdbb0006040 comp rx=0 tx=0).stop 2024-09-10T23:14:36.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.459+0000 7fdbc68bd640 1 -- 172.21.15.90:0/2104563694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbc015a380 msgr2=0x7fdbc00c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:36.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.459+0000 7fdbc68bd640 1 --2- 172.21.15.90:0/2104563694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbc015a380 0x7fdbc00c7ef0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdbc006ff50 tx=0x7fdbb8001b80 comp rx=0 tx=0).stop 2024-09-10T23:14:36.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.459+0000 7fdbc68bd640 1 -- 172.21.15.90:0/2104563694 shutdown_connections 2024-09-10T23:14:36.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.459+0000 7fdbc68bd640 1 --2- 172.21.15.90:0/2104563694 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdba0077f70 0x7fdba007a430 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.459+0000 7fdbc68bd640 1 --2- 172.21.15.90:0/2104563694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbc009dde0 0x7fdbc00c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.459+0000 7fdbc68bd640 1 --2- 172.21.15.90:0/2104563694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbc015a380 0x7fdbc00c7ef0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.459+0000 7fdbc68bd640 1 --2- 172.21.15.90:0/2104563694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbac004800 0x7fdbc009b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.459+0000 7fdbc68bd640 1 -- 172.21.15.90:0/2104563694 >> 172.21.15.90:0/2104563694 conn(0x7fdbc00cc850 msgr2=0x7fdbc00b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:36.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.459+0000 7fdbc68bd640 1 -- 172.21.15.90:0/2104563694 shutdown_connections 2024-09-10T23:14:36.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.459+0000 7fdbc68bd640 1 -- 172.21.15.90:0/2104563694 wait complete. 2024-09-10T23:14:36.471 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:14:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.570+0000 7fda4f8f7640 1 -- 172.21.15.90:0/2146788932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda340052e0 msgr2=0x7fda3400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.570+0000 7fda4f8f7640 1 --2- 172.21.15.90:0/2146788932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda340052e0 0x7fda3400b9c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fda40009b50 tx=0x7fda34005830 comp rx=0 tx=0).stop 2024-09-10T23:14:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.570+0000 7fda4f8f7640 1 -- 172.21.15.90:0/2146788932 shutdown_connections 2024-09-10T23:14:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.570+0000 7fda4f8f7640 1 --2- 172.21.15.90:0/2146788932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda340052e0 0x7fda3400b9c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.570+0000 7fda4f8f7640 1 -- 172.21.15.90:0/2146788932 >> 172.21.15.90:0/2146788932 conn(0x7fda480cc850 msgr2=0x7fda480ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.571+0000 7fda4f8f7640 1 -- 172.21.15.90:0/2146788932 shutdown_connections 2024-09-10T23:14:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.571+0000 7fda4f8f7640 1 -- 172.21.15.90:0/2146788932 wait complete. 2024-09-10T23:14:36.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.572+0000 7fda4f8f7640 1 Processor -- start 2024-09-10T23:14:36.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.572+0000 7fda4f8f7640 1 -- start start 2024-09-10T23:14:36.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.572+0000 7fda4f8f7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda340052e0 0x7fda481f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:36.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.572+0000 7fda4f8f7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda480c8660 0x7fda48157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:36.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.572+0000 7fda4f8f7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda481f5f70 0x7fda480b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:36.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.572+0000 7fda4f8f7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fda480cabe0 con 0x7fda340052e0 2024-09-10T23:14:36.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.572+0000 7fda4f8f7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fda480caa60 con 0x7fda480c8660 2024-09-10T23:14:36.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.572+0000 7fda4f8f7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fda480cad60 con 0x7fda481f5f70 2024-09-10T23:14:36.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.573+0000 7fda4d693640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda340052e0 0x7fda481f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:36.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.573+0000 7fda4d693640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda340052e0 0x7fda481f2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48822/0 (socket says 172.21.15.90:48822) 2024-09-10T23:14:36.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.573+0000 7fda4d693640 1 -- 172.21.15.90:0/2346207623 learned_addr learned my addr 172.21.15.90:0/2346207623 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:36.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.573+0000 7fda4de94640 1 --2- 172.21.15.90:0/2346207623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda481f5f70 0x7fda480b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:36.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.573+0000 7fda4ce92640 1 --2- 172.21.15.90:0/2346207623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda480c8660 0x7fda48157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:36.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.573+0000 7fda4d693640 1 -- 172.21.15.90:0/2346207623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda481f5f70 msgr2=0x7fda480b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:36.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.573+0000 7fda4d693640 1 --2- 172.21.15.90:0/2346207623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda481f5f70 0x7fda480b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.573+0000 7fda4d693640 1 -- 172.21.15.90:0/2346207623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda480c8660 msgr2=0x7fda48157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:36.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.573+0000 7fda4d693640 1 --2- 172.21.15.90:0/2346207623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda480c8660 0x7fda48157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.573+0000 7fda4d693640 1 -- 172.21.15.90:0/2346207623 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda481f2fb0 con 0x7fda340052e0 2024-09-10T23:14:36.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.573+0000 7fda4d693640 1 --2- 172.21.15.90:0/2346207623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda340052e0 0x7fda481f2980 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fda4400ea70 tx=0x7fda4400ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:36.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.573+0000 7fda3dffb640 1 -- 172.21.15.90:0/2346207623 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda44003970 con 0x7fda340052e0 2024-09-10T23:14:36.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.573+0000 7fda3dffb640 1 -- 172.21.15.90:0/2346207623 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda44003c00 con 0x7fda340052e0 2024-09-10T23:14:36.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.573+0000 7fda4f8f7640 1 -- 172.21.15.90:0/2346207623 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda481f3290 con 0x7fda340052e0 2024-09-10T23:14:36.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.573+0000 7fda3dffb640 1 -- 172.21.15.90:0/2346207623 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda440060d0 con 0x7fda340052e0 2024-09-10T23:14:36.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.573+0000 7fda4f8f7640 1 -- 172.21.15.90:0/2346207623 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda480c6f40 con 0x7fda340052e0 2024-09-10T23:14:36.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.574+0000 7fda4f8f7640 1 -- 172.21.15.90:0/2346207623 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda480af410 con 0x7fda340052e0 2024-09-10T23:14:36.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.575+0000 7fda3dffb640 1 -- 172.21.15.90:0/2346207623 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fda4400c040 con 0x7fda340052e0 2024-09-10T23:14:36.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.575+0000 7fda3dffb640 1 --2- 172.21.15.90:0/2346207623 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fda2c077fa0 0x7fda2c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:36.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.575+0000 7fda3dffb640 1 -- 172.21.15.90:0/2346207623 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fda4409a430 con 0x7fda340052e0 2024-09-10T23:14:36.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.576+0000 7fda4ce92640 1 --2- 172.21.15.90:0/2346207623 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fda2c077fa0 0x7fda2c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:36.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.576+0000 7fda4ce92640 1 --2- 172.21.15.90:0/2346207623 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fda2c077fa0 0x7fda2c07a460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fda480c8a80 tx=0x7fda380067a0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:36.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.580+0000 7fda3dffb640 1 -- 172.21.15.90:0/2346207623 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fda480af410 con 0x7fda340052e0 2024-09-10T23:14:36.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.754+0000 7fda4f8f7640 1 -- 172.21.15.90:0/2346207623 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda480cdcb0 con 0x7fda340052e0 2024-09-10T23:14:36.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.755+0000 7fda3dffb640 1 -- 172.21.15.90:0/2346207623 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16678 (secure 0 0 0) 0x7fda44062970 con 0x7fda340052e0 2024-09-10T23:14:36.756 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:36.756 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":22,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:14:35.458022+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:14:33.985657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:14:34.420690+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:14:36.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.757+0000 7fda4f8f7640 1 -- 172.21.15.90:0/2346207623 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fda2c077fa0 msgr2=0x7fda2c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:36.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.757+0000 7fda4f8f7640 1 --2- 172.21.15.90:0/2346207623 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fda2c077fa0 0x7fda2c07a460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fda480c8a80 tx=0x7fda380067a0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.757+0000 7fda4f8f7640 1 -- 172.21.15.90:0/2346207623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda340052e0 msgr2=0x7fda481f2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:36.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.757+0000 7fda4f8f7640 1 --2- 172.21.15.90:0/2346207623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda340052e0 0x7fda481f2980 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fda4400ea70 tx=0x7fda4400ef30 comp rx=0 tx=0).stop 2024-09-10T23:14:36.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.757+0000 7fda4f8f7640 1 -- 172.21.15.90:0/2346207623 shutdown_connections 2024-09-10T23:14:36.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.757+0000 7fda4f8f7640 1 --2- 172.21.15.90:0/2346207623 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fda2c077fa0 0x7fda2c07a460 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.757+0000 7fda4f8f7640 1 --2- 172.21.15.90:0/2346207623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda480c8660 0x7fda48157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.757+0000 7fda4f8f7640 1 --2- 172.21.15.90:0/2346207623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda481f5f70 0x7fda480b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.757+0000 7fda4f8f7640 1 --2- 172.21.15.90:0/2346207623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda340052e0 0x7fda481f2980 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.757+0000 7fda4f8f7640 1 -- 172.21.15.90:0/2346207623 >> 172.21.15.90:0/2346207623 conn(0x7fda480cc850 msgr2=0x7fda48072630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:36.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.757+0000 7fda4f8f7640 1 -- 172.21.15.90:0/2346207623 shutdown_connections 2024-09-10T23:14:36.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.757+0000 7fda4f8f7640 1 -- 172.21.15.90:0/2346207623 wait complete. 2024-09-10T23:14:36.769 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:14:36.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.873+0000 7f94278b8640 1 -- 172.21.15.90:0/4039605583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f942015e230 msgr2=0x7f9420164ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:36.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.873+0000 7f94278b8640 1 --2- 172.21.15.90:0/4039605583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f942015e230 0x7f9420164ca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9420072210 tx=0x7f941802a530 comp rx=0 tx=0).stop 2024-09-10T23:14:36.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.873+0000 7f94278b8640 1 -- 172.21.15.90:0/4039605583 shutdown_connections 2024-09-10T23:14:36.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.873+0000 7f94278b8640 1 --2- 172.21.15.90:0/4039605583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f942015e230 0x7f9420164ca0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.873+0000 7f94278b8640 1 --2- 172.21.15.90:0/4039605583 >> v2:172.21.15.171:3300/0 conn(0x7f94200707c0 0x7f94200ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.873+0000 7f94278b8640 1 -- 172.21.15.90:0/4039605583 >> 172.21.15.90:0/4039605583 conn(0x7f94200cfc80 msgr2=0x7f94200d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:36.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.873+0000 7f94278b8640 1 -- 172.21.15.90:0/4039605583 shutdown_connections 2024-09-10T23:14:36.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.873+0000 7f94278b8640 1 -- 172.21.15.90:0/4039605583 wait complete. 2024-09-10T23:14:36.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.874+0000 7f94278b8640 1 Processor -- start 2024-09-10T23:14:36.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.874+0000 7f94278b8640 1 -- start start 2024-09-10T23:14:36.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f94278b8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94200707c0 0x7f942014c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:36.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f94278b8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94200ca810 0x7f9420157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:36.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f94278b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f942015e230 0x7f94200b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:36.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f94278b8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f942006f810 con 0x7f94200ca810 2024-09-10T23:14:36.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f94278b8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f942006f690 con 0x7f94200707c0 2024-09-10T23:14:36.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f94278b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f94200cf5f0 con 0x7f942015e230 2024-09-10T23:14:36.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f9424e53640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94200ca810 0x7f9420157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:36.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f9424e53640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94200ca810 0x7f9420157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48834/0 (socket says 172.21.15.90:48834) 2024-09-10T23:14:36.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f9424e53640 1 -- 172.21.15.90:0/35017242 learned_addr learned my addr 172.21.15.90:0/35017242 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:36.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f9425654640 1 --2- 172.21.15.90:0/35017242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94200707c0 0x7f942014c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:36.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f9425e55640 1 --2- 172.21.15.90:0/35017242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f942015e230 0x7f94200b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:36.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f9424e53640 1 -- 172.21.15.90:0/35017242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f942015e230 msgr2=0x7f94200b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:36.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f9424e53640 1 --2- 172.21.15.90:0/35017242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f942015e230 0x7f94200b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f9424e53640 1 -- 172.21.15.90:0/35017242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94200707c0 msgr2=0x7f942014c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:36.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f9424e53640 1 --2- 172.21.15.90:0/35017242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94200707c0 0x7f942014c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:36.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f9424e53640 1 -- 172.21.15.90:0/35017242 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94200b59d0 con 0x7f94200ca810 2024-09-10T23:14:36.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f9424e53640 1 --2- 172.21.15.90:0/35017242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94200ca810 0x7f9420157550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f941400c500 tx=0x7f941400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:36.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f941dffb640 1 -- 172.21.15.90:0/35017242 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9414017070 con 0x7f94200ca810 2024-09-10T23:14:36.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f941dffb640 1 -- 172.21.15.90:0/35017242 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94140035f0 con 0x7f94200ca810 2024-09-10T23:14:36.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f941dffb640 1 -- 172.21.15.90:0/35017242 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9414003a40 con 0x7f94200ca810 2024-09-10T23:14:36.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.875+0000 7f94278b8640 1 -- 172.21.15.90:0/35017242 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94200b3680 con 0x7f94200ca810 2024-09-10T23:14:36.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.876+0000 7f94278b8640 1 -- 172.21.15.90:0/35017242 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94200b3c40 con 0x7f94200ca810 2024-09-10T23:14:36.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.877+0000 7f94278b8640 1 -- 172.21.15.90:0/35017242 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f942015e780 con 0x7f94200ca810 2024-09-10T23:14:36.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.877+0000 7f941dffb640 1 -- 172.21.15.90:0/35017242 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9414003be0 con 0x7f94200ca810 2024-09-10T23:14:36.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.877+0000 7f941dffb640 1 --2- 172.21.15.90:0/35017242 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f940c077f70 0x7f940c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:36.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.878+0000 7f941dffb640 1 -- 172.21.15.90:0/35017242 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f94140994e0 con 0x7f94200ca810 2024-09-10T23:14:36.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.878+0000 7f9425654640 1 --2- 172.21.15.90:0/35017242 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f940c077f70 0x7f940c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:36.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.878+0000 7f9425654640 1 --2- 172.21.15.90:0/35017242 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f940c077f70 0x7f940c07a430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9410005c40 tx=0x7f941000a370 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:36.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:36.882+0000 7f941dffb640 1 -- 172.21.15.90:0/35017242 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9414062070 con 0x7f94200ca810 2024-09-10T23:14:37.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:37.091+0000 7f94278b8640 1 -- 172.21.15.90:0/35017242 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9420154440 con 0x7f94200ca810 2024-09-10T23:14:37.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:37.888+0000 7f941dffb640 1 -- 172.21.15.90:0/35017242 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7f9414061970 con 0x7f94200ca810 2024-09-10T23:14:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:37.892+0000 7f94278b8640 1 -- 172.21.15.90:0/35017242 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f940c077f70 msgr2=0x7f940c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:37.892+0000 7f94278b8640 1 --2- 172.21.15.90:0/35017242 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f940c077f70 0x7f940c07a430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9410005c40 tx=0x7f941000a370 comp rx=0 tx=0).stop 2024-09-10T23:14:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:37.892+0000 7f94278b8640 1 -- 172.21.15.90:0/35017242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94200ca810 msgr2=0x7f9420157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:37.892+0000 7f94278b8640 1 --2- 172.21.15.90:0/35017242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94200ca810 0x7f9420157550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f941400c500 tx=0x7f941400c9c0 comp rx=0 tx=0).stop 2024-09-10T23:14:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:37.892+0000 7f94278b8640 1 -- 172.21.15.90:0/35017242 shutdown_connections 2024-09-10T23:14:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:37.892+0000 7f94278b8640 1 --2- 172.21.15.90:0/35017242 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f940c077f70 0x7f940c07a430 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:37.892+0000 7f94278b8640 1 --2- 172.21.15.90:0/35017242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f942015e230 0x7f94200b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:37.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:37.892+0000 7f94278b8640 1 --2- 172.21.15.90:0/35017242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94200ca810 0x7f9420157550 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:37.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:37.892+0000 7f94278b8640 1 --2- 172.21.15.90:0/35017242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94200707c0 0x7f942014c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:37.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:37.892+0000 7f94278b8640 1 -- 172.21.15.90:0/35017242 >> 172.21.15.90:0/35017242 conn(0x7f94200cfc80 msgr2=0x7f9420073140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:37.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:37.892+0000 7f94278b8640 1 -- 172.21.15.90:0/35017242 shutdown_connections 2024-09-10T23:14:37.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:37.892+0000 7f94278b8640 1 -- 172.21.15.90:0/35017242 wait complete. 2024-09-10T23:14:37.906 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:14:37.906 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:14:38.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.014+0000 7faf6b6e2640 1 -- 172.21.15.90:0/2503736440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf640cc880 msgr2=0x7faf6415ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:38.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.014+0000 7faf6b6e2640 1 --2- 172.21.15.90:0/2503736440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf640cc880 0x7faf6415ff60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faf58009830 tx=0x7faf5802a510 comp rx=0 tx=0).stop 2024-09-10T23:14:38.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.014+0000 7faf6b6e2640 1 -- 172.21.15.90:0/2503736440 shutdown_connections 2024-09-10T23:14:38.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.014+0000 7faf6b6e2640 1 --2- 172.21.15.90:0/2503736440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf640cc880 0x7faf6415ff60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:38.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.014+0000 7faf6b6e2640 1 --2- 172.21.15.90:0/2503736440 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf6415c060 0x7faf6415fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:38.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.014+0000 7faf6b6e2640 1 -- 172.21.15.90:0/2503736440 >> 172.21.15.90:0/2503736440 conn(0x7faf6409a9f0 msgr2=0x7faf6409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:38.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.014+0000 7faf6b6e2640 1 -- 172.21.15.90:0/2503736440 shutdown_connections 2024-09-10T23:14:38.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.014+0000 7faf6b6e2640 1 -- 172.21.15.90:0/2503736440 wait complete. 2024-09-10T23:14:38.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.015+0000 7faf6b6e2640 1 Processor -- start 2024-09-10T23:14:38.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.015+0000 7faf6b6e2640 1 -- start start 2024-09-10T23:14:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.016+0000 7faf6b6e2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf640cc880 0x7faf640b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.016+0000 7faf6b6e2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf640d1cd0 0x7faf640c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.016+0000 7faf6b6e2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf6415c060 0x7faf6415b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.016+0000 7faf6b6e2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faf640722c0 con 0x7faf640cc880 2024-09-10T23:14:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.016+0000 7faf6b6e2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faf64072140 con 0x7faf6415c060 2024-09-10T23:14:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.016+0000 7faf6b6e2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faf64072440 con 0x7faf640d1cd0 2024-09-10T23:14:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.016+0000 7faf6947e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf640cc880 0x7faf640b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.016+0000 7faf6947e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf640cc880 0x7faf640b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48858/0 (socket says 172.21.15.90:48858) 2024-09-10T23:14:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.016+0000 7faf6947e640 1 -- 172.21.15.90:0/2514337231 learned_addr learned my addr 172.21.15.90:0/2514337231 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.016+0000 7faf68c7d640 1 --2- 172.21.15.90:0/2514337231 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf640d1cd0 0x7faf640c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.016+0000 7faf69c7f640 1 --2- 172.21.15.90:0/2514337231 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf6415c060 0x7faf6415b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.017+0000 7faf6947e640 1 -- 172.21.15.90:0/2514337231 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf640d1cd0 msgr2=0x7faf640c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.017+0000 7faf6947e640 1 --2- 172.21.15.90:0/2514337231 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf640d1cd0 0x7faf640c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:38.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.017+0000 7faf6947e640 1 -- 172.21.15.90:0/2514337231 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf6415c060 msgr2=0x7faf6415b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:38.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.017+0000 7faf6947e640 1 --2- 172.21.15.90:0/2514337231 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf6415c060 0x7faf6415b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:38.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.017+0000 7faf6947e640 1 -- 172.21.15.90:0/2514337231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6415b9a0 con 0x7faf640cc880 2024-09-10T23:14:38.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.017+0000 7faf69c7f640 1 --2- 172.21.15.90:0/2514337231 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf6415c060 0x7faf6415b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:14:38.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.017+0000 7faf6947e640 1 --2- 172.21.15.90:0/2514337231 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf640cc880 0x7faf640b38b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faf5400c970 tx=0x7faf5400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:38.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.017+0000 7faf61ffb640 1 -- 172.21.15.90:0/2514337231 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54007bb0 con 0x7faf640cc880 2024-09-10T23:14:38.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.017+0000 7faf61ffb640 1 -- 172.21.15.90:0/2514337231 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf54007e40 con 0x7faf640cc880 2024-09-10T23:14:38.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.017+0000 7faf6b6e2640 1 -- 172.21.15.90:0/2514337231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf640c8760 con 0x7faf640cc880 2024-09-10T23:14:38.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.017+0000 7faf61ffb640 1 -- 172.21.15.90:0/2514337231 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5400f690 con 0x7faf640cc880 2024-09-10T23:14:38.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.017+0000 7faf6b6e2640 1 -- 172.21.15.90:0/2514337231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf640b30b0 con 0x7faf640cc880 2024-09-10T23:14:38.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.018+0000 7faf6b6e2640 1 -- 172.21.15.90:0/2514337231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf64072960 con 0x7faf640cc880 2024-09-10T23:14:38.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.018+0000 7faf61ffb640 1 -- 172.21.15.90:0/2514337231 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7faf54020030 con 0x7faf640cc880 2024-09-10T23:14:38.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.019+0000 7faf61ffb640 1 --2- 172.21.15.90:0/2514337231 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faf50077f70 0x7faf5007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:38.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.019+0000 7faf61ffb640 1 -- 172.21.15.90:0/2514337231 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7faf5409a200 con 0x7faf640cc880 2024-09-10T23:14:38.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.019+0000 7faf68c7d640 1 --2- 172.21.15.90:0/2514337231 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faf50077f70 0x7faf5007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:38.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.020+0000 7faf68c7d640 1 --2- 172.21.15.90:0/2514337231 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faf50077f70 0x7faf5007a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf58034000 tx=0x7faf58004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:38.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.023+0000 7faf61ffb640 1 -- 172.21.15.90:0/2514337231 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7faf54014030 con 0x7faf640cc880 2024-09-10T23:14:38.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:38.234+0000 7faf6b6e2640 1 -- 172.21.15.90:0/2514337231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7faf64070b30 con 0x7faf640cc880 2024-09-10T23:14:39.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.143+0000 7faf61ffb640 1 -- 172.21.15.90:0/2514337231 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7faf54062d90 con 0x7faf640cc880 2024-09-10T23:14:39.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.146+0000 7faf6b6e2640 1 -- 172.21.15.90:0/2514337231 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faf50077f70 msgr2=0x7faf5007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:39.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.146+0000 7faf6b6e2640 1 --2- 172.21.15.90:0/2514337231 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faf50077f70 0x7faf5007a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf58034000 tx=0x7faf58004730 comp rx=0 tx=0).stop 2024-09-10T23:14:39.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.146+0000 7faf6b6e2640 1 -- 172.21.15.90:0/2514337231 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf640cc880 msgr2=0x7faf640b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:39.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.146+0000 7faf6b6e2640 1 --2- 172.21.15.90:0/2514337231 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf640cc880 0x7faf640b38b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faf5400c970 tx=0x7faf5400ce30 comp rx=0 tx=0).stop 2024-09-10T23:14:39.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.146+0000 7faf6b6e2640 1 -- 172.21.15.90:0/2514337231 shutdown_connections 2024-09-10T23:14:39.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.146+0000 7faf6b6e2640 1 --2- 172.21.15.90:0/2514337231 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faf50077f70 0x7faf5007a430 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.146+0000 7faf6b6e2640 1 --2- 172.21.15.90:0/2514337231 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf6415c060 0x7faf6415b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.146+0000 7faf6b6e2640 1 --2- 172.21.15.90:0/2514337231 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf640d1cd0 0x7faf640c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.146+0000 7faf6b6e2640 1 --2- 172.21.15.90:0/2514337231 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf640cc880 0x7faf640b38b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.146+0000 7faf6b6e2640 1 -- 172.21.15.90:0/2514337231 >> 172.21.15.90:0/2514337231 conn(0x7faf6409a9f0 msgr2=0x7faf640b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:39.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.146+0000 7faf6b6e2640 1 -- 172.21.15.90:0/2514337231 shutdown_connections 2024-09-10T23:14:39.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.146+0000 7faf6b6e2640 1 -- 172.21.15.90:0/2514337231 wait complete. 2024-09-10T23:14:39.159 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:14:39.159 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:14:39.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.260+0000 7fbb43240640 1 -- 172.21.15.90:0/2487529800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb2c003a50 msgr2=0x7fbb2c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:39.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.260+0000 7fbb43240640 1 --2- 172.21.15.90:0/2487529800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb2c003a50 0x7fbb2c003e70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbb30001690 tx=0x7fbb2c005830 comp rx=0 tx=0).stop 2024-09-10T23:14:39.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.260+0000 7fbb43240640 1 -- 172.21.15.90:0/2487529800 shutdown_connections 2024-09-10T23:14:39.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.260+0000 7fbb43240640 1 --2- 172.21.15.90:0/2487529800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb2c003a50 0x7fbb2c003e70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.260+0000 7fbb43240640 1 -- 172.21.15.90:0/2487529800 >> 172.21.15.90:0/2487529800 conn(0x7fbb3c0cc850 msgr2=0x7fbb3c0ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:39.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.260+0000 7fbb43240640 1 -- 172.21.15.90:0/2487529800 shutdown_connections 2024-09-10T23:14:39.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.260+0000 7fbb43240640 1 -- 172.21.15.90:0/2487529800 wait complete. 2024-09-10T23:14:39.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.261+0000 7fbb43240640 1 Processor -- start 2024-09-10T23:14:39.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.261+0000 7fbb43240640 1 -- start start 2024-09-10T23:14:39.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.262+0000 7fbb43240640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb2c003a50 0x7fbb3c159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:39.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.262+0000 7fbb43240640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb3c0b16e0 0x7fbb3c0b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:39.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.262+0000 7fbb43240640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb3c0b58a0 0x7fbb3c0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:39.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.262+0000 7fbb43240640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c06fc90 con 0x7fbb2c003a50 2024-09-10T23:14:39.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.262+0000 7fbb43240640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c06fb10 con 0x7fbb3c0b58a0 2024-09-10T23:14:39.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.262+0000 7fbb43240640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbb3c0ca820 con 0x7fbb3c0b16e0 2024-09-10T23:14:39.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.262+0000 7fbb40fdc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb2c003a50 0x7fbb3c159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:39.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.262+0000 7fbb40fdc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb2c003a50 0x7fbb3c159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50206/0 (socket says 172.21.15.90:50206) 2024-09-10T23:14:39.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.262+0000 7fbb40fdc640 1 -- 172.21.15.90:0/1523659642 learned_addr learned my addr 172.21.15.90:0/1523659642 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:39.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.262+0000 7fbb40fdc640 1 -- 172.21.15.90:0/1523659642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb3c0b16e0 msgr2=0x7fbb3c0b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:39.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.262+0000 7fbb40fdc640 1 --2- 172.21.15.90:0/1523659642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb3c0b16e0 0x7fbb3c0b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.262+0000 7fbb40fdc640 1 -- 172.21.15.90:0/1523659642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb3c0b58a0 msgr2=0x7fbb3c0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:39.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.262+0000 7fbb40fdc640 1 --2- 172.21.15.90:0/1523659642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb3c0b58a0 0x7fbb3c0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.262+0000 7fbb40fdc640 1 -- 172.21.15.90:0/1523659642 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3c159940 con 0x7fbb2c003a50 2024-09-10T23:14:39.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.262+0000 7fbb40fdc640 1 --2- 172.21.15.90:0/1523659642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb2c003a50 0x7fbb3c159400 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbb30000c00 tx=0x7fbb300062f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:39.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.262+0000 7fbb397fa640 1 -- 172.21.15.90:0/1523659642 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30042070 con 0x7fbb2c003a50 2024-09-10T23:14:39.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.263+0000 7fbb397fa640 1 -- 172.21.15.90:0/1523659642 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb30039070 con 0x7fbb2c003a50 2024-09-10T23:14:39.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.263+0000 7fbb397fa640 1 -- 172.21.15.90:0/1523659642 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30003ba0 con 0x7fbb2c003a50 2024-09-10T23:14:39.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.263+0000 7fbb43240640 1 -- 172.21.15.90:0/1523659642 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3c1f80f0 con 0x7fbb2c003a50 2024-09-10T23:14:39.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.263+0000 7fbb43240640 1 -- 172.21.15.90:0/1523659642 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb3c1f86b0 con 0x7fbb2c003a50 2024-09-10T23:14:39.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.263+0000 7fbb43240640 1 -- 172.21.15.90:0/1523659642 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb3c06ec20 con 0x7fbb2c003a50 2024-09-10T23:14:39.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.264+0000 7fbb397fa640 1 -- 172.21.15.90:0/1523659642 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbb30033420 con 0x7fbb2c003a50 2024-09-10T23:14:39.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.264+0000 7fbb397fa640 1 --2- 172.21.15.90:0/1523659642 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbb20077f70 0x7fbb2007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:39.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.265+0000 7fbb397fa640 1 -- 172.21.15.90:0/1523659642 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbb300b9310 con 0x7fbb2c003a50 2024-09-10T23:14:39.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.265+0000 7fbb3bfff640 1 --2- 172.21.15.90:0/1523659642 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbb20077f70 0x7fbb2007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:39.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.265+0000 7fbb3bfff640 1 --2- 172.21.15.90:0/1523659642 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbb20077f70 0x7fbb2007a430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbb28005bc0 tx=0x7fbb28005a70 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:39.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.269+0000 7fbb397fa640 1 -- 172.21.15.90:0/1523659642 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbb3c159940 con 0x7fbb2c003a50 2024-09-10T23:14:39.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.481+0000 7fbb43240640 1 -- 172.21.15.90:0/1523659642 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb3c0b0780 con 0x7fbb2c003a50 2024-09-10T23:14:39.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.482+0000 7fbb397fa640 1 -- 172.21.15.90:0/1523659642 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7fbb30081e20 con 0x7fbb2c003a50 2024-09-10T23:14:39.483 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:39.483 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":7,"btime":"2024-09-10T23:14:39:140018+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/286705671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":286705671},{"type":"v1","addr":"172.21.15.171:6837","nonce":286705671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/604738442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":604738442},{"type":"v1","addr":"172.21.15.171:6836","nonce":604738442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/1263661165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1263661165},{"type":"v1","addr":"172.21.15.90:6834","nonce":1263661165}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:14:35.457987+0000","modified":"2024-09-10T23:14:38.235652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4368},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4368":{"gid":4368,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6835/1573070489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":1573070489},{"type":"v1","addr":"172.21.15.90:6835","nonce":1573070489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4368,"qdb_cluster":[4368]},"id":1}]} 2024-09-10T23:14:39.483 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 7 2024-09-10T23:14:39.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.484+0000 7fbb43240640 1 -- 172.21.15.90:0/1523659642 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbb20077f70 msgr2=0x7fbb2007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:39.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.484+0000 7fbb43240640 1 --2- 172.21.15.90:0/1523659642 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbb20077f70 0x7fbb2007a430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbb28005bc0 tx=0x7fbb28005a70 comp rx=0 tx=0).stop 2024-09-10T23:14:39.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.484+0000 7fbb43240640 1 -- 172.21.15.90:0/1523659642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb2c003a50 msgr2=0x7fbb3c159400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:39.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.484+0000 7fbb43240640 1 --2- 172.21.15.90:0/1523659642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb2c003a50 0x7fbb3c159400 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbb30000c00 tx=0x7fbb300062f0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.484+0000 7fbb43240640 1 -- 172.21.15.90:0/1523659642 shutdown_connections 2024-09-10T23:14:39.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.484+0000 7fbb43240640 1 --2- 172.21.15.90:0/1523659642 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbb20077f70 0x7fbb2007a430 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.484+0000 7fbb43240640 1 --2- 172.21.15.90:0/1523659642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb3c0b58a0 0x7fbb3c0b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.484+0000 7fbb43240640 1 --2- 172.21.15.90:0/1523659642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb3c0b16e0 0x7fbb3c0b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.484+0000 7fbb43240640 1 --2- 172.21.15.90:0/1523659642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb2c003a50 0x7fbb3c159400 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.484+0000 7fbb43240640 1 -- 172.21.15.90:0/1523659642 >> 172.21.15.90:0/1523659642 conn(0x7fbb3c0cc850 msgr2=0x7fbb3c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:39.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.484+0000 7fbb43240640 1 -- 172.21.15.90:0/1523659642 shutdown_connections 2024-09-10T23:14:39.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.484+0000 7fbb43240640 1 -- 172.21.15.90:0/1523659642 wait complete. 2024-09-10T23:14:39.496 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:14:39.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.597+0000 7fac3f1ad640 1 -- 172.21.15.90:0/3022506901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac20003a00 msgr2=0x7fac20003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:39.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.597+0000 7fac3f1ad640 1 --2- 172.21.15.90:0/3022506901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac20003a00 0x7fac20003e20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fac34009b80 tx=0x7fac20005830 comp rx=0 tx=0).stop 2024-09-10T23:14:39.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.597+0000 7fac3d74a640 1 -- 172.21.15.90:0/3022506901 reap_dead start 2024-09-10T23:14:39.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.597+0000 7fac3f1ad640 1 -- 172.21.15.90:0/3022506901 shutdown_connections 2024-09-10T23:14:39.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.597+0000 7fac3f1ad640 1 -- 172.21.15.90:0/3022506901 >> 172.21.15.90:0/3022506901 conn(0x7fac3809d2a0 msgr2=0x7fac380d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:39.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.597+0000 7fac3f1ad640 1 -- 172.21.15.90:0/3022506901 shutdown_connections 2024-09-10T23:14:39.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.597+0000 7fac3f1ad640 1 -- 172.21.15.90:0/3022506901 wait complete. 2024-09-10T23:14:39.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.598+0000 7fac3f1ad640 1 Processor -- start 2024-09-10T23:14:39.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.598+0000 7fac3f1ad640 1 -- start start 2024-09-10T23:14:39.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac3f1ad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac20003a00 0x7fac3815ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:39.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac3f1ad640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac3815b950 0x7fac380c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:39.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac3f1ad640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3815b390 0x7fac380ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:39.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac3f1ad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac3815e4a0 con 0x7fac20003a00 2024-09-10T23:14:39.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac3f1ad640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fac3815e320 con 0x7fac3815b950 2024-09-10T23:14:39.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac3f1ad640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fac380b4a10 con 0x7fac3815b390 2024-09-10T23:14:39.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac3cf49640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac20003a00 0x7fac3815ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:39.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac3cf49640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac20003a00 0x7fac3815ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50228/0 (socket says 172.21.15.90:50228) 2024-09-10T23:14:39.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac3cf49640 1 -- 172.21.15.90:0/2600094121 learned_addr learned my addr 172.21.15.90:0/2600094121 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:39.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac2ffff640 1 --2- 172.21.15.90:0/2600094121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac3815b950 0x7fac380c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:39.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac3d74a640 1 --2- 172.21.15.90:0/2600094121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3815b390 0x7fac380ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:39.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac3cf49640 1 -- 172.21.15.90:0/2600094121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3815b390 msgr2=0x7fac380ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:39.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac3cf49640 1 --2- 172.21.15.90:0/2600094121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3815b390 0x7fac380ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac3cf49640 1 -- 172.21.15.90:0/2600094121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac3815b950 msgr2=0x7fac380c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:39.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac3cf49640 1 --2- 172.21.15.90:0/2600094121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac3815b950 0x7fac380c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac3cf49640 1 -- 172.21.15.90:0/2600094121 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac380c92a0 con 0x7fac20003a00 2024-09-10T23:14:39.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac2ffff640 1 --2- 172.21.15.90:0/2600094121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac3815b950 0x7fac380c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:14:39.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.599+0000 7fac3d74a640 1 --2- 172.21.15.90:0/2600094121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3815b390 0x7fac380ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:14:39.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.600+0000 7fac3cf49640 1 --2- 172.21.15.90:0/2600094121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac20003a00 0x7fac3815ac80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fac3402b4f0 tx=0x7fac34033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:39.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.600+0000 7fac2d7fa640 1 -- 172.21.15.90:0/2600094121 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac34038040 con 0x7fac20003a00 2024-09-10T23:14:39.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.600+0000 7fac2d7fa640 1 -- 172.21.15.90:0/2600094121 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac34004020 con 0x7fac20003a00 2024-09-10T23:14:39.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.600+0000 7fac3f1ad640 1 -- 172.21.15.90:0/2600094121 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac380c8a00 con 0x7fac20003a00 2024-09-10T23:14:39.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.600+0000 7fac2d7fa640 1 -- 172.21.15.90:0/2600094121 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac34004450 con 0x7fac20003a00 2024-09-10T23:14:39.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.600+0000 7fac3f1ad640 1 -- 172.21.15.90:0/2600094121 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac380c8fc0 con 0x7fac20003a00 2024-09-10T23:14:39.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.601+0000 7fac3f1ad640 1 -- 172.21.15.90:0/2600094121 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac380d1850 con 0x7fac20003a00 2024-09-10T23:14:39.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.601+0000 7fac2d7fa640 1 -- 172.21.15.90:0/2600094121 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fac3403b030 con 0x7fac20003a00 2024-09-10T23:14:39.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.602+0000 7fac2d7fa640 1 --2- 172.21.15.90:0/2600094121 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fac24077fa0 0x7fac2407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:39.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.602+0000 7fac2d7fa640 1 -- 172.21.15.90:0/2600094121 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fac340ba480 con 0x7fac20003a00 2024-09-10T23:14:39.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.602+0000 7fac2ffff640 1 --2- 172.21.15.90:0/2600094121 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fac24077fa0 0x7fac2407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:39.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.603+0000 7fac2ffff640 1 --2- 172.21.15.90:0/2600094121 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fac24077fa0 0x7fac2407a460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fac381612b0 tx=0x7fac28005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:39.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.606+0000 7fac2d7fa640 1 -- 172.21.15.90:0/2600094121 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fac34082f80 con 0x7fac20003a00 2024-09-10T23:14:39.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.782+0000 7fac3f1ad640 1 -- 172.21.15.90:0/2600094121 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac380d4f30 con 0x7fac20003a00 2024-09-10T23:14:39.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.783+0000 7fac2d7fa640 1 -- 172.21.15.90:0/2600094121 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16665 (secure 0 0 0) 0x7fac34082880 con 0x7fac20003a00 2024-09-10T23:14:39.784 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:39.784 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":23,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:14:37.132353+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:14:33.985657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:14:34.420690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:14:39.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.785+0000 7fac3f1ad640 1 -- 172.21.15.90:0/2600094121 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fac24077fa0 msgr2=0x7fac2407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:39.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.785+0000 7fac3f1ad640 1 --2- 172.21.15.90:0/2600094121 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fac24077fa0 0x7fac2407a460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fac381612b0 tx=0x7fac28005f90 comp rx=0 tx=0).stop 2024-09-10T23:14:39.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.785+0000 7fac3f1ad640 1 -- 172.21.15.90:0/2600094121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac20003a00 msgr2=0x7fac3815ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:39.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.785+0000 7fac3f1ad640 1 --2- 172.21.15.90:0/2600094121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac20003a00 0x7fac3815ac80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fac3402b4f0 tx=0x7fac34033670 comp rx=0 tx=0).stop 2024-09-10T23:14:39.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.785+0000 7fac3f1ad640 1 -- 172.21.15.90:0/2600094121 shutdown_connections 2024-09-10T23:14:39.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.785+0000 7fac3f1ad640 1 --2- 172.21.15.90:0/2600094121 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fac24077fa0 0x7fac2407a460 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.785+0000 7fac3f1ad640 1 --2- 172.21.15.90:0/2600094121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac3815b950 0x7fac380c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.785+0000 7fac3f1ad640 1 --2- 172.21.15.90:0/2600094121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3815b390 0x7fac380ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.785+0000 7fac3f1ad640 1 --2- 172.21.15.90:0/2600094121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac20003a00 0x7fac3815ac80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.785+0000 7fac3f1ad640 1 -- 172.21.15.90:0/2600094121 >> 172.21.15.90:0/2600094121 conn(0x7fac3809d2a0 msgr2=0x7fac380cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:39.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.785+0000 7fac3f1ad640 1 -- 172.21.15.90:0/2600094121 shutdown_connections 2024-09-10T23:14:39.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.786+0000 7fac3f1ad640 1 -- 172.21.15.90:0/2600094121 wait complete. 2024-09-10T23:14:39.797 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:14:39.798 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:14:39.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.897+0000 7f97ad8cf640 1 -- 172.21.15.90:0/892647733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97a80d1c70 msgr2=0x7f97a80b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:39.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.897+0000 7f97ad8cf640 1 --2- 172.21.15.90:0/892647733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97a80d1c70 0x7f97a80b3490 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f979c005fd0 tx=0x7f979c02a530 comp rx=0 tx=0).stop 2024-09-10T23:14:39.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.897+0000 7f97ad8cf640 1 -- 172.21.15.90:0/892647733 shutdown_connections 2024-09-10T23:14:39.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.897+0000 7f97ad8cf640 1 --2- 172.21.15.90:0/892647733 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97a80b3a00 0x7f97a80b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.897+0000 7f97ad8cf640 1 --2- 172.21.15.90:0/892647733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97a80d1c70 0x7f97a80b3490 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.897+0000 7f97ad8cf640 1 -- 172.21.15.90:0/892647733 >> 172.21.15.90:0/892647733 conn(0x7f97a809d2a0 msgr2=0x7f97a80d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:39.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.897+0000 7f97ad8cf640 1 -- 172.21.15.90:0/892647733 shutdown_connections 2024-09-10T23:14:39.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.897+0000 7f97ad8cf640 1 -- 172.21.15.90:0/892647733 wait complete. 2024-09-10T23:14:39.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.898+0000 7f97ad8cf640 1 Processor -- start 2024-09-10T23:14:39.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.898+0000 7f97ad8cf640 1 -- start start 2024-09-10T23:14:39.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97ad8cf640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97a80b3a00 0x7f97a80c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:39.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97ad8cf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97a80d1c70 0x7f97a815ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:39.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97ad8cf640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97a80d2470 0x7f97a81f84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:39.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97ad8cf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f97a80b4570 con 0x7f97a80d1c70 2024-09-10T23:14:39.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97ad8cf640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f97a80b43f0 con 0x7f97a80d2470 2024-09-10T23:14:39.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97ad8cf640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f97a80b46f0 con 0x7f97a80b3a00 2024-09-10T23:14:39.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97a67fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97a80d1c70 0x7f97a815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:39.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97a67fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97a80d1c70 0x7f97a815ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50260/0 (socket says 172.21.15.90:50260) 2024-09-10T23:14:39.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97a67fc640 1 -- 172.21.15.90:0/310366519 learned_addr learned my addr 172.21.15.90:0/310366519 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:39.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97a77fe640 1 --2- 172.21.15.90:0/310366519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97a80d2470 0x7f97a81f84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:39.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97a67fc640 1 -- 172.21.15.90:0/310366519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97a80b3a00 msgr2=0x7f97a80c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:39.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97a67fc640 1 --2- 172.21.15.90:0/310366519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97a80b3a00 0x7f97a80c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97a67fc640 1 -- 172.21.15.90:0/310366519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97a80d2470 msgr2=0x7f97a81f84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:39.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97a67fc640 1 --2- 172.21.15.90:0/310366519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97a80d2470 0x7f97a81f84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:39.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97a67fc640 1 -- 172.21.15.90:0/310366519 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a815f970 con 0x7f97a80d1c70 2024-09-10T23:14:39.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97a77fe640 1 --2- 172.21.15.90:0/310366519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97a80d2470 0x7f97a81f84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:14:39.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97a67fc640 1 --2- 172.21.15.90:0/310366519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97a80d1c70 0x7f97a815ef40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f979c000c00 tx=0x7f979c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:39.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f978ffff640 1 -- 172.21.15.90:0/310366519 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c03f070 con 0x7f97a80d1c70 2024-09-10T23:14:39.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f978ffff640 1 -- 172.21.15.90:0/310366519 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f979c004890 con 0x7f97a80d1c70 2024-09-10T23:14:39.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f978ffff640 1 -- 172.21.15.90:0/310366519 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c035030 con 0x7f97a80d1c70 2024-09-10T23:14:39.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97ad8cf640 1 -- 172.21.15.90:0/310366519 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a80ca380 con 0x7f97a80d1c70 2024-09-10T23:14:39.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.899+0000 7f97ad8cf640 1 -- 172.21.15.90:0/310366519 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a80ca940 con 0x7f97a80d1c70 2024-09-10T23:14:39.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.900+0000 7f97ad8cf640 1 -- 172.21.15.90:0/310366519 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97a815bdb0 con 0x7f97a80d1c70 2024-09-10T23:14:39.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.901+0000 7f978ffff640 1 -- 172.21.15.90:0/310366519 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f979c004ce0 con 0x7f97a80d1c70 2024-09-10T23:14:39.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.901+0000 7f978ffff640 1 --2- 172.21.15.90:0/310366519 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9794077f70 0x7f979407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:39.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.902+0000 7f978ffff640 1 -- 172.21.15.90:0/310366519 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f979c0bafe0 con 0x7f97a80d1c70 2024-09-10T23:14:39.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.902+0000 7f97a6ffd640 1 --2- 172.21.15.90:0/310366519 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9794077f70 0x7f979407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:39.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.902+0000 7f97a6ffd640 1 --2- 172.21.15.90:0/310366519 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9794077f70 0x7f979407a430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9798006fd0 tx=0x7f9798006bc0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:39.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:39.906+0000 7f978ffff640 1 -- 172.21.15.90:0/310366519 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f97a80cff60 con 0x7f97a80d1c70 2024-09-10T23:14:40.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.076+0000 7f97ad8cf640 1 -- 172.21.15.90:0/310366519 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97a81616f0 con 0x7f9794077f70 2024-09-10T23:14:40.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.080+0000 7f978ffff640 1 -- 172.21.15.90:0/310366519 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245613 (secure 0 0 0) 0x7f97a81616f0 con 0x7f9794077f70 2024-09-10T23:14:40.084 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:40.085 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:14:40.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.083+0000 7f97ad8cf640 1 -- 172.21.15.90:0/310366519 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9794077f70 msgr2=0x7f979407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:40.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.083+0000 7f97ad8cf640 1 --2- 172.21.15.90:0/310366519 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9794077f70 0x7f979407a430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9798006fd0 tx=0x7f9798006bc0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.083+0000 7f97ad8cf640 1 -- 172.21.15.90:0/310366519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97a80d1c70 msgr2=0x7f97a815ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:40.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.083+0000 7f97ad8cf640 1 --2- 172.21.15.90:0/310366519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97a80d1c70 0x7f97a815ef40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f979c000c00 tx=0x7f979c0039e0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.083+0000 7f97ad8cf640 1 -- 172.21.15.90:0/310366519 shutdown_connections 2024-09-10T23:14:40.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.083+0000 7f97ad8cf640 1 --2- 172.21.15.90:0/310366519 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9794077f70 0x7f979407a430 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.083+0000 7f97ad8cf640 1 --2- 172.21.15.90:0/310366519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97a80d2470 0x7f97a81f84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.083+0000 7f97ad8cf640 1 --2- 172.21.15.90:0/310366519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97a80d1c70 0x7f97a815ef40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.083+0000 7f97ad8cf640 1 --2- 172.21.15.90:0/310366519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97a80b3a00 0x7f97a80c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.083+0000 7f97ad8cf640 1 -- 172.21.15.90:0/310366519 >> 172.21.15.90:0/310366519 conn(0x7f97a809d2a0 msgr2=0x7f97a80b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:40.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.083+0000 7f97ad8cf640 1 -- 172.21.15.90:0/310366519 shutdown_connections 2024-09-10T23:14:40.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.083+0000 7f97ad8cf640 1 -- 172.21.15.90:0/310366519 wait complete. 2024-09-10T23:14:40.095 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-10T23:14:38.433628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":170,"acting":170,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":2696,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":2760704,"data_stored":1676274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.325537"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.121004+0000","last_change":"2024-09-10T23:14:35.121004+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.121004+0000","last_undegraded":"2024-09-10T23:14:35.121004+0000","last_fullsized":"2024-09-10T23:14:35.121004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.122569+0000","last_change":"2024-09-10T23:14:35.122569+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.122569+0000","last_undegraded":"2024-09-10T23:14:35.122569+0000","last_fullsized":"2024-09-10T23:14:35.122569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114752+0000","last_change":"2024-09-10T23:14:35.114752+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114752+0000","last_undegraded":"2024-09-10T23:14:35.114752+0000","last_fullsized":"2024-09-10T23:14:35.114752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.121173+0000","last_change":"2024-09-10T23:14:35.121173+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.121173+0000","last_undegraded":"2024-09-10T23:14:35.121173+0000","last_fullsized":"2024-09-10T23:14:35.121173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114303+0000","last_change":"2024-09-10T23:14:35.114303+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114303+0000","last_undegraded":"2024-09-10T23:14:35.114303+0000","last_fullsized":"2024-09-10T23:14:35.114303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119780+0000","last_change":"2024-09-10T23:14:35.119780+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119780+0000","last_undegraded":"2024-09-10T23:14:35.119780+0000","last_fullsized":"2024-09-10T23:14:35.119780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118752+0000","last_change":"2024-09-10T23:14:35.118752+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118752+0000","last_undegraded":"2024-09-10T23:14:35.118752+0000","last_fullsized":"2024-09-10T23:14:35.118752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.120489+0000","last_change":"2024-09-10T23:14:35.120489+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.120489+0000","last_undegraded":"2024-09-10T23:14:35.120489+0000","last_fullsized":"2024-09-10T23:14:35.120489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119325+0000","last_change":"2024-09-10T23:14:35.119325+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119325+0000","last_undegraded":"2024-09-10T23:14:35.119325+0000","last_fullsized":"2024-09-10T23:14:35.119325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116908+0000","last_change":"2024-09-10T23:14:35.116908+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116908+0000","last_undegraded":"2024-09-10T23:14:35.116908+0000","last_fullsized":"2024-09-10T23:14:35.116908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.113772+0000","last_change":"2024-09-10T23:14:35.113772+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.113772+0000","last_undegraded":"2024-09-10T23:14:35.113772+0000","last_fullsized":"2024-09-10T23:14:35.113772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118648+0000","last_change":"2024-09-10T23:14:35.118648+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118648+0000","last_undegraded":"2024-09-10T23:14:35.118648+0000","last_fullsized":"2024-09-10T23:14:35.118648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.120339+0000","last_change":"2024-09-10T23:14:35.120339+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.120339+0000","last_undegraded":"2024-09-10T23:14:35.120339+0000","last_fullsized":"2024-09-10T23:14:35.120339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114736+0000","last_change":"2024-09-10T23:14:35.114736+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114736+0000","last_undegraded":"2024-09-10T23:14:35.114736+0000","last_fullsized":"2024-09-10T23:14:35.114736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112881+0000","last_change":"2024-09-10T23:14:35.112881+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112881+0000","last_undegraded":"2024-09-10T23:14:35.112881+0000","last_fullsized":"2024-09-10T23:14:35.112881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116381+0000","last_change":"2024-09-10T23:14:35.116381+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116381+0000","last_undegraded":"2024-09-10T23:14:35.116381+0000","last_fullsized":"2024-09-10T23:14:35.116381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116639+0000","last_change":"2024-09-10T23:14:35.116639+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116639+0000","last_undegraded":"2024-09-10T23:14:35.116639+0000","last_fullsized":"2024-09-10T23:14:35.116639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118565+0000","last_change":"2024-09-10T23:14:35.118565+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118565+0000","last_undegraded":"2024-09-10T23:14:35.118565+0000","last_fullsized":"2024-09-10T23:14:35.118565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.113823+0000","last_change":"2024-09-10T23:14:35.113823+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.113823+0000","last_undegraded":"2024-09-10T23:14:35.113823+0000","last_fullsized":"2024-09-10T23:14:35.113823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118054+0000","last_change":"2024-09-10T23:14:35.118054+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118054+0000","last_undegraded":"2024-09-10T23:14:35.118054+0000","last_fullsized":"2024-09-10T23:14:35.118054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114301+0000","last_change":"2024-09-10T23:14:35.114301+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114301+0000","last_undegraded":"2024-09-10T23:14:35.114301+0000","last_fullsized":"2024-09-10T23:14:35.114301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117993+0000","last_change":"2024-09-10T23:14:35.117993+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117993+0000","last_undegraded":"2024-09-10T23:14:35.117993+0000","last_fullsized":"2024-09-10T23:14:35.117993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118808+0000","last_change":"2024-09-10T23:14:35.118808+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118808+0000","last_undegraded":"2024-09-10T23:14:35.118808+0000","last_fullsized":"2024-09-10T23:14:35.118808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119174+0000","last_change":"2024-09-10T23:14:35.119174+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119174+0000","last_undegraded":"2024-09-10T23:14:35.119174+0000","last_fullsized":"2024-09-10T23:14:35.119174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116417+0000","last_change":"2024-09-10T23:14:35.116417+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116417+0000","last_undegraded":"2024-09-10T23:14:35.116417+0000","last_fullsized":"2024-09-10T23:14:35.116417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112934+0000","last_change":"2024-09-10T23:14:35.112934+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112934+0000","last_undegraded":"2024-09-10T23:14:35.112934+0000","last_fullsized":"2024-09-10T23:14:35.112934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117857+0000","last_change":"2024-09-10T23:14:35.117857+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117857+0000","last_undegraded":"2024-09-10T23:14:35.117857+0000","last_fullsized":"2024-09-10T23:14:35.117857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.120966+0000","last_change":"2024-09-10T23:14:35.120966+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.120966+0000","last_undegraded":"2024-09-10T23:14:35.120966+0000","last_fullsized":"2024-09-10T23:14:35.120966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112514+0000","last_change":"2024-09-10T23:14:35.112514+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112514+0000","last_undegraded":"2024-09-10T23:14:35.112514+0000","last_fullsized":"2024-09-10T23:14:35.112514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132131+0000","last_change":"2024-09-10T23:14:35.127806+0000","last_active":"2024-09-10T23:14:35.132131+0000","last_peered":"2024-09-10T23:14:35.132131+0000","last_clean":"2024-09-10T23:14:35.132131+0000","last_became_active":"2024-09-10T23:14:35.127548+0000","last_became_peered":"2024-09-10T23:14:35.127548+0000","last_unstale":"2024-09-10T23:14:35.132131+0000","last_undegraded":"2024-09-10T23:14:35.132131+0000","last_fullsized":"2024-09-10T23:14:35.132131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:15.617243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.129705+0000","last_change":"2024-09-10T23:14:35.125689+0000","last_active":"2024-09-10T23:14:35.129705+0000","last_peered":"2024-09-10T23:14:35.129705+0000","last_clean":"2024-09-10T23:14:35.129705+0000","last_became_active":"2024-09-10T23:14:35.124148+0000","last_became_peered":"2024-09-10T23:14:35.124148+0000","last_unstale":"2024-09-10T23:14:35.129705+0000","last_undegraded":"2024-09-10T23:14:35.129705+0000","last_fullsized":"2024-09-10T23:14:35.129705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:29.882694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.134954+0000","last_change":"2024-09-10T23:14:35.130875+0000","last_active":"2024-09-10T23:14:35.134954+0000","last_peered":"2024-09-10T23:14:35.134954+0000","last_clean":"2024-09-10T23:14:35.134954+0000","last_became_active":"2024-09-10T23:14:35.130552+0000","last_became_peered":"2024-09-10T23:14:35.130552+0000","last_unstale":"2024-09-10T23:14:35.134954+0000","last_undegraded":"2024-09-10T23:14:35.134954+0000","last_fullsized":"2024-09-10T23:14:35.134954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:43.933909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118087+0000","last_change":"2024-09-10T23:14:35.118087+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118087+0000","last_undegraded":"2024-09-10T23:14:35.118087+0000","last_fullsized":"2024-09-10T23:14:35.118087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.125858+0000","last_change":"2024-09-10T23:14:35.123317+0000","last_active":"2024-09-10T23:14:35.125858+0000","last_peered":"2024-09-10T23:14:35.125858+0000","last_clean":"2024-09-10T23:14:35.125858+0000","last_became_active":"2024-09-10T23:14:35.123043+0000","last_became_peered":"2024-09-10T23:14:35.123043+0000","last_unstale":"2024-09-10T23:14:35.125858+0000","last_undegraded":"2024-09-10T23:14:35.125858+0000","last_fullsized":"2024-09-10T23:14:35.125858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:17.769511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119087+0000","last_change":"2024-09-10T23:14:35.119087+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119087+0000","last_undegraded":"2024-09-10T23:14:35.119087+0000","last_fullsized":"2024-09-10T23:14:35.119087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132771+0000","last_change":"2024-09-10T23:14:35.129118+0000","last_active":"2024-09-10T23:14:35.132771+0000","last_peered":"2024-09-10T23:14:35.132771+0000","last_clean":"2024-09-10T23:14:35.132771+0000","last_became_active":"2024-09-10T23:14:35.128858+0000","last_became_peered":"2024-09-10T23:14:35.128858+0000","last_unstale":"2024-09-10T23:14:35.132771+0000","last_undegraded":"2024-09-10T23:14:35.132771+0000","last_fullsized":"2024-09-10T23:14:35.132771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:52.160694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112583+0000","last_change":"2024-09-10T23:14:35.112583+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112583+0000","last_undegraded":"2024-09-10T23:14:35.112583+0000","last_fullsized":"2024-09-10T23:14:35.112583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.131974+0000","last_change":"2024-09-10T23:14:35.130807+0000","last_active":"2024-09-10T23:14:35.131974+0000","last_peered":"2024-09-10T23:14:35.131974+0000","last_clean":"2024-09-10T23:14:35.131974+0000","last_became_active":"2024-09-10T23:14:35.130541+0000","last_became_peered":"2024-09-10T23:14:35.130541+0000","last_unstale":"2024-09-10T23:14:35.131974+0000","last_undegraded":"2024-09-10T23:14:35.131974+0000","last_fullsized":"2024-09-10T23:14:35.131974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:52.160694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.126183+0000","last_change":"2024-09-10T23:14:35.122724+0000","last_active":"2024-09-10T23:14:35.126183+0000","last_peered":"2024-09-10T23:14:35.126183+0000","last_clean":"2024-09-10T23:14:35.126183+0000","last_became_active":"2024-09-10T23:14:35.119910+0000","last_became_peered":"2024-09-10T23:14:35.119910+0000","last_unstale":"2024-09-10T23:14:35.126183+0000","last_undegraded":"2024-09-10T23:14:35.126183+0000","last_fullsized":"2024-09-10T23:14:35.126183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:37.291436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112157+0000","last_change":"2024-09-10T23:14:35.112157+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112157+0000","last_undegraded":"2024-09-10T23:14:35.112157+0000","last_fullsized":"2024-09-10T23:14:35.112157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130737+0000","last_change":"2024-09-10T23:14:35.127319+0000","last_active":"2024-09-10T23:14:35.130737+0000","last_peered":"2024-09-10T23:14:35.130737+0000","last_clean":"2024-09-10T23:14:35.130737+0000","last_became_active":"2024-09-10T23:14:35.127042+0000","last_became_peered":"2024-09-10T23:14:35.127042+0000","last_unstale":"2024-09-10T23:14:35.130737+0000","last_undegraded":"2024-09-10T23:14:35.130737+0000","last_fullsized":"2024-09-10T23:14:35.130737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:17.769511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117847+0000","last_change":"2024-09-10T23:14:35.117847+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117847+0000","last_undegraded":"2024-09-10T23:14:35.117847+0000","last_fullsized":"2024-09-10T23:14:35.117847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:34.104312+0000","last_change":"2024-09-10T23:14:34.104312+0000","last_active":"2024-09-10T23:14:34.104312+0000","last_peered":"2024-09-10T23:14:34.104312+0000","last_clean":"2024-09-10T23:14:34.104312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:34.104312+0000","last_undegraded":"2024-09-10T23:14:34.104312+0000","last_fullsized":"2024-09-10T23:14:34.104312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132004+0000","last_change":"2024-09-10T23:14:35.130442+0000","last_active":"2024-09-10T23:14:35.132004+0000","last_peered":"2024-09-10T23:14:35.132004+0000","last_clean":"2024-09-10T23:14:35.132004+0000","last_became_active":"2024-09-10T23:14:35.130131+0000","last_became_peered":"2024-09-10T23:14:35.130131+0000","last_unstale":"2024-09-10T23:14:35.132004+0000","last_undegraded":"2024-09-10T23:14:35.132004+0000","last_fullsized":"2024-09-10T23:14:35.132004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:44.033195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119183+0000","last_change":"2024-09-10T23:14:35.119183+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119183+0000","last_undegraded":"2024-09-10T23:14:35.119183+0000","last_fullsized":"2024-09-10T23:14:35.119183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132788+0000","last_change":"2024-09-10T23:14:35.129215+0000","last_active":"2024-09-10T23:14:35.132788+0000","last_peered":"2024-09-10T23:14:35.132788+0000","last_clean":"2024-09-10T23:14:35.132788+0000","last_became_active":"2024-09-10T23:14:35.128170+0000","last_became_peered":"2024-09-10T23:14:35.128170+0000","last_unstale":"2024-09-10T23:14:35.132788+0000","last_undegraded":"2024-09-10T23:14:35.132788+0000","last_fullsized":"2024-09-10T23:14:35.132788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:44.033195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.120423+0000","last_change":"2024-09-10T23:14:35.120423+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.120423+0000","last_undegraded":"2024-09-10T23:14:35.120423+0000","last_fullsized":"2024-09-10T23:14:35.120423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132313+0000","last_change":"2024-09-10T23:14:35.127072+0000","last_active":"2024-09-10T23:14:35.132313+0000","last_peered":"2024-09-10T23:14:35.132313+0000","last_clean":"2024-09-10T23:14:35.132313+0000","last_became_active":"2024-09-10T23:14:35.126776+0000","last_became_peered":"2024-09-10T23:14:35.126776+0000","last_unstale":"2024-09-10T23:14:35.132313+0000","last_undegraded":"2024-09-10T23:14:35.132313+0000","last_fullsized":"2024-09-10T23:14:35.132313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:17.769511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118860+0000","last_change":"2024-09-10T23:14:35.118860+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118860+0000","last_undegraded":"2024-09-10T23:14:35.118860+0000","last_fullsized":"2024-09-10T23:14:35.118860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132364+0000","last_change":"2024-09-10T23:14:35.130472+0000","last_active":"2024-09-10T23:14:35.132364+0000","last_peered":"2024-09-10T23:14:35.132364+0000","last_clean":"2024-09-10T23:14:35.132364+0000","last_became_active":"2024-09-10T23:14:35.130164+0000","last_became_peered":"2024-09-10T23:14:35.130164+0000","last_unstale":"2024-09-10T23:14:35.132364+0000","last_undegraded":"2024-09-10T23:14:35.132364+0000","last_fullsized":"2024-09-10T23:14:35.132364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:15.617243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117999+0000","last_change":"2024-09-10T23:14:35.117999+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117999+0000","last_undegraded":"2024-09-10T23:14:35.117999+0000","last_fullsized":"2024-09-10T23:14:35.117999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.135053+0000","last_change":"2024-09-10T23:14:35.130891+0000","last_active":"2024-09-10T23:14:35.135053+0000","last_peered":"2024-09-10T23:14:35.135053+0000","last_clean":"2024-09-10T23:14:35.135053+0000","last_became_active":"2024-09-10T23:14:35.130654+0000","last_became_peered":"2024-09-10T23:14:35.130654+0000","last_unstale":"2024-09-10T23:14:35.135053+0000","last_undegraded":"2024-09-10T23:14:35.135053+0000","last_fullsized":"2024-09-10T23:14:35.135053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:38.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118098+0000","last_change":"2024-09-10T23:14:35.118098+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118098+0000","last_undegraded":"2024-09-10T23:14:35.118098+0000","last_fullsized":"2024-09-10T23:14:35.118098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.126166+0000","last_change":"2024-09-10T23:14:35.121691+0000","last_active":"2024-09-10T23:14:35.126166+0000","last_peered":"2024-09-10T23:14:35.126166+0000","last_clean":"2024-09-10T23:14:35.126166+0000","last_became_active":"2024-09-10T23:14:35.121391+0000","last_became_peered":"2024-09-10T23:14:35.121391+0000","last_unstale":"2024-09-10T23:14:35.126166+0000","last_undegraded":"2024-09-10T23:14:35.126166+0000","last_fullsized":"2024-09-10T23:14:35.126166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:15.617243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.113064+0000","last_change":"2024-09-10T23:14:35.113064+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.113064+0000","last_undegraded":"2024-09-10T23:14:35.113064+0000","last_fullsized":"2024-09-10T23:14:35.113064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132291+0000","last_change":"2024-09-10T23:14:35.126188+0000","last_active":"2024-09-10T23:14:35.132291+0000","last_peered":"2024-09-10T23:14:35.132291+0000","last_clean":"2024-09-10T23:14:35.132291+0000","last_became_active":"2024-09-10T23:14:35.125868+0000","last_became_peered":"2024-09-10T23:14:35.125868+0000","last_unstale":"2024-09-10T23:14:35.132291+0000","last_undegraded":"2024-09-10T23:14:35.132291+0000","last_fullsized":"2024-09-10T23:14:35.132291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:29.882694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117249+0000","last_change":"2024-09-10T23:14:35.117249+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117249+0000","last_undegraded":"2024-09-10T23:14:35.117249+0000","last_fullsized":"2024-09-10T23:14:35.117249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":107,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.124244+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:14:35.124244+0000","last_peered":"2024-09-10T23:14:35.124244+0000","last_clean":"2024-09-10T23:14:35.124244+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:14:35.124244+0000","last_undegraded":"2024-09-10T23:14:35.124244+0000","last_fullsized":"2024-09-10T23:14:35.124244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.128004+0000","last_change":"2024-09-10T23:14:35.126656+0000","last_active":"2024-09-10T23:14:35.128004+0000","last_peered":"2024-09-10T23:14:35.128004+0000","last_clean":"2024-09-10T23:14:35.128004+0000","last_became_active":"2024-09-10T23:14:35.126289+0000","last_became_peered":"2024-09-10T23:14:35.126289+0000","last_unstale":"2024-09-10T23:14:35.128004+0000","last_undegraded":"2024-09-10T23:14:35.128004+0000","last_fullsized":"2024-09-10T23:14:35.128004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:30.470000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119084+0000","last_change":"2024-09-10T23:14:35.119084+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119084+0000","last_undegraded":"2024-09-10T23:14:35.119084+0000","last_fullsized":"2024-09-10T23:14:35.119084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.136395+0000","last_change":"2024-09-10T23:14:35.132667+0000","last_active":"2024-09-10T23:14:35.136395+0000","last_peered":"2024-09-10T23:14:35.136395+0000","last_clean":"2024-09-10T23:14:35.136395+0000","last_became_active":"2024-09-10T23:14:35.132330+0000","last_became_peered":"2024-09-10T23:14:35.132330+0000","last_unstale":"2024-09-10T23:14:35.136395+0000","last_undegraded":"2024-09-10T23:14:35.136395+0000","last_fullsized":"2024-09-10T23:14:35.136395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:44.244654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.135063+0000","last_change":"2024-09-10T23:14:35.130254+0000","last_active":"2024-09-10T23:14:35.135063+0000","last_peered":"2024-09-10T23:14:35.135063+0000","last_clean":"2024-09-10T23:14:35.135063+0000","last_became_active":"2024-09-10T23:14:35.129994+0000","last_became_peered":"2024-09-10T23:14:35.129994+0000","last_unstale":"2024-09-10T23:14:35.135063+0000","last_undegraded":"2024-09-10T23:14:35.135063+0000","last_fullsized":"2024-09-10T23:14:35.135063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:43.933909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118747+0000","last_change":"2024-09-10T23:14:35.118747+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118747+0000","last_undegraded":"2024-09-10T23:14:35.118747+0000","last_fullsized":"2024-09-10T23:14:35.118747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.118725+0000","last_change":"2024-09-10T23:14:35.116348+0000","last_active":"2024-09-10T23:14:35.118725+0000","last_peered":"2024-09-10T23:14:35.118725+0000","last_clean":"2024-09-10T23:14:35.118725+0000","last_became_active":"2024-09-10T23:14:35.116063+0000","last_became_peered":"2024-09-10T23:14:35.116063+0000","last_unstale":"2024-09-10T23:14:35.118725+0000","last_undegraded":"2024-09-10T23:14:35.118725+0000","last_fullsized":"2024-09-10T23:14:35.118725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:29.882694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112047+0000","last_change":"2024-09-10T23:14:35.112047+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112047+0000","last_undegraded":"2024-09-10T23:14:35.112047+0000","last_fullsized":"2024-09-10T23:14:35.112047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130141+0000","last_change":"2024-09-10T23:14:35.123920+0000","last_active":"2024-09-10T23:14:35.130141+0000","last_peered":"2024-09-10T23:14:35.130141+0000","last_clean":"2024-09-10T23:14:35.130141+0000","last_became_active":"2024-09-10T23:14:35.123644+0000","last_became_peered":"2024-09-10T23:14:35.123644+0000","last_unstale":"2024-09-10T23:14:35.130141+0000","last_undegraded":"2024-09-10T23:14:35.130141+0000","last_fullsized":"2024-09-10T23:14:35.130141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:43.933909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112063+0000","last_change":"2024-09-10T23:14:35.112063+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112063+0000","last_undegraded":"2024-09-10T23:14:35.112063+0000","last_fullsized":"2024-09-10T23:14:35.112063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.139207+0000","last_change":"2024-09-10T23:14:35.133489+0000","last_active":"2024-09-10T23:14:35.139207+0000","last_peered":"2024-09-10T23:14:35.139207+0000","last_clean":"2024-09-10T23:14:35.139207+0000","last_became_active":"2024-09-10T23:14:35.133189+0000","last_became_peered":"2024-09-10T23:14:35.133189+0000","last_unstale":"2024-09-10T23:14:35.139207+0000","last_undegraded":"2024-09-10T23:14:35.139207+0000","last_fullsized":"2024-09-10T23:14:35.139207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:26.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117391+0000","last_change":"2024-09-10T23:14:35.117391+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117391+0000","last_undegraded":"2024-09-10T23:14:35.117391+0000","last_fullsized":"2024-09-10T23:14:35.117391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.135146+0000","last_change":"2024-09-10T23:14:35.130762+0000","last_active":"2024-09-10T23:14:35.135146+0000","last_peered":"2024-09-10T23:14:35.135146+0000","last_clean":"2024-09-10T23:14:35.135146+0000","last_became_active":"2024-09-10T23:14:35.130502+0000","last_became_peered":"2024-09-10T23:14:35.130502+0000","last_unstale":"2024-09-10T23:14:35.135146+0000","last_undegraded":"2024-09-10T23:14:35.135146+0000","last_fullsized":"2024-09-10T23:14:35.135146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116558+0000","last_change":"2024-09-10T23:14:35.116558+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116558+0000","last_undegraded":"2024-09-10T23:14:35.116558+0000","last_fullsized":"2024-09-10T23:14:35.116558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.129905+0000","last_change":"2024-09-10T23:14:35.128484+0000","last_active":"2024-09-10T23:14:35.129905+0000","last_peered":"2024-09-10T23:14:35.129905+0000","last_clean":"2024-09-10T23:14:35.129905+0000","last_became_active":"2024-09-10T23:14:35.127877+0000","last_became_peered":"2024-09-10T23:14:35.127877+0000","last_unstale":"2024-09-10T23:14:35.129905+0000","last_undegraded":"2024-09-10T23:14:35.129905+0000","last_fullsized":"2024-09-10T23:14:35.129905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:30.470000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.139207+0000","last_change":"2024-09-10T23:14:35.133467+0000","last_active":"2024-09-10T23:14:35.139207+0000","last_peered":"2024-09-10T23:14:35.139207+0000","last_clean":"2024-09-10T23:14:35.139207+0000","last_became_active":"2024-09-10T23:14:35.133163+0000","last_became_peered":"2024-09-10T23:14:35.133163+0000","last_unstale":"2024-09-10T23:14:35.139207+0000","last_undegraded":"2024-09-10T23:14:35.139207+0000","last_fullsized":"2024-09-10T23:14:35.139207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:48.848197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112226+0000","last_change":"2024-09-10T23:14:35.112226+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112226+0000","last_undegraded":"2024-09-10T23:14:35.112226+0000","last_fullsized":"2024-09-10T23:14:35.112226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130194+0000","last_change":"2024-09-10T23:14:35.125619+0000","last_active":"2024-09-10T23:14:35.130194+0000","last_peered":"2024-09-10T23:14:35.130194+0000","last_clean":"2024-09-10T23:14:35.130194+0000","last_became_active":"2024-09-10T23:14:35.125258+0000","last_became_peered":"2024-09-10T23:14:35.125258+0000","last_unstale":"2024-09-10T23:14:35.130194+0000","last_undegraded":"2024-09-10T23:14:35.130194+0000","last_fullsized":"2024-09-10T23:14:35.130194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:00.433782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117658+0000","last_change":"2024-09-10T23:14:35.117658+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117658+0000","last_undegraded":"2024-09-10T23:14:35.117658+0000","last_fullsized":"2024-09-10T23:14:35.117658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130047+0000","last_change":"2024-09-10T23:14:35.124311+0000","last_active":"2024-09-10T23:14:35.130047+0000","last_peered":"2024-09-10T23:14:35.130047+0000","last_clean":"2024-09-10T23:14:35.130047+0000","last_became_active":"2024-09-10T23:14:35.124054+0000","last_became_peered":"2024-09-10T23:14:35.124054+0000","last_unstale":"2024-09-10T23:14:35.130047+0000","last_undegraded":"2024-09-10T23:14:35.130047+0000","last_fullsized":"2024-09-10T23:14:35.130047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:38.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116580+0000","last_change":"2024-09-10T23:14:35.116580+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116580+0000","last_undegraded":"2024-09-10T23:14:35.116580+0000","last_fullsized":"2024-09-10T23:14:35.116580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130425+0000","last_change":"2024-09-10T23:14:35.128785+0000","last_active":"2024-09-10T23:14:35.130425+0000","last_peered":"2024-09-10T23:14:35.130425+0000","last_clean":"2024-09-10T23:14:35.130425+0000","last_became_active":"2024-09-10T23:14:35.128523+0000","last_became_peered":"2024-09-10T23:14:35.128523+0000","last_unstale":"2024-09-10T23:14:35.130425+0000","last_undegraded":"2024-09-10T23:14:35.130425+0000","last_fullsized":"2024-09-10T23:14:35.130425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:38.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117405+0000","last_change":"2024-09-10T23:14:35.117405+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117405+0000","last_undegraded":"2024-09-10T23:14:35.117405+0000","last_fullsized":"2024-09-10T23:14:35.117405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112932+0000","last_change":"2024-09-10T23:14:35.112932+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112932+0000","last_undegraded":"2024-09-10T23:14:35.112932+0000","last_fullsized":"2024-09-10T23:14:35.112932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130675+0000","last_change":"2024-09-10T23:14:35.128918+0000","last_active":"2024-09-10T23:14:35.130675+0000","last_peered":"2024-09-10T23:14:35.130675+0000","last_clean":"2024-09-10T23:14:35.130675+0000","last_became_active":"2024-09-10T23:14:35.128646+0000","last_became_peered":"2024-09-10T23:14:35.128646+0000","last_unstale":"2024-09-10T23:14:35.130675+0000","last_undegraded":"2024-09-10T23:14:35.130675+0000","last_fullsized":"2024-09-10T23:14:35.130675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:00.433782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114104+0000","last_change":"2024-09-10T23:14:35.114104+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114104+0000","last_undegraded":"2024-09-10T23:14:35.114104+0000","last_fullsized":"2024-09-10T23:14:35.114104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132931+0000","last_change":"2024-09-10T23:14:35.131443+0000","last_active":"2024-09-10T23:14:35.132931+0000","last_peered":"2024-09-10T23:14:35.132931+0000","last_clean":"2024-09-10T23:14:35.132931+0000","last_became_active":"2024-09-10T23:14:35.131123+0000","last_became_peered":"2024-09-10T23:14:35.131123+0000","last_unstale":"2024-09-10T23:14:35.132931+0000","last_undegraded":"2024-09-10T23:14:35.132931+0000","last_fullsized":"2024-09-10T23:14:35.132931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.134892+0000","last_change":"2024-09-10T23:14:35.129994+0000","last_active":"2024-09-10T23:14:35.134892+0000","last_peered":"2024-09-10T23:14:35.134892+0000","last_clean":"2024-09-10T23:14:35.134892+0000","last_became_active":"2024-09-10T23:14:35.129609+0000","last_became_peered":"2024-09-10T23:14:35.129609+0000","last_unstale":"2024-09-10T23:14:35.134892+0000","last_undegraded":"2024-09-10T23:14:35.134892+0000","last_fullsized":"2024-09-10T23:14:35.134892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:37.291436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119352+0000","last_change":"2024-09-10T23:14:35.119352+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119352+0000","last_undegraded":"2024-09-10T23:14:35.119352+0000","last_fullsized":"2024-09-10T23:14:35.119352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:34.104312+0000","last_change":"2024-09-10T23:14:34.104312+0000","last_active":"2024-09-10T23:14:34.104312+0000","last_peered":"2024-09-10T23:14:34.104312+0000","last_clean":"2024-09-10T23:14:34.104312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:34.104312+0000","last_undegraded":"2024-09-10T23:14:34.104312+0000","last_fullsized":"2024-09-10T23:14:34.104312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":778240,"data_stored":646436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:14:40.099 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:14:40.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.237+0000 7fad698c6640 1 -- 172.21.15.90:0/2906802823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad640d2470 msgr2=0x7fad640b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:40.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.237+0000 7fad698c6640 1 --2- 172.21.15.90:0/2906802823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad640d2470 0x7fad640b3490 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fad54005fd0 tx=0x7fad5402a5d0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.237+0000 7fad698c6640 1 -- 172.21.15.90:0/2906802823 shutdown_connections 2024-09-10T23:14:40.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.237+0000 7fad698c6640 1 --2- 172.21.15.90:0/2906802823 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad640b3a00 0x7fad640b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.237+0000 7fad698c6640 1 --2- 172.21.15.90:0/2906802823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad640d2470 0x7fad640b3490 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.237+0000 7fad698c6640 1 -- 172.21.15.90:0/2906802823 >> 172.21.15.90:0/2906802823 conn(0x7fad6409d2a0 msgr2=0x7fad640d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:40.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.237+0000 7fad698c6640 1 -- 172.21.15.90:0/2906802823 shutdown_connections 2024-09-10T23:14:40.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.237+0000 7fad698c6640 1 -- 172.21.15.90:0/2906802823 wait complete. 2024-09-10T23:14:40.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.238+0000 7fad698c6640 1 Processor -- start 2024-09-10T23:14:40.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.238+0000 7fad698c6640 1 -- start start 2024-09-10T23:14:40.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad698c6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad640b3a00 0x7fad6415f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:40.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad698c6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad640d1c70 0x7fad641f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:40.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad698c6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad640d2470 0x7fad641f5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:40.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad698c6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fad640b4570 con 0x7fad640d1c70 2024-09-10T23:14:40.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad698c6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fad640b43f0 con 0x7fad640d2470 2024-09-10T23:14:40.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad698c6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fad640b46f0 con 0x7fad640b3a00 2024-09-10T23:14:40.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad627fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad640d1c70 0x7fad641f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:40.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad627fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad640d1c70 0x7fad641f4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50262/0 (socket says 172.21.15.90:50262) 2024-09-10T23:14:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad627fc640 1 -- 172.21.15.90:0/732527903 learned_addr learned my addr 172.21.15.90:0/732527903 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad62ffd640 1 --2- 172.21.15.90:0/732527903 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad640b3a00 0x7fad6415f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad637fe640 1 --2- 172.21.15.90:0/732527903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad640d2470 0x7fad641f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad627fc640 1 -- 172.21.15.90:0/732527903 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad640b3a00 msgr2=0x7fad6415f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad627fc640 1 --2- 172.21.15.90:0/732527903 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad640b3a00 0x7fad6415f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad627fc640 1 -- 172.21.15.90:0/732527903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad640d2470 msgr2=0x7fad641f5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad627fc640 1 --2- 172.21.15.90:0/732527903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad640d2470 0x7fad641f5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad627fc640 1 -- 172.21.15.90:0/732527903 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad64160310 con 0x7fad640d1c70 2024-09-10T23:14:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad62ffd640 1 --2- 172.21.15.90:0/732527903 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad640b3a00 0x7fad6415f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:14:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad627fc640 1 --2- 172.21.15.90:0/732527903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad640d1c70 0x7fad641f4f50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad5800c420 tx=0x7fad5800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad4bfff640 1 -- 172.21.15.90:0/732527903 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad58017070 con 0x7fad640d1c70 2024-09-10T23:14:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad4bfff640 1 -- 172.21.15.90:0/732527903 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad580053c0 con 0x7fad640d1c70 2024-09-10T23:14:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad698c6640 1 -- 172.21.15.90:0/732527903 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad640b6fd0 con 0x7fad640d1c70 2024-09-10T23:14:40.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.239+0000 7fad4bfff640 1 -- 172.21.15.90:0/732527903 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad58003850 con 0x7fad640d1c70 2024-09-10T23:14:40.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.240+0000 7fad698c6640 1 -- 172.21.15.90:0/732527903 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad640b7810 con 0x7fad640d1c70 2024-09-10T23:14:40.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.241+0000 7fad698c6640 1 -- 172.21.15.90:0/732527903 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad640b3eb0 con 0x7fad640d1c70 2024-09-10T23:14:40.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.241+0000 7fad4bfff640 1 -- 172.21.15.90:0/732527903 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fad580039f0 con 0x7fad640d1c70 2024-09-10T23:14:40.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.242+0000 7fad4bfff640 1 --2- 172.21.15.90:0/732527903 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fad50077fa0 0x7fad5007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:40.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.242+0000 7fad4bfff640 1 -- 172.21.15.90:0/732527903 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fad58099450 con 0x7fad640d1c70 2024-09-10T23:14:40.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.242+0000 7fad62ffd640 1 --2- 172.21.15.90:0/732527903 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fad50077fa0 0x7fad5007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:40.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.242+0000 7fad62ffd640 1 --2- 172.21.15.90:0/732527903 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fad50077fa0 0x7fad5007a460 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fad54033000 tx=0x7fad54004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:40.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.246+0000 7fad4bfff640 1 -- 172.21.15.90:0/732527903 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fad640b6fd0 con 0x7fad640d1c70 2024-09-10T23:14:40.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.417+0000 7fad698c6640 1 -- 172.21.15.90:0/732527903 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad640b79e0 con 0x7fad50077fa0 2024-09-10T23:14:40.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.421+0000 7fad4bfff640 1 -- 172.21.15.90:0/732527903 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245613 (secure 0 0 0) 0x7fad640b79e0 con 0x7fad50077fa0 2024-09-10T23:14:40.425 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:40.426 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:14:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.424+0000 7fad698c6640 1 -- 172.21.15.90:0/732527903 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fad50077fa0 msgr2=0x7fad5007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.424+0000 7fad698c6640 1 --2- 172.21.15.90:0/732527903 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fad50077fa0 0x7fad5007a460 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fad54033000 tx=0x7fad54004730 comp rx=0 tx=0).stop 2024-09-10T23:14:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.424+0000 7fad698c6640 1 -- 172.21.15.90:0/732527903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad640d1c70 msgr2=0x7fad641f4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.424+0000 7fad698c6640 1 --2- 172.21.15.90:0/732527903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad640d1c70 0x7fad641f4f50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad5800c420 tx=0x7fad5800c8e0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.425+0000 7fad698c6640 1 -- 172.21.15.90:0/732527903 shutdown_connections 2024-09-10T23:14:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.425+0000 7fad698c6640 1 --2- 172.21.15.90:0/732527903 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fad50077fa0 0x7fad5007a460 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.425+0000 7fad698c6640 1 --2- 172.21.15.90:0/732527903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad640d2470 0x7fad641f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.425+0000 7fad698c6640 1 --2- 172.21.15.90:0/732527903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad640d1c70 0x7fad641f4f50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.425+0000 7fad698c6640 1 --2- 172.21.15.90:0/732527903 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad640b3a00 0x7fad6415f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.425+0000 7fad698c6640 1 -- 172.21.15.90:0/732527903 >> 172.21.15.90:0/732527903 conn(0x7fad6409d2a0 msgr2=0x7fad640d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.425+0000 7fad698c6640 1 -- 172.21.15.90:0/732527903 shutdown_connections 2024-09-10T23:14:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.425+0000 7fad698c6640 1 -- 172.21.15.90:0/732527903 wait complete. 2024-09-10T23:14:40.436 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-10T23:14:38.433628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":170,"acting":170,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":2696,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":2760704,"data_stored":1676274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.325537"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.121004+0000","last_change":"2024-09-10T23:14:35.121004+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.121004+0000","last_undegraded":"2024-09-10T23:14:35.121004+0000","last_fullsized":"2024-09-10T23:14:35.121004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.122569+0000","last_change":"2024-09-10T23:14:35.122569+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.122569+0000","last_undegraded":"2024-09-10T23:14:35.122569+0000","last_fullsized":"2024-09-10T23:14:35.122569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114752+0000","last_change":"2024-09-10T23:14:35.114752+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114752+0000","last_undegraded":"2024-09-10T23:14:35.114752+0000","last_fullsized":"2024-09-10T23:14:35.114752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.121173+0000","last_change":"2024-09-10T23:14:35.121173+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.121173+0000","last_undegraded":"2024-09-10T23:14:35.121173+0000","last_fullsized":"2024-09-10T23:14:35.121173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114303+0000","last_change":"2024-09-10T23:14:35.114303+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114303+0000","last_undegraded":"2024-09-10T23:14:35.114303+0000","last_fullsized":"2024-09-10T23:14:35.114303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119780+0000","last_change":"2024-09-10T23:14:35.119780+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119780+0000","last_undegraded":"2024-09-10T23:14:35.119780+0000","last_fullsized":"2024-09-10T23:14:35.119780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118752+0000","last_change":"2024-09-10T23:14:35.118752+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118752+0000","last_undegraded":"2024-09-10T23:14:35.118752+0000","last_fullsized":"2024-09-10T23:14:35.118752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.120489+0000","last_change":"2024-09-10T23:14:35.120489+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.120489+0000","last_undegraded":"2024-09-10T23:14:35.120489+0000","last_fullsized":"2024-09-10T23:14:35.120489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119325+0000","last_change":"2024-09-10T23:14:35.119325+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119325+0000","last_undegraded":"2024-09-10T23:14:35.119325+0000","last_fullsized":"2024-09-10T23:14:35.119325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116908+0000","last_change":"2024-09-10T23:14:35.116908+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116908+0000","last_undegraded":"2024-09-10T23:14:35.116908+0000","last_fullsized":"2024-09-10T23:14:35.116908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.113772+0000","last_change":"2024-09-10T23:14:35.113772+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.113772+0000","last_undegraded":"2024-09-10T23:14:35.113772+0000","last_fullsized":"2024-09-10T23:14:35.113772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118648+0000","last_change":"2024-09-10T23:14:35.118648+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118648+0000","last_undegraded":"2024-09-10T23:14:35.118648+0000","last_fullsized":"2024-09-10T23:14:35.118648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.120339+0000","last_change":"2024-09-10T23:14:35.120339+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.120339+0000","last_undegraded":"2024-09-10T23:14:35.120339+0000","last_fullsized":"2024-09-10T23:14:35.120339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114736+0000","last_change":"2024-09-10T23:14:35.114736+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114736+0000","last_undegraded":"2024-09-10T23:14:35.114736+0000","last_fullsized":"2024-09-10T23:14:35.114736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112881+0000","last_change":"2024-09-10T23:14:35.112881+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112881+0000","last_undegraded":"2024-09-10T23:14:35.112881+0000","last_fullsized":"2024-09-10T23:14:35.112881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116381+0000","last_change":"2024-09-10T23:14:35.116381+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116381+0000","last_undegraded":"2024-09-10T23:14:35.116381+0000","last_fullsized":"2024-09-10T23:14:35.116381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116639+0000","last_change":"2024-09-10T23:14:35.116639+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116639+0000","last_undegraded":"2024-09-10T23:14:35.116639+0000","last_fullsized":"2024-09-10T23:14:35.116639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118565+0000","last_change":"2024-09-10T23:14:35.118565+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118565+0000","last_undegraded":"2024-09-10T23:14:35.118565+0000","last_fullsized":"2024-09-10T23:14:35.118565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.113823+0000","last_change":"2024-09-10T23:14:35.113823+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.113823+0000","last_undegraded":"2024-09-10T23:14:35.113823+0000","last_fullsized":"2024-09-10T23:14:35.113823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118054+0000","last_change":"2024-09-10T23:14:35.118054+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118054+0000","last_undegraded":"2024-09-10T23:14:35.118054+0000","last_fullsized":"2024-09-10T23:14:35.118054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114301+0000","last_change":"2024-09-10T23:14:35.114301+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114301+0000","last_undegraded":"2024-09-10T23:14:35.114301+0000","last_fullsized":"2024-09-10T23:14:35.114301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117993+0000","last_change":"2024-09-10T23:14:35.117993+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117993+0000","last_undegraded":"2024-09-10T23:14:35.117993+0000","last_fullsized":"2024-09-10T23:14:35.117993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118808+0000","last_change":"2024-09-10T23:14:35.118808+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118808+0000","last_undegraded":"2024-09-10T23:14:35.118808+0000","last_fullsized":"2024-09-10T23:14:35.118808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119174+0000","last_change":"2024-09-10T23:14:35.119174+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119174+0000","last_undegraded":"2024-09-10T23:14:35.119174+0000","last_fullsized":"2024-09-10T23:14:35.119174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116417+0000","last_change":"2024-09-10T23:14:35.116417+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116417+0000","last_undegraded":"2024-09-10T23:14:35.116417+0000","last_fullsized":"2024-09-10T23:14:35.116417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112934+0000","last_change":"2024-09-10T23:14:35.112934+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112934+0000","last_undegraded":"2024-09-10T23:14:35.112934+0000","last_fullsized":"2024-09-10T23:14:35.112934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117857+0000","last_change":"2024-09-10T23:14:35.117857+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117857+0000","last_undegraded":"2024-09-10T23:14:35.117857+0000","last_fullsized":"2024-09-10T23:14:35.117857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.120966+0000","last_change":"2024-09-10T23:14:35.120966+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.120966+0000","last_undegraded":"2024-09-10T23:14:35.120966+0000","last_fullsized":"2024-09-10T23:14:35.120966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112514+0000","last_change":"2024-09-10T23:14:35.112514+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112514+0000","last_undegraded":"2024-09-10T23:14:35.112514+0000","last_fullsized":"2024-09-10T23:14:35.112514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132131+0000","last_change":"2024-09-10T23:14:35.127806+0000","last_active":"2024-09-10T23:14:35.132131+0000","last_peered":"2024-09-10T23:14:35.132131+0000","last_clean":"2024-09-10T23:14:35.132131+0000","last_became_active":"2024-09-10T23:14:35.127548+0000","last_became_peered":"2024-09-10T23:14:35.127548+0000","last_unstale":"2024-09-10T23:14:35.132131+0000","last_undegraded":"2024-09-10T23:14:35.132131+0000","last_fullsized":"2024-09-10T23:14:35.132131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:15.617243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.129705+0000","last_change":"2024-09-10T23:14:35.125689+0000","last_active":"2024-09-10T23:14:35.129705+0000","last_peered":"2024-09-10T23:14:35.129705+0000","last_clean":"2024-09-10T23:14:35.129705+0000","last_became_active":"2024-09-10T23:14:35.124148+0000","last_became_peered":"2024-09-10T23:14:35.124148+0000","last_unstale":"2024-09-10T23:14:35.129705+0000","last_undegraded":"2024-09-10T23:14:35.129705+0000","last_fullsized":"2024-09-10T23:14:35.129705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:29.882694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.134954+0000","last_change":"2024-09-10T23:14:35.130875+0000","last_active":"2024-09-10T23:14:35.134954+0000","last_peered":"2024-09-10T23:14:35.134954+0000","last_clean":"2024-09-10T23:14:35.134954+0000","last_became_active":"2024-09-10T23:14:35.130552+0000","last_became_peered":"2024-09-10T23:14:35.130552+0000","last_unstale":"2024-09-10T23:14:35.134954+0000","last_undegraded":"2024-09-10T23:14:35.134954+0000","last_fullsized":"2024-09-10T23:14:35.134954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:43.933909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118087+0000","last_change":"2024-09-10T23:14:35.118087+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118087+0000","last_undegraded":"2024-09-10T23:14:35.118087+0000","last_fullsized":"2024-09-10T23:14:35.118087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.125858+0000","last_change":"2024-09-10T23:14:35.123317+0000","last_active":"2024-09-10T23:14:35.125858+0000","last_peered":"2024-09-10T23:14:35.125858+0000","last_clean":"2024-09-10T23:14:35.125858+0000","last_became_active":"2024-09-10T23:14:35.123043+0000","last_became_peered":"2024-09-10T23:14:35.123043+0000","last_unstale":"2024-09-10T23:14:35.125858+0000","last_undegraded":"2024-09-10T23:14:35.125858+0000","last_fullsized":"2024-09-10T23:14:35.125858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:17.769511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119087+0000","last_change":"2024-09-10T23:14:35.119087+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119087+0000","last_undegraded":"2024-09-10T23:14:35.119087+0000","last_fullsized":"2024-09-10T23:14:35.119087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132771+0000","last_change":"2024-09-10T23:14:35.129118+0000","last_active":"2024-09-10T23:14:35.132771+0000","last_peered":"2024-09-10T23:14:35.132771+0000","last_clean":"2024-09-10T23:14:35.132771+0000","last_became_active":"2024-09-10T23:14:35.128858+0000","last_became_peered":"2024-09-10T23:14:35.128858+0000","last_unstale":"2024-09-10T23:14:35.132771+0000","last_undegraded":"2024-09-10T23:14:35.132771+0000","last_fullsized":"2024-09-10T23:14:35.132771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:52.160694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112583+0000","last_change":"2024-09-10T23:14:35.112583+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112583+0000","last_undegraded":"2024-09-10T23:14:35.112583+0000","last_fullsized":"2024-09-10T23:14:35.112583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.131974+0000","last_change":"2024-09-10T23:14:35.130807+0000","last_active":"2024-09-10T23:14:35.131974+0000","last_peered":"2024-09-10T23:14:35.131974+0000","last_clean":"2024-09-10T23:14:35.131974+0000","last_became_active":"2024-09-10T23:14:35.130541+0000","last_became_peered":"2024-09-10T23:14:35.130541+0000","last_unstale":"2024-09-10T23:14:35.131974+0000","last_undegraded":"2024-09-10T23:14:35.131974+0000","last_fullsized":"2024-09-10T23:14:35.131974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:52.160694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.126183+0000","last_change":"2024-09-10T23:14:35.122724+0000","last_active":"2024-09-10T23:14:35.126183+0000","last_peered":"2024-09-10T23:14:35.126183+0000","last_clean":"2024-09-10T23:14:35.126183+0000","last_became_active":"2024-09-10T23:14:35.119910+0000","last_became_peered":"2024-09-10T23:14:35.119910+0000","last_unstale":"2024-09-10T23:14:35.126183+0000","last_undegraded":"2024-09-10T23:14:35.126183+0000","last_fullsized":"2024-09-10T23:14:35.126183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:37.291436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112157+0000","last_change":"2024-09-10T23:14:35.112157+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112157+0000","last_undegraded":"2024-09-10T23:14:35.112157+0000","last_fullsized":"2024-09-10T23:14:35.112157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130737+0000","last_change":"2024-09-10T23:14:35.127319+0000","last_active":"2024-09-10T23:14:35.130737+0000","last_peered":"2024-09-10T23:14:35.130737+0000","last_clean":"2024-09-10T23:14:35.130737+0000","last_became_active":"2024-09-10T23:14:35.127042+0000","last_became_peered":"2024-09-10T23:14:35.127042+0000","last_unstale":"2024-09-10T23:14:35.130737+0000","last_undegraded":"2024-09-10T23:14:35.130737+0000","last_fullsized":"2024-09-10T23:14:35.130737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:17.769511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117847+0000","last_change":"2024-09-10T23:14:35.117847+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117847+0000","last_undegraded":"2024-09-10T23:14:35.117847+0000","last_fullsized":"2024-09-10T23:14:35.117847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:34.104312+0000","last_change":"2024-09-10T23:14:34.104312+0000","last_active":"2024-09-10T23:14:34.104312+0000","last_peered":"2024-09-10T23:14:34.104312+0000","last_clean":"2024-09-10T23:14:34.104312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:34.104312+0000","last_undegraded":"2024-09-10T23:14:34.104312+0000","last_fullsized":"2024-09-10T23:14:34.104312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132004+0000","last_change":"2024-09-10T23:14:35.130442+0000","last_active":"2024-09-10T23:14:35.132004+0000","last_peered":"2024-09-10T23:14:35.132004+0000","last_clean":"2024-09-10T23:14:35.132004+0000","last_became_active":"2024-09-10T23:14:35.130131+0000","last_became_peered":"2024-09-10T23:14:35.130131+0000","last_unstale":"2024-09-10T23:14:35.132004+0000","last_undegraded":"2024-09-10T23:14:35.132004+0000","last_fullsized":"2024-09-10T23:14:35.132004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:44.033195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119183+0000","last_change":"2024-09-10T23:14:35.119183+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119183+0000","last_undegraded":"2024-09-10T23:14:35.119183+0000","last_fullsized":"2024-09-10T23:14:35.119183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132788+0000","last_change":"2024-09-10T23:14:35.129215+0000","last_active":"2024-09-10T23:14:35.132788+0000","last_peered":"2024-09-10T23:14:35.132788+0000","last_clean":"2024-09-10T23:14:35.132788+0000","last_became_active":"2024-09-10T23:14:35.128170+0000","last_became_peered":"2024-09-10T23:14:35.128170+0000","last_unstale":"2024-09-10T23:14:35.132788+0000","last_undegraded":"2024-09-10T23:14:35.132788+0000","last_fullsized":"2024-09-10T23:14:35.132788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:44.033195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.120423+0000","last_change":"2024-09-10T23:14:35.120423+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.120423+0000","last_undegraded":"2024-09-10T23:14:35.120423+0000","last_fullsized":"2024-09-10T23:14:35.120423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132313+0000","last_change":"2024-09-10T23:14:35.127072+0000","last_active":"2024-09-10T23:14:35.132313+0000","last_peered":"2024-09-10T23:14:35.132313+0000","last_clean":"2024-09-10T23:14:35.132313+0000","last_became_active":"2024-09-10T23:14:35.126776+0000","last_became_peered":"2024-09-10T23:14:35.126776+0000","last_unstale":"2024-09-10T23:14:35.132313+0000","last_undegraded":"2024-09-10T23:14:35.132313+0000","last_fullsized":"2024-09-10T23:14:35.132313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:17.769511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118860+0000","last_change":"2024-09-10T23:14:35.118860+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118860+0000","last_undegraded":"2024-09-10T23:14:35.118860+0000","last_fullsized":"2024-09-10T23:14:35.118860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132364+0000","last_change":"2024-09-10T23:14:35.130472+0000","last_active":"2024-09-10T23:14:35.132364+0000","last_peered":"2024-09-10T23:14:35.132364+0000","last_clean":"2024-09-10T23:14:35.132364+0000","last_became_active":"2024-09-10T23:14:35.130164+0000","last_became_peered":"2024-09-10T23:14:35.130164+0000","last_unstale":"2024-09-10T23:14:35.132364+0000","last_undegraded":"2024-09-10T23:14:35.132364+0000","last_fullsized":"2024-09-10T23:14:35.132364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:15.617243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117999+0000","last_change":"2024-09-10T23:14:35.117999+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117999+0000","last_undegraded":"2024-09-10T23:14:35.117999+0000","last_fullsized":"2024-09-10T23:14:35.117999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.135053+0000","last_change":"2024-09-10T23:14:35.130891+0000","last_active":"2024-09-10T23:14:35.135053+0000","last_peered":"2024-09-10T23:14:35.135053+0000","last_clean":"2024-09-10T23:14:35.135053+0000","last_became_active":"2024-09-10T23:14:35.130654+0000","last_became_peered":"2024-09-10T23:14:35.130654+0000","last_unstale":"2024-09-10T23:14:35.135053+0000","last_undegraded":"2024-09-10T23:14:35.135053+0000","last_fullsized":"2024-09-10T23:14:35.135053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:38.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118098+0000","last_change":"2024-09-10T23:14:35.118098+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118098+0000","last_undegraded":"2024-09-10T23:14:35.118098+0000","last_fullsized":"2024-09-10T23:14:35.118098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.126166+0000","last_change":"2024-09-10T23:14:35.121691+0000","last_active":"2024-09-10T23:14:35.126166+0000","last_peered":"2024-09-10T23:14:35.126166+0000","last_clean":"2024-09-10T23:14:35.126166+0000","last_became_active":"2024-09-10T23:14:35.121391+0000","last_became_peered":"2024-09-10T23:14:35.121391+0000","last_unstale":"2024-09-10T23:14:35.126166+0000","last_undegraded":"2024-09-10T23:14:35.126166+0000","last_fullsized":"2024-09-10T23:14:35.126166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:15.617243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.113064+0000","last_change":"2024-09-10T23:14:35.113064+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.113064+0000","last_undegraded":"2024-09-10T23:14:35.113064+0000","last_fullsized":"2024-09-10T23:14:35.113064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132291+0000","last_change":"2024-09-10T23:14:35.126188+0000","last_active":"2024-09-10T23:14:35.132291+0000","last_peered":"2024-09-10T23:14:35.132291+0000","last_clean":"2024-09-10T23:14:35.132291+0000","last_became_active":"2024-09-10T23:14:35.125868+0000","last_became_peered":"2024-09-10T23:14:35.125868+0000","last_unstale":"2024-09-10T23:14:35.132291+0000","last_undegraded":"2024-09-10T23:14:35.132291+0000","last_fullsized":"2024-09-10T23:14:35.132291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:29.882694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117249+0000","last_change":"2024-09-10T23:14:35.117249+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117249+0000","last_undegraded":"2024-09-10T23:14:35.117249+0000","last_fullsized":"2024-09-10T23:14:35.117249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":107,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.124244+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:14:35.124244+0000","last_peered":"2024-09-10T23:14:35.124244+0000","last_clean":"2024-09-10T23:14:35.124244+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:14:35.124244+0000","last_undegraded":"2024-09-10T23:14:35.124244+0000","last_fullsized":"2024-09-10T23:14:35.124244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.128004+0000","last_change":"2024-09-10T23:14:35.126656+0000","last_active":"2024-09-10T23:14:35.128004+0000","last_peered":"2024-09-10T23:14:35.128004+0000","last_clean":"2024-09-10T23:14:35.128004+0000","last_became_active":"2024-09-10T23:14:35.126289+0000","last_became_peered":"2024-09-10T23:14:35.126289+0000","last_unstale":"2024-09-10T23:14:35.128004+0000","last_undegraded":"2024-09-10T23:14:35.128004+0000","last_fullsized":"2024-09-10T23:14:35.128004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:30.470000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119084+0000","last_change":"2024-09-10T23:14:35.119084+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119084+0000","last_undegraded":"2024-09-10T23:14:35.119084+0000","last_fullsized":"2024-09-10T23:14:35.119084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.136395+0000","last_change":"2024-09-10T23:14:35.132667+0000","last_active":"2024-09-10T23:14:35.136395+0000","last_peered":"2024-09-10T23:14:35.136395+0000","last_clean":"2024-09-10T23:14:35.136395+0000","last_became_active":"2024-09-10T23:14:35.132330+0000","last_became_peered":"2024-09-10T23:14:35.132330+0000","last_unstale":"2024-09-10T23:14:35.136395+0000","last_undegraded":"2024-09-10T23:14:35.136395+0000","last_fullsized":"2024-09-10T23:14:35.136395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:44.244654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.135063+0000","last_change":"2024-09-10T23:14:35.130254+0000","last_active":"2024-09-10T23:14:35.135063+0000","last_peered":"2024-09-10T23:14:35.135063+0000","last_clean":"2024-09-10T23:14:35.135063+0000","last_became_active":"2024-09-10T23:14:35.129994+0000","last_became_peered":"2024-09-10T23:14:35.129994+0000","last_unstale":"2024-09-10T23:14:35.135063+0000","last_undegraded":"2024-09-10T23:14:35.135063+0000","last_fullsized":"2024-09-10T23:14:35.135063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:43.933909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118747+0000","last_change":"2024-09-10T23:14:35.118747+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118747+0000","last_undegraded":"2024-09-10T23:14:35.118747+0000","last_fullsized":"2024-09-10T23:14:35.118747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.118725+0000","last_change":"2024-09-10T23:14:35.116348+0000","last_active":"2024-09-10T23:14:35.118725+0000","last_peered":"2024-09-10T23:14:35.118725+0000","last_clean":"2024-09-10T23:14:35.118725+0000","last_became_active":"2024-09-10T23:14:35.116063+0000","last_became_peered":"2024-09-10T23:14:35.116063+0000","last_unstale":"2024-09-10T23:14:35.118725+0000","last_undegraded":"2024-09-10T23:14:35.118725+0000","last_fullsized":"2024-09-10T23:14:35.118725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:29.882694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112047+0000","last_change":"2024-09-10T23:14:35.112047+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112047+0000","last_undegraded":"2024-09-10T23:14:35.112047+0000","last_fullsized":"2024-09-10T23:14:35.112047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130141+0000","last_change":"2024-09-10T23:14:35.123920+0000","last_active":"2024-09-10T23:14:35.130141+0000","last_peered":"2024-09-10T23:14:35.130141+0000","last_clean":"2024-09-10T23:14:35.130141+0000","last_became_active":"2024-09-10T23:14:35.123644+0000","last_became_peered":"2024-09-10T23:14:35.123644+0000","last_unstale":"2024-09-10T23:14:35.130141+0000","last_undegraded":"2024-09-10T23:14:35.130141+0000","last_fullsized":"2024-09-10T23:14:35.130141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:43.933909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112063+0000","last_change":"2024-09-10T23:14:35.112063+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112063+0000","last_undegraded":"2024-09-10T23:14:35.112063+0000","last_fullsized":"2024-09-10T23:14:35.112063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.139207+0000","last_change":"2024-09-10T23:14:35.133489+0000","last_active":"2024-09-10T23:14:35.139207+0000","last_peered":"2024-09-10T23:14:35.139207+0000","last_clean":"2024-09-10T23:14:35.139207+0000","last_became_active":"2024-09-10T23:14:35.133189+0000","last_became_peered":"2024-09-10T23:14:35.133189+0000","last_unstale":"2024-09-10T23:14:35.139207+0000","last_undegraded":"2024-09-10T23:14:35.139207+0000","last_fullsized":"2024-09-10T23:14:35.139207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:26.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117391+0000","last_change":"2024-09-10T23:14:35.117391+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117391+0000","last_undegraded":"2024-09-10T23:14:35.117391+0000","last_fullsized":"2024-09-10T23:14:35.117391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.135146+0000","last_change":"2024-09-10T23:14:35.130762+0000","last_active":"2024-09-10T23:14:35.135146+0000","last_peered":"2024-09-10T23:14:35.135146+0000","last_clean":"2024-09-10T23:14:35.135146+0000","last_became_active":"2024-09-10T23:14:35.130502+0000","last_became_peered":"2024-09-10T23:14:35.130502+0000","last_unstale":"2024-09-10T23:14:35.135146+0000","last_undegraded":"2024-09-10T23:14:35.135146+0000","last_fullsized":"2024-09-10T23:14:35.135146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116558+0000","last_change":"2024-09-10T23:14:35.116558+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116558+0000","last_undegraded":"2024-09-10T23:14:35.116558+0000","last_fullsized":"2024-09-10T23:14:35.116558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.129905+0000","last_change":"2024-09-10T23:14:35.128484+0000","last_active":"2024-09-10T23:14:35.129905+0000","last_peered":"2024-09-10T23:14:35.129905+0000","last_clean":"2024-09-10T23:14:35.129905+0000","last_became_active":"2024-09-10T23:14:35.127877+0000","last_became_peered":"2024-09-10T23:14:35.127877+0000","last_unstale":"2024-09-10T23:14:35.129905+0000","last_undegraded":"2024-09-10T23:14:35.129905+0000","last_fullsized":"2024-09-10T23:14:35.129905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:30.470000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.139207+0000","last_change":"2024-09-10T23:14:35.133467+0000","last_active":"2024-09-10T23:14:35.139207+0000","last_peered":"2024-09-10T23:14:35.139207+0000","last_clean":"2024-09-10T23:14:35.139207+0000","last_became_active":"2024-09-10T23:14:35.133163+0000","last_became_peered":"2024-09-10T23:14:35.133163+0000","last_unstale":"2024-09-10T23:14:35.139207+0000","last_undegraded":"2024-09-10T23:14:35.139207+0000","last_fullsized":"2024-09-10T23:14:35.139207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:48.848197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112226+0000","last_change":"2024-09-10T23:14:35.112226+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112226+0000","last_undegraded":"2024-09-10T23:14:35.112226+0000","last_fullsized":"2024-09-10T23:14:35.112226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130194+0000","last_change":"2024-09-10T23:14:35.125619+0000","last_active":"2024-09-10T23:14:35.130194+0000","last_peered":"2024-09-10T23:14:35.130194+0000","last_clean":"2024-09-10T23:14:35.130194+0000","last_became_active":"2024-09-10T23:14:35.125258+0000","last_became_peered":"2024-09-10T23:14:35.125258+0000","last_unstale":"2024-09-10T23:14:35.130194+0000","last_undegraded":"2024-09-10T23:14:35.130194+0000","last_fullsized":"2024-09-10T23:14:35.130194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:00.433782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117658+0000","last_change":"2024-09-10T23:14:35.117658+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117658+0000","last_undegraded":"2024-09-10T23:14:35.117658+0000","last_fullsized":"2024-09-10T23:14:35.117658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130047+0000","last_change":"2024-09-10T23:14:35.124311+0000","last_active":"2024-09-10T23:14:35.130047+0000","last_peered":"2024-09-10T23:14:35.130047+0000","last_clean":"2024-09-10T23:14:35.130047+0000","last_became_active":"2024-09-10T23:14:35.124054+0000","last_became_peered":"2024-09-10T23:14:35.124054+0000","last_unstale":"2024-09-10T23:14:35.130047+0000","last_undegraded":"2024-09-10T23:14:35.130047+0000","last_fullsized":"2024-09-10T23:14:35.130047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:38.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116580+0000","last_change":"2024-09-10T23:14:35.116580+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116580+0000","last_undegraded":"2024-09-10T23:14:35.116580+0000","last_fullsized":"2024-09-10T23:14:35.116580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130425+0000","last_change":"2024-09-10T23:14:35.128785+0000","last_active":"2024-09-10T23:14:35.130425+0000","last_peered":"2024-09-10T23:14:35.130425+0000","last_clean":"2024-09-10T23:14:35.130425+0000","last_became_active":"2024-09-10T23:14:35.128523+0000","last_became_peered":"2024-09-10T23:14:35.128523+0000","last_unstale":"2024-09-10T23:14:35.130425+0000","last_undegraded":"2024-09-10T23:14:35.130425+0000","last_fullsized":"2024-09-10T23:14:35.130425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:38.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117405+0000","last_change":"2024-09-10T23:14:35.117405+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117405+0000","last_undegraded":"2024-09-10T23:14:35.117405+0000","last_fullsized":"2024-09-10T23:14:35.117405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112932+0000","last_change":"2024-09-10T23:14:35.112932+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112932+0000","last_undegraded":"2024-09-10T23:14:35.112932+0000","last_fullsized":"2024-09-10T23:14:35.112932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130675+0000","last_change":"2024-09-10T23:14:35.128918+0000","last_active":"2024-09-10T23:14:35.130675+0000","last_peered":"2024-09-10T23:14:35.130675+0000","last_clean":"2024-09-10T23:14:35.130675+0000","last_became_active":"2024-09-10T23:14:35.128646+0000","last_became_peered":"2024-09-10T23:14:35.128646+0000","last_unstale":"2024-09-10T23:14:35.130675+0000","last_undegraded":"2024-09-10T23:14:35.130675+0000","last_fullsized":"2024-09-10T23:14:35.130675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:00.433782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114104+0000","last_change":"2024-09-10T23:14:35.114104+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114104+0000","last_undegraded":"2024-09-10T23:14:35.114104+0000","last_fullsized":"2024-09-10T23:14:35.114104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132931+0000","last_change":"2024-09-10T23:14:35.131443+0000","last_active":"2024-09-10T23:14:35.132931+0000","last_peered":"2024-09-10T23:14:35.132931+0000","last_clean":"2024-09-10T23:14:35.132931+0000","last_became_active":"2024-09-10T23:14:35.131123+0000","last_became_peered":"2024-09-10T23:14:35.131123+0000","last_unstale":"2024-09-10T23:14:35.132931+0000","last_undegraded":"2024-09-10T23:14:35.132931+0000","last_fullsized":"2024-09-10T23:14:35.132931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:35.106228+0000","last_change":"2024-09-10T23:14:35.106228+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.106228+0000","last_undegraded":"2024-09-10T23:14:35.106228+0000","last_fullsized":"2024-09-10T23:14:35.106228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.134892+0000","last_change":"2024-09-10T23:14:35.129994+0000","last_active":"2024-09-10T23:14:35.134892+0000","last_peered":"2024-09-10T23:14:35.134892+0000","last_clean":"2024-09-10T23:14:35.134892+0000","last_became_active":"2024-09-10T23:14:35.129609+0000","last_became_peered":"2024-09-10T23:14:35.129609+0000","last_unstale":"2024-09-10T23:14:35.134892+0000","last_undegraded":"2024-09-10T23:14:35.134892+0000","last_fullsized":"2024-09-10T23:14:35.134892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:37.291436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119352+0000","last_change":"2024-09-10T23:14:35.119352+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119352+0000","last_undegraded":"2024-09-10T23:14:35.119352+0000","last_fullsized":"2024-09-10T23:14:35.119352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:14:34.104312+0000","last_change":"2024-09-10T23:14:34.104312+0000","last_active":"2024-09-10T23:14:34.104312+0000","last_peered":"2024-09-10T23:14:34.104312+0000","last_clean":"2024-09-10T23:14:34.104312+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:34.104312+0000","last_undegraded":"2024-09-10T23:14:34.104312+0000","last_fullsized":"2024-09-10T23:14:34.104312+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":778240,"data_stored":646436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:14:40.440 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:14:40.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.576+0000 7f1e804b6640 1 -- 172.21.15.90:0/184721285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e7806d240 msgr2=0x7f1e780d0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:40.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.576+0000 7f1e804b6640 1 --2- 172.21.15.90:0/184721285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e7806d240 0x7f1e780d0840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e70005fd0 tx=0x7f1e7002a970 comp rx=0 tx=0).stop 2024-09-10T23:14:40.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.577+0000 7f1e804b6640 1 -- 172.21.15.90:0/184721285 shutdown_connections 2024-09-10T23:14:40.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.577+0000 7f1e804b6640 1 --2- 172.21.15.90:0/184721285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e7806d240 0x7f1e780d0840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.577+0000 7f1e804b6640 1 --2- 172.21.15.90:0/184721285 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e7815bdb0 0x7f1e78073a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.577+0000 7f1e804b6640 1 -- 172.21.15.90:0/184721285 >> 172.21.15.90:0/184721285 conn(0x7f1e780cd960 msgr2=0x7f1e780cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:40.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.577+0000 7f1e804b6640 1 -- 172.21.15.90:0/184721285 shutdown_connections 2024-09-10T23:14:40.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.577+0000 7f1e804b6640 1 -- 172.21.15.90:0/184721285 wait complete. 2024-09-10T23:14:40.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.578+0000 7f1e804b6640 1 Processor -- start 2024-09-10T23:14:40.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.578+0000 7f1e804b6640 1 -- start start 2024-09-10T23:14:40.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e804b6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e7806d240 0x7f1e780b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:40.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e804b6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e780d0400 0x7f1e780c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:40.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e804b6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e7815bdb0 0x7f1e780b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:40.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e804b6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7815ffb0 con 0x7f1e7815bdb0 2024-09-10T23:14:40.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e804b6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7815fe30 con 0x7f1e780d0400 2024-09-10T23:14:40.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e804b6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1e78160130 con 0x7f1e7806d240 2024-09-10T23:14:40.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e7ea53640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e7815bdb0 0x7f1e780b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:40.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e7ea53640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e7815bdb0 0x7f1e780b2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50282/0 (socket says 172.21.15.90:50282) 2024-09-10T23:14:40.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e7ea53640 1 -- 172.21.15.90:0/527929594 learned_addr learned my addr 172.21.15.90:0/527929594 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:40.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e7e252640 1 --2- 172.21.15.90:0/527929594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e7806d240 0x7f1e780b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:40.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e7da51640 1 --2- 172.21.15.90:0/527929594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e780d0400 0x7f1e780c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:40.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e7ea53640 1 -- 172.21.15.90:0/527929594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e7806d240 msgr2=0x7f1e780b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:40.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e7ea53640 1 --2- 172.21.15.90:0/527929594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e7806d240 0x7f1e780b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e7ea53640 1 -- 172.21.15.90:0/527929594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e780d0400 msgr2=0x7f1e780c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:40.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e7ea53640 1 --2- 172.21.15.90:0/527929594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e780d0400 0x7f1e780c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e7ea53640 1 -- 172.21.15.90:0/527929594 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e780b1a30 con 0x7f1e7815bdb0 2024-09-10T23:14:40.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e7ea53640 1 --2- 172.21.15.90:0/527929594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e7815bdb0 0x7f1e780b2ef0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1e7002af30 tx=0x7f1e70003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:40.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e6effd640 1 -- 172.21.15.90:0/527929594 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e70034070 con 0x7f1e7815bdb0 2024-09-10T23:14:40.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e6effd640 1 -- 172.21.15.90:0/527929594 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e70004640 con 0x7f1e7815bdb0 2024-09-10T23:14:40.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e804b6640 1 -- 172.21.15.90:0/527929594 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e780b1750 con 0x7f1e7815bdb0 2024-09-10T23:14:40.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e6effd640 1 -- 172.21.15.90:0/527929594 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e700446a0 con 0x7f1e7815bdb0 2024-09-10T23:14:40.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.579+0000 7f1e804b6640 1 -- 172.21.15.90:0/527929594 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e780b29d0 con 0x7f1e7815bdb0 2024-09-10T23:14:40.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.580+0000 7f1e804b6640 1 -- 172.21.15.90:0/527929594 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e781605e0 con 0x7f1e7815bdb0 2024-09-10T23:14:40.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.581+0000 7f1e6effd640 1 -- 172.21.15.90:0/527929594 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1e7004c070 con 0x7f1e7815bdb0 2024-09-10T23:14:40.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.581+0000 7f1e6effd640 1 --2- 172.21.15.90:0/527929594 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1e5c077f70 0x7f1e5c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:40.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.581+0000 7f1e6effd640 1 -- 172.21.15.90:0/527929594 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1e700bb830 con 0x7f1e7815bdb0 2024-09-10T23:14:40.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.581+0000 7f1e7e252640 1 --2- 172.21.15.90:0/527929594 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1e5c077f70 0x7f1e5c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:40.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.582+0000 7f1e7e252640 1 --2- 172.21.15.90:0/527929594 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1e5c077f70 0x7f1e5c07a430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e74005fd0 tx=0x7f1e74005850 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:40.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.585+0000 7f1e6effd640 1 -- 172.21.15.90:0/527929594 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1e70049060 con 0x7f1e7815bdb0 2024-09-10T23:14:40.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.759+0000 7f1e804b6640 1 -- 172.21.15.90:0/527929594 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e780b2370 con 0x7f1e5c077f70 2024-09-10T23:14:40.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.763+0000 7f1e6effd640 1 -- 172.21.15.90:0/527929594 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247477 (secure 0 0 0) 0x7f1e780b2370 con 0x7f1e5c077f70 2024-09-10T23:14:40.767 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:40.768 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:14:40.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.766+0000 7f1e804b6640 1 -- 172.21.15.90:0/527929594 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1e5c077f70 msgr2=0x7f1e5c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:40.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.766+0000 7f1e804b6640 1 --2- 172.21.15.90:0/527929594 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1e5c077f70 0x7f1e5c07a430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e74005fd0 tx=0x7f1e74005850 comp rx=0 tx=0).stop 2024-09-10T23:14:40.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.766+0000 7f1e804b6640 1 -- 172.21.15.90:0/527929594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e7815bdb0 msgr2=0x7f1e780b2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:40.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.766+0000 7f1e804b6640 1 --2- 172.21.15.90:0/527929594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e7815bdb0 0x7f1e780b2ef0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1e7002af30 tx=0x7f1e70003f90 comp rx=0 tx=0).stop 2024-09-10T23:14:40.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.766+0000 7f1e804b6640 1 -- 172.21.15.90:0/527929594 shutdown_connections 2024-09-10T23:14:40.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.766+0000 7f1e804b6640 1 --2- 172.21.15.90:0/527929594 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1e5c077f70 0x7f1e5c07a430 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.766+0000 7f1e804b6640 1 --2- 172.21.15.90:0/527929594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e780d0400 0x7f1e780c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.766+0000 7f1e804b6640 1 --2- 172.21.15.90:0/527929594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1e7815bdb0 0x7f1e780b2ef0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.766+0000 7f1e804b6640 1 --2- 172.21.15.90:0/527929594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e7806d240 0x7f1e780b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.766+0000 7f1e804b6640 1 -- 172.21.15.90:0/527929594 >> 172.21.15.90:0/527929594 conn(0x7f1e780cd960 msgr2=0x7f1e7815f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:40.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.766+0000 7f1e804b6640 1 -- 172.21.15.90:0/527929594 shutdown_connections 2024-09-10T23:14:40.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.766+0000 7f1e804b6640 1 -- 172.21.15.90:0/527929594 wait complete. 2024-09-10T23:14:40.778 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-10T23:14:40.433986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":24,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218972,"kb_used_data":2744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755748,"statfs":{"total":773094113280,"available":772869885952,"internally_reserved":0,"allocated":2809856,"data_stored":1695779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001270"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.121004+0000","last_change":"2024-09-10T23:14:35.121004+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.121004+0000","last_undegraded":"2024-09-10T23:14:35.121004+0000","last_fullsized":"2024-09-10T23:14:35.121004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.122569+0000","last_change":"2024-09-10T23:14:35.122569+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.122569+0000","last_undegraded":"2024-09-10T23:14:35.122569+0000","last_fullsized":"2024-09-10T23:14:35.122569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.153495+0000","last_change":"2024-09-10T23:14:36.148244+0000","last_active":"2024-09-10T23:14:36.153495+0000","last_peered":"2024-09-10T23:14:36.153495+0000","last_clean":"2024-09-10T23:14:36.153495+0000","last_became_active":"2024-09-10T23:14:36.147940+0000","last_became_peered":"2024-09-10T23:14:36.147940+0000","last_unstale":"2024-09-10T23:14:36.153495+0000","last_undegraded":"2024-09-10T23:14:36.153495+0000","last_fullsized":"2024-09-10T23:14:36.153495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:54.387324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114752+0000","last_change":"2024-09-10T23:14:35.114752+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114752+0000","last_undegraded":"2024-09-10T23:14:35.114752+0000","last_fullsized":"2024-09-10T23:14:35.114752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.121173+0000","last_change":"2024-09-10T23:14:35.121173+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.121173+0000","last_undegraded":"2024-09-10T23:14:35.121173+0000","last_fullsized":"2024-09-10T23:14:35.121173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114303+0000","last_change":"2024-09-10T23:14:35.114303+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114303+0000","last_undegraded":"2024-09-10T23:14:35.114303+0000","last_fullsized":"2024-09-10T23:14:35.114303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119780+0000","last_change":"2024-09-10T23:14:35.119780+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119780+0000","last_undegraded":"2024-09-10T23:14:35.119780+0000","last_fullsized":"2024-09-10T23:14:35.119780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118752+0000","last_change":"2024-09-10T23:14:35.118752+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118752+0000","last_undegraded":"2024-09-10T23:14:35.118752+0000","last_fullsized":"2024-09-10T23:14:35.118752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.120489+0000","last_change":"2024-09-10T23:14:35.120489+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.120489+0000","last_undegraded":"2024-09-10T23:14:35.120489+0000","last_fullsized":"2024-09-10T23:14:35.120489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119325+0000","last_change":"2024-09-10T23:14:35.119325+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119325+0000","last_undegraded":"2024-09-10T23:14:35.119325+0000","last_fullsized":"2024-09-10T23:14:35.119325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116908+0000","last_change":"2024-09-10T23:14:35.116908+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116908+0000","last_undegraded":"2024-09-10T23:14:35.116908+0000","last_fullsized":"2024-09-10T23:14:35.116908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.113772+0000","last_change":"2024-09-10T23:14:35.113772+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.113772+0000","last_undegraded":"2024-09-10T23:14:35.113772+0000","last_fullsized":"2024-09-10T23:14:35.113772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118648+0000","last_change":"2024-09-10T23:14:35.118648+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118648+0000","last_undegraded":"2024-09-10T23:14:35.118648+0000","last_fullsized":"2024-09-10T23:14:35.118648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.158955+0000","last_change":"2024-09-10T23:14:36.150886+0000","last_active":"2024-09-10T23:14:36.158955+0000","last_peered":"2024-09-10T23:14:36.158955+0000","last_clean":"2024-09-10T23:14:36.158955+0000","last_became_active":"2024-09-10T23:14:36.150523+0000","last_became_peered":"2024-09-10T23:14:36.150523+0000","last_unstale":"2024-09-10T23:14:36.158955+0000","last_undegraded":"2024-09-10T23:14:36.158955+0000","last_fullsized":"2024-09-10T23:14:36.158955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:35.034783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.120339+0000","last_change":"2024-09-10T23:14:35.120339+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.120339+0000","last_undegraded":"2024-09-10T23:14:35.120339+0000","last_fullsized":"2024-09-10T23:14:35.120339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114736+0000","last_change":"2024-09-10T23:14:35.114736+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114736+0000","last_undegraded":"2024-09-10T23:14:35.114736+0000","last_fullsized":"2024-09-10T23:14:35.114736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112881+0000","last_change":"2024-09-10T23:14:35.112881+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112881+0000","last_undegraded":"2024-09-10T23:14:35.112881+0000","last_fullsized":"2024-09-10T23:14:35.112881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116381+0000","last_change":"2024-09-10T23:14:35.116381+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116381+0000","last_undegraded":"2024-09-10T23:14:35.116381+0000","last_fullsized":"2024-09-10T23:14:35.116381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116639+0000","last_change":"2024-09-10T23:14:35.116639+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116639+0000","last_undegraded":"2024-09-10T23:14:35.116639+0000","last_fullsized":"2024-09-10T23:14:35.116639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118565+0000","last_change":"2024-09-10T23:14:35.118565+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118565+0000","last_undegraded":"2024-09-10T23:14:35.118565+0000","last_fullsized":"2024-09-10T23:14:35.118565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.162528+0000","last_change":"2024-09-10T23:14:36.157805+0000","last_active":"2024-09-10T23:14:36.162528+0000","last_peered":"2024-09-10T23:14:36.162528+0000","last_clean":"2024-09-10T23:14:36.162528+0000","last_became_active":"2024-09-10T23:14:36.157536+0000","last_became_peered":"2024-09-10T23:14:36.157536+0000","last_unstale":"2024-09-10T23:14:36.162528+0000","last_undegraded":"2024-09-10T23:14:36.162528+0000","last_fullsized":"2024-09-10T23:14:36.162528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:48.635981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.113823+0000","last_change":"2024-09-10T23:14:35.113823+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.113823+0000","last_undegraded":"2024-09-10T23:14:35.113823+0000","last_fullsized":"2024-09-10T23:14:35.113823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118054+0000","last_change":"2024-09-10T23:14:35.118054+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118054+0000","last_undegraded":"2024-09-10T23:14:35.118054+0000","last_fullsized":"2024-09-10T23:14:35.118054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114301+0000","last_change":"2024-09-10T23:14:35.114301+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114301+0000","last_undegraded":"2024-09-10T23:14:35.114301+0000","last_fullsized":"2024-09-10T23:14:35.114301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117993+0000","last_change":"2024-09-10T23:14:35.117993+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117993+0000","last_undegraded":"2024-09-10T23:14:35.117993+0000","last_fullsized":"2024-09-10T23:14:35.117993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118808+0000","last_change":"2024-09-10T23:14:35.118808+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118808+0000","last_undegraded":"2024-09-10T23:14:35.118808+0000","last_fullsized":"2024-09-10T23:14:35.118808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119174+0000","last_change":"2024-09-10T23:14:35.119174+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119174+0000","last_undegraded":"2024-09-10T23:14:35.119174+0000","last_fullsized":"2024-09-10T23:14:35.119174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116417+0000","last_change":"2024-09-10T23:14:35.116417+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116417+0000","last_undegraded":"2024-09-10T23:14:35.116417+0000","last_fullsized":"2024-09-10T23:14:35.116417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.159092+0000","last_change":"2024-09-10T23:14:36.152030+0000","last_active":"2024-09-10T23:14:36.159092+0000","last_peered":"2024-09-10T23:14:36.159092+0000","last_clean":"2024-09-10T23:14:36.159092+0000","last_became_active":"2024-09-10T23:14:36.151377+0000","last_became_peered":"2024-09-10T23:14:36.151377+0000","last_unstale":"2024-09-10T23:14:36.159092+0000","last_undegraded":"2024-09-10T23:14:36.159092+0000","last_fullsized":"2024-09-10T23:14:36.159092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:15.755571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112934+0000","last_change":"2024-09-10T23:14:35.112934+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112934+0000","last_undegraded":"2024-09-10T23:14:35.112934+0000","last_fullsized":"2024-09-10T23:14:35.112934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117857+0000","last_change":"2024-09-10T23:14:35.117857+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117857+0000","last_undegraded":"2024-09-10T23:14:35.117857+0000","last_fullsized":"2024-09-10T23:14:35.117857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.120966+0000","last_change":"2024-09-10T23:14:35.120966+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.120966+0000","last_undegraded":"2024-09-10T23:14:35.120966+0000","last_fullsized":"2024-09-10T23:14:35.120966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112514+0000","last_change":"2024-09-10T23:14:35.112514+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112514+0000","last_undegraded":"2024-09-10T23:14:35.112514+0000","last_fullsized":"2024-09-10T23:14:35.112514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132131+0000","last_change":"2024-09-10T23:14:35.127806+0000","last_active":"2024-09-10T23:14:35.132131+0000","last_peered":"2024-09-10T23:14:35.132131+0000","last_clean":"2024-09-10T23:14:35.132131+0000","last_became_active":"2024-09-10T23:14:35.127548+0000","last_became_peered":"2024-09-10T23:14:35.127548+0000","last_unstale":"2024-09-10T23:14:35.132131+0000","last_undegraded":"2024-09-10T23:14:35.132131+0000","last_fullsized":"2024-09-10T23:14:35.132131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:15.617243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.159066+0000","last_change":"2024-09-10T23:14:36.151022+0000","last_active":"2024-09-10T23:14:36.159066+0000","last_peered":"2024-09-10T23:14:36.159066+0000","last_clean":"2024-09-10T23:14:36.159066+0000","last_became_active":"2024-09-10T23:14:36.150753+0000","last_became_peered":"2024-09-10T23:14:36.150753+0000","last_unstale":"2024-09-10T23:14:36.159066+0000","last_undegraded":"2024-09-10T23:14:36.159066+0000","last_fullsized":"2024-09-10T23:14:36.159066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:53.550698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.129705+0000","last_change":"2024-09-10T23:14:35.125689+0000","last_active":"2024-09-10T23:14:35.129705+0000","last_peered":"2024-09-10T23:14:35.129705+0000","last_clean":"2024-09-10T23:14:35.129705+0000","last_became_active":"2024-09-10T23:14:35.124148+0000","last_became_peered":"2024-09-10T23:14:35.124148+0000","last_unstale":"2024-09-10T23:14:35.129705+0000","last_undegraded":"2024-09-10T23:14:35.129705+0000","last_fullsized":"2024-09-10T23:14:35.129705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:29.882694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.134954+0000","last_change":"2024-09-10T23:14:35.130875+0000","last_active":"2024-09-10T23:14:35.134954+0000","last_peered":"2024-09-10T23:14:35.134954+0000","last_clean":"2024-09-10T23:14:35.134954+0000","last_became_active":"2024-09-10T23:14:35.130552+0000","last_became_peered":"2024-09-10T23:14:35.130552+0000","last_unstale":"2024-09-10T23:14:35.134954+0000","last_undegraded":"2024-09-10T23:14:35.134954+0000","last_fullsized":"2024-09-10T23:14:35.134954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:43.933909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118087+0000","last_change":"2024-09-10T23:14:35.118087+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118087+0000","last_undegraded":"2024-09-10T23:14:35.118087+0000","last_fullsized":"2024-09-10T23:14:35.118087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.125858+0000","last_change":"2024-09-10T23:14:35.123317+0000","last_active":"2024-09-10T23:14:35.125858+0000","last_peered":"2024-09-10T23:14:35.125858+0000","last_clean":"2024-09-10T23:14:35.125858+0000","last_became_active":"2024-09-10T23:14:35.123043+0000","last_became_peered":"2024-09-10T23:14:35.123043+0000","last_unstale":"2024-09-10T23:14:35.125858+0000","last_undegraded":"2024-09-10T23:14:35.125858+0000","last_fullsized":"2024-09-10T23:14:35.125858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:17.769511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119087+0000","last_change":"2024-09-10T23:14:35.119087+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119087+0000","last_undegraded":"2024-09-10T23:14:35.119087+0000","last_fullsized":"2024-09-10T23:14:35.119087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132771+0000","last_change":"2024-09-10T23:14:35.129118+0000","last_active":"2024-09-10T23:14:35.132771+0000","last_peered":"2024-09-10T23:14:35.132771+0000","last_clean":"2024-09-10T23:14:35.132771+0000","last_became_active":"2024-09-10T23:14:35.128858+0000","last_became_peered":"2024-09-10T23:14:35.128858+0000","last_unstale":"2024-09-10T23:14:35.132771+0000","last_undegraded":"2024-09-10T23:14:35.132771+0000","last_fullsized":"2024-09-10T23:14:35.132771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:52.160694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112583+0000","last_change":"2024-09-10T23:14:35.112583+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112583+0000","last_undegraded":"2024-09-10T23:14:35.112583+0000","last_fullsized":"2024-09-10T23:14:35.112583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.131974+0000","last_change":"2024-09-10T23:14:35.130807+0000","last_active":"2024-09-10T23:14:35.131974+0000","last_peered":"2024-09-10T23:14:35.131974+0000","last_clean":"2024-09-10T23:14:35.131974+0000","last_became_active":"2024-09-10T23:14:35.130541+0000","last_became_peered":"2024-09-10T23:14:35.130541+0000","last_unstale":"2024-09-10T23:14:35.131974+0000","last_undegraded":"2024-09-10T23:14:35.131974+0000","last_fullsized":"2024-09-10T23:14:35.131974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:52.160694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.158106+0000","last_change":"2024-09-10T23:14:36.149079+0000","last_active":"2024-09-10T23:14:36.158106+0000","last_peered":"2024-09-10T23:14:36.158106+0000","last_clean":"2024-09-10T23:14:36.158106+0000","last_became_active":"2024-09-10T23:14:36.148726+0000","last_became_peered":"2024-09-10T23:14:36.148726+0000","last_unstale":"2024-09-10T23:14:36.158106+0000","last_undegraded":"2024-09-10T23:14:36.158106+0000","last_fullsized":"2024-09-10T23:14:36.158106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:14.162329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.126183+0000","last_change":"2024-09-10T23:14:35.122724+0000","last_active":"2024-09-10T23:14:35.126183+0000","last_peered":"2024-09-10T23:14:35.126183+0000","last_clean":"2024-09-10T23:14:35.126183+0000","last_became_active":"2024-09-10T23:14:35.119910+0000","last_became_peered":"2024-09-10T23:14:35.119910+0000","last_unstale":"2024-09-10T23:14:35.126183+0000","last_undegraded":"2024-09-10T23:14:35.126183+0000","last_fullsized":"2024-09-10T23:14:35.126183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:37.291436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112157+0000","last_change":"2024-09-10T23:14:35.112157+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112157+0000","last_undegraded":"2024-09-10T23:14:35.112157+0000","last_fullsized":"2024-09-10T23:14:35.112157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130737+0000","last_change":"2024-09-10T23:14:35.127319+0000","last_active":"2024-09-10T23:14:35.130737+0000","last_peered":"2024-09-10T23:14:35.130737+0000","last_clean":"2024-09-10T23:14:35.130737+0000","last_became_active":"2024-09-10T23:14:35.127042+0000","last_became_peered":"2024-09-10T23:14:35.127042+0000","last_unstale":"2024-09-10T23:14:35.130737+0000","last_undegraded":"2024-09-10T23:14:35.130737+0000","last_fullsized":"2024-09-10T23:14:35.130737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:17.769511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117847+0000","last_change":"2024-09-10T23:14:35.117847+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117847+0000","last_undegraded":"2024-09-10T23:14:35.117847+0000","last_fullsized":"2024-09-10T23:14:35.117847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.164818+0000","last_change":"2024-09-10T23:14:35.123801+0000","last_active":"2024-09-10T23:14:36.164818+0000","last_peered":"2024-09-10T23:14:36.164818+0000","last_clean":"2024-09-10T23:14:36.164818+0000","last_became_active":"2024-09-10T23:14:35.123332+0000","last_became_peered":"2024-09-10T23:14:35.123332+0000","last_unstale":"2024-09-10T23:14:36.164818+0000","last_undegraded":"2024-09-10T23:14:36.164818+0000","last_fullsized":"2024-09-10T23:14:36.164818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:57.857780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.159103+0000","last_change":"2024-09-10T23:14:36.153086+0000","last_active":"2024-09-10T23:14:36.159103+0000","last_peered":"2024-09-10T23:14:36.159103+0000","last_clean":"2024-09-10T23:14:36.159103+0000","last_became_active":"2024-09-10T23:14:36.152843+0000","last_became_peered":"2024-09-10T23:14:36.152843+0000","last_unstale":"2024-09-10T23:14:36.159103+0000","last_undegraded":"2024-09-10T23:14:36.159103+0000","last_fullsized":"2024-09-10T23:14:36.159103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:23.627384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132004+0000","last_change":"2024-09-10T23:14:35.130442+0000","last_active":"2024-09-10T23:14:35.132004+0000","last_peered":"2024-09-10T23:14:35.132004+0000","last_clean":"2024-09-10T23:14:35.132004+0000","last_became_active":"2024-09-10T23:14:35.130131+0000","last_became_peered":"2024-09-10T23:14:35.130131+0000","last_unstale":"2024-09-10T23:14:35.132004+0000","last_undegraded":"2024-09-10T23:14:35.132004+0000","last_fullsized":"2024-09-10T23:14:35.132004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:44.033195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119183+0000","last_change":"2024-09-10T23:14:35.119183+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119183+0000","last_undegraded":"2024-09-10T23:14:35.119183+0000","last_fullsized":"2024-09-10T23:14:35.119183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132788+0000","last_change":"2024-09-10T23:14:35.129215+0000","last_active":"2024-09-10T23:14:35.132788+0000","last_peered":"2024-09-10T23:14:35.132788+0000","last_clean":"2024-09-10T23:14:35.132788+0000","last_became_active":"2024-09-10T23:14:35.128170+0000","last_became_peered":"2024-09-10T23:14:35.128170+0000","last_unstale":"2024-09-10T23:14:35.132788+0000","last_undegraded":"2024-09-10T23:14:35.132788+0000","last_fullsized":"2024-09-10T23:14:35.132788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:44.033195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.120423+0000","last_change":"2024-09-10T23:14:35.120423+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.120423+0000","last_undegraded":"2024-09-10T23:14:35.120423+0000","last_fullsized":"2024-09-10T23:14:35.120423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132313+0000","last_change":"2024-09-10T23:14:35.127072+0000","last_active":"2024-09-10T23:14:35.132313+0000","last_peered":"2024-09-10T23:14:35.132313+0000","last_clean":"2024-09-10T23:14:35.132313+0000","last_became_active":"2024-09-10T23:14:35.126776+0000","last_became_peered":"2024-09-10T23:14:35.126776+0000","last_unstale":"2024-09-10T23:14:35.132313+0000","last_undegraded":"2024-09-10T23:14:35.132313+0000","last_fullsized":"2024-09-10T23:14:35.132313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:17.769511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118860+0000","last_change":"2024-09-10T23:14:35.118860+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118860+0000","last_undegraded":"2024-09-10T23:14:35.118860+0000","last_fullsized":"2024-09-10T23:14:35.118860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132364+0000","last_change":"2024-09-10T23:14:35.130472+0000","last_active":"2024-09-10T23:14:35.132364+0000","last_peered":"2024-09-10T23:14:35.132364+0000","last_clean":"2024-09-10T23:14:35.132364+0000","last_became_active":"2024-09-10T23:14:35.130164+0000","last_became_peered":"2024-09-10T23:14:35.130164+0000","last_unstale":"2024-09-10T23:14:35.132364+0000","last_undegraded":"2024-09-10T23:14:35.132364+0000","last_fullsized":"2024-09-10T23:14:35.132364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:15.617243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117999+0000","last_change":"2024-09-10T23:14:35.117999+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117999+0000","last_undegraded":"2024-09-10T23:14:35.117999+0000","last_fullsized":"2024-09-10T23:14:35.117999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.135053+0000","last_change":"2024-09-10T23:14:35.130891+0000","last_active":"2024-09-10T23:14:35.135053+0000","last_peered":"2024-09-10T23:14:35.135053+0000","last_clean":"2024-09-10T23:14:35.135053+0000","last_became_active":"2024-09-10T23:14:35.130654+0000","last_became_peered":"2024-09-10T23:14:35.130654+0000","last_unstale":"2024-09-10T23:14:35.135053+0000","last_undegraded":"2024-09-10T23:14:35.135053+0000","last_fullsized":"2024-09-10T23:14:35.135053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:38.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118098+0000","last_change":"2024-09-10T23:14:35.118098+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118098+0000","last_undegraded":"2024-09-10T23:14:35.118098+0000","last_fullsized":"2024-09-10T23:14:35.118098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.126166+0000","last_change":"2024-09-10T23:14:35.121691+0000","last_active":"2024-09-10T23:14:35.126166+0000","last_peered":"2024-09-10T23:14:35.126166+0000","last_clean":"2024-09-10T23:14:35.126166+0000","last_became_active":"2024-09-10T23:14:35.121391+0000","last_became_peered":"2024-09-10T23:14:35.121391+0000","last_unstale":"2024-09-10T23:14:35.126166+0000","last_undegraded":"2024-09-10T23:14:35.126166+0000","last_fullsized":"2024-09-10T23:14:35.126166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:15.617243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.113064+0000","last_change":"2024-09-10T23:14:35.113064+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.113064+0000","last_undegraded":"2024-09-10T23:14:35.113064+0000","last_fullsized":"2024-09-10T23:14:35.113064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132291+0000","last_change":"2024-09-10T23:14:35.126188+0000","last_active":"2024-09-10T23:14:35.132291+0000","last_peered":"2024-09-10T23:14:35.132291+0000","last_clean":"2024-09-10T23:14:35.132291+0000","last_became_active":"2024-09-10T23:14:35.125868+0000","last_became_peered":"2024-09-10T23:14:35.125868+0000","last_unstale":"2024-09-10T23:14:35.132291+0000","last_undegraded":"2024-09-10T23:14:35.132291+0000","last_fullsized":"2024-09-10T23:14:35.132291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:29.882694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117249+0000","last_change":"2024-09-10T23:14:35.117249+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117249+0000","last_undegraded":"2024-09-10T23:14:35.117249+0000","last_fullsized":"2024-09-10T23:14:35.117249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":107,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.124244+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:14:35.124244+0000","last_peered":"2024-09-10T23:14:35.124244+0000","last_clean":"2024-09-10T23:14:35.124244+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:14:35.124244+0000","last_undegraded":"2024-09-10T23:14:35.124244+0000","last_fullsized":"2024-09-10T23:14:35.124244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.128004+0000","last_change":"2024-09-10T23:14:35.126656+0000","last_active":"2024-09-10T23:14:35.128004+0000","last_peered":"2024-09-10T23:14:35.128004+0000","last_clean":"2024-09-10T23:14:35.128004+0000","last_became_active":"2024-09-10T23:14:35.126289+0000","last_became_peered":"2024-09-10T23:14:35.126289+0000","last_unstale":"2024-09-10T23:14:35.128004+0000","last_undegraded":"2024-09-10T23:14:35.128004+0000","last_fullsized":"2024-09-10T23:14:35.128004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:30.470000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119084+0000","last_change":"2024-09-10T23:14:35.119084+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119084+0000","last_undegraded":"2024-09-10T23:14:35.119084+0000","last_fullsized":"2024-09-10T23:14:35.119084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.136395+0000","last_change":"2024-09-10T23:14:35.132667+0000","last_active":"2024-09-10T23:14:35.136395+0000","last_peered":"2024-09-10T23:14:35.136395+0000","last_clean":"2024-09-10T23:14:35.136395+0000","last_became_active":"2024-09-10T23:14:35.132330+0000","last_became_peered":"2024-09-10T23:14:35.132330+0000","last_unstale":"2024-09-10T23:14:35.136395+0000","last_undegraded":"2024-09-10T23:14:35.136395+0000","last_fullsized":"2024-09-10T23:14:35.136395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:44.244654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.158551+0000","last_change":"2024-09-10T23:14:36.149640+0000","last_active":"2024-09-10T23:14:36.158551+0000","last_peered":"2024-09-10T23:14:36.158551+0000","last_clean":"2024-09-10T23:14:36.158551+0000","last_became_active":"2024-09-10T23:14:36.148907+0000","last_became_peered":"2024-09-10T23:14:36.148907+0000","last_unstale":"2024-09-10T23:14:36.158551+0000","last_undegraded":"2024-09-10T23:14:36.158551+0000","last_fullsized":"2024-09-10T23:14:36.158551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:20.668623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.135063+0000","last_change":"2024-09-10T23:14:35.130254+0000","last_active":"2024-09-10T23:14:35.135063+0000","last_peered":"2024-09-10T23:14:35.135063+0000","last_clean":"2024-09-10T23:14:35.135063+0000","last_became_active":"2024-09-10T23:14:35.129994+0000","last_became_peered":"2024-09-10T23:14:35.129994+0000","last_unstale":"2024-09-10T23:14:35.135063+0000","last_undegraded":"2024-09-10T23:14:35.135063+0000","last_fullsized":"2024-09-10T23:14:35.135063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:43.933909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118747+0000","last_change":"2024-09-10T23:14:35.118747+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118747+0000","last_undegraded":"2024-09-10T23:14:35.118747+0000","last_fullsized":"2024-09-10T23:14:35.118747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.118725+0000","last_change":"2024-09-10T23:14:35.116348+0000","last_active":"2024-09-10T23:14:35.118725+0000","last_peered":"2024-09-10T23:14:35.118725+0000","last_clean":"2024-09-10T23:14:35.118725+0000","last_became_active":"2024-09-10T23:14:35.116063+0000","last_became_peered":"2024-09-10T23:14:35.116063+0000","last_unstale":"2024-09-10T23:14:35.118725+0000","last_undegraded":"2024-09-10T23:14:35.118725+0000","last_fullsized":"2024-09-10T23:14:35.118725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:29.882694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112047+0000","last_change":"2024-09-10T23:14:35.112047+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112047+0000","last_undegraded":"2024-09-10T23:14:35.112047+0000","last_fullsized":"2024-09-10T23:14:35.112047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130141+0000","last_change":"2024-09-10T23:14:35.123920+0000","last_active":"2024-09-10T23:14:35.130141+0000","last_peered":"2024-09-10T23:14:35.130141+0000","last_clean":"2024-09-10T23:14:35.130141+0000","last_became_active":"2024-09-10T23:14:35.123644+0000","last_became_peered":"2024-09-10T23:14:35.123644+0000","last_unstale":"2024-09-10T23:14:35.130141+0000","last_undegraded":"2024-09-10T23:14:35.130141+0000","last_fullsized":"2024-09-10T23:14:35.130141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:43.933909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112063+0000","last_change":"2024-09-10T23:14:35.112063+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112063+0000","last_undegraded":"2024-09-10T23:14:35.112063+0000","last_fullsized":"2024-09-10T23:14:35.112063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.139207+0000","last_change":"2024-09-10T23:14:35.133489+0000","last_active":"2024-09-10T23:14:35.139207+0000","last_peered":"2024-09-10T23:14:35.139207+0000","last_clean":"2024-09-10T23:14:35.139207+0000","last_became_active":"2024-09-10T23:14:35.133189+0000","last_became_peered":"2024-09-10T23:14:35.133189+0000","last_unstale":"2024-09-10T23:14:35.139207+0000","last_undegraded":"2024-09-10T23:14:35.139207+0000","last_fullsized":"2024-09-10T23:14:35.139207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:26.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117391+0000","last_change":"2024-09-10T23:14:35.117391+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117391+0000","last_undegraded":"2024-09-10T23:14:35.117391+0000","last_fullsized":"2024-09-10T23:14:35.117391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.135146+0000","last_change":"2024-09-10T23:14:35.130762+0000","last_active":"2024-09-10T23:14:35.135146+0000","last_peered":"2024-09-10T23:14:35.135146+0000","last_clean":"2024-09-10T23:14:35.135146+0000","last_became_active":"2024-09-10T23:14:35.130502+0000","last_became_peered":"2024-09-10T23:14:35.130502+0000","last_unstale":"2024-09-10T23:14:35.135146+0000","last_undegraded":"2024-09-10T23:14:35.135146+0000","last_fullsized":"2024-09-10T23:14:35.135146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116558+0000","last_change":"2024-09-10T23:14:35.116558+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116558+0000","last_undegraded":"2024-09-10T23:14:35.116558+0000","last_fullsized":"2024-09-10T23:14:35.116558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.129905+0000","last_change":"2024-09-10T23:14:35.128484+0000","last_active":"2024-09-10T23:14:35.129905+0000","last_peered":"2024-09-10T23:14:35.129905+0000","last_clean":"2024-09-10T23:14:35.129905+0000","last_became_active":"2024-09-10T23:14:35.127877+0000","last_became_peered":"2024-09-10T23:14:35.127877+0000","last_unstale":"2024-09-10T23:14:35.129905+0000","last_undegraded":"2024-09-10T23:14:35.129905+0000","last_fullsized":"2024-09-10T23:14:35.129905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:30.470000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.158765+0000","last_change":"2024-09-10T23:14:36.150091+0000","last_active":"2024-09-10T23:14:36.158765+0000","last_peered":"2024-09-10T23:14:36.158765+0000","last_clean":"2024-09-10T23:14:36.158765+0000","last_became_active":"2024-09-10T23:14:36.149727+0000","last_became_peered":"2024-09-10T23:14:36.149727+0000","last_unstale":"2024-09-10T23:14:36.158765+0000","last_undegraded":"2024-09-10T23:14:36.158765+0000","last_fullsized":"2024-09-10T23:14:36.158765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:26:11.441337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.139207+0000","last_change":"2024-09-10T23:14:35.133467+0000","last_active":"2024-09-10T23:14:35.139207+0000","last_peered":"2024-09-10T23:14:35.139207+0000","last_clean":"2024-09-10T23:14:35.139207+0000","last_became_active":"2024-09-10T23:14:35.133163+0000","last_became_peered":"2024-09-10T23:14:35.133163+0000","last_unstale":"2024-09-10T23:14:35.139207+0000","last_undegraded":"2024-09-10T23:14:35.139207+0000","last_fullsized":"2024-09-10T23:14:35.139207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:48.848197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112226+0000","last_change":"2024-09-10T23:14:35.112226+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112226+0000","last_undegraded":"2024-09-10T23:14:35.112226+0000","last_fullsized":"2024-09-10T23:14:35.112226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130194+0000","last_change":"2024-09-10T23:14:35.125619+0000","last_active":"2024-09-10T23:14:35.130194+0000","last_peered":"2024-09-10T23:14:35.130194+0000","last_clean":"2024-09-10T23:14:35.130194+0000","last_became_active":"2024-09-10T23:14:35.125258+0000","last_became_peered":"2024-09-10T23:14:35.125258+0000","last_unstale":"2024-09-10T23:14:35.130194+0000","last_undegraded":"2024-09-10T23:14:35.130194+0000","last_fullsized":"2024-09-10T23:14:35.130194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:00.433782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117658+0000","last_change":"2024-09-10T23:14:35.117658+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117658+0000","last_undegraded":"2024-09-10T23:14:35.117658+0000","last_fullsized":"2024-09-10T23:14:35.117658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130047+0000","last_change":"2024-09-10T23:14:35.124311+0000","last_active":"2024-09-10T23:14:35.130047+0000","last_peered":"2024-09-10T23:14:35.130047+0000","last_clean":"2024-09-10T23:14:35.130047+0000","last_became_active":"2024-09-10T23:14:35.124054+0000","last_became_peered":"2024-09-10T23:14:35.124054+0000","last_unstale":"2024-09-10T23:14:35.130047+0000","last_undegraded":"2024-09-10T23:14:35.130047+0000","last_fullsized":"2024-09-10T23:14:35.130047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:38.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116580+0000","last_change":"2024-09-10T23:14:35.116580+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116580+0000","last_undegraded":"2024-09-10T23:14:35.116580+0000","last_fullsized":"2024-09-10T23:14:35.116580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130425+0000","last_change":"2024-09-10T23:14:35.128785+0000","last_active":"2024-09-10T23:14:35.130425+0000","last_peered":"2024-09-10T23:14:35.130425+0000","last_clean":"2024-09-10T23:14:35.130425+0000","last_became_active":"2024-09-10T23:14:35.128523+0000","last_became_peered":"2024-09-10T23:14:35.128523+0000","last_unstale":"2024-09-10T23:14:35.130425+0000","last_undegraded":"2024-09-10T23:14:35.130425+0000","last_fullsized":"2024-09-10T23:14:35.130425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:38.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117405+0000","last_change":"2024-09-10T23:14:35.117405+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117405+0000","last_undegraded":"2024-09-10T23:14:35.117405+0000","last_fullsized":"2024-09-10T23:14:35.117405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112932+0000","last_change":"2024-09-10T23:14:35.112932+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112932+0000","last_undegraded":"2024-09-10T23:14:35.112932+0000","last_fullsized":"2024-09-10T23:14:35.112932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130675+0000","last_change":"2024-09-10T23:14:35.128918+0000","last_active":"2024-09-10T23:14:35.130675+0000","last_peered":"2024-09-10T23:14:35.130675+0000","last_clean":"2024-09-10T23:14:35.130675+0000","last_became_active":"2024-09-10T23:14:35.128646+0000","last_became_peered":"2024-09-10T23:14:35.128646+0000","last_unstale":"2024-09-10T23:14:35.130675+0000","last_undegraded":"2024-09-10T23:14:35.130675+0000","last_fullsized":"2024-09-10T23:14:35.130675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:00.433782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114104+0000","last_change":"2024-09-10T23:14:35.114104+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114104+0000","last_undegraded":"2024-09-10T23:14:35.114104+0000","last_fullsized":"2024-09-10T23:14:35.114104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132931+0000","last_change":"2024-09-10T23:14:35.131443+0000","last_active":"2024-09-10T23:14:35.132931+0000","last_peered":"2024-09-10T23:14:35.132931+0000","last_clean":"2024-09-10T23:14:35.132931+0000","last_became_active":"2024-09-10T23:14:35.131123+0000","last_became_peered":"2024-09-10T23:14:35.131123+0000","last_unstale":"2024-09-10T23:14:35.132931+0000","last_undegraded":"2024-09-10T23:14:35.132931+0000","last_fullsized":"2024-09-10T23:14:35.132931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.159061+0000","last_change":"2024-09-10T23:14:36.152236+0000","last_active":"2024-09-10T23:14:36.159061+0000","last_peered":"2024-09-10T23:14:36.159061+0000","last_clean":"2024-09-10T23:14:36.159061+0000","last_became_active":"2024-09-10T23:14:36.151945+0000","last_became_peered":"2024-09-10T23:14:36.151945+0000","last_unstale":"2024-09-10T23:14:36.159061+0000","last_undegraded":"2024-09-10T23:14:36.159061+0000","last_fullsized":"2024-09-10T23:14:36.159061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:34.828197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.134892+0000","last_change":"2024-09-10T23:14:35.129994+0000","last_active":"2024-09-10T23:14:35.134892+0000","last_peered":"2024-09-10T23:14:35.134892+0000","last_clean":"2024-09-10T23:14:35.134892+0000","last_became_active":"2024-09-10T23:14:35.129609+0000","last_became_peered":"2024-09-10T23:14:35.129609+0000","last_unstale":"2024-09-10T23:14:35.134892+0000","last_undegraded":"2024-09-10T23:14:35.134892+0000","last_fullsized":"2024-09-10T23:14:35.134892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:37.291436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119352+0000","last_change":"2024-09-10T23:14:35.119352+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119352+0000","last_undegraded":"2024-09-10T23:14:35.119352+0000","last_fullsized":"2024-09-10T23:14:35.119352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.164568+0000","last_change":"2024-09-10T23:14:35.129129+0000","last_active":"2024-09-10T23:14:36.164568+0000","last_peered":"2024-09-10T23:14:36.164568+0000","last_clean":"2024-09-10T23:14:36.164568+0000","last_became_active":"2024-09-10T23:14:35.128815+0000","last_became_peered":"2024-09-10T23:14:35.128815+0000","last_unstale":"2024-09-10T23:14:36.164568+0000","last_undegraded":"2024-09-10T23:14:36.164568+0000","last_fullsized":"2024-09-10T23:14:36.164568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:08.507246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":665941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:14:40.782 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-10T23:14:40.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.121004+0000', 'last_change': '2024-09-10T23:14:35.121004+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.121004+0000', 'last_undegraded': '2024-09-10T23:14:35.121004+0000', 'last_fullsized': '2024-09-10T23:14:35.121004+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:14:40.782 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-10T23:14:40.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.122569+0000', 'last_change': '2024-09-10T23:14:35.122569+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.122569+0000', 'last_undegraded': '2024-09-10T23:14:35.122569+0000', 'last_fullsized': '2024-09-10T23:14:35.122569+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T23:14:40.782 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-10T23:14:40.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.114752+0000', 'last_change': '2024-09-10T23:14:35.114752+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.114752+0000', 'last_undegraded': '2024-09-10T23:14:35.114752+0000', 'last_fullsized': '2024-09-10T23:14:35.114752+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:14:40.783 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-10T23:14:40.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.121173+0000', 'last_change': '2024-09-10T23:14:35.121173+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.121173+0000', 'last_undegraded': '2024-09-10T23:14:35.121173+0000', 'last_fullsized': '2024-09-10T23:14:35.121173+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:14:40.783 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-10T23:14:40.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.114303+0000', 'last_change': '2024-09-10T23:14:35.114303+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.114303+0000', 'last_undegraded': '2024-09-10T23:14:35.114303+0000', 'last_fullsized': '2024-09-10T23:14:35.114303+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:14:40.783 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-10T23:14:40.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.119780+0000', 'last_change': '2024-09-10T23:14:35.119780+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.119780+0000', 'last_undegraded': '2024-09-10T23:14:35.119780+0000', 'last_fullsized': '2024-09-10T23:14:35.119780+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:14:40.783 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-10T23:14:40.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.118752+0000', 'last_change': '2024-09-10T23:14:35.118752+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.118752+0000', 'last_undegraded': '2024-09-10T23:14:35.118752+0000', 'last_fullsized': '2024-09-10T23:14:35.118752+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:14:40.783 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-10T23:14:40.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.120489+0000', 'last_change': '2024-09-10T23:14:35.120489+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.120489+0000', 'last_undegraded': '2024-09-10T23:14:35.120489+0000', 'last_fullsized': '2024-09-10T23:14:35.120489+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:14:40.784 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-10T23:14:40.784 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.119325+0000', 'last_change': '2024-09-10T23:14:35.119325+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.119325+0000', 'last_undegraded': '2024-09-10T23:14:35.119325+0000', 'last_fullsized': '2024-09-10T23:14:35.119325+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:14:40.784 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-10T23:14:40.784 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.116908+0000', 'last_change': '2024-09-10T23:14:35.116908+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.116908+0000', 'last_undegraded': '2024-09-10T23:14:35.116908+0000', 'last_fullsized': '2024-09-10T23:14:35.116908+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:14:40.784 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-10T23:14:40.784 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.113772+0000', 'last_change': '2024-09-10T23:14:35.113772+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.113772+0000', 'last_undegraded': '2024-09-10T23:14:35.113772+0000', 'last_fullsized': '2024-09-10T23:14:35.113772+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:14:40.784 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-10T23:14:40.784 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.118648+0000', 'last_change': '2024-09-10T23:14:35.118648+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.118648+0000', 'last_undegraded': '2024-09-10T23:14:35.118648+0000', 'last_fullsized': '2024-09-10T23:14:35.118648+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:14:40.784 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-10T23:14:40.784 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.120339+0000', 'last_change': '2024-09-10T23:14:35.120339+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.120339+0000', 'last_undegraded': '2024-09-10T23:14:35.120339+0000', 'last_fullsized': '2024-09-10T23:14:35.120339+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T23:14:40.784 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-10T23:14:40.785 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.114736+0000', 'last_change': '2024-09-10T23:14:35.114736+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.114736+0000', 'last_undegraded': '2024-09-10T23:14:35.114736+0000', 'last_fullsized': '2024-09-10T23:14:35.114736+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:14:40.785 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-10T23:14:40.785 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.112881+0000', 'last_change': '2024-09-10T23:14:35.112881+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.112881+0000', 'last_undegraded': '2024-09-10T23:14:35.112881+0000', 'last_fullsized': '2024-09-10T23:14:35.112881+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:14:40.785 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-10T23:14:40.785 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.116381+0000', 'last_change': '2024-09-10T23:14:35.116381+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.116381+0000', 'last_undegraded': '2024-09-10T23:14:35.116381+0000', 'last_fullsized': '2024-09-10T23:14:35.116381+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T23:14:40.785 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-10T23:14:40.785 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.116639+0000', 'last_change': '2024-09-10T23:14:35.116639+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.116639+0000', 'last_undegraded': '2024-09-10T23:14:35.116639+0000', 'last_fullsized': '2024-09-10T23:14:35.116639+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:14:40.785 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-10T23:14:40.785 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.118565+0000', 'last_change': '2024-09-10T23:14:35.118565+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.118565+0000', 'last_undegraded': '2024-09-10T23:14:35.118565+0000', 'last_fullsized': '2024-09-10T23:14:35.118565+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:14:40.785 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-10T23:14:40.785 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.113823+0000', 'last_change': '2024-09-10T23:14:35.113823+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.113823+0000', 'last_undegraded': '2024-09-10T23:14:35.113823+0000', 'last_fullsized': '2024-09-10T23:14:35.113823+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:14:40.786 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-10T23:14:40.786 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.118054+0000', 'last_change': '2024-09-10T23:14:35.118054+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.118054+0000', 'last_undegraded': '2024-09-10T23:14:35.118054+0000', 'last_fullsized': '2024-09-10T23:14:35.118054+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:14:40.786 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-10T23:14:40.786 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.114301+0000', 'last_change': '2024-09-10T23:14:35.114301+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.114301+0000', 'last_undegraded': '2024-09-10T23:14:35.114301+0000', 'last_fullsized': '2024-09-10T23:14:35.114301+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:14:40.786 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-10T23:14:40.786 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.117993+0000', 'last_change': '2024-09-10T23:14:35.117993+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.117993+0000', 'last_undegraded': '2024-09-10T23:14:35.117993+0000', 'last_fullsized': '2024-09-10T23:14:35.117993+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:14:40.786 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-10T23:14:40.786 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.118808+0000', 'last_change': '2024-09-10T23:14:35.118808+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.118808+0000', 'last_undegraded': '2024-09-10T23:14:35.118808+0000', 'last_fullsized': '2024-09-10T23:14:35.118808+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:14:40.786 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-10T23:14:40.786 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.119174+0000', 'last_change': '2024-09-10T23:14:35.119174+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.119174+0000', 'last_undegraded': '2024-09-10T23:14:35.119174+0000', 'last_fullsized': '2024-09-10T23:14:35.119174+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T23:14:40.786 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-10T23:14:40.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.116417+0000', 'last_change': '2024-09-10T23:14:35.116417+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.116417+0000', 'last_undegraded': '2024-09-10T23:14:35.116417+0000', 'last_fullsized': '2024-09-10T23:14:35.116417+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:14:40.787 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-10T23:14:40.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.112934+0000', 'last_change': '2024-09-10T23:14:35.112934+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.112934+0000', 'last_undegraded': '2024-09-10T23:14:35.112934+0000', 'last_fullsized': '2024-09-10T23:14:35.112934+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:14:40.787 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-10T23:14:40.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.117857+0000', 'last_change': '2024-09-10T23:14:35.117857+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.117857+0000', 'last_undegraded': '2024-09-10T23:14:35.117857+0000', 'last_fullsized': '2024-09-10T23:14:35.117857+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T23:14:40.787 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-10T23:14:40.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.120966+0000', 'last_change': '2024-09-10T23:14:35.120966+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.120966+0000', 'last_undegraded': '2024-09-10T23:14:35.120966+0000', 'last_fullsized': '2024-09-10T23:14:35.120966+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:14:40.787 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-10T23:14:40.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.112514+0000', 'last_change': '2024-09-10T23:14:35.112514+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.112514+0000', 'last_undegraded': '2024-09-10T23:14:35.112514+0000', 'last_fullsized': '2024-09-10T23:14:35.112514+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:14:40.787 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-10T23:14:40.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.118087+0000', 'last_change': '2024-09-10T23:14:35.118087+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.118087+0000', 'last_undegraded': '2024-09-10T23:14:35.118087+0000', 'last_fullsized': '2024-09-10T23:14:35.118087+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:14:40.788 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-10T23:14:40.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.119087+0000', 'last_change': '2024-09-10T23:14:35.119087+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.119087+0000', 'last_undegraded': '2024-09-10T23:14:35.119087+0000', 'last_fullsized': '2024-09-10T23:14:35.119087+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T23:14:40.788 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-10T23:14:40.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.112583+0000', 'last_change': '2024-09-10T23:14:35.112583+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.112583+0000', 'last_undegraded': '2024-09-10T23:14:35.112583+0000', 'last_fullsized': '2024-09-10T23:14:35.112583+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:14:40.788 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-10T23:14:40.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.112157+0000', 'last_change': '2024-09-10T23:14:35.112157+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.112157+0000', 'last_undegraded': '2024-09-10T23:14:35.112157+0000', 'last_fullsized': '2024-09-10T23:14:35.112157+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:14:40.788 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-10T23:14:40.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.117847+0000', 'last_change': '2024-09-10T23:14:35.117847+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.117847+0000', 'last_undegraded': '2024-09-10T23:14:35.117847+0000', 'last_fullsized': '2024-09-10T23:14:35.117847+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:14:40.788 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-10T23:14:40.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.119183+0000', 'last_change': '2024-09-10T23:14:35.119183+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.119183+0000', 'last_undegraded': '2024-09-10T23:14:35.119183+0000', 'last_fullsized': '2024-09-10T23:14:35.119183+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:14:40.789 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-10T23:14:40.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.120423+0000', 'last_change': '2024-09-10T23:14:35.120423+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.120423+0000', 'last_undegraded': '2024-09-10T23:14:35.120423+0000', 'last_fullsized': '2024-09-10T23:14:35.120423+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:14:40.789 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-10T23:14:40.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.118860+0000', 'last_change': '2024-09-10T23:14:35.118860+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.118860+0000', 'last_undegraded': '2024-09-10T23:14:35.118860+0000', 'last_fullsized': '2024-09-10T23:14:35.118860+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:14:40.789 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-10T23:14:40.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.117999+0000', 'last_change': '2024-09-10T23:14:35.117999+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.117999+0000', 'last_undegraded': '2024-09-10T23:14:35.117999+0000', 'last_fullsized': '2024-09-10T23:14:35.117999+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:14:40.789 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-10T23:14:40.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.118098+0000', 'last_change': '2024-09-10T23:14:35.118098+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.118098+0000', 'last_undegraded': '2024-09-10T23:14:35.118098+0000', 'last_fullsized': '2024-09-10T23:14:35.118098+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:14:40.789 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-10T23:14:40.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.113064+0000', 'last_change': '2024-09-10T23:14:35.113064+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.113064+0000', 'last_undegraded': '2024-09-10T23:14:35.113064+0000', 'last_fullsized': '2024-09-10T23:14:35.113064+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:14:40.790 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-10T23:14:40.790 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.117249+0000', 'last_change': '2024-09-10T23:14:35.117249+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.117249+0000', 'last_undegraded': '2024-09-10T23:14:35.117249+0000', 'last_fullsized': '2024-09-10T23:14:35.117249+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:14:40.790 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-10T23:14:40.790 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.119084+0000', 'last_change': '2024-09-10T23:14:35.119084+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.119084+0000', 'last_undegraded': '2024-09-10T23:14:35.119084+0000', 'last_fullsized': '2024-09-10T23:14:35.119084+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:14:40.790 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-10T23:14:40.790 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.118747+0000', 'last_change': '2024-09-10T23:14:35.118747+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.118747+0000', 'last_undegraded': '2024-09-10T23:14:35.118747+0000', 'last_fullsized': '2024-09-10T23:14:35.118747+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T23:14:40.790 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-10T23:14:40.790 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.112047+0000', 'last_change': '2024-09-10T23:14:35.112047+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.112047+0000', 'last_undegraded': '2024-09-10T23:14:35.112047+0000', 'last_fullsized': '2024-09-10T23:14:35.112047+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:14:40.790 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-10T23:14:40.790 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.112063+0000', 'last_change': '2024-09-10T23:14:35.112063+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.112063+0000', 'last_undegraded': '2024-09-10T23:14:35.112063+0000', 'last_fullsized': '2024-09-10T23:14:35.112063+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:14:40.791 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-10T23:14:40.791 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.117391+0000', 'last_change': '2024-09-10T23:14:35.117391+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.117391+0000', 'last_undegraded': '2024-09-10T23:14:35.117391+0000', 'last_fullsized': '2024-09-10T23:14:35.117391+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T23:14:40.791 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-10T23:14:40.791 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.116558+0000', 'last_change': '2024-09-10T23:14:35.116558+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.116558+0000', 'last_undegraded': '2024-09-10T23:14:35.116558+0000', 'last_fullsized': '2024-09-10T23:14:35.116558+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:14:40.791 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-10T23:14:40.791 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.112226+0000', 'last_change': '2024-09-10T23:14:35.112226+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.112226+0000', 'last_undegraded': '2024-09-10T23:14:35.112226+0000', 'last_fullsized': '2024-09-10T23:14:35.112226+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:14:40.791 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-10T23:14:40.791 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.117658+0000', 'last_change': '2024-09-10T23:14:35.117658+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.117658+0000', 'last_undegraded': '2024-09-10T23:14:35.117658+0000', 'last_fullsized': '2024-09-10T23:14:35.117658+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:14:40.791 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-10T23:14:40.791 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.116580+0000', 'last_change': '2024-09-10T23:14:35.116580+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.116580+0000', 'last_undegraded': '2024-09-10T23:14:35.116580+0000', 'last_fullsized': '2024-09-10T23:14:35.116580+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:14:40.791 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-10T23:14:40.792 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.117405+0000', 'last_change': '2024-09-10T23:14:35.117405+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.117405+0000', 'last_undegraded': '2024-09-10T23:14:35.117405+0000', 'last_fullsized': '2024-09-10T23:14:35.117405+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:14:40.792 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-10T23:14:40.792 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.112932+0000', 'last_change': '2024-09-10T23:14:35.112932+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.112932+0000', 'last_undegraded': '2024-09-10T23:14:35.112932+0000', 'last_fullsized': '2024-09-10T23:14:35.112932+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:14:40.792 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-10T23:14:40.792 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.114104+0000', 'last_change': '2024-09-10T23:14:35.114104+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.114104+0000', 'last_undegraded': '2024-09-10T23:14:35.114104+0000', 'last_fullsized': '2024-09-10T23:14:35.114104+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:14:40.792 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-10T23:14:40.792 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:14:35.119352+0000', 'last_change': '2024-09-10T23:14:35.119352+0000', 'last_active': '2024-09-10T23:14:35.106228+0000', 'last_peered': '2024-09-10T23:14:35.106228+0000', 'last_clean': '2024-09-10T23:14:35.106228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:14:35.119352+0000', 'last_undegraded': '2024-09-10T23:14:35.119352+0000', 'last_fullsized': '2024-09-10T23:14:35.119352+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'last_clean_scrub_stamp': '2024-09-10T23:14:35.106228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:14:40.793 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:14:40.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.918+0000 7fafd4ab8640 1 -- 172.21.15.90:0/476694035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd00b1d90 msgr2=0x7fafd00cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:40.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.918+0000 7fafd4ab8640 1 --2- 172.21.15.90:0/476694035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd00b1d90 0x7fafd00cdcd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fafc8005fd0 tx=0x7fafc802aa90 comp rx=0 tx=0).stop 2024-09-10T23:14:40.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.918+0000 7fafd4ab8640 1 -- 172.21.15.90:0/476694035 shutdown_connections 2024-09-10T23:14:40.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.918+0000 7fafd4ab8640 1 --2- 172.21.15.90:0/476694035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd00b1d90 0x7fafd00cdcd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.918+0000 7fafd4ab8640 1 --2- 172.21.15.90:0/476694035 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fafd015ae10 0x7fafd00b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.918+0000 7fafd4ab8640 1 -- 172.21.15.90:0/476694035 >> 172.21.15.90:0/476694035 conn(0x7fafd00cc850 msgr2=0x7fafd00ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:40.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.918+0000 7fafd4ab8640 1 -- 172.21.15.90:0/476694035 shutdown_connections 2024-09-10T23:14:40.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.918+0000 7fafd4ab8640 1 -- 172.21.15.90:0/476694035 wait complete. 2024-09-10T23:14:40.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.919+0000 7fafd4ab8640 1 Processor -- start 2024-09-10T23:14:40.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.919+0000 7fafd4ab8640 1 -- start start 2024-09-10T23:14:40.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.920+0000 7fafd4ab8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafd00b1d90 0x7fafd00b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:40.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.920+0000 7fafd4ab8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd015aa30 0x7fafd00c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:40.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.920+0000 7fafd4ab8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fafd015ae10 0x7fafd00c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:40.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.920+0000 7fafd4ab8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fafd00ce5a0 con 0x7fafd015aa30 2024-09-10T23:14:40.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.920+0000 7fafd4ab8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fafd00ce420 con 0x7fafd00b1d90 2024-09-10T23:14:40.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.920+0000 7fafd4ab8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fafd00ce720 con 0x7fafd015ae10 2024-09-10T23:14:40.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.920+0000 7fafc7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd015aa30 0x7fafd00c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:40.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.920+0000 7fafc7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd015aa30 0x7fafd00c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50300/0 (socket says 172.21.15.90:50300) 2024-09-10T23:14:40.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.920+0000 7fafc7fff640 1 -- 172.21.15.90:0/2944186152 learned_addr learned my addr 172.21.15.90:0/2944186152 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:40.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.920+0000 7fafce59c640 1 --2- 172.21.15.90:0/2944186152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafd00b1d90 0x7fafd00b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:40.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.920+0000 7fafced9d640 1 --2- 172.21.15.90:0/2944186152 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fafd015ae10 0x7fafd00c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:40.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.920+0000 7fafc7fff640 1 -- 172.21.15.90:0/2944186152 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fafd015ae10 msgr2=0x7fafd00c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:40.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.920+0000 7fafc7fff640 1 --2- 172.21.15.90:0/2944186152 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fafd015ae10 0x7fafd00c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.920+0000 7fafc7fff640 1 -- 172.21.15.90:0/2944186152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafd00b1d90 msgr2=0x7fafd00b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:40.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.920+0000 7fafc7fff640 1 --2- 172.21.15.90:0/2944186152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafd00b1d90 0x7fafd00b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:40.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.920+0000 7fafc7fff640 1 -- 172.21.15.90:0/2944186152 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd00c8af0 con 0x7fafd015aa30 2024-09-10T23:14:40.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.920+0000 7fafc7fff640 1 --2- 172.21.15.90:0/2944186152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd015aa30 0x7fafd00c85b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fafb8005fd0 tx=0x7fafb800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:40.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.921+0000 7fafc6ffd640 1 -- 172.21.15.90:0/2944186152 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8017070 con 0x7fafd015aa30 2024-09-10T23:14:40.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.921+0000 7fafc6ffd640 1 -- 172.21.15.90:0/2944186152 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafb8009d20 con 0x7fafd015aa30 2024-09-10T23:14:40.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.921+0000 7fafc6ffd640 1 -- 172.21.15.90:0/2944186152 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8004280 con 0x7fafd015aa30 2024-09-10T23:14:40.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.921+0000 7fafd4ab8640 1 -- 172.21.15.90:0/2944186152 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd00c9b90 con 0x7fafd015aa30 2024-09-10T23:14:40.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.921+0000 7fafd4ab8640 1 -- 172.21.15.90:0/2944186152 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd00b3060 con 0x7fafd015aa30 2024-09-10T23:14:40.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.922+0000 7fafd4ab8640 1 -- 172.21.15.90:0/2944186152 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd00cec40 con 0x7fafd015aa30 2024-09-10T23:14:40.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.922+0000 7fafc6ffd640 1 -- 172.21.15.90:0/2944186152 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fafb80035f0 con 0x7fafd015aa30 2024-09-10T23:14:40.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.923+0000 7fafc6ffd640 1 --2- 172.21.15.90:0/2944186152 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fafb0077f70 0x7fafb007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:40.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.923+0000 7fafc6ffd640 1 -- 172.21.15.90:0/2944186152 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fafb809a010 con 0x7fafd015aa30 2024-09-10T23:14:40.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.923+0000 7fafce59c640 1 --2- 172.21.15.90:0/2944186152 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fafb0077f70 0x7fafb007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:40.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.923+0000 7fafce59c640 1 --2- 172.21.15.90:0/2944186152 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fafb0077f70 0x7fafb007a430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fafd0072e50 tx=0x7fafc0009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:40.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:40.927+0000 7fafc6ffd640 1 -- 172.21.15.90:0/2944186152 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fafb8020030 con 0x7fafd015aa30 2024-09-10T23:14:41.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.174+0000 7fafd4ab8640 1 -- 172.21.15.90:0/2944186152 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fafd00cf730 con 0x7fafd015aa30 2024-09-10T23:14:41.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.174+0000 7fafc6ffd640 1 -- 172.21.15.90:0/2944186152 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1139 (secure 0 0 0) 0x7fafb80624c0 con 0x7fafd015aa30 2024-09-10T23:14:41.175 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:41.175 INFO:teuthology.orchestra.run.smithi090.stdout:{"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010065,"num_in_osds":8,"osd_in_since":1726010055,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":54},{"state_name":"active+clean","count":43}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590984,"bytes_used":224227328,"bytes_avail":772869885952,"bytes_total":773094113280,"inactive_pgs_ratio":0.55670100450515747,"write_bytes_sec":1365,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":7,"btime":"2024-09-10T23:14:39:140018+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4368}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-10T23:14:12.112086+0000","services":{}},"progress_events":{}} 2024-09-10T23:14:41.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.176+0000 7fafd4ab8640 1 -- 172.21.15.90:0/2944186152 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fafb0077f70 msgr2=0x7fafb007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:41.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.176+0000 7fafd4ab8640 1 --2- 172.21.15.90:0/2944186152 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fafb0077f70 0x7fafb007a430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fafd0072e50 tx=0x7fafc0009040 comp rx=0 tx=0).stop 2024-09-10T23:14:41.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.176+0000 7fafd4ab8640 1 -- 172.21.15.90:0/2944186152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd015aa30 msgr2=0x7fafd00c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:41.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.176+0000 7fafd4ab8640 1 --2- 172.21.15.90:0/2944186152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd015aa30 0x7fafd00c85b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fafb8005fd0 tx=0x7fafb800dde0 comp rx=0 tx=0).stop 2024-09-10T23:14:41.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.176+0000 7fafd4ab8640 1 -- 172.21.15.90:0/2944186152 shutdown_connections 2024-09-10T23:14:41.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.176+0000 7fafd4ab8640 1 --2- 172.21.15.90:0/2944186152 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fafb0077f70 0x7fafb007a430 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:41.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.176+0000 7fafd4ab8640 1 --2- 172.21.15.90:0/2944186152 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fafd015ae10 0x7fafd00c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:41.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.176+0000 7fafd4ab8640 1 --2- 172.21.15.90:0/2944186152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd015aa30 0x7fafd00c85b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:41.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.176+0000 7fafd4ab8640 1 --2- 172.21.15.90:0/2944186152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafd00b1d90 0x7fafd00b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:41.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.176+0000 7fafd4ab8640 1 -- 172.21.15.90:0/2944186152 >> 172.21.15.90:0/2944186152 conn(0x7fafd00cc850 msgr2=0x7fafd00ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:41.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.177+0000 7fafd4ab8640 1 -- 172.21.15.90:0/2944186152 shutdown_connections 2024-09-10T23:14:41.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.177+0000 7fafd4ab8640 1 -- 172.21.15.90:0/2944186152 wait complete. 2024-09-10T23:14:41.188 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T23:14:41.189 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:14:41.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.288+0000 7f2be56b6640 1 -- 172.21.15.90:0/3735000845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be00d0ab0 msgr2=0x7f2be00d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:41.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.288+0000 7f2be56b6640 1 --2- 172.21.15.90:0/3735000845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be00d0ab0 0x7f2be00d0f60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2be008e660 tx=0x7f2bd802a560 comp rx=0 tx=0).stop 2024-09-10T23:14:41.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.289+0000 7f2be56b6640 1 -- 172.21.15.90:0/3735000845 shutdown_connections 2024-09-10T23:14:41.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.289+0000 7f2be56b6640 1 --2- 172.21.15.90:0/3735000845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be00d0ab0 0x7f2be00d0f60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:41.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.289+0000 7f2be56b6640 1 --2- 172.21.15.90:0/3735000845 >> v2:172.21.15.171:3300/0 conn(0x7f2be00d1c70 0x7f2be00d2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:41.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.289+0000 7f2be56b6640 1 --2- 172.21.15.90:0/3735000845 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2be00d2470 0x7f2be00b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:41.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.289+0000 7f2be56b6640 1 -- 172.21.15.90:0/3735000845 >> 172.21.15.90:0/3735000845 conn(0x7f2be009d2a0 msgr2=0x7f2be00d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:41.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.289+0000 7f2be56b6640 1 -- 172.21.15.90:0/3735000845 shutdown_connections 2024-09-10T23:14:41.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.289+0000 7f2be56b6640 1 -- 172.21.15.90:0/3735000845 wait complete. 2024-09-10T23:14:41.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.290+0000 7f2be56b6640 1 Processor -- start 2024-09-10T23:14:41.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.290+0000 7f2be56b6640 1 -- start start 2024-09-10T23:14:41.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2be56b6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be00d0ab0 0x7f2be00ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:41.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2be56b6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2be00d1c70 0x7f2be01f3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:41.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2be56b6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2be00d2470 0x7f2be01f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:41.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2be56b6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2be015e4a0 con 0x7f2be00d0ab0 2024-09-10T23:14:41.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2be56b6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2be015e320 con 0x7f2be00d1c70 2024-09-10T23:14:41.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2be56b6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2be00d14a0 con 0x7f2be00d2470 2024-09-10T23:14:41.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2bdeffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be00d0ab0 0x7f2be00ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:41.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2bdeffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be00d0ab0 0x7f2be00ca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50312/0 (socket says 172.21.15.90:50312) 2024-09-10T23:14:41.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2bdeffd640 1 -- 172.21.15.90:0/1755959787 learned_addr learned my addr 172.21.15.90:0/1755959787 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:41.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2bde7fc640 1 --2- 172.21.15.90:0/1755959787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2be00d1c70 0x7f2be01f3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:41.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2bdf7fe640 1 --2- 172.21.15.90:0/1755959787 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2be00d2470 0x7f2be01f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:41.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2bdeffd640 1 -- 172.21.15.90:0/1755959787 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2be00d2470 msgr2=0x7f2be01f3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:41.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2bdeffd640 1 --2- 172.21.15.90:0/1755959787 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2be00d2470 0x7f2be01f3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:41.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2bdeffd640 1 -- 172.21.15.90:0/1755959787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2be00d1c70 msgr2=0x7f2be01f3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:41.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2bdeffd640 1 --2- 172.21.15.90:0/1755959787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2be00d1c70 0x7f2be01f3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:41.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2bdeffd640 1 -- 172.21.15.90:0/1755959787 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be015bb60 con 0x7f2be00d0ab0 2024-09-10T23:14:41.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2bdeffd640 1 --2- 172.21.15.90:0/1755959787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be00d0ab0 0x7f2be00ca310 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2bd000ba50 tx=0x7f2bd000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:41.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2bc77fe640 1 -- 172.21.15.90:0/1755959787 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0019070 con 0x7f2be00d0ab0 2024-09-10T23:14:41.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2bc77fe640 1 -- 172.21.15.90:0/1755959787 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2bd000ccf0 con 0x7f2be00d0ab0 2024-09-10T23:14:41.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2be56b6640 1 -- 172.21.15.90:0/1755959787 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be0150630 con 0x7f2be00d0ab0 2024-09-10T23:14:41.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2bc77fe640 1 -- 172.21.15.90:0/1755959787 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd00146a0 con 0x7f2be00d0ab0 2024-09-10T23:14:41.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.291+0000 7f2be56b6640 1 -- 172.21.15.90:0/1755959787 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be015be20 con 0x7f2be00d0ab0 2024-09-10T23:14:41.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.293+0000 7f2be56b6640 1 -- 172.21.15.90:0/1755959787 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be00d0f60 con 0x7f2be00d0ab0 2024-09-10T23:14:41.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.293+0000 7f2bc77fe640 1 -- 172.21.15.90:0/1755959787 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2bd001d3b0 con 0x7f2be00d0ab0 2024-09-10T23:14:41.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.293+0000 7f2bc77fe640 1 --2- 172.21.15.90:0/1755959787 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2bcc077f70 0x7f2bcc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:41.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.293+0000 7f2bc77fe640 1 -- 172.21.15.90:0/1755959787 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2bd0099e10 con 0x7f2be00d0ab0 2024-09-10T23:14:41.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.294+0000 7f2bde7fc640 1 --2- 172.21.15.90:0/1755959787 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2bcc077f70 0x7f2bcc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:41.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.294+0000 7f2bde7fc640 1 --2- 172.21.15.90:0/1755959787 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2bcc077f70 0x7f2bcc07a430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4005db0 tx=0x7f2bd4005d40 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:41.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.298+0000 7f2bc77fe640 1 -- 172.21.15.90:0/1755959787 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2bd00629a0 con 0x7f2be00d0ab0 2024-09-10T23:14:41.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.468+0000 7f2be56b6640 1 -- 172.21.15.90:0/1755959787 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2be0159a90 con 0x7f2bcc077f70 2024-09-10T23:14:41.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.473+0000 7f2bc77fe640 1 -- 172.21.15.90:0/1755959787 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247477 (secure 0 0 0) 0x7f2bd400ea40 con 0x7f2bcc077f70 2024-09-10T23:14:41.476 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:41.477 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:14:41.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.475+0000 7f2be56b6640 1 -- 172.21.15.90:0/1755959787 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2bcc077f70 msgr2=0x7f2bcc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:41.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.476+0000 7f2be56b6640 1 --2- 172.21.15.90:0/1755959787 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2bcc077f70 0x7f2bcc07a430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4005db0 tx=0x7f2bd4005d40 comp rx=0 tx=0).stop 2024-09-10T23:14:41.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.476+0000 7f2be56b6640 1 -- 172.21.15.90:0/1755959787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be00d0ab0 msgr2=0x7f2be00ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:41.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.476+0000 7f2be56b6640 1 --2- 172.21.15.90:0/1755959787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be00d0ab0 0x7f2be00ca310 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2bd000ba50 tx=0x7f2bd000bf10 comp rx=0 tx=0).stop 2024-09-10T23:14:41.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.476+0000 7f2be56b6640 1 -- 172.21.15.90:0/1755959787 shutdown_connections 2024-09-10T23:14:41.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.476+0000 7f2be56b6640 1 --2- 172.21.15.90:0/1755959787 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2bcc077f70 0x7f2bcc07a430 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:41.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.476+0000 7f2be56b6640 1 --2- 172.21.15.90:0/1755959787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2be00d1c70 0x7f2be01f3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:41.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.476+0000 7f2be56b6640 1 --2- 172.21.15.90:0/1755959787 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2be00d2470 0x7f2be01f3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:41.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.476+0000 7f2be56b6640 1 --2- 172.21.15.90:0/1755959787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be00d0ab0 0x7f2be00ca310 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:41.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.476+0000 7f2be56b6640 1 -- 172.21.15.90:0/1755959787 >> 172.21.15.90:0/1755959787 conn(0x7f2be009d2a0 msgr2=0x7f2be00ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:41.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.476+0000 7f2be56b6640 1 -- 172.21.15.90:0/1755959787 shutdown_connections 2024-09-10T23:14:41.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:41.476+0000 7f2be56b6640 1 -- 172.21.15.90:0/1755959787 wait complete. 2024-09-10T23:14:41.487 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-10T23:14:40.433986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":24,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218972,"kb_used_data":2744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755748,"statfs":{"total":773094113280,"available":772869885952,"internally_reserved":0,"allocated":2809856,"data_stored":1695779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001270"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.121004+0000","last_change":"2024-09-10T23:14:35.121004+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.121004+0000","last_undegraded":"2024-09-10T23:14:35.121004+0000","last_fullsized":"2024-09-10T23:14:35.121004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.122569+0000","last_change":"2024-09-10T23:14:35.122569+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.122569+0000","last_undegraded":"2024-09-10T23:14:35.122569+0000","last_fullsized":"2024-09-10T23:14:35.122569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.153495+0000","last_change":"2024-09-10T23:14:36.148244+0000","last_active":"2024-09-10T23:14:36.153495+0000","last_peered":"2024-09-10T23:14:36.153495+0000","last_clean":"2024-09-10T23:14:36.153495+0000","last_became_active":"2024-09-10T23:14:36.147940+0000","last_became_peered":"2024-09-10T23:14:36.147940+0000","last_unstale":"2024-09-10T23:14:36.153495+0000","last_undegraded":"2024-09-10T23:14:36.153495+0000","last_fullsized":"2024-09-10T23:14:36.153495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:54.387324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114752+0000","last_change":"2024-09-10T23:14:35.114752+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114752+0000","last_undegraded":"2024-09-10T23:14:35.114752+0000","last_fullsized":"2024-09-10T23:14:35.114752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.121173+0000","last_change":"2024-09-10T23:14:35.121173+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.121173+0000","last_undegraded":"2024-09-10T23:14:35.121173+0000","last_fullsized":"2024-09-10T23:14:35.121173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114303+0000","last_change":"2024-09-10T23:14:35.114303+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114303+0000","last_undegraded":"2024-09-10T23:14:35.114303+0000","last_fullsized":"2024-09-10T23:14:35.114303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119780+0000","last_change":"2024-09-10T23:14:35.119780+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119780+0000","last_undegraded":"2024-09-10T23:14:35.119780+0000","last_fullsized":"2024-09-10T23:14:35.119780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118752+0000","last_change":"2024-09-10T23:14:35.118752+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118752+0000","last_undegraded":"2024-09-10T23:14:35.118752+0000","last_fullsized":"2024-09-10T23:14:35.118752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.120489+0000","last_change":"2024-09-10T23:14:35.120489+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.120489+0000","last_undegraded":"2024-09-10T23:14:35.120489+0000","last_fullsized":"2024-09-10T23:14:35.120489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119325+0000","last_change":"2024-09-10T23:14:35.119325+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119325+0000","last_undegraded":"2024-09-10T23:14:35.119325+0000","last_fullsized":"2024-09-10T23:14:35.119325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116908+0000","last_change":"2024-09-10T23:14:35.116908+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116908+0000","last_undegraded":"2024-09-10T23:14:35.116908+0000","last_fullsized":"2024-09-10T23:14:35.116908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.113772+0000","last_change":"2024-09-10T23:14:35.113772+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.113772+0000","last_undegraded":"2024-09-10T23:14:35.113772+0000","last_fullsized":"2024-09-10T23:14:35.113772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118648+0000","last_change":"2024-09-10T23:14:35.118648+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118648+0000","last_undegraded":"2024-09-10T23:14:35.118648+0000","last_fullsized":"2024-09-10T23:14:35.118648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.158955+0000","last_change":"2024-09-10T23:14:36.150886+0000","last_active":"2024-09-10T23:14:36.158955+0000","last_peered":"2024-09-10T23:14:36.158955+0000","last_clean":"2024-09-10T23:14:36.158955+0000","last_became_active":"2024-09-10T23:14:36.150523+0000","last_became_peered":"2024-09-10T23:14:36.150523+0000","last_unstale":"2024-09-10T23:14:36.158955+0000","last_undegraded":"2024-09-10T23:14:36.158955+0000","last_fullsized":"2024-09-10T23:14:36.158955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:35.034783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.120339+0000","last_change":"2024-09-10T23:14:35.120339+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.120339+0000","last_undegraded":"2024-09-10T23:14:35.120339+0000","last_fullsized":"2024-09-10T23:14:35.120339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114736+0000","last_change":"2024-09-10T23:14:35.114736+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114736+0000","last_undegraded":"2024-09-10T23:14:35.114736+0000","last_fullsized":"2024-09-10T23:14:35.114736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112881+0000","last_change":"2024-09-10T23:14:35.112881+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112881+0000","last_undegraded":"2024-09-10T23:14:35.112881+0000","last_fullsized":"2024-09-10T23:14:35.112881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116381+0000","last_change":"2024-09-10T23:14:35.116381+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116381+0000","last_undegraded":"2024-09-10T23:14:35.116381+0000","last_fullsized":"2024-09-10T23:14:35.116381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116639+0000","last_change":"2024-09-10T23:14:35.116639+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116639+0000","last_undegraded":"2024-09-10T23:14:35.116639+0000","last_fullsized":"2024-09-10T23:14:35.116639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118565+0000","last_change":"2024-09-10T23:14:35.118565+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118565+0000","last_undegraded":"2024-09-10T23:14:35.118565+0000","last_fullsized":"2024-09-10T23:14:35.118565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.162528+0000","last_change":"2024-09-10T23:14:36.157805+0000","last_active":"2024-09-10T23:14:36.162528+0000","last_peered":"2024-09-10T23:14:36.162528+0000","last_clean":"2024-09-10T23:14:36.162528+0000","last_became_active":"2024-09-10T23:14:36.157536+0000","last_became_peered":"2024-09-10T23:14:36.157536+0000","last_unstale":"2024-09-10T23:14:36.162528+0000","last_undegraded":"2024-09-10T23:14:36.162528+0000","last_fullsized":"2024-09-10T23:14:36.162528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:48.635981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.113823+0000","last_change":"2024-09-10T23:14:35.113823+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.113823+0000","last_undegraded":"2024-09-10T23:14:35.113823+0000","last_fullsized":"2024-09-10T23:14:35.113823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118054+0000","last_change":"2024-09-10T23:14:35.118054+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118054+0000","last_undegraded":"2024-09-10T23:14:35.118054+0000","last_fullsized":"2024-09-10T23:14:35.118054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114301+0000","last_change":"2024-09-10T23:14:35.114301+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114301+0000","last_undegraded":"2024-09-10T23:14:35.114301+0000","last_fullsized":"2024-09-10T23:14:35.114301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117993+0000","last_change":"2024-09-10T23:14:35.117993+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117993+0000","last_undegraded":"2024-09-10T23:14:35.117993+0000","last_fullsized":"2024-09-10T23:14:35.117993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118808+0000","last_change":"2024-09-10T23:14:35.118808+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118808+0000","last_undegraded":"2024-09-10T23:14:35.118808+0000","last_fullsized":"2024-09-10T23:14:35.118808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119174+0000","last_change":"2024-09-10T23:14:35.119174+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119174+0000","last_undegraded":"2024-09-10T23:14:35.119174+0000","last_fullsized":"2024-09-10T23:14:35.119174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116417+0000","last_change":"2024-09-10T23:14:35.116417+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116417+0000","last_undegraded":"2024-09-10T23:14:35.116417+0000","last_fullsized":"2024-09-10T23:14:35.116417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.159092+0000","last_change":"2024-09-10T23:14:36.152030+0000","last_active":"2024-09-10T23:14:36.159092+0000","last_peered":"2024-09-10T23:14:36.159092+0000","last_clean":"2024-09-10T23:14:36.159092+0000","last_became_active":"2024-09-10T23:14:36.151377+0000","last_became_peered":"2024-09-10T23:14:36.151377+0000","last_unstale":"2024-09-10T23:14:36.159092+0000","last_undegraded":"2024-09-10T23:14:36.159092+0000","last_fullsized":"2024-09-10T23:14:36.159092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:15.755571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112934+0000","last_change":"2024-09-10T23:14:35.112934+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112934+0000","last_undegraded":"2024-09-10T23:14:35.112934+0000","last_fullsized":"2024-09-10T23:14:35.112934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117857+0000","last_change":"2024-09-10T23:14:35.117857+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117857+0000","last_undegraded":"2024-09-10T23:14:35.117857+0000","last_fullsized":"2024-09-10T23:14:35.117857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.120966+0000","last_change":"2024-09-10T23:14:35.120966+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.120966+0000","last_undegraded":"2024-09-10T23:14:35.120966+0000","last_fullsized":"2024-09-10T23:14:35.120966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112514+0000","last_change":"2024-09-10T23:14:35.112514+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112514+0000","last_undegraded":"2024-09-10T23:14:35.112514+0000","last_fullsized":"2024-09-10T23:14:35.112514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132131+0000","last_change":"2024-09-10T23:14:35.127806+0000","last_active":"2024-09-10T23:14:35.132131+0000","last_peered":"2024-09-10T23:14:35.132131+0000","last_clean":"2024-09-10T23:14:35.132131+0000","last_became_active":"2024-09-10T23:14:35.127548+0000","last_became_peered":"2024-09-10T23:14:35.127548+0000","last_unstale":"2024-09-10T23:14:35.132131+0000","last_undegraded":"2024-09-10T23:14:35.132131+0000","last_fullsized":"2024-09-10T23:14:35.132131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:15.617243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.159066+0000","last_change":"2024-09-10T23:14:36.151022+0000","last_active":"2024-09-10T23:14:36.159066+0000","last_peered":"2024-09-10T23:14:36.159066+0000","last_clean":"2024-09-10T23:14:36.159066+0000","last_became_active":"2024-09-10T23:14:36.150753+0000","last_became_peered":"2024-09-10T23:14:36.150753+0000","last_unstale":"2024-09-10T23:14:36.159066+0000","last_undegraded":"2024-09-10T23:14:36.159066+0000","last_fullsized":"2024-09-10T23:14:36.159066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:53.550698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.129705+0000","last_change":"2024-09-10T23:14:35.125689+0000","last_active":"2024-09-10T23:14:35.129705+0000","last_peered":"2024-09-10T23:14:35.129705+0000","last_clean":"2024-09-10T23:14:35.129705+0000","last_became_active":"2024-09-10T23:14:35.124148+0000","last_became_peered":"2024-09-10T23:14:35.124148+0000","last_unstale":"2024-09-10T23:14:35.129705+0000","last_undegraded":"2024-09-10T23:14:35.129705+0000","last_fullsized":"2024-09-10T23:14:35.129705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:29.882694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.134954+0000","last_change":"2024-09-10T23:14:35.130875+0000","last_active":"2024-09-10T23:14:35.134954+0000","last_peered":"2024-09-10T23:14:35.134954+0000","last_clean":"2024-09-10T23:14:35.134954+0000","last_became_active":"2024-09-10T23:14:35.130552+0000","last_became_peered":"2024-09-10T23:14:35.130552+0000","last_unstale":"2024-09-10T23:14:35.134954+0000","last_undegraded":"2024-09-10T23:14:35.134954+0000","last_fullsized":"2024-09-10T23:14:35.134954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:43.933909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118087+0000","last_change":"2024-09-10T23:14:35.118087+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118087+0000","last_undegraded":"2024-09-10T23:14:35.118087+0000","last_fullsized":"2024-09-10T23:14:35.118087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.125858+0000","last_change":"2024-09-10T23:14:35.123317+0000","last_active":"2024-09-10T23:14:35.125858+0000","last_peered":"2024-09-10T23:14:35.125858+0000","last_clean":"2024-09-10T23:14:35.125858+0000","last_became_active":"2024-09-10T23:14:35.123043+0000","last_became_peered":"2024-09-10T23:14:35.123043+0000","last_unstale":"2024-09-10T23:14:35.125858+0000","last_undegraded":"2024-09-10T23:14:35.125858+0000","last_fullsized":"2024-09-10T23:14:35.125858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:17.769511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119087+0000","last_change":"2024-09-10T23:14:35.119087+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119087+0000","last_undegraded":"2024-09-10T23:14:35.119087+0000","last_fullsized":"2024-09-10T23:14:35.119087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132771+0000","last_change":"2024-09-10T23:14:35.129118+0000","last_active":"2024-09-10T23:14:35.132771+0000","last_peered":"2024-09-10T23:14:35.132771+0000","last_clean":"2024-09-10T23:14:35.132771+0000","last_became_active":"2024-09-10T23:14:35.128858+0000","last_became_peered":"2024-09-10T23:14:35.128858+0000","last_unstale":"2024-09-10T23:14:35.132771+0000","last_undegraded":"2024-09-10T23:14:35.132771+0000","last_fullsized":"2024-09-10T23:14:35.132771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:52.160694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112583+0000","last_change":"2024-09-10T23:14:35.112583+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112583+0000","last_undegraded":"2024-09-10T23:14:35.112583+0000","last_fullsized":"2024-09-10T23:14:35.112583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.131974+0000","last_change":"2024-09-10T23:14:35.130807+0000","last_active":"2024-09-10T23:14:35.131974+0000","last_peered":"2024-09-10T23:14:35.131974+0000","last_clean":"2024-09-10T23:14:35.131974+0000","last_became_active":"2024-09-10T23:14:35.130541+0000","last_became_peered":"2024-09-10T23:14:35.130541+0000","last_unstale":"2024-09-10T23:14:35.131974+0000","last_undegraded":"2024-09-10T23:14:35.131974+0000","last_fullsized":"2024-09-10T23:14:35.131974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:52.160694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.158106+0000","last_change":"2024-09-10T23:14:36.149079+0000","last_active":"2024-09-10T23:14:36.158106+0000","last_peered":"2024-09-10T23:14:36.158106+0000","last_clean":"2024-09-10T23:14:36.158106+0000","last_became_active":"2024-09-10T23:14:36.148726+0000","last_became_peered":"2024-09-10T23:14:36.148726+0000","last_unstale":"2024-09-10T23:14:36.158106+0000","last_undegraded":"2024-09-10T23:14:36.158106+0000","last_fullsized":"2024-09-10T23:14:36.158106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:14.162329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.126183+0000","last_change":"2024-09-10T23:14:35.122724+0000","last_active":"2024-09-10T23:14:35.126183+0000","last_peered":"2024-09-10T23:14:35.126183+0000","last_clean":"2024-09-10T23:14:35.126183+0000","last_became_active":"2024-09-10T23:14:35.119910+0000","last_became_peered":"2024-09-10T23:14:35.119910+0000","last_unstale":"2024-09-10T23:14:35.126183+0000","last_undegraded":"2024-09-10T23:14:35.126183+0000","last_fullsized":"2024-09-10T23:14:35.126183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:37.291436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112157+0000","last_change":"2024-09-10T23:14:35.112157+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112157+0000","last_undegraded":"2024-09-10T23:14:35.112157+0000","last_fullsized":"2024-09-10T23:14:35.112157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130737+0000","last_change":"2024-09-10T23:14:35.127319+0000","last_active":"2024-09-10T23:14:35.130737+0000","last_peered":"2024-09-10T23:14:35.130737+0000","last_clean":"2024-09-10T23:14:35.130737+0000","last_became_active":"2024-09-10T23:14:35.127042+0000","last_became_peered":"2024-09-10T23:14:35.127042+0000","last_unstale":"2024-09-10T23:14:35.130737+0000","last_undegraded":"2024-09-10T23:14:35.130737+0000","last_fullsized":"2024-09-10T23:14:35.130737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:17.769511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117847+0000","last_change":"2024-09-10T23:14:35.117847+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117847+0000","last_undegraded":"2024-09-10T23:14:35.117847+0000","last_fullsized":"2024-09-10T23:14:35.117847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.164818+0000","last_change":"2024-09-10T23:14:35.123801+0000","last_active":"2024-09-10T23:14:36.164818+0000","last_peered":"2024-09-10T23:14:36.164818+0000","last_clean":"2024-09-10T23:14:36.164818+0000","last_became_active":"2024-09-10T23:14:35.123332+0000","last_became_peered":"2024-09-10T23:14:35.123332+0000","last_unstale":"2024-09-10T23:14:36.164818+0000","last_undegraded":"2024-09-10T23:14:36.164818+0000","last_fullsized":"2024-09-10T23:14:36.164818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:57.857780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.159103+0000","last_change":"2024-09-10T23:14:36.153086+0000","last_active":"2024-09-10T23:14:36.159103+0000","last_peered":"2024-09-10T23:14:36.159103+0000","last_clean":"2024-09-10T23:14:36.159103+0000","last_became_active":"2024-09-10T23:14:36.152843+0000","last_became_peered":"2024-09-10T23:14:36.152843+0000","last_unstale":"2024-09-10T23:14:36.159103+0000","last_undegraded":"2024-09-10T23:14:36.159103+0000","last_fullsized":"2024-09-10T23:14:36.159103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:23.627384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132004+0000","last_change":"2024-09-10T23:14:35.130442+0000","last_active":"2024-09-10T23:14:35.132004+0000","last_peered":"2024-09-10T23:14:35.132004+0000","last_clean":"2024-09-10T23:14:35.132004+0000","last_became_active":"2024-09-10T23:14:35.130131+0000","last_became_peered":"2024-09-10T23:14:35.130131+0000","last_unstale":"2024-09-10T23:14:35.132004+0000","last_undegraded":"2024-09-10T23:14:35.132004+0000","last_fullsized":"2024-09-10T23:14:35.132004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:44.033195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119183+0000","last_change":"2024-09-10T23:14:35.119183+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119183+0000","last_undegraded":"2024-09-10T23:14:35.119183+0000","last_fullsized":"2024-09-10T23:14:35.119183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132788+0000","last_change":"2024-09-10T23:14:35.129215+0000","last_active":"2024-09-10T23:14:35.132788+0000","last_peered":"2024-09-10T23:14:35.132788+0000","last_clean":"2024-09-10T23:14:35.132788+0000","last_became_active":"2024-09-10T23:14:35.128170+0000","last_became_peered":"2024-09-10T23:14:35.128170+0000","last_unstale":"2024-09-10T23:14:35.132788+0000","last_undegraded":"2024-09-10T23:14:35.132788+0000","last_fullsized":"2024-09-10T23:14:35.132788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:44.033195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.120423+0000","last_change":"2024-09-10T23:14:35.120423+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.120423+0000","last_undegraded":"2024-09-10T23:14:35.120423+0000","last_fullsized":"2024-09-10T23:14:35.120423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132313+0000","last_change":"2024-09-10T23:14:35.127072+0000","last_active":"2024-09-10T23:14:35.132313+0000","last_peered":"2024-09-10T23:14:35.132313+0000","last_clean":"2024-09-10T23:14:35.132313+0000","last_became_active":"2024-09-10T23:14:35.126776+0000","last_became_peered":"2024-09-10T23:14:35.126776+0000","last_unstale":"2024-09-10T23:14:35.132313+0000","last_undegraded":"2024-09-10T23:14:35.132313+0000","last_fullsized":"2024-09-10T23:14:35.132313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:17.769511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118860+0000","last_change":"2024-09-10T23:14:35.118860+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118860+0000","last_undegraded":"2024-09-10T23:14:35.118860+0000","last_fullsized":"2024-09-10T23:14:35.118860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132364+0000","last_change":"2024-09-10T23:14:35.130472+0000","last_active":"2024-09-10T23:14:35.132364+0000","last_peered":"2024-09-10T23:14:35.132364+0000","last_clean":"2024-09-10T23:14:35.132364+0000","last_became_active":"2024-09-10T23:14:35.130164+0000","last_became_peered":"2024-09-10T23:14:35.130164+0000","last_unstale":"2024-09-10T23:14:35.132364+0000","last_undegraded":"2024-09-10T23:14:35.132364+0000","last_fullsized":"2024-09-10T23:14:35.132364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:15.617243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117999+0000","last_change":"2024-09-10T23:14:35.117999+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117999+0000","last_undegraded":"2024-09-10T23:14:35.117999+0000","last_fullsized":"2024-09-10T23:14:35.117999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.135053+0000","last_change":"2024-09-10T23:14:35.130891+0000","last_active":"2024-09-10T23:14:35.135053+0000","last_peered":"2024-09-10T23:14:35.135053+0000","last_clean":"2024-09-10T23:14:35.135053+0000","last_became_active":"2024-09-10T23:14:35.130654+0000","last_became_peered":"2024-09-10T23:14:35.130654+0000","last_unstale":"2024-09-10T23:14:35.135053+0000","last_undegraded":"2024-09-10T23:14:35.135053+0000","last_fullsized":"2024-09-10T23:14:35.135053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:38.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118098+0000","last_change":"2024-09-10T23:14:35.118098+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118098+0000","last_undegraded":"2024-09-10T23:14:35.118098+0000","last_fullsized":"2024-09-10T23:14:35.118098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.126166+0000","last_change":"2024-09-10T23:14:35.121691+0000","last_active":"2024-09-10T23:14:35.126166+0000","last_peered":"2024-09-10T23:14:35.126166+0000","last_clean":"2024-09-10T23:14:35.126166+0000","last_became_active":"2024-09-10T23:14:35.121391+0000","last_became_peered":"2024-09-10T23:14:35.121391+0000","last_unstale":"2024-09-10T23:14:35.126166+0000","last_undegraded":"2024-09-10T23:14:35.126166+0000","last_fullsized":"2024-09-10T23:14:35.126166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:15.617243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.113064+0000","last_change":"2024-09-10T23:14:35.113064+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.113064+0000","last_undegraded":"2024-09-10T23:14:35.113064+0000","last_fullsized":"2024-09-10T23:14:35.113064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132291+0000","last_change":"2024-09-10T23:14:35.126188+0000","last_active":"2024-09-10T23:14:35.132291+0000","last_peered":"2024-09-10T23:14:35.132291+0000","last_clean":"2024-09-10T23:14:35.132291+0000","last_became_active":"2024-09-10T23:14:35.125868+0000","last_became_peered":"2024-09-10T23:14:35.125868+0000","last_unstale":"2024-09-10T23:14:35.132291+0000","last_undegraded":"2024-09-10T23:14:35.132291+0000","last_fullsized":"2024-09-10T23:14:35.132291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:29.882694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117249+0000","last_change":"2024-09-10T23:14:35.117249+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117249+0000","last_undegraded":"2024-09-10T23:14:35.117249+0000","last_fullsized":"2024-09-10T23:14:35.117249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":107,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.124244+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:14:35.124244+0000","last_peered":"2024-09-10T23:14:35.124244+0000","last_clean":"2024-09-10T23:14:35.124244+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:14:35.124244+0000","last_undegraded":"2024-09-10T23:14:35.124244+0000","last_fullsized":"2024-09-10T23:14:35.124244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.128004+0000","last_change":"2024-09-10T23:14:35.126656+0000","last_active":"2024-09-10T23:14:35.128004+0000","last_peered":"2024-09-10T23:14:35.128004+0000","last_clean":"2024-09-10T23:14:35.128004+0000","last_became_active":"2024-09-10T23:14:35.126289+0000","last_became_peered":"2024-09-10T23:14:35.126289+0000","last_unstale":"2024-09-10T23:14:35.128004+0000","last_undegraded":"2024-09-10T23:14:35.128004+0000","last_fullsized":"2024-09-10T23:14:35.128004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:30.470000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119084+0000","last_change":"2024-09-10T23:14:35.119084+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119084+0000","last_undegraded":"2024-09-10T23:14:35.119084+0000","last_fullsized":"2024-09-10T23:14:35.119084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.136395+0000","last_change":"2024-09-10T23:14:35.132667+0000","last_active":"2024-09-10T23:14:35.136395+0000","last_peered":"2024-09-10T23:14:35.136395+0000","last_clean":"2024-09-10T23:14:35.136395+0000","last_became_active":"2024-09-10T23:14:35.132330+0000","last_became_peered":"2024-09-10T23:14:35.132330+0000","last_unstale":"2024-09-10T23:14:35.136395+0000","last_undegraded":"2024-09-10T23:14:35.136395+0000","last_fullsized":"2024-09-10T23:14:35.136395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:44.244654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.158551+0000","last_change":"2024-09-10T23:14:36.149640+0000","last_active":"2024-09-10T23:14:36.158551+0000","last_peered":"2024-09-10T23:14:36.158551+0000","last_clean":"2024-09-10T23:14:36.158551+0000","last_became_active":"2024-09-10T23:14:36.148907+0000","last_became_peered":"2024-09-10T23:14:36.148907+0000","last_unstale":"2024-09-10T23:14:36.158551+0000","last_undegraded":"2024-09-10T23:14:36.158551+0000","last_fullsized":"2024-09-10T23:14:36.158551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:20.668623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.135063+0000","last_change":"2024-09-10T23:14:35.130254+0000","last_active":"2024-09-10T23:14:35.135063+0000","last_peered":"2024-09-10T23:14:35.135063+0000","last_clean":"2024-09-10T23:14:35.135063+0000","last_became_active":"2024-09-10T23:14:35.129994+0000","last_became_peered":"2024-09-10T23:14:35.129994+0000","last_unstale":"2024-09-10T23:14:35.135063+0000","last_undegraded":"2024-09-10T23:14:35.135063+0000","last_fullsized":"2024-09-10T23:14:35.135063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:43.933909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.118747+0000","last_change":"2024-09-10T23:14:35.118747+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.118747+0000","last_undegraded":"2024-09-10T23:14:35.118747+0000","last_fullsized":"2024-09-10T23:14:35.118747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.118725+0000","last_change":"2024-09-10T23:14:35.116348+0000","last_active":"2024-09-10T23:14:35.118725+0000","last_peered":"2024-09-10T23:14:35.118725+0000","last_clean":"2024-09-10T23:14:35.118725+0000","last_became_active":"2024-09-10T23:14:35.116063+0000","last_became_peered":"2024-09-10T23:14:35.116063+0000","last_unstale":"2024-09-10T23:14:35.118725+0000","last_undegraded":"2024-09-10T23:14:35.118725+0000","last_fullsized":"2024-09-10T23:14:35.118725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:29.882694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112047+0000","last_change":"2024-09-10T23:14:35.112047+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112047+0000","last_undegraded":"2024-09-10T23:14:35.112047+0000","last_fullsized":"2024-09-10T23:14:35.112047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130141+0000","last_change":"2024-09-10T23:14:35.123920+0000","last_active":"2024-09-10T23:14:35.130141+0000","last_peered":"2024-09-10T23:14:35.130141+0000","last_clean":"2024-09-10T23:14:35.130141+0000","last_became_active":"2024-09-10T23:14:35.123644+0000","last_became_peered":"2024-09-10T23:14:35.123644+0000","last_unstale":"2024-09-10T23:14:35.130141+0000","last_undegraded":"2024-09-10T23:14:35.130141+0000","last_fullsized":"2024-09-10T23:14:35.130141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:43.933909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112063+0000","last_change":"2024-09-10T23:14:35.112063+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112063+0000","last_undegraded":"2024-09-10T23:14:35.112063+0000","last_fullsized":"2024-09-10T23:14:35.112063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.139207+0000","last_change":"2024-09-10T23:14:35.133489+0000","last_active":"2024-09-10T23:14:35.139207+0000","last_peered":"2024-09-10T23:14:35.139207+0000","last_clean":"2024-09-10T23:14:35.139207+0000","last_became_active":"2024-09-10T23:14:35.133189+0000","last_became_peered":"2024-09-10T23:14:35.133189+0000","last_unstale":"2024-09-10T23:14:35.139207+0000","last_undegraded":"2024-09-10T23:14:35.139207+0000","last_fullsized":"2024-09-10T23:14:35.139207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:26.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117391+0000","last_change":"2024-09-10T23:14:35.117391+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117391+0000","last_undegraded":"2024-09-10T23:14:35.117391+0000","last_fullsized":"2024-09-10T23:14:35.117391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.135146+0000","last_change":"2024-09-10T23:14:35.130762+0000","last_active":"2024-09-10T23:14:35.135146+0000","last_peered":"2024-09-10T23:14:35.135146+0000","last_clean":"2024-09-10T23:14:35.135146+0000","last_became_active":"2024-09-10T23:14:35.130502+0000","last_became_peered":"2024-09-10T23:14:35.130502+0000","last_unstale":"2024-09-10T23:14:35.135146+0000","last_undegraded":"2024-09-10T23:14:35.135146+0000","last_fullsized":"2024-09-10T23:14:35.135146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116558+0000","last_change":"2024-09-10T23:14:35.116558+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116558+0000","last_undegraded":"2024-09-10T23:14:35.116558+0000","last_fullsized":"2024-09-10T23:14:35.116558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.129905+0000","last_change":"2024-09-10T23:14:35.128484+0000","last_active":"2024-09-10T23:14:35.129905+0000","last_peered":"2024-09-10T23:14:35.129905+0000","last_clean":"2024-09-10T23:14:35.129905+0000","last_became_active":"2024-09-10T23:14:35.127877+0000","last_became_peered":"2024-09-10T23:14:35.127877+0000","last_unstale":"2024-09-10T23:14:35.129905+0000","last_undegraded":"2024-09-10T23:14:35.129905+0000","last_fullsized":"2024-09-10T23:14:35.129905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:30.470000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.158765+0000","last_change":"2024-09-10T23:14:36.150091+0000","last_active":"2024-09-10T23:14:36.158765+0000","last_peered":"2024-09-10T23:14:36.158765+0000","last_clean":"2024-09-10T23:14:36.158765+0000","last_became_active":"2024-09-10T23:14:36.149727+0000","last_became_peered":"2024-09-10T23:14:36.149727+0000","last_unstale":"2024-09-10T23:14:36.158765+0000","last_undegraded":"2024-09-10T23:14:36.158765+0000","last_fullsized":"2024-09-10T23:14:36.158765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:26:11.441337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.139207+0000","last_change":"2024-09-10T23:14:35.133467+0000","last_active":"2024-09-10T23:14:35.139207+0000","last_peered":"2024-09-10T23:14:35.139207+0000","last_clean":"2024-09-10T23:14:35.139207+0000","last_became_active":"2024-09-10T23:14:35.133163+0000","last_became_peered":"2024-09-10T23:14:35.133163+0000","last_unstale":"2024-09-10T23:14:35.139207+0000","last_undegraded":"2024-09-10T23:14:35.139207+0000","last_fullsized":"2024-09-10T23:14:35.139207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:48.848197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112226+0000","last_change":"2024-09-10T23:14:35.112226+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112226+0000","last_undegraded":"2024-09-10T23:14:35.112226+0000","last_fullsized":"2024-09-10T23:14:35.112226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130194+0000","last_change":"2024-09-10T23:14:35.125619+0000","last_active":"2024-09-10T23:14:35.130194+0000","last_peered":"2024-09-10T23:14:35.130194+0000","last_clean":"2024-09-10T23:14:35.130194+0000","last_became_active":"2024-09-10T23:14:35.125258+0000","last_became_peered":"2024-09-10T23:14:35.125258+0000","last_unstale":"2024-09-10T23:14:35.130194+0000","last_undegraded":"2024-09-10T23:14:35.130194+0000","last_fullsized":"2024-09-10T23:14:35.130194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:00.433782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117658+0000","last_change":"2024-09-10T23:14:35.117658+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117658+0000","last_undegraded":"2024-09-10T23:14:35.117658+0000","last_fullsized":"2024-09-10T23:14:35.117658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130047+0000","last_change":"2024-09-10T23:14:35.124311+0000","last_active":"2024-09-10T23:14:35.130047+0000","last_peered":"2024-09-10T23:14:35.130047+0000","last_clean":"2024-09-10T23:14:35.130047+0000","last_became_active":"2024-09-10T23:14:35.124054+0000","last_became_peered":"2024-09-10T23:14:35.124054+0000","last_unstale":"2024-09-10T23:14:35.130047+0000","last_undegraded":"2024-09-10T23:14:35.130047+0000","last_fullsized":"2024-09-10T23:14:35.130047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:38.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.116580+0000","last_change":"2024-09-10T23:14:35.116580+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.116580+0000","last_undegraded":"2024-09-10T23:14:35.116580+0000","last_fullsized":"2024-09-10T23:14:35.116580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130425+0000","last_change":"2024-09-10T23:14:35.128785+0000","last_active":"2024-09-10T23:14:35.130425+0000","last_peered":"2024-09-10T23:14:35.130425+0000","last_clean":"2024-09-10T23:14:35.130425+0000","last_became_active":"2024-09-10T23:14:35.128523+0000","last_became_peered":"2024-09-10T23:14:35.128523+0000","last_unstale":"2024-09-10T23:14:35.130425+0000","last_undegraded":"2024-09-10T23:14:35.130425+0000","last_fullsized":"2024-09-10T23:14:35.130425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:38.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.117405+0000","last_change":"2024-09-10T23:14:35.117405+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.117405+0000","last_undegraded":"2024-09-10T23:14:35.117405+0000","last_fullsized":"2024-09-10T23:14:35.117405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.112932+0000","last_change":"2024-09-10T23:14:35.112932+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.112932+0000","last_undegraded":"2024-09-10T23:14:35.112932+0000","last_fullsized":"2024-09-10T23:14:35.112932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.130675+0000","last_change":"2024-09-10T23:14:35.128918+0000","last_active":"2024-09-10T23:14:35.130675+0000","last_peered":"2024-09-10T23:14:35.130675+0000","last_clean":"2024-09-10T23:14:35.130675+0000","last_became_active":"2024-09-10T23:14:35.128646+0000","last_became_peered":"2024-09-10T23:14:35.128646+0000","last_unstale":"2024-09-10T23:14:35.130675+0000","last_undegraded":"2024-09-10T23:14:35.130675+0000","last_fullsized":"2024-09-10T23:14:35.130675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:00.433782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.114104+0000","last_change":"2024-09-10T23:14:35.114104+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.114104+0000","last_undegraded":"2024-09-10T23:14:35.114104+0000","last_fullsized":"2024-09-10T23:14:35.114104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.132931+0000","last_change":"2024-09-10T23:14:35.131443+0000","last_active":"2024-09-10T23:14:35.132931+0000","last_peered":"2024-09-10T23:14:35.132931+0000","last_clean":"2024-09-10T23:14:35.132931+0000","last_became_active":"2024-09-10T23:14:35.131123+0000","last_became_peered":"2024-09-10T23:14:35.131123+0000","last_unstale":"2024-09-10T23:14:35.132931+0000","last_undegraded":"2024-09-10T23:14:35.132931+0000","last_fullsized":"2024-09-10T23:14:35.132931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.159061+0000","last_change":"2024-09-10T23:14:36.152236+0000","last_active":"2024-09-10T23:14:36.159061+0000","last_peered":"2024-09-10T23:14:36.159061+0000","last_clean":"2024-09-10T23:14:36.159061+0000","last_became_active":"2024-09-10T23:14:36.151945+0000","last_became_peered":"2024-09-10T23:14:36.151945+0000","last_unstale":"2024-09-10T23:14:36.159061+0000","last_undegraded":"2024-09-10T23:14:36.159061+0000","last_fullsized":"2024-09-10T23:14:36.159061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:34.828197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T23:14:35.134892+0000","last_change":"2024-09-10T23:14:35.129994+0000","last_active":"2024-09-10T23:14:35.134892+0000","last_peered":"2024-09-10T23:14:35.134892+0000","last_clean":"2024-09-10T23:14:35.134892+0000","last_became_active":"2024-09-10T23:14:35.129609+0000","last_became_peered":"2024-09-10T23:14:35.129609+0000","last_unstale":"2024-09-10T23:14:35.134892+0000","last_undegraded":"2024-09-10T23:14:35.134892+0000","last_fullsized":"2024-09-10T23:14:35.134892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:37.291436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-10T23:14:35.119352+0000","last_change":"2024-09-10T23:14:35.119352+0000","last_active":"2024-09-10T23:14:35.106228+0000","last_peered":"2024-09-10T23:14:35.106228+0000","last_clean":"2024-09-10T23:14:35.106228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:14:35.119352+0000","last_undegraded":"2024-09-10T23:14:35.119352+0000","last_fullsized":"2024-09-10T23:14:35.119352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T23:14:36.164568+0000","last_change":"2024-09-10T23:14:35.129129+0000","last_active":"2024-09-10T23:14:36.164568+0000","last_peered":"2024-09-10T23:14:36.164568+0000","last_clean":"2024-09-10T23:14:36.164568+0000","last_became_active":"2024-09-10T23:14:35.128815+0000","last_became_peered":"2024-09-10T23:14:35.128815+0000","last_unstale":"2024-09-10T23:14:36.164568+0000","last_undegraded":"2024-09-10T23:14:36.164568+0000","last_fullsized":"2024-09-10T23:14:36.164568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:08.507246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":665941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:14:41.789 INFO:tasks.ceph.mds.c.smithi090.stderr:2024-09-10T23:14:41.789+0000 7f536b80a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:14:44.492 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:14:44.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.604+0000 7ff1c6ef7640 1 -- 172.21.15.90:0/1165627705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1a8005210 msgr2=0x7ff1a800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:44.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.604+0000 7ff1c6ef7640 1 --2- 172.21.15.90:0/1165627705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1a8005210 0x7ff1a800b9c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0069870 tx=0x7ff1a8005830 comp rx=0 tx=0).stop 2024-09-10T23:14:44.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.604+0000 7ff1c5494640 1 -- 172.21.15.90:0/1165627705 reap_dead start 2024-09-10T23:14:44.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.604+0000 7ff1c6ef7640 1 -- 172.21.15.90:0/1165627705 shutdown_connections 2024-09-10T23:14:44.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.604+0000 7ff1c6ef7640 1 -- 172.21.15.90:0/1165627705 >> 172.21.15.90:0/1165627705 conn(0x7ff1c00d1dd0 msgr2=0x7ff1c00d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:44.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.604+0000 7ff1c6ef7640 1 -- 172.21.15.90:0/1165627705 shutdown_connections 2024-09-10T23:14:44.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.604+0000 7ff1c6ef7640 1 -- 172.21.15.90:0/1165627705 wait complete. 2024-09-10T23:14:44.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.605+0000 7ff1c6ef7640 1 Processor -- start 2024-09-10T23:14:44.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.605+0000 7ff1c6ef7640 1 -- start start 2024-09-10T23:14:44.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1c6ef7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1a8005210 0x7ff1c00c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:44.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1c6ef7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1c00c8ea0 0x7ff1c00c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:44.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1c6ef7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1c01f5680 0x7ff1c01f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:44.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1c6ef7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c0164fd0 con 0x7ff1a8005210 2024-09-10T23:14:44.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1c6ef7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c00cdcf0 con 0x7ff1c00c8ea0 2024-09-10T23:14:44.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1c6ef7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c0165150 con 0x7ff1c01f5680 2024-09-10T23:14:44.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1c4c93640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1a8005210 0x7ff1c00c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:44.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1c4c93640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1a8005210 0x7ff1c00c4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50326/0 (socket says 172.21.15.90:50326) 2024-09-10T23:14:44.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1c4c93640 1 -- 172.21.15.90:0/1660247442 learned_addr learned my addr 172.21.15.90:0/1660247442 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:44.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1c5494640 1 --2- 172.21.15.90:0/1660247442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1c01f5680 0x7ff1c01f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:44.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1bffff640 1 --2- 172.21.15.90:0/1660247442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1c00c8ea0 0x7ff1c00c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:44.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1c4c93640 1 -- 172.21.15.90:0/1660247442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1c01f5680 msgr2=0x7ff1c01f5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:44.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1c4c93640 1 --2- 172.21.15.90:0/1660247442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1c01f5680 0x7ff1c01f5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:44.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1c4c93640 1 -- 172.21.15.90:0/1660247442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1c00c8ea0 msgr2=0x7ff1c00c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:44.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1c4c93640 1 --2- 172.21.15.90:0/1660247442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1c00c8ea0 0x7ff1c00c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:44.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1c4c93640 1 -- 172.21.15.90:0/1660247442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c00cade0 con 0x7ff1a8005210 2024-09-10T23:14:44.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1c4c93640 1 --2- 172.21.15.90:0/1660247442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1a8005210 0x7ff1c00c4be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0003f90 tx=0x7ff1b000f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:44.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1bd7fa640 1 -- 172.21.15.90:0/1660247442 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0011640 con 0x7ff1a8005210 2024-09-10T23:14:44.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1bd7fa640 1 -- 172.21.15.90:0/1660247442 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1b0016020 con 0x7ff1a8005210 2024-09-10T23:14:44.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.606+0000 7ff1c6ef7640 1 -- 172.21.15.90:0/1660247442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c01f6040 con 0x7ff1a8005210 2024-09-10T23:14:44.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.607+0000 7ff1bd7fa640 1 -- 172.21.15.90:0/1660247442 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0011a60 con 0x7ff1a8005210 2024-09-10T23:14:44.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.607+0000 7ff1c6ef7640 1 -- 172.21.15.90:0/1660247442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c00cb300 con 0x7ff1a8005210 2024-09-10T23:14:44.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.607+0000 7ff1c6ef7640 1 -- 172.21.15.90:0/1660247442 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c00cfe50 con 0x7ff1a8005210 2024-09-10T23:14:44.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.608+0000 7ff1bd7fa640 1 -- 172.21.15.90:0/1660247442 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff1b0011c00 con 0x7ff1a8005210 2024-09-10T23:14:44.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.608+0000 7ff1bd7fa640 1 --2- 172.21.15.90:0/1660247442 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff1ac077fa0 0x7ff1ac07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:44.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.609+0000 7ff1bd7fa640 1 -- 172.21.15.90:0/1660247442 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff1b009a540 con 0x7ff1a8005210 2024-09-10T23:14:44.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.609+0000 7ff1bffff640 1 --2- 172.21.15.90:0/1660247442 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff1ac077fa0 0x7ff1ac07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:44.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.609+0000 7ff1bffff640 1 --2- 172.21.15.90:0/1660247442 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff1ac077fa0 0x7ff1ac07a460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4001220 tx=0x7ff1b40067a0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:44.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.613+0000 7ff1bd7fa640 1 -- 172.21.15.90:0/1660247442 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff1b0020020 con 0x7ff1a8005210 2024-09-10T23:14:44.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.786+0000 7ff1c6ef7640 1 -- 172.21.15.90:0/1660247442 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff1c00749d0 con 0x7ff1ac077fa0 2024-09-10T23:14:44.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.791+0000 7ff1bd7fa640 1 -- 172.21.15.90:0/1660247442 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251923 (secure 0 0 0) 0x7ff1c00749d0 con 0x7ff1ac077fa0 2024-09-10T23:14:44.794 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:44.795 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:14:44.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.794+0000 7ff1c6ef7640 1 -- 172.21.15.90:0/1660247442 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff1ac077fa0 msgr2=0x7ff1ac07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:44.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.794+0000 7ff1c6ef7640 1 --2- 172.21.15.90:0/1660247442 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff1ac077fa0 0x7ff1ac07a460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4001220 tx=0x7ff1b40067a0 comp rx=0 tx=0).stop 2024-09-10T23:14:44.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.794+0000 7ff1c6ef7640 1 -- 172.21.15.90:0/1660247442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1a8005210 msgr2=0x7ff1c00c4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:44.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.794+0000 7ff1c6ef7640 1 --2- 172.21.15.90:0/1660247442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1a8005210 0x7ff1c00c4be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0003f90 tx=0x7ff1b000f7e0 comp rx=0 tx=0).stop 2024-09-10T23:14:44.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.794+0000 7ff1c6ef7640 1 -- 172.21.15.90:0/1660247442 shutdown_connections 2024-09-10T23:14:44.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.794+0000 7ff1c6ef7640 1 --2- 172.21.15.90:0/1660247442 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff1ac077fa0 0x7ff1ac07a460 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:44.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.794+0000 7ff1c6ef7640 1 --2- 172.21.15.90:0/1660247442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1c00c8ea0 0x7ff1c00c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:44.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.794+0000 7ff1c6ef7640 1 --2- 172.21.15.90:0/1660247442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1c01f5680 0x7ff1c01f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:44.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.794+0000 7ff1c6ef7640 1 --2- 172.21.15.90:0/1660247442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1a8005210 0x7ff1c00c4be0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:44.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.794+0000 7ff1c6ef7640 1 -- 172.21.15.90:0/1660247442 >> 172.21.15.90:0/1660247442 conn(0x7ff1c00d1dd0 msgr2=0x7ff1c0159f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:44.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.794+0000 7ff1c6ef7640 1 -- 172.21.15.90:0/1660247442 shutdown_connections 2024-09-10T23:14:44.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.794+0000 7ff1c6ef7640 1 -- 172.21.15.90:0/1660247442 wait complete. 2024-09-10T23:14:44.806 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-10T23:14:44.434926+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219304,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755416,"statfs":{"total":773094113280,"available":772869545984,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.301903"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550557+0000","last_change":"2024-09-10T23:14:36.157525+0000","last_active":"2024-09-10T23:14:38.550557+0000","last_peered":"2024-09-10T23:14:38.550557+0000","last_clean":"2024-09-10T23:14:38.550557+0000","last_became_active":"2024-09-10T23:14:36.157019+0000","last_became_peered":"2024-09-10T23:14:36.157019+0000","last_unstale":"2024-09-10T23:14:38.550557+0000","last_undegraded":"2024-09-10T23:14:38.550557+0000","last_fullsized":"2024-09-10T23:14:38.550557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:16.389050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150199+0000","last_change":"2024-09-10T23:14:36.152453+0000","last_active":"2024-09-10T23:14:37.150199+0000","last_peered":"2024-09-10T23:14:37.150199+0000","last_clean":"2024-09-10T23:14:37.150199+0000","last_became_active":"2024-09-10T23:14:36.152182+0000","last_became_peered":"2024-09-10T23:14:36.152182+0000","last_unstale":"2024-09-10T23:14:37.150199+0000","last_undegraded":"2024-09-10T23:14:37.150199+0000","last_fullsized":"2024-09-10T23:14:37.150199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:25.629769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550144+0000","last_change":"2024-09-10T23:14:36.148244+0000","last_active":"2024-09-10T23:14:38.550144+0000","last_peered":"2024-09-10T23:14:38.550144+0000","last_clean":"2024-09-10T23:14:38.550144+0000","last_became_active":"2024-09-10T23:14:36.147940+0000","last_became_peered":"2024-09-10T23:14:36.147940+0000","last_unstale":"2024-09-10T23:14:38.550144+0000","last_undegraded":"2024-09-10T23:14:38.550144+0000","last_fullsized":"2024-09-10T23:14:38.550144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:14.738749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141919+0000","last_change":"2024-09-10T23:14:36.147531+0000","last_active":"2024-09-10T23:14:37.141919+0000","last_peered":"2024-09-10T23:14:37.141919+0000","last_clean":"2024-09-10T23:14:37.141919+0000","last_became_active":"2024-09-10T23:14:36.146965+0000","last_became_peered":"2024-09-10T23:14:36.146965+0000","last_unstale":"2024-09-10T23:14:37.141919+0000","last_undegraded":"2024-09-10T23:14:37.141919+0000","last_fullsized":"2024-09-10T23:14:37.141919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:52.426211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550241+0000","last_change":"2024-09-10T23:14:36.153446+0000","last_active":"2024-09-10T23:14:38.550241+0000","last_peered":"2024-09-10T23:14:38.550241+0000","last_clean":"2024-09-10T23:14:38.550241+0000","last_became_active":"2024-09-10T23:14:36.152291+0000","last_became_peered":"2024-09-10T23:14:36.152291+0000","last_unstale":"2024-09-10T23:14:38.550241+0000","last_undegraded":"2024-09-10T23:14:38.550241+0000","last_fullsized":"2024-09-10T23:14:38.550241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:44.783941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140958+0000","last_change":"2024-09-10T23:14:36.154507+0000","last_active":"2024-09-10T23:14:37.140958+0000","last_peered":"2024-09-10T23:14:37.140958+0000","last_clean":"2024-09-10T23:14:37.140958+0000","last_became_active":"2024-09-10T23:14:36.154186+0000","last_became_peered":"2024-09-10T23:14:36.154186+0000","last_unstale":"2024-09-10T23:14:37.140958+0000","last_undegraded":"2024-09-10T23:14:37.140958+0000","last_fullsized":"2024-09-10T23:14:37.140958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:53.614015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549991+0000","last_change":"2024-09-10T23:14:36.156472+0000","last_active":"2024-09-10T23:14:38.549991+0000","last_peered":"2024-09-10T23:14:38.549991+0000","last_clean":"2024-09-10T23:14:38.549991+0000","last_became_active":"2024-09-10T23:14:36.156157+0000","last_became_peered":"2024-09-10T23:14:36.156157+0000","last_unstale":"2024-09-10T23:14:38.549991+0000","last_undegraded":"2024-09-10T23:14:38.549991+0000","last_fullsized":"2024-09-10T23:14:38.549991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:04.288672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139515+0000","last_change":"2024-09-10T23:14:36.152200+0000","last_active":"2024-09-10T23:14:37.139515+0000","last_peered":"2024-09-10T23:14:37.139515+0000","last_clean":"2024-09-10T23:14:37.139515+0000","last_became_active":"2024-09-10T23:14:36.151338+0000","last_became_peered":"2024-09-10T23:14:36.151338+0000","last_unstale":"2024-09-10T23:14:37.139515+0000","last_undegraded":"2024-09-10T23:14:37.139515+0000","last_fullsized":"2024-09-10T23:14:37.139515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:51.090210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550576+0000","last_change":"2024-09-10T23:14:36.154027+0000","last_active":"2024-09-10T23:14:38.550576+0000","last_peered":"2024-09-10T23:14:38.550576+0000","last_clean":"2024-09-10T23:14:38.550576+0000","last_became_active":"2024-09-10T23:14:36.153704+0000","last_became_peered":"2024-09-10T23:14:36.153704+0000","last_unstale":"2024-09-10T23:14:38.550576+0000","last_undegraded":"2024-09-10T23:14:38.550576+0000","last_fullsized":"2024-09-10T23:14:38.550576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:18.861499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152342+0000","last_change":"2024-09-10T23:14:36.159590+0000","last_active":"2024-09-10T23:14:37.152342+0000","last_peered":"2024-09-10T23:14:37.152342+0000","last_clean":"2024-09-10T23:14:37.152342+0000","last_became_active":"2024-09-10T23:14:36.159315+0000","last_became_peered":"2024-09-10T23:14:36.159315+0000","last_unstale":"2024-09-10T23:14:37.152342+0000","last_undegraded":"2024-09-10T23:14:37.152342+0000","last_fullsized":"2024-09-10T23:14:37.152342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:21:21.970379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152280+0000","last_change":"2024-09-10T23:14:36.152936+0000","last_active":"2024-09-10T23:14:37.152280+0000","last_peered":"2024-09-10T23:14:37.152280+0000","last_clean":"2024-09-10T23:14:37.152280+0000","last_became_active":"2024-09-10T23:14:36.152606+0000","last_became_peered":"2024-09-10T23:14:36.152606+0000","last_unstale":"2024-09-10T23:14:37.152280+0000","last_undegraded":"2024-09-10T23:14:37.152280+0000","last_fullsized":"2024-09-10T23:14:37.152280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:09.306575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141439+0000","last_change":"2024-09-10T23:14:36.153356+0000","last_active":"2024-09-10T23:14:37.141439+0000","last_peered":"2024-09-10T23:14:37.141439+0000","last_clean":"2024-09-10T23:14:37.141439+0000","last_became_active":"2024-09-10T23:14:36.153096+0000","last_became_peered":"2024-09-10T23:14:36.153096+0000","last_unstale":"2024-09-10T23:14:37.141439+0000","last_undegraded":"2024-09-10T23:14:37.141439+0000","last_fullsized":"2024-09-10T23:14:37.141439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:27.153088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139741+0000","last_change":"2024-09-10T23:14:36.154715+0000","last_active":"2024-09-10T23:14:37.139741+0000","last_peered":"2024-09-10T23:14:37.139741+0000","last_clean":"2024-09-10T23:14:37.139741+0000","last_became_active":"2024-09-10T23:14:36.154463+0000","last_became_peered":"2024-09-10T23:14:36.154463+0000","last_unstale":"2024-09-10T23:14:37.139741+0000","last_undegraded":"2024-09-10T23:14:37.139741+0000","last_fullsized":"2024-09-10T23:14:37.139741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:12.246804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549988+0000","last_change":"2024-09-10T23:14:36.150886+0000","last_active":"2024-09-10T23:14:38.549988+0000","last_peered":"2024-09-10T23:14:38.549988+0000","last_clean":"2024-09-10T23:14:38.549988+0000","last_became_active":"2024-09-10T23:14:36.150523+0000","last_became_peered":"2024-09-10T23:14:36.150523+0000","last_unstale":"2024-09-10T23:14:38.549988+0000","last_undegraded":"2024-09-10T23:14:38.549988+0000","last_fullsized":"2024-09-10T23:14:38.549988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:13.596941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.149903+0000","last_change":"2024-09-10T23:14:36.147483+0000","last_active":"2024-09-10T23:14:37.149903+0000","last_peered":"2024-09-10T23:14:37.149903+0000","last_clean":"2024-09-10T23:14:37.149903+0000","last_became_active":"2024-09-10T23:14:36.147242+0000","last_became_peered":"2024-09-10T23:14:36.147242+0000","last_unstale":"2024-09-10T23:14:37.149903+0000","last_undegraded":"2024-09-10T23:14:37.149903+0000","last_fullsized":"2024-09-10T23:14:37.149903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:54.426629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140650+0000","last_change":"2024-09-10T23:14:36.151723+0000","last_active":"2024-09-10T23:14:37.140650+0000","last_peered":"2024-09-10T23:14:37.140650+0000","last_clean":"2024-09-10T23:14:37.140650+0000","last_became_active":"2024-09-10T23:14:36.151442+0000","last_became_peered":"2024-09-10T23:14:36.151442+0000","last_unstale":"2024-09-10T23:14:37.140650+0000","last_undegraded":"2024-09-10T23:14:37.140650+0000","last_fullsized":"2024-09-10T23:14:37.140650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:17.368639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141988+0000","last_change":"2024-09-10T23:14:36.153862+0000","last_active":"2024-09-10T23:14:37.141988+0000","last_peered":"2024-09-10T23:14:37.141988+0000","last_clean":"2024-09-10T23:14:37.141988+0000","last_became_active":"2024-09-10T23:14:36.152179+0000","last_became_peered":"2024-09-10T23:14:36.152179+0000","last_unstale":"2024-09-10T23:14:37.141988+0000","last_undegraded":"2024-09-10T23:14:37.141988+0000","last_fullsized":"2024-09-10T23:14:37.141988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:33:53.930716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549831+0000","last_change":"2024-09-10T23:14:36.158706+0000","last_active":"2024-09-10T23:14:38.549831+0000","last_peered":"2024-09-10T23:14:38.549831+0000","last_clean":"2024-09-10T23:14:38.549831+0000","last_became_active":"2024-09-10T23:14:36.158420+0000","last_became_peered":"2024-09-10T23:14:36.158420+0000","last_unstale":"2024-09-10T23:14:38.549831+0000","last_undegraded":"2024-09-10T23:14:38.549831+0000","last_fullsized":"2024-09-10T23:14:38.549831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:08.892988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550685+0000","last_change":"2024-09-10T23:14:36.152726+0000","last_active":"2024-09-10T23:14:38.550685+0000","last_peered":"2024-09-10T23:14:38.550685+0000","last_clean":"2024-09-10T23:14:38.550685+0000","last_became_active":"2024-09-10T23:14:36.152374+0000","last_became_peered":"2024-09-10T23:14:36.152374+0000","last_unstale":"2024-09-10T23:14:38.550685+0000","last_undegraded":"2024-09-10T23:14:38.550685+0000","last_fullsized":"2024-09-10T23:14:38.550685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:12.992438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152157+0000","last_change":"2024-09-10T23:14:36.150916+0000","last_active":"2024-09-10T23:14:37.152157+0000","last_peered":"2024-09-10T23:14:37.152157+0000","last_clean":"2024-09-10T23:14:37.152157+0000","last_became_active":"2024-09-10T23:14:36.150604+0000","last_became_peered":"2024-09-10T23:14:36.150604+0000","last_unstale":"2024-09-10T23:14:37.152157+0000","last_undegraded":"2024-09-10T23:14:37.152157+0000","last_fullsized":"2024-09-10T23:14:37.152157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:54.426629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550184+0000","last_change":"2024-09-10T23:14:36.157805+0000","last_active":"2024-09-10T23:14:38.550184+0000","last_peered":"2024-09-10T23:14:38.550184+0000","last_clean":"2024-09-10T23:14:38.550184+0000","last_became_active":"2024-09-10T23:14:36.157536+0000","last_became_peered":"2024-09-10T23:14:36.157536+0000","last_unstale":"2024-09-10T23:14:38.550184+0000","last_undegraded":"2024-09-10T23:14:38.550184+0000","last_fullsized":"2024-09-10T23:14:38.550184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:40.133768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141173+0000","last_change":"2024-09-10T23:14:36.152281+0000","last_active":"2024-09-10T23:14:37.141173+0000","last_peered":"2024-09-10T23:14:37.141173+0000","last_clean":"2024-09-10T23:14:37.141173+0000","last_became_active":"2024-09-10T23:14:36.151529+0000","last_became_peered":"2024-09-10T23:14:36.151529+0000","last_unstale":"2024-09-10T23:14:37.141173+0000","last_undegraded":"2024-09-10T23:14:37.141173+0000","last_fullsized":"2024-09-10T23:14:37.141173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:11.115291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139685+0000","last_change":"2024-09-10T23:14:36.147303+0000","last_active":"2024-09-10T23:14:37.139685+0000","last_peered":"2024-09-10T23:14:37.139685+0000","last_clean":"2024-09-10T23:14:37.139685+0000","last_became_active":"2024-09-10T23:14:36.147060+0000","last_became_peered":"2024-09-10T23:14:36.147060+0000","last_unstale":"2024-09-10T23:14:37.139685+0000","last_undegraded":"2024-09-10T23:14:37.139685+0000","last_fullsized":"2024-09-10T23:14:37.139685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:09.306575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140708+0000","last_change":"2024-09-10T23:14:36.145720+0000","last_active":"2024-09-10T23:14:37.140708+0000","last_peered":"2024-09-10T23:14:37.140708+0000","last_clean":"2024-09-10T23:14:37.140708+0000","last_became_active":"2024-09-10T23:14:36.145429+0000","last_became_peered":"2024-09-10T23:14:36.145429+0000","last_unstale":"2024-09-10T23:14:37.140708+0000","last_undegraded":"2024-09-10T23:14:37.140708+0000","last_fullsized":"2024-09-10T23:14:37.140708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:25.629769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139719+0000","last_change":"2024-09-10T23:14:36.146763+0000","last_active":"2024-09-10T23:14:37.139719+0000","last_peered":"2024-09-10T23:14:37.139719+0000","last_clean":"2024-09-10T23:14:37.139719+0000","last_became_active":"2024-09-10T23:14:36.146527+0000","last_became_peered":"2024-09-10T23:14:36.146527+0000","last_unstale":"2024-09-10T23:14:37.139719+0000","last_undegraded":"2024-09-10T23:14:37.139719+0000","last_fullsized":"2024-09-10T23:14:37.139719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:17.368639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152398+0000","last_change":"2024-09-10T23:14:36.156168+0000","last_active":"2024-09-10T23:14:37.152398+0000","last_peered":"2024-09-10T23:14:37.152398+0000","last_clean":"2024-09-10T23:14:37.152398+0000","last_became_active":"2024-09-10T23:14:36.155916+0000","last_became_peered":"2024-09-10T23:14:36.155916+0000","last_unstale":"2024-09-10T23:14:37.152398+0000","last_undegraded":"2024-09-10T23:14:37.152398+0000","last_fullsized":"2024-09-10T23:14:37.152398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:25.629769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150143+0000","last_change":"2024-09-10T23:14:36.146397+0000","last_active":"2024-09-10T23:14:37.150143+0000","last_peered":"2024-09-10T23:14:37.150143+0000","last_clean":"2024-09-10T23:14:37.150143+0000","last_became_active":"2024-09-10T23:14:36.146152+0000","last_became_peered":"2024-09-10T23:14:36.146152+0000","last_unstale":"2024-09-10T23:14:37.150143+0000","last_undegraded":"2024-09-10T23:14:37.150143+0000","last_fullsized":"2024-09-10T23:14:37.150143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:17.368639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139875+0000","last_change":"2024-09-10T23:14:36.146125+0000","last_active":"2024-09-10T23:14:37.139875+0000","last_peered":"2024-09-10T23:14:37.139875+0000","last_clean":"2024-09-10T23:14:37.139875+0000","last_became_active":"2024-09-10T23:14:36.145863+0000","last_became_peered":"2024-09-10T23:14:36.145863+0000","last_unstale":"2024-09-10T23:14:37.139875+0000","last_undegraded":"2024-09-10T23:14:37.139875+0000","last_fullsized":"2024-09-10T23:14:37.139875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:25.629769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550206+0000","last_change":"2024-09-10T23:14:36.152030+0000","last_active":"2024-09-10T23:14:38.550206+0000","last_peered":"2024-09-10T23:14:38.550206+0000","last_clean":"2024-09-10T23:14:38.550206+0000","last_became_active":"2024-09-10T23:14:36.151377+0000","last_became_peered":"2024-09-10T23:14:36.151377+0000","last_unstale":"2024-09-10T23:14:38.550206+0000","last_undegraded":"2024-09-10T23:14:38.550206+0000","last_fullsized":"2024-09-10T23:14:38.550206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:43.028083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141416+0000","last_change":"2024-09-10T23:14:36.148781+0000","last_active":"2024-09-10T23:14:37.141416+0000","last_peered":"2024-09-10T23:14:37.141416+0000","last_clean":"2024-09-10T23:14:37.141416+0000","last_became_active":"2024-09-10T23:14:36.148514+0000","last_became_peered":"2024-09-10T23:14:36.148514+0000","last_unstale":"2024-09-10T23:14:37.141416+0000","last_undegraded":"2024-09-10T23:14:37.141416+0000","last_fullsized":"2024-09-10T23:14:37.141416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:04.288672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549603+0000","last_change":"2024-09-10T23:14:36.142412+0000","last_active":"2024-09-10T23:14:38.549603+0000","last_peered":"2024-09-10T23:14:38.549603+0000","last_clean":"2024-09-10T23:14:38.549603+0000","last_became_active":"2024-09-10T23:14:36.142104+0000","last_became_peered":"2024-09-10T23:14:36.142104+0000","last_unstale":"2024-09-10T23:14:38.549603+0000","last_undegraded":"2024-09-10T23:14:38.549603+0000","last_fullsized":"2024-09-10T23:14:38.549603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:19.143333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152290+0000","last_change":"2024-09-10T23:14:36.155544+0000","last_active":"2024-09-10T23:14:37.152290+0000","last_peered":"2024-09-10T23:14:37.152290+0000","last_clean":"2024-09-10T23:14:37.152290+0000","last_became_active":"2024-09-10T23:14:36.155266+0000","last_became_peered":"2024-09-10T23:14:36.155266+0000","last_unstale":"2024-09-10T23:14:37.152290+0000","last_undegraded":"2024-09-10T23:14:37.152290+0000","last_fullsized":"2024-09-10T23:14:37.152290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:11.830037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141010+0000","last_change":"2024-09-10T23:14:36.151970+0000","last_active":"2024-09-10T23:14:37.141010+0000","last_peered":"2024-09-10T23:14:37.141010+0000","last_clean":"2024-09-10T23:14:37.141010+0000","last_became_active":"2024-09-10T23:14:36.151677+0000","last_became_peered":"2024-09-10T23:14:36.151677+0000","last_unstale":"2024-09-10T23:14:37.141010+0000","last_undegraded":"2024-09-10T23:14:37.141010+0000","last_fullsized":"2024-09-10T23:14:37.141010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:49.850113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139903+0000","last_change":"2024-09-10T23:14:35.127806+0000","last_active":"2024-09-10T23:14:37.139903+0000","last_peered":"2024-09-10T23:14:37.139903+0000","last_clean":"2024-09-10T23:14:37.139903+0000","last_became_active":"2024-09-10T23:14:35.127548+0000","last_became_peered":"2024-09-10T23:14:35.127548+0000","last_unstale":"2024-09-10T23:14:37.139903+0000","last_undegraded":"2024-09-10T23:14:37.139903+0000","last_fullsized":"2024-09-10T23:14:37.139903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:00.433782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550342+0000","last_change":"2024-09-10T23:14:36.151022+0000","last_active":"2024-09-10T23:14:38.550342+0000","last_peered":"2024-09-10T23:14:38.550342+0000","last_clean":"2024-09-10T23:14:38.550342+0000","last_became_active":"2024-09-10T23:14:36.150753+0000","last_became_peered":"2024-09-10T23:14:36.150753+0000","last_unstale":"2024-09-10T23:14:38.550342+0000","last_undegraded":"2024-09-10T23:14:38.550342+0000","last_fullsized":"2024-09-10T23:14:38.550342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:49.125136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.151995+0000","last_change":"2024-09-10T23:14:35.125689+0000","last_active":"2024-09-10T23:14:37.151995+0000","last_peered":"2024-09-10T23:14:37.151995+0000","last_clean":"2024-09-10T23:14:37.151995+0000","last_became_active":"2024-09-10T23:14:35.124148+0000","last_became_peered":"2024-09-10T23:14:35.124148+0000","last_unstale":"2024-09-10T23:14:37.151995+0000","last_undegraded":"2024-09-10T23:14:37.151995+0000","last_fullsized":"2024-09-10T23:14:37.151995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:26.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139928+0000","last_change":"2024-09-10T23:14:35.130875+0000","last_active":"2024-09-10T23:14:37.139928+0000","last_peered":"2024-09-10T23:14:37.139928+0000","last_clean":"2024-09-10T23:14:37.139928+0000","last_became_active":"2024-09-10T23:14:35.130552+0000","last_became_peered":"2024-09-10T23:14:35.130552+0000","last_unstale":"2024-09-10T23:14:37.139928+0000","last_undegraded":"2024-09-10T23:14:37.139928+0000","last_fullsized":"2024-09-10T23:14:37.139928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139600+0000","last_change":"2024-09-10T23:14:36.153264+0000","last_active":"2024-09-10T23:14:37.139600+0000","last_peered":"2024-09-10T23:14:37.139600+0000","last_clean":"2024-09-10T23:14:37.139600+0000","last_became_active":"2024-09-10T23:14:36.153009+0000","last_became_peered":"2024-09-10T23:14:36.153009+0000","last_unstale":"2024-09-10T23:14:37.139600+0000","last_undegraded":"2024-09-10T23:14:37.139600+0000","last_fullsized":"2024-09-10T23:14:37.139600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:54.426629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140838+0000","last_change":"2024-09-10T23:14:35.123317+0000","last_active":"2024-09-10T23:14:37.140838+0000","last_peered":"2024-09-10T23:14:37.140838+0000","last_clean":"2024-09-10T23:14:37.140838+0000","last_became_active":"2024-09-10T23:14:35.123043+0000","last_became_peered":"2024-09-10T23:14:35.123043+0000","last_unstale":"2024-09-10T23:14:37.140838+0000","last_undegraded":"2024-09-10T23:14:37.140838+0000","last_fullsized":"2024-09-10T23:14:37.140838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:44.244654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.149909+0000","last_change":"2024-09-10T23:14:36.149488+0000","last_active":"2024-09-10T23:14:37.149909+0000","last_peered":"2024-09-10T23:14:37.149909+0000","last_clean":"2024-09-10T23:14:37.149909+0000","last_became_active":"2024-09-10T23:14:36.149221+0000","last_became_peered":"2024-09-10T23:14:36.149221+0000","last_unstale":"2024-09-10T23:14:37.149909+0000","last_undegraded":"2024-09-10T23:14:37.149909+0000","last_fullsized":"2024-09-10T23:14:37.149909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:55.476145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152279+0000","last_change":"2024-09-10T23:14:35.129118+0000","last_active":"2024-09-10T23:14:37.152279+0000","last_peered":"2024-09-10T23:14:37.152279+0000","last_clean":"2024-09-10T23:14:37.152279+0000","last_became_active":"2024-09-10T23:14:35.128858+0000","last_became_peered":"2024-09-10T23:14:35.128858+0000","last_unstale":"2024-09-10T23:14:37.152279+0000","last_undegraded":"2024-09-10T23:14:37.152279+0000","last_fullsized":"2024-09-10T23:14:37.152279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:00.727658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141203+0000","last_change":"2024-09-10T23:14:36.152153+0000","last_active":"2024-09-10T23:14:37.141203+0000","last_peered":"2024-09-10T23:14:37.141203+0000","last_clean":"2024-09-10T23:14:37.141203+0000","last_became_active":"2024-09-10T23:14:36.151862+0000","last_became_peered":"2024-09-10T23:14:36.151862+0000","last_unstale":"2024-09-10T23:14:37.141203+0000","last_undegraded":"2024-09-10T23:14:37.141203+0000","last_fullsized":"2024-09-10T23:14:37.141203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:28.160849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141363+0000","last_change":"2024-09-10T23:14:35.130807+0000","last_active":"2024-09-10T23:14:37.141363+0000","last_peered":"2024-09-10T23:14:37.141363+0000","last_clean":"2024-09-10T23:14:37.141363+0000","last_became_active":"2024-09-10T23:14:35.130541+0000","last_became_peered":"2024-09-10T23:14:35.130541+0000","last_unstale":"2024-09-10T23:14:37.141363+0000","last_undegraded":"2024-09-10T23:14:37.141363+0000","last_fullsized":"2024-09-10T23:14:37.141363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:48.848197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550023+0000","last_change":"2024-09-10T23:14:36.149079+0000","last_active":"2024-09-10T23:14:38.550023+0000","last_peered":"2024-09-10T23:14:38.550023+0000","last_clean":"2024-09-10T23:14:38.550023+0000","last_became_active":"2024-09-10T23:14:36.148726+0000","last_became_peered":"2024-09-10T23:14:36.148726+0000","last_unstale":"2024-09-10T23:14:38.550023+0000","last_undegraded":"2024-09-10T23:14:38.550023+0000","last_fullsized":"2024-09-10T23:14:38.550023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:52.012404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150094+0000","last_change":"2024-09-10T23:14:35.122724+0000","last_active":"2024-09-10T23:14:37.150094+0000","last_peered":"2024-09-10T23:14:37.150094+0000","last_clean":"2024-09-10T23:14:37.150094+0000","last_became_active":"2024-09-10T23:14:35.119910+0000","last_became_peered":"2024-09-10T23:14:35.119910+0000","last_unstale":"2024-09-10T23:14:37.150094+0000","last_undegraded":"2024-09-10T23:14:37.150094+0000","last_fullsized":"2024-09-10T23:14:37.150094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:52.598287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141829+0000","last_change":"2024-09-10T23:14:36.155881+0000","last_active":"2024-09-10T23:14:37.141829+0000","last_peered":"2024-09-10T23:14:37.141829+0000","last_clean":"2024-09-10T23:14:37.141829+0000","last_became_active":"2024-09-10T23:14:36.155598+0000","last_became_peered":"2024-09-10T23:14:36.155598+0000","last_unstale":"2024-09-10T23:14:37.141829+0000","last_undegraded":"2024-09-10T23:14:37.141829+0000","last_fullsized":"2024-09-10T23:14:37.141829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:19.143333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152332+0000","last_change":"2024-09-10T23:14:35.127319+0000","last_active":"2024-09-10T23:14:37.152332+0000","last_peered":"2024-09-10T23:14:37.152332+0000","last_clean":"2024-09-10T23:14:37.152332+0000","last_became_active":"2024-09-10T23:14:35.127042+0000","last_became_peered":"2024-09-10T23:14:35.127042+0000","last_unstale":"2024-09-10T23:14:37.152332+0000","last_undegraded":"2024-09-10T23:14:37.152332+0000","last_fullsized":"2024-09-10T23:14:37.152332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:48.848197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550250+0000","last_change":"2024-09-10T23:14:36.150360+0000","last_active":"2024-09-10T23:14:38.550250+0000","last_peered":"2024-09-10T23:14:38.550250+0000","last_clean":"2024-09-10T23:14:38.550250+0000","last_became_active":"2024-09-10T23:14:36.150031+0000","last_became_peered":"2024-09-10T23:14:36.150031+0000","last_unstale":"2024-09-10T23:14:38.550250+0000","last_undegraded":"2024-09-10T23:14:38.550250+0000","last_fullsized":"2024-09-10T23:14:38.550250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:52.426211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550432+0000","last_change":"2024-09-10T23:14:35.123801+0000","last_active":"2024-09-10T23:14:38.550432+0000","last_peered":"2024-09-10T23:14:38.550432+0000","last_clean":"2024-09-10T23:14:38.550432+0000","last_became_active":"2024-09-10T23:14:35.123332+0000","last_became_peered":"2024-09-10T23:14:35.123332+0000","last_unstale":"2024-09-10T23:14:38.550432+0000","last_undegraded":"2024-09-10T23:14:38.550432+0000","last_fullsized":"2024-09-10T23:14:38.550432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:57.857780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550087+0000","last_change":"2024-09-10T23:14:36.153086+0000","last_active":"2024-09-10T23:14:38.550087+0000","last_peered":"2024-09-10T23:14:38.550087+0000","last_clean":"2024-09-10T23:14:38.550087+0000","last_became_active":"2024-09-10T23:14:36.152843+0000","last_became_peered":"2024-09-10T23:14:36.152843+0000","last_unstale":"2024-09-10T23:14:38.550087+0000","last_undegraded":"2024-09-10T23:14:38.550087+0000","last_fullsized":"2024-09-10T23:14:38.550087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:59.216035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141525+0000","last_change":"2024-09-10T23:14:35.130442+0000","last_active":"2024-09-10T23:14:37.141525+0000","last_peered":"2024-09-10T23:14:37.141525+0000","last_clean":"2024-09-10T23:14:37.141525+0000","last_became_active":"2024-09-10T23:14:35.130131+0000","last_became_peered":"2024-09-10T23:14:35.130131+0000","last_unstale":"2024-09-10T23:14:37.141525+0000","last_undegraded":"2024-09-10T23:14:37.141525+0000","last_fullsized":"2024-09-10T23:14:37.141525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:26.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550333+0000","last_change":"2024-09-10T23:14:36.153529+0000","last_active":"2024-09-10T23:14:38.550333+0000","last_peered":"2024-09-10T23:14:38.550333+0000","last_clean":"2024-09-10T23:14:38.550333+0000","last_became_active":"2024-09-10T23:14:36.153131+0000","last_became_peered":"2024-09-10T23:14:36.153131+0000","last_unstale":"2024-09-10T23:14:38.550333+0000","last_undegraded":"2024-09-10T23:14:38.550333+0000","last_fullsized":"2024-09-10T23:14:38.550333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:33:53.930716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152026+0000","last_change":"2024-09-10T23:14:35.129215+0000","last_active":"2024-09-10T23:14:37.152026+0000","last_peered":"2024-09-10T23:14:37.152026+0000","last_clean":"2024-09-10T23:14:37.152026+0000","last_became_active":"2024-09-10T23:14:35.128170+0000","last_became_peered":"2024-09-10T23:14:35.128170+0000","last_unstale":"2024-09-10T23:14:37.152026+0000","last_undegraded":"2024-09-10T23:14:37.152026+0000","last_fullsized":"2024-09-10T23:14:37.152026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:44.244654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152200+0000","last_change":"2024-09-10T23:14:36.154580+0000","last_active":"2024-09-10T23:14:37.152200+0000","last_peered":"2024-09-10T23:14:37.152200+0000","last_clean":"2024-09-10T23:14:37.152200+0000","last_became_active":"2024-09-10T23:14:36.154172+0000","last_became_peered":"2024-09-10T23:14:36.154172+0000","last_unstale":"2024-09-10T23:14:37.152200+0000","last_undegraded":"2024-09-10T23:14:37.152200+0000","last_fullsized":"2024-09-10T23:14:37.152200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:12.246804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549517+0000","last_change":"2024-09-10T23:14:35.127072+0000","last_active":"2024-09-10T23:14:38.549517+0000","last_peered":"2024-09-10T23:14:38.549517+0000","last_clean":"2024-09-10T23:14:38.549517+0000","last_became_active":"2024-09-10T23:14:35.126776+0000","last_became_peered":"2024-09-10T23:14:35.126776+0000","last_unstale":"2024-09-10T23:14:38.549517+0000","last_undegraded":"2024-09-10T23:14:38.549517+0000","last_fullsized":"2024-09-10T23:14:38.549517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:50.458204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550012+0000","last_change":"2024-09-10T23:14:36.150674+0000","last_active":"2024-09-10T23:14:38.550012+0000","last_peered":"2024-09-10T23:14:38.550012+0000","last_clean":"2024-09-10T23:14:38.550012+0000","last_became_active":"2024-09-10T23:14:36.149916+0000","last_became_peered":"2024-09-10T23:14:36.149916+0000","last_unstale":"2024-09-10T23:14:38.550012+0000","last_undegraded":"2024-09-10T23:14:38.550012+0000","last_fullsized":"2024-09-10T23:14:38.550012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:28.160849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141391+0000","last_change":"2024-09-10T23:14:35.130472+0000","last_active":"2024-09-10T23:14:37.141391+0000","last_peered":"2024-09-10T23:14:37.141391+0000","last_clean":"2024-09-10T23:14:37.141391+0000","last_became_active":"2024-09-10T23:14:35.130164+0000","last_became_peered":"2024-09-10T23:14:35.130164+0000","last_unstale":"2024-09-10T23:14:37.141391+0000","last_undegraded":"2024-09-10T23:14:37.141391+0000","last_fullsized":"2024-09-10T23:14:37.141391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:37.291436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550513+0000","last_change":"2024-09-10T23:14:36.153260+0000","last_active":"2024-09-10T23:14:38.550513+0000","last_peered":"2024-09-10T23:14:38.550513+0000","last_clean":"2024-09-10T23:14:38.550513+0000","last_became_active":"2024-09-10T23:14:36.152964+0000","last_became_peered":"2024-09-10T23:14:36.152964+0000","last_unstale":"2024-09-10T23:14:38.550513+0000","last_undegraded":"2024-09-10T23:14:38.550513+0000","last_fullsized":"2024-09-10T23:14:38.550513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:08.022145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549956+0000","last_change":"2024-09-10T23:14:35.130891+0000","last_active":"2024-09-10T23:14:38.549956+0000","last_peered":"2024-09-10T23:14:38.549956+0000","last_clean":"2024-09-10T23:14:38.549956+0000","last_became_active":"2024-09-10T23:14:35.130654+0000","last_became_peered":"2024-09-10T23:14:35.130654+0000","last_unstale":"2024-09-10T23:14:38.549956+0000","last_undegraded":"2024-09-10T23:14:38.549956+0000","last_fullsized":"2024-09-10T23:14:38.549956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:37.763702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550813+0000","last_change":"2024-09-10T23:14:36.152970+0000","last_active":"2024-09-10T23:14:38.550813+0000","last_peered":"2024-09-10T23:14:38.550813+0000","last_clean":"2024-09-10T23:14:38.550813+0000","last_became_active":"2024-09-10T23:14:36.152669+0000","last_became_peered":"2024-09-10T23:14:36.152669+0000","last_unstale":"2024-09-10T23:14:38.550813+0000","last_undegraded":"2024-09-10T23:14:38.550813+0000","last_fullsized":"2024-09-10T23:14:38.550813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:26.515458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150214+0000","last_change":"2024-09-10T23:14:35.121691+0000","last_active":"2024-09-10T23:14:37.150214+0000","last_peered":"2024-09-10T23:14:37.150214+0000","last_clean":"2024-09-10T23:14:37.150214+0000","last_became_active":"2024-09-10T23:14:35.121391+0000","last_became_peered":"2024-09-10T23:14:35.121391+0000","last_unstale":"2024-09-10T23:14:37.150214+0000","last_undegraded":"2024-09-10T23:14:37.150214+0000","last_fullsized":"2024-09-10T23:14:37.150214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:10.992208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.142206+0000","last_change":"2024-09-10T23:14:36.145872+0000","last_active":"2024-09-10T23:14:37.142206+0000","last_peered":"2024-09-10T23:14:37.142206+0000","last_clean":"2024-09-10T23:14:37.142206+0000","last_became_active":"2024-09-10T23:14:36.145477+0000","last_became_peered":"2024-09-10T23:14:36.145477+0000","last_unstale":"2024-09-10T23:14:37.142206+0000","last_undegraded":"2024-09-10T23:14:37.142206+0000","last_fullsized":"2024-09-10T23:14:37.142206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:16.389050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549809+0000","last_change":"2024-09-10T23:14:35.126188+0000","last_active":"2024-09-10T23:14:38.549809+0000","last_peered":"2024-09-10T23:14:38.549809+0000","last_clean":"2024-09-10T23:14:38.549809+0000","last_became_active":"2024-09-10T23:14:35.125868+0000","last_became_peered":"2024-09-10T23:14:35.125868+0000","last_unstale":"2024-09-10T23:14:38.549809+0000","last_undegraded":"2024-09-10T23:14:38.549809+0000","last_fullsized":"2024-09-10T23:14:38.549809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:40.440663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550457+0000","last_change":"2024-09-10T23:14:36.158261+0000","last_active":"2024-09-10T23:14:38.550457+0000","last_peered":"2024-09-10T23:14:38.550457+0000","last_clean":"2024-09-10T23:14:38.550457+0000","last_became_active":"2024-09-10T23:14:36.157994+0000","last_became_peered":"2024-09-10T23:14:36.157994+0000","last_unstale":"2024-09-10T23:14:38.550457+0000","last_undegraded":"2024-09-10T23:14:38.550457+0000","last_fullsized":"2024-09-10T23:14:38.550457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:42.507579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550004+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:14:38.550004+0000","last_peered":"2024-09-10T23:14:38.550004+0000","last_clean":"2024-09-10T23:14:38.550004+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:14:38.550004+0000","last_undegraded":"2024-09-10T23:14:38.550004+0000","last_fullsized":"2024-09-10T23:14:38.550004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140725+0000","last_change":"2024-09-10T23:14:35.126656+0000","last_active":"2024-09-10T23:14:37.140725+0000","last_peered":"2024-09-10T23:14:37.140725+0000","last_clean":"2024-09-10T23:14:37.140725+0000","last_became_active":"2024-09-10T23:14:35.126289+0000","last_became_peered":"2024-09-10T23:14:35.126289+0000","last_unstale":"2024-09-10T23:14:37.140725+0000","last_undegraded":"2024-09-10T23:14:37.140725+0000","last_fullsized":"2024-09-10T23:14:37.140725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139727+0000","last_change":"2024-09-10T23:14:36.151908+0000","last_active":"2024-09-10T23:14:37.139727+0000","last_peered":"2024-09-10T23:14:37.139727+0000","last_clean":"2024-09-10T23:14:37.139727+0000","last_became_active":"2024-09-10T23:14:36.151632+0000","last_became_peered":"2024-09-10T23:14:36.151632+0000","last_unstale":"2024-09-10T23:14:37.139727+0000","last_undegraded":"2024-09-10T23:14:37.139727+0000","last_fullsized":"2024-09-10T23:14:37.139727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:11.830037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549866+0000","last_change":"2024-09-10T23:14:35.132667+0000","last_active":"2024-09-10T23:14:38.549866+0000","last_peered":"2024-09-10T23:14:38.549866+0000","last_clean":"2024-09-10T23:14:38.549866+0000","last_became_active":"2024-09-10T23:14:35.132330+0000","last_became_peered":"2024-09-10T23:14:35.132330+0000","last_unstale":"2024-09-10T23:14:38.549866+0000","last_undegraded":"2024-09-10T23:14:38.549866+0000","last_fullsized":"2024-09-10T23:14:38.549866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:52.598287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549820+0000","last_change":"2024-09-10T23:14:36.149640+0000","last_active":"2024-09-10T23:14:38.549820+0000","last_peered":"2024-09-10T23:14:38.549820+0000","last_clean":"2024-09-10T23:14:38.549820+0000","last_became_active":"2024-09-10T23:14:36.148907+0000","last_became_peered":"2024-09-10T23:14:36.148907+0000","last_unstale":"2024-09-10T23:14:38.549820+0000","last_undegraded":"2024-09-10T23:14:38.549820+0000","last_fullsized":"2024-09-10T23:14:38.549820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:02.988430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549624+0000","last_change":"2024-09-10T23:14:35.130254+0000","last_active":"2024-09-10T23:14:38.549624+0000","last_peered":"2024-09-10T23:14:38.549624+0000","last_clean":"2024-09-10T23:14:38.549624+0000","last_became_active":"2024-09-10T23:14:35.129994+0000","last_became_peered":"2024-09-10T23:14:35.129994+0000","last_unstale":"2024-09-10T23:14:38.549624+0000","last_undegraded":"2024-09-10T23:14:38.549624+0000","last_fullsized":"2024-09-10T23:14:38.549624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.149929+0000","last_change":"2024-09-10T23:14:36.147135+0000","last_active":"2024-09-10T23:14:37.149929+0000","last_peered":"2024-09-10T23:14:37.149929+0000","last_clean":"2024-09-10T23:14:37.149929+0000","last_became_active":"2024-09-10T23:14:36.146791+0000","last_became_peered":"2024-09-10T23:14:36.146791+0000","last_unstale":"2024-09-10T23:14:37.149929+0000","last_undegraded":"2024-09-10T23:14:37.149929+0000","last_fullsized":"2024-09-10T23:14:37.149929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:20.756119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141573+0000","last_change":"2024-09-10T23:14:35.116348+0000","last_active":"2024-09-10T23:14:37.141573+0000","last_peered":"2024-09-10T23:14:37.141573+0000","last_clean":"2024-09-10T23:14:37.141573+0000","last_became_active":"2024-09-10T23:14:35.116063+0000","last_became_peered":"2024-09-10T23:14:35.116063+0000","last_unstale":"2024-09-10T23:14:37.141573+0000","last_undegraded":"2024-09-10T23:14:37.141573+0000","last_fullsized":"2024-09-10T23:14:37.141573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:52.598287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141784+0000","last_change":"2024-09-10T23:14:36.154237+0000","last_active":"2024-09-10T23:14:37.141784+0000","last_peered":"2024-09-10T23:14:37.141784+0000","last_clean":"2024-09-10T23:14:37.141784+0000","last_became_active":"2024-09-10T23:14:36.153966+0000","last_became_peered":"2024-09-10T23:14:36.153966+0000","last_unstale":"2024-09-10T23:14:37.141784+0000","last_undegraded":"2024-09-10T23:14:37.141784+0000","last_fullsized":"2024-09-10T23:14:37.141784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:36.806040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150055+0000","last_change":"2024-09-10T23:14:35.123920+0000","last_active":"2024-09-10T23:14:37.150055+0000","last_peered":"2024-09-10T23:14:37.150055+0000","last_clean":"2024-09-10T23:14:37.150055+0000","last_became_active":"2024-09-10T23:14:35.123644+0000","last_became_peered":"2024-09-10T23:14:35.123644+0000","last_unstale":"2024-09-10T23:14:37.150055+0000","last_undegraded":"2024-09-10T23:14:37.150055+0000","last_fullsized":"2024-09-10T23:14:37.150055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:26.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.142073+0000","last_change":"2024-09-10T23:14:36.145847+0000","last_active":"2024-09-10T23:14:37.142073+0000","last_peered":"2024-09-10T23:14:37.142073+0000","last_clean":"2024-09-10T23:14:37.142073+0000","last_became_active":"2024-09-10T23:14:36.145505+0000","last_became_peered":"2024-09-10T23:14:36.145505+0000","last_unstale":"2024-09-10T23:14:37.142073+0000","last_undegraded":"2024-09-10T23:14:37.142073+0000","last_fullsized":"2024-09-10T23:14:37.142073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:42.507579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550650+0000","last_change":"2024-09-10T23:14:35.133489+0000","last_active":"2024-09-10T23:14:38.550650+0000","last_peered":"2024-09-10T23:14:38.550650+0000","last_clean":"2024-09-10T23:14:38.550650+0000","last_became_active":"2024-09-10T23:14:35.133189+0000","last_became_peered":"2024-09-10T23:14:35.133189+0000","last_unstale":"2024-09-10T23:14:38.550650+0000","last_undegraded":"2024-09-10T23:14:38.550650+0000","last_fullsized":"2024-09-10T23:14:38.550650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:47.943661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.149972+0000","last_change":"2024-09-10T23:14:36.145337+0000","last_active":"2024-09-10T23:14:37.149972+0000","last_peered":"2024-09-10T23:14:37.149972+0000","last_clean":"2024-09-10T23:14:37.149972+0000","last_became_active":"2024-09-10T23:14:36.145030+0000","last_became_peered":"2024-09-10T23:14:36.145030+0000","last_unstale":"2024-09-10T23:14:37.149972+0000","last_undegraded":"2024-09-10T23:14:37.149972+0000","last_fullsized":"2024-09-10T23:14:37.149972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:12.246804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150235+0000","last_change":"2024-09-10T23:14:35.130762+0000","last_active":"2024-09-10T23:14:37.150235+0000","last_peered":"2024-09-10T23:14:37.150235+0000","last_clean":"2024-09-10T23:14:37.150235+0000","last_became_active":"2024-09-10T23:14:35.130502+0000","last_became_peered":"2024-09-10T23:14:35.130502+0000","last_unstale":"2024-09-10T23:14:37.150235+0000","last_undegraded":"2024-09-10T23:14:37.150235+0000","last_fullsized":"2024-09-10T23:14:37.150235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:37.092636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140000+0000","last_change":"2024-09-10T23:14:36.158417+0000","last_active":"2024-09-10T23:14:37.140000+0000","last_peered":"2024-09-10T23:14:37.140000+0000","last_clean":"2024-09-10T23:14:37.140000+0000","last_became_active":"2024-09-10T23:14:36.158157+0000","last_became_peered":"2024-09-10T23:14:36.158157+0000","last_unstale":"2024-09-10T23:14:37.140000+0000","last_undegraded":"2024-09-10T23:14:37.140000+0000","last_fullsized":"2024-09-10T23:14:37.140000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:11.115291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152322+0000","last_change":"2024-09-10T23:14:35.128484+0000","last_active":"2024-09-10T23:14:37.152322+0000","last_peered":"2024-09-10T23:14:37.152322+0000","last_clean":"2024-09-10T23:14:37.152322+0000","last_became_active":"2024-09-10T23:14:35.127877+0000","last_became_peered":"2024-09-10T23:14:35.127877+0000","last_unstale":"2024-09-10T23:14:37.152322+0000","last_undegraded":"2024-09-10T23:14:37.152322+0000","last_fullsized":"2024-09-10T23:14:37.152322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550037+0000","last_change":"2024-09-10T23:14:36.150091+0000","last_active":"2024-09-10T23:14:38.550037+0000","last_peered":"2024-09-10T23:14:38.550037+0000","last_clean":"2024-09-10T23:14:38.550037+0000","last_became_active":"2024-09-10T23:14:36.149727+0000","last_became_peered":"2024-09-10T23:14:36.149727+0000","last_unstale":"2024-09-10T23:14:38.550037+0000","last_undegraded":"2024-09-10T23:14:38.550037+0000","last_fullsized":"2024-09-10T23:14:38.550037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:30:11.421097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549852+0000","last_change":"2024-09-10T23:14:35.133467+0000","last_active":"2024-09-10T23:14:38.549852+0000","last_peered":"2024-09-10T23:14:38.549852+0000","last_clean":"2024-09-10T23:14:38.549852+0000","last_became_active":"2024-09-10T23:14:35.133163+0000","last_became_peered":"2024-09-10T23:14:35.133163+0000","last_unstale":"2024-09-10T23:14:38.549852+0000","last_undegraded":"2024-09-10T23:14:38.549852+0000","last_fullsized":"2024-09-10T23:14:38.549852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:12.209676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141682+0000","last_change":"2024-09-10T23:14:36.146249+0000","last_active":"2024-09-10T23:14:37.141682+0000","last_peered":"2024-09-10T23:14:37.141682+0000","last_clean":"2024-09-10T23:14:37.141682+0000","last_became_active":"2024-09-10T23:14:36.145993+0000","last_became_peered":"2024-09-10T23:14:36.145993+0000","last_unstale":"2024-09-10T23:14:37.141682+0000","last_undegraded":"2024-09-10T23:14:37.141682+0000","last_fullsized":"2024-09-10T23:14:37.141682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:53.600203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150057+0000","last_change":"2024-09-10T23:14:35.125619+0000","last_active":"2024-09-10T23:14:37.150057+0000","last_peered":"2024-09-10T23:14:37.150057+0000","last_clean":"2024-09-10T23:14:37.150057+0000","last_became_active":"2024-09-10T23:14:35.125258+0000","last_became_peered":"2024-09-10T23:14:35.125258+0000","last_unstale":"2024-09-10T23:14:37.150057+0000","last_undegraded":"2024-09-10T23:14:37.150057+0000","last_fullsized":"2024-09-10T23:14:37.150057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:44.244654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140094+0000","last_change":"2024-09-10T23:14:36.145873+0000","last_active":"2024-09-10T23:14:37.140094+0000","last_peered":"2024-09-10T23:14:37.140094+0000","last_clean":"2024-09-10T23:14:37.140094+0000","last_became_active":"2024-09-10T23:14:36.145109+0000","last_became_peered":"2024-09-10T23:14:36.145109+0000","last_unstale":"2024-09-10T23:14:37.140094+0000","last_undegraded":"2024-09-10T23:14:37.140094+0000","last_fullsized":"2024-09-10T23:14:37.140094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:28.160849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.149958+0000","last_change":"2024-09-10T23:14:35.124311+0000","last_active":"2024-09-10T23:14:37.149958+0000","last_peered":"2024-09-10T23:14:37.149958+0000","last_clean":"2024-09-10T23:14:37.149958+0000","last_became_active":"2024-09-10T23:14:35.124054+0000","last_became_peered":"2024-09-10T23:14:35.124054+0000","last_unstale":"2024-09-10T23:14:37.149958+0000","last_undegraded":"2024-09-10T23:14:37.149958+0000","last_fullsized":"2024-09-10T23:14:37.149958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:48.848197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139873+0000","last_change":"2024-09-10T23:14:36.155283+0000","last_active":"2024-09-10T23:14:37.139873+0000","last_peered":"2024-09-10T23:14:37.139873+0000","last_clean":"2024-09-10T23:14:37.139873+0000","last_became_active":"2024-09-10T23:14:36.154917+0000","last_became_peered":"2024-09-10T23:14:36.154917+0000","last_unstale":"2024-09-10T23:14:37.139873+0000","last_undegraded":"2024-09-10T23:14:37.139873+0000","last_fullsized":"2024-09-10T23:14:37.139873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:09.415499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550448+0000","last_change":"2024-09-10T23:14:35.128785+0000","last_active":"2024-09-10T23:14:38.550448+0000","last_peered":"2024-09-10T23:14:38.550448+0000","last_clean":"2024-09-10T23:14:38.550448+0000","last_became_active":"2024-09-10T23:14:35.128523+0000","last_became_peered":"2024-09-10T23:14:35.128523+0000","last_unstale":"2024-09-10T23:14:38.550448+0000","last_undegraded":"2024-09-10T23:14:38.550448+0000","last_fullsized":"2024-09-10T23:14:38.550448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:01.097187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152074+0000","last_change":"2024-09-10T23:14:36.153266+0000","last_active":"2024-09-10T23:14:37.152074+0000","last_peered":"2024-09-10T23:14:37.152074+0000","last_clean":"2024-09-10T23:14:37.152074+0000","last_became_active":"2024-09-10T23:14:36.152781+0000","last_became_peered":"2024-09-10T23:14:36.152781+0000","last_unstale":"2024-09-10T23:14:37.152074+0000","last_undegraded":"2024-09-10T23:14:37.152074+0000","last_fullsized":"2024-09-10T23:14:37.152074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:51.090210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141856+0000","last_change":"2024-09-10T23:14:36.149184+0000","last_active":"2024-09-10T23:14:37.141856+0000","last_peered":"2024-09-10T23:14:37.141856+0000","last_clean":"2024-09-10T23:14:37.141856+0000","last_became_active":"2024-09-10T23:14:36.146259+0000","last_became_peered":"2024-09-10T23:14:36.146259+0000","last_unstale":"2024-09-10T23:14:37.141856+0000","last_undegraded":"2024-09-10T23:14:37.141856+0000","last_fullsized":"2024-09-10T23:14:37.141856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:44.783941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550156+0000","last_change":"2024-09-10T23:14:35.128918+0000","last_active":"2024-09-10T23:14:38.550156+0000","last_peered":"2024-09-10T23:14:38.550156+0000","last_clean":"2024-09-10T23:14:38.550156+0000","last_became_active":"2024-09-10T23:14:35.128646+0000","last_became_peered":"2024-09-10T23:14:35.128646+0000","last_unstale":"2024-09-10T23:14:38.550156+0000","last_undegraded":"2024-09-10T23:14:38.550156+0000","last_fullsized":"2024-09-10T23:14:38.550156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:10.992208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.142141+0000","last_change":"2024-09-10T23:14:36.147233+0000","last_active":"2024-09-10T23:14:37.142141+0000","last_peered":"2024-09-10T23:14:37.142141+0000","last_clean":"2024-09-10T23:14:37.142141+0000","last_became_active":"2024-09-10T23:14:36.146609+0000","last_became_peered":"2024-09-10T23:14:36.146609+0000","last_unstale":"2024-09-10T23:14:37.142141+0000","last_undegraded":"2024-09-10T23:14:37.142141+0000","last_fullsized":"2024-09-10T23:14:37.142141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:08.022145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550494+0000","last_change":"2024-09-10T23:14:35.131443+0000","last_active":"2024-09-10T23:14:38.550494+0000","last_peered":"2024-09-10T23:14:38.550494+0000","last_clean":"2024-09-10T23:14:38.550494+0000","last_became_active":"2024-09-10T23:14:35.131123+0000","last_became_peered":"2024-09-10T23:14:35.131123+0000","last_unstale":"2024-09-10T23:14:38.550494+0000","last_undegraded":"2024-09-10T23:14:38.550494+0000","last_fullsized":"2024-09-10T23:14:38.550494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:37.092636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549797+0000","last_change":"2024-09-10T23:14:36.152236+0000","last_active":"2024-09-10T23:14:38.549797+0000","last_peered":"2024-09-10T23:14:38.549797+0000","last_clean":"2024-09-10T23:14:38.549797+0000","last_became_active":"2024-09-10T23:14:36.151945+0000","last_became_peered":"2024-09-10T23:14:36.151945+0000","last_unstale":"2024-09-10T23:14:38.549797+0000","last_undegraded":"2024-09-10T23:14:38.549797+0000","last_fullsized":"2024-09-10T23:14:38.549797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:33.925368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140035+0000","last_change":"2024-09-10T23:14:35.129994+0000","last_active":"2024-09-10T23:14:37.140035+0000","last_peered":"2024-09-10T23:14:37.140035+0000","last_clean":"2024-09-10T23:14:37.140035+0000","last_became_active":"2024-09-10T23:14:35.129609+0000","last_became_peered":"2024-09-10T23:14:35.129609+0000","last_unstale":"2024-09-10T23:14:37.140035+0000","last_undegraded":"2024-09-10T23:14:37.140035+0000","last_fullsized":"2024-09-10T23:14:37.140035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:38.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140095+0000","last_change":"2024-09-10T23:14:36.157814+0000","last_active":"2024-09-10T23:14:37.140095+0000","last_peered":"2024-09-10T23:14:37.140095+0000","last_clean":"2024-09-10T23:14:37.140095+0000","last_became_active":"2024-09-10T23:14:36.157514+0000","last_became_peered":"2024-09-10T23:14:36.157514+0000","last_unstale":"2024-09-10T23:14:37.140095+0000","last_undegraded":"2024-09-10T23:14:37.140095+0000","last_fullsized":"2024-09-10T23:14:37.140095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:14.103635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550272+0000","last_change":"2024-09-10T23:14:35.129129+0000","last_active":"2024-09-10T23:14:38.550272+0000","last_peered":"2024-09-10T23:14:38.550272+0000","last_clean":"2024-09-10T23:14:38.550272+0000","last_became_active":"2024-09-10T23:14:35.128815+0000","last_became_peered":"2024-09-10T23:14:35.128815+0000","last_unstale":"2024-09-10T23:14:38.550272+0000","last_undegraded":"2024-09-10T23:14:38.550272+0000","last_fullsized":"2024-09-10T23:14:38.550272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:08.507246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":831488,"data_stored":672185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":237568,"data_stored":81325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":81361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":241664,"data_stored":81395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":672241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:14:44.809 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:14:44.810 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-10T23:14:44.810 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T23:14:44.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.946+0000 7f2f07ff3640 1 -- 172.21.15.90:0/3823593800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f000cc310 msgr2=0x7f2f000b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:44.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.946+0000 7f2f07ff3640 1 --2- 172.21.15.90:0/3823593800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f000cc310 0x7f2f000b1850 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000aa10 tx=0x7f2ef002b950 comp rx=0 tx=0).stop 2024-09-10T23:14:44.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.946+0000 7f2f07ff3640 1 -- 172.21.15.90:0/3823593800 shutdown_connections 2024-09-10T23:14:44.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.946+0000 7f2f07ff3640 1 --2- 172.21.15.90:0/3823593800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f000cc310 0x7f2f000b1850 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:44.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.946+0000 7f2f07ff3640 1 -- 172.21.15.90:0/3823593800 >> 172.21.15.90:0/3823593800 conn(0x7f2f000cc850 msgr2=0x7f2f000ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:44.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.946+0000 7f2f07ff3640 1 -- 172.21.15.90:0/3823593800 shutdown_connections 2024-09-10T23:14:44.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.946+0000 7f2f07ff3640 1 -- 172.21.15.90:0/3823593800 wait complete. 2024-09-10T23:14:44.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.947+0000 7f2f07ff3640 1 Processor -- start 2024-09-10T23:14:44.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.947+0000 7f2f07ff3640 1 -- start start 2024-09-10T23:14:44.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f07ff3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f000b1d90 0x7f2f00157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:44.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f07ff3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f000cc310 0x7f2f000b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:44.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f07ff3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f00159c90 0x7f2f0009ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:44.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f07ff3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2f00070820 con 0x7f2f00159c90 2024-09-10T23:14:44.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f07ff3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0015b290 con 0x7f2f000cc310 2024-09-10T23:14:44.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f07ff3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2f000709a0 con 0x7f2f000b1d90 2024-09-10T23:14:44.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f06590640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f00159c90 0x7f2f0009ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:44.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f06590640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f00159c90 0x7f2f0009ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50348/0 (socket says 172.21.15.90:50348) 2024-09-10T23:14:44.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f06590640 1 -- 172.21.15.90:0/219572222 learned_addr learned my addr 172.21.15.90:0/219572222 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:44.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f0558e640 1 --2- 172.21.15.90:0/219572222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f000cc310 0x7f2f000b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:44.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f05d8f640 1 --2- 172.21.15.90:0/219572222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f000b1d90 0x7f2f00157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:44.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f06590640 1 -- 172.21.15.90:0/219572222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f000b1d90 msgr2=0x7f2f00157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:44.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f06590640 1 --2- 172.21.15.90:0/219572222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f000b1d90 0x7f2f00157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:44.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f06590640 1 -- 172.21.15.90:0/219572222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f000cc310 msgr2=0x7f2f000b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:44.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f06590640 1 --2- 172.21.15.90:0/219572222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f000cc310 0x7f2f000b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:44.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f06590640 1 -- 172.21.15.90:0/219572222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f001f52c0 con 0x7f2f00159c90 2024-09-10T23:14:44.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f05d8f640 1 --2- 172.21.15.90:0/219572222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f000b1d90 0x7f2f00157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:44.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f06590640 1 --2- 172.21.15.90:0/219572222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f00159c90 0x7f2f0009ce70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800c7a0 tx=0x7f2ef800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:44.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2ef67fc640 1 -- 172.21.15.90:0/219572222 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8003b70 con 0x7f2f00159c90 2024-09-10T23:14:44.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2ef67fc640 1 -- 172.21.15.90:0/219572222 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ef8003d10 con 0x7f2f00159c90 2024-09-10T23:14:44.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f07ff3640 1 -- 172.21.15.90:0/219572222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f001f55a0 con 0x7f2f00159c90 2024-09-10T23:14:44.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2ef67fc640 1 -- 172.21.15.90:0/219572222 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef800aab0 con 0x7f2f00159c90 2024-09-10T23:14:44.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.948+0000 7f2f07ff3640 1 -- 172.21.15.90:0/219572222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f001f5b60 con 0x7f2f00159c90 2024-09-10T23:14:44.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.949+0000 7f2f07ff3640 1 -- 172.21.15.90:0/219572222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f001f5d60 con 0x7f2f00159c90 2024-09-10T23:14:44.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.950+0000 7f2ef67fc640 1 -- 172.21.15.90:0/219572222 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2ef800ac50 con 0x7f2f00159c90 2024-09-10T23:14:44.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.950+0000 7f2ef67fc640 1 --2- 172.21.15.90:0/219572222 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ee4077f70 0x7f2ee407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:44.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.951+0000 7f2ef67fc640 1 -- 172.21.15.90:0/219572222 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2ef8099b10 con 0x7f2f00159c90 2024-09-10T23:14:44.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.951+0000 7f2f05d8f640 1 --2- 172.21.15.90:0/219572222 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ee4077f70 0x7f2ee407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:44.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.951+0000 7f2f05d8f640 1 --2- 172.21.15.90:0/219572222 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ee4077f70 0x7f2ee407a430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2efc007fd0 tx=0x7f2efc009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:44.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:44.954+0000 7f2ef67fc640 1 -- 172.21.15.90:0/219572222 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2f001f5d60 con 0x7f2f00159c90 2024-09-10T23:14:45.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.130+0000 7f2f07ff3640 1 -- 172.21.15.90:0/219572222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f2f000b1850 con 0x7f2f00159c90 2024-09-10T23:14:45.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.131+0000 7f2ef67fc640 1 -- 172.21.15.90:0/219572222 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v27) ==== 86+0+160 (secure 0 0 0) 0x7f2ef8062610 con 0x7f2f00159c90 2024-09-10T23:14:45.132 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:45.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.133+0000 7f2f07ff3640 1 -- 172.21.15.90:0/219572222 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ee4077f70 msgr2=0x7f2ee407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:45.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.133+0000 7f2f07ff3640 1 --2- 172.21.15.90:0/219572222 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ee4077f70 0x7f2ee407a430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2efc007fd0 tx=0x7f2efc009040 comp rx=0 tx=0).stop 2024-09-10T23:14:45.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.133+0000 7f2f07ff3640 1 -- 172.21.15.90:0/219572222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f00159c90 msgr2=0x7f2f0009ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:45.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.133+0000 7f2f07ff3640 1 --2- 172.21.15.90:0/219572222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f00159c90 0x7f2f0009ce70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800c7a0 tx=0x7f2ef800cc60 comp rx=0 tx=0).stop 2024-09-10T23:14:45.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.133+0000 7f2f07ff3640 1 -- 172.21.15.90:0/219572222 shutdown_connections 2024-09-10T23:14:45.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.133+0000 7f2f07ff3640 1 --2- 172.21.15.90:0/219572222 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ee4077f70 0x7f2ee407a430 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.133+0000 7f2f07ff3640 1 --2- 172.21.15.90:0/219572222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f000cc310 0x7f2f000b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.133+0000 7f2f07ff3640 1 --2- 172.21.15.90:0/219572222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f00159c90 0x7f2f0009ce70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.133+0000 7f2f07ff3640 1 --2- 172.21.15.90:0/219572222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f000b1d90 0x7f2f00157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.133+0000 7f2f07ff3640 1 -- 172.21.15.90:0/219572222 >> 172.21.15.90:0/219572222 conn(0x7f2f000cc850 msgr2=0x7f2f00072630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:45.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.133+0000 7f2f07ff3640 1 -- 172.21.15.90:0/219572222 shutdown_connections 2024-09-10T23:14:45.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.133+0000 7f2f07ff3640 1 -- 172.21.15.90:0/219572222 wait complete. 2024-09-10T23:14:45.145 INFO:teuthology.orchestra.run.smithi090.stdout:[{"version":27,"timestamp":"2024-09-10T23:14:24.585645+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"5181.430205"}]}] 2024-09-10T23:14:45.145 INFO:tasks.ceph_manager:config epoch is 27 2024-09-10T23:14:45.145 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T23:14:45.146 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T23:14:45.146 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T23:14:45.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.244+0000 7f2a6a8e4640 1 -- 172.21.15.90:0/2379265648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a64073680 msgr2=0x7f2a64073af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:45.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.244+0000 7f2a6a8e4640 1 --2- 172.21.15.90:0/2379265648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a64073680 0x7f2a64073af0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2a640752b0 tx=0x7f2a5802a560 comp rx=0 tx=0).stop 2024-09-10T23:14:45.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.244+0000 7f2a6a8e4640 1 -- 172.21.15.90:0/2379265648 shutdown_connections 2024-09-10T23:14:45.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.244+0000 7f2a6a8e4640 1 --2- 172.21.15.90:0/2379265648 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a6415e9d0 0x7f2a6415ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.244+0000 7f2a6a8e4640 1 --2- 172.21.15.90:0/2379265648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a64073680 0x7f2a64073af0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.244+0000 7f2a6a8e4640 1 --2- 172.21.15.90:0/2379265648 >> v2:172.21.15.171:3300/0 conn(0x7f2a64151e10 0x7f2a6415bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.244+0000 7f2a6a8e4640 1 -- 172.21.15.90:0/2379265648 >> 172.21.15.90:0/2379265648 conn(0x7f2a640d0c20 msgr2=0x7f2a640d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:45.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.244+0000 7f2a6a8e4640 1 -- 172.21.15.90:0/2379265648 shutdown_connections 2024-09-10T23:14:45.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.244+0000 7f2a6a8e4640 1 -- 172.21.15.90:0/2379265648 wait complete. 2024-09-10T23:14:45.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.245+0000 7f2a6a8e4640 1 Processor -- start 2024-09-10T23:14:45.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.245+0000 7f2a6a8e4640 1 -- start start 2024-09-10T23:14:45.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.246+0000 7f2a6a8e4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a64073680 0x7f2a641f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:45.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.246+0000 7f2a6a8e4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a64151e10 0x7f2a641f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:45.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.246+0000 7f2a6a8e4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a6415e9d0 0x7f2a6415d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:45.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.246+0000 7f2a6a8e4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2a640cc820 con 0x7f2a64151e10 2024-09-10T23:14:45.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.246+0000 7f2a6a8e4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2a640cc6a0 con 0x7f2a64073680 2024-09-10T23:14:45.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.246+0000 7f2a6a8e4640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2a640cc9a0 con 0x7f2a6415e9d0 2024-09-10T23:14:45.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.246+0000 7f2a637fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a64151e10 0x7f2a641f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:45.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.246+0000 7f2a637fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a64151e10 0x7f2a641f66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50364/0 (socket says 172.21.15.90:50364) 2024-09-10T23:14:45.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.246+0000 7f2a637fe640 1 -- 172.21.15.90:0/2074769864 learned_addr learned my addr 172.21.15.90:0/2074769864 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:45.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.246+0000 7f2a63fff640 1 --2- 172.21.15.90:0/2074769864 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a64073680 0x7f2a641f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:45.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.246+0000 7f2a68e81640 1 --2- 172.21.15.90:0/2074769864 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a6415e9d0 0x7f2a6415d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:45.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.247+0000 7f2a637fe640 1 -- 172.21.15.90:0/2074769864 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a6415e9d0 msgr2=0x7f2a6415d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:45.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.247+0000 7f2a637fe640 1 --2- 172.21.15.90:0/2074769864 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a6415e9d0 0x7f2a6415d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.247+0000 7f2a637fe640 1 -- 172.21.15.90:0/2074769864 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a64073680 msgr2=0x7f2a641f2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:45.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.247+0000 7f2a637fe640 1 --2- 172.21.15.90:0/2074769864 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a64073680 0x7f2a641f2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.247+0000 7f2a637fe640 1 -- 172.21.15.90:0/2074769864 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a641f2eb0 con 0x7f2a64151e10 2024-09-10T23:14:45.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.247+0000 7f2a637fe640 1 --2- 172.21.15.90:0/2074769864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a64151e10 0x7f2a641f66d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009850 tx=0x7f2a580039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:45.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.247+0000 7f2a60ff9640 1 -- 172.21.15.90:0/2074769864 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5803f070 con 0x7f2a64151e10 2024-09-10T23:14:45.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.247+0000 7f2a60ff9640 1 -- 172.21.15.90:0/2074769864 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a58004890 con 0x7f2a64151e10 2024-09-10T23:14:45.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.247+0000 7f2a6a8e4640 1 -- 172.21.15.90:0/2074769864 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a641f3190 con 0x7f2a64151e10 2024-09-10T23:14:45.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.247+0000 7f2a60ff9640 1 -- 172.21.15.90:0/2074769864 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a58035030 con 0x7f2a64151e10 2024-09-10T23:14:45.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.247+0000 7f2a6a8e4640 1 -- 172.21.15.90:0/2074769864 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a6415d640 con 0x7f2a64151e10 2024-09-10T23:14:45.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.248+0000 7f2a6a8e4640 1 -- 172.21.15.90:0/2074769864 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a6415bfd0 con 0x7f2a64151e10 2024-09-10T23:14:45.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.249+0000 7f2a60ff9640 1 -- 172.21.15.90:0/2074769864 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2a58004ca0 con 0x7f2a64151e10 2024-09-10T23:14:45.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.249+0000 7f2a60ff9640 1 --2- 172.21.15.90:0/2074769864 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a50077f70 0x7f2a5007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:45.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.249+0000 7f2a60ff9640 1 -- 172.21.15.90:0/2074769864 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2a580bafc0 con 0x7f2a64151e10 2024-09-10T23:14:45.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.249+0000 7f2a63fff640 1 --2- 172.21.15.90:0/2074769864 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a50077f70 0x7f2a5007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:45.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.250+0000 7f2a63fff640 1 --2- 172.21.15.90:0/2074769864 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a50077f70 0x7f2a5007a430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2a54005940 tx=0x7f2a5400c460 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:45.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.253+0000 7f2a60ff9640 1 -- 172.21.15.90:0/2074769864 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2a58083b50 con 0x7f2a64151e10 2024-09-10T23:14:45.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.473+0000 7f2a6a8e4640 1 -- 172.21.15.90:0/2074769864 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2a640b6ba0 con 0x7f2a64151e10 2024-09-10T23:14:45.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.476+0000 7f2a60ff9640 1 -- 172.21.15.90:0/2074769864 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+193249 (secure 0 0 0) 0x7f2a58083450 con 0x7f2a64151e10 2024-09-10T23:14:45.479 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:45.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.479+0000 7f2a6a8e4640 1 -- 172.21.15.90:0/2074769864 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a50077f70 msgr2=0x7f2a5007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:45.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.479+0000 7f2a6a8e4640 1 --2- 172.21.15.90:0/2074769864 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a50077f70 0x7f2a5007a430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2a54005940 tx=0x7f2a5400c460 comp rx=0 tx=0).stop 2024-09-10T23:14:45.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.479+0000 7f2a6a8e4640 1 -- 172.21.15.90:0/2074769864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a64151e10 msgr2=0x7f2a641f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:45.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.479+0000 7f2a6a8e4640 1 --2- 172.21.15.90:0/2074769864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a64151e10 0x7f2a641f66d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009850 tx=0x7f2a580039e0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.479+0000 7f2a6a8e4640 1 -- 172.21.15.90:0/2074769864 shutdown_connections 2024-09-10T23:14:45.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.479+0000 7f2a6a8e4640 1 --2- 172.21.15.90:0/2074769864 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a50077f70 0x7f2a5007a430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.479+0000 7f2a6a8e4640 1 --2- 172.21.15.90:0/2074769864 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a6415e9d0 0x7f2a6415d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.479+0000 7f2a6a8e4640 1 --2- 172.21.15.90:0/2074769864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a64151e10 0x7f2a641f66d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.479+0000 7f2a6a8e4640 1 --2- 172.21.15.90:0/2074769864 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a64073680 0x7f2a641f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.479+0000 7f2a6a8e4640 1 -- 172.21.15.90:0/2074769864 >> 172.21.15.90:0/2074769864 conn(0x7f2a640d0c20 msgr2=0x7f2a640cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:45.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.479+0000 7f2a6a8e4640 1 -- 172.21.15.90:0/2074769864 shutdown_connections 2024-09-10T23:14:45.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.479+0000 7f2a6a8e4640 1 -- 172.21.15.90:0/2074769864 wait complete. 2024-09-10T23:14:45.491 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":5,"flags":0,"active_gid":4123,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1044758290},{"type":"v1","addr":"172.21.15.171:6801","nonce":1044758290}]},"active_addr":"172.21.15.171:6801/1044758290","active_change":"2024-09-10T23:14:16.425701+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4139,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":2528890205}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":4076643777}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":1042724116}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":217418662}]}]} 2024-09-10T23:14:45.495 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T23:14:45.495 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T23:14:45.495 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:14:45.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.596+0000 7fde72f52640 1 -- 172.21.15.90:0/1292028203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde6c15aa30 msgr2=0x7fde6c0ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:45.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.596+0000 7fde72f52640 1 --2- 172.21.15.90:0/1292028203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde6c15aa30 0x7fde6c0ca420 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fde68005fd0 tx=0x7fde6802a5d0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.596+0000 7fde72f52640 1 -- 172.21.15.90:0/1292028203 shutdown_connections 2024-09-10T23:14:45.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.596+0000 7fde72f52640 1 --2- 172.21.15.90:0/1292028203 >> v2:172.21.15.171:3300/0 conn(0x7fde6c0ca960 0x7fde6c0b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.596+0000 7fde72f52640 1 --2- 172.21.15.90:0/1292028203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde6c15aa30 0x7fde6c0ca420 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.596+0000 7fde72f52640 1 -- 172.21.15.90:0/1292028203 >> 172.21.15.90:0/1292028203 conn(0x7fde6c0cc850 msgr2=0x7fde6c0ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:45.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.596+0000 7fde72f52640 1 -- 172.21.15.90:0/1292028203 shutdown_connections 2024-09-10T23:14:45.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.596+0000 7fde72f52640 1 -- 172.21.15.90:0/1292028203 wait complete. 2024-09-10T23:14:45.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.597+0000 7fde72f52640 1 Processor -- start 2024-09-10T23:14:45.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.597+0000 7fde72f52640 1 -- start start 2024-09-10T23:14:45.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.598+0000 7fde72f52640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde6c15aa30 0x7fde6c157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:45.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.598+0000 7fde72f52640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde6c15ae10 0x7fde6c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:45.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.598+0000 7fde72f52640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde6c06f4a0 0x7fde6c1594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:45.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.598+0000 7fde72f52640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c0b2120 con 0x7fde6c15aa30 2024-09-10T23:14:45.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.598+0000 7fde72f52640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c0b1fa0 con 0x7fde6c06f4a0 2024-09-10T23:14:45.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.598+0000 7fde72f52640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fde6c06fcd0 con 0x7fde6c15ae10 2024-09-10T23:14:45.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.598+0000 7fde70cee640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde6c15aa30 0x7fde6c157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:45.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.598+0000 7fde70cee640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde6c15aa30 0x7fde6c157810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50380/0 (socket says 172.21.15.90:50380) 2024-09-10T23:14:45.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.598+0000 7fde70cee640 1 -- 172.21.15.90:0/2803292719 learned_addr learned my addr 172.21.15.90:0/2803292719 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.598+0000 7fde714ef640 1 --2- 172.21.15.90:0/2803292719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde6c06f4a0 0x7fde6c1594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.598+0000 7fde63fff640 1 --2- 172.21.15.90:0/2803292719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde6c15ae10 0x7fde6c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.598+0000 7fde70cee640 1 -- 172.21.15.90:0/2803292719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde6c15ae10 msgr2=0x7fde6c06ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.598+0000 7fde70cee640 1 --2- 172.21.15.90:0/2803292719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde6c15ae10 0x7fde6c06ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.598+0000 7fde70cee640 1 -- 172.21.15.90:0/2803292719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde6c06f4a0 msgr2=0x7fde6c1594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.598+0000 7fde70cee640 1 --2- 172.21.15.90:0/2803292719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde6c06f4a0 0x7fde6c1594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.598+0000 7fde70cee640 1 -- 172.21.15.90:0/2803292719 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6c06f940 con 0x7fde6c15aa30 2024-09-10T23:14:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.599+0000 7fde70cee640 1 --2- 172.21.15.90:0/2803292719 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde6c15aa30 0x7fde6c157810 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fde680099f0 tx=0x7fde68003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.599+0000 7fde617fa640 1 -- 172.21.15.90:0/2803292719 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6803f070 con 0x7fde6c15aa30 2024-09-10T23:14:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.599+0000 7fde72f52640 1 -- 172.21.15.90:0/2803292719 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde6c0b4c10 con 0x7fde6c15aa30 2024-09-10T23:14:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.599+0000 7fde617fa640 1 -- 172.21.15.90:0/2803292719 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde68005600 con 0x7fde6c15aa30 2024-09-10T23:14:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.599+0000 7fde617fa640 1 -- 172.21.15.90:0/2803292719 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde68035030 con 0x7fde6c15aa30 2024-09-10T23:14:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.599+0000 7fde72f52640 1 -- 172.21.15.90:0/2803292719 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde6c0b51d0 con 0x7fde6c15aa30 2024-09-10T23:14:45.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.600+0000 7fde72f52640 1 -- 172.21.15.90:0/2803292719 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde6c0701f0 con 0x7fde6c15aa30 2024-09-10T23:14:45.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.600+0000 7fde617fa640 1 -- 172.21.15.90:0/2803292719 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fde68004a00 con 0x7fde6c15aa30 2024-09-10T23:14:45.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.601+0000 7fde617fa640 1 --2- 172.21.15.90:0/2803292719 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fde58077f70 0x7fde5807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:45.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.601+0000 7fde617fa640 1 -- 172.21.15.90:0/2803292719 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fde680baba0 con 0x7fde6c15aa30 2024-09-10T23:14:45.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.601+0000 7fde63fff640 1 --2- 172.21.15.90:0/2803292719 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fde58077f70 0x7fde5807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:45.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.602+0000 7fde63fff640 1 --2- 172.21.15.90:0/2803292719 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fde58077f70 0x7fde5807a430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde6c0ca350 tx=0x7fde5c005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:45.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.605+0000 7fde617fa640 1 -- 172.21.15.90:0/2803292719 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fde68082fd0 con 0x7fde6c15aa30 2024-09-10T23:14:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.782+0000 7fde72f52640 1 -- 172.21.15.90:0/2803292719 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde6c0b17b0 con 0x7fde6c15aa30 2024-09-10T23:14:45.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.783+0000 7fde617fa640 1 -- 172.21.15.90:0/2803292719 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16665 (secure 0 0 0) 0x7fde68087a00 con 0x7fde6c15aa30 2024-09-10T23:14:45.784 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:45.784 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":23,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:14:37.132353+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:14:33.985657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:14:34.420690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:14:45.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.785+0000 7fde72f52640 1 -- 172.21.15.90:0/2803292719 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fde58077f70 msgr2=0x7fde5807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:45.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.785+0000 7fde72f52640 1 --2- 172.21.15.90:0/2803292719 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fde58077f70 0x7fde5807a430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde6c0ca350 tx=0x7fde5c005f90 comp rx=0 tx=0).stop 2024-09-10T23:14:45.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.785+0000 7fde72f52640 1 -- 172.21.15.90:0/2803292719 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde6c15aa30 msgr2=0x7fde6c157810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:45.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.785+0000 7fde72f52640 1 --2- 172.21.15.90:0/2803292719 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde6c15aa30 0x7fde6c157810 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fde680099f0 tx=0x7fde68003820 comp rx=0 tx=0).stop 2024-09-10T23:14:45.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.785+0000 7fde72f52640 1 -- 172.21.15.90:0/2803292719 shutdown_connections 2024-09-10T23:14:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.785+0000 7fde72f52640 1 --2- 172.21.15.90:0/2803292719 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fde58077f70 0x7fde5807a430 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.785+0000 7fde72f52640 1 --2- 172.21.15.90:0/2803292719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde6c06f4a0 0x7fde6c1594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.785+0000 7fde72f52640 1 --2- 172.21.15.90:0/2803292719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde6c15ae10 0x7fde6c06ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.785+0000 7fde72f52640 1 --2- 172.21.15.90:0/2803292719 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde6c15aa30 0x7fde6c157810 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.785+0000 7fde72f52640 1 -- 172.21.15.90:0/2803292719 >> 172.21.15.90:0/2803292719 conn(0x7fde6c0cc850 msgr2=0x7fde6c0ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.785+0000 7fde72f52640 1 -- 172.21.15.90:0/2803292719 shutdown_connections 2024-09-10T23:14:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.785+0000 7fde72f52640 1 -- 172.21.15.90:0/2803292719 wait complete. 2024-09-10T23:14:45.798 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T23:14:45.798 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:14:45.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.898+0000 7f355f45a640 1 -- 172.21.15.90:0/1464870144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35580ccea0 msgr2=0x7f35580cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:45.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.898+0000 7f355f45a640 1 --2- 172.21.15.90:0/1464870144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35580ccea0 0x7f35580cd280 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3558161c90 tx=0x7f355402aa30 comp rx=0 tx=0).stop 2024-09-10T23:14:45.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.898+0000 7f355f45a640 1 -- 172.21.15.90:0/1464870144 shutdown_connections 2024-09-10T23:14:45.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.898+0000 7f355f45a640 1 --2- 172.21.15.90:0/1464870144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580b0750 0x7f35580caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.898+0000 7f355f45a640 1 --2- 172.21.15.90:0/1464870144 >> v2:172.21.15.171:3300/0 conn(0x7f35580afdb0 0x7f35580b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.898+0000 7f355f45a640 1 --2- 172.21.15.90:0/1464870144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35580ccea0 0x7f35580cd280 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.898+0000 7f355f45a640 1 -- 172.21.15.90:0/1464870144 >> 172.21.15.90:0/1464870144 conn(0x7f35580d0490 msgr2=0x7f35580d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:45.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.898+0000 7f355f45a640 1 -- 172.21.15.90:0/1464870144 shutdown_connections 2024-09-10T23:14:45.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.898+0000 7f355f45a640 1 -- 172.21.15.90:0/1464870144 wait complete. 2024-09-10T23:14:45.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.899+0000 7f355f45a640 1 Processor -- start 2024-09-10T23:14:45.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.899+0000 7f355f45a640 1 -- start start 2024-09-10T23:14:45.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.900+0000 7f355f45a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580afdb0 0x7f355809a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:45.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.900+0000 7f355f45a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35580b0750 0x7f355814f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:45.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.900+0000 7f355f45a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35580ccea0 0x7f35581f1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:45.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.900+0000 7f355f45a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f35580cbd40 con 0x7f35580ccea0 2024-09-10T23:14:45.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.900+0000 7f355f45a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3558073020 con 0x7f35580b0750 2024-09-10T23:14:45.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.900+0000 7f355f45a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3558073950 con 0x7f35580afdb0 2024-09-10T23:14:45.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.900+0000 7f355d9f7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35580ccea0 0x7f35581f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:45.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.900+0000 7f355d9f7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35580ccea0 0x7f35581f1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50404/0 (socket says 172.21.15.90:50404) 2024-09-10T23:14:45.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.900+0000 7f355d9f7640 1 -- 172.21.15.90:0/1330997646 learned_addr learned my addr 172.21.15.90:0/1330997646 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:45.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.900+0000 7f355d1f6640 1 --2- 172.21.15.90:0/1330997646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580afdb0 0x7f355809a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:45.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.900+0000 7f355c9f5640 1 --2- 172.21.15.90:0/1330997646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35580b0750 0x7f355814f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:45.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.900+0000 7f355d9f7640 1 -- 172.21.15.90:0/1330997646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580afdb0 msgr2=0x7f355809a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:45.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.900+0000 7f355d9f7640 1 --2- 172.21.15.90:0/1330997646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580afdb0 0x7f355809a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.900+0000 7f355d9f7640 1 -- 172.21.15.90:0/1330997646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35580b0750 msgr2=0x7f355814f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:45.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.900+0000 7f355d9f7640 1 --2- 172.21.15.90:0/1330997646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35580b0750 0x7f355814f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:45.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.900+0000 7f355d9f7640 1 -- 172.21.15.90:0/1330997646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3558152430 con 0x7f35580ccea0 2024-09-10T23:14:45.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.900+0000 7f355d9f7640 1 --2- 172.21.15.90:0/1330997646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35580ccea0 0x7f35581f1850 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f355000d750 tx=0x7f355000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:45.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.901+0000 7f354dffb640 1 -- 172.21.15.90:0/1330997646 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550017070 con 0x7f35580ccea0 2024-09-10T23:14:45.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.901+0000 7f354dffb640 1 -- 172.21.15.90:0/1330997646 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3550009cc0 con 0x7f35580ccea0 2024-09-10T23:14:45.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.901+0000 7f355f45a640 1 -- 172.21.15.90:0/1330997646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35580c8930 con 0x7f35580ccea0 2024-09-10T23:14:45.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.901+0000 7f354dffb640 1 -- 172.21.15.90:0/1330997646 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355000de60 con 0x7f35580ccea0 2024-09-10T23:14:45.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.901+0000 7f355f45a640 1 -- 172.21.15.90:0/1330997646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35580c8ef0 con 0x7f35580ccea0 2024-09-10T23:14:45.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.902+0000 7f355f45a640 1 -- 172.21.15.90:0/1330997646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f355806d820 con 0x7f35580ccea0 2024-09-10T23:14:45.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.902+0000 7f354dffb640 1 -- 172.21.15.90:0/1330997646 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3550005280 con 0x7f35580ccea0 2024-09-10T23:14:45.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.903+0000 7f354dffb640 1 --2- 172.21.15.90:0/1330997646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f353c077f70 0x7f353c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:45.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.903+0000 7f354dffb640 1 -- 172.21.15.90:0/1330997646 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3550099dc0 con 0x7f35580ccea0 2024-09-10T23:14:45.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.903+0000 7f355d1f6640 1 --2- 172.21.15.90:0/1330997646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f353c077f70 0x7f353c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:45.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.903+0000 7f355d1f6640 1 --2- 172.21.15.90:0/1330997646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f353c077f70 0x7f353c07a430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3554035000 tx=0x7f355403b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:45.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:45.907+0000 7f354dffb640 1 -- 172.21.15.90:0/1330997646 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3550062270 con 0x7f35580ccea0 2024-09-10T23:14:46.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.080+0000 7f355f45a640 1 -- 172.21.15.90:0/1330997646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35580c8650 con 0x7f35580ccea0 2024-09-10T23:14:46.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.081+0000 7f354dffb640 1 -- 172.21.15.90:0/1330997646 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16665 (secure 0 0 0) 0x7f3550066ca0 con 0x7f35580ccea0 2024-09-10T23:14:46.082 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:46.083 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":23,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:14:37.132353+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:14:33.985657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:14:34.420690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:14:46.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.083+0000 7f355f45a640 1 -- 172.21.15.90:0/1330997646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f353c077f70 msgr2=0x7f353c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.083+0000 7f355f45a640 1 --2- 172.21.15.90:0/1330997646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f353c077f70 0x7f353c07a430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3554035000 tx=0x7f355403b040 comp rx=0 tx=0).stop 2024-09-10T23:14:46.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.083+0000 7f355f45a640 1 -- 172.21.15.90:0/1330997646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35580ccea0 msgr2=0x7f35581f1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.083+0000 7f355f45a640 1 --2- 172.21.15.90:0/1330997646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35580ccea0 0x7f35581f1850 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f355000d750 tx=0x7f355000dc10 comp rx=0 tx=0).stop 2024-09-10T23:14:46.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.083+0000 7f355f45a640 1 -- 172.21.15.90:0/1330997646 shutdown_connections 2024-09-10T23:14:46.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.083+0000 7f355f45a640 1 --2- 172.21.15.90:0/1330997646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f353c077f70 0x7f353c07a430 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.083+0000 7f355f45a640 1 --2- 172.21.15.90:0/1330997646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35580b0750 0x7f355814f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.083+0000 7f355f45a640 1 --2- 172.21.15.90:0/1330997646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35580ccea0 0x7f35581f1850 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.083+0000 7f355f45a640 1 --2- 172.21.15.90:0/1330997646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580afdb0 0x7f355809a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.083+0000 7f355f45a640 1 -- 172.21.15.90:0/1330997646 >> 172.21.15.90:0/1330997646 conn(0x7f35580d0490 msgr2=0x7f35580cb550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.084+0000 7f355f45a640 1 -- 172.21.15.90:0/1330997646 shutdown_connections 2024-09-10T23:14:46.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.084+0000 7f355f45a640 1 -- 172.21.15.90:0/1330997646 wait complete. 2024-09-10T23:14:46.096 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T23:14:46.096 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T23:14:46.096 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T23:14:46.097 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T23:14:46.097 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T23:14:46.098 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T23:14:46.098 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T23:14:46.099 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T23:14:46.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.268+0000 7fe633ea2640 1 -- 172.21.15.90:0/3130231917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe62c072730 msgr2=0x7fe62c0cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.268+0000 7fe633ea2640 1 --2- 172.21.15.90:0/3130231917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe62c072730 0x7fe62c0cd9a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe624005fd0 tx=0x7fe62402aac0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.268+0000 7fe633ea2640 1 -- 172.21.15.90:0/3130231917 shutdown_connections 2024-09-10T23:14:46.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.268+0000 7fe633ea2640 1 --2- 172.21.15.90:0/3130231917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe62c072730 0x7fe62c0cd9a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.268+0000 7fe633ea2640 1 --2- 172.21.15.90:0/3130231917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe62c0cf420 0x7fe62c06f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.268+0000 7fe633ea2640 1 -- 172.21.15.90:0/3130231917 >> 172.21.15.90:0/3130231917 conn(0x7fe62c06d540 msgr2=0x7fe62c0cc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.268+0000 7fe633ea2640 1 -- 172.21.15.90:0/3130231917 shutdown_connections 2024-09-10T23:14:46.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.268+0000 7fe633ea2640 1 -- 172.21.15.90:0/3130231917 wait complete. 2024-09-10T23:14:46.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.270+0000 7ff4b22b8640 1 -- 172.21.15.90:0/360464210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4ac0ca420 msgr2=0x7ff4ac0ca850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.270+0000 7ff4b22b8640 1 --2- 172.21.15.90:0/360464210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4ac0ca420 0x7ff4ac0ca850 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac06f2e0 tx=0x7ff4a402a890 comp rx=0 tx=0).stop 2024-09-10T23:14:46.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.270+0000 7ff4b22b8640 1 -- 172.21.15.90:0/360464210 shutdown_connections 2024-09-10T23:14:46.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.270+0000 7ff4b22b8640 1 --2- 172.21.15.90:0/360464210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4ac0ca420 0x7ff4ac0ca850 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.270+0000 7fe633ea2640 1 Processor -- start 2024-09-10T23:14:46.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.270+0000 7ff4b22b8640 1 -- 172.21.15.90:0/360464210 >> 172.21.15.90:0/360464210 conn(0x7ff4ac0cc850 msgr2=0x7ff4ac0ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.270+0000 7ff4b22b8640 1 -- 172.21.15.90:0/360464210 shutdown_connections 2024-09-10T23:14:46.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.270+0000 7ff597ced640 1 -- 172.21.15.90:0/139958091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff590070820 msgr2=0x7ff5900ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.270+0000 7ff597ced640 1 --2- 172.21.15.90:0/139958091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff590070820 0x7ff5900ca420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff590070c00 tx=0x7ff58c02a4b0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.271+0000 7ff4b22b8640 1 -- 172.21.15.90:0/360464210 wait complete. 2024-09-10T23:14:46.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.271+0000 7ff597ced640 1 -- 172.21.15.90:0/139958091 shutdown_connections 2024-09-10T23:14:46.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.271+0000 7ff597ced640 1 --2- 172.21.15.90:0/139958091 >> v2:172.21.15.171:3300/0 conn(0x7ff590073e50 0x7ff590159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.271+0000 7ff597ced640 1 --2- 172.21.15.90:0/139958091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff590070820 0x7ff5900ca420 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.271+0000 7ff597ced640 1 -- 172.21.15.90:0/139958091 >> 172.21.15.90:0/139958091 conn(0x7ff5900cc850 msgr2=0x7ff5900ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.271+0000 7ff597ced640 1 -- 172.21.15.90:0/139958091 shutdown_connections 2024-09-10T23:14:46.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.270+0000 7fe633ea2640 1 -- start start 2024-09-10T23:14:46.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.271+0000 7f2c34d45640 1 -- 172.21.15.90:0/2069980929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c28037ee0 msgr2=0x7f2c280e6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.271+0000 7f2c34d45640 1 --2- 172.21.15.90:0/2069980929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c28037ee0 0x7f2c280e6b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2c24009830 tx=0x7f2c2402a4b0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.271+0000 7f2c34d45640 1 -- 172.21.15.90:0/2069980929 shutdown_connections 2024-09-10T23:14:46.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.271+0000 7f2c34d45640 1 --2- 172.21.15.90:0/2069980929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c28037ee0 0x7f2c280e6b10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.271+0000 7f2c34d45640 1 -- 172.21.15.90:0/2069980929 >> 172.21.15.90:0/2069980929 conn(0x7f2c2803a3a0 msgr2=0x7f2c2803a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.271+0000 7f1fc8164640 1 -- 172.21.15.90:0/919421719 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fac004800 msgr2=0x7f1fac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.271+0000 7f1fc8164640 1 --2- 172.21.15.90:0/919421719 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fac004800 0x7f1fac004c80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009880 tx=0x7f1fac005830 comp rx=0 tx=0).stop 2024-09-10T23:14:46.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.271+0000 7ff597ced640 1 -- 172.21.15.90:0/139958091 wait complete. 2024-09-10T23:14:46.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.272+0000 7fe633ea2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe62c072730 0x7fe62c16b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.272+0000 7f1fc8164640 1 -- 172.21.15.90:0/919421719 shutdown_connections 2024-09-10T23:14:46.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.272+0000 7f1fc8164640 1 --2- 172.21.15.90:0/919421719 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fac004800 0x7f1fac004c80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.272+0000 7f1fc8164640 1 -- 172.21.15.90:0/919421719 >> 172.21.15.90:0/919421719 conn(0x7f1fc00d0c90 msgr2=0x7f1fc00d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.272+0000 7fe633ea2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe62c0cf420 0x7fe62c16c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.272+0000 7fe633ea2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe62c0cf800 0x7fe62c09c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.273+0000 7ff4b22b8640 1 Processor -- start 2024-09-10T23:14:46.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.273+0000 7ff4b22b8640 1 -- start start 2024-09-10T23:14:46.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7ff4b22b8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4ac0aef50 0x7ff4ac09a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff4b22b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4ac0ca420 0x7ff4ac0b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff4b22b8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4ac157fc0 0x7ff4ac14fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff4b22b8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac0b1c50 con 0x7ff4ac157fc0 2024-09-10T23:14:46.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff4b22b8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac0b1ad0 con 0x7ff4ac0aef50 2024-09-10T23:14:46.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff4abfff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4ac0aef50 0x7ff4ac09a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff4b22b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ac0b1dd0 con 0x7ff4ac0ca420 2024-09-10T23:14:46.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff4abfff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4ac0aef50 0x7ff4ac09a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.90:58976/0 (socket says 172.21.15.90:58976) 2024-09-10T23:14:46.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff4abfff640 1 -- 172.21.15.90:0/1732864522 learned_addr learned my addr 172.21.15.90:0/1732864522 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:46.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.273+0000 7ff597ced640 1 Processor -- start 2024-09-10T23:14:46.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.273+0000 7ff597ced640 1 -- start start 2024-09-10T23:14:46.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7ff597ced640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff590070820 0x7ff5900b5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7ff597ced640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff590073e50 0x7ff59009d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7ff597ced640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5900cc310 0x7ff5900c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7ff597ced640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff5900cdb40 con 0x7ff5900cc310 2024-09-10T23:14:46.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7ff597ced640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff5900744d0 con 0x7ff590073e50 2024-09-10T23:14:46.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7ff597ced640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff5900b1850 con 0x7ff590070820 2024-09-10T23:14:46.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7ff595a89640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff590070820 0x7ff5900b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7ff595a89640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff590070820 0x7ff5900b5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.90:56834/0 (socket says 172.21.15.90:56834) 2024-09-10T23:14:46.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7ff595a89640 1 -- 172.21.15.90:0/4054027286 learned_addr learned my addr 172.21.15.90:0/4054027286 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:46.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7ff59628a640 1 --2- 172.21.15.90:0/4054027286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5900cc310 0x7ff5900c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7ff595288640 1 --2- 172.21.15.90:0/4054027286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff590073e50 0x7ff59009d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff59628a640 1 -- 172.21.15.90:0/4054027286 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff590070820 msgr2=0x7ff5900b5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff59628a640 1 --2- 172.21.15.90:0/4054027286 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff590070820 0x7ff5900b5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff59628a640 1 -- 172.21.15.90:0/4054027286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff590073e50 msgr2=0x7ff59009d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff59628a640 1 --2- 172.21.15.90:0/4054027286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff590073e50 0x7ff59009d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff59628a640 1 -- 172.21.15.90:0/4054027286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59009cef0 con 0x7ff5900cc310 2024-09-10T23:14:46.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.272+0000 7fe633ea2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c06ff90 con 0x7fe62c0cf420 2024-09-10T23:14:46.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.272+0000 7fe633ea2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c0ca670 con 0x7fe62c0cf800 2024-09-10T23:14:46.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.272+0000 7fe633ea2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe62c070110 con 0x7fe62c072730 2024-09-10T23:14:46.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.272+0000 7fe63143d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe62c0cf420 0x7fe62c16c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.272+0000 7fe63143d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe62c0cf420 0x7fe62c16c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50464/0 (socket says 172.21.15.90:50464) 2024-09-10T23:14:46.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.272+0000 7fe63143d640 1 -- 172.21.15.90:0/1457606384 learned_addr learned my addr 172.21.15.90:0/1457606384 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:46.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.272+0000 7fe63243f640 1 --2- 172.21.15.90:0/1457606384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe62c0cf800 0x7fe62c09c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.272+0000 7fe631c3e640 1 --2- 172.21.15.90:0/1457606384 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe62c072730 0x7fe62c16b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.273+0000 7fe63143d640 1 -- 172.21.15.90:0/1457606384 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe62c072730 msgr2=0x7fe62c16b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.273+0000 7fe63143d640 1 --2- 172.21.15.90:0/1457606384 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe62c072730 0x7fe62c16b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.273+0000 7fe63143d640 1 -- 172.21.15.90:0/1457606384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe62c0cf800 msgr2=0x7fe62c09c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.273+0000 7fe63143d640 1 --2- 172.21.15.90:0/1457606384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe62c0cf800 0x7fe62c09c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.273+0000 7fe63143d640 1 -- 172.21.15.90:0/1457606384 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62c0b5630 con 0x7fe62c0cf420 2024-09-10T23:14:46.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7fe63143d640 1 --2- 172.21.15.90:0/1457606384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe62c0cf420 0x7fe62c16c2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe624009bf0 tx=0x7fe624003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.271+0000 7f2c34d45640 1 -- 172.21.15.90:0/2069980929 shutdown_connections 2024-09-10T23:14:46.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.271+0000 7f2c34d45640 1 -- 172.21.15.90:0/2069980929 wait complete. 2024-09-10T23:14:46.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.273+0000 7f2c34d45640 1 Processor -- start 2024-09-10T23:14:46.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.273+0000 7f2c34d45640 1 -- start start 2024-09-10T23:14:46.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7f2c34d45640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c28037ee0 0x7f2c28050300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7f2c34d45640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c2803b910 0x7f2c2803d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7f2c34d45640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c280e2770 0x7f2c2819b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7f2c34d45640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2c280577f0 con 0x7f2c2803b910 2024-09-10T23:14:46.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7f2c34d45640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2c28057670 con 0x7f2c28037ee0 2024-09-10T23:14:46.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7f2c34d45640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2c28057970 con 0x7f2c280e2770 2024-09-10T23:14:46.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7f2c2ed9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c280e2770 0x7f2c2819b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7f2c2ed9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c280e2770 0x7f2c2819b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.90:56844/0 (socket says 172.21.15.90:56844) 2024-09-10T23:14:46.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7f2c2ed9d640 1 -- 172.21.15.90:0/3280932461 learned_addr learned my addr 172.21.15.90:0/3280932461 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:46.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7f2c2e59c640 1 --2- 172.21.15.90:0/3280932461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c28037ee0 0x7f2c28050300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.272+0000 7f1fc8164640 1 -- 172.21.15.90:0/919421719 shutdown_connections 2024-09-10T23:14:46.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.273+0000 7f1fc8164640 1 -- 172.21.15.90:0/919421719 wait complete. 2024-09-10T23:14:46.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7fe6227fc640 1 -- 172.21.15.90:0/1457606384 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624004450 con 0x7fe62c0cf420 2024-09-10T23:14:46.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7fe633ea2640 1 -- 172.21.15.90:0/1457606384 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe62c0b5910 con 0x7fe62c0cf420 2024-09-10T23:14:46.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7fe633ea2640 1 -- 172.21.15.90:0/1457606384 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe62c09b6e0 con 0x7fe62c0cf420 2024-09-10T23:14:46.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff4a3fff640 1 --2- 172.21.15.90:0/1732864522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4ac0ca420 0x7ff4ac0b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff4b0855640 1 --2- 172.21.15.90:0/1732864522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4ac157fc0 0x7ff4ac14fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7f2c2ed9d640 1 -- 172.21.15.90:0/3280932461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c28037ee0 msgr2=0x7f2c28050300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7f2c2ed9d640 1 --2- 172.21.15.90:0/3280932461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c28037ee0 0x7f2c28050300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7f2c2ed9d640 1 -- 172.21.15.90:0/3280932461 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c2803b910 msgr2=0x7f2c2803d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7f2c2ed9d640 1 --2- 172.21.15.90:0/3280932461 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c2803b910 0x7f2c2803d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7f2c2ed9d640 1 -- 172.21.15.90:0/3280932461 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2819bad0 con 0x7f2c280e2770 2024-09-10T23:14:46.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7f1fc8164640 1 Processor -- start 2024-09-10T23:14:46.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.274+0000 7f1fc8164640 1 -- start start 2024-09-10T23:14:46.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff4a3fff640 1 -- 172.21.15.90:0/1732864522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4ac0aef50 msgr2=0x7ff4ac09a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff4a3fff640 1 --2- 172.21.15.90:0/1732864522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4ac0aef50 0x7ff4ac09a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff4a3fff640 1 -- 172.21.15.90:0/1732864522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4ac157fc0 msgr2=0x7ff4ac14fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7ff4a3fff640 1 --2- 172.21.15.90:0/1732864522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4ac157fc0 0x7ff4ac14fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7ff4a3fff640 1 -- 172.21.15.90:0/1732864522 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ac0b35a0 con 0x7ff4ac0ca420 2024-09-10T23:14:46.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7ff4a3fff640 1 --2- 172.21.15.90:0/1732864522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4ac0ca420 0x7ff4ac0b3060 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff49400d5a0 tx=0x7ff49400da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7ff4b0855640 1 --2- 172.21.15.90:0/1732864522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4ac157fc0 0x7ff4ac14fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:14:46.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7f1fc8164640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fac004800 0x7f1fc00ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7f1fc8164640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fc00b00c0 0x7f1fc01fea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7f1fc8164640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fc0201630 0x7f1fc00700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7f1fc8164640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc015f790 con 0x7f1fc00b00c0 2024-09-10T23:14:46.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7f1fc8164640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc0155710 con 0x7f1fac004800 2024-09-10T23:14:46.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7f1fc8164640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc0073730 con 0x7f1fc0201630 2024-09-10T23:14:46.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7f1fc56ff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fc00b00c0 0x7f1fc01fea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7ff4a97fa640 1 -- 172.21.15.90:0/1732864522 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4940035f0 con 0x7ff4ac0ca420 2024-09-10T23:14:46.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7fe6227fc640 1 -- 172.21.15.90:0/1457606384 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe624043070 con 0x7fe62c0cf420 2024-09-10T23:14:46.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.275+0000 7fe6227fc640 1 -- 172.21.15.90:0/1457606384 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624036400 con 0x7fe62c0cf420 2024-09-10T23:14:46.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7f1fc56ff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fc00b00c0 0x7f1fc01fea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50496/0 (socket says 172.21.15.90:50496) 2024-09-10T23:14:46.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7fa21bbd3640 1 -- 172.21.15.90:0/3435926725 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2140d4b30 msgr2=0x7fa2140b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7fa21bbd3640 1 --2- 172.21.15.90:0/3435926725 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2140d4b30 0x7fa2140b2d00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa210009830 tx=0x7fa21002a5b0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7f1fc56ff640 1 -- 172.21.15.90:0/1469897526 learned_addr learned my addr 172.21.15.90:0/1469897526 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:46.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7f1fc6701640 1 --2- 172.21.15.90:0/1469897526 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fc0201630 0x7f1fc00700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7f2c2ed9d640 1 --2- 172.21.15.90:0/3280932461 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c280e2770 0x7f2c2819b0c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2c3006a7a0 tx=0x7f2c30069fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.276+0000 7ff4a97fa640 1 -- 172.21.15.90:0/1732864522 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff494015070 con 0x7ff4ac0ca420 2024-09-10T23:14:46.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7f1fc5f00640 1 --2- 172.21.15.90:0/1469897526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fac004800 0x7f1fc00ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7f2c1effd640 1 -- 172.21.15.90:0/3280932461 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3007f070 con 0x7f2c280e2770 2024-09-10T23:14:46.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7ff4a97fa640 1 -- 172.21.15.90:0/1732864522 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494003b20 con 0x7ff4ac0ca420 2024-09-10T23:14:46.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7f2c1effd640 1 -- 172.21.15.90:0/3280932461 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c300746c0 con 0x7f2c280e2770 2024-09-10T23:14:46.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7ff59628a640 1 --2- 172.21.15.90:0/4054027286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5900cc310 0x7ff5900c5d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff58800ca30 tx=0x7ff58800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7fa21bbd3640 1 -- 172.21.15.90:0/3435926725 shutdown_connections 2024-09-10T23:14:46.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7fa21bbd3640 1 --2- 172.21.15.90:0/3435926725 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2140d4b30 0x7fa2140b2d00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7fa21bbd3640 1 -- 172.21.15.90:0/3435926725 >> 172.21.15.90:0/3435926725 conn(0x7fa2140d4010 msgr2=0x7fa2140d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7f1fc6701640 1 -- 172.21.15.90:0/1469897526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fac004800 msgr2=0x7f1fc00ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7f1fc6701640 1 --2- 172.21.15.90:0/1469897526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fac004800 0x7f1fc00ae660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7f1fc6701640 1 -- 172.21.15.90:0/1469897526 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fc00b00c0 msgr2=0x7f1fc01fea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7f1fc6701640 1 --2- 172.21.15.90:0/1469897526 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fc00b00c0 0x7f1fc01fea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7f1fc6701640 1 -- 172.21.15.90:0/1469897526 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc0202090 con 0x7f1fc0201630 2024-09-10T23:14:46.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7f1fc6701640 1 --2- 172.21.15.90:0/1469897526 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fc0201630 0x7f1fc00700a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1fc015bd50 tx=0x7f1fb8006790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7ff4b22b8640 1 -- 172.21.15.90:0/1732864522 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4ac09afd0 con 0x7ff4ac0ca420 2024-09-10T23:14:46.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7f1fc56ff640 1 --2- 172.21.15.90:0/1469897526 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fc00b00c0 0x7f1fc01fea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:14:46.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7f2c1effd640 1 -- 172.21.15.90:0/3280932461 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30074b90 con 0x7f2c280e2770 2024-09-10T23:14:46.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7f2c34d45640 1 -- 172.21.15.90:0/3280932461 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c2819bdb0 con 0x7f2c280e2770 2024-09-10T23:14:46.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7f2c34d45640 1 -- 172.21.15.90:0/3280932461 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c2804fde0 con 0x7f2c280e2770 2024-09-10T23:14:46.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7fe6227fc640 1 -- 172.21.15.90:0/1457606384 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe6240365a0 con 0x7fe62c0cf420 2024-09-10T23:14:46.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7fe633ea2640 1 -- 172.21.15.90:0/1457606384 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe614001030 con 0x7fe62c0cf420 2024-09-10T23:14:46.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.278+0000 7ff4b22b8640 1 -- 172.21.15.90:0/1732864522 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4ac15b720 con 0x7ff4ac0ca420 2024-09-10T23:14:46.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.278+0000 7ff5867fc640 1 -- 172.21.15.90:0/4054027286 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff588007d90 con 0x7ff5900cc310 2024-09-10T23:14:46.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.278+0000 7ff5867fc640 1 -- 172.21.15.90:0/4054027286 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff588004c10 con 0x7ff5900cc310 2024-09-10T23:14:46.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.278+0000 7ff5867fc640 1 -- 172.21.15.90:0/4054027286 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff588005020 con 0x7ff5900cc310 2024-09-10T23:14:46.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.278+0000 7ff597ced640 1 -- 172.21.15.90:0/4054027286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff59009d810 con 0x7ff5900cc310 2024-09-10T23:14:46.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.278+0000 7ff597ced640 1 -- 172.21.15.90:0/4054027286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5900b3b20 con 0x7ff5900cc310 2024-09-10T23:14:46.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.278+0000 7f645b7fe640 1 -- 172.21.15.90:0/2982803666 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450031a50 con 0x7f645c069fc0 2024-09-10T23:14:46.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.277+0000 7fa21bbd3640 1 -- 172.21.15.90:0/3435926725 shutdown_connections 2024-09-10T23:14:46.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.278+0000 7fe6227fc640 1 --2- 172.21.15.90:0/1457606384 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe610077f70 0x7fe61007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.278+0000 7fe6227fc640 1 -- 172.21.15.90:0/1457606384 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe6240ba960 con 0x7fe62c0cf420 2024-09-10T23:14:46.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.278+0000 7fe6227fc640 1 --2- 172.21.15.90:0/1457606384 >> [v2:172.21.15.90:6816/2119406419,v1:172.21.15.90:6817/2119406419] conn(0x7fe6100801f0 0x7fe610082610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.279+0000 7fe6227fc640 1 -- 172.21.15.90:0/1457606384 --> [v2:172.21.15.90:6816/2119406419,v1:172.21.15.90:6817/2119406419] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe624030ec0 con 0x7fe6100801f0 2024-09-10T23:14:46.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.279+0000 7fe6227fc640 1 -- 172.21.15.90:0/1457606384 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fe6240bf280 con 0x7fe62c0cf420 2024-09-10T23:14:46.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.279+0000 7fe63243f640 1 --2- 172.21.15.90:0/1457606384 >> [v2:172.21.15.90:6816/2119406419,v1:172.21.15.90:6817/2119406419] conn(0x7fe6100801f0 0x7fe610082610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.279+0000 7fa21bbd3640 1 -- 172.21.15.90:0/3435926725 wait complete. 2024-09-10T23:14:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.278+0000 7f1fb67fc640 1 -- 172.21.15.90:0/1469897526 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800fc30 con 0x7f1fc0201630 2024-09-10T23:14:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.278+0000 7f1fb67fc640 1 -- 172.21.15.90:0/1469897526 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fb800fdf0 con 0x7f1fc0201630 2024-09-10T23:14:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.279+0000 7f1fb67fc640 1 -- 172.21.15.90:0/1469897526 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8011690 con 0x7f1fc0201630 2024-09-10T23:14:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.279+0000 7f1fc8164640 1 -- 172.21.15.90:0/1469897526 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc0202370 con 0x7f1fc0201630 2024-09-10T23:14:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.278+0000 7f6461a7b640 1 -- 172.21.15.90:0/2982803666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f645c069fc0 msgr2=0x7f645c0cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.278+0000 7f6461a7b640 1 --2- 172.21.15.90:0/2982803666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f645c069fc0 0x7f645c0cd940 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6450009830 tx=0x7f645002a640 comp rx=0 tx=0).stop 2024-09-10T23:14:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.279+0000 7f6461a7b640 1 -- 172.21.15.90:0/2982803666 shutdown_connections 2024-09-10T23:14:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.279+0000 7f6461a7b640 1 --2- 172.21.15.90:0/2982803666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f645c069fc0 0x7f645c0cd940 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.279+0000 7f6461a7b640 1 -- 172.21.15.90:0/2982803666 >> 172.21.15.90:0/2982803666 conn(0x7f645c0cc7f0 msgr2=0x7f645c0ccbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.279+0000 7f2c34d45640 1 -- 172.21.15.90:0/3280932461 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2c2804f8f0 con 0x7f2c280e2770 2024-09-10T23:14:46.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.279+0000 7ff573fff640 1 -- 172.21.15.90:0/4054027286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff5900ca420 con 0x7ff5900cc310 2024-09-10T23:14:46.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.279+0000 7f1fc8164640 1 -- 172.21.15.90:0/1469897526 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc00aeba0 con 0x7f1fc0201630 2024-09-10T23:14:46.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.280+0000 7ff4b22b8640 1 -- 172.21.15.90:0/1732864522 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff4ac0ca850 con 0x7ff4ac0ca420 2024-09-10T23:14:46.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.280+0000 7fe63243f640 1 --2- 172.21.15.90:0/1457606384 >> [v2:172.21.15.90:6816/2119406419,v1:172.21.15.90:6817/2119406419] conn(0x7fe6100801f0 0x7fe610082610 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.280+0000 7ff5867fc640 1 -- 172.21.15.90:0/4054027286 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff5880051c0 con 0x7ff5900cc310 2024-09-10T23:14:46.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.280+0000 7f1fc8164640 1 -- 172.21.15.90:0/1469897526 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1fc00ae240 con 0x7f1fc0201630 2024-09-10T23:14:46.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.279+0000 7f2c1effd640 1 -- 172.21.15.90:0/3280932461 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2c30084450 con 0x7f2c280e2770 2024-09-10T23:14:46.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7fa21bbd3640 1 Processor -- start 2024-09-10T23:14:46.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7f2867285640 1 -- 172.21.15.90:0/2397339266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28600cc3f0 msgr2=0x7f28600d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7f2867285640 1 --2- 172.21.15.90:0/2397339266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28600cc3f0 0x7f28600d03a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f28600afb20 tx=0x7f285c02b810 comp rx=0 tx=0).stop 2024-09-10T23:14:46.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.279+0000 7f6461a7b640 1 -- 172.21.15.90:0/2982803666 shutdown_connections 2024-09-10T23:14:46.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7ff5867fc640 1 --2- 172.21.15.90:0/4054027286 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff574078040 0x7ff57407a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7fa21bbd3640 1 -- start start 2024-09-10T23:14:46.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.280+0000 7f2c1effd640 1 --2- 172.21.15.90:0/3280932461 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2c10077fa0 0x7f2c1007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.280+0000 7f2c1effd640 1 -- 172.21.15.90:0/3280932461 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2c30104170 con 0x7f2c280e2770 2024-09-10T23:14:46.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.280+0000 7f2c1effd640 1 --2- 172.21.15.90:0/3280932461 >> [v2:172.21.15.90:6808/2857408980,v1:172.21.15.90:6809/2857408980] conn(0x7f2c10080220 0x7f2c10082640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.280+0000 7f2c1effd640 1 -- 172.21.15.90:0/3280932461 --> [v2:172.21.15.90:6808/2857408980,v1:172.21.15.90:6809/2857408980] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c3006fe50 con 0x7f2c10080220 2024-09-10T23:14:46.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.280+0000 7f2c1effd640 1 -- 172.21.15.90:0/3280932461 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f2c3010b050 con 0x7f2c280e2770 2024-09-10T23:14:46.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7fe6227fc640 1 -- 172.21.15.90:0/1457606384 <== osd.2 v2:172.21.15.90:6816/2119406419 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe624030ec0 con 0x7fe6100801f0 2024-09-10T23:14:46.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7f2867285640 1 -- 172.21.15.90:0/2397339266 shutdown_connections 2024-09-10T23:14:46.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7ff595a89640 1 --2- 172.21.15.90:0/4054027286 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff574078040 0x7ff57407a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7ff5867fc640 1 -- 172.21.15.90:0/4054027286 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff58809a7a0 con 0x7ff5900cc310 2024-09-10T23:14:46.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7f2c2dd9b640 1 --2- 172.21.15.90:0/3280932461 >> [v2:172.21.15.90:6808/2857408980,v1:172.21.15.90:6809/2857408980] conn(0x7f2c10080220 0x7f2c10082640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7f2c2e59c640 1 --2- 172.21.15.90:0/3280932461 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2c10077fa0 0x7f2c1007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7f2c2dd9b640 1 --2- 172.21.15.90:0/3280932461 >> [v2:172.21.15.90:6808/2857408980,v1:172.21.15.90:6809/2857408980] conn(0x7f2c10080220 0x7f2c10082640 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7f2867285640 1 --2- 172.21.15.90:0/2397339266 >> v2:172.21.15.171:3300/0 conn(0x7f28600ce310 0x7f28600ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7fe631c3e640 1 --2- 172.21.15.90:0/1457606384 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe610077f70 0x7fe61007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7f2867285640 1 --2- 172.21.15.90:0/2397339266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28600cfe70 0x7f28600d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7ff5867fc640 1 --2- 172.21.15.90:0/4054027286 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x7ff574080260 0x7ff574082680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7ff5867fc640 1 -- 172.21.15.90:0/4054027286 --> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff58800ee50 con 0x7ff574080260 2024-09-10T23:14:46.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7ff5867fc640 1 -- 172.21.15.90:0/4054027286 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ff5880a1050 con 0x7ff5900cc310 2024-09-10T23:14:46.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7f2867285640 1 --2- 172.21.15.90:0/2397339266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28600cc3f0 0x7f28600d03a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7f2867285640 1 -- 172.21.15.90:0/2397339266 >> 172.21.15.90:0/2397339266 conn(0x7f2860073430 msgr2=0x7f28600742e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.282+0000 7ff595a89640 1 --2- 172.21.15.90:0/4054027286 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff574078040 0x7ff57407a500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0095f0 tx=0x7ff58c004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.282+0000 7ff595288640 1 --2- 172.21.15.90:0/4054027286 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x7ff574080260 0x7ff574082680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.282+0000 7f1fb67fc640 1 -- 172.21.15.90:0/1469897526 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1fb803b970 con 0x7f1fc0201630 2024-09-10T23:14:46.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.282+0000 7f2867285640 1 -- 172.21.15.90:0/2397339266 shutdown_connections 2024-09-10T23:14:46.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.281+0000 7f6461a7b640 1 -- 172.21.15.90:0/2982803666 wait complete. 2024-09-10T23:14:46.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.282+0000 7fa21bbd3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2140d2760 0x7fa2141f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.282+0000 7fa21bbd3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2140d2b40 0x7fa21414e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.282+0000 7fa21bbd3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2140d4b30 0x7fa214157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.282+0000 7fa21bbd3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa21416da40 con 0x7fa2140d2b40 2024-09-10T23:14:46.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.282+0000 7fa21bbd3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa2140d1900 con 0x7fa2140d2760 2024-09-10T23:14:46.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.282+0000 7fa21bbd3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa21416dbc0 con 0x7fa2140d4b30 2024-09-10T23:14:46.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.282+0000 7fa21996f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2140d2760 0x7fa2141f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.282+0000 7f2c1effd640 1 -- 172.21.15.90:0/3280932461 <== osd.3 v2:172.21.15.90:6808/2857408980 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2c3006fe50 con 0x7f2c10080220 2024-09-10T23:14:46.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.282+0000 7ff4a97fa640 1 -- 172.21.15.90:0/1732864522 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff494003cc0 con 0x7ff4ac0ca420 2024-09-10T23:14:46.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7fa21916e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2140d2b40 0x7fa21414e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7fa21916e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2140d2b40 0x7fa21414e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50512/0 (socket says 172.21.15.90:50512) 2024-09-10T23:14:46.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7fa21916e640 1 -- 172.21.15.90:0/3373567295 learned_addr learned my addr 172.21.15.90:0/3373567295 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:46.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.282+0000 7f1fb67fc640 1 --2- 172.21.15.90:0/1469897526 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1fa40780a0 0x7f1fa407a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7f1fb67fc640 1 -- 172.21.15.90:0/1469897526 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1fb809ada0 con 0x7f1fc0201630 2024-09-10T23:14:46.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7f1fb67fc640 1 --2- 172.21.15.90:0/1469897526 >> [v2:172.21.15.171:6826/126573870,v1:172.21.15.171:6827/126573870] conn(0x7f1fa40802c0 0x7f1fa40826e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7f1fb67fc640 1 -- 172.21.15.90:0/1469897526 --> [v2:172.21.15.171:6826/126573870,v1:172.21.15.171:6827/126573870] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1fb8017e80 con 0x7f1fa40802c0 2024-09-10T23:14:46.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7f1fb67fc640 1 -- 172.21.15.90:0/1469897526 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f1fb809b190 con 0x7f1fc0201630 2024-09-10T23:14:46.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7f1fc5f00640 1 --2- 172.21.15.90:0/1469897526 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1fa40780a0 0x7f1fa407a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7f1fc56ff640 1 --2- 172.21.15.90:0/1469897526 >> [v2:172.21.15.171:6826/126573870,v1:172.21.15.171:6827/126573870] conn(0x7f1fa40802c0 0x7f1fa40826e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.282+0000 7f2867285640 1 -- 172.21.15.90:0/2397339266 wait complete. 2024-09-10T23:14:46.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7fe631c3e640 1 --2- 172.21.15.90:0/1457606384 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe610077f70 0x7fe61007a430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe61c0058c0 tx=0x7fe61c00a4c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7ff4a97fa640 1 --2- 172.21.15.90:0/1732864522 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff48c078040 0x7ff48c07a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7ff4a97fa640 1 -- 172.21.15.90:0/1732864522 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff494099570 con 0x7ff4ac0ca420 2024-09-10T23:14:46.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7ff4a97fa640 1 --2- 172.21.15.90:0/1732864522 >> [v2:172.21.15.90:6800/1564469617,v1:172.21.15.90:6801/1564469617] conn(0x7ff48c0802c0 0x7ff48c0826e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7ff4a97fa640 1 -- 172.21.15.90:0/1732864522 --> [v2:172.21.15.90:6800/1564469617,v1:172.21.15.90:6801/1564469617] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff48c082d90 con 0x7ff48c0802c0 2024-09-10T23:14:46.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7ff4a97fa640 1 -- 172.21.15.90:0/1732864522 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ff4940a0050 con 0x7ff4ac0ca420 2024-09-10T23:14:46.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7ff4abfff640 1 --2- 172.21.15.90:0/1732864522 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff48c078040 0x7ff48c07a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.282+0000 7ff595288640 1 --2- 172.21.15.90:0/4054027286 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x7ff574080260 0x7ff574082680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.284+0000 7ff5867fc640 1 -- 172.21.15.90:0/4054027286 <== osd.1 v2:172.21.15.90:6824/165329743 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff58800ee50 con 0x7ff574080260 2024-09-10T23:14:46.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7f6461a7b640 1 Processor -- start 2024-09-10T23:14:46.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7f6461a7b640 1 -- start start 2024-09-10T23:14:46.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.284+0000 7f2867285640 1 Processor -- start 2024-09-10T23:14:46.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.284+0000 7f2867285640 1 -- start start 2024-09-10T23:14:46.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.284+0000 7f1fc5f00640 1 --2- 172.21.15.90:0/1469897526 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1fa40780a0 0x7f1fa407a560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0052150 tx=0x7f1fb0005d10 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.284+0000 7ff4b0855640 1 --2- 172.21.15.90:0/1732864522 >> [v2:172.21.15.90:6800/1564469617,v1:172.21.15.90:6801/1564469617] conn(0x7ff48c0802c0 0x7ff48c0826e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7fa21916e640 1 -- 172.21.15.90:0/3373567295 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2140d4b30 msgr2=0x7fa214157140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T23:14:46.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7fa21916e640 1 --2- 172.21.15.90:0/3373567295 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2140d4b30 0x7fa214157140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7fa21916e640 1 -- 172.21.15.90:0/3373567295 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2140d2760 msgr2=0x7fa2141f8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7fa21916e640 1 --2- 172.21.15.90:0/3373567295 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2140d2760 0x7fa2141f8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.283+0000 7fa21916e640 1 -- 172.21.15.90:0/3373567295 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21414ec20 con 0x7fa2140d2b40 2024-09-10T23:14:46.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.284+0000 7f1fc56ff640 1 --2- 172.21.15.90:0/1469897526 >> [v2:172.21.15.171:6826/126573870,v1:172.21.15.171:6827/126573870] conn(0x7f1fa40802c0 0x7f1fa40826e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.284+0000 7ff4abfff640 1 --2- 172.21.15.90:0/1732864522 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff48c078040 0x7ff48c07a500 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff49c000c00 tx=0x7ff49c0051b0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.284+0000 7fa21916e640 1 --2- 172.21.15.90:0/3373567295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2140d2b40 0x7fa21414e6e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa21002aba0 tx=0x7fa210003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7ff4b0855640 1 --2- 172.21.15.90:0/1732864522 >> [v2:172.21.15.90:6800/1564469617,v1:172.21.15.90:6801/1564469617] conn(0x7ff48c0802c0 0x7ff48c0826e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7fa2067fc640 1 -- 172.21.15.90:0/3373567295 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210005020 con 0x7fa2140d2b40 2024-09-10T23:14:46.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7fa2067fc640 1 -- 172.21.15.90:0/3373567295 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2100052b0 con 0x7fa2140d2b40 2024-09-10T23:14:46.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7fa2067fc640 1 -- 172.21.15.90:0/3373567295 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2100047a0 con 0x7fa2140d2b40 2024-09-10T23:14:46.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7fa21bbd3640 1 -- 172.21.15.90:0/3373567295 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa21414fbc0 con 0x7fa2140d2b40 2024-09-10T23:14:46.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7fa21bbd3640 1 -- 172.21.15.90:0/3373567295 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa214150180 con 0x7fa2140d2b40 2024-09-10T23:14:46.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7f2867285640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28600cc3f0 0x7f28600c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7f2867285640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28600ce310 0x7f28600b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7f2867285640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28600cfe70 0x7f28600b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7f2867285640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f28600cab70 con 0x7f28600ce310 2024-09-10T23:14:46.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7f2867285640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2860070f80 con 0x7f28600cc3f0 2024-09-10T23:14:46.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7f2867285640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f28600cf5c0 con 0x7f28600cfe70 2024-09-10T23:14:46.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.286+0000 7f2865021640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28600cc3f0 0x7f28600c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.286+0000 7f2865021640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28600cc3f0 0x7f28600c74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.90:59018/0 (socket says 172.21.15.90:59018) 2024-09-10T23:14:46.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.286+0000 7f2865021640 1 -- 172.21.15.90:0/2641229878 learned_addr learned my addr 172.21.15.90:0/2641229878 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:46.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.286+0000 7ff4a97fa640 1 -- 172.21.15.90:0/1732864522 <== osd.0 v2:172.21.15.90:6800/1564469617 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff48c082d90 con 0x7ff48c0802c0 2024-09-10T23:14:46.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.286+0000 7f2865822640 1 --2- 172.21.15.90:0/2641229878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28600cfe70 0x7f28600b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7f6461a7b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f645c069fc0 0x7f645c0c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7f6461a7b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f645c0708f0 0x7f645c150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.286+0000 7f2865021640 1 -- 172.21.15.90:0/2641229878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28600cfe70 msgr2=0x7f28600b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7f6461a7b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f645c073100 0x7f645c0af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7f6461a7b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f645c0710f0 con 0x7f645c0708f0 2024-09-10T23:14:46.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7f6461a7b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f645c070f70 con 0x7f645c069fc0 2024-09-10T23:14:46.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.286+0000 7fa21bbd3640 1 -- 172.21.15.90:0/3373567295 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa214150830 con 0x7fa2140d2b40 2024-09-10T23:14:46.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.286+0000 7f2865021640 1 --2- 172.21.15.90:0/2641229878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28600cfe70 0x7f28600b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.287+0000 7f2865021640 1 -- 172.21.15.90:0/2641229878 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28600ce310 msgr2=0x7f28600b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.287+0000 7f2865021640 1 --2- 172.21.15.90:0/2641229878 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28600ce310 0x7f28600b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.287+0000 7f2865021640 1 -- 172.21.15.90:0/2641229878 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28600c9770 con 0x7f28600cc3f0 2024-09-10T23:14:46.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7f6461a7b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f645c071270 con 0x7f645c073100 2024-09-10T23:14:46.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7f645bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f645c0708f0 0x7f645c150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7f645bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f645c0708f0 0x7f645c150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50524/0 (socket says 172.21.15.90:50524) 2024-09-10T23:14:46.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.285+0000 7f645bfff640 1 -- 172.21.15.90:0/1628601018 learned_addr learned my addr 172.21.15.90:0/1628601018 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:46.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.286+0000 7f646127a640 1 --2- 172.21.15.90:0/1628601018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f645c073100 0x7f645c0af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.286+0000 7f645bfff640 1 -- 172.21.15.90:0/1628601018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f645c073100 msgr2=0x7f645c0af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.286+0000 7f645bfff640 1 --2- 172.21.15.90:0/1628601018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f645c073100 0x7f645c0af0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.286+0000 7f645bfff640 1 -- 172.21.15.90:0/1628601018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f645c069fc0 msgr2=0x7f645c0c99e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T23:14:46.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.286+0000 7f645bfff640 1 --2- 172.21.15.90:0/1628601018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f645c069fc0 0x7f645c0c99e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.286+0000 7f645bfff640 1 -- 172.21.15.90:0/1628601018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645c09d400 con 0x7f645c0708f0 2024-09-10T23:14:46.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.287+0000 7f2865021640 1 --2- 172.21.15.90:0/2641229878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28600cc3f0 0x7f28600c74e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f285c00a960 tx=0x7f285c004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.288+0000 7fa2067fc640 1 -- 172.21.15.90:0/3373567295 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa210031770 con 0x7fa2140d2b40 2024-09-10T23:14:46.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.287+0000 7f2855ffb640 1 -- 172.21.15.90:0/2641229878 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c040030 con 0x7f28600cc3f0 2024-09-10T23:14:46.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.287+0000 7f2855ffb640 1 -- 172.21.15.90:0/2641229878 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f285c003800 con 0x7f28600cc3f0 2024-09-10T23:14:46.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.287+0000 7f2855ffb640 1 -- 172.21.15.90:0/2641229878 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c003c30 con 0x7f28600cc3f0 2024-09-10T23:14:46.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.287+0000 7f2867285640 1 -- 172.21.15.90:0/2641229878 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28600c9a10 con 0x7f28600cc3f0 2024-09-10T23:14:46.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.288+0000 7f2867285640 1 -- 172.21.15.90:0/2641229878 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28600c7ff0 con 0x7f28600cc3f0 2024-09-10T23:14:46.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.288+0000 7f1fb67fc640 1 -- 172.21.15.90:0/1469897526 <== osd.6 v2:172.21.15.171:6826/126573870 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1fb8017e80 con 0x7f1fa40802c0 2024-09-10T23:14:46.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.287+0000 7f645bfff640 1 --2- 172.21.15.90:0/1628601018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f645c0708f0 0x7f645c150320 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f644800c450 tx=0x7f644800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.287+0000 7f64597fa640 1 -- 172.21.15.90:0/1628601018 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6448011790 con 0x7f645c0708f0 2024-09-10T23:14:46.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.287+0000 7f64597fa640 1 -- 172.21.15.90:0/1628601018 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6448017070 con 0x7f645c0708f0 2024-09-10T23:14:46.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.287+0000 7f64597fa640 1 -- 172.21.15.90:0/1628601018 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6448011cc0 con 0x7f645c0708f0 2024-09-10T23:14:46.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.287+0000 7f6461a7b640 1 -- 172.21.15.90:0/1628601018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f645c09d6e0 con 0x7f645c0708f0 2024-09-10T23:14:46.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.288+0000 7f6461a7b640 1 -- 172.21.15.90:0/1628601018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f645c09d080 con 0x7f645c0708f0 2024-09-10T23:14:46.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.289+0000 7fa2067fc640 1 --2- 172.21.15.90:0/3373567295 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa1f8077fc0 0x7fa1f807a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.289+0000 7fa2067fc640 1 -- 172.21.15.90:0/3373567295 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa2100baed0 con 0x7fa2140d2b40 2024-09-10T23:14:46.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.289+0000 7fa2067fc640 1 --2- 172.21.15.90:0/3373567295 >> [v2:172.21.15.171:6810/1503898082,v1:172.21.15.171:6811/1503898082] conn(0x7fa1f8080160 0x7fa1f8082580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.289+0000 7fa2067fc640 1 -- 172.21.15.90:0/3373567295 --> [v2:172.21.15.171:6810/1503898082,v1:172.21.15.171:6811/1503898082] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa210032e50 con 0x7fa1f8080160 2024-09-10T23:14:46.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.289+0000 7fa21996f640 1 --2- 172.21.15.90:0/3373567295 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa1f8077fc0 0x7fa1f807a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.289+0000 7f6446ffd640 1 -- 172.21.15.90:0/1628601018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f645c073f30 con 0x7f645c0708f0 2024-09-10T23:14:46.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.289+0000 7fa21a170640 1 --2- 172.21.15.90:0/3373567295 >> [v2:172.21.15.171:6810/1503898082,v1:172.21.15.171:6811/1503898082] conn(0x7fa1f8080160 0x7fa1f8082580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.290+0000 7fa2067fc640 1 -- 172.21.15.90:0/3373567295 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa21007fa90 con 0x7fa2140d2b40 2024-09-10T23:14:46.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.290+0000 7f2867285640 1 -- 172.21.15.90:0/2641229878 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f28600cee90 con 0x7f28600cc3f0 2024-09-10T23:14:46.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.290+0000 7fa21996f640 1 --2- 172.21.15.90:0/3373567295 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa1f8077fc0 0x7fa1f807a480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa2080016b0 tx=0x7fa208009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.290+0000 7f2c2e59c640 1 --2- 172.21.15.90:0/3280932461 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2c10077fa0 0x7f2c1007a460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2c20000f60 tx=0x7f2c20009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.290+0000 7fa21a170640 1 --2- 172.21.15.90:0/3373567295 >> [v2:172.21.15.171:6810/1503898082,v1:172.21.15.171:6811/1503898082] conn(0x7fa1f8080160 0x7fa1f8082580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.291+0000 7f2855ffb640 1 -- 172.21.15.90:0/2641229878 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f285c00b040 con 0x7f28600cc3f0 2024-09-10T23:14:46.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.291+0000 7fa2067fc640 1 -- 172.21.15.90:0/3373567295 <== osd.4 v2:172.21.15.171:6810/1503898082 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa210032e50 con 0x7fa1f8080160 2024-09-10T23:14:46.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.291+0000 7f64597fa640 1 -- 172.21.15.90:0/1628601018 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f644801c460 con 0x7f645c0708f0 2024-09-10T23:14:46.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.291+0000 7f2855ffb640 1 --2- 172.21.15.90:0/2641229878 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2844077fa0 0x7f284407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.292+0000 7f2855ffb640 1 -- 172.21.15.90:0/2641229878 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f285c0baae0 con 0x7f28600cc3f0 2024-09-10T23:14:46.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.292+0000 7f2855ffb640 1 --2- 172.21.15.90:0/2641229878 >> [v2:172.21.15.171:6818/2053754805,v1:172.21.15.171:6819/2053754805] conn(0x7f2844080140 0x7f2844082560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.292+0000 7f2855ffb640 1 -- 172.21.15.90:0/2641229878 --> [v2:172.21.15.171:6818/2053754805,v1:172.21.15.171:6819/2053754805] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f285c00c1c0 con 0x7f2844080140 2024-09-10T23:14:46.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.292+0000 7f2865822640 1 --2- 172.21.15.90:0/2641229878 >> [v2:172.21.15.171:6818/2053754805,v1:172.21.15.171:6819/2053754805] conn(0x7f2844080140 0x7f2844082560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.292+0000 7f2864820640 1 --2- 172.21.15.90:0/2641229878 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2844077fa0 0x7f284407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.292+0000 7f64597fa640 1 --2- 172.21.15.90:0/1628601018 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6440078040 0x7f644007a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.292+0000 7f64597fa640 1 -- 172.21.15.90:0/1628601018 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f644809a530 con 0x7f645c0708f0 2024-09-10T23:14:46.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.292+0000 7f64597fa640 1 --2- 172.21.15.90:0/1628601018 >> [v2:172.21.15.171:6802/3756038245,v1:172.21.15.171:6803/3756038245] conn(0x7f64400802c0 0x7f64400826e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.292+0000 7f64597fa640 1 -- 172.21.15.90:0/1628601018 --> [v2:172.21.15.171:6802/3756038245,v1:172.21.15.171:6803/3756038245] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6448023e70 con 0x7f64400802c0 2024-09-10T23:14:46.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.292+0000 7f64597fa640 1 -- 172.21.15.90:0/1628601018 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f644809a920 con 0x7f645c0708f0 2024-09-10T23:14:46.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.292+0000 7f2855ffb640 1 -- 172.21.15.90:0/2641229878 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f285c07f540 con 0x7f28600cc3f0 2024-09-10T23:14:46.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.293+0000 7f646127a640 1 --2- 172.21.15.90:0/1628601018 >> [v2:172.21.15.171:6802/3756038245,v1:172.21.15.171:6803/3756038245] conn(0x7f64400802c0 0x7f64400826e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.293+0000 7f6460a79640 1 --2- 172.21.15.90:0/1628601018 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6440078040 0x7f644007a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.293+0000 7f2865822640 1 --2- 172.21.15.90:0/2641229878 >> [v2:172.21.15.171:6818/2053754805,v1:172.21.15.171:6819/2053754805] conn(0x7f2844080140 0x7f2844082560 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.293+0000 7f2864820640 1 --2- 172.21.15.90:0/2641229878 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2844077fa0 0x7f284407a460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f286015dd70 tx=0x7f2850006ba0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.293+0000 7f646127a640 1 --2- 172.21.15.90:0/1628601018 >> [v2:172.21.15.171:6802/3756038245,v1:172.21.15.171:6803/3756038245] conn(0x7f64400802c0 0x7f64400826e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.293+0000 7f6460a79640 1 --2- 172.21.15.90:0/1628601018 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6440078040 0x7f644007a500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6450034000 tx=0x7f6450004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.294+0000 7f2855ffb640 1 -- 172.21.15.90:0/2641229878 <== osd.5 v2:172.21.15.171:6818/2053754805 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f285c00c1c0 con 0x7f2844080140 2024-09-10T23:14:46.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.296+0000 7f64597fa640 1 -- 172.21.15.90:0/1628601018 <== osd.7 v2:172.21.15.171:6802/3756038245 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6448023e70 con 0x7f64400802c0 2024-09-10T23:14:46.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.311+0000 7f2c34d45640 1 -- 172.21.15.90:0/3280932461 --> [v2:172.21.15.90:6808/2857408980,v1:172.21.15.90:6809/2857408980] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2c28057e70 con 0x7f2c10080220 2024-09-10T23:14:46.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.312+0000 7f2c1effd640 1 -- 172.21.15.90:0/3280932461 <== osd.3 v2:172.21.15.90:6808/2857408980 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2c28057e70 con 0x7f2c10080220 2024-09-10T23:14:46.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.312+0000 7f2c1cff9640 1 -- 172.21.15.90:0/3280932461 >> [v2:172.21.15.90:6808/2857408980,v1:172.21.15.90:6809/2857408980] conn(0x7f2c10080220 msgr2=0x7f2c10082640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.313+0000 7f2c1cff9640 1 --2- 172.21.15.90:0/3280932461 >> [v2:172.21.15.90:6808/2857408980,v1:172.21.15.90:6809/2857408980] conn(0x7f2c10080220 0x7f2c10082640 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.313+0000 7f2c1cff9640 1 -- 172.21.15.90:0/3280932461 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2c10077fa0 msgr2=0x7f2c1007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.313+0000 7f2c1cff9640 1 --2- 172.21.15.90:0/3280932461 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2c10077fa0 0x7f2c1007a460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2c20000f60 tx=0x7f2c20009040 comp rx=0 tx=0).stop 2024-09-10T23:14:46.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.313+0000 7f2c1cff9640 1 -- 172.21.15.90:0/3280932461 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c280e2770 msgr2=0x7f2c2819b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.313+0000 7f2c1cff9640 1 --2- 172.21.15.90:0/3280932461 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c280e2770 0x7f2c2819b0c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2c3006a7a0 tx=0x7f2c30069fc0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.313+0000 7f2c2ed9d640 1 -- 172.21.15.90:0/3280932461 reap_dead start 2024-09-10T23:14:46.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.313+0000 7f2c1cff9640 1 -- 172.21.15.90:0/3280932461 shutdown_connections 2024-09-10T23:14:46.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.313+0000 7f2c1cff9640 1 -- 172.21.15.90:0/3280932461 >> 172.21.15.90:0/3280932461 conn(0x7f2c2803a3a0 msgr2=0x7f2c28056c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.314+0000 7f2c1cff9640 1 -- 172.21.15.90:0/3280932461 shutdown_connections 2024-09-10T23:14:46.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.314+0000 7f2c1cff9640 1 -- 172.21.15.90:0/3280932461 wait complete. 2024-09-10T23:14:46.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.314+0000 7fe633ea2640 1 -- 172.21.15.90:0/1457606384 --> [v2:172.21.15.90:6816/2119406419,v1:172.21.15.90:6817/2119406419] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe614002dd0 con 0x7fe6100801f0 2024-09-10T23:14:46.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.314+0000 7ff573fff640 1 -- 172.21.15.90:0/4054027286 --> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff5900b53f0 con 0x7ff574080260 2024-09-10T23:14:46.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.314+0000 7fe6227fc640 1 -- 172.21.15.90:0/1457606384 <== osd.2 v2:172.21.15.90:6816/2119406419 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe614002dd0 con 0x7fe6100801f0 2024-09-10T23:14:46.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.315+0000 7ff5867fc640 1 -- 172.21.15.90:0/4054027286 <== osd.1 v2:172.21.15.90:6824/165329743 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff5900b53f0 con 0x7ff574080260 2024-09-10T23:14:46.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.315+0000 7ff573fff640 1 -- 172.21.15.90:0/4054027286 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x7ff574080260 msgr2=0x7ff574082680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.315+0000 7ff573fff640 1 --2- 172.21.15.90:0/4054027286 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x7ff574080260 0x7ff574082680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.315+0000 7ff573fff640 1 -- 172.21.15.90:0/4054027286 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff574078040 msgr2=0x7ff57407a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.315+0000 7ff573fff640 1 --2- 172.21.15.90:0/4054027286 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff574078040 0x7ff57407a500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0095f0 tx=0x7ff58c004730 comp rx=0 tx=0).stop 2024-09-10T23:14:46.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.315+0000 7ff573fff640 1 -- 172.21.15.90:0/4054027286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5900cc310 msgr2=0x7ff5900c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.315+0000 7ff573fff640 1 --2- 172.21.15.90:0/4054027286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5900cc310 0x7ff5900c5d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff58800ca30 tx=0x7ff58800cef0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.317+0000 7ff59628a640 1 -- 172.21.15.90:0/4054027286 reap_dead start 2024-09-10T23:14:46.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.317+0000 7ff573fff640 1 -- 172.21.15.90:0/4054027286 shutdown_connections 2024-09-10T23:14:46.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.317+0000 7ff573fff640 1 -- 172.21.15.90:0/4054027286 >> 172.21.15.90:0/4054027286 conn(0x7ff5900cc850 msgr2=0x7ff590075880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.317+0000 7ff4b22b8640 1 -- 172.21.15.90:0/1732864522 --> [v2:172.21.15.90:6800/1564469617,v1:172.21.15.90:6801/1564469617] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff4ac0cdc70 con 0x7ff48c0802c0 2024-09-10T23:14:46.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.317+0000 7ff4a97fa640 1 -- 172.21.15.90:0/1732864522 <== osd.0 v2:172.21.15.90:6800/1564469617 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff4ac0cdc70 con 0x7ff48c0802c0 2024-09-10T23:14:46.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.315+0000 7fe633ea2640 1 -- 172.21.15.90:0/1457606384 >> [v2:172.21.15.90:6816/2119406419,v1:172.21.15.90:6817/2119406419] conn(0x7fe6100801f0 msgr2=0x7fe610082610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.315+0000 7fe633ea2640 1 --2- 172.21.15.90:0/1457606384 >> [v2:172.21.15.90:6816/2119406419,v1:172.21.15.90:6817/2119406419] conn(0x7fe6100801f0 0x7fe610082610 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.315+0000 7fe633ea2640 1 -- 172.21.15.90:0/1457606384 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe610077f70 msgr2=0x7fe61007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.315+0000 7fe633ea2640 1 --2- 172.21.15.90:0/1457606384 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe610077f70 0x7fe61007a430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe61c0058c0 tx=0x7fe61c00a4c0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.315+0000 7fe633ea2640 1 -- 172.21.15.90:0/1457606384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe62c0cf420 msgr2=0x7fe62c16c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.315+0000 7fe633ea2640 1 --2- 172.21.15.90:0/1457606384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe62c0cf420 0x7fe62c16c2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe624009bf0 tx=0x7fe624003f10 comp rx=0 tx=0).stop 2024-09-10T23:14:46.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.316+0000 7fe63243f640 1 -- 172.21.15.90:0/1457606384 reap_dead start 2024-09-10T23:14:46.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.317+0000 7fe633ea2640 1 -- 172.21.15.90:0/1457606384 shutdown_connections 2024-09-10T23:14:46.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.317+0000 7fe633ea2640 1 -- 172.21.15.90:0/1457606384 >> 172.21.15.90:0/1457606384 conn(0x7fe62c06d540 msgr2=0x7fe62c075880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.318+0000 7ff4b22b8640 1 -- 172.21.15.90:0/1732864522 >> [v2:172.21.15.90:6800/1564469617,v1:172.21.15.90:6801/1564469617] conn(0x7ff48c0802c0 msgr2=0x7ff48c0826e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.318+0000 7ff4b22b8640 1 --2- 172.21.15.90:0/1732864522 >> [v2:172.21.15.90:6800/1564469617,v1:172.21.15.90:6801/1564469617] conn(0x7ff48c0802c0 0x7ff48c0826e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.318+0000 7fe633ea2640 1 -- 172.21.15.90:0/1457606384 shutdown_connections 2024-09-10T23:14:46.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.318+0000 7fe633ea2640 1 -- 172.21.15.90:0/1457606384 wait complete. 2024-09-10T23:14:46.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.318+0000 7ff4b22b8640 1 -- 172.21.15.90:0/1732864522 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff48c078040 msgr2=0x7ff48c07a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.318+0000 7ff4b22b8640 1 --2- 172.21.15.90:0/1732864522 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff48c078040 0x7ff48c07a500 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff49c000c00 tx=0x7ff49c0051b0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.318+0000 7ff4b22b8640 1 -- 172.21.15.90:0/1732864522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4ac0ca420 msgr2=0x7ff4ac0b3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.318+0000 7ff4b22b8640 1 --2- 172.21.15.90:0/1732864522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4ac0ca420 0x7ff4ac0b3060 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff49400d5a0 tx=0x7ff49400da60 comp rx=0 tx=0).stop 2024-09-10T23:14:46.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.318+0000 7ff4b0855640 1 -- 172.21.15.90:0/1732864522 reap_dead start 2024-09-10T23:14:46.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.318+0000 7ff4b22b8640 1 -- 172.21.15.90:0/1732864522 shutdown_connections 2024-09-10T23:14:46.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.318+0000 7ff4b22b8640 1 -- 172.21.15.90:0/1732864522 >> 172.21.15.90:0/1732864522 conn(0x7ff4ac0cc850 msgr2=0x7ff4ac0ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.318+0000 7ff4b22b8640 1 -- 172.21.15.90:0/1732864522 shutdown_connections 2024-09-10T23:14:46.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.318+0000 7ff4b22b8640 1 -- 172.21.15.90:0/1732864522 wait complete. 2024-09-10T23:14:46.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.318+0000 7ff573fff640 1 -- 172.21.15.90:0/4054027286 shutdown_connections 2024-09-10T23:14:46.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.318+0000 7ff573fff640 1 -- 172.21.15.90:0/4054027286 wait complete. 2024-09-10T23:14:46.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.318+0000 7fa21bbd3640 1 -- 172.21.15.90:0/3373567295 --> [v2:172.21.15.171:6810/1503898082,v1:172.21.15.171:6811/1503898082] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa2140b2d00 con 0x7fa1f8080160 2024-09-10T23:14:46.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.319+0000 7fa2067fc640 1 -- 172.21.15.90:0/3373567295 <== osd.4 v2:172.21.15.171:6810/1503898082 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa2140b2d00 con 0x7fa1f8080160 2024-09-10T23:14:46.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.319+0000 7f1fc8164640 1 -- 172.21.15.90:0/1469897526 --> [v2:172.21.15.171:6826/126573870,v1:172.21.15.171:6827/126573870] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1fc015b2b0 con 0x7f1fa40802c0 2024-09-10T23:14:46.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.320+0000 7fa21bbd3640 1 -- 172.21.15.90:0/3373567295 >> [v2:172.21.15.171:6810/1503898082,v1:172.21.15.171:6811/1503898082] conn(0x7fa1f8080160 msgr2=0x7fa1f8082580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.320+0000 7fa21bbd3640 1 --2- 172.21.15.90:0/3373567295 >> [v2:172.21.15.171:6810/1503898082,v1:172.21.15.171:6811/1503898082] conn(0x7fa1f8080160 0x7fa1f8082580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.320+0000 7f1fb67fc640 1 -- 172.21.15.90:0/1469897526 <== osd.6 v2:172.21.15.171:6826/126573870 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1fc015b2b0 con 0x7f1fa40802c0 2024-09-10T23:14:46.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.320+0000 7f1fc8164640 1 -- 172.21.15.90:0/1469897526 >> [v2:172.21.15.171:6826/126573870,v1:172.21.15.171:6827/126573870] conn(0x7f1fa40802c0 msgr2=0x7f1fa40826e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.320+0000 7f1fc8164640 1 --2- 172.21.15.90:0/1469897526 >> [v2:172.21.15.171:6826/126573870,v1:172.21.15.171:6827/126573870] conn(0x7f1fa40802c0 0x7f1fa40826e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.321+0000 7fa21bbd3640 1 -- 172.21.15.90:0/3373567295 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa1f8077fc0 msgr2=0x7fa1f807a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.321+0000 7f1fc8164640 1 -- 172.21.15.90:0/1469897526 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1fa40780a0 msgr2=0x7f1fa407a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.321+0000 7f1fc8164640 1 --2- 172.21.15.90:0/1469897526 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1fa40780a0 0x7f1fa407a560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0052150 tx=0x7f1fb0005d10 comp rx=0 tx=0).stop 2024-09-10T23:14:46.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.321+0000 7f1fc8164640 1 -- 172.21.15.90:0/1469897526 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fc0201630 msgr2=0x7f1fc00700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.321+0000 7f1fc8164640 1 --2- 172.21.15.90:0/1469897526 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fc0201630 0x7f1fc00700a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1fc015bd50 tx=0x7f1fb8006790 comp rx=0 tx=0).stop 2024-09-10T23:14:46.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.321+0000 7fa21bbd3640 1 --2- 172.21.15.90:0/3373567295 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa1f8077fc0 0x7fa1f807a480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa2080016b0 tx=0x7fa208009040 comp rx=0 tx=0).stop 2024-09-10T23:14:46.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.321+0000 7fa21bbd3640 1 -- 172.21.15.90:0/3373567295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2140d2b40 msgr2=0x7fa21414e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.321+0000 7fa21bbd3640 1 --2- 172.21.15.90:0/3373567295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2140d2b40 0x7fa21414e6e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa21002aba0 tx=0x7fa210003b90 comp rx=0 tx=0).stop 2024-09-10T23:14:46.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.321+0000 7fa21a170640 1 -- 172.21.15.90:0/3373567295 reap_dead start 2024-09-10T23:14:46.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.321+0000 7fa21bbd3640 1 -- 172.21.15.90:0/3373567295 shutdown_connections 2024-09-10T23:14:46.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.321+0000 7fa21bbd3640 1 -- 172.21.15.90:0/3373567295 >> 172.21.15.90:0/3373567295 conn(0x7fa2140d4010 msgr2=0x7fa2140d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.321+0000 7fa21bbd3640 1 -- 172.21.15.90:0/3373567295 shutdown_connections 2024-09-10T23:14:46.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.321+0000 7fa21bbd3640 1 -- 172.21.15.90:0/3373567295 wait complete. 2024-09-10T23:14:46.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.321+0000 7f1fc6701640 1 -- 172.21.15.90:0/1469897526 reap_dead start 2024-09-10T23:14:46.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.322+0000 7f1fc8164640 1 -- 172.21.15.90:0/1469897526 shutdown_connections 2024-09-10T23:14:46.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.322+0000 7f1fc8164640 1 -- 172.21.15.90:0/1469897526 >> 172.21.15.90:0/1469897526 conn(0x7f1fc00d0c90 msgr2=0x7f1fc00c5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.322+0000 7f1fc8164640 1 -- 172.21.15.90:0/1469897526 shutdown_connections 2024-09-10T23:14:46.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.322+0000 7f1fc8164640 1 -- 172.21.15.90:0/1469897526 wait complete. 2024-09-10T23:14:46.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.323+0000 7f2867285640 1 -- 172.21.15.90:0/2641229878 --> [v2:172.21.15.171:6818/2053754805,v1:172.21.15.171:6819/2053754805] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f28600b4540 con 0x7f2844080140 2024-09-10T23:14:46.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.324+0000 7f6446ffd640 1 -- 172.21.15.90:0/1628601018 --> [v2:172.21.15.171:6802/3756038245,v1:172.21.15.171:6803/3756038245] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f645c0c8fd0 con 0x7f64400802c0 2024-09-10T23:14:46.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.325+0000 7f2855ffb640 1 -- 172.21.15.90:0/2641229878 <== osd.5 v2:172.21.15.171:6818/2053754805 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f28600b4540 con 0x7f2844080140 2024-09-10T23:14:46.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.325+0000 7f2867285640 1 -- 172.21.15.90:0/2641229878 >> [v2:172.21.15.171:6818/2053754805,v1:172.21.15.171:6819/2053754805] conn(0x7f2844080140 msgr2=0x7f2844082560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.326+0000 7f2867285640 1 --2- 172.21.15.90:0/2641229878 >> [v2:172.21.15.171:6818/2053754805,v1:172.21.15.171:6819/2053754805] conn(0x7f2844080140 0x7f2844082560 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.326+0000 7f2867285640 1 -- 172.21.15.90:0/2641229878 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2844077fa0 msgr2=0x7f284407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.326+0000 7f2867285640 1 --2- 172.21.15.90:0/2641229878 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2844077fa0 0x7f284407a460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f286015dd70 tx=0x7f2850006ba0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.326+0000 7f2867285640 1 -- 172.21.15.90:0/2641229878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28600cc3f0 msgr2=0x7f28600c74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.326+0000 7f2867285640 1 --2- 172.21.15.90:0/2641229878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28600cc3f0 0x7f28600c74e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f285c00a960 tx=0x7f285c004360 comp rx=0 tx=0).stop 2024-09-10T23:14:46.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.326+0000 7f2865822640 1 -- 172.21.15.90:0/2641229878 reap_dead start 2024-09-10T23:14:46.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.325+0000 7f64597fa640 1 -- 172.21.15.90:0/1628601018 <== osd.7 v2:172.21.15.171:6802/3756038245 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f645c0c8fd0 con 0x7f64400802c0 2024-09-10T23:14:46.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.326+0000 7f6446ffd640 1 -- 172.21.15.90:0/1628601018 >> [v2:172.21.15.171:6802/3756038245,v1:172.21.15.171:6803/3756038245] conn(0x7f64400802c0 msgr2=0x7f64400826e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.326+0000 7f6446ffd640 1 --2- 172.21.15.90:0/1628601018 >> [v2:172.21.15.171:6802/3756038245,v1:172.21.15.171:6803/3756038245] conn(0x7f64400802c0 0x7f64400826e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.327+0000 7f6446ffd640 1 -- 172.21.15.90:0/1628601018 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6440078040 msgr2=0x7f644007a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.327+0000 7f6446ffd640 1 --2- 172.21.15.90:0/1628601018 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6440078040 0x7f644007a500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6450034000 tx=0x7f6450004730 comp rx=0 tx=0).stop 2024-09-10T23:14:46.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.327+0000 7f6446ffd640 1 -- 172.21.15.90:0/1628601018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f645c0708f0 msgr2=0x7f645c150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.327+0000 7f6446ffd640 1 --2- 172.21.15.90:0/1628601018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f645c0708f0 0x7f645c150320 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f644800c450 tx=0x7f644800c910 comp rx=0 tx=0).stop 2024-09-10T23:14:46.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.327+0000 7f646127a640 1 -- 172.21.15.90:0/1628601018 reap_dead start 2024-09-10T23:14:46.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.327+0000 7f6446ffd640 1 -- 172.21.15.90:0/1628601018 shutdown_connections 2024-09-10T23:14:46.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.327+0000 7f6446ffd640 1 -- 172.21.15.90:0/1628601018 >> 172.21.15.90:0/1628601018 conn(0x7f645c0cc7f0 msgr2=0x7f645c0ccbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.327+0000 7f2867285640 1 -- 172.21.15.90:0/2641229878 shutdown_connections 2024-09-10T23:14:46.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.327+0000 7f2867285640 1 -- 172.21.15.90:0/2641229878 >> 172.21.15.90:0/2641229878 conn(0x7f2860073430 msgr2=0x7f28600aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.327+0000 7f6446ffd640 1 -- 172.21.15.90:0/1628601018 shutdown_connections 2024-09-10T23:14:46.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.327+0000 7f6446ffd640 1 -- 172.21.15.90:0/1628601018 wait complete. 2024-09-10T23:14:46.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.327+0000 7f2867285640 1 -- 172.21.15.90:0/2641229878 shutdown_connections 2024-09-10T23:14:46.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.327+0000 7f2867285640 1 -- 172.21.15.90:0/2641229878 wait complete. 2024-09-10T23:14:46.349 INFO:teuthology.orchestra.run.smithi090.stdout:64424509449 2024-09-10T23:14:46.350 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T23:14:46.350 INFO:teuthology.orchestra.run.smithi090.stdout:64424509448 2024-09-10T23:14:46.351 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T23:14:46.351 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-09-10T23:14:46.352 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T23:14:46.352 INFO:teuthology.orchestra.run.smithi090.stdout:64424509447 2024-09-10T23:14:46.353 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T23:14:46.353 INFO:teuthology.orchestra.run.smithi090.stdout:64424509449 2024-09-10T23:14:46.354 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T23:14:46.354 INFO:teuthology.orchestra.run.smithi090.stdout:64424509447 2024-09-10T23:14:46.355 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T23:14:46.355 INFO:teuthology.orchestra.run.smithi090.stdout:64424509448 2024-09-10T23:14:46.356 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T23:14:46.356 INFO:teuthology.orchestra.run.smithi090.stdout:64424509447 2024-09-10T23:14:46.357 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T23:14:46.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.562+0000 7f339d6db640 1 -- 172.21.15.90:0/1951246072 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3390005a60 msgr2=0x7f3390035fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.562+0000 7f339d6db640 1 --2- 172.21.15.90:0/1951246072 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3390005a60 0x7f3390035fe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3384005fd0 tx=0x7f338402e4c0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f339d6db640 1 -- 172.21.15.90:0/1951246072 shutdown_connections 2024-09-10T23:14:46.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f5d6ffff640 1 -- 172.21.15.90:0/723475946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d68054860 msgr2=0x7f5d68054c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f5d6ffff640 1 --2- 172.21.15.90:0/723475946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d68054860 0x7f5d68054c40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5d600098e0 tx=0x7f5d6002a4d0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f339d6db640 1 --2- 172.21.15.90:0/1951246072 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3390005a60 0x7f3390035fe0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f339d6db640 1 --2- 172.21.15.90:0/1951246072 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339001c890 0x7f339001cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f4d9df03640 1 -- 172.21.15.90:0/2382132155 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d900366f0 msgr2=0x7f4d9001c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f4d9df03640 1 --2- 172.21.15.90:0/2382132155 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d900366f0 0x7f4d9001c800 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009860 tx=0x7f4d8402a5a0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f3892ffd640 1 -- 172.21.15.90:0/3863530527 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38880047a0 con 0x7f388c0e2c20 2024-09-10T23:14:46.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f339d6db640 1 -- 172.21.15.90:0/1951246072 >> 172.21.15.90:0/1951246072 conn(0x7f3390054560 msgr2=0x7f3390054940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f5d6ffff640 1 -- 172.21.15.90:0/723475946 shutdown_connections 2024-09-10T23:14:46.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f5d6ffff640 1 --2- 172.21.15.90:0/723475946 >> v2:172.21.15.171:3300/0 conn(0x7f5d68034ba0 0x7f5d68008660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f5d6ffff640 1 --2- 172.21.15.90:0/723475946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d68054860 0x7f5d68054c40 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5d600098e0 tx=0x7f5d6002a4d0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f4d9df03640 1 -- 172.21.15.90:0/2382132155 shutdown_connections 2024-09-10T23:14:46.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f4d9df03640 1 --2- 172.21.15.90:0/2382132155 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d900366f0 0x7f4d9001c800 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f4d9df03640 1 -- 172.21.15.90:0/2382132155 >> 172.21.15.90:0/2382132155 conn(0x7f4d90054560 msgr2=0x7f4d90054940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f5d6ffff640 1 -- 172.21.15.90:0/723475946 >> 172.21.15.90:0/723475946 conn(0x7f5d6801e890 msgr2=0x7f5d68055640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f339d6db640 1 -- 172.21.15.90:0/1951246072 shutdown_connections 2024-09-10T23:14:46.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f339d6db640 1 -- 172.21.15.90:0/1951246072 wait complete. 2024-09-10T23:14:46.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7fa7d3d0e640 1 -- 172.21.15.90:0/3240306985 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7cc15bfb0 msgr2=0x7fa7cc0ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7fa7d3d0e640 1 --2- 172.21.15.90:0/3240306985 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7cc15bfb0 0x7fa7cc0ce700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc0b5310 tx=0x7fa7bc02a490 comp rx=0 tx=0).stop 2024-09-10T23:14:46.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.563+0000 7f3899132640 1 -- 172.21.15.90:0/3863530527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f388c0e2c20 msgr2=0x7f388c036a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7f3899132640 1 --2- 172.21.15.90:0/3863530527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f388c0e2c20 0x7f388c036a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f388c00d4a0 tx=0x7f388802c720 comp rx=0 tx=0).stop 2024-09-10T23:14:46.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7f5d6ffff640 1 -- 172.21.15.90:0/723475946 shutdown_connections 2024-09-10T23:14:46.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7f3899132640 1 -- 172.21.15.90:0/3863530527 shutdown_connections 2024-09-10T23:14:46.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7f3899132640 1 --2- 172.21.15.90:0/3863530527 >> v2:172.21.15.90:3300/0 conn(0x7f388c0370c0 0x7f388c037570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7f3899132640 1 --2- 172.21.15.90:0/3863530527 >> v2:172.21.15.171:3300/0 conn(0x7f388c034340 0x7f388c055f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7f3899132640 1 --2- 172.21.15.90:0/3863530527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f388c0e2c20 0x7f388c036a00 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f388c00d4a0 tx=0x7f388802c720 comp rx=0 tx=0).stop 2024-09-10T23:14:46.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7f4d9df03640 1 -- 172.21.15.90:0/2382132155 shutdown_connections 2024-09-10T23:14:46.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7f3899132640 1 -- 172.21.15.90:0/3863530527 >> 172.21.15.90:0/3863530527 conn(0x7f388c01e890 msgr2=0x7f388c055640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7f4d9df03640 1 -- 172.21.15.90:0/2382132155 wait complete. 2024-09-10T23:14:46.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7f3899132640 1 -- 172.21.15.90:0/3863530527 shutdown_connections 2024-09-10T23:14:46.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7fd1f4f6b640 1 -- 172.21.15.90:0/3501768848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f0073620 msgr2=0x7fd1f0151cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7fd1f4f6b640 1 --2- 172.21.15.90:0/3501768848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f0073620 0x7fd1f0151cd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400fb30 tx=0x7fd1e402e6b0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7fd1f4f6b640 1 -- 172.21.15.90:0/3501768848 shutdown_connections 2024-09-10T23:14:46.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7fd1f4f6b640 1 --2- 172.21.15.90:0/3501768848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f0073620 0x7fd1f0151cd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7fd1f4f6b640 1 -- 172.21.15.90:0/3501768848 >> 172.21.15.90:0/3501768848 conn(0x7fd1f0069590 msgr2=0x7fd1f006cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7f5d6ffff640 1 -- 172.21.15.90:0/723475946 wait complete. 2024-09-10T23:14:46.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7fd1f4f6b640 1 -- 172.21.15.90:0/3501768848 shutdown_connections 2024-09-10T23:14:46.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7fd1f4f6b640 1 -- 172.21.15.90:0/3501768848 wait complete. 2024-09-10T23:14:46.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7fa7d3d0e640 1 -- 172.21.15.90:0/3240306985 shutdown_connections 2024-09-10T23:14:46.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7fa7d3d0e640 1 --2- 172.21.15.90:0/3240306985 >> v2:172.21.15.171:3300/0 conn(0x7fa7cc0cdc50 0x7fa7cc0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7fa7d3d0e640 1 --2- 172.21.15.90:0/3240306985 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7cc15bfb0 0x7fa7cc0ce700 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7fa7d3d0e640 1 -- 172.21.15.90:0/3240306985 >> 172.21.15.90:0/3240306985 conn(0x7fa7cc0d1ec0 msgr2=0x7fa7cc0d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.564+0000 7f3899132640 1 -- 172.21.15.90:0/3863530527 wait complete. 2024-09-10T23:14:46.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.566+0000 7f3899132640 1 Processor -- start 2024-09-10T23:14:46.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.566+0000 7fa7d3d0e640 1 -- 172.21.15.90:0/3240306985 shutdown_connections 2024-09-10T23:14:46.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.566+0000 7f5d6ffff640 1 Processor -- start 2024-09-10T23:14:46.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.566+0000 7f339d6db640 1 Processor -- start 2024-09-10T23:14:46.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.566+0000 7f339d6db640 1 -- start start 2024-09-10T23:14:46.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.566+0000 7f4d9df03640 1 Processor -- start 2024-09-10T23:14:46.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.566+0000 7f4d9df03640 1 -- start start 2024-09-10T23:14:46.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.566+0000 7f3899132640 1 -- start start 2024-09-10T23:14:46.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.566+0000 7fd1f4f6b640 1 Processor -- start 2024-09-10T23:14:46.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.566+0000 7fd1f4f6b640 1 -- start start 2024-09-10T23:14:46.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.567+0000 7f3899132640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f388c034340 0x7f388c04b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.567+0000 7f3899132640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f388c0370c0 0x7f388c167f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.567+0000 7f3899132640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f388c1814d0 0x7f388c0e0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.567+0000 7f3899132640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f388c0082c0 con 0x7f388c0370c0 2024-09-10T23:14:46.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.567+0000 7f3899132640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f388c008140 con 0x7f388c1814d0 2024-09-10T23:14:46.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.567+0000 7f3899132640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f388c008440 con 0x7f388c034340 2024-09-10T23:14:46.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.567+0000 7f3893fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f388c034340 0x7f388c04b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.567+0000 7f3898931640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f388c1814d0 0x7f388c0e0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.567+0000 7f3893fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f388c034340 0x7f388c04b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.90:56950/0 (socket says 172.21.15.90:56950) 2024-09-10T23:14:46.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.567+0000 7f3898931640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f388c1814d0 0x7f388c0e0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.90:59072/0 (socket says 172.21.15.90:59072) 2024-09-10T23:14:46.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.567+0000 7f3893fff640 1 -- 172.21.15.90:0/2856371626 learned_addr learned my addr 172.21.15.90:0/2856371626 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:46.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.567+0000 7f38937fe640 1 --2- 172.21.15.90:0/2856371626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f388c0370c0 0x7f388c167f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.566+0000 7fa7d3d0e640 1 -- 172.21.15.90:0/3240306985 wait complete. 2024-09-10T23:14:46.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f3893fff640 1 -- 172.21.15.90:0/2856371626 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f388c1814d0 msgr2=0x7f388c0e0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f3893fff640 1 --2- 172.21.15.90:0/2856371626 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f388c1814d0 0x7f388c0e0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f3893fff640 1 -- 172.21.15.90:0/2856371626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f388c0370c0 msgr2=0x7f388c167f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.567+0000 7fd1f4f6b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f0073620 0x7fd1f01f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.567+0000 7fd1f4f6b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1f00b3aa0 0x7fd1f0159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7fd1f4f6b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd1f01518f0 0x7fd1f0157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7fd1f4f6b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f006fb90 con 0x7fd1f0073620 2024-09-10T23:14:46.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7fd1f4f6b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f006fa10 con 0x7fd1f00b3aa0 2024-09-10T23:14:46.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7fd1f4f6b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd1f006fd10 con 0x7fd1f01518f0 2024-09-10T23:14:46.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f4d9df03640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d90005a60 0x7f4d9004ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7fd1eed9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd1f01518f0 0x7fd1f0157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f339d6db640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3390005a60 0x7f339004a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f3893fff640 1 --2- 172.21.15.90:0/2856371626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f388c0370c0 0x7f388c167f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f3893fff640 1 -- 172.21.15.90:0/2856371626 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388c1819b0 con 0x7f388c034340 2024-09-10T23:14:46.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f38937fe640 1 --2- 172.21.15.90:0/2856371626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f388c0370c0 0x7f388c167f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:14:46.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f4d9df03640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d9000ba00 0x7f4d90021970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f339d6db640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339001c890 0x7f3390178680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f339d6db640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3390036520 0x7f3390178bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7fd1ee59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f0073620 0x7fd1f01f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7fd1ee59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f0073620 0x7fd1f01f4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50588/0 (socket says 172.21.15.90:50588) 2024-09-10T23:14:46.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7fd1ee59c640 1 -- 172.21.15.90:0/2291570843 learned_addr learned my addr 172.21.15.90:0/2291570843 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:46.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7fd1edd9b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1f00b3aa0 0x7fd1f0159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f4d9cf01640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d90005a60 0x7f4d9004ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f4d9cf01640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d90005a60 0x7f4d9004ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.90:56970/0 (socket says 172.21.15.90:56970) 2024-09-10T23:14:46.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7fa7d3d0e640 1 Processor -- start 2024-09-10T23:14:46.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f339ceda640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3390036520 0x7f3390178bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f339ceda640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3390036520 0x7f3390178bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50602/0 (socket says 172.21.15.90:50602) 2024-09-10T23:14:46.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f339ceda640 1 -- 172.21.15.90:0/3015372760 learned_addr learned my addr 172.21.15.90:0/3015372760 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:46.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7fd1ee59c640 1 -- 172.21.15.90:0/2291570843 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd1f01518f0 msgr2=0x7fd1f0157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7fd1ee59c640 1 --2- 172.21.15.90:0/2291570843 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd1f01518f0 0x7fd1f0157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7fd1ee59c640 1 -- 172.21.15.90:0/2291570843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1f00b3aa0 msgr2=0x7fd1f0159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7fd1ee59c640 1 --2- 172.21.15.90:0/2291570843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1f00b3aa0 0x7fd1f0159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7fd1ee59c640 1 -- 172.21.15.90:0/2291570843 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f01f4590 con 0x7fd1f0073620 2024-09-10T23:14:46.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f339d6db640 1 -- 172.21.15.90:0/3015372760 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f339000aa60 con 0x7f3390036520 2024-09-10T23:14:46.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f339d6db640 1 -- 172.21.15.90:0/3015372760 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f339000bc10 con 0x7f3390005a60 2024-09-10T23:14:46.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f339d6db640 1 -- 172.21.15.90:0/3015372760 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f339000abe0 con 0x7f339001c890 2024-09-10T23:14:46.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f4d97fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d9000ba00 0x7f4d90021970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7f4d97fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d9000ba00 0x7f4d90021970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50608/0 (socket says 172.21.15.90:50608) 2024-09-10T23:14:46.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f4d9cf01640 1 -- 172.21.15.90:0/4249254228 learned_addr learned my addr 172.21.15.90:0/4249254228 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:46.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f3893fff640 1 --2- 172.21.15.90:0/2856371626 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f388c034340 0x7f388c04b8a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3888000c00 tx=0x7f3888003910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f4d9df03640 1 --2- 172.21.15.90:0/4249254228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d900366f0 0x7f4d901762d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f4d9df03640 1 -- 172.21.15.90:0/4249254228 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9000a1a0 con 0x7f4d9000ba00 2024-09-10T23:14:46.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f4d9df03640 1 -- 172.21.15.90:0/4249254228 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9000a020 con 0x7f4d900366f0 2024-09-10T23:14:46.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f4d9df03640 1 -- 172.21.15.90:0/4249254228 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9000a320 con 0x7f4d90005a60 2024-09-10T23:14:46.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f4d9d702640 1 --2- 172.21.15.90:0/4249254228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d900366f0 0x7f4d901762d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f339ceda640 1 -- 172.21.15.90:0/3015372760 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339001c890 msgr2=0x7f3390178680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T23:14:46.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f339ceda640 1 --2- 172.21.15.90:0/3015372760 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339001c890 0x7f3390178680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f339ceda640 1 -- 172.21.15.90:0/3015372760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3390005a60 msgr2=0x7f339004a690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T23:14:46.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f339ceda640 1 --2- 172.21.15.90:0/3015372760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3390005a60 0x7f339004a690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f339ceda640 1 -- 172.21.15.90:0/3015372760 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339004c200 con 0x7f3390036520 2024-09-10T23:14:46.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7fd1ee59c640 1 --2- 172.21.15.90:0/2291570843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f0073620 0x7fd1f01f4050 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000c480 tx=0x7fd1e000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7fd1deffd640 1 -- 172.21.15.90:0/2291570843 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0016020 con 0x7fd1f0073620 2024-09-10T23:14:46.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7fd1deffd640 1 -- 172.21.15.90:0/2291570843 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1e00053e0 con 0x7fd1f0073620 2024-09-10T23:14:46.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7fd1deffd640 1 -- 172.21.15.90:0/2291570843 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0007280 con 0x7fd1f0073620 2024-09-10T23:14:46.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7fd1f4f6b640 1 -- 172.21.15.90:0/2291570843 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f015f2c0 con 0x7fd1f0073620 2024-09-10T23:14:46.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7fba9d223640 1 -- 172.21.15.90:0/3425068467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba84003a00 msgr2=0x7fba84003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7fba9d223640 1 --2- 172.21.15.90:0/3425068467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba84003a00 0x7fba84003e00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fba80009850 tx=0x7fba84005830 comp rx=0 tx=0).stop 2024-09-10T23:14:46.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f978770e640 1 -- 172.21.15.90:0/3562854086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97800d23a0 msgr2=0x7f97800d2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f978770e640 1 --2- 172.21.15.90:0/3562854086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97800d23a0 0x7f97800d2810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f977800b3b0 tx=0x7f977802a960 comp rx=0 tx=0).stop 2024-09-10T23:14:46.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7fba9d223640 1 -- 172.21.15.90:0/3425068467 shutdown_connections 2024-09-10T23:14:46.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7fba9d223640 1 --2- 172.21.15.90:0/3425068467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba84003a00 0x7fba84003e00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7fba9d223640 1 -- 172.21.15.90:0/3425068467 >> 172.21.15.90:0/3425068467 conn(0x7fba980d0aa0 msgr2=0x7fba980d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f339ceda640 1 --2- 172.21.15.90:0/3015372760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3390036520 0x7f3390178bc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3398066a10 tx=0x7f339806df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f978770e640 1 -- 172.21.15.90:0/3562854086 shutdown_connections 2024-09-10T23:14:46.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f978770e640 1 --2- 172.21.15.90:0/3562854086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97800d23a0 0x7f97800d2810 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f978770e640 1 --2- 172.21.15.90:0/3562854086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f978015deb0 0x7f97800cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f978770e640 1 -- 172.21.15.90:0/3562854086 >> 172.21.15.90:0/3562854086 conn(0x7f97800d3dc0 msgr2=0x7f97800d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7fd1f4f6b640 1 -- 172.21.15.90:0/2291570843 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1f015d3e0 con 0x7fd1f0073620 2024-09-10T23:14:46.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f978770e640 1 -- 172.21.15.90:0/3562854086 shutdown_connections 2024-09-10T23:14:46.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.568+0000 7fa7d3d0e640 1 -- start start 2024-09-10T23:14:46.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7fa7d3d0e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7cc0cdc50 0x7fa7cc0c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7fa7d3d0e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7cc0d0450 0x7fa7cc200dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.570+0000 7fa7d3d0e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7cc15bfb0 0x7fa7cc0cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.570+0000 7f4d97fff640 1 -- 172.21.15.90:0/4249254228 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d90005a60 msgr2=0x7f4d9004ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.570+0000 7fa7d3d0e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc0cd1e0 con 0x7fa7cc0cdc50 2024-09-10T23:14:46.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.570+0000 7fa7d3d0e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc0d2bf0 con 0x7fa7cc15bfb0 2024-09-10T23:14:46.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.570+0000 7fa7d3d0e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa7cc0cd360 con 0x7fa7cc0d0450 2024-09-10T23:14:46.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.570+0000 7f4d97fff640 1 --2- 172.21.15.90:0/4249254228 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d90005a60 0x7f4d9004ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.570+0000 7f4d97fff640 1 -- 172.21.15.90:0/4249254228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d900366f0 msgr2=0x7f4d901762d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.570+0000 7f4d97fff640 1 --2- 172.21.15.90:0/4249254228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d900366f0 0x7f4d901762d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.570+0000 7f3890ff9640 1 -- 172.21.15.90:0/2856371626 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888040020 con 0x7f388c034340 2024-09-10T23:14:46.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.570+0000 7f3890ff9640 1 -- 172.21.15.90:0/2856371626 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38880047a0 con 0x7f388c034340 2024-09-10T23:14:46.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.570+0000 7f3890ff9640 1 -- 172.21.15.90:0/2856371626 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888037030 con 0x7f388c034340 2024-09-10T23:14:46.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f5d6ffff640 1 -- start start 2024-09-10T23:14:46.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.570+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d68034650 0x7f5d68007f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.570+0000 7f4d97fff640 1 -- 172.21.15.90:0/4249254228 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d90020bb0 con 0x7f4d9000ba00 2024-09-10T23:14:46.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.570+0000 7f3899132640 1 -- 172.21.15.90:0/2856371626 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f388c181c90 con 0x7f388c034340 2024-09-10T23:14:46.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.570+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d68034ba0 0x7f5d680337a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.570+0000 7f3899132640 1 -- 172.21.15.90:0/2856371626 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f388c182250 con 0x7f388c034340 2024-09-10T23:14:46.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.570+0000 7f5d6effd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d68034650 0x7f5d68007f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f5d6effd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d68034650 0x7f5d68007f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.90:56980/0 (socket says 172.21.15.90:56980) 2024-09-10T23:14:46.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f3394ff9640 1 -- 172.21.15.90:0/3015372760 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339808f020 con 0x7f3390036520 2024-09-10T23:14:46.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f3394ff9640 1 -- 172.21.15.90:0/3015372760 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3398063590 con 0x7f3390036520 2024-09-10T23:14:46.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f3394ff9640 1 -- 172.21.15.90:0/3015372760 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3398063a40 con 0x7f3390036520 2024-09-10T23:14:46.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7fd1f4f6b640 1 -- 172.21.15.90:0/2291570843 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1f00702a0 con 0x7fd1f0073620 2024-09-10T23:14:46.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f5d6e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d68034ba0 0x7f5d680337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7fa7d12a9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7cc0d0450 0x7fa7cc200dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7fa7d12a9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7cc0d0450 0x7fa7cc200dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.90:56972/0 (socket says 172.21.15.90:56972) 2024-09-10T23:14:46.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7fa7d12a9640 1 -- 172.21.15.90:0/739760525 learned_addr learned my addr 172.21.15.90:0/739760525 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:46.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7fa7d22ab640 1 --2- 172.21.15.90:0/739760525 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7cc15bfb0 0x7fa7cc0cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7fa7d1aaa640 1 --2- 172.21.15.90:0/739760525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7cc0cdc50 0x7fa7cc0c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f339d6db640 1 -- 172.21.15.90:0/3015372760 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f339004c4e0 con 0x7f3390036520 2024-09-10T23:14:46.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f339d6db640 1 -- 172.21.15.90:0/3015372760 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33901794b0 con 0x7f3390036520 2024-09-10T23:14:46.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.572+0000 7f4d97fff640 1 --2- 172.21.15.90:0/4249254228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d9000ba00 0x7f4d90021970 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4d84031000 tx=0x7f4d840038f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7fa7d12a9640 1 -- 172.21.15.90:0/739760525 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7cc15bfb0 msgr2=0x7fa7cc0cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7fa7d12a9640 1 --2- 172.21.15.90:0/739760525 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7cc15bfb0 0x7fa7cc0cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7fa7d12a9640 1 -- 172.21.15.90:0/739760525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7cc0cdc50 msgr2=0x7fa7cc0c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7fa7d12a9640 1 --2- 172.21.15.90:0/739760525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7cc0cdc50 0x7fa7cc0c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7fa7d12a9640 1 -- 172.21.15.90:0/739760525 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7cc0c7cd0 con 0x7fa7cc0d0450 2024-09-10T23:14:46.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.572+0000 7fa7d12a9640 1 --2- 172.21.15.90:0/739760525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7cc0d0450 0x7fa7cc200dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800b410 tx=0x7fa7c800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f5d6e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d68034ba0 0x7f5d680337a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50626/0 (socket says 172.21.15.90:50626) 2024-09-10T23:14:46.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d6817e6f0 0x7f5d68049b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f5d6e7fc640 1 -- 172.21.15.90:0/1645994288 learned_addr learned my addr 172.21.15.90:0/1645994288 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:46.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f5d6ffff640 1 -- 172.21.15.90:0/1645994288 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5d680e69c0 con 0x7f5d68034ba0 2024-09-10T23:14:46.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f5d6ffff640 1 -- 172.21.15.90:0/1645994288 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5d680e6840 con 0x7f5d6817e6f0 2024-09-10T23:14:46.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f5d6ffff640 1 -- 172.21.15.90:0/1645994288 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5d6803a540 con 0x7f5d68034650 2024-09-10T23:14:46.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f5d6f7fe640 1 --2- 172.21.15.90:0/1645994288 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d6817e6f0 0x7f5d68049b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f5d6e7fc640 1 -- 172.21.15.90:0/1645994288 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d68034650 msgr2=0x7f5d68007f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f5d6e7fc640 1 --2- 172.21.15.90:0/1645994288 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d68034650 0x7f5d68007f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f5d6e7fc640 1 -- 172.21.15.90:0/1645994288 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d6817e6f0 msgr2=0x7f5d68049b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f5d6e7fc640 1 --2- 172.21.15.90:0/1645994288 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d6817e6f0 0x7f5d68049b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f5d6e7fc640 1 -- 172.21.15.90:0/1645994288 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d6817ec40 con 0x7f5d68034ba0 2024-09-10T23:14:46.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f5d6effd640 1 --2- 172.21.15.90:0/1645994288 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d68034650 0x7f5d68007f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:14:46.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7fba9d223640 1 -- 172.21.15.90:0/3425068467 shutdown_connections 2024-09-10T23:14:46.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.569+0000 7f978770e640 1 -- 172.21.15.90:0/3562854086 wait complete. 2024-09-10T23:14:46.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f978770e640 1 Processor -- start 2024-09-10T23:14:46.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7f978770e640 1 -- start start 2024-09-10T23:14:46.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.571+0000 7fd1deffd640 1 -- 172.21.15.90:0/2291570843 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd1e0007420 con 0x7fd1f0073620 2024-09-10T23:14:46.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.572+0000 7f3899132640 1 -- 172.21.15.90:0/2856371626 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f388c008990 con 0x7f388c034340 2024-09-10T23:14:46.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.572+0000 7fd1deffd640 1 --2- 172.21.15.90:0/2291570843 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd1d0078040 0x7fd1d007a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.572+0000 7fa7c27fc640 1 -- 172.21.15.90:0/739760525 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8015020 con 0x7fa7cc0d0450 2024-09-10T23:14:46.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.572+0000 7fa7c27fc640 1 -- 172.21.15.90:0/739760525 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7c8011920 con 0x7fa7cc0d0450 2024-09-10T23:14:46.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.572+0000 7fa7c27fc640 1 -- 172.21.15.90:0/739760525 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8011d90 con 0x7fa7cc0d0450 2024-09-10T23:14:46.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.573+0000 7fa7d3d0e640 1 -- 172.21.15.90:0/739760525 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7cc0c7fb0 con 0x7fa7cc0d0450 2024-09-10T23:14:46.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.573+0000 7fa7d3d0e640 1 -- 172.21.15.90:0/739760525 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7cc0c8570 con 0x7fa7cc0d0450 2024-09-10T23:14:46.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.572+0000 7f978770e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97800d12e0 0x7f97800cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.572+0000 7f978770e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97800d23a0 0x7f97801591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.573+0000 7f978770e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f978015deb0 0x7f97802051e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.573+0000 7f978770e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f97800b37a0 con 0x7f97800d12e0 2024-09-10T23:14:46.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.573+0000 7f978770e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f97800b3620 con 0x7f978015deb0 2024-09-10T23:14:46.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.573+0000 7f978770e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f97800b3920 con 0x7f97800d23a0 2024-09-10T23:14:46.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.572+0000 7fd1edd9b640 1 --2- 172.21.15.90:0/2291570843 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd1d0078040 0x7fd1d007a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.572+0000 7fd1deffd640 1 -- 172.21.15.90:0/2291570843 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd1e0099220 con 0x7fd1f0073620 2024-09-10T23:14:46.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.572+0000 7f5d6e7fc640 1 --2- 172.21.15.90:0/1645994288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d68034ba0 0x7f5d680337a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400d770 tx=0x7f5d6400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.572+0000 7fba9d223640 1 -- 172.21.15.90:0/3425068467 wait complete. 2024-09-10T23:14:46.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.573+0000 7fd1edd9b640 1 --2- 172.21.15.90:0/2291570843 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd1d0078040 0x7fd1d007a500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4038000 tx=0x7fd1e4004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.573+0000 7f9785cab640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f978015deb0 0x7f97802051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.573+0000 7f9785cab640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f978015deb0 0x7f97802051e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.90:59104/0 (socket says 172.21.15.90:59104) 2024-09-10T23:14:46.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.573+0000 7f9785cab640 1 -- 172.21.15.90:0/220283435 learned_addr learned my addr 172.21.15.90:0/220283435 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:46.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.573+0000 7f339d6db640 1 -- 172.21.15.90:0/3015372760 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f339001ded0 con 0x7f3390036520 2024-09-10T23:14:46.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.573+0000 7f5d577fe640 1 -- 172.21.15.90:0/1645994288 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64017070 con 0x7f5d68034ba0 2024-09-10T23:14:46.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.573+0000 7f5d6ffff640 1 -- 172.21.15.90:0/1645994288 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d68007150 con 0x7f5d68034ba0 2024-09-10T23:14:46.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.574+0000 7f5d6ffff640 1 -- 172.21.15.90:0/1645994288 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d68007710 con 0x7f5d68034ba0 2024-09-10T23:14:46.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.574+0000 7fba9d223640 1 Processor -- start 2024-09-10T23:14:46.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.574+0000 7fba9d223640 1 -- start start 2024-09-10T23:14:46.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.573+0000 7f97854aa640 1 --2- 172.21.15.90:0/220283435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97800d12e0 0x7f97800cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.574+0000 7f97854aa640 1 -- 172.21.15.90:0/220283435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97800d23a0 msgr2=0x7f97801591e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T23:14:46.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.574+0000 7f97854aa640 1 --2- 172.21.15.90:0/220283435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97800d23a0 0x7f97801591e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.574+0000 7f97854aa640 1 -- 172.21.15.90:0/220283435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f978015deb0 msgr2=0x7f97802051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.574+0000 7f97854aa640 1 --2- 172.21.15.90:0/220283435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f978015deb0 0x7f97802051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.574+0000 7f97854aa640 1 -- 172.21.15.90:0/220283435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9780159720 con 0x7f97800d12e0 2024-09-10T23:14:46.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.574+0000 7f9785cab640 1 --2- 172.21.15.90:0/220283435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f978015deb0 0x7f97802051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:14:46.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.573+0000 7f3890ff9640 1 -- 172.21.15.90:0/2856371626 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3888004bd0 con 0x7f388c034340 2024-09-10T23:14:46.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.574+0000 7f3890ff9640 1 --2- 172.21.15.90:0/2856371626 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3878078040 0x7f387807a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.574+0000 7f97854aa640 1 --2- 172.21.15.90:0/220283435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97800d12e0 0x7f97800cdbf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f977c00e710 tx=0x7f977c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.574+0000 7fa7d3d0e640 1 -- 172.21.15.90:0/739760525 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7cc0cd890 con 0x7fa7cc0d0450 2024-09-10T23:14:46.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.574+0000 7f3890ff9640 1 -- 172.21.15.90:0/2856371626 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f38880bad30 con 0x7f388c034340 2024-09-10T23:14:46.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.574+0000 7f38937fe640 1 --2- 172.21.15.90:0/2856371626 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3878078040 0x7f387807a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.575+0000 7f3394ff9640 1 -- 172.21.15.90:0/3015372760 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3398063be0 con 0x7f3390036520 2024-09-10T23:14:46.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.575+0000 7f3394ff9640 1 --2- 172.21.15.90:0/3015372760 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f337c077fc0 0x7f337c07a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.574+0000 7f4d957fa640 1 -- 172.21.15.90:0/4249254228 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84005c90 con 0x7f4d9000ba00 2024-09-10T23:14:46.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.574+0000 7f4d957fa640 1 -- 172.21.15.90:0/4249254228 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d84003ae0 con 0x7f4d9000ba00 2024-09-10T23:14:46.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.574+0000 7f4d9df03640 1 -- 172.21.15.90:0/4249254228 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d90020e90 con 0x7f4d9000ba00 2024-09-10T23:14:46.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.575+0000 7f5d6ffff640 1 -- 172.21.15.90:0/1645994288 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d68054c40 con 0x7f5d68034ba0 2024-09-10T23:14:46.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.575+0000 7fba9d223640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba84003a00 0x7fba980ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.575+0000 7fba9d223640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba981f8af0 0x7fba98155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.575+0000 7fba9d223640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba981f7e00 0x7fba981f82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.575+0000 7fba9d223640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fba9815e710 con 0x7fba981f7e00 2024-09-10T23:14:46.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.575+0000 7fba9d223640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fba9815e590 con 0x7fba981f8af0 2024-09-10T23:14:46.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.575+0000 7fba9d223640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fba9806cb30 con 0x7fba84003a00 2024-09-10T23:14:46.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.575+0000 7f3394ff9640 1 -- 172.21.15.90:0/3015372760 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3398114960 con 0x7f3390036520 2024-09-10T23:14:46.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.575+0000 7f3397fff640 1 --2- 172.21.15.90:0/3015372760 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f337c077fc0 0x7f337c07a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.575+0000 7f4d9df03640 1 -- 172.21.15.90:0/4249254228 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d90021450 con 0x7f4d9000ba00 2024-09-10T23:14:46.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.575+0000 7f4d957fa640 1 -- 172.21.15.90:0/4249254228 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84031950 con 0x7f4d9000ba00 2024-09-10T23:14:46.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.575+0000 7fba96d9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba84003a00 0x7fba980ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.575+0000 7fba9759e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba981f7e00 0x7fba981f82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7fba96d9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba84003a00 0x7fba980ca640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.90:57000/0 (socket says 172.21.15.90:57000) 2024-09-10T23:14:46.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7fba9759e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba981f7e00 0x7fba981f82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50650/0 (socket says 172.21.15.90:50650) 2024-09-10T23:14:46.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7fba96d9d640 1 -- 172.21.15.90:0/2702278051 learned_addr learned my addr 172.21.15.90:0/2702278051 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:46.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7fa7c27fc640 1 -- 172.21.15.90:0/739760525 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa7c801a400 con 0x7fa7cc0d0450 2024-09-10T23:14:46.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7fba9659c640 1 --2- 172.21.15.90:0/2702278051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba981f8af0 0x7fba98155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7f38937fe640 1 --2- 172.21.15.90:0/2856371626 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3878078040 0x7f387807a500 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f388c0e0410 tx=0x7f38800090e0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7fba96d9d640 1 -- 172.21.15.90:0/2702278051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba981f8af0 msgr2=0x7fba98155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7fba96d9d640 1 --2- 172.21.15.90:0/2702278051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba981f8af0 0x7fba98155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7fba96d9d640 1 -- 172.21.15.90:0/2702278051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba981f7e00 msgr2=0x7fba981f82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7fba96d9d640 1 --2- 172.21.15.90:0/2702278051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba981f7e00 0x7fba981f82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7fba96d9d640 1 -- 172.21.15.90:0/2702278051 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba980c7c10 con 0x7fba84003a00 2024-09-10T23:14:46.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7fba9659c640 1 --2- 172.21.15.90:0/2702278051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba981f8af0 0x7fba98155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:46.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7fba9759e640 1 --2- 172.21.15.90:0/2702278051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba981f7e00 0x7fba981f82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:14:46.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7fba96d9d640 1 --2- 172.21.15.90:0/2702278051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba84003a00 0x7fba980ca640 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fba80009940 tx=0x7fba80032a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7f3397fff640 1 --2- 172.21.15.90:0/3015372760 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f337c077fc0 0x7f337c07a480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f338c005860 tx=0x7f338c0057b0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7fa7c27fc640 1 --2- 172.21.15.90:0/739760525 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa7b0077ff0 0x7fa7b007a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7fa7c27fc640 1 -- 172.21.15.90:0/739760525 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa7c8099f00 con 0x7fa7cc0d0450 2024-09-10T23:14:46.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.576+0000 7fa7d1aaa640 1 --2- 172.21.15.90:0/739760525 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa7b0077ff0 0x7fa7b007a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.577+0000 7f4d9df03640 1 -- 172.21.15.90:0/4249254228 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d90000d50 con 0x7f4d9000ba00 2024-09-10T23:14:46.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.577+0000 7fa7d1aaa640 1 --2- 172.21.15.90:0/739760525 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa7b0077ff0 0x7fa7b007a4b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc034000 tx=0x7fa7bc004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.579+0000 7f3890ff9640 1 -- 172.21.15.90:0/2856371626 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f388804a030 con 0x7f388c034340 2024-09-10T23:14:46.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.579+0000 7f5d577fe640 1 -- 172.21.15.90:0/1645994288 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d64009bd0 con 0x7f5d68034ba0 2024-09-10T23:14:46.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.579+0000 7f5d577fe640 1 -- 172.21.15.90:0/1645994288 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64021060 con 0x7f5d68034ba0 2024-09-10T23:14:46.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.579+0000 7f9775ffb640 1 -- 172.21.15.90:0/220283435 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c00ca50 con 0x7f97800d12e0 2024-09-10T23:14:46.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.579+0000 7fd1deffd640 1 -- 172.21.15.90:0/2291570843 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd1f01f4590 con 0x7fd1f0073620 2024-09-10T23:14:46.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.580+0000 7f978770e640 1 -- 172.21.15.90:0/220283435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97801599a0 con 0x7f97800d12e0 2024-09-10T23:14:46.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.580+0000 7f978770e640 1 -- 172.21.15.90:0/220283435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f978015a240 con 0x7f97800d12e0 2024-09-10T23:14:46.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.581+0000 7f976b7fe640 1 -- 172.21.15.90:0/220283435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9760005290 con 0x7f97800d12e0 2024-09-10T23:14:46.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.583+0000 7fba8f7fe640 1 -- 172.21.15.90:0/2702278051 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba80040020 con 0x7fba84003a00 2024-09-10T23:14:46.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.583+0000 7fba8f7fe640 1 -- 172.21.15.90:0/2702278051 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba80032e30 con 0x7fba84003a00 2024-09-10T23:14:46.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.583+0000 7fba8f7fe640 1 -- 172.21.15.90:0/2702278051 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba80037040 con 0x7fba84003a00 2024-09-10T23:14:46.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.583+0000 7fba9d223640 1 -- 172.21.15.90:0/2702278051 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba981555a0 con 0x7fba84003a00 2024-09-10T23:14:46.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.583+0000 7fba9d223640 1 -- 172.21.15.90:0/2702278051 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fba980b5770 con 0x7fba84003a00 2024-09-10T23:14:46.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.583+0000 7fa7c27fc640 1 -- 172.21.15.90:0/739760525 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa7c801f020 con 0x7fa7cc0d0450 2024-09-10T23:14:46.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.585+0000 7fba8f7fe640 1 -- 172.21.15.90:0/2702278051 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fba8003c6c0 con 0x7fba84003a00 2024-09-10T23:14:46.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.585+0000 7f3394ff9640 1 -- 172.21.15.90:0/3015372760 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3398099030 con 0x7f3390036520 2024-09-10T23:14:46.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.585+0000 7fba8f7fe640 1 --2- 172.21.15.90:0/2702278051 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fba78077f70 0x7fba7807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.585+0000 7fba8f7fe640 1 -- 172.21.15.90:0/2702278051 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fba800ba090 con 0x7fba84003a00 2024-09-10T23:14:46.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.587+0000 7fba9659c640 1 --2- 172.21.15.90:0/2702278051 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fba78077f70 0x7fba7807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.587+0000 7fba9d223640 1 -- 172.21.15.90:0/2702278051 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba9806cfb0 con 0x7fba84003a00 2024-09-10T23:14:46.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.588+0000 7f5d577fe640 1 -- 172.21.15.90:0/1645994288 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5d64026480 con 0x7f5d68034ba0 2024-09-10T23:14:46.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.589+0000 7f5d577fe640 1 --2- 172.21.15.90:0/1645994288 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5d5c077f70 0x7f5d5c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.589+0000 7f5d577fe640 1 -- 172.21.15.90:0/1645994288 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5d6409a550 con 0x7f5d68034ba0 2024-09-10T23:14:46.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.590+0000 7f4d957fa640 1 -- 172.21.15.90:0/4249254228 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4d8404b060 con 0x7f4d9000ba00 2024-09-10T23:14:46.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.590+0000 7fba9659c640 1 --2- 172.21.15.90:0/2702278051 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fba78077f70 0x7fba7807a430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fba980ca130 tx=0x7fba880017a0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.590+0000 7f5d6effd640 1 --2- 172.21.15.90:0/1645994288 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5d5c077f70 0x7f5d5c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.590+0000 7f4d957fa640 1 --2- 172.21.15.90:0/4249254228 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4d7c078040 0x7f4d7c07a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.591+0000 7f4d957fa640 1 -- 172.21.15.90:0/4249254228 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4d840ba950 con 0x7f4d9000ba00 2024-09-10T23:14:46.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.590+0000 7f9775ffb640 1 -- 172.21.15.90:0/220283435 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f977c00ce00 con 0x7f97800d12e0 2024-09-10T23:14:46.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.590+0000 7f9775ffb640 1 -- 172.21.15.90:0/220283435 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c00ca50 con 0x7f97800d12e0 2024-09-10T23:14:46.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.591+0000 7f5d6effd640 1 --2- 172.21.15.90:0/1645994288 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5d5c077f70 0x7f5d5c07a430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5d60034000 tx=0x7f5d60004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.591+0000 7f9775ffb640 1 -- 172.21.15.90:0/220283435 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f977c010430 con 0x7f97800d12e0 2024-09-10T23:14:46.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.591+0000 7f4d9cf01640 1 --2- 172.21.15.90:0/4249254228 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4d7c078040 0x7f4d7c07a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.591+0000 7f9775ffb640 1 --2- 172.21.15.90:0/220283435 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9764078170 0x7f976407a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:46.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.591+0000 7f4d9cf01640 1 --2- 172.21.15.90:0/4249254228 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4d7c078040 0x7f4d7c07a500 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c007fd0 tx=0x7f4d8c007eb0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.592+0000 7f9784ca9640 1 --2- 172.21.15.90:0/220283435 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9764078170 0x7f976407a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:46.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.592+0000 7fba8f7fe640 1 -- 172.21.15.90:0/2702278051 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fba8004a030 con 0x7fba84003a00 2024-09-10T23:14:46.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.592+0000 7f9784ca9640 1 --2- 172.21.15.90:0/220283435 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9764078170 0x7f976407a630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f978015db90 tx=0x7f97700079b0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:46.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.593+0000 7f4d957fa640 1 -- 172.21.15.90:0/4249254228 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4d8403f030 con 0x7f4d9000ba00 2024-09-10T23:14:46.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.602+0000 7f5d577fe640 1 -- 172.21.15.90:0/1645994288 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5d64062a70 con 0x7f5d68034ba0 2024-09-10T23:14:46.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.603+0000 7f9775ffb640 1 -- 172.21.15.90:0/220283435 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f977c05f1d0 con 0x7f97800d12e0 2024-09-10T23:14:46.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.611+0000 7f9775ffb640 1 -- 172.21.15.90:0/220283435 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f977c026020 con 0x7f97800d12e0 2024-09-10T23:14:46.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.985+0000 7f3899132640 1 -- 172.21.15.90:0/2856371626 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f388c051560 con 0x7f388c034340 2024-09-10T23:14:46.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.986+0000 7f3890ff9640 1 -- 172.21.15.90:0/2856371626 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f38880831c0 con 0x7f388c034340 2024-09-10T23:14:46.987 INFO:teuthology.orchestra.run.smithi090.stdout:64424509449 2024-09-10T23:14:46.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.989+0000 7f387e7fc640 1 -- 172.21.15.90:0/2856371626 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3878078040 msgr2=0x7f387807a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.989+0000 7f387e7fc640 1 --2- 172.21.15.90:0/2856371626 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3878078040 0x7f387807a500 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f388c0e0410 tx=0x7f38800090e0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.990+0000 7f387e7fc640 1 -- 172.21.15.90:0/2856371626 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f388c034340 msgr2=0x7f388c04b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:46.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.990+0000 7f387e7fc640 1 --2- 172.21.15.90:0/2856371626 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f388c034340 0x7f388c04b8a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3888000c00 tx=0x7f3888003910 comp rx=0 tx=0).stop 2024-09-10T23:14:46.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.990+0000 7f387e7fc640 1 -- 172.21.15.90:0/2856371626 shutdown_connections 2024-09-10T23:14:46.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.990+0000 7f387e7fc640 1 --2- 172.21.15.90:0/2856371626 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3878078040 0x7f387807a500 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.990+0000 7f387e7fc640 1 --2- 172.21.15.90:0/2856371626 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f388c1814d0 0x7f388c0e0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.990+0000 7f387e7fc640 1 --2- 172.21.15.90:0/2856371626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f388c0370c0 0x7f388c167f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.990+0000 7f387e7fc640 1 --2- 172.21.15.90:0/2856371626 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f388c034340 0x7f388c04b8a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:46.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.990+0000 7f387e7fc640 1 -- 172.21.15.90:0/2856371626 >> 172.21.15.90:0/2856371626 conn(0x7f388c01e890 msgr2=0x7f388c0520c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:46.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.990+0000 7f387e7fc640 1 -- 172.21.15.90:0/2856371626 shutdown_connections 2024-09-10T23:14:46.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.991+0000 7f387e7fc640 1 -- 172.21.15.90:0/2856371626 wait complete. 2024-09-10T23:14:46.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.993+0000 7fd1f4f6b640 1 -- 172.21.15.90:0/2291570843 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd1f00cc610 con 0x7fd1f0073620 2024-09-10T23:14:46.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.994+0000 7fd1deffd640 1 -- 172.21.15.90:0/2291570843 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd1e0061d90 con 0x7fd1f0073620 2024-09-10T23:14:46.995 INFO:teuthology.orchestra.run.smithi090.stdout:64424509447 2024-09-10T23:14:47.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.998+0000 7fd1dcff9640 1 -- 172.21.15.90:0/2291570843 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd1d0078040 msgr2=0x7fd1d007a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.998+0000 7fd1dcff9640 1 --2- 172.21.15.90:0/2291570843 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd1d0078040 0x7fd1d007a500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4038000 tx=0x7fd1e4004730 comp rx=0 tx=0).stop 2024-09-10T23:14:47.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.998+0000 7fd1dcff9640 1 -- 172.21.15.90:0/2291570843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f0073620 msgr2=0x7fd1f01f4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.998+0000 7fd1dcff9640 1 --2- 172.21.15.90:0/2291570843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f0073620 0x7fd1f01f4050 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000c480 tx=0x7fd1e000c940 comp rx=0 tx=0).stop 2024-09-10T23:14:47.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.998+0000 7fd1dcff9640 1 -- 172.21.15.90:0/2291570843 shutdown_connections 2024-09-10T23:14:47.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.998+0000 7fd1dcff9640 1 --2- 172.21.15.90:0/2291570843 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd1d0078040 0x7fd1d007a500 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.999+0000 7fd1dcff9640 1 --2- 172.21.15.90:0/2291570843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1f00b3aa0 0x7fd1f0159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.999+0000 7fd1dcff9640 1 --2- 172.21.15.90:0/2291570843 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd1f01518f0 0x7fd1f0157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.999+0000 7fd1dcff9640 1 --2- 172.21.15.90:0/2291570843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f0073620 0x7fd1f01f4050 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.999+0000 7fd1dcff9640 1 -- 172.21.15.90:0/2291570843 >> 172.21.15.90:0/2291570843 conn(0x7fd1f0069590 msgr2=0x7fd1f0154350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:47.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.999+0000 7fd1dcff9640 1 -- 172.21.15.90:0/2291570843 shutdown_connections 2024-09-10T23:14:47.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.999+0000 7fd1dcff9640 1 -- 172.21.15.90:0/2291570843 wait complete. 2024-09-10T23:14:47.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:46.999+0000 7fa7d3d0e640 1 -- 172.21.15.90:0/739760525 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa7cc0c5340 con 0x7fa7cc0d0450 2024-09-10T23:14:47.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.000+0000 7fa7c27fc640 1 -- 172.21.15.90:0/739760525 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa7c80629e0 con 0x7fa7cc0d0450 2024-09-10T23:14:47.005 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-09-10T23:14:47.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.004+0000 7fa7affff640 1 -- 172.21.15.90:0/739760525 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa7b0077ff0 msgr2=0x7fa7b007a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.004+0000 7fa7affff640 1 --2- 172.21.15.90:0/739760525 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa7b0077ff0 0x7fa7b007a4b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc034000 tx=0x7fa7bc004730 comp rx=0 tx=0).stop 2024-09-10T23:14:47.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.004+0000 7fa7affff640 1 -- 172.21.15.90:0/739760525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7cc0d0450 msgr2=0x7fa7cc200dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.004+0000 7fa7affff640 1 --2- 172.21.15.90:0/739760525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7cc0d0450 0x7fa7cc200dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800b410 tx=0x7fa7c800b8d0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.004+0000 7fa7affff640 1 -- 172.21.15.90:0/739760525 shutdown_connections 2024-09-10T23:14:47.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.004+0000 7fa7affff640 1 --2- 172.21.15.90:0/739760525 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa7b0077ff0 0x7fa7b007a4b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.006 INFO:teuthology.orchestra.run.smithi090.stdout:64424509448 2024-09-10T23:14:47.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.004+0000 7fa7affff640 1 --2- 172.21.15.90:0/739760525 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7cc15bfb0 0x7fa7cc0cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.004+0000 7fa7affff640 1 --2- 172.21.15.90:0/739760525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7cc0d0450 0x7fa7cc200dd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.004+0000 7fa7affff640 1 --2- 172.21.15.90:0/739760525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7cc0cdc50 0x7fa7cc0c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.004+0000 7fa7affff640 1 -- 172.21.15.90:0/739760525 >> 172.21.15.90:0/739760525 conn(0x7fa7cc0d1ec0 msgr2=0x7fa7cc071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:47.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.003+0000 7f339d6db640 1 -- 172.21.15.90:0/3015372760 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f339001d9a0 con 0x7f3390036520 2024-09-10T23:14:47.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.004+0000 7f3394ff9640 1 -- 172.21.15.90:0/3015372760 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f33980dd6e0 con 0x7f3390036520 2024-09-10T23:14:47.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.005+0000 7fa7affff640 1 -- 172.21.15.90:0/739760525 shutdown_connections 2024-09-10T23:14:47.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.005+0000 7fa7affff640 1 -- 172.21.15.90:0/739760525 wait complete. 2024-09-10T23:14:47.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.1 2024-09-10T23:14:47.009 DEBUG:teuthology.parallel:result is None 2024-09-10T23:14:47.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.008+0000 7f339d6db640 1 -- 172.21.15.90:0/3015372760 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f337c077fc0 msgr2=0x7f337c07a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.008+0000 7f339d6db640 1 --2- 172.21.15.90:0/3015372760 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f337c077fc0 0x7f337c07a480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f338c005860 tx=0x7f338c0057b0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.008+0000 7f339d6db640 1 -- 172.21.15.90:0/3015372760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3390036520 msgr2=0x7f3390178bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.008+0000 7f339d6db640 1 --2- 172.21.15.90:0/3015372760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3390036520 0x7f3390178bc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3398066a10 tx=0x7f339806df10 comp rx=0 tx=0).stop 2024-09-10T23:14:47.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.008+0000 7f339d6db640 1 -- 172.21.15.90:0/3015372760 shutdown_connections 2024-09-10T23:14:47.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.008+0000 7f339d6db640 1 --2- 172.21.15.90:0/3015372760 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f337c077fc0 0x7f337c07a480 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.008+0000 7f339d6db640 1 --2- 172.21.15.90:0/3015372760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3390036520 0x7f3390178bc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.008+0000 7f339d6db640 1 --2- 172.21.15.90:0/3015372760 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339001c890 0x7f3390178680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.008+0000 7f339d6db640 1 --2- 172.21.15.90:0/3015372760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3390005a60 0x7f339004a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.008+0000 7f339d6db640 1 -- 172.21.15.90:0/3015372760 >> 172.21.15.90:0/3015372760 conn(0x7f3390054560 msgr2=0x7f3390009a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:47.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.009+0000 7f339d6db640 1 -- 172.21.15.90:0/3015372760 shutdown_connections 2024-09-10T23:14:47.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.009+0000 7f339d6db640 1 -- 172.21.15.90:0/3015372760 wait complete. 2024-09-10T23:14:47.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.013+0000 7fba9d223640 1 -- 172.21.15.90:0/2702278051 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fba980d18a0 con 0x7fba84003a00 2024-09-10T23:14:47.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.013+0000 7f4d9df03640 1 -- 172.21.15.90:0/4249254228 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4d9004f9d0 con 0x7f4d9000ba00 2024-09-10T23:14:47.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.013+0000 7fba8f7fe640 1 -- 172.21.15.90:0/2702278051 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fba8004a030 con 0x7fba84003a00 2024-09-10T23:14:47.015 INFO:teuthology.orchestra.run.smithi090.stdout:64424509447 2024-09-10T23:14:47.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.014+0000 7f4d957fa640 1 -- 172.21.15.90:0/4249254228 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4d84082de0 con 0x7f4d9000ba00 2024-09-10T23:14:47.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.014+0000 7f5d6ffff640 1 -- 172.21.15.90:0/1645994288 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5d6800c8b0 con 0x7f5d68034ba0 2024-09-10T23:14:47.015 INFO:teuthology.orchestra.run.smithi090.stdout:64424509449 2024-09-10T23:14:47.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.014+0000 7f5d577fe640 1 -- 172.21.15.90:0/1645994288 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5d640674a0 con 0x7f5d68034ba0 2024-09-10T23:14:47.016 INFO:teuthology.orchestra.run.smithi090.stdout:64424509447 2024-09-10T23:14:47.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.017+0000 7fba9d223640 1 -- 172.21.15.90:0/2702278051 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fba78077f70 msgr2=0x7fba7807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.017+0000 7fba9d223640 1 --2- 172.21.15.90:0/2702278051 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fba78077f70 0x7fba7807a430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fba980ca130 tx=0x7fba880017a0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.017+0000 7fba9d223640 1 -- 172.21.15.90:0/2702278051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba84003a00 msgr2=0x7fba980ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.017+0000 7fba9d223640 1 --2- 172.21.15.90:0/2702278051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba84003a00 0x7fba980ca640 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fba80009940 tx=0x7fba80032a00 comp rx=0 tx=0).stop 2024-09-10T23:14:47.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.017+0000 7fba9d223640 1 -- 172.21.15.90:0/2702278051 shutdown_connections 2024-09-10T23:14:47.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.017+0000 7fba9d223640 1 --2- 172.21.15.90:0/2702278051 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fba78077f70 0x7fba7807a430 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.017+0000 7fba9d223640 1 --2- 172.21.15.90:0/2702278051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba981f8af0 0x7fba98155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.017+0000 7fba9d223640 1 --2- 172.21.15.90:0/2702278051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba981f7e00 0x7fba981f82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.017+0000 7fba9d223640 1 --2- 172.21.15.90:0/2702278051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba84003a00 0x7fba980ca640 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.017+0000 7fba9d223640 1 -- 172.21.15.90:0/2702278051 >> 172.21.15.90:0/2702278051 conn(0x7fba980d0aa0 msgr2=0x7fba980b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:47.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.017+0000 7fba9d223640 1 -- 172.21.15.90:0/2702278051 shutdown_connections 2024-09-10T23:14:47.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.017+0000 7fba9d223640 1 -- 172.21.15.90:0/2702278051 wait complete. 2024-09-10T23:14:47.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.017+0000 7f4d9df03640 1 -- 172.21.15.90:0/4249254228 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4d7c078040 msgr2=0x7f4d7c07a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.017+0000 7f4d9df03640 1 --2- 172.21.15.90:0/4249254228 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4d7c078040 0x7f4d7c07a500 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c007fd0 tx=0x7f4d8c007eb0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.017+0000 7f4d9df03640 1 -- 172.21.15.90:0/4249254228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d9000ba00 msgr2=0x7f4d90021970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.017+0000 7f4d9df03640 1 --2- 172.21.15.90:0/4249254228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d9000ba00 0x7f4d90021970 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4d84031000 tx=0x7f4d840038f0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f4d9df03640 1 -- 172.21.15.90:0/4249254228 shutdown_connections 2024-09-10T23:14:47.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f4d9df03640 1 --2- 172.21.15.90:0/4249254228 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4d7c078040 0x7f4d7c07a500 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f4d9df03640 1 --2- 172.21.15.90:0/4249254228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d900366f0 0x7f4d901762d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f4d9df03640 1 --2- 172.21.15.90:0/4249254228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d9000ba00 0x7f4d90021970 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f4d9df03640 1 --2- 172.21.15.90:0/4249254228 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d90005a60 0x7f4d9004ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f4d9df03640 1 -- 172.21.15.90:0/4249254228 >> 172.21.15.90:0/4249254228 conn(0x7f4d90054560 msgr2=0x7f4d90035fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:47.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f5d6ffff640 1 -- 172.21.15.90:0/1645994288 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5d5c077f70 msgr2=0x7f5d5c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f5d6ffff640 1 --2- 172.21.15.90:0/1645994288 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5d5c077f70 0x7f5d5c07a430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5d60034000 tx=0x7f5d60004730 comp rx=0 tx=0).stop 2024-09-10T23:14:47.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f5d6ffff640 1 -- 172.21.15.90:0/1645994288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d68034ba0 msgr2=0x7f5d680337a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f5d6ffff640 1 --2- 172.21.15.90:0/1645994288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d68034ba0 0x7f5d680337a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400d770 tx=0x7f5d6400dc30 comp rx=0 tx=0).stop 2024-09-10T23:14:47.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f4d9df03640 1 -- 172.21.15.90:0/4249254228 shutdown_connections 2024-09-10T23:14:47.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f4d9df03640 1 -- 172.21.15.90:0/4249254228 wait complete. 2024-09-10T23:14:47.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f5d6ffff640 1 -- 172.21.15.90:0/1645994288 shutdown_connections 2024-09-10T23:14:47.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f5d6ffff640 1 --2- 172.21.15.90:0/1645994288 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5d5c077f70 0x7f5d5c07a430 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f5d6ffff640 1 --2- 172.21.15.90:0/1645994288 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d6817e6f0 0x7f5d68049b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f5d6ffff640 1 --2- 172.21.15.90:0/1645994288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d68034ba0 0x7f5d680337a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f5d6ffff640 1 --2- 172.21.15.90:0/1645994288 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d68034650 0x7f5d68007f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f5d6ffff640 1 -- 172.21.15.90:0/1645994288 >> 172.21.15.90:0/1645994288 conn(0x7f5d6801e890 msgr2=0x7f5d680e1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:47.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f5d6ffff640 1 -- 172.21.15.90:0/1645994288 shutdown_connections 2024-09-10T23:14:47.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.018+0000 7f5d6ffff640 1 -- 172.21.15.90:0/1645994288 wait complete. 2024-09-10T23:14:47.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-09-10T23:14:47.024 DEBUG:teuthology.parallel:result is None 2024-09-10T23:14:47.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-09-10T23:14:47.024 DEBUG:teuthology.parallel:result is None 2024-09-10T23:14:47.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.2 2024-09-10T23:14:47.027 DEBUG:teuthology.parallel:result is None 2024-09-10T23:14:47.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.032+0000 7f976b7fe640 1 -- 172.21.15.90:0/220283435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9760005850 con 0x7f97800d12e0 2024-09-10T23:14:47.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.033+0000 7f9775ffb640 1 -- 172.21.15.90:0/220283435 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f977c026020 con 0x7f97800d12e0 2024-09-10T23:14:47.034 INFO:teuthology.orchestra.run.smithi090.stdout:64424509448 2024-09-10T23:14:47.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.036+0000 7f976b7fe640 1 -- 172.21.15.90:0/220283435 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9764078170 msgr2=0x7f976407a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.036+0000 7f976b7fe640 1 --2- 172.21.15.90:0/220283435 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9764078170 0x7f976407a630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f978015db90 tx=0x7f97700079b0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.036+0000 7f976b7fe640 1 -- 172.21.15.90:0/220283435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97800d12e0 msgr2=0x7f97800cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.036+0000 7f976b7fe640 1 --2- 172.21.15.90:0/220283435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97800d12e0 0x7f97800cdbf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f977c00e710 tx=0x7f977c00ebd0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.036+0000 7f976b7fe640 1 -- 172.21.15.90:0/220283435 shutdown_connections 2024-09-10T23:14:47.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.036+0000 7f976b7fe640 1 --2- 172.21.15.90:0/220283435 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9764078170 0x7f976407a630 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.036+0000 7f976b7fe640 1 --2- 172.21.15.90:0/220283435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f978015deb0 0x7f97802051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.036+0000 7f976b7fe640 1 --2- 172.21.15.90:0/220283435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97800d23a0 0x7f97801591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.036+0000 7f976b7fe640 1 --2- 172.21.15.90:0/220283435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97800d12e0 0x7f97800cdbf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.036+0000 7f976b7fe640 1 -- 172.21.15.90:0/220283435 >> 172.21.15.90:0/220283435 conn(0x7f97800d3dc0 msgr2=0x7f97800b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:47.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.4 2024-09-10T23:14:47.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.036+0000 7f976b7fe640 1 -- 172.21.15.90:0/220283435 shutdown_connections 2024-09-10T23:14:47.039 DEBUG:teuthology.parallel:result is None 2024-09-10T23:14:47.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2024-09-10T23:14:47.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.036+0000 7f976b7fe640 1 -- 172.21.15.90:0/220283435 wait complete. 2024-09-10T23:14:47.040 DEBUG:teuthology.parallel:result is None 2024-09-10T23:14:47.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-09-10T23:14:47.041 DEBUG:teuthology.parallel:result is None 2024-09-10T23:14:47.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.7 2024-09-10T23:14:47.048 DEBUG:teuthology.parallel:result is None 2024-09-10T23:14:47.048 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:14:47.048 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:14:47.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.188+0000 7f7c588dd640 1 -- 172.21.15.90:0/2641969867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c540d1c70 msgr2=0x7f7c540b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.188+0000 7f7c588dd640 1 --2- 172.21.15.90:0/2641969867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c540d1c70 0x7f7c540b3490 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009830 tx=0x7f7c3c02a510 comp rx=0 tx=0).stop 2024-09-10T23:14:47.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.188+0000 7f7c588dd640 1 -- 172.21.15.90:0/2641969867 shutdown_connections 2024-09-10T23:14:47.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.188+0000 7f7c588dd640 1 --2- 172.21.15.90:0/2641969867 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c540b3a00 0x7f7c540b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.188+0000 7f7c588dd640 1 --2- 172.21.15.90:0/2641969867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c540d1c70 0x7f7c540b3490 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.188+0000 7f7c588dd640 1 -- 172.21.15.90:0/2641969867 >> 172.21.15.90:0/2641969867 conn(0x7f7c5409d2a0 msgr2=0x7f7c540d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:47.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.188+0000 7f7c588dd640 1 -- 172.21.15.90:0/2641969867 shutdown_connections 2024-09-10T23:14:47.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.188+0000 7f7c588dd640 1 -- 172.21.15.90:0/2641969867 wait complete. 2024-09-10T23:14:47.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.189+0000 7f7c588dd640 1 Processor -- start 2024-09-10T23:14:47.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.189+0000 7f7c588dd640 1 -- start start 2024-09-10T23:14:47.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.190+0000 7f7c588dd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c540b3a00 0x7f7c541f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:47.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.190+0000 7f7c588dd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c540d1c70 0x7f7c540c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:47.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.190+0000 7f7c588dd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c540d2470 0x7f7c540c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:47.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.190+0000 7f7c588dd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7c540b4570 con 0x7f7c540b3a00 2024-09-10T23:14:47.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.190+0000 7f7c588dd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7c540b43f0 con 0x7f7c540d2470 2024-09-10T23:14:47.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.190+0000 7f7c588dd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7c540b46f0 con 0x7f7c540d1c70 2024-09-10T23:14:47.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.190+0000 7f7c5259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c540b3a00 0x7f7c541f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:47.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.190+0000 7f7c5259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c540b3a00 0x7f7c541f5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50658/0 (socket says 172.21.15.90:50658) 2024-09-10T23:14:47.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.190+0000 7f7c5259c640 1 -- 172.21.15.90:0/681371044 learned_addr learned my addr 172.21.15.90:0/681371044 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:47.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.190+0000 7f7c52d9d640 1 --2- 172.21.15.90:0/681371044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c540d2470 0x7f7c540c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:47.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.190+0000 7f7c51d9b640 1 --2- 172.21.15.90:0/681371044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c540d1c70 0x7f7c540c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:47.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.190+0000 7f7c5259c640 1 -- 172.21.15.90:0/681371044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c540d1c70 msgr2=0x7f7c540c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.190+0000 7f7c5259c640 1 --2- 172.21.15.90:0/681371044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c540d1c70 0x7f7c540c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.190+0000 7f7c5259c640 1 -- 172.21.15.90:0/681371044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c540d2470 msgr2=0x7f7c540c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.190+0000 7f7c5259c640 1 --2- 172.21.15.90:0/681371044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c540d2470 0x7f7c540c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.190+0000 7f7c5259c640 1 -- 172.21.15.90:0/681371044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c541f4bb0 con 0x7f7c540b3a00 2024-09-10T23:14:47.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.190+0000 7f7c5259c640 1 --2- 172.21.15.90:0/681371044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c540b3a00 0x7f7c541f5460 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400c7a0 tx=0x7f7c4400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:47.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.191+0000 7f7c4affd640 1 -- 172.21.15.90:0/681371044 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c44017070 con 0x7f7c540b3a00 2024-09-10T23:14:47.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.191+0000 7f7c4affd640 1 -- 172.21.15.90:0/681371044 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c4400ce50 con 0x7f7c540b3a00 2024-09-10T23:14:47.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.191+0000 7f7c4affd640 1 -- 172.21.15.90:0/681371044 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c440052d0 con 0x7f7c540b3a00 2024-09-10T23:14:47.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.191+0000 7f7c588dd640 1 -- 172.21.15.90:0/681371044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c540c87b0 con 0x7f7c540b3a00 2024-09-10T23:14:47.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.191+0000 7f7c588dd640 1 -- 172.21.15.90:0/681371044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c541f5a70 con 0x7f7c540b3a00 2024-09-10T23:14:47.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.192+0000 7f7c588dd640 1 -- 172.21.15.90:0/681371044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c540b3eb0 con 0x7f7c540b3a00 2024-09-10T23:14:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.192+0000 7f7c4affd640 1 -- 172.21.15.90:0/681371044 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7c44005470 con 0x7f7c540b3a00 2024-09-10T23:14:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.193+0000 7f7c4affd640 1 --2- 172.21.15.90:0/681371044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c34077f70 0x7f7c3407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.193+0000 7f7c4affd640 1 -- 172.21.15.90:0/681371044 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7c44099730 con 0x7f7c540b3a00 2024-09-10T23:14:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.193+0000 7f7c51d9b640 1 --2- 172.21.15.90:0/681371044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c34077f70 0x7f7c3407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.193+0000 7f7c51d9b640 1 --2- 172.21.15.90:0/681371044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c34077f70 0x7f7c3407a430 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c034000 tx=0x7f7c3c004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:47.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.197+0000 7f7c4affd640 1 -- 172.21.15.90:0/681371044 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7c541f4bb0 con 0x7f7c540b3a00 2024-09-10T23:14:47.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.367+0000 7f7c588dd640 1 -- 172.21.15.90:0/681371044 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7c540d2aa0 con 0x7f7c34077f70 2024-09-10T23:14:47.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.371+0000 7f7c4affd640 1 -- 172.21.15.90:0/681371044 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f7c540d2aa0 con 0x7f7c34077f70 2024-09-10T23:14:47.375 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:47.376 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:14:47.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.374+0000 7f7c588dd640 1 -- 172.21.15.90:0/681371044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c34077f70 msgr2=0x7f7c3407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.374+0000 7f7c588dd640 1 --2- 172.21.15.90:0/681371044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c34077f70 0x7f7c3407a430 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c034000 tx=0x7f7c3c004730 comp rx=0 tx=0).stop 2024-09-10T23:14:47.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.374+0000 7f7c588dd640 1 -- 172.21.15.90:0/681371044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c540b3a00 msgr2=0x7f7c541f5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.374+0000 7f7c588dd640 1 --2- 172.21.15.90:0/681371044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c540b3a00 0x7f7c541f5460 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400c7a0 tx=0x7f7c4400cc60 comp rx=0 tx=0).stop 2024-09-10T23:14:47.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.374+0000 7f7c588dd640 1 -- 172.21.15.90:0/681371044 shutdown_connections 2024-09-10T23:14:47.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.374+0000 7f7c588dd640 1 --2- 172.21.15.90:0/681371044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c34077f70 0x7f7c3407a430 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.374+0000 7f7c588dd640 1 --2- 172.21.15.90:0/681371044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c540d2470 0x7f7c540c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.374+0000 7f7c588dd640 1 --2- 172.21.15.90:0/681371044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c540d1c70 0x7f7c540c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.374+0000 7f7c588dd640 1 --2- 172.21.15.90:0/681371044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c540b3a00 0x7f7c541f5460 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.374+0000 7f7c588dd640 1 -- 172.21.15.90:0/681371044 >> 172.21.15.90:0/681371044 conn(0x7f7c5409d2a0 msgr2=0x7f7c5406d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:47.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.374+0000 7f7c588dd640 1 -- 172.21.15.90:0/681371044 shutdown_connections 2024-09-10T23:14:47.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.374+0000 7f7c588dd640 1 -- 172.21.15.90:0/681371044 wait complete. 2024-09-10T23:14:47.386 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-10T23:14:46.435450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219304,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755416,"statfs":{"total":773094113280,"available":772869545984,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002292"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550557+0000","last_change":"2024-09-10T23:14:36.157525+0000","last_active":"2024-09-10T23:14:38.550557+0000","last_peered":"2024-09-10T23:14:38.550557+0000","last_clean":"2024-09-10T23:14:38.550557+0000","last_became_active":"2024-09-10T23:14:36.157019+0000","last_became_peered":"2024-09-10T23:14:36.157019+0000","last_unstale":"2024-09-10T23:14:38.550557+0000","last_undegraded":"2024-09-10T23:14:38.550557+0000","last_fullsized":"2024-09-10T23:14:38.550557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:16.389050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150199+0000","last_change":"2024-09-10T23:14:36.152453+0000","last_active":"2024-09-10T23:14:37.150199+0000","last_peered":"2024-09-10T23:14:37.150199+0000","last_clean":"2024-09-10T23:14:37.150199+0000","last_became_active":"2024-09-10T23:14:36.152182+0000","last_became_peered":"2024-09-10T23:14:36.152182+0000","last_unstale":"2024-09-10T23:14:37.150199+0000","last_undegraded":"2024-09-10T23:14:37.150199+0000","last_fullsized":"2024-09-10T23:14:37.150199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:25.629769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550144+0000","last_change":"2024-09-10T23:14:36.148244+0000","last_active":"2024-09-10T23:14:38.550144+0000","last_peered":"2024-09-10T23:14:38.550144+0000","last_clean":"2024-09-10T23:14:38.550144+0000","last_became_active":"2024-09-10T23:14:36.147940+0000","last_became_peered":"2024-09-10T23:14:36.147940+0000","last_unstale":"2024-09-10T23:14:38.550144+0000","last_undegraded":"2024-09-10T23:14:38.550144+0000","last_fullsized":"2024-09-10T23:14:38.550144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:14.738749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141919+0000","last_change":"2024-09-10T23:14:36.147531+0000","last_active":"2024-09-10T23:14:37.141919+0000","last_peered":"2024-09-10T23:14:37.141919+0000","last_clean":"2024-09-10T23:14:37.141919+0000","last_became_active":"2024-09-10T23:14:36.146965+0000","last_became_peered":"2024-09-10T23:14:36.146965+0000","last_unstale":"2024-09-10T23:14:37.141919+0000","last_undegraded":"2024-09-10T23:14:37.141919+0000","last_fullsized":"2024-09-10T23:14:37.141919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:52.426211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550241+0000","last_change":"2024-09-10T23:14:36.153446+0000","last_active":"2024-09-10T23:14:38.550241+0000","last_peered":"2024-09-10T23:14:38.550241+0000","last_clean":"2024-09-10T23:14:38.550241+0000","last_became_active":"2024-09-10T23:14:36.152291+0000","last_became_peered":"2024-09-10T23:14:36.152291+0000","last_unstale":"2024-09-10T23:14:38.550241+0000","last_undegraded":"2024-09-10T23:14:38.550241+0000","last_fullsized":"2024-09-10T23:14:38.550241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:44.783941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140958+0000","last_change":"2024-09-10T23:14:36.154507+0000","last_active":"2024-09-10T23:14:37.140958+0000","last_peered":"2024-09-10T23:14:37.140958+0000","last_clean":"2024-09-10T23:14:37.140958+0000","last_became_active":"2024-09-10T23:14:36.154186+0000","last_became_peered":"2024-09-10T23:14:36.154186+0000","last_unstale":"2024-09-10T23:14:37.140958+0000","last_undegraded":"2024-09-10T23:14:37.140958+0000","last_fullsized":"2024-09-10T23:14:37.140958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:53.614015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549991+0000","last_change":"2024-09-10T23:14:36.156472+0000","last_active":"2024-09-10T23:14:38.549991+0000","last_peered":"2024-09-10T23:14:38.549991+0000","last_clean":"2024-09-10T23:14:38.549991+0000","last_became_active":"2024-09-10T23:14:36.156157+0000","last_became_peered":"2024-09-10T23:14:36.156157+0000","last_unstale":"2024-09-10T23:14:38.549991+0000","last_undegraded":"2024-09-10T23:14:38.549991+0000","last_fullsized":"2024-09-10T23:14:38.549991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:04.288672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139515+0000","last_change":"2024-09-10T23:14:36.152200+0000","last_active":"2024-09-10T23:14:37.139515+0000","last_peered":"2024-09-10T23:14:37.139515+0000","last_clean":"2024-09-10T23:14:37.139515+0000","last_became_active":"2024-09-10T23:14:36.151338+0000","last_became_peered":"2024-09-10T23:14:36.151338+0000","last_unstale":"2024-09-10T23:14:37.139515+0000","last_undegraded":"2024-09-10T23:14:37.139515+0000","last_fullsized":"2024-09-10T23:14:37.139515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:51.090210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550576+0000","last_change":"2024-09-10T23:14:36.154027+0000","last_active":"2024-09-10T23:14:38.550576+0000","last_peered":"2024-09-10T23:14:38.550576+0000","last_clean":"2024-09-10T23:14:38.550576+0000","last_became_active":"2024-09-10T23:14:36.153704+0000","last_became_peered":"2024-09-10T23:14:36.153704+0000","last_unstale":"2024-09-10T23:14:38.550576+0000","last_undegraded":"2024-09-10T23:14:38.550576+0000","last_fullsized":"2024-09-10T23:14:38.550576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:18.861499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152342+0000","last_change":"2024-09-10T23:14:36.159590+0000","last_active":"2024-09-10T23:14:37.152342+0000","last_peered":"2024-09-10T23:14:37.152342+0000","last_clean":"2024-09-10T23:14:37.152342+0000","last_became_active":"2024-09-10T23:14:36.159315+0000","last_became_peered":"2024-09-10T23:14:36.159315+0000","last_unstale":"2024-09-10T23:14:37.152342+0000","last_undegraded":"2024-09-10T23:14:37.152342+0000","last_fullsized":"2024-09-10T23:14:37.152342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:21:21.970379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152280+0000","last_change":"2024-09-10T23:14:36.152936+0000","last_active":"2024-09-10T23:14:37.152280+0000","last_peered":"2024-09-10T23:14:37.152280+0000","last_clean":"2024-09-10T23:14:37.152280+0000","last_became_active":"2024-09-10T23:14:36.152606+0000","last_became_peered":"2024-09-10T23:14:36.152606+0000","last_unstale":"2024-09-10T23:14:37.152280+0000","last_undegraded":"2024-09-10T23:14:37.152280+0000","last_fullsized":"2024-09-10T23:14:37.152280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:09.306575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141439+0000","last_change":"2024-09-10T23:14:36.153356+0000","last_active":"2024-09-10T23:14:37.141439+0000","last_peered":"2024-09-10T23:14:37.141439+0000","last_clean":"2024-09-10T23:14:37.141439+0000","last_became_active":"2024-09-10T23:14:36.153096+0000","last_became_peered":"2024-09-10T23:14:36.153096+0000","last_unstale":"2024-09-10T23:14:37.141439+0000","last_undegraded":"2024-09-10T23:14:37.141439+0000","last_fullsized":"2024-09-10T23:14:37.141439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:27.153088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139741+0000","last_change":"2024-09-10T23:14:36.154715+0000","last_active":"2024-09-10T23:14:37.139741+0000","last_peered":"2024-09-10T23:14:37.139741+0000","last_clean":"2024-09-10T23:14:37.139741+0000","last_became_active":"2024-09-10T23:14:36.154463+0000","last_became_peered":"2024-09-10T23:14:36.154463+0000","last_unstale":"2024-09-10T23:14:37.139741+0000","last_undegraded":"2024-09-10T23:14:37.139741+0000","last_fullsized":"2024-09-10T23:14:37.139741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:12.246804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549988+0000","last_change":"2024-09-10T23:14:36.150886+0000","last_active":"2024-09-10T23:14:38.549988+0000","last_peered":"2024-09-10T23:14:38.549988+0000","last_clean":"2024-09-10T23:14:38.549988+0000","last_became_active":"2024-09-10T23:14:36.150523+0000","last_became_peered":"2024-09-10T23:14:36.150523+0000","last_unstale":"2024-09-10T23:14:38.549988+0000","last_undegraded":"2024-09-10T23:14:38.549988+0000","last_fullsized":"2024-09-10T23:14:38.549988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:13.596941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.149903+0000","last_change":"2024-09-10T23:14:36.147483+0000","last_active":"2024-09-10T23:14:37.149903+0000","last_peered":"2024-09-10T23:14:37.149903+0000","last_clean":"2024-09-10T23:14:37.149903+0000","last_became_active":"2024-09-10T23:14:36.147242+0000","last_became_peered":"2024-09-10T23:14:36.147242+0000","last_unstale":"2024-09-10T23:14:37.149903+0000","last_undegraded":"2024-09-10T23:14:37.149903+0000","last_fullsized":"2024-09-10T23:14:37.149903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:54.426629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140650+0000","last_change":"2024-09-10T23:14:36.151723+0000","last_active":"2024-09-10T23:14:37.140650+0000","last_peered":"2024-09-10T23:14:37.140650+0000","last_clean":"2024-09-10T23:14:37.140650+0000","last_became_active":"2024-09-10T23:14:36.151442+0000","last_became_peered":"2024-09-10T23:14:36.151442+0000","last_unstale":"2024-09-10T23:14:37.140650+0000","last_undegraded":"2024-09-10T23:14:37.140650+0000","last_fullsized":"2024-09-10T23:14:37.140650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:17.368639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141988+0000","last_change":"2024-09-10T23:14:36.153862+0000","last_active":"2024-09-10T23:14:37.141988+0000","last_peered":"2024-09-10T23:14:37.141988+0000","last_clean":"2024-09-10T23:14:37.141988+0000","last_became_active":"2024-09-10T23:14:36.152179+0000","last_became_peered":"2024-09-10T23:14:36.152179+0000","last_unstale":"2024-09-10T23:14:37.141988+0000","last_undegraded":"2024-09-10T23:14:37.141988+0000","last_fullsized":"2024-09-10T23:14:37.141988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:33:53.930716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549831+0000","last_change":"2024-09-10T23:14:36.158706+0000","last_active":"2024-09-10T23:14:38.549831+0000","last_peered":"2024-09-10T23:14:38.549831+0000","last_clean":"2024-09-10T23:14:38.549831+0000","last_became_active":"2024-09-10T23:14:36.158420+0000","last_became_peered":"2024-09-10T23:14:36.158420+0000","last_unstale":"2024-09-10T23:14:38.549831+0000","last_undegraded":"2024-09-10T23:14:38.549831+0000","last_fullsized":"2024-09-10T23:14:38.549831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:08.892988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550685+0000","last_change":"2024-09-10T23:14:36.152726+0000","last_active":"2024-09-10T23:14:38.550685+0000","last_peered":"2024-09-10T23:14:38.550685+0000","last_clean":"2024-09-10T23:14:38.550685+0000","last_became_active":"2024-09-10T23:14:36.152374+0000","last_became_peered":"2024-09-10T23:14:36.152374+0000","last_unstale":"2024-09-10T23:14:38.550685+0000","last_undegraded":"2024-09-10T23:14:38.550685+0000","last_fullsized":"2024-09-10T23:14:38.550685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:12.992438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152157+0000","last_change":"2024-09-10T23:14:36.150916+0000","last_active":"2024-09-10T23:14:37.152157+0000","last_peered":"2024-09-10T23:14:37.152157+0000","last_clean":"2024-09-10T23:14:37.152157+0000","last_became_active":"2024-09-10T23:14:36.150604+0000","last_became_peered":"2024-09-10T23:14:36.150604+0000","last_unstale":"2024-09-10T23:14:37.152157+0000","last_undegraded":"2024-09-10T23:14:37.152157+0000","last_fullsized":"2024-09-10T23:14:37.152157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:54.426629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550184+0000","last_change":"2024-09-10T23:14:36.157805+0000","last_active":"2024-09-10T23:14:38.550184+0000","last_peered":"2024-09-10T23:14:38.550184+0000","last_clean":"2024-09-10T23:14:38.550184+0000","last_became_active":"2024-09-10T23:14:36.157536+0000","last_became_peered":"2024-09-10T23:14:36.157536+0000","last_unstale":"2024-09-10T23:14:38.550184+0000","last_undegraded":"2024-09-10T23:14:38.550184+0000","last_fullsized":"2024-09-10T23:14:38.550184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:40.133768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141173+0000","last_change":"2024-09-10T23:14:36.152281+0000","last_active":"2024-09-10T23:14:37.141173+0000","last_peered":"2024-09-10T23:14:37.141173+0000","last_clean":"2024-09-10T23:14:37.141173+0000","last_became_active":"2024-09-10T23:14:36.151529+0000","last_became_peered":"2024-09-10T23:14:36.151529+0000","last_unstale":"2024-09-10T23:14:37.141173+0000","last_undegraded":"2024-09-10T23:14:37.141173+0000","last_fullsized":"2024-09-10T23:14:37.141173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:11.115291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139685+0000","last_change":"2024-09-10T23:14:36.147303+0000","last_active":"2024-09-10T23:14:37.139685+0000","last_peered":"2024-09-10T23:14:37.139685+0000","last_clean":"2024-09-10T23:14:37.139685+0000","last_became_active":"2024-09-10T23:14:36.147060+0000","last_became_peered":"2024-09-10T23:14:36.147060+0000","last_unstale":"2024-09-10T23:14:37.139685+0000","last_undegraded":"2024-09-10T23:14:37.139685+0000","last_fullsized":"2024-09-10T23:14:37.139685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:09.306575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140708+0000","last_change":"2024-09-10T23:14:36.145720+0000","last_active":"2024-09-10T23:14:37.140708+0000","last_peered":"2024-09-10T23:14:37.140708+0000","last_clean":"2024-09-10T23:14:37.140708+0000","last_became_active":"2024-09-10T23:14:36.145429+0000","last_became_peered":"2024-09-10T23:14:36.145429+0000","last_unstale":"2024-09-10T23:14:37.140708+0000","last_undegraded":"2024-09-10T23:14:37.140708+0000","last_fullsized":"2024-09-10T23:14:37.140708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:25.629769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139719+0000","last_change":"2024-09-10T23:14:36.146763+0000","last_active":"2024-09-10T23:14:37.139719+0000","last_peered":"2024-09-10T23:14:37.139719+0000","last_clean":"2024-09-10T23:14:37.139719+0000","last_became_active":"2024-09-10T23:14:36.146527+0000","last_became_peered":"2024-09-10T23:14:36.146527+0000","last_unstale":"2024-09-10T23:14:37.139719+0000","last_undegraded":"2024-09-10T23:14:37.139719+0000","last_fullsized":"2024-09-10T23:14:37.139719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:17.368639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152398+0000","last_change":"2024-09-10T23:14:36.156168+0000","last_active":"2024-09-10T23:14:37.152398+0000","last_peered":"2024-09-10T23:14:37.152398+0000","last_clean":"2024-09-10T23:14:37.152398+0000","last_became_active":"2024-09-10T23:14:36.155916+0000","last_became_peered":"2024-09-10T23:14:36.155916+0000","last_unstale":"2024-09-10T23:14:37.152398+0000","last_undegraded":"2024-09-10T23:14:37.152398+0000","last_fullsized":"2024-09-10T23:14:37.152398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:25.629769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150143+0000","last_change":"2024-09-10T23:14:36.146397+0000","last_active":"2024-09-10T23:14:37.150143+0000","last_peered":"2024-09-10T23:14:37.150143+0000","last_clean":"2024-09-10T23:14:37.150143+0000","last_became_active":"2024-09-10T23:14:36.146152+0000","last_became_peered":"2024-09-10T23:14:36.146152+0000","last_unstale":"2024-09-10T23:14:37.150143+0000","last_undegraded":"2024-09-10T23:14:37.150143+0000","last_fullsized":"2024-09-10T23:14:37.150143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:17.368639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139875+0000","last_change":"2024-09-10T23:14:36.146125+0000","last_active":"2024-09-10T23:14:37.139875+0000","last_peered":"2024-09-10T23:14:37.139875+0000","last_clean":"2024-09-10T23:14:37.139875+0000","last_became_active":"2024-09-10T23:14:36.145863+0000","last_became_peered":"2024-09-10T23:14:36.145863+0000","last_unstale":"2024-09-10T23:14:37.139875+0000","last_undegraded":"2024-09-10T23:14:37.139875+0000","last_fullsized":"2024-09-10T23:14:37.139875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:25.629769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550206+0000","last_change":"2024-09-10T23:14:36.152030+0000","last_active":"2024-09-10T23:14:38.550206+0000","last_peered":"2024-09-10T23:14:38.550206+0000","last_clean":"2024-09-10T23:14:38.550206+0000","last_became_active":"2024-09-10T23:14:36.151377+0000","last_became_peered":"2024-09-10T23:14:36.151377+0000","last_unstale":"2024-09-10T23:14:38.550206+0000","last_undegraded":"2024-09-10T23:14:38.550206+0000","last_fullsized":"2024-09-10T23:14:38.550206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:43.028083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141416+0000","last_change":"2024-09-10T23:14:36.148781+0000","last_active":"2024-09-10T23:14:37.141416+0000","last_peered":"2024-09-10T23:14:37.141416+0000","last_clean":"2024-09-10T23:14:37.141416+0000","last_became_active":"2024-09-10T23:14:36.148514+0000","last_became_peered":"2024-09-10T23:14:36.148514+0000","last_unstale":"2024-09-10T23:14:37.141416+0000","last_undegraded":"2024-09-10T23:14:37.141416+0000","last_fullsized":"2024-09-10T23:14:37.141416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:04.288672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549603+0000","last_change":"2024-09-10T23:14:36.142412+0000","last_active":"2024-09-10T23:14:38.549603+0000","last_peered":"2024-09-10T23:14:38.549603+0000","last_clean":"2024-09-10T23:14:38.549603+0000","last_became_active":"2024-09-10T23:14:36.142104+0000","last_became_peered":"2024-09-10T23:14:36.142104+0000","last_unstale":"2024-09-10T23:14:38.549603+0000","last_undegraded":"2024-09-10T23:14:38.549603+0000","last_fullsized":"2024-09-10T23:14:38.549603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:19.143333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152290+0000","last_change":"2024-09-10T23:14:36.155544+0000","last_active":"2024-09-10T23:14:37.152290+0000","last_peered":"2024-09-10T23:14:37.152290+0000","last_clean":"2024-09-10T23:14:37.152290+0000","last_became_active":"2024-09-10T23:14:36.155266+0000","last_became_peered":"2024-09-10T23:14:36.155266+0000","last_unstale":"2024-09-10T23:14:37.152290+0000","last_undegraded":"2024-09-10T23:14:37.152290+0000","last_fullsized":"2024-09-10T23:14:37.152290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:11.830037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141010+0000","last_change":"2024-09-10T23:14:36.151970+0000","last_active":"2024-09-10T23:14:37.141010+0000","last_peered":"2024-09-10T23:14:37.141010+0000","last_clean":"2024-09-10T23:14:37.141010+0000","last_became_active":"2024-09-10T23:14:36.151677+0000","last_became_peered":"2024-09-10T23:14:36.151677+0000","last_unstale":"2024-09-10T23:14:37.141010+0000","last_undegraded":"2024-09-10T23:14:37.141010+0000","last_fullsized":"2024-09-10T23:14:37.141010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:49.850113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139903+0000","last_change":"2024-09-10T23:14:35.127806+0000","last_active":"2024-09-10T23:14:37.139903+0000","last_peered":"2024-09-10T23:14:37.139903+0000","last_clean":"2024-09-10T23:14:37.139903+0000","last_became_active":"2024-09-10T23:14:35.127548+0000","last_became_peered":"2024-09-10T23:14:35.127548+0000","last_unstale":"2024-09-10T23:14:37.139903+0000","last_undegraded":"2024-09-10T23:14:37.139903+0000","last_fullsized":"2024-09-10T23:14:37.139903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:00.433782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550342+0000","last_change":"2024-09-10T23:14:36.151022+0000","last_active":"2024-09-10T23:14:38.550342+0000","last_peered":"2024-09-10T23:14:38.550342+0000","last_clean":"2024-09-10T23:14:38.550342+0000","last_became_active":"2024-09-10T23:14:36.150753+0000","last_became_peered":"2024-09-10T23:14:36.150753+0000","last_unstale":"2024-09-10T23:14:38.550342+0000","last_undegraded":"2024-09-10T23:14:38.550342+0000","last_fullsized":"2024-09-10T23:14:38.550342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:49.125136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.151995+0000","last_change":"2024-09-10T23:14:35.125689+0000","last_active":"2024-09-10T23:14:37.151995+0000","last_peered":"2024-09-10T23:14:37.151995+0000","last_clean":"2024-09-10T23:14:37.151995+0000","last_became_active":"2024-09-10T23:14:35.124148+0000","last_became_peered":"2024-09-10T23:14:35.124148+0000","last_unstale":"2024-09-10T23:14:37.151995+0000","last_undegraded":"2024-09-10T23:14:37.151995+0000","last_fullsized":"2024-09-10T23:14:37.151995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:26.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139928+0000","last_change":"2024-09-10T23:14:35.130875+0000","last_active":"2024-09-10T23:14:37.139928+0000","last_peered":"2024-09-10T23:14:37.139928+0000","last_clean":"2024-09-10T23:14:37.139928+0000","last_became_active":"2024-09-10T23:14:35.130552+0000","last_became_peered":"2024-09-10T23:14:35.130552+0000","last_unstale":"2024-09-10T23:14:37.139928+0000","last_undegraded":"2024-09-10T23:14:37.139928+0000","last_fullsized":"2024-09-10T23:14:37.139928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139600+0000","last_change":"2024-09-10T23:14:36.153264+0000","last_active":"2024-09-10T23:14:37.139600+0000","last_peered":"2024-09-10T23:14:37.139600+0000","last_clean":"2024-09-10T23:14:37.139600+0000","last_became_active":"2024-09-10T23:14:36.153009+0000","last_became_peered":"2024-09-10T23:14:36.153009+0000","last_unstale":"2024-09-10T23:14:37.139600+0000","last_undegraded":"2024-09-10T23:14:37.139600+0000","last_fullsized":"2024-09-10T23:14:37.139600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:54.426629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140838+0000","last_change":"2024-09-10T23:14:35.123317+0000","last_active":"2024-09-10T23:14:37.140838+0000","last_peered":"2024-09-10T23:14:37.140838+0000","last_clean":"2024-09-10T23:14:37.140838+0000","last_became_active":"2024-09-10T23:14:35.123043+0000","last_became_peered":"2024-09-10T23:14:35.123043+0000","last_unstale":"2024-09-10T23:14:37.140838+0000","last_undegraded":"2024-09-10T23:14:37.140838+0000","last_fullsized":"2024-09-10T23:14:37.140838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:44.244654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.149909+0000","last_change":"2024-09-10T23:14:36.149488+0000","last_active":"2024-09-10T23:14:37.149909+0000","last_peered":"2024-09-10T23:14:37.149909+0000","last_clean":"2024-09-10T23:14:37.149909+0000","last_became_active":"2024-09-10T23:14:36.149221+0000","last_became_peered":"2024-09-10T23:14:36.149221+0000","last_unstale":"2024-09-10T23:14:37.149909+0000","last_undegraded":"2024-09-10T23:14:37.149909+0000","last_fullsized":"2024-09-10T23:14:37.149909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:55.476145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152279+0000","last_change":"2024-09-10T23:14:35.129118+0000","last_active":"2024-09-10T23:14:37.152279+0000","last_peered":"2024-09-10T23:14:37.152279+0000","last_clean":"2024-09-10T23:14:37.152279+0000","last_became_active":"2024-09-10T23:14:35.128858+0000","last_became_peered":"2024-09-10T23:14:35.128858+0000","last_unstale":"2024-09-10T23:14:37.152279+0000","last_undegraded":"2024-09-10T23:14:37.152279+0000","last_fullsized":"2024-09-10T23:14:37.152279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:00.727658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141203+0000","last_change":"2024-09-10T23:14:36.152153+0000","last_active":"2024-09-10T23:14:37.141203+0000","last_peered":"2024-09-10T23:14:37.141203+0000","last_clean":"2024-09-10T23:14:37.141203+0000","last_became_active":"2024-09-10T23:14:36.151862+0000","last_became_peered":"2024-09-10T23:14:36.151862+0000","last_unstale":"2024-09-10T23:14:37.141203+0000","last_undegraded":"2024-09-10T23:14:37.141203+0000","last_fullsized":"2024-09-10T23:14:37.141203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:28.160849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141363+0000","last_change":"2024-09-10T23:14:35.130807+0000","last_active":"2024-09-10T23:14:37.141363+0000","last_peered":"2024-09-10T23:14:37.141363+0000","last_clean":"2024-09-10T23:14:37.141363+0000","last_became_active":"2024-09-10T23:14:35.130541+0000","last_became_peered":"2024-09-10T23:14:35.130541+0000","last_unstale":"2024-09-10T23:14:37.141363+0000","last_undegraded":"2024-09-10T23:14:37.141363+0000","last_fullsized":"2024-09-10T23:14:37.141363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:48.848197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550023+0000","last_change":"2024-09-10T23:14:36.149079+0000","last_active":"2024-09-10T23:14:38.550023+0000","last_peered":"2024-09-10T23:14:38.550023+0000","last_clean":"2024-09-10T23:14:38.550023+0000","last_became_active":"2024-09-10T23:14:36.148726+0000","last_became_peered":"2024-09-10T23:14:36.148726+0000","last_unstale":"2024-09-10T23:14:38.550023+0000","last_undegraded":"2024-09-10T23:14:38.550023+0000","last_fullsized":"2024-09-10T23:14:38.550023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:52.012404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150094+0000","last_change":"2024-09-10T23:14:35.122724+0000","last_active":"2024-09-10T23:14:37.150094+0000","last_peered":"2024-09-10T23:14:37.150094+0000","last_clean":"2024-09-10T23:14:37.150094+0000","last_became_active":"2024-09-10T23:14:35.119910+0000","last_became_peered":"2024-09-10T23:14:35.119910+0000","last_unstale":"2024-09-10T23:14:37.150094+0000","last_undegraded":"2024-09-10T23:14:37.150094+0000","last_fullsized":"2024-09-10T23:14:37.150094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:52.598287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141829+0000","last_change":"2024-09-10T23:14:36.155881+0000","last_active":"2024-09-10T23:14:37.141829+0000","last_peered":"2024-09-10T23:14:37.141829+0000","last_clean":"2024-09-10T23:14:37.141829+0000","last_became_active":"2024-09-10T23:14:36.155598+0000","last_became_peered":"2024-09-10T23:14:36.155598+0000","last_unstale":"2024-09-10T23:14:37.141829+0000","last_undegraded":"2024-09-10T23:14:37.141829+0000","last_fullsized":"2024-09-10T23:14:37.141829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:19.143333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152332+0000","last_change":"2024-09-10T23:14:35.127319+0000","last_active":"2024-09-10T23:14:37.152332+0000","last_peered":"2024-09-10T23:14:37.152332+0000","last_clean":"2024-09-10T23:14:37.152332+0000","last_became_active":"2024-09-10T23:14:35.127042+0000","last_became_peered":"2024-09-10T23:14:35.127042+0000","last_unstale":"2024-09-10T23:14:37.152332+0000","last_undegraded":"2024-09-10T23:14:37.152332+0000","last_fullsized":"2024-09-10T23:14:37.152332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:48.848197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550250+0000","last_change":"2024-09-10T23:14:36.150360+0000","last_active":"2024-09-10T23:14:38.550250+0000","last_peered":"2024-09-10T23:14:38.550250+0000","last_clean":"2024-09-10T23:14:38.550250+0000","last_became_active":"2024-09-10T23:14:36.150031+0000","last_became_peered":"2024-09-10T23:14:36.150031+0000","last_unstale":"2024-09-10T23:14:38.550250+0000","last_undegraded":"2024-09-10T23:14:38.550250+0000","last_fullsized":"2024-09-10T23:14:38.550250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:52.426211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550432+0000","last_change":"2024-09-10T23:14:35.123801+0000","last_active":"2024-09-10T23:14:38.550432+0000","last_peered":"2024-09-10T23:14:38.550432+0000","last_clean":"2024-09-10T23:14:38.550432+0000","last_became_active":"2024-09-10T23:14:35.123332+0000","last_became_peered":"2024-09-10T23:14:35.123332+0000","last_unstale":"2024-09-10T23:14:38.550432+0000","last_undegraded":"2024-09-10T23:14:38.550432+0000","last_fullsized":"2024-09-10T23:14:38.550432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:57.857780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550087+0000","last_change":"2024-09-10T23:14:36.153086+0000","last_active":"2024-09-10T23:14:38.550087+0000","last_peered":"2024-09-10T23:14:38.550087+0000","last_clean":"2024-09-10T23:14:38.550087+0000","last_became_active":"2024-09-10T23:14:36.152843+0000","last_became_peered":"2024-09-10T23:14:36.152843+0000","last_unstale":"2024-09-10T23:14:38.550087+0000","last_undegraded":"2024-09-10T23:14:38.550087+0000","last_fullsized":"2024-09-10T23:14:38.550087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:59.216035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141525+0000","last_change":"2024-09-10T23:14:35.130442+0000","last_active":"2024-09-10T23:14:37.141525+0000","last_peered":"2024-09-10T23:14:37.141525+0000","last_clean":"2024-09-10T23:14:37.141525+0000","last_became_active":"2024-09-10T23:14:35.130131+0000","last_became_peered":"2024-09-10T23:14:35.130131+0000","last_unstale":"2024-09-10T23:14:37.141525+0000","last_undegraded":"2024-09-10T23:14:37.141525+0000","last_fullsized":"2024-09-10T23:14:37.141525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:26.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550333+0000","last_change":"2024-09-10T23:14:36.153529+0000","last_active":"2024-09-10T23:14:38.550333+0000","last_peered":"2024-09-10T23:14:38.550333+0000","last_clean":"2024-09-10T23:14:38.550333+0000","last_became_active":"2024-09-10T23:14:36.153131+0000","last_became_peered":"2024-09-10T23:14:36.153131+0000","last_unstale":"2024-09-10T23:14:38.550333+0000","last_undegraded":"2024-09-10T23:14:38.550333+0000","last_fullsized":"2024-09-10T23:14:38.550333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:33:53.930716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152026+0000","last_change":"2024-09-10T23:14:35.129215+0000","last_active":"2024-09-10T23:14:37.152026+0000","last_peered":"2024-09-10T23:14:37.152026+0000","last_clean":"2024-09-10T23:14:37.152026+0000","last_became_active":"2024-09-10T23:14:35.128170+0000","last_became_peered":"2024-09-10T23:14:35.128170+0000","last_unstale":"2024-09-10T23:14:37.152026+0000","last_undegraded":"2024-09-10T23:14:37.152026+0000","last_fullsized":"2024-09-10T23:14:37.152026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:44.244654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152200+0000","last_change":"2024-09-10T23:14:36.154580+0000","last_active":"2024-09-10T23:14:37.152200+0000","last_peered":"2024-09-10T23:14:37.152200+0000","last_clean":"2024-09-10T23:14:37.152200+0000","last_became_active":"2024-09-10T23:14:36.154172+0000","last_became_peered":"2024-09-10T23:14:36.154172+0000","last_unstale":"2024-09-10T23:14:37.152200+0000","last_undegraded":"2024-09-10T23:14:37.152200+0000","last_fullsized":"2024-09-10T23:14:37.152200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:12.246804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549517+0000","last_change":"2024-09-10T23:14:35.127072+0000","last_active":"2024-09-10T23:14:38.549517+0000","last_peered":"2024-09-10T23:14:38.549517+0000","last_clean":"2024-09-10T23:14:38.549517+0000","last_became_active":"2024-09-10T23:14:35.126776+0000","last_became_peered":"2024-09-10T23:14:35.126776+0000","last_unstale":"2024-09-10T23:14:38.549517+0000","last_undegraded":"2024-09-10T23:14:38.549517+0000","last_fullsized":"2024-09-10T23:14:38.549517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:50.458204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550012+0000","last_change":"2024-09-10T23:14:36.150674+0000","last_active":"2024-09-10T23:14:38.550012+0000","last_peered":"2024-09-10T23:14:38.550012+0000","last_clean":"2024-09-10T23:14:38.550012+0000","last_became_active":"2024-09-10T23:14:36.149916+0000","last_became_peered":"2024-09-10T23:14:36.149916+0000","last_unstale":"2024-09-10T23:14:38.550012+0000","last_undegraded":"2024-09-10T23:14:38.550012+0000","last_fullsized":"2024-09-10T23:14:38.550012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:28.160849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141391+0000","last_change":"2024-09-10T23:14:35.130472+0000","last_active":"2024-09-10T23:14:37.141391+0000","last_peered":"2024-09-10T23:14:37.141391+0000","last_clean":"2024-09-10T23:14:37.141391+0000","last_became_active":"2024-09-10T23:14:35.130164+0000","last_became_peered":"2024-09-10T23:14:35.130164+0000","last_unstale":"2024-09-10T23:14:37.141391+0000","last_undegraded":"2024-09-10T23:14:37.141391+0000","last_fullsized":"2024-09-10T23:14:37.141391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:37.291436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550513+0000","last_change":"2024-09-10T23:14:36.153260+0000","last_active":"2024-09-10T23:14:38.550513+0000","last_peered":"2024-09-10T23:14:38.550513+0000","last_clean":"2024-09-10T23:14:38.550513+0000","last_became_active":"2024-09-10T23:14:36.152964+0000","last_became_peered":"2024-09-10T23:14:36.152964+0000","last_unstale":"2024-09-10T23:14:38.550513+0000","last_undegraded":"2024-09-10T23:14:38.550513+0000","last_fullsized":"2024-09-10T23:14:38.550513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:08.022145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549956+0000","last_change":"2024-09-10T23:14:35.130891+0000","last_active":"2024-09-10T23:14:38.549956+0000","last_peered":"2024-09-10T23:14:38.549956+0000","last_clean":"2024-09-10T23:14:38.549956+0000","last_became_active":"2024-09-10T23:14:35.130654+0000","last_became_peered":"2024-09-10T23:14:35.130654+0000","last_unstale":"2024-09-10T23:14:38.549956+0000","last_undegraded":"2024-09-10T23:14:38.549956+0000","last_fullsized":"2024-09-10T23:14:38.549956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:37.763702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550813+0000","last_change":"2024-09-10T23:14:36.152970+0000","last_active":"2024-09-10T23:14:38.550813+0000","last_peered":"2024-09-10T23:14:38.550813+0000","last_clean":"2024-09-10T23:14:38.550813+0000","last_became_active":"2024-09-10T23:14:36.152669+0000","last_became_peered":"2024-09-10T23:14:36.152669+0000","last_unstale":"2024-09-10T23:14:38.550813+0000","last_undegraded":"2024-09-10T23:14:38.550813+0000","last_fullsized":"2024-09-10T23:14:38.550813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:26.515458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150214+0000","last_change":"2024-09-10T23:14:35.121691+0000","last_active":"2024-09-10T23:14:37.150214+0000","last_peered":"2024-09-10T23:14:37.150214+0000","last_clean":"2024-09-10T23:14:37.150214+0000","last_became_active":"2024-09-10T23:14:35.121391+0000","last_became_peered":"2024-09-10T23:14:35.121391+0000","last_unstale":"2024-09-10T23:14:37.150214+0000","last_undegraded":"2024-09-10T23:14:37.150214+0000","last_fullsized":"2024-09-10T23:14:37.150214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:10.992208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.142206+0000","last_change":"2024-09-10T23:14:36.145872+0000","last_active":"2024-09-10T23:14:37.142206+0000","last_peered":"2024-09-10T23:14:37.142206+0000","last_clean":"2024-09-10T23:14:37.142206+0000","last_became_active":"2024-09-10T23:14:36.145477+0000","last_became_peered":"2024-09-10T23:14:36.145477+0000","last_unstale":"2024-09-10T23:14:37.142206+0000","last_undegraded":"2024-09-10T23:14:37.142206+0000","last_fullsized":"2024-09-10T23:14:37.142206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:16.389050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549809+0000","last_change":"2024-09-10T23:14:35.126188+0000","last_active":"2024-09-10T23:14:38.549809+0000","last_peered":"2024-09-10T23:14:38.549809+0000","last_clean":"2024-09-10T23:14:38.549809+0000","last_became_active":"2024-09-10T23:14:35.125868+0000","last_became_peered":"2024-09-10T23:14:35.125868+0000","last_unstale":"2024-09-10T23:14:38.549809+0000","last_undegraded":"2024-09-10T23:14:38.549809+0000","last_fullsized":"2024-09-10T23:14:38.549809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:40.440663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550457+0000","last_change":"2024-09-10T23:14:36.158261+0000","last_active":"2024-09-10T23:14:38.550457+0000","last_peered":"2024-09-10T23:14:38.550457+0000","last_clean":"2024-09-10T23:14:38.550457+0000","last_became_active":"2024-09-10T23:14:36.157994+0000","last_became_peered":"2024-09-10T23:14:36.157994+0000","last_unstale":"2024-09-10T23:14:38.550457+0000","last_undegraded":"2024-09-10T23:14:38.550457+0000","last_fullsized":"2024-09-10T23:14:38.550457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:42.507579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550004+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:14:38.550004+0000","last_peered":"2024-09-10T23:14:38.550004+0000","last_clean":"2024-09-10T23:14:38.550004+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:14:38.550004+0000","last_undegraded":"2024-09-10T23:14:38.550004+0000","last_fullsized":"2024-09-10T23:14:38.550004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140725+0000","last_change":"2024-09-10T23:14:35.126656+0000","last_active":"2024-09-10T23:14:37.140725+0000","last_peered":"2024-09-10T23:14:37.140725+0000","last_clean":"2024-09-10T23:14:37.140725+0000","last_became_active":"2024-09-10T23:14:35.126289+0000","last_became_peered":"2024-09-10T23:14:35.126289+0000","last_unstale":"2024-09-10T23:14:37.140725+0000","last_undegraded":"2024-09-10T23:14:37.140725+0000","last_fullsized":"2024-09-10T23:14:37.140725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139727+0000","last_change":"2024-09-10T23:14:36.151908+0000","last_active":"2024-09-10T23:14:37.139727+0000","last_peered":"2024-09-10T23:14:37.139727+0000","last_clean":"2024-09-10T23:14:37.139727+0000","last_became_active":"2024-09-10T23:14:36.151632+0000","last_became_peered":"2024-09-10T23:14:36.151632+0000","last_unstale":"2024-09-10T23:14:37.139727+0000","last_undegraded":"2024-09-10T23:14:37.139727+0000","last_fullsized":"2024-09-10T23:14:37.139727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:11.830037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549866+0000","last_change":"2024-09-10T23:14:35.132667+0000","last_active":"2024-09-10T23:14:38.549866+0000","last_peered":"2024-09-10T23:14:38.549866+0000","last_clean":"2024-09-10T23:14:38.549866+0000","last_became_active":"2024-09-10T23:14:35.132330+0000","last_became_peered":"2024-09-10T23:14:35.132330+0000","last_unstale":"2024-09-10T23:14:38.549866+0000","last_undegraded":"2024-09-10T23:14:38.549866+0000","last_fullsized":"2024-09-10T23:14:38.549866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:52.598287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549820+0000","last_change":"2024-09-10T23:14:36.149640+0000","last_active":"2024-09-10T23:14:38.549820+0000","last_peered":"2024-09-10T23:14:38.549820+0000","last_clean":"2024-09-10T23:14:38.549820+0000","last_became_active":"2024-09-10T23:14:36.148907+0000","last_became_peered":"2024-09-10T23:14:36.148907+0000","last_unstale":"2024-09-10T23:14:38.549820+0000","last_undegraded":"2024-09-10T23:14:38.549820+0000","last_fullsized":"2024-09-10T23:14:38.549820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:02.988430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549624+0000","last_change":"2024-09-10T23:14:35.130254+0000","last_active":"2024-09-10T23:14:38.549624+0000","last_peered":"2024-09-10T23:14:38.549624+0000","last_clean":"2024-09-10T23:14:38.549624+0000","last_became_active":"2024-09-10T23:14:35.129994+0000","last_became_peered":"2024-09-10T23:14:35.129994+0000","last_unstale":"2024-09-10T23:14:38.549624+0000","last_undegraded":"2024-09-10T23:14:38.549624+0000","last_fullsized":"2024-09-10T23:14:38.549624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.149929+0000","last_change":"2024-09-10T23:14:36.147135+0000","last_active":"2024-09-10T23:14:37.149929+0000","last_peered":"2024-09-10T23:14:37.149929+0000","last_clean":"2024-09-10T23:14:37.149929+0000","last_became_active":"2024-09-10T23:14:36.146791+0000","last_became_peered":"2024-09-10T23:14:36.146791+0000","last_unstale":"2024-09-10T23:14:37.149929+0000","last_undegraded":"2024-09-10T23:14:37.149929+0000","last_fullsized":"2024-09-10T23:14:37.149929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:20.756119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141573+0000","last_change":"2024-09-10T23:14:35.116348+0000","last_active":"2024-09-10T23:14:37.141573+0000","last_peered":"2024-09-10T23:14:37.141573+0000","last_clean":"2024-09-10T23:14:37.141573+0000","last_became_active":"2024-09-10T23:14:35.116063+0000","last_became_peered":"2024-09-10T23:14:35.116063+0000","last_unstale":"2024-09-10T23:14:37.141573+0000","last_undegraded":"2024-09-10T23:14:37.141573+0000","last_fullsized":"2024-09-10T23:14:37.141573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:52.598287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141784+0000","last_change":"2024-09-10T23:14:36.154237+0000","last_active":"2024-09-10T23:14:37.141784+0000","last_peered":"2024-09-10T23:14:37.141784+0000","last_clean":"2024-09-10T23:14:37.141784+0000","last_became_active":"2024-09-10T23:14:36.153966+0000","last_became_peered":"2024-09-10T23:14:36.153966+0000","last_unstale":"2024-09-10T23:14:37.141784+0000","last_undegraded":"2024-09-10T23:14:37.141784+0000","last_fullsized":"2024-09-10T23:14:37.141784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:36.806040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150055+0000","last_change":"2024-09-10T23:14:35.123920+0000","last_active":"2024-09-10T23:14:37.150055+0000","last_peered":"2024-09-10T23:14:37.150055+0000","last_clean":"2024-09-10T23:14:37.150055+0000","last_became_active":"2024-09-10T23:14:35.123644+0000","last_became_peered":"2024-09-10T23:14:35.123644+0000","last_unstale":"2024-09-10T23:14:37.150055+0000","last_undegraded":"2024-09-10T23:14:37.150055+0000","last_fullsized":"2024-09-10T23:14:37.150055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:26.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.142073+0000","last_change":"2024-09-10T23:14:36.145847+0000","last_active":"2024-09-10T23:14:37.142073+0000","last_peered":"2024-09-10T23:14:37.142073+0000","last_clean":"2024-09-10T23:14:37.142073+0000","last_became_active":"2024-09-10T23:14:36.145505+0000","last_became_peered":"2024-09-10T23:14:36.145505+0000","last_unstale":"2024-09-10T23:14:37.142073+0000","last_undegraded":"2024-09-10T23:14:37.142073+0000","last_fullsized":"2024-09-10T23:14:37.142073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:42.507579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550650+0000","last_change":"2024-09-10T23:14:35.133489+0000","last_active":"2024-09-10T23:14:38.550650+0000","last_peered":"2024-09-10T23:14:38.550650+0000","last_clean":"2024-09-10T23:14:38.550650+0000","last_became_active":"2024-09-10T23:14:35.133189+0000","last_became_peered":"2024-09-10T23:14:35.133189+0000","last_unstale":"2024-09-10T23:14:38.550650+0000","last_undegraded":"2024-09-10T23:14:38.550650+0000","last_fullsized":"2024-09-10T23:14:38.550650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:47.943661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.149972+0000","last_change":"2024-09-10T23:14:36.145337+0000","last_active":"2024-09-10T23:14:37.149972+0000","last_peered":"2024-09-10T23:14:37.149972+0000","last_clean":"2024-09-10T23:14:37.149972+0000","last_became_active":"2024-09-10T23:14:36.145030+0000","last_became_peered":"2024-09-10T23:14:36.145030+0000","last_unstale":"2024-09-10T23:14:37.149972+0000","last_undegraded":"2024-09-10T23:14:37.149972+0000","last_fullsized":"2024-09-10T23:14:37.149972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:12.246804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150235+0000","last_change":"2024-09-10T23:14:35.130762+0000","last_active":"2024-09-10T23:14:37.150235+0000","last_peered":"2024-09-10T23:14:37.150235+0000","last_clean":"2024-09-10T23:14:37.150235+0000","last_became_active":"2024-09-10T23:14:35.130502+0000","last_became_peered":"2024-09-10T23:14:35.130502+0000","last_unstale":"2024-09-10T23:14:37.150235+0000","last_undegraded":"2024-09-10T23:14:37.150235+0000","last_fullsized":"2024-09-10T23:14:37.150235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:37.092636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140000+0000","last_change":"2024-09-10T23:14:36.158417+0000","last_active":"2024-09-10T23:14:37.140000+0000","last_peered":"2024-09-10T23:14:37.140000+0000","last_clean":"2024-09-10T23:14:37.140000+0000","last_became_active":"2024-09-10T23:14:36.158157+0000","last_became_peered":"2024-09-10T23:14:36.158157+0000","last_unstale":"2024-09-10T23:14:37.140000+0000","last_undegraded":"2024-09-10T23:14:37.140000+0000","last_fullsized":"2024-09-10T23:14:37.140000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:11.115291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152322+0000","last_change":"2024-09-10T23:14:35.128484+0000","last_active":"2024-09-10T23:14:37.152322+0000","last_peered":"2024-09-10T23:14:37.152322+0000","last_clean":"2024-09-10T23:14:37.152322+0000","last_became_active":"2024-09-10T23:14:35.127877+0000","last_became_peered":"2024-09-10T23:14:35.127877+0000","last_unstale":"2024-09-10T23:14:37.152322+0000","last_undegraded":"2024-09-10T23:14:37.152322+0000","last_fullsized":"2024-09-10T23:14:37.152322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550037+0000","last_change":"2024-09-10T23:14:36.150091+0000","last_active":"2024-09-10T23:14:38.550037+0000","last_peered":"2024-09-10T23:14:38.550037+0000","last_clean":"2024-09-10T23:14:38.550037+0000","last_became_active":"2024-09-10T23:14:36.149727+0000","last_became_peered":"2024-09-10T23:14:36.149727+0000","last_unstale":"2024-09-10T23:14:38.550037+0000","last_undegraded":"2024-09-10T23:14:38.550037+0000","last_fullsized":"2024-09-10T23:14:38.550037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:30:11.421097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549852+0000","last_change":"2024-09-10T23:14:35.133467+0000","last_active":"2024-09-10T23:14:38.549852+0000","last_peered":"2024-09-10T23:14:38.549852+0000","last_clean":"2024-09-10T23:14:38.549852+0000","last_became_active":"2024-09-10T23:14:35.133163+0000","last_became_peered":"2024-09-10T23:14:35.133163+0000","last_unstale":"2024-09-10T23:14:38.549852+0000","last_undegraded":"2024-09-10T23:14:38.549852+0000","last_fullsized":"2024-09-10T23:14:38.549852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:12.209676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141682+0000","last_change":"2024-09-10T23:14:36.146249+0000","last_active":"2024-09-10T23:14:37.141682+0000","last_peered":"2024-09-10T23:14:37.141682+0000","last_clean":"2024-09-10T23:14:37.141682+0000","last_became_active":"2024-09-10T23:14:36.145993+0000","last_became_peered":"2024-09-10T23:14:36.145993+0000","last_unstale":"2024-09-10T23:14:37.141682+0000","last_undegraded":"2024-09-10T23:14:37.141682+0000","last_fullsized":"2024-09-10T23:14:37.141682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:53.600203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150057+0000","last_change":"2024-09-10T23:14:35.125619+0000","last_active":"2024-09-10T23:14:37.150057+0000","last_peered":"2024-09-10T23:14:37.150057+0000","last_clean":"2024-09-10T23:14:37.150057+0000","last_became_active":"2024-09-10T23:14:35.125258+0000","last_became_peered":"2024-09-10T23:14:35.125258+0000","last_unstale":"2024-09-10T23:14:37.150057+0000","last_undegraded":"2024-09-10T23:14:37.150057+0000","last_fullsized":"2024-09-10T23:14:37.150057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:44.244654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140094+0000","last_change":"2024-09-10T23:14:36.145873+0000","last_active":"2024-09-10T23:14:37.140094+0000","last_peered":"2024-09-10T23:14:37.140094+0000","last_clean":"2024-09-10T23:14:37.140094+0000","last_became_active":"2024-09-10T23:14:36.145109+0000","last_became_peered":"2024-09-10T23:14:36.145109+0000","last_unstale":"2024-09-10T23:14:37.140094+0000","last_undegraded":"2024-09-10T23:14:37.140094+0000","last_fullsized":"2024-09-10T23:14:37.140094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:28.160849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.149958+0000","last_change":"2024-09-10T23:14:35.124311+0000","last_active":"2024-09-10T23:14:37.149958+0000","last_peered":"2024-09-10T23:14:37.149958+0000","last_clean":"2024-09-10T23:14:37.149958+0000","last_became_active":"2024-09-10T23:14:35.124054+0000","last_became_peered":"2024-09-10T23:14:35.124054+0000","last_unstale":"2024-09-10T23:14:37.149958+0000","last_undegraded":"2024-09-10T23:14:37.149958+0000","last_fullsized":"2024-09-10T23:14:37.149958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:48.848197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139873+0000","last_change":"2024-09-10T23:14:36.155283+0000","last_active":"2024-09-10T23:14:37.139873+0000","last_peered":"2024-09-10T23:14:37.139873+0000","last_clean":"2024-09-10T23:14:37.139873+0000","last_became_active":"2024-09-10T23:14:36.154917+0000","last_became_peered":"2024-09-10T23:14:36.154917+0000","last_unstale":"2024-09-10T23:14:37.139873+0000","last_undegraded":"2024-09-10T23:14:37.139873+0000","last_fullsized":"2024-09-10T23:14:37.139873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:09.415499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550448+0000","last_change":"2024-09-10T23:14:35.128785+0000","last_active":"2024-09-10T23:14:38.550448+0000","last_peered":"2024-09-10T23:14:38.550448+0000","last_clean":"2024-09-10T23:14:38.550448+0000","last_became_active":"2024-09-10T23:14:35.128523+0000","last_became_peered":"2024-09-10T23:14:35.128523+0000","last_unstale":"2024-09-10T23:14:38.550448+0000","last_undegraded":"2024-09-10T23:14:38.550448+0000","last_fullsized":"2024-09-10T23:14:38.550448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:01.097187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152074+0000","last_change":"2024-09-10T23:14:36.153266+0000","last_active":"2024-09-10T23:14:37.152074+0000","last_peered":"2024-09-10T23:14:37.152074+0000","last_clean":"2024-09-10T23:14:37.152074+0000","last_became_active":"2024-09-10T23:14:36.152781+0000","last_became_peered":"2024-09-10T23:14:36.152781+0000","last_unstale":"2024-09-10T23:14:37.152074+0000","last_undegraded":"2024-09-10T23:14:37.152074+0000","last_fullsized":"2024-09-10T23:14:37.152074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:51.090210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141856+0000","last_change":"2024-09-10T23:14:36.149184+0000","last_active":"2024-09-10T23:14:37.141856+0000","last_peered":"2024-09-10T23:14:37.141856+0000","last_clean":"2024-09-10T23:14:37.141856+0000","last_became_active":"2024-09-10T23:14:36.146259+0000","last_became_peered":"2024-09-10T23:14:36.146259+0000","last_unstale":"2024-09-10T23:14:37.141856+0000","last_undegraded":"2024-09-10T23:14:37.141856+0000","last_fullsized":"2024-09-10T23:14:37.141856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:44.783941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550156+0000","last_change":"2024-09-10T23:14:35.128918+0000","last_active":"2024-09-10T23:14:38.550156+0000","last_peered":"2024-09-10T23:14:38.550156+0000","last_clean":"2024-09-10T23:14:38.550156+0000","last_became_active":"2024-09-10T23:14:35.128646+0000","last_became_peered":"2024-09-10T23:14:35.128646+0000","last_unstale":"2024-09-10T23:14:38.550156+0000","last_undegraded":"2024-09-10T23:14:38.550156+0000","last_fullsized":"2024-09-10T23:14:38.550156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:10.992208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.142141+0000","last_change":"2024-09-10T23:14:36.147233+0000","last_active":"2024-09-10T23:14:37.142141+0000","last_peered":"2024-09-10T23:14:37.142141+0000","last_clean":"2024-09-10T23:14:37.142141+0000","last_became_active":"2024-09-10T23:14:36.146609+0000","last_became_peered":"2024-09-10T23:14:36.146609+0000","last_unstale":"2024-09-10T23:14:37.142141+0000","last_undegraded":"2024-09-10T23:14:37.142141+0000","last_fullsized":"2024-09-10T23:14:37.142141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:08.022145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550494+0000","last_change":"2024-09-10T23:14:35.131443+0000","last_active":"2024-09-10T23:14:38.550494+0000","last_peered":"2024-09-10T23:14:38.550494+0000","last_clean":"2024-09-10T23:14:38.550494+0000","last_became_active":"2024-09-10T23:14:35.131123+0000","last_became_peered":"2024-09-10T23:14:35.131123+0000","last_unstale":"2024-09-10T23:14:38.550494+0000","last_undegraded":"2024-09-10T23:14:38.550494+0000","last_fullsized":"2024-09-10T23:14:38.550494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:37.092636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549797+0000","last_change":"2024-09-10T23:14:36.152236+0000","last_active":"2024-09-10T23:14:38.549797+0000","last_peered":"2024-09-10T23:14:38.549797+0000","last_clean":"2024-09-10T23:14:38.549797+0000","last_became_active":"2024-09-10T23:14:36.151945+0000","last_became_peered":"2024-09-10T23:14:36.151945+0000","last_unstale":"2024-09-10T23:14:38.549797+0000","last_undegraded":"2024-09-10T23:14:38.549797+0000","last_fullsized":"2024-09-10T23:14:38.549797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:33.925368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140035+0000","last_change":"2024-09-10T23:14:35.129994+0000","last_active":"2024-09-10T23:14:37.140035+0000","last_peered":"2024-09-10T23:14:37.140035+0000","last_clean":"2024-09-10T23:14:37.140035+0000","last_became_active":"2024-09-10T23:14:35.129609+0000","last_became_peered":"2024-09-10T23:14:35.129609+0000","last_unstale":"2024-09-10T23:14:37.140035+0000","last_undegraded":"2024-09-10T23:14:37.140035+0000","last_fullsized":"2024-09-10T23:14:37.140035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:38.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140095+0000","last_change":"2024-09-10T23:14:36.157814+0000","last_active":"2024-09-10T23:14:37.140095+0000","last_peered":"2024-09-10T23:14:37.140095+0000","last_clean":"2024-09-10T23:14:37.140095+0000","last_became_active":"2024-09-10T23:14:36.157514+0000","last_became_peered":"2024-09-10T23:14:36.157514+0000","last_unstale":"2024-09-10T23:14:37.140095+0000","last_undegraded":"2024-09-10T23:14:37.140095+0000","last_fullsized":"2024-09-10T23:14:37.140095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:14.103635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550272+0000","last_change":"2024-09-10T23:14:35.129129+0000","last_active":"2024-09-10T23:14:38.550272+0000","last_peered":"2024-09-10T23:14:38.550272+0000","last_clean":"2024-09-10T23:14:38.550272+0000","last_became_active":"2024-09-10T23:14:35.128815+0000","last_became_peered":"2024-09-10T23:14:35.128815+0000","last_unstale":"2024-09-10T23:14:38.550272+0000","last_undegraded":"2024-09-10T23:14:38.550272+0000","last_fullsized":"2024-09-10T23:14:38.550272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:08.507246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":831488,"data_stored":672185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":237568,"data_stored":81325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":81361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":241664,"data_stored":81395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":672241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:14:47.390 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:14:47.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.526+0000 7f5876bf4640 1 -- 172.21.15.90:0/1185350253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58700d1c70 msgr2=0x7f58700d2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.526+0000 7f5876bf4640 1 --2- 172.21.15.90:0/1185350253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58700d1c70 0x7f58700d2850 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f587008d0d0 tx=0x7f586402a560 comp rx=0 tx=0).stop 2024-09-10T23:14:47.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.526+0000 7f5876bf4640 1 -- 172.21.15.90:0/1185350253 shutdown_connections 2024-09-10T23:14:47.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.526+0000 7f5876bf4640 1 --2- 172.21.15.90:0/1185350253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58700d0ab0 0x7f58700d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.526+0000 7f5876bf4640 1 --2- 172.21.15.90:0/1185350253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58700d1c70 0x7f58700d2850 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.526+0000 7f5876bf4640 1 --2- 172.21.15.90:0/1185350253 >> v2:172.21.15.171:3300/0 conn(0x7f58700d2470 0x7f58700b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.526+0000 7f5876bf4640 1 -- 172.21.15.90:0/1185350253 >> 172.21.15.90:0/1185350253 conn(0x7f587009d2a0 msgr2=0x7f58700d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:47.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.526+0000 7f5876bf4640 1 -- 172.21.15.90:0/1185350253 shutdown_connections 2024-09-10T23:14:47.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.526+0000 7f5876bf4640 1 -- 172.21.15.90:0/1185350253 wait complete. 2024-09-10T23:14:47.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.527+0000 7f5876bf4640 1 Processor -- start 2024-09-10T23:14:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.527+0000 7f5876bf4640 1 -- start start 2024-09-10T23:14:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.528+0000 7f5876bf4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58700d0ab0 0x7f58700c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.528+0000 7f5876bf4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58700d1c70 0x7f58700c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.528+0000 7f5876bf4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58700d2470 0x7f5870154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.528+0000 7f5876bf4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f587015e4a0 con 0x7f58700d1c70 2024-09-10T23:14:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.528+0000 7f5876bf4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f587015e320 con 0x7f58700d2470 2024-09-10T23:14:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.528+0000 7f5876bf4640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f58700d14a0 con 0x7f58700d0ab0 2024-09-10T23:14:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.528+0000 7f586ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58700d1c70 0x7f58700c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.528+0000 7f586ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58700d1c70 0x7f58700c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50672/0 (socket says 172.21.15.90:50672) 2024-09-10T23:14:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.528+0000 7f586ffff640 1 -- 172.21.15.90:0/640803151 learned_addr learned my addr 172.21.15.90:0/640803151 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.528+0000 7f5874990640 1 --2- 172.21.15.90:0/640803151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58700d0ab0 0x7f58700c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.528+0000 7f5875191640 1 --2- 172.21.15.90:0/640803151 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58700d2470 0x7f5870154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:47.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.529+0000 7f586ffff640 1 -- 172.21.15.90:0/640803151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58700d0ab0 msgr2=0x7f58700c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.529+0000 7f586ffff640 1 --2- 172.21.15.90:0/640803151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58700d0ab0 0x7f58700c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.529+0000 7f586ffff640 1 -- 172.21.15.90:0/640803151 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58700d2470 msgr2=0x7f5870154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.529+0000 7f586ffff640 1 --2- 172.21.15.90:0/640803151 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58700d2470 0x7f5870154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.529+0000 7f586ffff640 1 -- 172.21.15.90:0/640803151 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58700c8110 con 0x7f58700d1c70 2024-09-10T23:14:47.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.529+0000 7f586ffff640 1 --2- 172.21.15.90:0/640803151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58700d1c70 0x7f58700c7bd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5864009850 tx=0x7f58640039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:47.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.529+0000 7f586d7fa640 1 -- 172.21.15.90:0/640803151 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586403f070 con 0x7f58700d1c70 2024-09-10T23:14:47.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.529+0000 7f586d7fa640 1 -- 172.21.15.90:0/640803151 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5864004890 con 0x7f58700d1c70 2024-09-10T23:14:47.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.529+0000 7f5876bf4640 1 -- 172.21.15.90:0/640803151 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58700a06a0 con 0x7f58700d1c70 2024-09-10T23:14:47.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.529+0000 7f586d7fa640 1 -- 172.21.15.90:0/640803151 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5864035030 con 0x7f58700d1c70 2024-09-10T23:14:47.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.529+0000 7f5876bf4640 1 -- 172.21.15.90:0/640803151 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58700c8390 con 0x7f58700d1c70 2024-09-10T23:14:47.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.530+0000 7f5876bf4640 1 -- 172.21.15.90:0/640803151 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58700d0f60 con 0x7f58700d1c70 2024-09-10T23:14:47.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.531+0000 7f586d7fa640 1 -- 172.21.15.90:0/640803151 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5864004ca0 con 0x7f58700d1c70 2024-09-10T23:14:47.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.531+0000 7f586d7fa640 1 --2- 172.21.15.90:0/640803151 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f585c077f70 0x7f585c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:47.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.531+0000 7f586d7fa640 1 -- 172.21.15.90:0/640803151 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f58640bafd0 con 0x7f58700d1c70 2024-09-10T23:14:47.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.531+0000 7f5874990640 1 --2- 172.21.15.90:0/640803151 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f585c077f70 0x7f585c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:47.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.532+0000 7f5874990640 1 --2- 172.21.15.90:0/640803151 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f585c077f70 0x7f585c07a430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5860005fd0 tx=0x7f586000a250 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:47.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.535+0000 7f586d7fa640 1 -- 172.21.15.90:0/640803151 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f58700c8110 con 0x7f58700d1c70 2024-09-10T23:14:47.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.705+0000 7f5876bf4640 1 -- 172.21.15.90:0/640803151 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f587009e570 con 0x7f585c077f70 2024-09-10T23:14:47.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.709+0000 7f586d7fa640 1 -- 172.21.15.90:0/640803151 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f587009e570 con 0x7f585c077f70 2024-09-10T23:14:47.712 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:47.714 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:14:47.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.712+0000 7f5876bf4640 1 -- 172.21.15.90:0/640803151 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f585c077f70 msgr2=0x7f585c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.712+0000 7f5876bf4640 1 --2- 172.21.15.90:0/640803151 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f585c077f70 0x7f585c07a430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5860005fd0 tx=0x7f586000a250 comp rx=0 tx=0).stop 2024-09-10T23:14:47.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.712+0000 7f5876bf4640 1 -- 172.21.15.90:0/640803151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58700d1c70 msgr2=0x7f58700c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.712+0000 7f5876bf4640 1 --2- 172.21.15.90:0/640803151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58700d1c70 0x7f58700c7bd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5864009850 tx=0x7f58640039e0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.712+0000 7f5876bf4640 1 -- 172.21.15.90:0/640803151 shutdown_connections 2024-09-10T23:14:47.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.712+0000 7f5876bf4640 1 --2- 172.21.15.90:0/640803151 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f585c077f70 0x7f585c07a430 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.712+0000 7f5876bf4640 1 --2- 172.21.15.90:0/640803151 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58700d2470 0x7f5870154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.712+0000 7f5876bf4640 1 --2- 172.21.15.90:0/640803151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58700d1c70 0x7f58700c7bd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.712+0000 7f5876bf4640 1 --2- 172.21.15.90:0/640803151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58700d0ab0 0x7f58700c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.712+0000 7f5876bf4640 1 -- 172.21.15.90:0/640803151 >> 172.21.15.90:0/640803151 conn(0x7f587009d2a0 msgr2=0x7f58700b6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:47.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.712+0000 7f5876bf4640 1 -- 172.21.15.90:0/640803151 shutdown_connections 2024-09-10T23:14:47.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.712+0000 7f5876bf4640 1 -- 172.21.15.90:0/640803151 wait complete. 2024-09-10T23:14:47.724 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-10T23:14:46.435450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219304,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755416,"statfs":{"total":773094113280,"available":772869545984,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002292"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550557+0000","last_change":"2024-09-10T23:14:36.157525+0000","last_active":"2024-09-10T23:14:38.550557+0000","last_peered":"2024-09-10T23:14:38.550557+0000","last_clean":"2024-09-10T23:14:38.550557+0000","last_became_active":"2024-09-10T23:14:36.157019+0000","last_became_peered":"2024-09-10T23:14:36.157019+0000","last_unstale":"2024-09-10T23:14:38.550557+0000","last_undegraded":"2024-09-10T23:14:38.550557+0000","last_fullsized":"2024-09-10T23:14:38.550557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:16.389050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150199+0000","last_change":"2024-09-10T23:14:36.152453+0000","last_active":"2024-09-10T23:14:37.150199+0000","last_peered":"2024-09-10T23:14:37.150199+0000","last_clean":"2024-09-10T23:14:37.150199+0000","last_became_active":"2024-09-10T23:14:36.152182+0000","last_became_peered":"2024-09-10T23:14:36.152182+0000","last_unstale":"2024-09-10T23:14:37.150199+0000","last_undegraded":"2024-09-10T23:14:37.150199+0000","last_fullsized":"2024-09-10T23:14:37.150199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:25.629769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550144+0000","last_change":"2024-09-10T23:14:36.148244+0000","last_active":"2024-09-10T23:14:38.550144+0000","last_peered":"2024-09-10T23:14:38.550144+0000","last_clean":"2024-09-10T23:14:38.550144+0000","last_became_active":"2024-09-10T23:14:36.147940+0000","last_became_peered":"2024-09-10T23:14:36.147940+0000","last_unstale":"2024-09-10T23:14:38.550144+0000","last_undegraded":"2024-09-10T23:14:38.550144+0000","last_fullsized":"2024-09-10T23:14:38.550144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:14.738749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141919+0000","last_change":"2024-09-10T23:14:36.147531+0000","last_active":"2024-09-10T23:14:37.141919+0000","last_peered":"2024-09-10T23:14:37.141919+0000","last_clean":"2024-09-10T23:14:37.141919+0000","last_became_active":"2024-09-10T23:14:36.146965+0000","last_became_peered":"2024-09-10T23:14:36.146965+0000","last_unstale":"2024-09-10T23:14:37.141919+0000","last_undegraded":"2024-09-10T23:14:37.141919+0000","last_fullsized":"2024-09-10T23:14:37.141919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:52.426211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550241+0000","last_change":"2024-09-10T23:14:36.153446+0000","last_active":"2024-09-10T23:14:38.550241+0000","last_peered":"2024-09-10T23:14:38.550241+0000","last_clean":"2024-09-10T23:14:38.550241+0000","last_became_active":"2024-09-10T23:14:36.152291+0000","last_became_peered":"2024-09-10T23:14:36.152291+0000","last_unstale":"2024-09-10T23:14:38.550241+0000","last_undegraded":"2024-09-10T23:14:38.550241+0000","last_fullsized":"2024-09-10T23:14:38.550241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:44.783941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140958+0000","last_change":"2024-09-10T23:14:36.154507+0000","last_active":"2024-09-10T23:14:37.140958+0000","last_peered":"2024-09-10T23:14:37.140958+0000","last_clean":"2024-09-10T23:14:37.140958+0000","last_became_active":"2024-09-10T23:14:36.154186+0000","last_became_peered":"2024-09-10T23:14:36.154186+0000","last_unstale":"2024-09-10T23:14:37.140958+0000","last_undegraded":"2024-09-10T23:14:37.140958+0000","last_fullsized":"2024-09-10T23:14:37.140958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:53.614015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549991+0000","last_change":"2024-09-10T23:14:36.156472+0000","last_active":"2024-09-10T23:14:38.549991+0000","last_peered":"2024-09-10T23:14:38.549991+0000","last_clean":"2024-09-10T23:14:38.549991+0000","last_became_active":"2024-09-10T23:14:36.156157+0000","last_became_peered":"2024-09-10T23:14:36.156157+0000","last_unstale":"2024-09-10T23:14:38.549991+0000","last_undegraded":"2024-09-10T23:14:38.549991+0000","last_fullsized":"2024-09-10T23:14:38.549991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:04.288672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139515+0000","last_change":"2024-09-10T23:14:36.152200+0000","last_active":"2024-09-10T23:14:37.139515+0000","last_peered":"2024-09-10T23:14:37.139515+0000","last_clean":"2024-09-10T23:14:37.139515+0000","last_became_active":"2024-09-10T23:14:36.151338+0000","last_became_peered":"2024-09-10T23:14:36.151338+0000","last_unstale":"2024-09-10T23:14:37.139515+0000","last_undegraded":"2024-09-10T23:14:37.139515+0000","last_fullsized":"2024-09-10T23:14:37.139515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:51.090210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550576+0000","last_change":"2024-09-10T23:14:36.154027+0000","last_active":"2024-09-10T23:14:38.550576+0000","last_peered":"2024-09-10T23:14:38.550576+0000","last_clean":"2024-09-10T23:14:38.550576+0000","last_became_active":"2024-09-10T23:14:36.153704+0000","last_became_peered":"2024-09-10T23:14:36.153704+0000","last_unstale":"2024-09-10T23:14:38.550576+0000","last_undegraded":"2024-09-10T23:14:38.550576+0000","last_fullsized":"2024-09-10T23:14:38.550576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:18.861499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152342+0000","last_change":"2024-09-10T23:14:36.159590+0000","last_active":"2024-09-10T23:14:37.152342+0000","last_peered":"2024-09-10T23:14:37.152342+0000","last_clean":"2024-09-10T23:14:37.152342+0000","last_became_active":"2024-09-10T23:14:36.159315+0000","last_became_peered":"2024-09-10T23:14:36.159315+0000","last_unstale":"2024-09-10T23:14:37.152342+0000","last_undegraded":"2024-09-10T23:14:37.152342+0000","last_fullsized":"2024-09-10T23:14:37.152342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:21:21.970379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152280+0000","last_change":"2024-09-10T23:14:36.152936+0000","last_active":"2024-09-10T23:14:37.152280+0000","last_peered":"2024-09-10T23:14:37.152280+0000","last_clean":"2024-09-10T23:14:37.152280+0000","last_became_active":"2024-09-10T23:14:36.152606+0000","last_became_peered":"2024-09-10T23:14:36.152606+0000","last_unstale":"2024-09-10T23:14:37.152280+0000","last_undegraded":"2024-09-10T23:14:37.152280+0000","last_fullsized":"2024-09-10T23:14:37.152280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:09.306575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141439+0000","last_change":"2024-09-10T23:14:36.153356+0000","last_active":"2024-09-10T23:14:37.141439+0000","last_peered":"2024-09-10T23:14:37.141439+0000","last_clean":"2024-09-10T23:14:37.141439+0000","last_became_active":"2024-09-10T23:14:36.153096+0000","last_became_peered":"2024-09-10T23:14:36.153096+0000","last_unstale":"2024-09-10T23:14:37.141439+0000","last_undegraded":"2024-09-10T23:14:37.141439+0000","last_fullsized":"2024-09-10T23:14:37.141439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:27.153088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139741+0000","last_change":"2024-09-10T23:14:36.154715+0000","last_active":"2024-09-10T23:14:37.139741+0000","last_peered":"2024-09-10T23:14:37.139741+0000","last_clean":"2024-09-10T23:14:37.139741+0000","last_became_active":"2024-09-10T23:14:36.154463+0000","last_became_peered":"2024-09-10T23:14:36.154463+0000","last_unstale":"2024-09-10T23:14:37.139741+0000","last_undegraded":"2024-09-10T23:14:37.139741+0000","last_fullsized":"2024-09-10T23:14:37.139741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:12.246804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549988+0000","last_change":"2024-09-10T23:14:36.150886+0000","last_active":"2024-09-10T23:14:38.549988+0000","last_peered":"2024-09-10T23:14:38.549988+0000","last_clean":"2024-09-10T23:14:38.549988+0000","last_became_active":"2024-09-10T23:14:36.150523+0000","last_became_peered":"2024-09-10T23:14:36.150523+0000","last_unstale":"2024-09-10T23:14:38.549988+0000","last_undegraded":"2024-09-10T23:14:38.549988+0000","last_fullsized":"2024-09-10T23:14:38.549988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:13.596941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.149903+0000","last_change":"2024-09-10T23:14:36.147483+0000","last_active":"2024-09-10T23:14:37.149903+0000","last_peered":"2024-09-10T23:14:37.149903+0000","last_clean":"2024-09-10T23:14:37.149903+0000","last_became_active":"2024-09-10T23:14:36.147242+0000","last_became_peered":"2024-09-10T23:14:36.147242+0000","last_unstale":"2024-09-10T23:14:37.149903+0000","last_undegraded":"2024-09-10T23:14:37.149903+0000","last_fullsized":"2024-09-10T23:14:37.149903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:54.426629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140650+0000","last_change":"2024-09-10T23:14:36.151723+0000","last_active":"2024-09-10T23:14:37.140650+0000","last_peered":"2024-09-10T23:14:37.140650+0000","last_clean":"2024-09-10T23:14:37.140650+0000","last_became_active":"2024-09-10T23:14:36.151442+0000","last_became_peered":"2024-09-10T23:14:36.151442+0000","last_unstale":"2024-09-10T23:14:37.140650+0000","last_undegraded":"2024-09-10T23:14:37.140650+0000","last_fullsized":"2024-09-10T23:14:37.140650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:17.368639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141988+0000","last_change":"2024-09-10T23:14:36.153862+0000","last_active":"2024-09-10T23:14:37.141988+0000","last_peered":"2024-09-10T23:14:37.141988+0000","last_clean":"2024-09-10T23:14:37.141988+0000","last_became_active":"2024-09-10T23:14:36.152179+0000","last_became_peered":"2024-09-10T23:14:36.152179+0000","last_unstale":"2024-09-10T23:14:37.141988+0000","last_undegraded":"2024-09-10T23:14:37.141988+0000","last_fullsized":"2024-09-10T23:14:37.141988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:33:53.930716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549831+0000","last_change":"2024-09-10T23:14:36.158706+0000","last_active":"2024-09-10T23:14:38.549831+0000","last_peered":"2024-09-10T23:14:38.549831+0000","last_clean":"2024-09-10T23:14:38.549831+0000","last_became_active":"2024-09-10T23:14:36.158420+0000","last_became_peered":"2024-09-10T23:14:36.158420+0000","last_unstale":"2024-09-10T23:14:38.549831+0000","last_undegraded":"2024-09-10T23:14:38.549831+0000","last_fullsized":"2024-09-10T23:14:38.549831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:08.892988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550685+0000","last_change":"2024-09-10T23:14:36.152726+0000","last_active":"2024-09-10T23:14:38.550685+0000","last_peered":"2024-09-10T23:14:38.550685+0000","last_clean":"2024-09-10T23:14:38.550685+0000","last_became_active":"2024-09-10T23:14:36.152374+0000","last_became_peered":"2024-09-10T23:14:36.152374+0000","last_unstale":"2024-09-10T23:14:38.550685+0000","last_undegraded":"2024-09-10T23:14:38.550685+0000","last_fullsized":"2024-09-10T23:14:38.550685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:12.992438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152157+0000","last_change":"2024-09-10T23:14:36.150916+0000","last_active":"2024-09-10T23:14:37.152157+0000","last_peered":"2024-09-10T23:14:37.152157+0000","last_clean":"2024-09-10T23:14:37.152157+0000","last_became_active":"2024-09-10T23:14:36.150604+0000","last_became_peered":"2024-09-10T23:14:36.150604+0000","last_unstale":"2024-09-10T23:14:37.152157+0000","last_undegraded":"2024-09-10T23:14:37.152157+0000","last_fullsized":"2024-09-10T23:14:37.152157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:54.426629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550184+0000","last_change":"2024-09-10T23:14:36.157805+0000","last_active":"2024-09-10T23:14:38.550184+0000","last_peered":"2024-09-10T23:14:38.550184+0000","last_clean":"2024-09-10T23:14:38.550184+0000","last_became_active":"2024-09-10T23:14:36.157536+0000","last_became_peered":"2024-09-10T23:14:36.157536+0000","last_unstale":"2024-09-10T23:14:38.550184+0000","last_undegraded":"2024-09-10T23:14:38.550184+0000","last_fullsized":"2024-09-10T23:14:38.550184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:40.133768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141173+0000","last_change":"2024-09-10T23:14:36.152281+0000","last_active":"2024-09-10T23:14:37.141173+0000","last_peered":"2024-09-10T23:14:37.141173+0000","last_clean":"2024-09-10T23:14:37.141173+0000","last_became_active":"2024-09-10T23:14:36.151529+0000","last_became_peered":"2024-09-10T23:14:36.151529+0000","last_unstale":"2024-09-10T23:14:37.141173+0000","last_undegraded":"2024-09-10T23:14:37.141173+0000","last_fullsized":"2024-09-10T23:14:37.141173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:11.115291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139685+0000","last_change":"2024-09-10T23:14:36.147303+0000","last_active":"2024-09-10T23:14:37.139685+0000","last_peered":"2024-09-10T23:14:37.139685+0000","last_clean":"2024-09-10T23:14:37.139685+0000","last_became_active":"2024-09-10T23:14:36.147060+0000","last_became_peered":"2024-09-10T23:14:36.147060+0000","last_unstale":"2024-09-10T23:14:37.139685+0000","last_undegraded":"2024-09-10T23:14:37.139685+0000","last_fullsized":"2024-09-10T23:14:37.139685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:09.306575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140708+0000","last_change":"2024-09-10T23:14:36.145720+0000","last_active":"2024-09-10T23:14:37.140708+0000","last_peered":"2024-09-10T23:14:37.140708+0000","last_clean":"2024-09-10T23:14:37.140708+0000","last_became_active":"2024-09-10T23:14:36.145429+0000","last_became_peered":"2024-09-10T23:14:36.145429+0000","last_unstale":"2024-09-10T23:14:37.140708+0000","last_undegraded":"2024-09-10T23:14:37.140708+0000","last_fullsized":"2024-09-10T23:14:37.140708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:25.629769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139719+0000","last_change":"2024-09-10T23:14:36.146763+0000","last_active":"2024-09-10T23:14:37.139719+0000","last_peered":"2024-09-10T23:14:37.139719+0000","last_clean":"2024-09-10T23:14:37.139719+0000","last_became_active":"2024-09-10T23:14:36.146527+0000","last_became_peered":"2024-09-10T23:14:36.146527+0000","last_unstale":"2024-09-10T23:14:37.139719+0000","last_undegraded":"2024-09-10T23:14:37.139719+0000","last_fullsized":"2024-09-10T23:14:37.139719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:17.368639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152398+0000","last_change":"2024-09-10T23:14:36.156168+0000","last_active":"2024-09-10T23:14:37.152398+0000","last_peered":"2024-09-10T23:14:37.152398+0000","last_clean":"2024-09-10T23:14:37.152398+0000","last_became_active":"2024-09-10T23:14:36.155916+0000","last_became_peered":"2024-09-10T23:14:36.155916+0000","last_unstale":"2024-09-10T23:14:37.152398+0000","last_undegraded":"2024-09-10T23:14:37.152398+0000","last_fullsized":"2024-09-10T23:14:37.152398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:25.629769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150143+0000","last_change":"2024-09-10T23:14:36.146397+0000","last_active":"2024-09-10T23:14:37.150143+0000","last_peered":"2024-09-10T23:14:37.150143+0000","last_clean":"2024-09-10T23:14:37.150143+0000","last_became_active":"2024-09-10T23:14:36.146152+0000","last_became_peered":"2024-09-10T23:14:36.146152+0000","last_unstale":"2024-09-10T23:14:37.150143+0000","last_undegraded":"2024-09-10T23:14:37.150143+0000","last_fullsized":"2024-09-10T23:14:37.150143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:17.368639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139875+0000","last_change":"2024-09-10T23:14:36.146125+0000","last_active":"2024-09-10T23:14:37.139875+0000","last_peered":"2024-09-10T23:14:37.139875+0000","last_clean":"2024-09-10T23:14:37.139875+0000","last_became_active":"2024-09-10T23:14:36.145863+0000","last_became_peered":"2024-09-10T23:14:36.145863+0000","last_unstale":"2024-09-10T23:14:37.139875+0000","last_undegraded":"2024-09-10T23:14:37.139875+0000","last_fullsized":"2024-09-10T23:14:37.139875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:25.629769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550206+0000","last_change":"2024-09-10T23:14:36.152030+0000","last_active":"2024-09-10T23:14:38.550206+0000","last_peered":"2024-09-10T23:14:38.550206+0000","last_clean":"2024-09-10T23:14:38.550206+0000","last_became_active":"2024-09-10T23:14:36.151377+0000","last_became_peered":"2024-09-10T23:14:36.151377+0000","last_unstale":"2024-09-10T23:14:38.550206+0000","last_undegraded":"2024-09-10T23:14:38.550206+0000","last_fullsized":"2024-09-10T23:14:38.550206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:43.028083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141416+0000","last_change":"2024-09-10T23:14:36.148781+0000","last_active":"2024-09-10T23:14:37.141416+0000","last_peered":"2024-09-10T23:14:37.141416+0000","last_clean":"2024-09-10T23:14:37.141416+0000","last_became_active":"2024-09-10T23:14:36.148514+0000","last_became_peered":"2024-09-10T23:14:36.148514+0000","last_unstale":"2024-09-10T23:14:37.141416+0000","last_undegraded":"2024-09-10T23:14:37.141416+0000","last_fullsized":"2024-09-10T23:14:37.141416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:04.288672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549603+0000","last_change":"2024-09-10T23:14:36.142412+0000","last_active":"2024-09-10T23:14:38.549603+0000","last_peered":"2024-09-10T23:14:38.549603+0000","last_clean":"2024-09-10T23:14:38.549603+0000","last_became_active":"2024-09-10T23:14:36.142104+0000","last_became_peered":"2024-09-10T23:14:36.142104+0000","last_unstale":"2024-09-10T23:14:38.549603+0000","last_undegraded":"2024-09-10T23:14:38.549603+0000","last_fullsized":"2024-09-10T23:14:38.549603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:19.143333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152290+0000","last_change":"2024-09-10T23:14:36.155544+0000","last_active":"2024-09-10T23:14:37.152290+0000","last_peered":"2024-09-10T23:14:37.152290+0000","last_clean":"2024-09-10T23:14:37.152290+0000","last_became_active":"2024-09-10T23:14:36.155266+0000","last_became_peered":"2024-09-10T23:14:36.155266+0000","last_unstale":"2024-09-10T23:14:37.152290+0000","last_undegraded":"2024-09-10T23:14:37.152290+0000","last_fullsized":"2024-09-10T23:14:37.152290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:11.830037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141010+0000","last_change":"2024-09-10T23:14:36.151970+0000","last_active":"2024-09-10T23:14:37.141010+0000","last_peered":"2024-09-10T23:14:37.141010+0000","last_clean":"2024-09-10T23:14:37.141010+0000","last_became_active":"2024-09-10T23:14:36.151677+0000","last_became_peered":"2024-09-10T23:14:36.151677+0000","last_unstale":"2024-09-10T23:14:37.141010+0000","last_undegraded":"2024-09-10T23:14:37.141010+0000","last_fullsized":"2024-09-10T23:14:37.141010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:49.850113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139903+0000","last_change":"2024-09-10T23:14:35.127806+0000","last_active":"2024-09-10T23:14:37.139903+0000","last_peered":"2024-09-10T23:14:37.139903+0000","last_clean":"2024-09-10T23:14:37.139903+0000","last_became_active":"2024-09-10T23:14:35.127548+0000","last_became_peered":"2024-09-10T23:14:35.127548+0000","last_unstale":"2024-09-10T23:14:37.139903+0000","last_undegraded":"2024-09-10T23:14:37.139903+0000","last_fullsized":"2024-09-10T23:14:37.139903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:00.433782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550342+0000","last_change":"2024-09-10T23:14:36.151022+0000","last_active":"2024-09-10T23:14:38.550342+0000","last_peered":"2024-09-10T23:14:38.550342+0000","last_clean":"2024-09-10T23:14:38.550342+0000","last_became_active":"2024-09-10T23:14:36.150753+0000","last_became_peered":"2024-09-10T23:14:36.150753+0000","last_unstale":"2024-09-10T23:14:38.550342+0000","last_undegraded":"2024-09-10T23:14:38.550342+0000","last_fullsized":"2024-09-10T23:14:38.550342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:49.125136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.151995+0000","last_change":"2024-09-10T23:14:35.125689+0000","last_active":"2024-09-10T23:14:37.151995+0000","last_peered":"2024-09-10T23:14:37.151995+0000","last_clean":"2024-09-10T23:14:37.151995+0000","last_became_active":"2024-09-10T23:14:35.124148+0000","last_became_peered":"2024-09-10T23:14:35.124148+0000","last_unstale":"2024-09-10T23:14:37.151995+0000","last_undegraded":"2024-09-10T23:14:37.151995+0000","last_fullsized":"2024-09-10T23:14:37.151995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:26.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139928+0000","last_change":"2024-09-10T23:14:35.130875+0000","last_active":"2024-09-10T23:14:37.139928+0000","last_peered":"2024-09-10T23:14:37.139928+0000","last_clean":"2024-09-10T23:14:37.139928+0000","last_became_active":"2024-09-10T23:14:35.130552+0000","last_became_peered":"2024-09-10T23:14:35.130552+0000","last_unstale":"2024-09-10T23:14:37.139928+0000","last_undegraded":"2024-09-10T23:14:37.139928+0000","last_fullsized":"2024-09-10T23:14:37.139928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139600+0000","last_change":"2024-09-10T23:14:36.153264+0000","last_active":"2024-09-10T23:14:37.139600+0000","last_peered":"2024-09-10T23:14:37.139600+0000","last_clean":"2024-09-10T23:14:37.139600+0000","last_became_active":"2024-09-10T23:14:36.153009+0000","last_became_peered":"2024-09-10T23:14:36.153009+0000","last_unstale":"2024-09-10T23:14:37.139600+0000","last_undegraded":"2024-09-10T23:14:37.139600+0000","last_fullsized":"2024-09-10T23:14:37.139600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:54.426629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140838+0000","last_change":"2024-09-10T23:14:35.123317+0000","last_active":"2024-09-10T23:14:37.140838+0000","last_peered":"2024-09-10T23:14:37.140838+0000","last_clean":"2024-09-10T23:14:37.140838+0000","last_became_active":"2024-09-10T23:14:35.123043+0000","last_became_peered":"2024-09-10T23:14:35.123043+0000","last_unstale":"2024-09-10T23:14:37.140838+0000","last_undegraded":"2024-09-10T23:14:37.140838+0000","last_fullsized":"2024-09-10T23:14:37.140838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:44.244654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.149909+0000","last_change":"2024-09-10T23:14:36.149488+0000","last_active":"2024-09-10T23:14:37.149909+0000","last_peered":"2024-09-10T23:14:37.149909+0000","last_clean":"2024-09-10T23:14:37.149909+0000","last_became_active":"2024-09-10T23:14:36.149221+0000","last_became_peered":"2024-09-10T23:14:36.149221+0000","last_unstale":"2024-09-10T23:14:37.149909+0000","last_undegraded":"2024-09-10T23:14:37.149909+0000","last_fullsized":"2024-09-10T23:14:37.149909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:55.476145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152279+0000","last_change":"2024-09-10T23:14:35.129118+0000","last_active":"2024-09-10T23:14:37.152279+0000","last_peered":"2024-09-10T23:14:37.152279+0000","last_clean":"2024-09-10T23:14:37.152279+0000","last_became_active":"2024-09-10T23:14:35.128858+0000","last_became_peered":"2024-09-10T23:14:35.128858+0000","last_unstale":"2024-09-10T23:14:37.152279+0000","last_undegraded":"2024-09-10T23:14:37.152279+0000","last_fullsized":"2024-09-10T23:14:37.152279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:00.727658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141203+0000","last_change":"2024-09-10T23:14:36.152153+0000","last_active":"2024-09-10T23:14:37.141203+0000","last_peered":"2024-09-10T23:14:37.141203+0000","last_clean":"2024-09-10T23:14:37.141203+0000","last_became_active":"2024-09-10T23:14:36.151862+0000","last_became_peered":"2024-09-10T23:14:36.151862+0000","last_unstale":"2024-09-10T23:14:37.141203+0000","last_undegraded":"2024-09-10T23:14:37.141203+0000","last_fullsized":"2024-09-10T23:14:37.141203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:28.160849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141363+0000","last_change":"2024-09-10T23:14:35.130807+0000","last_active":"2024-09-10T23:14:37.141363+0000","last_peered":"2024-09-10T23:14:37.141363+0000","last_clean":"2024-09-10T23:14:37.141363+0000","last_became_active":"2024-09-10T23:14:35.130541+0000","last_became_peered":"2024-09-10T23:14:35.130541+0000","last_unstale":"2024-09-10T23:14:37.141363+0000","last_undegraded":"2024-09-10T23:14:37.141363+0000","last_fullsized":"2024-09-10T23:14:37.141363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:48.848197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550023+0000","last_change":"2024-09-10T23:14:36.149079+0000","last_active":"2024-09-10T23:14:38.550023+0000","last_peered":"2024-09-10T23:14:38.550023+0000","last_clean":"2024-09-10T23:14:38.550023+0000","last_became_active":"2024-09-10T23:14:36.148726+0000","last_became_peered":"2024-09-10T23:14:36.148726+0000","last_unstale":"2024-09-10T23:14:38.550023+0000","last_undegraded":"2024-09-10T23:14:38.550023+0000","last_fullsized":"2024-09-10T23:14:38.550023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:52.012404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150094+0000","last_change":"2024-09-10T23:14:35.122724+0000","last_active":"2024-09-10T23:14:37.150094+0000","last_peered":"2024-09-10T23:14:37.150094+0000","last_clean":"2024-09-10T23:14:37.150094+0000","last_became_active":"2024-09-10T23:14:35.119910+0000","last_became_peered":"2024-09-10T23:14:35.119910+0000","last_unstale":"2024-09-10T23:14:37.150094+0000","last_undegraded":"2024-09-10T23:14:37.150094+0000","last_fullsized":"2024-09-10T23:14:37.150094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:52.598287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141829+0000","last_change":"2024-09-10T23:14:36.155881+0000","last_active":"2024-09-10T23:14:37.141829+0000","last_peered":"2024-09-10T23:14:37.141829+0000","last_clean":"2024-09-10T23:14:37.141829+0000","last_became_active":"2024-09-10T23:14:36.155598+0000","last_became_peered":"2024-09-10T23:14:36.155598+0000","last_unstale":"2024-09-10T23:14:37.141829+0000","last_undegraded":"2024-09-10T23:14:37.141829+0000","last_fullsized":"2024-09-10T23:14:37.141829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:19.143333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152332+0000","last_change":"2024-09-10T23:14:35.127319+0000","last_active":"2024-09-10T23:14:37.152332+0000","last_peered":"2024-09-10T23:14:37.152332+0000","last_clean":"2024-09-10T23:14:37.152332+0000","last_became_active":"2024-09-10T23:14:35.127042+0000","last_became_peered":"2024-09-10T23:14:35.127042+0000","last_unstale":"2024-09-10T23:14:37.152332+0000","last_undegraded":"2024-09-10T23:14:37.152332+0000","last_fullsized":"2024-09-10T23:14:37.152332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:48.848197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550250+0000","last_change":"2024-09-10T23:14:36.150360+0000","last_active":"2024-09-10T23:14:38.550250+0000","last_peered":"2024-09-10T23:14:38.550250+0000","last_clean":"2024-09-10T23:14:38.550250+0000","last_became_active":"2024-09-10T23:14:36.150031+0000","last_became_peered":"2024-09-10T23:14:36.150031+0000","last_unstale":"2024-09-10T23:14:38.550250+0000","last_undegraded":"2024-09-10T23:14:38.550250+0000","last_fullsized":"2024-09-10T23:14:38.550250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:52.426211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550432+0000","last_change":"2024-09-10T23:14:35.123801+0000","last_active":"2024-09-10T23:14:38.550432+0000","last_peered":"2024-09-10T23:14:38.550432+0000","last_clean":"2024-09-10T23:14:38.550432+0000","last_became_active":"2024-09-10T23:14:35.123332+0000","last_became_peered":"2024-09-10T23:14:35.123332+0000","last_unstale":"2024-09-10T23:14:38.550432+0000","last_undegraded":"2024-09-10T23:14:38.550432+0000","last_fullsized":"2024-09-10T23:14:38.550432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:57.857780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550087+0000","last_change":"2024-09-10T23:14:36.153086+0000","last_active":"2024-09-10T23:14:38.550087+0000","last_peered":"2024-09-10T23:14:38.550087+0000","last_clean":"2024-09-10T23:14:38.550087+0000","last_became_active":"2024-09-10T23:14:36.152843+0000","last_became_peered":"2024-09-10T23:14:36.152843+0000","last_unstale":"2024-09-10T23:14:38.550087+0000","last_undegraded":"2024-09-10T23:14:38.550087+0000","last_fullsized":"2024-09-10T23:14:38.550087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:59.216035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141525+0000","last_change":"2024-09-10T23:14:35.130442+0000","last_active":"2024-09-10T23:14:37.141525+0000","last_peered":"2024-09-10T23:14:37.141525+0000","last_clean":"2024-09-10T23:14:37.141525+0000","last_became_active":"2024-09-10T23:14:35.130131+0000","last_became_peered":"2024-09-10T23:14:35.130131+0000","last_unstale":"2024-09-10T23:14:37.141525+0000","last_undegraded":"2024-09-10T23:14:37.141525+0000","last_fullsized":"2024-09-10T23:14:37.141525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:26.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550333+0000","last_change":"2024-09-10T23:14:36.153529+0000","last_active":"2024-09-10T23:14:38.550333+0000","last_peered":"2024-09-10T23:14:38.550333+0000","last_clean":"2024-09-10T23:14:38.550333+0000","last_became_active":"2024-09-10T23:14:36.153131+0000","last_became_peered":"2024-09-10T23:14:36.153131+0000","last_unstale":"2024-09-10T23:14:38.550333+0000","last_undegraded":"2024-09-10T23:14:38.550333+0000","last_fullsized":"2024-09-10T23:14:38.550333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:33:53.930716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152026+0000","last_change":"2024-09-10T23:14:35.129215+0000","last_active":"2024-09-10T23:14:37.152026+0000","last_peered":"2024-09-10T23:14:37.152026+0000","last_clean":"2024-09-10T23:14:37.152026+0000","last_became_active":"2024-09-10T23:14:35.128170+0000","last_became_peered":"2024-09-10T23:14:35.128170+0000","last_unstale":"2024-09-10T23:14:37.152026+0000","last_undegraded":"2024-09-10T23:14:37.152026+0000","last_fullsized":"2024-09-10T23:14:37.152026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:44.244654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152200+0000","last_change":"2024-09-10T23:14:36.154580+0000","last_active":"2024-09-10T23:14:37.152200+0000","last_peered":"2024-09-10T23:14:37.152200+0000","last_clean":"2024-09-10T23:14:37.152200+0000","last_became_active":"2024-09-10T23:14:36.154172+0000","last_became_peered":"2024-09-10T23:14:36.154172+0000","last_unstale":"2024-09-10T23:14:37.152200+0000","last_undegraded":"2024-09-10T23:14:37.152200+0000","last_fullsized":"2024-09-10T23:14:37.152200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:12.246804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549517+0000","last_change":"2024-09-10T23:14:35.127072+0000","last_active":"2024-09-10T23:14:38.549517+0000","last_peered":"2024-09-10T23:14:38.549517+0000","last_clean":"2024-09-10T23:14:38.549517+0000","last_became_active":"2024-09-10T23:14:35.126776+0000","last_became_peered":"2024-09-10T23:14:35.126776+0000","last_unstale":"2024-09-10T23:14:38.549517+0000","last_undegraded":"2024-09-10T23:14:38.549517+0000","last_fullsized":"2024-09-10T23:14:38.549517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:50.458204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550012+0000","last_change":"2024-09-10T23:14:36.150674+0000","last_active":"2024-09-10T23:14:38.550012+0000","last_peered":"2024-09-10T23:14:38.550012+0000","last_clean":"2024-09-10T23:14:38.550012+0000","last_became_active":"2024-09-10T23:14:36.149916+0000","last_became_peered":"2024-09-10T23:14:36.149916+0000","last_unstale":"2024-09-10T23:14:38.550012+0000","last_undegraded":"2024-09-10T23:14:38.550012+0000","last_fullsized":"2024-09-10T23:14:38.550012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:28.160849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141391+0000","last_change":"2024-09-10T23:14:35.130472+0000","last_active":"2024-09-10T23:14:37.141391+0000","last_peered":"2024-09-10T23:14:37.141391+0000","last_clean":"2024-09-10T23:14:37.141391+0000","last_became_active":"2024-09-10T23:14:35.130164+0000","last_became_peered":"2024-09-10T23:14:35.130164+0000","last_unstale":"2024-09-10T23:14:37.141391+0000","last_undegraded":"2024-09-10T23:14:37.141391+0000","last_fullsized":"2024-09-10T23:14:37.141391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:37.291436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550513+0000","last_change":"2024-09-10T23:14:36.153260+0000","last_active":"2024-09-10T23:14:38.550513+0000","last_peered":"2024-09-10T23:14:38.550513+0000","last_clean":"2024-09-10T23:14:38.550513+0000","last_became_active":"2024-09-10T23:14:36.152964+0000","last_became_peered":"2024-09-10T23:14:36.152964+0000","last_unstale":"2024-09-10T23:14:38.550513+0000","last_undegraded":"2024-09-10T23:14:38.550513+0000","last_fullsized":"2024-09-10T23:14:38.550513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:08.022145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549956+0000","last_change":"2024-09-10T23:14:35.130891+0000","last_active":"2024-09-10T23:14:38.549956+0000","last_peered":"2024-09-10T23:14:38.549956+0000","last_clean":"2024-09-10T23:14:38.549956+0000","last_became_active":"2024-09-10T23:14:35.130654+0000","last_became_peered":"2024-09-10T23:14:35.130654+0000","last_unstale":"2024-09-10T23:14:38.549956+0000","last_undegraded":"2024-09-10T23:14:38.549956+0000","last_fullsized":"2024-09-10T23:14:38.549956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:37.763702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550813+0000","last_change":"2024-09-10T23:14:36.152970+0000","last_active":"2024-09-10T23:14:38.550813+0000","last_peered":"2024-09-10T23:14:38.550813+0000","last_clean":"2024-09-10T23:14:38.550813+0000","last_became_active":"2024-09-10T23:14:36.152669+0000","last_became_peered":"2024-09-10T23:14:36.152669+0000","last_unstale":"2024-09-10T23:14:38.550813+0000","last_undegraded":"2024-09-10T23:14:38.550813+0000","last_fullsized":"2024-09-10T23:14:38.550813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:26.515458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150214+0000","last_change":"2024-09-10T23:14:35.121691+0000","last_active":"2024-09-10T23:14:37.150214+0000","last_peered":"2024-09-10T23:14:37.150214+0000","last_clean":"2024-09-10T23:14:37.150214+0000","last_became_active":"2024-09-10T23:14:35.121391+0000","last_became_peered":"2024-09-10T23:14:35.121391+0000","last_unstale":"2024-09-10T23:14:37.150214+0000","last_undegraded":"2024-09-10T23:14:37.150214+0000","last_fullsized":"2024-09-10T23:14:37.150214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:10.992208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.142206+0000","last_change":"2024-09-10T23:14:36.145872+0000","last_active":"2024-09-10T23:14:37.142206+0000","last_peered":"2024-09-10T23:14:37.142206+0000","last_clean":"2024-09-10T23:14:37.142206+0000","last_became_active":"2024-09-10T23:14:36.145477+0000","last_became_peered":"2024-09-10T23:14:36.145477+0000","last_unstale":"2024-09-10T23:14:37.142206+0000","last_undegraded":"2024-09-10T23:14:37.142206+0000","last_fullsized":"2024-09-10T23:14:37.142206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:16.389050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549809+0000","last_change":"2024-09-10T23:14:35.126188+0000","last_active":"2024-09-10T23:14:38.549809+0000","last_peered":"2024-09-10T23:14:38.549809+0000","last_clean":"2024-09-10T23:14:38.549809+0000","last_became_active":"2024-09-10T23:14:35.125868+0000","last_became_peered":"2024-09-10T23:14:35.125868+0000","last_unstale":"2024-09-10T23:14:38.549809+0000","last_undegraded":"2024-09-10T23:14:38.549809+0000","last_fullsized":"2024-09-10T23:14:38.549809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:40.440663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550457+0000","last_change":"2024-09-10T23:14:36.158261+0000","last_active":"2024-09-10T23:14:38.550457+0000","last_peered":"2024-09-10T23:14:38.550457+0000","last_clean":"2024-09-10T23:14:38.550457+0000","last_became_active":"2024-09-10T23:14:36.157994+0000","last_became_peered":"2024-09-10T23:14:36.157994+0000","last_unstale":"2024-09-10T23:14:38.550457+0000","last_undegraded":"2024-09-10T23:14:38.550457+0000","last_fullsized":"2024-09-10T23:14:38.550457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:42.507579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550004+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:14:38.550004+0000","last_peered":"2024-09-10T23:14:38.550004+0000","last_clean":"2024-09-10T23:14:38.550004+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:14:38.550004+0000","last_undegraded":"2024-09-10T23:14:38.550004+0000","last_fullsized":"2024-09-10T23:14:38.550004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140725+0000","last_change":"2024-09-10T23:14:35.126656+0000","last_active":"2024-09-10T23:14:37.140725+0000","last_peered":"2024-09-10T23:14:37.140725+0000","last_clean":"2024-09-10T23:14:37.140725+0000","last_became_active":"2024-09-10T23:14:35.126289+0000","last_became_peered":"2024-09-10T23:14:35.126289+0000","last_unstale":"2024-09-10T23:14:37.140725+0000","last_undegraded":"2024-09-10T23:14:37.140725+0000","last_fullsized":"2024-09-10T23:14:37.140725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139727+0000","last_change":"2024-09-10T23:14:36.151908+0000","last_active":"2024-09-10T23:14:37.139727+0000","last_peered":"2024-09-10T23:14:37.139727+0000","last_clean":"2024-09-10T23:14:37.139727+0000","last_became_active":"2024-09-10T23:14:36.151632+0000","last_became_peered":"2024-09-10T23:14:36.151632+0000","last_unstale":"2024-09-10T23:14:37.139727+0000","last_undegraded":"2024-09-10T23:14:37.139727+0000","last_fullsized":"2024-09-10T23:14:37.139727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:11.830037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549866+0000","last_change":"2024-09-10T23:14:35.132667+0000","last_active":"2024-09-10T23:14:38.549866+0000","last_peered":"2024-09-10T23:14:38.549866+0000","last_clean":"2024-09-10T23:14:38.549866+0000","last_became_active":"2024-09-10T23:14:35.132330+0000","last_became_peered":"2024-09-10T23:14:35.132330+0000","last_unstale":"2024-09-10T23:14:38.549866+0000","last_undegraded":"2024-09-10T23:14:38.549866+0000","last_fullsized":"2024-09-10T23:14:38.549866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:52.598287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549820+0000","last_change":"2024-09-10T23:14:36.149640+0000","last_active":"2024-09-10T23:14:38.549820+0000","last_peered":"2024-09-10T23:14:38.549820+0000","last_clean":"2024-09-10T23:14:38.549820+0000","last_became_active":"2024-09-10T23:14:36.148907+0000","last_became_peered":"2024-09-10T23:14:36.148907+0000","last_unstale":"2024-09-10T23:14:38.549820+0000","last_undegraded":"2024-09-10T23:14:38.549820+0000","last_fullsized":"2024-09-10T23:14:38.549820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:02.988430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549624+0000","last_change":"2024-09-10T23:14:35.130254+0000","last_active":"2024-09-10T23:14:38.549624+0000","last_peered":"2024-09-10T23:14:38.549624+0000","last_clean":"2024-09-10T23:14:38.549624+0000","last_became_active":"2024-09-10T23:14:35.129994+0000","last_became_peered":"2024-09-10T23:14:35.129994+0000","last_unstale":"2024-09-10T23:14:38.549624+0000","last_undegraded":"2024-09-10T23:14:38.549624+0000","last_fullsized":"2024-09-10T23:14:38.549624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.149929+0000","last_change":"2024-09-10T23:14:36.147135+0000","last_active":"2024-09-10T23:14:37.149929+0000","last_peered":"2024-09-10T23:14:37.149929+0000","last_clean":"2024-09-10T23:14:37.149929+0000","last_became_active":"2024-09-10T23:14:36.146791+0000","last_became_peered":"2024-09-10T23:14:36.146791+0000","last_unstale":"2024-09-10T23:14:37.149929+0000","last_undegraded":"2024-09-10T23:14:37.149929+0000","last_fullsized":"2024-09-10T23:14:37.149929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:20.756119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141573+0000","last_change":"2024-09-10T23:14:35.116348+0000","last_active":"2024-09-10T23:14:37.141573+0000","last_peered":"2024-09-10T23:14:37.141573+0000","last_clean":"2024-09-10T23:14:37.141573+0000","last_became_active":"2024-09-10T23:14:35.116063+0000","last_became_peered":"2024-09-10T23:14:35.116063+0000","last_unstale":"2024-09-10T23:14:37.141573+0000","last_undegraded":"2024-09-10T23:14:37.141573+0000","last_fullsized":"2024-09-10T23:14:37.141573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:52.598287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141784+0000","last_change":"2024-09-10T23:14:36.154237+0000","last_active":"2024-09-10T23:14:37.141784+0000","last_peered":"2024-09-10T23:14:37.141784+0000","last_clean":"2024-09-10T23:14:37.141784+0000","last_became_active":"2024-09-10T23:14:36.153966+0000","last_became_peered":"2024-09-10T23:14:36.153966+0000","last_unstale":"2024-09-10T23:14:37.141784+0000","last_undegraded":"2024-09-10T23:14:37.141784+0000","last_fullsized":"2024-09-10T23:14:37.141784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:36.806040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150055+0000","last_change":"2024-09-10T23:14:35.123920+0000","last_active":"2024-09-10T23:14:37.150055+0000","last_peered":"2024-09-10T23:14:37.150055+0000","last_clean":"2024-09-10T23:14:37.150055+0000","last_became_active":"2024-09-10T23:14:35.123644+0000","last_became_peered":"2024-09-10T23:14:35.123644+0000","last_unstale":"2024-09-10T23:14:37.150055+0000","last_undegraded":"2024-09-10T23:14:37.150055+0000","last_fullsized":"2024-09-10T23:14:37.150055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:26.151172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.142073+0000","last_change":"2024-09-10T23:14:36.145847+0000","last_active":"2024-09-10T23:14:37.142073+0000","last_peered":"2024-09-10T23:14:37.142073+0000","last_clean":"2024-09-10T23:14:37.142073+0000","last_became_active":"2024-09-10T23:14:36.145505+0000","last_became_peered":"2024-09-10T23:14:36.145505+0000","last_unstale":"2024-09-10T23:14:37.142073+0000","last_undegraded":"2024-09-10T23:14:37.142073+0000","last_fullsized":"2024-09-10T23:14:37.142073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:42.507579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550650+0000","last_change":"2024-09-10T23:14:35.133489+0000","last_active":"2024-09-10T23:14:38.550650+0000","last_peered":"2024-09-10T23:14:38.550650+0000","last_clean":"2024-09-10T23:14:38.550650+0000","last_became_active":"2024-09-10T23:14:35.133189+0000","last_became_peered":"2024-09-10T23:14:35.133189+0000","last_unstale":"2024-09-10T23:14:38.550650+0000","last_undegraded":"2024-09-10T23:14:38.550650+0000","last_fullsized":"2024-09-10T23:14:38.550650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:47.943661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.149972+0000","last_change":"2024-09-10T23:14:36.145337+0000","last_active":"2024-09-10T23:14:37.149972+0000","last_peered":"2024-09-10T23:14:37.149972+0000","last_clean":"2024-09-10T23:14:37.149972+0000","last_became_active":"2024-09-10T23:14:36.145030+0000","last_became_peered":"2024-09-10T23:14:36.145030+0000","last_unstale":"2024-09-10T23:14:37.149972+0000","last_undegraded":"2024-09-10T23:14:37.149972+0000","last_fullsized":"2024-09-10T23:14:37.149972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:12.246804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150235+0000","last_change":"2024-09-10T23:14:35.130762+0000","last_active":"2024-09-10T23:14:37.150235+0000","last_peered":"2024-09-10T23:14:37.150235+0000","last_clean":"2024-09-10T23:14:37.150235+0000","last_became_active":"2024-09-10T23:14:35.130502+0000","last_became_peered":"2024-09-10T23:14:35.130502+0000","last_unstale":"2024-09-10T23:14:37.150235+0000","last_undegraded":"2024-09-10T23:14:37.150235+0000","last_fullsized":"2024-09-10T23:14:37.150235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:37.092636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140000+0000","last_change":"2024-09-10T23:14:36.158417+0000","last_active":"2024-09-10T23:14:37.140000+0000","last_peered":"2024-09-10T23:14:37.140000+0000","last_clean":"2024-09-10T23:14:37.140000+0000","last_became_active":"2024-09-10T23:14:36.158157+0000","last_became_peered":"2024-09-10T23:14:36.158157+0000","last_unstale":"2024-09-10T23:14:37.140000+0000","last_undegraded":"2024-09-10T23:14:37.140000+0000","last_fullsized":"2024-09-10T23:14:37.140000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:11.115291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152322+0000","last_change":"2024-09-10T23:14:35.128484+0000","last_active":"2024-09-10T23:14:37.152322+0000","last_peered":"2024-09-10T23:14:37.152322+0000","last_clean":"2024-09-10T23:14:37.152322+0000","last_became_active":"2024-09-10T23:14:35.127877+0000","last_became_peered":"2024-09-10T23:14:35.127877+0000","last_unstale":"2024-09-10T23:14:37.152322+0000","last_undegraded":"2024-09-10T23:14:37.152322+0000","last_fullsized":"2024-09-10T23:14:37.152322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:35.830026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550037+0000","last_change":"2024-09-10T23:14:36.150091+0000","last_active":"2024-09-10T23:14:38.550037+0000","last_peered":"2024-09-10T23:14:38.550037+0000","last_clean":"2024-09-10T23:14:38.550037+0000","last_became_active":"2024-09-10T23:14:36.149727+0000","last_became_peered":"2024-09-10T23:14:36.149727+0000","last_unstale":"2024-09-10T23:14:38.550037+0000","last_undegraded":"2024-09-10T23:14:38.550037+0000","last_fullsized":"2024-09-10T23:14:38.550037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:30:11.421097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549852+0000","last_change":"2024-09-10T23:14:35.133467+0000","last_active":"2024-09-10T23:14:38.549852+0000","last_peered":"2024-09-10T23:14:38.549852+0000","last_clean":"2024-09-10T23:14:38.549852+0000","last_became_active":"2024-09-10T23:14:35.133163+0000","last_became_peered":"2024-09-10T23:14:35.133163+0000","last_unstale":"2024-09-10T23:14:38.549852+0000","last_undegraded":"2024-09-10T23:14:38.549852+0000","last_fullsized":"2024-09-10T23:14:38.549852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:12.209676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141682+0000","last_change":"2024-09-10T23:14:36.146249+0000","last_active":"2024-09-10T23:14:37.141682+0000","last_peered":"2024-09-10T23:14:37.141682+0000","last_clean":"2024-09-10T23:14:37.141682+0000","last_became_active":"2024-09-10T23:14:36.145993+0000","last_became_peered":"2024-09-10T23:14:36.145993+0000","last_unstale":"2024-09-10T23:14:37.141682+0000","last_undegraded":"2024-09-10T23:14:37.141682+0000","last_fullsized":"2024-09-10T23:14:37.141682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:53.600203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.150057+0000","last_change":"2024-09-10T23:14:35.125619+0000","last_active":"2024-09-10T23:14:37.150057+0000","last_peered":"2024-09-10T23:14:37.150057+0000","last_clean":"2024-09-10T23:14:37.150057+0000","last_became_active":"2024-09-10T23:14:35.125258+0000","last_became_peered":"2024-09-10T23:14:35.125258+0000","last_unstale":"2024-09-10T23:14:37.150057+0000","last_undegraded":"2024-09-10T23:14:37.150057+0000","last_fullsized":"2024-09-10T23:14:37.150057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:44.244654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140094+0000","last_change":"2024-09-10T23:14:36.145873+0000","last_active":"2024-09-10T23:14:37.140094+0000","last_peered":"2024-09-10T23:14:37.140094+0000","last_clean":"2024-09-10T23:14:37.140094+0000","last_became_active":"2024-09-10T23:14:36.145109+0000","last_became_peered":"2024-09-10T23:14:36.145109+0000","last_unstale":"2024-09-10T23:14:37.140094+0000","last_undegraded":"2024-09-10T23:14:37.140094+0000","last_fullsized":"2024-09-10T23:14:37.140094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:28.160849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.149958+0000","last_change":"2024-09-10T23:14:35.124311+0000","last_active":"2024-09-10T23:14:37.149958+0000","last_peered":"2024-09-10T23:14:37.149958+0000","last_clean":"2024-09-10T23:14:37.149958+0000","last_became_active":"2024-09-10T23:14:35.124054+0000","last_became_peered":"2024-09-10T23:14:35.124054+0000","last_unstale":"2024-09-10T23:14:37.149958+0000","last_undegraded":"2024-09-10T23:14:37.149958+0000","last_fullsized":"2024-09-10T23:14:37.149958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:48.848197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.139873+0000","last_change":"2024-09-10T23:14:36.155283+0000","last_active":"2024-09-10T23:14:37.139873+0000","last_peered":"2024-09-10T23:14:37.139873+0000","last_clean":"2024-09-10T23:14:37.139873+0000","last_became_active":"2024-09-10T23:14:36.154917+0000","last_became_peered":"2024-09-10T23:14:36.154917+0000","last_unstale":"2024-09-10T23:14:37.139873+0000","last_undegraded":"2024-09-10T23:14:37.139873+0000","last_fullsized":"2024-09-10T23:14:37.139873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:09.415499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550448+0000","last_change":"2024-09-10T23:14:35.128785+0000","last_active":"2024-09-10T23:14:38.550448+0000","last_peered":"2024-09-10T23:14:38.550448+0000","last_clean":"2024-09-10T23:14:38.550448+0000","last_became_active":"2024-09-10T23:14:35.128523+0000","last_became_peered":"2024-09-10T23:14:35.128523+0000","last_unstale":"2024-09-10T23:14:38.550448+0000","last_undegraded":"2024-09-10T23:14:38.550448+0000","last_fullsized":"2024-09-10T23:14:38.550448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:01.097187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.152074+0000","last_change":"2024-09-10T23:14:36.153266+0000","last_active":"2024-09-10T23:14:37.152074+0000","last_peered":"2024-09-10T23:14:37.152074+0000","last_clean":"2024-09-10T23:14:37.152074+0000","last_became_active":"2024-09-10T23:14:36.152781+0000","last_became_peered":"2024-09-10T23:14:36.152781+0000","last_unstale":"2024-09-10T23:14:37.152074+0000","last_undegraded":"2024-09-10T23:14:37.152074+0000","last_fullsized":"2024-09-10T23:14:37.152074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:51.090210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.141856+0000","last_change":"2024-09-10T23:14:36.149184+0000","last_active":"2024-09-10T23:14:37.141856+0000","last_peered":"2024-09-10T23:14:37.141856+0000","last_clean":"2024-09-10T23:14:37.141856+0000","last_became_active":"2024-09-10T23:14:36.146259+0000","last_became_peered":"2024-09-10T23:14:36.146259+0000","last_unstale":"2024-09-10T23:14:37.141856+0000","last_undegraded":"2024-09-10T23:14:37.141856+0000","last_fullsized":"2024-09-10T23:14:37.141856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:44.783941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550156+0000","last_change":"2024-09-10T23:14:35.128918+0000","last_active":"2024-09-10T23:14:38.550156+0000","last_peered":"2024-09-10T23:14:38.550156+0000","last_clean":"2024-09-10T23:14:38.550156+0000","last_became_active":"2024-09-10T23:14:35.128646+0000","last_became_peered":"2024-09-10T23:14:35.128646+0000","last_unstale":"2024-09-10T23:14:38.550156+0000","last_undegraded":"2024-09-10T23:14:38.550156+0000","last_fullsized":"2024-09-10T23:14:38.550156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:10.992208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.142141+0000","last_change":"2024-09-10T23:14:36.147233+0000","last_active":"2024-09-10T23:14:37.142141+0000","last_peered":"2024-09-10T23:14:37.142141+0000","last_clean":"2024-09-10T23:14:37.142141+0000","last_became_active":"2024-09-10T23:14:36.146609+0000","last_became_peered":"2024-09-10T23:14:36.146609+0000","last_unstale":"2024-09-10T23:14:37.142141+0000","last_undegraded":"2024-09-10T23:14:37.142141+0000","last_fullsized":"2024-09-10T23:14:37.142141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:08.022145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550494+0000","last_change":"2024-09-10T23:14:35.131443+0000","last_active":"2024-09-10T23:14:38.550494+0000","last_peered":"2024-09-10T23:14:38.550494+0000","last_clean":"2024-09-10T23:14:38.550494+0000","last_became_active":"2024-09-10T23:14:35.131123+0000","last_became_peered":"2024-09-10T23:14:35.131123+0000","last_unstale":"2024-09-10T23:14:38.550494+0000","last_undegraded":"2024-09-10T23:14:38.550494+0000","last_fullsized":"2024-09-10T23:14:38.550494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:37.092636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.549797+0000","last_change":"2024-09-10T23:14:36.152236+0000","last_active":"2024-09-10T23:14:38.549797+0000","last_peered":"2024-09-10T23:14:38.549797+0000","last_clean":"2024-09-10T23:14:38.549797+0000","last_became_active":"2024-09-10T23:14:36.151945+0000","last_became_peered":"2024-09-10T23:14:36.151945+0000","last_unstale":"2024-09-10T23:14:38.549797+0000","last_undegraded":"2024-09-10T23:14:38.549797+0000","last_fullsized":"2024-09-10T23:14:38.549797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:33.925368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140035+0000","last_change":"2024-09-10T23:14:35.129994+0000","last_active":"2024-09-10T23:14:37.140035+0000","last_peered":"2024-09-10T23:14:37.140035+0000","last_clean":"2024-09-10T23:14:37.140035+0000","last_became_active":"2024-09-10T23:14:35.129609+0000","last_became_peered":"2024-09-10T23:14:35.129609+0000","last_unstale":"2024-09-10T23:14:37.140035+0000","last_undegraded":"2024-09-10T23:14:37.140035+0000","last_fullsized":"2024-09-10T23:14:37.140035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:38.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:37.140095+0000","last_change":"2024-09-10T23:14:36.157814+0000","last_active":"2024-09-10T23:14:37.140095+0000","last_peered":"2024-09-10T23:14:37.140095+0000","last_clean":"2024-09-10T23:14:37.140095+0000","last_became_active":"2024-09-10T23:14:36.157514+0000","last_became_peered":"2024-09-10T23:14:36.157514+0000","last_unstale":"2024-09-10T23:14:37.140095+0000","last_undegraded":"2024-09-10T23:14:37.140095+0000","last_fullsized":"2024-09-10T23:14:37.140095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:35.106228+0000","last_clean_scrub_stamp":"2024-09-10T23:14:35.106228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:14.103635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T23:14:38.550272+0000","last_change":"2024-09-10T23:14:35.129129+0000","last_active":"2024-09-10T23:14:38.550272+0000","last_peered":"2024-09-10T23:14:38.550272+0000","last_clean":"2024-09-10T23:14:38.550272+0000","last_became_active":"2024-09-10T23:14:35.128815+0000","last_became_peered":"2024-09-10T23:14:35.128815+0000","last_unstale":"2024-09-10T23:14:38.550272+0000","last_undegraded":"2024-09-10T23:14:38.550272+0000","last_fullsized":"2024-09-10T23:14:38.550272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:34.104312+0000","last_clean_scrub_stamp":"2024-09-10T23:14:34.104312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:08.507246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":831488,"data_stored":672185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":237568,"data_stored":81325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":81361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":241664,"data_stored":81395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":672241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:14:47.728 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:14:47.728 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T23:14:47.728 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T23:14:47.728 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T23:14:47.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.862+0000 7f239f93d640 1 -- 172.21.15.90:0/72104789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23980d2960 msgr2=0x7f23980cfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.862+0000 7f239f93d640 1 --2- 172.21.15.90:0/72104789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23980d2960 0x7f23980cfe50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f238c009860 tx=0x7f238c02a440 comp rx=0 tx=0).stop 2024-09-10T23:14:47.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.862+0000 7f239f93d640 1 -- 172.21.15.90:0/72104789 shutdown_connections 2024-09-10T23:14:47.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.862+0000 7f239f93d640 1 --2- 172.21.15.90:0/72104789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23980d2960 0x7f23980cfe50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.862+0000 7f239f93d640 1 -- 172.21.15.90:0/72104789 >> 172.21.15.90:0/72104789 conn(0x7f23980d1dd0 msgr2=0x7f23980d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:47.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.862+0000 7f239f93d640 1 -- 172.21.15.90:0/72104789 shutdown_connections 2024-09-10T23:14:47.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.862+0000 7f239f93d640 1 -- 172.21.15.90:0/72104789 wait complete. 2024-09-10T23:14:47.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.864+0000 7f239f93d640 1 Processor -- start 2024-09-10T23:14:47.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.864+0000 7f239f93d640 1 -- start start 2024-09-10T23:14:47.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.864+0000 7f239f93d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23980d0390 0x7f23980cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:47.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.864+0000 7f239f93d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23980d2960 0x7f23981f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:47.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.864+0000 7f239f93d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f239815c0c0 0x7f2398156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:47.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.864+0000 7f239f93d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f23980b56c0 con 0x7f23980d2960 2024-09-10T23:14:47.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.864+0000 7f239f93d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f23980b5540 con 0x7f239815c0c0 2024-09-10T23:14:47.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.864+0000 7f239f93d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f23980b5840 con 0x7f23980d0390 2024-09-10T23:14:47.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.864+0000 7f239ced8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23980d2960 0x7f23981f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:47.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.864+0000 7f239ced8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23980d2960 0x7f23981f2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50680/0 (socket says 172.21.15.90:50680) 2024-09-10T23:14:47.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.864+0000 7f239ced8640 1 -- 172.21.15.90:0/3223975758 learned_addr learned my addr 172.21.15.90:0/3223975758 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:47.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.865+0000 7f239d6d9640 1 --2- 172.21.15.90:0/3223975758 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23980d0390 0x7f23980cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:47.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.865+0000 7f239deda640 1 --2- 172.21.15.90:0/3223975758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f239815c0c0 0x7f2398156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:47.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.865+0000 7f239ced8640 1 -- 172.21.15.90:0/3223975758 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23980d0390 msgr2=0x7f23980cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.865+0000 7f239ced8640 1 --2- 172.21.15.90:0/3223975758 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23980d0390 0x7f23980cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.865+0000 7f239ced8640 1 -- 172.21.15.90:0/3223975758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f239815c0c0 msgr2=0x7f2398156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:47.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.865+0000 7f239ced8640 1 --2- 172.21.15.90:0/3223975758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f239815c0c0 0x7f2398156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:47.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.865+0000 7f239ced8640 1 -- 172.21.15.90:0/3223975758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23981f35e0 con 0x7f23980d2960 2024-09-10T23:14:47.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.865+0000 7f239ced8640 1 --2- 172.21.15.90:0/3223975758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23980d2960 0x7f23981f2c00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f238c009950 tx=0x7f238c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:47.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.865+0000 7f2395ffb640 1 -- 172.21.15.90:0/3223975758 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c040020 con 0x7f23980d2960 2024-09-10T23:14:47.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.865+0000 7f2395ffb640 1 -- 172.21.15.90:0/3223975758 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f238c038040 con 0x7f23980d2960 2024-09-10T23:14:47.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.865+0000 7f239f93d640 1 -- 172.21.15.90:0/3223975758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23981f38c0 con 0x7f23980d2960 2024-09-10T23:14:47.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.865+0000 7f2395ffb640 1 -- 172.21.15.90:0/3223975758 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c037070 con 0x7f23980d2960 2024-09-10T23:14:47.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.865+0000 7f239f93d640 1 -- 172.21.15.90:0/3223975758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23980cbe20 con 0x7f23980d2960 2024-09-10T23:14:47.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.866+0000 7f239f93d640 1 -- 172.21.15.90:0/3223975758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23980cfe50 con 0x7f23980d2960 2024-09-10T23:14:47.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.867+0000 7f2395ffb640 1 -- 172.21.15.90:0/3223975758 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f238c02acc0 con 0x7f23980d2960 2024-09-10T23:14:47.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.867+0000 7f2395ffb640 1 --2- 172.21.15.90:0/3223975758 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2384077fa0 0x7f238407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:47.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.867+0000 7f2395ffb640 1 -- 172.21.15.90:0/3223975758 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f238c0ba2a0 con 0x7f23980d2960 2024-09-10T23:14:47.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.868+0000 7f239d6d9640 1 --2- 172.21.15.90:0/3223975758 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2384077fa0 0x7f238407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:47.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.868+0000 7f239d6d9640 1 --2- 172.21.15.90:0/3223975758 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2384077fa0 0x7f238407a460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f23900013d0 tx=0x7f2390009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:47.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:47.871+0000 7f2395ffb640 1 -- 172.21.15.90:0/3223975758 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f238c04a030 con 0x7f23980d2960 2024-09-10T23:14:48.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.084+0000 7f239f93d640 1 -- 172.21.15.90:0/3223975758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f23980ce5c0 con 0x7f23980d2960 2024-09-10T23:14:48.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.084+0000 7f2395ffb640 1 -- 172.21.15.90:0/3223975758 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f238c082d20 con 0x7f23980d2960 2024-09-10T23:14:48.086 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:48.086 INFO:teuthology.orchestra.run.smithi090.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T23:14:48.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.087+0000 7f239f93d640 1 -- 172.21.15.90:0/3223975758 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2384077fa0 msgr2=0x7f238407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:48.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.087+0000 7f239f93d640 1 --2- 172.21.15.90:0/3223975758 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2384077fa0 0x7f238407a460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f23900013d0 tx=0x7f2390009040 comp rx=0 tx=0).stop 2024-09-10T23:14:48.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.087+0000 7f239f93d640 1 -- 172.21.15.90:0/3223975758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23980d2960 msgr2=0x7f23981f2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:48.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.087+0000 7f239f93d640 1 --2- 172.21.15.90:0/3223975758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23980d2960 0x7f23981f2c00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f238c009950 tx=0x7f238c003c10 comp rx=0 tx=0).stop 2024-09-10T23:14:48.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.087+0000 7f239f93d640 1 -- 172.21.15.90:0/3223975758 shutdown_connections 2024-09-10T23:14:48.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.087+0000 7f239f93d640 1 --2- 172.21.15.90:0/3223975758 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2384077fa0 0x7f238407a460 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.087+0000 7f239f93d640 1 --2- 172.21.15.90:0/3223975758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f239815c0c0 0x7f2398156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.087+0000 7f239f93d640 1 --2- 172.21.15.90:0/3223975758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23980d2960 0x7f23981f2c00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.087+0000 7f239f93d640 1 --2- 172.21.15.90:0/3223975758 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23980d0390 0x7f23980cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.087+0000 7f239f93d640 1 -- 172.21.15.90:0/3223975758 >> 172.21.15.90:0/3223975758 conn(0x7f23980d1dd0 msgr2=0x7f23980cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:48.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.087+0000 7f239f93d640 1 -- 172.21.15.90:0/3223975758 shutdown_connections 2024-09-10T23:14:48.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.087+0000 7f239f93d640 1 -- 172.21.15.90:0/3223975758 wait complete. 2024-09-10T23:14:48.098 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T23:14:48.098 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:14:48.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.198+0000 7f2585047640 1 -- 172.21.15.90:0/484585956 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f256c003a00 msgr2=0x7f256c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:48.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.198+0000 7f2585047640 1 --2- 172.21.15.90:0/484585956 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f256c003a00 0x7f256c003e00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2578005fd0 tx=0x7f256c005830 comp rx=0 tx=0).stop 2024-09-10T23:14:48.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.199+0000 7f2585047640 1 -- 172.21.15.90:0/484585956 shutdown_connections 2024-09-10T23:14:48.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.199+0000 7f2585047640 1 --2- 172.21.15.90:0/484585956 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f256c003a00 0x7f256c003e00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.199+0000 7f2585047640 1 -- 172.21.15.90:0/484585956 >> 172.21.15.90:0/484585956 conn(0x7f258009d2a0 msgr2=0x7f25800d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:48.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.199+0000 7f2585047640 1 -- 172.21.15.90:0/484585956 shutdown_connections 2024-09-10T23:14:48.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.199+0000 7f2585047640 1 -- 172.21.15.90:0/484585956 wait complete. 2024-09-10T23:14:48.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.200+0000 7f2585047640 1 Processor -- start 2024-09-10T23:14:48.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.200+0000 7f2585047640 1 -- start start 2024-09-10T23:14:48.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f2585047640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c003a00 0x7f258015e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:48.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f2585047640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25800b8950 0x7f25801f5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:48.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f2585047640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2580160aa0 0x7f2580160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:48.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f2585047640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f25800b3610 con 0x7f25800b8950 2024-09-10T23:14:48.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f2585047640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f25800b3490 con 0x7f2580160aa0 2024-09-10T23:14:48.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f2585047640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f25800b3790 con 0x7f256c003a00 2024-09-10T23:14:48.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f257e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25800b8950 0x7f25801f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:48.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f257e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25800b8950 0x7f25801f5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49100/0 (socket says 172.21.15.90:49100) 2024-09-10T23:14:48.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f257e59c640 1 -- 172.21.15.90:0/1415111999 learned_addr learned my addr 172.21.15.90:0/1415111999 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:48.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f257ed9d640 1 --2- 172.21.15.90:0/1415111999 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c003a00 0x7f258015e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:48.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f257f59e640 1 --2- 172.21.15.90:0/1415111999 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2580160aa0 0x7f2580160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:48.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f257e59c640 1 -- 172.21.15.90:0/1415111999 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c003a00 msgr2=0x7f258015e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:48.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f257e59c640 1 --2- 172.21.15.90:0/1415111999 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c003a00 0x7f258015e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f257e59c640 1 -- 172.21.15.90:0/1415111999 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2580160aa0 msgr2=0x7f2580160f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:48.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f257e59c640 1 --2- 172.21.15.90:0/1415111999 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2580160aa0 0x7f2580160f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f257e59c640 1 -- 172.21.15.90:0/1415111999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25800b8e80 con 0x7f25800b8950 2024-09-10T23:14:48.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f257e59c640 1 --2- 172.21.15.90:0/1415111999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25800b8950 0x7f25801f5560 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f256800d8f0 tx=0x7f256800ddb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:48.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f25777fe640 1 -- 172.21.15.90:0/1415111999 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256800b830 con 0x7f25800b8950 2024-09-10T23:14:48.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f25777fe640 1 -- 172.21.15.90:0/1415111999 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f256800bac0 con 0x7f25800b8950 2024-09-10T23:14:48.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f2585047640 1 -- 172.21.15.90:0/1415111999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25800b9160 con 0x7f25800b8950 2024-09-10T23:14:48.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.201+0000 7f25777fe640 1 -- 172.21.15.90:0/1415111999 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25680035f0 con 0x7f25800b8950 2024-09-10T23:14:48.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.202+0000 7f2585047640 1 -- 172.21.15.90:0/1415111999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25800b72e0 con 0x7f25800b8950 2024-09-10T23:14:48.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.203+0000 7f2585047640 1 -- 172.21.15.90:0/1415111999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25800d29c0 con 0x7f25800b8950 2024-09-10T23:14:48.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.203+0000 7f25777fe640 1 -- 172.21.15.90:0/1415111999 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2568003790 con 0x7f25800b8950 2024-09-10T23:14:48.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.203+0000 7f25777fe640 1 --2- 172.21.15.90:0/1415111999 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2560077fa0 0x7f256007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:48.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.203+0000 7f25777fe640 1 -- 172.21.15.90:0/1415111999 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f256809a200 con 0x7f25800b8950 2024-09-10T23:14:48.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.204+0000 7f257ed9d640 1 --2- 172.21.15.90:0/1415111999 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2560077fa0 0x7f256007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:48.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.204+0000 7f257ed9d640 1 --2- 172.21.15.90:0/1415111999 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2560077fa0 0x7f256007a460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2578035000 tx=0x7f257802d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:48.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.208+0000 7f25777fe640 1 -- 172.21.15.90:0/1415111999 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f25800cff60 con 0x7f25800b8950 2024-09-10T23:14:48.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.416+0000 7f2585047640 1 -- 172.21.15.90:0/1415111999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25800b8730 con 0x7f25800b8950 2024-09-10T23:14:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.417+0000 7f25777fe640 1 -- 172.21.15.90:0/1415111999 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7f2568062d90 con 0x7f25800b8950 2024-09-10T23:14:48.418 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:48.418 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":7,"btime":"2024-09-10T23:14:39:140018+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/286705671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":286705671},{"type":"v1","addr":"172.21.15.171:6837","nonce":286705671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/604738442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":604738442},{"type":"v1","addr":"172.21.15.171:6836","nonce":604738442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/1263661165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1263661165},{"type":"v1","addr":"172.21.15.90:6834","nonce":1263661165}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:14:35.457987+0000","modified":"2024-09-10T23:14:38.235652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4368},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4368":{"gid":4368,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6835/1573070489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":1573070489},{"type":"v1","addr":"172.21.15.90:6835","nonce":1573070489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4368,"qdb_cluster":[4368]},"id":1}]} 2024-09-10T23:14:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 7 2024-09-10T23:14:48.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.419+0000 7f2585047640 1 -- 172.21.15.90:0/1415111999 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2560077fa0 msgr2=0x7f256007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:48.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.419+0000 7f2585047640 1 --2- 172.21.15.90:0/1415111999 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2560077fa0 0x7f256007a460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2578035000 tx=0x7f257802d040 comp rx=0 tx=0).stop 2024-09-10T23:14:48.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.419+0000 7f2585047640 1 -- 172.21.15.90:0/1415111999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25800b8950 msgr2=0x7f25801f5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:48.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.419+0000 7f2585047640 1 --2- 172.21.15.90:0/1415111999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25800b8950 0x7f25801f5560 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f256800d8f0 tx=0x7f256800ddb0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.419+0000 7f2585047640 1 -- 172.21.15.90:0/1415111999 shutdown_connections 2024-09-10T23:14:48.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.419+0000 7f2585047640 1 --2- 172.21.15.90:0/1415111999 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2560077fa0 0x7f256007a460 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.419+0000 7f2585047640 1 --2- 172.21.15.90:0/1415111999 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2580160aa0 0x7f2580160f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.419+0000 7f2585047640 1 --2- 172.21.15.90:0/1415111999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25800b8950 0x7f25801f5560 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.419+0000 7f2585047640 1 --2- 172.21.15.90:0/1415111999 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c003a00 0x7f258015e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.419+0000 7f2585047640 1 -- 172.21.15.90:0/1415111999 >> 172.21.15.90:0/1415111999 conn(0x7f258009d2a0 msgr2=0x7f25800b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:48.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.419+0000 7f2585047640 1 -- 172.21.15.90:0/1415111999 shutdown_connections 2024-09-10T23:14:48.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.419+0000 7f2585047640 1 -- 172.21.15.90:0/1415111999 wait complete. 2024-09-10T23:14:48.431 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:14:48.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.531+0000 7f77a7b4b640 1 -- 172.21.15.90:0/46664403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c0051c0 msgr2=0x7f778c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:48.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.531+0000 7f77a7b4b640 1 --2- 172.21.15.90:0/46664403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c0051c0 0x7f778c00b9c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7798006fd0 tx=0x7f778c005830 comp rx=0 tx=0).stop 2024-09-10T23:14:48.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.531+0000 7f77a7b4b640 1 -- 172.21.15.90:0/46664403 shutdown_connections 2024-09-10T23:14:48.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.531+0000 7f77a7b4b640 1 --2- 172.21.15.90:0/46664403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c0051c0 0x7f778c00b9c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.531+0000 7f77a7b4b640 1 -- 172.21.15.90:0/46664403 >> 172.21.15.90:0/46664403 conn(0x7f77a00d1dd0 msgr2=0x7f77a00d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:48.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.531+0000 7f77a7b4b640 1 -- 172.21.15.90:0/46664403 shutdown_connections 2024-09-10T23:14:48.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.531+0000 7f77a7b4b640 1 -- 172.21.15.90:0/46664403 wait complete. 2024-09-10T23:14:48.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.533+0000 7f77a7b4b640 1 Processor -- start 2024-09-10T23:14:48.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.533+0000 7f77a7b4b640 1 -- start start 2024-09-10T23:14:48.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.533+0000 7f77a7b4b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c0051c0 0x7f77a00b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:48.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.533+0000 7f77a7b4b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77a00aea00 0x7f77a0159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:48.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.533+0000 7f77a7b4b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77a009f140 0x7f77a009f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:48.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.533+0000 7f77a7b4b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f77a00cffd0 con 0x7f778c0051c0 2024-09-10T23:14:48.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.533+0000 7f77a7b4b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f77a00cfe50 con 0x7f77a00aea00 2024-09-10T23:14:48.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.533+0000 7f77a7b4b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f77a00d0150 con 0x7f77a009f140 2024-09-10T23:14:48.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.533+0000 7f77a58e7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c0051c0 0x7f77a00b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:48.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.534+0000 7f77a58e7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c0051c0 0x7f77a00b75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49106/0 (socket says 172.21.15.90:49106) 2024-09-10T23:14:48.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.534+0000 7f77a58e7640 1 -- 172.21.15.90:0/1519990334 learned_addr learned my addr 172.21.15.90:0/1519990334 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:48.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.534+0000 7f77a50e6640 1 --2- 172.21.15.90:0/1519990334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77a00aea00 0x7f77a0159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:48.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.534+0000 7f77a60e8640 1 --2- 172.21.15.90:0/1519990334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77a009f140 0x7f77a009f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:48.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.534+0000 7f77a58e7640 1 -- 172.21.15.90:0/1519990334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77a009f140 msgr2=0x7f77a009f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:48.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.534+0000 7f77a58e7640 1 --2- 172.21.15.90:0/1519990334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77a009f140 0x7f77a009f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.534+0000 7f77a58e7640 1 -- 172.21.15.90:0/1519990334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77a00aea00 msgr2=0x7f77a0159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:48.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.534+0000 7f77a58e7640 1 --2- 172.21.15.90:0/1519990334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77a00aea00 0x7f77a0159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.534+0000 7f77a58e7640 1 -- 172.21.15.90:0/1519990334 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a00aef00 con 0x7f778c0051c0 2024-09-10T23:14:48.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.534+0000 7f77a50e6640 1 --2- 172.21.15.90:0/1519990334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77a00aea00 0x7f77a0159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:48.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.534+0000 7f77a58e7640 1 --2- 172.21.15.90:0/1519990334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c0051c0 0x7f77a00b75b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f779c0018c0 tx=0x7f779c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:48.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.534+0000 7f77967fc640 1 -- 172.21.15.90:0/1519990334 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c015070 con 0x7f778c0051c0 2024-09-10T23:14:48.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.534+0000 7f77967fc640 1 -- 172.21.15.90:0/1519990334 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f779c00e9e0 con 0x7f778c0051c0 2024-09-10T23:14:48.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.534+0000 7f77a7b4b640 1 -- 172.21.15.90:0/1519990334 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a00af1e0 con 0x7f778c0051c0 2024-09-10T23:14:48.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.534+0000 7f77967fc640 1 -- 172.21.15.90:0/1519990334 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c00edf0 con 0x7f778c0051c0 2024-09-10T23:14:48.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.534+0000 7f77a7b4b640 1 -- 172.21.15.90:0/1519990334 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a00af7a0 con 0x7f778c0051c0 2024-09-10T23:14:48.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.535+0000 7f77a7b4b640 1 -- 172.21.15.90:0/1519990334 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77a00cf570 con 0x7f778c0051c0 2024-09-10T23:14:48.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.536+0000 7f77967fc640 1 -- 172.21.15.90:0/1519990334 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f779c011460 con 0x7f778c0051c0 2024-09-10T23:14:48.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.536+0000 7f77967fc640 1 --2- 172.21.15.90:0/1519990334 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7784077fa0 0x7f778407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:48.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.536+0000 7f77967fc640 1 -- 172.21.15.90:0/1519990334 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f779c09a900 con 0x7f778c0051c0 2024-09-10T23:14:48.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.536+0000 7f77a50e6640 1 --2- 172.21.15.90:0/1519990334 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7784077fa0 0x7f778407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:48.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.537+0000 7f77a50e6640 1 --2- 172.21.15.90:0/1519990334 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7784077fa0 0x7f778407a460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f77a00b7210 tx=0x7f7790005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:48.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.540+0000 7f77967fc640 1 -- 172.21.15.90:0/1519990334 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f779c063410 con 0x7f778c0051c0 2024-09-10T23:14:48.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.748+0000 7f77a7b4b640 1 -- 172.21.15.90:0/1519990334 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77a00ce5c0 con 0x7f778c0051c0 2024-09-10T23:14:48.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.749+0000 7f77967fc640 1 -- 172.21.15.90:0/1519990334 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7f779c062d10 con 0x7f778c0051c0 2024-09-10T23:14:48.750 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:48.750 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":7,"btime":"2024-09-10T23:14:39:140018+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/286705671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":286705671},{"type":"v1","addr":"172.21.15.171:6837","nonce":286705671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/604738442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":604738442},{"type":"v1","addr":"172.21.15.171:6836","nonce":604738442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/1263661165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1263661165},{"type":"v1","addr":"172.21.15.90:6834","nonce":1263661165}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:14:35.457987+0000","modified":"2024-09-10T23:14:38.235652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4368},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4368":{"gid":4368,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6835/1573070489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":1573070489},{"type":"v1","addr":"172.21.15.90:6835","nonce":1573070489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4368,"qdb_cluster":[4368]},"id":1}]} 2024-09-10T23:14:48.751 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 7 2024-09-10T23:14:48.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.751+0000 7f77a7b4b640 1 -- 172.21.15.90:0/1519990334 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7784077fa0 msgr2=0x7f778407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:48.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.751+0000 7f77a7b4b640 1 --2- 172.21.15.90:0/1519990334 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7784077fa0 0x7f778407a460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f77a00b7210 tx=0x7f7790005f90 comp rx=0 tx=0).stop 2024-09-10T23:14:48.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.751+0000 7f77a7b4b640 1 -- 172.21.15.90:0/1519990334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c0051c0 msgr2=0x7f77a00b75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:48.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.751+0000 7f77a7b4b640 1 --2- 172.21.15.90:0/1519990334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c0051c0 0x7f77a00b75b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f779c0018c0 tx=0x7f779c001d80 comp rx=0 tx=0).stop 2024-09-10T23:14:48.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.751+0000 7f77a7b4b640 1 -- 172.21.15.90:0/1519990334 shutdown_connections 2024-09-10T23:14:48.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.751+0000 7f77a7b4b640 1 --2- 172.21.15.90:0/1519990334 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7784077fa0 0x7f778407a460 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.751+0000 7f77a7b4b640 1 --2- 172.21.15.90:0/1519990334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77a00aea00 0x7f77a0159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.751+0000 7f77a7b4b640 1 --2- 172.21.15.90:0/1519990334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77a009f140 0x7f77a009f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.751+0000 7f77a7b4b640 1 --2- 172.21.15.90:0/1519990334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f778c0051c0 0x7f77a00b75b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.751+0000 7f77a7b4b640 1 -- 172.21.15.90:0/1519990334 >> 172.21.15.90:0/1519990334 conn(0x7f77a00d1dd0 msgr2=0x7f77a015cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:48.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.751+0000 7f77a7b4b640 1 -- 172.21.15.90:0/1519990334 shutdown_connections 2024-09-10T23:14:48.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.751+0000 7f77a7b4b640 1 -- 172.21.15.90:0/1519990334 wait complete. 2024-09-10T23:14:48.763 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:14:48.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.862+0000 7eff4af82640 1 -- 172.21.15.90:0/2311414317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff440ca960 msgr2=0x7eff440b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:48.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.862+0000 7eff4af82640 1 --2- 172.21.15.90:0/2311414317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff440ca960 0x7eff440b1850 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7eff30005fd0 tx=0x7eff3002a5d0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.862+0000 7eff4af82640 1 -- 172.21.15.90:0/2311414317 shutdown_connections 2024-09-10T23:14:48.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.862+0000 7eff4af82640 1 --2- 172.21.15.90:0/2311414317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff440ca960 0x7eff440b1850 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.862+0000 7eff4af82640 1 --2- 172.21.15.90:0/2311414317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff4415aa30 0x7eff440ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.862+0000 7eff4af82640 1 -- 172.21.15.90:0/2311414317 >> 172.21.15.90:0/2311414317 conn(0x7eff440cc850 msgr2=0x7eff440ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:48.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.862+0000 7eff4af82640 1 -- 172.21.15.90:0/2311414317 shutdown_connections 2024-09-10T23:14:48.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.862+0000 7eff4af82640 1 -- 172.21.15.90:0/2311414317 wait complete. 2024-09-10T23:14:48.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.863+0000 7eff4af82640 1 Processor -- start 2024-09-10T23:14:48.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.863+0000 7eff4af82640 1 -- start start 2024-09-10T23:14:48.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.864+0000 7eff4af82640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff4415aa30 0x7eff440ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:48.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.864+0000 7eff4af82640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff4415ae10 0x7eff441f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:48.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.864+0000 7eff4af82640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff440acd20 0x7eff4415cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:48.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.864+0000 7eff4af82640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7eff440b2120 con 0x7eff440acd20 2024-09-10T23:14:48.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.864+0000 7eff4af82640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7eff440b1fa0 con 0x7eff4415aa30 2024-09-10T23:14:48.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.864+0000 7eff4af82640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7eff4406fcd0 con 0x7eff4415ae10 2024-09-10T23:14:48.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.864+0000 7eff4951f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff440acd20 0x7eff4415cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:48.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.864+0000 7eff4951f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff440acd20 0x7eff4415cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49128/0 (socket says 172.21.15.90:49128) 2024-09-10T23:14:48.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.864+0000 7eff4951f640 1 -- 172.21.15.90:0/835194691 learned_addr learned my addr 172.21.15.90:0/835194691 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:48.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.864+0000 7eff43fff640 1 --2- 172.21.15.90:0/835194691 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff4415ae10 0x7eff441f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:48.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.864+0000 7eff48d1e640 1 --2- 172.21.15.90:0/835194691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff4415aa30 0x7eff440ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:48.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.865+0000 7eff4951f640 1 -- 172.21.15.90:0/835194691 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff4415ae10 msgr2=0x7eff441f46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:48.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.865+0000 7eff4951f640 1 --2- 172.21.15.90:0/835194691 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff4415ae10 0x7eff441f46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.865+0000 7eff4951f640 1 -- 172.21.15.90:0/835194691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff4415aa30 msgr2=0x7eff440ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:48.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.865+0000 7eff4951f640 1 --2- 172.21.15.90:0/835194691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff4415aa30 0x7eff440ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:48.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.865+0000 7eff4951f640 1 -- 172.21.15.90:0/835194691 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff441f4db0 con 0x7eff440acd20 2024-09-10T23:14:48.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.865+0000 7eff4951f640 1 --2- 172.21.15.90:0/835194691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff440acd20 0x7eff4415cbb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7eff3c00c7a0 tx=0x7eff3c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:48.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.865+0000 7eff417fa640 1 -- 172.21.15.90:0/835194691 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c003b70 con 0x7eff440acd20 2024-09-10T23:14:48.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.865+0000 7eff417fa640 1 -- 172.21.15.90:0/835194691 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff3c003d10 con 0x7eff440acd20 2024-09-10T23:14:48.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.865+0000 7eff417fa640 1 -- 172.21.15.90:0/835194691 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c00aab0 con 0x7eff440acd20 2024-09-10T23:14:48.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.865+0000 7eff4af82640 1 -- 172.21.15.90:0/835194691 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff441f5090 con 0x7eff440acd20 2024-09-10T23:14:48.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.865+0000 7eff4af82640 1 -- 172.21.15.90:0/835194691 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff440b2d30 con 0x7eff440acd20 2024-09-10T23:14:48.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.866+0000 7eff4af82640 1 -- 172.21.15.90:0/835194691 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff440701f0 con 0x7eff440acd20 2024-09-10T23:14:48.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.866+0000 7eff417fa640 1 -- 172.21.15.90:0/835194691 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7eff3c00ac50 con 0x7eff440acd20 2024-09-10T23:14:48.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.867+0000 7eff417fa640 1 --2- 172.21.15.90:0/835194691 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff28077f70 0x7eff2807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:48.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.867+0000 7eff417fa640 1 -- 172.21.15.90:0/835194691 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7eff3c0999a0 con 0x7eff440acd20 2024-09-10T23:14:48.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.867+0000 7eff48d1e640 1 --2- 172.21.15.90:0/835194691 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff28077f70 0x7eff2807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:48.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.868+0000 7eff48d1e640 1 --2- 172.21.15.90:0/835194691 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff28077f70 0x7eff2807a430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff440ae0e0 tx=0x7eff3800b390 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:48.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:48.871+0000 7eff417fa640 1 -- 172.21.15.90:0/835194691 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7eff3c061ee0 con 0x7eff440acd20 2024-09-10T23:14:49.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.045+0000 7eff4af82640 1 -- 172.21.15.90:0/835194691 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff440b0520 con 0x7eff440acd20 2024-09-10T23:14:49.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.046+0000 7eff417fa640 1 -- 172.21.15.90:0/835194691 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16665 (secure 0 0 0) 0x7eff3c066910 con 0x7eff440acd20 2024-09-10T23:14:49.047 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:49.048 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":23,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:14:37.132353+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:14:33.985657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:14:34.420690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:14:49.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.048+0000 7eff4af82640 1 -- 172.21.15.90:0/835194691 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff28077f70 msgr2=0x7eff2807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:49.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.048+0000 7eff4af82640 1 --2- 172.21.15.90:0/835194691 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff28077f70 0x7eff2807a430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff440ae0e0 tx=0x7eff3800b390 comp rx=0 tx=0).stop 2024-09-10T23:14:49.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.048+0000 7eff4af82640 1 -- 172.21.15.90:0/835194691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff440acd20 msgr2=0x7eff4415cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:49.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.048+0000 7eff4af82640 1 --2- 172.21.15.90:0/835194691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff440acd20 0x7eff4415cbb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7eff3c00c7a0 tx=0x7eff3c00cc60 comp rx=0 tx=0).stop 2024-09-10T23:14:49.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.048+0000 7eff4af82640 1 -- 172.21.15.90:0/835194691 shutdown_connections 2024-09-10T23:14:49.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.048+0000 7eff4af82640 1 --2- 172.21.15.90:0/835194691 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff28077f70 0x7eff2807a430 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.048+0000 7eff4af82640 1 --2- 172.21.15.90:0/835194691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff440acd20 0x7eff4415cbb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.048+0000 7eff4af82640 1 --2- 172.21.15.90:0/835194691 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff4415ae10 0x7eff441f46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.048+0000 7eff4af82640 1 --2- 172.21.15.90:0/835194691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff4415aa30 0x7eff440ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.048+0000 7eff4af82640 1 -- 172.21.15.90:0/835194691 >> 172.21.15.90:0/835194691 conn(0x7eff440cc850 msgr2=0x7eff440cef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:49.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.049+0000 7eff4af82640 1 -- 172.21.15.90:0/835194691 shutdown_connections 2024-09-10T23:14:49.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.049+0000 7eff4af82640 1 -- 172.21.15.90:0/835194691 wait complete. 2024-09-10T23:14:49.060 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:14:49.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.161+0000 7f0b937f3640 1 -- 172.21.15.90:0/1003295340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b8c0cc310 msgr2=0x7f0b8c0b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:49.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.161+0000 7f0b937f3640 1 --2- 172.21.15.90:0/1003295340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b8c0cc310 0x7f0b8c0b1850 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c06db00 tx=0x7f0b7c02a4d0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.161+0000 7f0b937f3640 1 -- 172.21.15.90:0/1003295340 shutdown_connections 2024-09-10T23:14:49.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.161+0000 7f0b937f3640 1 --2- 172.21.15.90:0/1003295340 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b8c0b1d90 0x7f0b8c073740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.161+0000 7f0b937f3640 1 --2- 172.21.15.90:0/1003295340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b8c0cc310 0x7f0b8c0b1850 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.161+0000 7f0b937f3640 1 --2- 172.21.15.90:0/1003295340 >> v2:172.21.15.171:3300/0 conn(0x7f0b8c159c90 0x7f0b8c0ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.161+0000 7f0b937f3640 1 -- 172.21.15.90:0/1003295340 >> 172.21.15.90:0/1003295340 conn(0x7f0b8c0cc850 msgr2=0x7f0b8c0ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:49.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.161+0000 7f0b937f3640 1 -- 172.21.15.90:0/1003295340 shutdown_connections 2024-09-10T23:14:49.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.161+0000 7f0b937f3640 1 -- 172.21.15.90:0/1003295340 wait complete. 2024-09-10T23:14:49.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.162+0000 7f0b937f3640 1 Processor -- start 2024-09-10T23:14:49.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.162+0000 7f0b937f3640 1 -- start start 2024-09-10T23:14:49.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b937f3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b8c0b1d90 0x7f0b8c158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b937f3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b8c0cc310 0x7f0b8c09b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b937f3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b8c159c90 0x7f0b8c09bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b937f3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8c0cdb40 con 0x7f0b8c0b1d90 2024-09-10T23:14:49.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b937f3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8c070a30 con 0x7f0b8c159c90 2024-09-10T23:14:49.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b937f3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0b8c073c80 con 0x7f0b8c0cc310 2024-09-10T23:14:49.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b9158f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b8c0b1d90 0x7f0b8c158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b9158f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b8c0b1d90 0x7f0b8c158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49154/0 (socket says 172.21.15.90:49154) 2024-09-10T23:14:49.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b9158f640 1 -- 172.21.15.90:0/174852818 learned_addr learned my addr 172.21.15.90:0/174852818 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:49.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b90d8e640 1 --2- 172.21.15.90:0/174852818 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b8c0cc310 0x7f0b8c09b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b91d90640 1 --2- 172.21.15.90:0/174852818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b8c159c90 0x7f0b8c09bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b9158f640 1 -- 172.21.15.90:0/174852818 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b8c0cc310 msgr2=0x7f0b8c09b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:49.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b9158f640 1 --2- 172.21.15.90:0/174852818 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b8c0cc310 0x7f0b8c09b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b9158f640 1 -- 172.21.15.90:0/174852818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b8c159c90 msgr2=0x7f0b8c09bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:49.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b9158f640 1 --2- 172.21.15.90:0/174852818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b8c159c90 0x7f0b8c09bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b9158f640 1 -- 172.21.15.90:0/174852818 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b8c1591c0 con 0x7f0b8c0b1d90 2024-09-10T23:14:49.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b91d90640 1 --2- 172.21.15.90:0/174852818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b8c159c90 0x7f0b8c09bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:49.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b90d8e640 1 --2- 172.21.15.90:0/174852818 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b8c0cc310 0x7f0b8c09b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:49.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b9158f640 1 --2- 172.21.15.90:0/174852818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b8c0b1d90 0x7f0b8c158c80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800ea20 tx=0x7f0b8800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:49.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b81ffb640 1 -- 172.21.15.90:0/174852818 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8800cde0 con 0x7f0b8c0b1d90 2024-09-10T23:14:49.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b81ffb640 1 -- 172.21.15.90:0/174852818 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b88011560 con 0x7f0b8c0b1d90 2024-09-10T23:14:49.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b937f3640 1 -- 172.21.15.90:0/174852818 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b8c1f5a20 con 0x7f0b8c0b1d90 2024-09-10T23:14:49.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.163+0000 7f0b81ffb640 1 -- 172.21.15.90:0/174852818 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88011970 con 0x7f0b8c0b1d90 2024-09-10T23:14:49.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.164+0000 7f0b937f3640 1 -- 172.21.15.90:0/174852818 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b8c09af20 con 0x7f0b8c0b1d90 2024-09-10T23:14:49.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.165+0000 7f0b937f3640 1 -- 172.21.15.90:0/174852818 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b8c09aa50 con 0x7f0b8c0b1d90 2024-09-10T23:14:49.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.165+0000 7f0b81ffb640 1 -- 172.21.15.90:0/174852818 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0b88022030 con 0x7f0b8c0b1d90 2024-09-10T23:14:49.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.166+0000 7f0b81ffb640 1 --2- 172.21.15.90:0/174852818 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b70077fa0 0x7f0b7007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.166+0000 7f0b81ffb640 1 -- 172.21.15.90:0/174852818 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0b8809a610 con 0x7f0b8c0b1d90 2024-09-10T23:14:49.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.166+0000 7f0b90d8e640 1 --2- 172.21.15.90:0/174852818 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b70077fa0 0x7f0b7007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.166+0000 7f0b90d8e640 1 --2- 172.21.15.90:0/174852818 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b70077fa0 0x7f0b7007a460 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c033000 tx=0x7f0b7c004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:49.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.170+0000 7f0b81ffb640 1 -- 172.21.15.90:0/174852818 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0b88016030 con 0x7f0b8c0b1d90 2024-09-10T23:14:49.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.380+0000 7f0b937f3640 1 -- 172.21.15.90:0/174852818 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b8c0b5d50 con 0x7f0b8c0b1d90 2024-09-10T23:14:49.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.381+0000 7f0b81ffb640 1 -- 172.21.15.90:0/174852818 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7f0b88063110 con 0x7f0b8c0b1d90 2024-09-10T23:14:49.382 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:49.382 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":7,"btime":"2024-09-10T23:14:39:140018+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/286705671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":286705671},{"type":"v1","addr":"172.21.15.171:6837","nonce":286705671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/604738442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":604738442},{"type":"v1","addr":"172.21.15.171:6836","nonce":604738442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/1263661165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1263661165},{"type":"v1","addr":"172.21.15.90:6834","nonce":1263661165}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:14:35.457987+0000","modified":"2024-09-10T23:14:38.235652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4368},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4368":{"gid":4368,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6835/1573070489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":1573070489},{"type":"v1","addr":"172.21.15.90:6835","nonce":1573070489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4368,"qdb_cluster":[4368]},"id":1}]} 2024-09-10T23:14:49.382 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 7 2024-09-10T23:14:49.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.383+0000 7f0b937f3640 1 -- 172.21.15.90:0/174852818 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b70077fa0 msgr2=0x7f0b7007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:49.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.383+0000 7f0b937f3640 1 --2- 172.21.15.90:0/174852818 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b70077fa0 0x7f0b7007a460 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c033000 tx=0x7f0b7c004730 comp rx=0 tx=0).stop 2024-09-10T23:14:49.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.383+0000 7f0b937f3640 1 -- 172.21.15.90:0/174852818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b8c0b1d90 msgr2=0x7f0b8c158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:49.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.383+0000 7f0b937f3640 1 --2- 172.21.15.90:0/174852818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b8c0b1d90 0x7f0b8c158c80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800ea20 tx=0x7f0b8800eee0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.383+0000 7f0b937f3640 1 -- 172.21.15.90:0/174852818 shutdown_connections 2024-09-10T23:14:49.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.383+0000 7f0b937f3640 1 --2- 172.21.15.90:0/174852818 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b70077fa0 0x7f0b7007a460 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.383+0000 7f0b937f3640 1 --2- 172.21.15.90:0/174852818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b8c159c90 0x7f0b8c09bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.383+0000 7f0b937f3640 1 --2- 172.21.15.90:0/174852818 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b8c0cc310 0x7f0b8c09b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.383+0000 7f0b937f3640 1 --2- 172.21.15.90:0/174852818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b8c0b1d90 0x7f0b8c158c80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.383+0000 7f0b937f3640 1 -- 172.21.15.90:0/174852818 >> 172.21.15.90:0/174852818 conn(0x7f0b8c0cc850 msgr2=0x7f0b8c0ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:49.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.383+0000 7f0b937f3640 1 -- 172.21.15.90:0/174852818 shutdown_connections 2024-09-10T23:14:49.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.383+0000 7f0b937f3640 1 -- 172.21.15.90:0/174852818 wait complete. 2024-09-10T23:14:49.797 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:14:35.457987+0000', 'modified': '2024-09-10T23:14:38.235652+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4368}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4368': {'gid': 4368, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.90:6835/1573070489', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6833', 'nonce': 1573070489}, {'type': 'v1', 'addr': '172.21.15.90:6835', 'nonce': 1573070489}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4368, 'qdb_cluster': [4368]} 2024-09-10T23:14:49.798 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:14:49.798 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T23:14:49.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.901+0000 7fb955500640 1 -- 172.21.15.90:0/1448131755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9500b65b0 msgr2=0x7fb9500d05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:49.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.901+0000 7fb955500640 1 --2- 172.21.15.90:0/1448131755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9500b65b0 0x7fb9500d05e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb948005fd0 tx=0x7fb94802a4a0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.901+0000 7fb955500640 1 -- 172.21.15.90:0/1448131755 shutdown_connections 2024-09-10T23:14:49.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.901+0000 7fb955500640 1 --2- 172.21.15.90:0/1448131755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9500b65b0 0x7fb9500d05e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.901+0000 7fb955500640 1 --2- 172.21.15.90:0/1448131755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb95015bec0 0x7fb9500cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.901+0000 7fb955500640 1 -- 172.21.15.90:0/1448131755 >> 172.21.15.90:0/1448131755 conn(0x7fb9500d1dd0 msgr2=0x7fb9500d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:49.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.901+0000 7fb955500640 1 -- 172.21.15.90:0/1448131755 shutdown_connections 2024-09-10T23:14:49.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.901+0000 7fb955500640 1 -- 172.21.15.90:0/1448131755 wait complete. 2024-09-10T23:14:49.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.902+0000 7fb955500640 1 Processor -- start 2024-09-10T23:14:49.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.902+0000 7fb955500640 1 -- start start 2024-09-10T23:14:49.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.903+0000 7fb955500640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9500b65b0 0x7fb9501509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.903+0000 7fb955500640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9500d0180 0x7fb95014d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.903+0000 7fb955500640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb95015bec0 0x7fb95014dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.903+0000 7fb955500640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb9500cd500 con 0x7fb9500d0180 2024-09-10T23:14:49.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.903+0000 7fb955500640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb9500cd380 con 0x7fb9500b65b0 2024-09-10T23:14:49.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.903+0000 7fb955500640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb9500ceef0 con 0x7fb95015bec0 2024-09-10T23:14:49.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.903+0000 7fb94e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9500d0180 0x7fb95014d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.903+0000 7fb94e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9500d0180 0x7fb95014d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49172/0 (socket says 172.21.15.90:49172) 2024-09-10T23:14:49.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.903+0000 7fb94e7fc640 1 -- 172.21.15.90:0/2160315683 learned_addr learned my addr 172.21.15.90:0/2160315683 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:49.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.903+0000 7fb94f7fe640 1 --2- 172.21.15.90:0/2160315683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb95015bec0 0x7fb95014dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.903+0000 7fb94effd640 1 --2- 172.21.15.90:0/2160315683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9500b65b0 0x7fb9501509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.903+0000 7fb94e7fc640 1 -- 172.21.15.90:0/2160315683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb95015bec0 msgr2=0x7fb95014dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:49.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.903+0000 7fb94e7fc640 1 --2- 172.21.15.90:0/2160315683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb95015bec0 0x7fb95014dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.903+0000 7fb94e7fc640 1 -- 172.21.15.90:0/2160315683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9500b65b0 msgr2=0x7fb9501509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:49.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.903+0000 7fb94e7fc640 1 --2- 172.21.15.90:0/2160315683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9500b65b0 0x7fb9501509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.903+0000 7fb94e7fc640 1 -- 172.21.15.90:0/2160315683 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9500ca090 con 0x7fb9500d0180 2024-09-10T23:14:49.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.903+0000 7fb94e7fc640 1 --2- 172.21.15.90:0/2160315683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9500d0180 0x7fb95014d6e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb94400c460 tx=0x7fb94400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:49.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.904+0000 7fb9377fe640 1 -- 172.21.15.90:0/2160315683 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944016020 con 0x7fb9500d0180 2024-09-10T23:14:49.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.904+0000 7fb9377fe640 1 -- 172.21.15.90:0/2160315683 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb944012960 con 0x7fb9500d0180 2024-09-10T23:14:49.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.904+0000 7fb955500640 1 -- 172.21.15.90:0/2160315683 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9500ca370 con 0x7fb9500d0180 2024-09-10T23:14:49.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.904+0000 7fb9377fe640 1 -- 172.21.15.90:0/2160315683 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944012db0 con 0x7fb9500d0180 2024-09-10T23:14:49.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.904+0000 7fb955500640 1 -- 172.21.15.90:0/2160315683 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9500ca930 con 0x7fb9500d0180 2024-09-10T23:14:49.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.905+0000 7fb9377fe640 1 -- 172.21.15.90:0/2160315683 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb94401b400 con 0x7fb9500d0180 2024-09-10T23:14:49.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.906+0000 7fb9377fe640 1 --2- 172.21.15.90:0/2160315683 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb93c077f70 0x7fb93c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.906+0000 7fb9377fe640 1 -- 172.21.15.90:0/2160315683 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb944099fe0 con 0x7fb9500d0180 2024-09-10T23:14:49.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.906+0000 7fb94effd640 1 --2- 172.21.15.90:0/2160315683 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb93c077f70 0x7fb93c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.907+0000 7fb9582cc740 1 Processor -- start 2024-09-10T23:14:49.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.907+0000 7fb94effd640 1 --2- 172.21.15.90:0/2160315683 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb93c077f70 0x7fb93c07a430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb940005c40 tx=0x7fb94000a530 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:49.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.907+0000 7fb9582cc740 1 -- start start 2024-09-10T23:14:49.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.907+0000 7fb9582cc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e1ee1b0 0x55601e1c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.907+0000 7fb9582cc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e20ddf0 0x55601e20e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.907+0000 7fb9582cc740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e1c35f0 0x55601e1c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.907+0000 7fb9582cc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55601e13a820 con 0x55601e1ee1b0 2024-09-10T23:14:49.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.907+0000 7fb9582cc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55601e129c50 con 0x55601e20ddf0 2024-09-10T23:14:49.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.907+0000 7fb9582cc740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55601e12da60 con 0x55601e1c35f0 2024-09-10T23:14:49.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.908+0000 7fb94effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e1ee1b0 0x55601e1c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.908+0000 7fb94effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e1ee1b0 0x55601e1c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49186/0 (socket says 172.21.15.90:49186) 2024-09-10T23:14:49.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.908+0000 7fb94effd640 1 -- 172.21.15.90:0/3584305634 learned_addr learned my addr 172.21.15.90:0/3584305634 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:49.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.908+0000 7fb94f7fe640 1 --2- 172.21.15.90:0/3584305634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e1c35f0 0x55601e1c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.908+0000 7fb94e7fc640 1 --2- 172.21.15.90:0/3584305634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e20ddf0 0x55601e20e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.908+0000 7fb94effd640 1 -- 172.21.15.90:0/3584305634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e1c35f0 msgr2=0x55601e1c3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:14:49.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.908+0000 7fb94effd640 1 --2- 172.21.15.90:0/3584305634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e1c35f0 0x55601e1c3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.908+0000 7fb94effd640 1 -- 172.21.15.90:0/3584305634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e20ddf0 msgr2=0x55601e20e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:14:49.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.908+0000 7fb94effd640 1 --2- 172.21.15.90:0/3584305634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e20ddf0 0x55601e20e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.908+0000 7fb94effd640 1 -- 172.21.15.90:0/3584305634 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55601de8b850 con 0x55601e1ee1b0 2024-09-10T23:14:49.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.908+0000 7fb94effd640 1 --2- 172.21.15.90:0/3584305634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e1ee1b0 0x55601e1c5b20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb94000ac20 tx=0x7fb940012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7444175a73a3cf2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:49.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.908+0000 7fb934ff9640 1 -- 172.21.15.90:0/3584305634 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb940016070 con 0x55601e1ee1b0 2024-09-10T23:14:49.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.908+0000 7fb934ff9640 1 -- 172.21.15.90:0/3584305634 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb94001ba90 con 0x55601e1ee1b0 2024-09-10T23:14:49.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.908+0000 7fb934ff9640 1 -- 172.21.15.90:0/3584305634 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94001be40 con 0x55601e1ee1b0 2024-09-10T23:14:49.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.909+0000 7fb9582cc740 1 -- 172.21.15.90:0/3584305634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e1ee1b0 msgr2=0x55601e1c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:49.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.909+0000 7fb9582cc740 1 --2- 172.21.15.90:0/3584305634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e1ee1b0 0x55601e1c5b20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb94000ac20 tx=0x7fb940012000 comp rx=0 tx=0).stop 2024-09-10T23:14:49.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.909+0000 7fb9582cc740 1 -- 172.21.15.90:0/3584305634 shutdown_connections 2024-09-10T23:14:49.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.909+0000 7fb9582cc740 1 --2- 172.21.15.90:0/3584305634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e20ddf0 0x55601e20e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.909+0000 7fb9582cc740 1 --2- 172.21.15.90:0/3584305634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e1c35f0 0x55601e1c3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.909+0000 7fb9582cc740 1 --2- 172.21.15.90:0/3584305634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e1ee1b0 0x55601e1c5b20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.909+0000 7fb9582cc740 1 -- 172.21.15.90:0/3584305634 >> 172.21.15.90:0/3584305634 conn(0x55601e1c46a0 msgr2=0x55601e1c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:49.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.909+0000 7fb9582cc740 1 -- 172.21.15.90:0/3584305634 shutdown_connections 2024-09-10T23:14:49.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.909+0000 7fb9582cc740 1 -- 172.21.15.90:0/3584305634 wait complete. 2024-09-10T23:14:49.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.909+0000 7fb9582cc740 1 -- start start 2024-09-10T23:14:49.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.910+0000 7fb9582cc740 1 Processor -- start 2024-09-10T23:14:49.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.910+0000 7fb9582cc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 0x55601e206530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.910+0000 7fb9582cc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e20ddf0 0x55601e1f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.910+0000 7fb9582cc740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e1f1150 0x55601e1e9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.910+0000 7fb9582cc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55601de9a620 con 0x55601e20ddf0 2024-09-10T23:14:49.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.910+0000 7fb9582cc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55601e0cf5f0 con 0x55601e1ee1b0 2024-09-10T23:14:49.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.910+0000 7fb9582cc740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55601e1c2b30 con 0x55601e1f1150 2024-09-10T23:14:49.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.910+0000 7fb9582cc740 10 client.0 _ll_register_callbacks cb 0x55601e0d30a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:14:49.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.910+0000 7fb94e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e20ddf0 0x55601e1f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.910+0000 7fb94e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e20ddf0 0x55601e1f0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49188/0 (socket says 172.21.15.90:49188) 2024-09-10T23:14:49.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.910+0000 7fb94e7fc640 1 -- 172.21.15.90:0/2436976449 learned_addr learned my addr 172.21.15.90:0/2436976449 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:49.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb94effd640 1 --2- 172.21.15.90:0/2436976449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 0x55601e206530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb94f7fe640 1 --2- 172.21.15.90:0/2436976449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e1f1150 0x55601e1e9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb94e7fc640 1 -- 172.21.15.90:0/2436976449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e1f1150 msgr2=0x55601e1e9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:14:49.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb94e7fc640 1 --2- 172.21.15.90:0/2436976449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e1f1150 0x55601e1e9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb94e7fc640 1 -- 172.21.15.90:0/2436976449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 msgr2=0x55601e206530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:14:49.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb94e7fc640 1 --2- 172.21.15.90:0/2436976449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 0x55601e206530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb94e7fc640 1 -- 172.21.15.90:0/2436976449 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55601df026b0 con 0x55601e20ddf0 2024-09-10T23:14:49.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb94effd640 1 --2- 172.21.15.90:0/2436976449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 0x55601e206530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:49.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb94e7fc640 1 --2- 172.21.15.90:0/2436976449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e20ddf0 0x55601e1f0c10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb944098520 tx=0x7fb944061fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14824d329b56107 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:49.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb92dffb640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:14:49.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb92dffb640 1 -- 172.21.15.90:0/2436976449 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94406b040 con 0x55601e20ddf0 2024-09-10T23:14:49.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb92dffb640 1 -- 172.21.15.90:0/2436976449 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb9440618c0 con 0x55601e20ddf0 2024-09-10T23:14:49.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb9582cc740 1 -- 172.21.15.90:0/2436976449 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb94001ba90 con 0x55601e20ddf0 2024-09-10T23:14:49.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb92dffb640 1 -- 172.21.15.90:0/2436976449 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fb944096050 con 0x55601e20ddf0 2024-09-10T23:14:49.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb9582cc740 10 client.4671 fetch_fsmap learned FSMap version 7 2024-09-10T23:14:49.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb9582cc740 1 -- 172.21.15.90:0/2436976449 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55601e1f0150 con 0x55601e20ddf0 2024-09-10T23:14:49.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb92dffb640 1 -- 172.21.15.90:0/2436976449 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb94001ba90 con 0x55601e20ddf0 2024-09-10T23:14:49.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb92dffb640 1 -- 172.21.15.90:0/2436976449 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7fb94405dda0 con 0x55601e20ddf0 2024-09-10T23:14:49.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb9582cc740 10 client.4671 fetch_fsmap finished waiting for FSMap version 7 2024-09-10T23:14:49.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb9582cc740 10 client.4671 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:14:49.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb9582cc740 20 client.4671 populate_metadata read hostname 'smithi090' 2024-09-10T23:14:49.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb9582cc740 1 --2- 172.21.15.90:0/2436976449 >> [v2:172.21.15.90:6833/1573070489,v1:172.21.15.90:6835/1573070489] conn(0x55601e1d8060 0x55601e1d7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb9582cc740 4 client.4671 mds_command: new command op to 4368 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:14:49.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb9582cc740 1 -- 172.21.15.90:0/2436976449 --> [v2:172.21.15.90:6833/1573070489,v1:172.21.15.90:6835/1573070489] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55601e13c770 con 0x55601e1d8060 2024-09-10T23:14:49.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.911+0000 7fb94effd640 1 --2- 172.21.15.90:0/2436976449 >> [v2:172.21.15.90:6833/1573070489,v1:172.21.15.90:6835/1573070489] conn(0x55601e1d8060 0x55601e1d7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.912+0000 7fb94effd640 1 --2- 172.21.15.90:0/2436976449 >> [v2:172.21.15.90:6833/1573070489,v1:172.21.15.90:6835/1573070489] conn(0x55601e1d8060 0x55601e1d7080 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38bf31b3bdb4378a server_cookie=242b17f281b6abff in_seq=0 out_seq=0 2024-09-10T23:14:49.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.912+0000 7fb92dffb640 10 client.4671 ms_handle_connect on v2:172.21.15.90:6833/1573070489 2024-09-10T23:14:49.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.912+0000 7fb92dffb640 1 -- 172.21.15.90:0/2436976449 <== mds.0 v2:172.21.15.90:6833/1573070489 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55601e13c770 con 0x55601e1d8060 2024-09-10T23:14:49.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.912+0000 7fb92dffb640 10 client.4671 handle_command_reply: tid=0 2024-09-10T23:14:49.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.912+0000 7fb9582cc740 1 client.4671 shutdown 2024-09-10T23:14:49.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.913+0000 7fb9582cc740 1 -- 172.21.15.90:0/2436976449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e20ddf0 msgr2=0x55601e1f0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:49.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.913+0000 7fb9582cc740 1 --2- 172.21.15.90:0/2436976449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e20ddf0 0x55601e1f0c10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb944098520 tx=0x7fb944061fd0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.913+0000 7fb9582cc740 1 -- 172.21.15.90:0/2436976449 shutdown_connections 2024-09-10T23:14:49.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.913+0000 7fb9582cc740 1 --2- 172.21.15.90:0/2436976449 >> [v2:172.21.15.90:6833/1573070489,v1:172.21.15.90:6835/1573070489] conn(0x55601e1d8060 0x55601e1d7080 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.913+0000 7fb9582cc740 1 --2- 172.21.15.90:0/2436976449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e1f1150 0x55601e1e9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.913+0000 7fb9582cc740 1 --2- 172.21.15.90:0/2436976449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e20ddf0 0x55601e1f0c10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.913+0000 7fb9582cc740 1 --2- 172.21.15.90:0/2436976449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 0x55601e206530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.913+0000 7fb92dffb640 0 client.4671 ms_handle_reset on v2:172.21.15.90:6833/1573070489 2024-09-10T23:14:49.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.913+0000 7fb9582cc740 1 -- 172.21.15.90:0/2436976449 >> 172.21.15.90:0/2436976449 conn(0x55601e1c35f0 msgr2=0x55601e1ee590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:49.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.913+0000 7fb9582cc740 1 -- 172.21.15.90:0/2436976449 shutdown_connections 2024-09-10T23:14:49.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.913+0000 7fb9582cc740 1 -- 172.21.15.90:0/2436976449 wait complete. 2024-09-10T23:14:49.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.913+0000 7fb9582cc740 20 client.4671 trim_cache size 0 max 16384 2024-09-10T23:14:49.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.931+0000 7fb9582cc740 1 Processor -- start 2024-09-10T23:14:49.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.931+0000 7fb9582cc740 1 -- start start 2024-09-10T23:14:49.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.931+0000 7fb9582cc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 0x55601e20d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.931+0000 7fb9582cc740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e1f1150 0x55601e1f0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.931+0000 7fb9582cc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e20ddf0 0x55601e230d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.931+0000 7fb9582cc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb9501fe130 con 0x55601e20ddf0 2024-09-10T23:14:49.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.931+0000 7fb9582cc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb9501f69a0 con 0x55601e1ee1b0 2024-09-10T23:14:49.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.931+0000 7fb9582cc740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb9500b1750 con 0x55601e1f1150 2024-09-10T23:14:49.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.931+0000 7fb94f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e20ddf0 0x55601e230d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.931+0000 7fb94f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e20ddf0 0x55601e230d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49196/0 (socket says 172.21.15.90:49196) 2024-09-10T23:14:49.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.931+0000 7fb94f7fe640 1 -- 172.21.15.90:0/3519974180 learned_addr learned my addr 172.21.15.90:0/3519974180 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:49.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.932+0000 7fb94effd640 1 --2- 172.21.15.90:0/3519974180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 0x55601e20d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.932+0000 7fb94e7fc640 1 --2- 172.21.15.90:0/3519974180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e1f1150 0x55601e1f0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.932+0000 7fb94f7fe640 1 -- 172.21.15.90:0/3519974180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e1f1150 msgr2=0x55601e1f0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:14:49.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.932+0000 7fb94f7fe640 1 --2- 172.21.15.90:0/3519974180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e1f1150 0x55601e1f0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.932+0000 7fb94f7fe640 1 -- 172.21.15.90:0/3519974180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 msgr2=0x55601e20d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:14:49.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.932+0000 7fb94f7fe640 1 --2- 172.21.15.90:0/3519974180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 0x55601e20d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.932+0000 7fb94f7fe640 1 -- 172.21.15.90:0/3519974180 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55601e207f60 con 0x55601e20ddf0 2024-09-10T23:14:49.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.932+0000 7fb94effd640 1 --2- 172.21.15.90:0/3519974180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 0x55601e20d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:49.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.932+0000 7fb94f7fe640 1 --2- 172.21.15.90:0/3519974180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e20ddf0 0x55601e230d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb9480099f0 tx=0x7fb9480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9824a396ba52c87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:49.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.932+0000 7fb92ffff640 1 -- 172.21.15.90:0/3519974180 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948035040 con 0x55601e20ddf0 2024-09-10T23:14:49.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.932+0000 7fb92ffff640 1 -- 172.21.15.90:0/3519974180 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9480035f0 con 0x55601e20ddf0 2024-09-10T23:14:49.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.932+0000 7fb92ffff640 1 -- 172.21.15.90:0/3519974180 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948003a40 con 0x55601e20ddf0 2024-09-10T23:14:49.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.933+0000 7fb9582cc740 1 -- 172.21.15.90:0/3519974180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e20ddf0 msgr2=0x55601e230d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:49.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.933+0000 7fb9582cc740 1 --2- 172.21.15.90:0/3519974180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e20ddf0 0x55601e230d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb9480099f0 tx=0x7fb9480046c0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.933+0000 7fb9582cc740 1 -- 172.21.15.90:0/3519974180 shutdown_connections 2024-09-10T23:14:49.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.933+0000 7fb9582cc740 1 --2- 172.21.15.90:0/3519974180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e20ddf0 0x55601e230d90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.933+0000 7fb9582cc740 1 --2- 172.21.15.90:0/3519974180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e1f1150 0x55601e1f0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.933+0000 7fb9582cc740 1 --2- 172.21.15.90:0/3519974180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 0x55601e20d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.933+0000 7fb9582cc740 1 -- 172.21.15.90:0/3519974180 >> 172.21.15.90:0/3519974180 conn(0x55601e1c35f0 msgr2=0x55601e20e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:49.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.933+0000 7fb9582cc740 1 -- 172.21.15.90:0/3519974180 shutdown_connections 2024-09-10T23:14:49.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.933+0000 7fb9582cc740 1 -- 172.21.15.90:0/3519974180 wait complete. 2024-09-10T23:14:49.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.933+0000 7fb9582cc740 1 -- start start 2024-09-10T23:14:49.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.933+0000 7fb9582cc740 1 Processor -- start 2024-09-10T23:14:49.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb9582cc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 0x55601e1ecc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb9582cc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e1f1150 0x55601e21f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb9582cc740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e20ddf0 0x55601e1d71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb9582cc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55601e1d7ee0 con 0x55601e1f1150 2024-09-10T23:14:49.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb9582cc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55601e1e73f0 con 0x55601e1ee1b0 2024-09-10T23:14:49.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb9582cc740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55601e1d8500 con 0x55601e20ddf0 2024-09-10T23:14:49.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb9582cc740 10 client.0 _ll_register_callbacks cb 0x7fb94406b2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:14:49.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb94e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e1f1150 0x55601e21f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb94e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e1f1150 0x55601e21f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49202/0 (socket says 172.21.15.90:49202) 2024-09-10T23:14:49.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb94e7fc640 1 -- 172.21.15.90:0/3953613312 learned_addr learned my addr 172.21.15.90:0/3953613312 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:49.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb94effd640 1 --2- 172.21.15.90:0/3953613312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 0x55601e1ecc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb94f7fe640 1 --2- 172.21.15.90:0/3953613312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e20ddf0 0x55601e1d71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb94e7fc640 1 -- 172.21.15.90:0/3953613312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e20ddf0 msgr2=0x55601e1d71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:14:49.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb94e7fc640 1 --2- 172.21.15.90:0/3953613312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e20ddf0 0x55601e1d71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb94e7fc640 1 -- 172.21.15.90:0/3953613312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 msgr2=0x55601e1ecc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:14:49.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb94e7fc640 1 --2- 172.21.15.90:0/3953613312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 0x55601e1ecc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb94e7fc640 1 -- 172.21.15.90:0/3953613312 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55601e1f1590 con 0x55601e1f1150 2024-09-10T23:14:49.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb94f7fe640 1 --2- 172.21.15.90:0/3953613312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e20ddf0 0x55601e1d71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:49.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb94effd640 1 --2- 172.21.15.90:0/3953613312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 0x55601e1ecc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:49.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb94e7fc640 1 --2- 172.21.15.90:0/3953613312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e1f1150 0x55601e21f6e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb944098840 tx=0x7fb944061af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7972467695445ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:49.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.934+0000 7fb92dffb640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:14:49.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.935+0000 7fb92dffb640 1 -- 172.21.15.90:0/3953613312 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94406b040 con 0x55601e1f1150 2024-09-10T23:14:49.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.935+0000 7fb92dffb640 1 -- 172.21.15.90:0/3953613312 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb944069290 con 0x55601e1f1150 2024-09-10T23:14:49.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.935+0000 7fb9582cc740 1 -- 172.21.15.90:0/3953613312 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9480035f0 con 0x55601e1f1150 2024-09-10T23:14:49.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.935+0000 7fb92dffb640 1 -- 172.21.15.90:0/3953613312 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fb944062220 con 0x55601e1f1150 2024-09-10T23:14:49.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.935+0000 7fb9582cc740 10 client.4677 fetch_fsmap learned FSMap version 7 2024-09-10T23:14:49.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.935+0000 7fb9582cc740 1 -- 172.21.15.90:0/3953613312 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55601e21fc20 con 0x55601e1f1150 2024-09-10T23:14:49.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.935+0000 7fb92dffb640 1 -- 172.21.15.90:0/3953613312 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9480035f0 con 0x55601e1f1150 2024-09-10T23:14:49.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.935+0000 7fb92dffb640 1 -- 172.21.15.90:0/3953613312 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7fb944061120 con 0x55601e1f1150 2024-09-10T23:14:49.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.935+0000 7fb9582cc740 10 client.4677 fetch_fsmap finished waiting for FSMap version 7 2024-09-10T23:14:49.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.935+0000 7fb9582cc740 10 client.4677 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:14:49.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.935+0000 7fb9582cc740 20 client.4677 populate_metadata read hostname 'smithi090' 2024-09-10T23:14:49.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.935+0000 7fb9582cc740 1 --2- 172.21.15.90:0/3953613312 >> [v2:172.21.15.90:6833/1573070489,v1:172.21.15.90:6835/1573070489] conn(0x55601e204eb0 0x55601e205290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:49.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.935+0000 7fb9582cc740 4 client.4677 mds_command: new command op to 4368 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:14:49.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.935+0000 7fb9582cc740 1 -- 172.21.15.90:0/3953613312 --> [v2:172.21.15.90:6833/1573070489,v1:172.21.15.90:6835/1573070489] -- command(tid 0: {"prefix": "status"}) -- 0x55601e138220 con 0x55601e204eb0 2024-09-10T23:14:49.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.935+0000 7fb94effd640 1 --2- 172.21.15.90:0/3953613312 >> [v2:172.21.15.90:6833/1573070489,v1:172.21.15.90:6835/1573070489] conn(0x55601e204eb0 0x55601e205290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:49.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.935+0000 7fb92dffb640 10 client.4677 ms_handle_connect on v2:172.21.15.90:6833/1573070489 2024-09-10T23:14:49.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.935+0000 7fb94effd640 1 --2- 172.21.15.90:0/3953613312 >> [v2:172.21.15.90:6833/1573070489,v1:172.21.15.90:6835/1573070489] conn(0x55601e204eb0 0x55601e205290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2ba91aa027acd40 server_cookie=67039fcea1d48f1a in_seq=0 out_seq=0 2024-09-10T23:14:49.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb92dffb640 1 -- 172.21.15.90:0/3953613312 <== mds.0 v2:172.21.15.90:6833/1573070489 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x55601e138220 con 0x55601e204eb0 2024-09-10T23:14:49.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb92dffb640 10 client.4677 handle_command_reply: tid=0 2024-09-10T23:14:49.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb9582cc740 1 client.4677 shutdown 2024-09-10T23:14:49.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb9582cc740 1 -- 172.21.15.90:0/3953613312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e1f1150 msgr2=0x55601e21f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:49.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb9582cc740 1 --2- 172.21.15.90:0/3953613312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e1f1150 0x55601e21f6e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb944098840 tx=0x7fb944061af0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb9582cc740 1 -- 172.21.15.90:0/3953613312 shutdown_connections 2024-09-10T23:14:49.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb9582cc740 1 --2- 172.21.15.90:0/3953613312 >> [v2:172.21.15.90:6833/1573070489,v1:172.21.15.90:6835/1573070489] conn(0x55601e204eb0 0x55601e205290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb9582cc740 1 --2- 172.21.15.90:0/3953613312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55601e20ddf0 0x55601e1d71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb9582cc740 1 --2- 172.21.15.90:0/3953613312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55601e1f1150 0x55601e21f6e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb92dffb640 0 client.4677 ms_handle_reset on v2:172.21.15.90:6833/1573070489 2024-09-10T23:14:49.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb9582cc740 1 --2- 172.21.15.90:0/3953613312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55601e1ee1b0 0x55601e1ecc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb9582cc740 1 -- 172.21.15.90:0/3953613312 >> 172.21.15.90:0/3953613312 conn(0x55601e1c35f0 msgr2=0x55601e1e6120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:49.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb9582cc740 1 -- 172.21.15.90:0/3953613312 shutdown_connections 2024-09-10T23:14:49.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb9582cc740 1 -- 172.21.15.90:0/3953613312 wait complete. 2024-09-10T23:14:49.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb9582cc740 20 client.4677 trim_cache size 0 max 16384 2024-09-10T23:14:49.946 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:14:49.947 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd", 2024-09-10T23:14:49.947 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2024-09-10T23:14:49.947 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4368, 2024-09-10T23:14:49.947 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-09-10T23:14:49.947 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-09-10T23:14:49.947 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2024-09-10T23:14:49.947 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 13.793525744, 2024-09-10T23:14:49.947 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 7, 2024-09-10T23:14:49.947 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 23, 2024-09-10T23:14:49.947 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 23, 2024-09-10T23:14:49.947 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 19.157959929 2024-09-10T23:14:49.948 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:14:49.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb955500640 1 -- 172.21.15.90:0/2160315683 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb93c077f70 msgr2=0x7fb93c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:49.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb955500640 1 --2- 172.21.15.90:0/2160315683 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb93c077f70 0x7fb93c07a430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb940005c40 tx=0x7fb94000a530 comp rx=0 tx=0).stop 2024-09-10T23:14:49.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb955500640 1 -- 172.21.15.90:0/2160315683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9500d0180 msgr2=0x7fb95014d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:49.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb955500640 1 --2- 172.21.15.90:0/2160315683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9500d0180 0x7fb95014d6e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb94400c460 tx=0x7fb94400c920 comp rx=0 tx=0).stop 2024-09-10T23:14:49.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb955500640 1 -- 172.21.15.90:0/2160315683 shutdown_connections 2024-09-10T23:14:49.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb955500640 1 --2- 172.21.15.90:0/2160315683 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb93c077f70 0x7fb93c07a430 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb955500640 1 --2- 172.21.15.90:0/2160315683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb95015bec0 0x7fb95014dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb955500640 1 --2- 172.21.15.90:0/2160315683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9500d0180 0x7fb95014d6e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb955500640 1 --2- 172.21.15.90:0/2160315683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9500b65b0 0x7fb9501509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:49.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb955500640 1 -- 172.21.15.90:0/2160315683 >> 172.21.15.90:0/2160315683 conn(0x7fb9500d1dd0 msgr2=0x7fb9500c78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:49.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb955500640 1 -- 172.21.15.90:0/2160315683 shutdown_connections 2024-09-10T23:14:49.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:49.936+0000 7fb955500640 1 -- 172.21.15.90:0/2160315683 wait complete. 2024-09-10T23:14:49.950 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T23:14:49.979 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T23:14:49.979 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-10T23:14:49.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:49.979 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-10T23:14:49.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:49.995 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link delete ceph-brx 2024-09-10T23:14:50.062 INFO:teuthology.orchestra.run.smithi090.stderr:Cannot find device "ceph-brx" 2024-09-10T23:14:50.063 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:14:50.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:50.064 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-10T23:14:50.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:50.119 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link delete ceph-brx 2024-09-10T23:14:50.186 INFO:teuthology.orchestra.run.smithi090.stderr:Cannot find device "ceph-brx" 2024-09-10T23:14:50.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:14:50.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:50.187 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-09-10T23:14:50.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:50.207 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link delete ceph-brx 2024-09-10T23:14:50.278 INFO:teuthology.orchestra.run.smithi171.stderr:Cannot find device "ceph-brx" 2024-09-10T23:14:50.279 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:14:50.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:50.280 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-09-10T23:14:50.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:50.339 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link delete ceph-brx 2024-09-10T23:14:50.411 INFO:teuthology.orchestra.run.smithi171.stderr:Cannot find device "ceph-brx" 2024-09-10T23:14:50.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:14:50.413 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-10T23:14:50.413 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T23:14:50.413 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:14:50.414 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:14:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.516+0000 7fed4696b640 1 -- 172.21.15.90:0/364217654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed400d07f0 msgr2=0x7fed400ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.516+0000 7fed4696b640 1 --2- 172.21.15.90:0/364217654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed400d07f0 0x7fed400ce5f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fed400764f0 tx=0x7fed3802aa30 comp rx=0 tx=0).stop 2024-09-10T23:14:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.516+0000 7fed4696b640 1 -- 172.21.15.90:0/364217654 shutdown_connections 2024-09-10T23:14:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.516+0000 7fed4696b640 1 --2- 172.21.15.90:0/364217654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed400d07f0 0x7fed400ce5f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.516+0000 7fed4696b640 1 --2- 172.21.15.90:0/364217654 >> v2:172.21.15.171:3300/0 conn(0x7fed400cfcc0 0x7fed400ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.516+0000 7fed4696b640 1 --2- 172.21.15.90:0/364217654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed400d0410 0x7fed400b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.516+0000 7fed4696b640 1 -- 172.21.15.90:0/364217654 >> 172.21.15.90:0/364217654 conn(0x7fed400d1dc0 msgr2=0x7fed400d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.516+0000 7fed4696b640 1 -- 172.21.15.90:0/364217654 shutdown_connections 2024-09-10T23:14:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.516+0000 7fed4696b640 1 -- 172.21.15.90:0/364217654 wait complete. 2024-09-10T23:14:50.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.517+0000 7fed4696b640 1 Processor -- start 2024-09-10T23:14:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.518+0000 7fed4696b640 1 -- start start 2024-09-10T23:14:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.518+0000 7fed4696b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed400cfcc0 0x7fed400c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.518+0000 7fed4696b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed400d0410 0x7fed40150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.518+0000 7fed4696b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed400d07f0 0x7fed401f6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.518+0000 7fed4696b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fed40160030 con 0x7fed400d0410 2024-09-10T23:14:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.518+0000 7fed4696b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fed4015feb0 con 0x7fed400d07f0 2024-09-10T23:14:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.518+0000 7fed4696b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fed401601b0 con 0x7fed400cfcc0 2024-09-10T23:14:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.518+0000 7fed37fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed400d0410 0x7fed40150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.518+0000 7fed37fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed400d0410 0x7fed40150240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49218/0 (socket says 172.21.15.90:49218) 2024-09-10T23:14:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.518+0000 7fed37fff640 1 -- 172.21.15.90:0/2242367660 learned_addr learned my addr 172.21.15.90:0/2242367660 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.518+0000 7fed3ffff640 1 --2- 172.21.15.90:0/2242367660 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed400cfcc0 0x7fed400c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.518+0000 7fed44f08640 1 --2- 172.21.15.90:0/2242367660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed400d07f0 0x7fed401f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.519+0000 7fed37fff640 1 -- 172.21.15.90:0/2242367660 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed400cfcc0 msgr2=0x7fed400c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.519+0000 7fed37fff640 1 --2- 172.21.15.90:0/2242367660 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed400cfcc0 0x7fed400c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.519+0000 7fed37fff640 1 -- 172.21.15.90:0/2242367660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed400d07f0 msgr2=0x7fed401f6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.519+0000 7fed37fff640 1 --2- 172.21.15.90:0/2242367660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed400d07f0 0x7fed401f6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.519+0000 7fed37fff640 1 -- 172.21.15.90:0/2242367660 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed40159d90 con 0x7fed400d0410 2024-09-10T23:14:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.519+0000 7fed44f08640 1 --2- 172.21.15.90:0/2242367660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed400d07f0 0x7fed401f6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.519+0000 7fed37fff640 1 --2- 172.21.15.90:0/2242367660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed400d0410 0x7fed40150240 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fed2800d770 tx=0x7fed2800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.519+0000 7fed3d7fa640 1 -- 172.21.15.90:0/2242367660 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28017070 con 0x7fed400d0410 2024-09-10T23:14:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.519+0000 7fed3d7fa640 1 -- 172.21.15.90:0/2242367660 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed28009d20 con 0x7fed400d0410 2024-09-10T23:14:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.519+0000 7fed3d7fa640 1 -- 172.21.15.90:0/2242367660 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed280106c0 con 0x7fed400d0410 2024-09-10T23:14:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.519+0000 7fed4696b640 1 -- 172.21.15.90:0/2242367660 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed400c7650 con 0x7fed400d0410 2024-09-10T23:14:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.519+0000 7fed4696b640 1 -- 172.21.15.90:0/2242367660 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed40150780 con 0x7fed400d0410 2024-09-10T23:14:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.520+0000 7fed4696b640 1 -- 172.21.15.90:0/2242367660 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed4006ac40 con 0x7fed400d0410 2024-09-10T23:14:50.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.520+0000 7fed3d7fa640 1 -- 172.21.15.90:0/2242367660 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fed28010860 con 0x7fed400d0410 2024-09-10T23:14:50.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.521+0000 7fed3d7fa640 1 --2- 172.21.15.90:0/2242367660 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fed20077f70 0x7fed2007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:50.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.521+0000 7fed3d7fa640 1 -- 172.21.15.90:0/2242367660 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fed2809a0c0 con 0x7fed400d0410 2024-09-10T23:14:50.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.521+0000 7fed3ffff640 1 --2- 172.21.15.90:0/2242367660 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fed20077f70 0x7fed2007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:50.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.522+0000 7fed3ffff640 1 --2- 172.21.15.90:0/2242367660 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fed20077f70 0x7fed2007a430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fed30005fd0 tx=0x7fed3000b390 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:50.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.525+0000 7fed3d7fa640 1 -- 172.21.15.90:0/2242367660 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fed4006ac40 con 0x7fed400d0410 2024-09-10T23:14:50.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.736+0000 7fed4696b640 1 -- 172.21.15.90:0/2242367660 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fed400b0db0 con 0x7fed400d0410 2024-09-10T23:14:50.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.737+0000 7fed3d7fa640 1 -- 172.21.15.90:0/2242367660 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fed400b0db0 con 0x7fed400d0410 2024-09-10T23:14:50.738 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:14:50.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.739+0000 7fed4696b640 1 -- 172.21.15.90:0/2242367660 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fed20077f70 msgr2=0x7fed2007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:50.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.739+0000 7fed4696b640 1 --2- 172.21.15.90:0/2242367660 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fed20077f70 0x7fed2007a430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fed30005fd0 tx=0x7fed3000b390 comp rx=0 tx=0).stop 2024-09-10T23:14:50.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.739+0000 7fed4696b640 1 -- 172.21.15.90:0/2242367660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed400d0410 msgr2=0x7fed40150240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:50.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.739+0000 7fed4696b640 1 --2- 172.21.15.90:0/2242367660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed400d0410 0x7fed40150240 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fed2800d770 tx=0x7fed2800dc30 comp rx=0 tx=0).stop 2024-09-10T23:14:50.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.739+0000 7fed4696b640 1 -- 172.21.15.90:0/2242367660 shutdown_connections 2024-09-10T23:14:50.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.739+0000 7fed4696b640 1 --2- 172.21.15.90:0/2242367660 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fed20077f70 0x7fed2007a430 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:50.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.739+0000 7fed4696b640 1 --2- 172.21.15.90:0/2242367660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed400d07f0 0x7fed401f6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:50.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.739+0000 7fed4696b640 1 --2- 172.21.15.90:0/2242367660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed400d0410 0x7fed40150240 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:50.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.739+0000 7fed4696b640 1 --2- 172.21.15.90:0/2242367660 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed400cfcc0 0x7fed400c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:50.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.739+0000 7fed4696b640 1 -- 172.21.15.90:0/2242367660 >> 172.21.15.90:0/2242367660 conn(0x7fed400d1dc0 msgr2=0x7fed400b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:50.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.739+0000 7fed4696b640 1 -- 172.21.15.90:0/2242367660 shutdown_connections 2024-09-10T23:14:50.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50.739+0000 7fed4696b640 1 -- 172.21.15.90:0/2242367660 wait complete. 2024-09-10T23:14:50.751 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:14:50.752 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:14:50.752 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2024-09-10T23:14:50.752 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:14:50.752 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:14:50.752 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:14:50.752 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:14:50.753 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:14:50.753 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:14:50.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:50.753 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2024-09-10T23:14:50.769 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:14:50.769 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:14:50.769 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:14:50.769 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:50.770 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-10T23:14:50.770 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:50.770 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:14:50.770 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:50.770 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2024-09-10T23:14:50.770 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:14:50.770 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:50.770 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2024-09-10T23:14:50.770 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:14:50.770 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:50.770 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:14:50.770 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:50.770 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:14:50.770 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42757sec preferred_lft 42757sec 2024-09-10T23:14:50.771 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link noprefixroute 2024-09-10T23:14:50.771 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:50.771 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T23:14:50.771 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:50.771 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:14:50.771 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add name ceph-brx type bridge 2024-09-10T23:14:50.771 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip addr flush dev ceph-brx 2024-09-10T23:14:50.771 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set ceph-brx up 2024-09-10T23:14:50.772 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T23:14:50.772 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:14:50.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:50.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:50.969 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:14:50.994 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-09-10T23:14:50.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:50.996 DEBUG:teuthology.orchestra.run.smithi090:> route 2024-09-10T23:14:51.063 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2024-09-10T23:14:51.063 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:14:51.063 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:14:51.063 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:14:51.063 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:14:51.064 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:51.064 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:14:51.064 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:14:51.064 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:14:51.064 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:14:51.064 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:14:51.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:51.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:51.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:51.349 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-10T23:14:51.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:51.366 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list-id 2024-09-10T23:14:51.421 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:51.421 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:14:51.421 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:14:51.421 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T23:14:51.421 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:14:51.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:51.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:51.538 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T23:14:51.538 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:51.538 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:14:51.538 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T23:14:51.538 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T23:14:51.539 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T23:14:51.539 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T23:14:51.539 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T23:14:51.539 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:14:51.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:51.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:51.656 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:51.656 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:14:51.656 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2024-09-10T23:14:51.656 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T23:14:51.656 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:14:51.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:51.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:51.732 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:14:51.732 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:14:51.748 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:14:51.754 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:14:51.754 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:14:51.809 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:14:51.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:51.809 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:14:51.896 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:14:51.897 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:14:51.897 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:14:52.041 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:14:52.041 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:14:52.042 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:14:52.042 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:14:52.042 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:14:52.047 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:14:52.047 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:14:52.047 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:14:52.047 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:14:52.047 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:14:52.047 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:14:52.047 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:14:52.047 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:14:52.048 INFO:teuthology.orchestra.run.smithi090.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T23:14:52.048 INFO:teuthology.orchestra.run.smithi090.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:14:52.048 INFO:teuthology.orchestra.run.smithi090.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:14:52.049 INFO:teuthology.orchestra.run.smithi090.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:14:52.049 INFO:teuthology.orchestra.run.smithi090.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:14:52.050 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:14:52.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:52.050 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:14:52.075 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:14:52.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:14:52.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:52.178 INFO:teuthology.orchestra.run.smithi090.stdout:client4582 2024-09-10T23:14:52.179 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:14:52.179 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:14:52.195 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:14:52.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:14:52.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:52.295 INFO:teuthology.orchestra.run.smithi090.stdout:client4582 2024-09-10T23:14:52.295 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:14:52.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:14:52.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:52.357 INFO:teuthology.orchestra.run.smithi090.stdout:client4582 2024-09-10T23:14:52.357 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd.client4582/status') 2024-09-10T23:14:52.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:52.419 INFO:teuthology.orchestra.run.smithi090.stdout:instance: client.4582 (3)172.21.15.90:0/1319601419 2024-09-10T23:14:52.419 INFO:teuthology.orchestra.run.smithi090.stdout:blocklisted: false 2024-09-10T23:14:52.420 INFO:teuthology.orchestra.run.smithi090.stderr:0+1 records in 2024-09-10T23:14:52.420 INFO:teuthology.orchestra.run.smithi090.stderr:0+1 records out 2024-09-10T23:14:52.420 INFO:teuthology.orchestra.run.smithi090.stderr:70 bytes copied, 2.2261e-05 s, 3.1 MB/s 2024-09-10T23:14:52.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:52.426 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-10T23:14:52.426 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T23:14:52.426 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T23:14:52.426 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:14:52.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.527+0000 7fcc877ec640 1 -- 172.21.15.90:0/792454733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc6c004800 msgr2=0x7fcc6c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:52.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.527+0000 7fcc877ec640 1 --2- 172.21.15.90:0/792454733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc6c004800 0x7fcc6c004c80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcc70006f90 tx=0x7fcc6c005830 comp rx=0 tx=0).stop 2024-09-10T23:14:52.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.527+0000 7fcc85d89640 1 -- 172.21.15.90:0/792454733 reap_dead start 2024-09-10T23:14:52.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.527+0000 7fcc877ec640 1 -- 172.21.15.90:0/792454733 shutdown_connections 2024-09-10T23:14:52.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.527+0000 7fcc877ec640 1 -- 172.21.15.90:0/792454733 >> 172.21.15.90:0/792454733 conn(0x7fcc800cc850 msgr2=0x7fcc800ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:52.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.527+0000 7fcc877ec640 1 -- 172.21.15.90:0/792454733 shutdown_connections 2024-09-10T23:14:52.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.527+0000 7fcc877ec640 1 -- 172.21.15.90:0/792454733 wait complete. 2024-09-10T23:14:52.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.528+0000 7fcc877ec640 1 Processor -- start 2024-09-10T23:14:52.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.528+0000 7fcc877ec640 1 -- start start 2024-09-10T23:14:52.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.529+0000 7fcc877ec640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc6c004800 0x7fcc801f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:52.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.529+0000 7fcc877ec640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc801f6130 0x7fcc800c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:52.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.529+0000 7fcc877ec640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc800c6ea0 0x7fcc800b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:52.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.529+0000 7fcc877ec640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcc800cde50 con 0x7fcc6c004800 2024-09-10T23:14:52.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.529+0000 7fcc877ec640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcc800cdcd0 con 0x7fcc801f6130 2024-09-10T23:14:52.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.529+0000 7fcc877ec640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcc800cdfd0 con 0x7fcc800c6ea0 2024-09-10T23:14:52.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.529+0000 7fcc85588640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc6c004800 0x7fcc801f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:52.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.529+0000 7fcc85588640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc6c004800 0x7fcc801f20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49234/0 (socket says 172.21.15.90:49234) 2024-09-10T23:14:52.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.529+0000 7fcc85588640 1 -- 172.21.15.90:0/1475855659 learned_addr learned my addr 172.21.15.90:0/1475855659 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:52.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.529+0000 7fcc85d89640 1 --2- 172.21.15.90:0/1475855659 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc800c6ea0 0x7fcc800b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:52.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.529+0000 7fcc84d87640 1 --2- 172.21.15.90:0/1475855659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc801f6130 0x7fcc800c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:52.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.529+0000 7fcc85588640 1 -- 172.21.15.90:0/1475855659 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc800c6ea0 msgr2=0x7fcc800b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:52.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.529+0000 7fcc85588640 1 --2- 172.21.15.90:0/1475855659 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc800c6ea0 0x7fcc800b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:52.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.529+0000 7fcc85588640 1 -- 172.21.15.90:0/1475855659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc801f6130 msgr2=0x7fcc800c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:52.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.529+0000 7fcc85588640 1 --2- 172.21.15.90:0/1475855659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc801f6130 0x7fcc800c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:52.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.529+0000 7fcc85588640 1 -- 172.21.15.90:0/1475855659 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc8009d800 con 0x7fcc6c004800 2024-09-10T23:14:52.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.529+0000 7fcc84d87640 1 --2- 172.21.15.90:0/1475855659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc801f6130 0x7fcc800c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:52.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.530+0000 7fcc85588640 1 --2- 172.21.15.90:0/1475855659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc6c004800 0x7fcc801f20e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00b5e0 tx=0x7fcc7c00baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:52.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.530+0000 7fcc75ffb640 1 -- 172.21.15.90:0/1475855659 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c010ae0 con 0x7fcc6c004800 2024-09-10T23:14:52.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.530+0000 7fcc75ffb640 1 -- 172.21.15.90:0/1475855659 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc7c015070 con 0x7fcc6c004800 2024-09-10T23:14:52.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.530+0000 7fcc75ffb640 1 -- 172.21.15.90:0/1475855659 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c01a470 con 0x7fcc6c004800 2024-09-10T23:14:52.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.530+0000 7fcc877ec640 1 -- 172.21.15.90:0/1475855659 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc801f2760 con 0x7fcc6c004800 2024-09-10T23:14:52.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.530+0000 7fcc877ec640 1 -- 172.21.15.90:0/1475855659 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc801f2d20 con 0x7fcc6c004800 2024-09-10T23:14:52.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.531+0000 7fcc877ec640 1 -- 172.21.15.90:0/1475855659 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc800ca420 con 0x7fcc6c004800 2024-09-10T23:14:52.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.532+0000 7fcc75ffb640 1 -- 172.21.15.90:0/1475855659 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcc7c022030 con 0x7fcc6c004800 2024-09-10T23:14:52.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.532+0000 7fcc75ffb640 1 --2- 172.21.15.90:0/1475855659 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcc64077fa0 0x7fcc6407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:52.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.532+0000 7fcc75ffb640 1 -- 172.21.15.90:0/1475855659 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcc7c09a560 con 0x7fcc6c004800 2024-09-10T23:14:52.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.532+0000 7fcc84d87640 1 --2- 172.21.15.90:0/1475855659 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcc64077fa0 0x7fcc6407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:52.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.533+0000 7fcc84d87640 1 --2- 172.21.15.90:0/1475855659 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcc64077fa0 0x7fcc6407a460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcc70033000 tx=0x7fcc800733d0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:52.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.536+0000 7fcc75ffb640 1 -- 172.21.15.90:0/1475855659 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcc8009d800 con 0x7fcc6c004800 2024-09-10T23:14:52.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.746+0000 7fcc877ec640 1 -- 172.21.15.90:0/1475855659 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcc800cf050 con 0x7fcc6c004800 2024-09-10T23:14:52.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.746+0000 7fcc75ffb640 1 -- 172.21.15.90:0/1475855659 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fcc7c063060 con 0x7fcc6c004800 2024-09-10T23:14:52.747 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:14:52.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.749+0000 7fcc877ec640 1 -- 172.21.15.90:0/1475855659 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcc64077fa0 msgr2=0x7fcc6407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:52.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.749+0000 7fcc877ec640 1 --2- 172.21.15.90:0/1475855659 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcc64077fa0 0x7fcc6407a460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcc70033000 tx=0x7fcc800733d0 comp rx=0 tx=0).stop 2024-09-10T23:14:52.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.749+0000 7fcc877ec640 1 -- 172.21.15.90:0/1475855659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc6c004800 msgr2=0x7fcc801f20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:52.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.749+0000 7fcc877ec640 1 --2- 172.21.15.90:0/1475855659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc6c004800 0x7fcc801f20e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00b5e0 tx=0x7fcc7c00baa0 comp rx=0 tx=0).stop 2024-09-10T23:14:52.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.749+0000 7fcc877ec640 1 -- 172.21.15.90:0/1475855659 shutdown_connections 2024-09-10T23:14:52.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.749+0000 7fcc877ec640 1 --2- 172.21.15.90:0/1475855659 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcc64077fa0 0x7fcc6407a460 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:52.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.749+0000 7fcc877ec640 1 --2- 172.21.15.90:0/1475855659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc801f6130 0x7fcc800c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:52.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.749+0000 7fcc877ec640 1 --2- 172.21.15.90:0/1475855659 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc800c6ea0 0x7fcc800b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:52.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.749+0000 7fcc877ec640 1 --2- 172.21.15.90:0/1475855659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc6c004800 0x7fcc801f20e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:52.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.749+0000 7fcc877ec640 1 -- 172.21.15.90:0/1475855659 >> 172.21.15.90:0/1475855659 conn(0x7fcc800cc850 msgr2=0x7fcc800c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:52.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.749+0000 7fcc877ec640 1 -- 172.21.15.90:0/1475855659 shutdown_connections 2024-09-10T23:14:52.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52.749+0000 7fcc877ec640 1 -- 172.21.15.90:0/1475855659 wait complete. 2024-09-10T23:14:52.760 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:14:52.760 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:14:52.760 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2024-09-10T23:14:52.760 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-10T23:14:52.760 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T23:14:52.761 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:14:52.761 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:14:52.761 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:14:52.761 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-10T23:14:52.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:52.761 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2024-09-10T23:14:52.777 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:14:52.777 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:14:52.777 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:14:52.777 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:52.777 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-10T23:14:52.777 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:52.778 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:14:52.778 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:52.778 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2024-09-10T23:14:52.778 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:14:52.778 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:52.778 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2024-09-10T23:14:52.778 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:14:52.778 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:52.778 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:14:52.778 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:52.778 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:14:52.778 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42755sec preferred_lft 42755sec 2024-09-10T23:14:52.778 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link noprefixroute 2024-09-10T23:14:52.778 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:52.779 INFO:teuthology.orchestra.run.smithi090.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:14:52.779 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 76:ad:51:1a:2a:60 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:52.779 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:14:52.779 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:52.779 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::882a:a9ff:fefc:893f/64 scope link tentative 2024-09-10T23:14:52.779 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:52.779 INFO:teuthology.orchestra.run.smithi090.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:14:52.779 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 76:ad:51:1a:2a:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:14:52.779 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::74ad:51ff:fe1a:2a60/64 scope link tentative 2024-09-10T23:14:52.779 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:52.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:52.780 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:14:52.840 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-09-10T23:14:52.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:52.842 DEBUG:teuthology.orchestra.run.smithi090:> route 2024-09-10T23:14:52.899 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2024-09-10T23:14:52.899 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:14:52.899 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:14:52.899 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:14:52.899 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:14:52.899 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:52.899 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:14:52.900 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:14:52.900 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:14:52.900 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:14:52.900 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:14:52.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:53.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:53.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:53.026 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-10T23:14:53.040 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:14:53.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:53.041 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list-id 2024-09-10T23:14:53.096 INFO:teuthology.orchestra.run.smithi090.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-10T23:14:53.097 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:53.097 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:14:53.097 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:14:53.098 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-10T23:14:53.098 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:14:53.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:53.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:53.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:53.213 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T23:14:53.238 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:14:53.238 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:14:53.238 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:14:53.238 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:53.238 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-10T23:14:53.238 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:53.238 INFO:teuthology.orchestra.run.smithi090.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:14:53.238 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether fe:f5:fd:95:f7:88 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T23:14:53.238 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T23:14:53.238 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:53.238 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::fcf5:fdff:fe95:f788/64 scope link tentative 2024-09-10T23:14:53.239 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:53.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:53.240 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T23:14:53.304 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:14:53.304 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:14:53.304 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:14:53.305 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:53.305 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-10T23:14:53.305 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:53.305 INFO:teuthology.orchestra.run.smithi090.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:14:53.305 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether fe:f5:fd:95:f7:88 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T23:14:53.305 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T23:14:53.305 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:53.305 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::fcf5:fdff:fe95:f788/64 scope link tentative 2024-09-10T23:14:53.305 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:53.306 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-10T23:14:53.306 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:53.307 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:14:53.307 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-10T23:14:53.307 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T23:14:53.307 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-10T23:14:53.307 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-10T23:14:53.307 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-10T23:14:53.307 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:14:53.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:53.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:53.458 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:53.458 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:14:53.458 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.1 up 2024-09-10T23:14:53.458 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T23:14:53.458 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:14:53.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:53.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:53.535 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:14:53.535 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-10T23:14:53.550 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-10T23:14:53.550 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:14:53.550 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-10T23:14:53.603 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:14:53.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:53.603 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-10T23:14:53.686 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-10T23:14:53.686 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-10T23:14:53.686 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:14:53.695 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-10T23:14:53.695 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-10T23:14:53.695 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:14:53.695 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:14:53.695 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:14:53.701 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-10T23:14:53.701 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-10T23:14:53.701 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:14:53.701 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:14:53.701 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:14:53.701 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:14:53.701 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:14:53.701 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:14:53.701 INFO:teuthology.orchestra.run.smithi090.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-10T23:14:53.702 INFO:teuthology.orchestra.run.smithi090.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:14:53.702 INFO:teuthology.orchestra.run.smithi090.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:14:53.702 INFO:teuthology.orchestra.run.smithi090.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:14:53.702 INFO:teuthology.orchestra.run.smithi090.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:14:53.703 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:14:53.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:53.703 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-10T23:14:53.768 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:14:53.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:14:53.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:53.864 INFO:teuthology.orchestra.run.smithi090.stdout:client4591 2024-09-10T23:14:53.865 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:14:53.865 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:14:53.881 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:14:53.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:14:53.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:53.975 INFO:teuthology.orchestra.run.smithi090.stdout:client4591 2024-09-10T23:14:53.976 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:14:54.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:14:54.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:54.032 INFO:teuthology.orchestra.run.smithi090.stdout:client4591 2024-09-10T23:14:54.032 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd.client4591/status') 2024-09-10T23:14:54.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:54.090 INFO:teuthology.orchestra.run.smithi090.stdout:instance: client.4591 (3)172.21.15.90:0/2032294597 2024-09-10T23:14:54.090 INFO:teuthology.orchestra.run.smithi090.stdout:blocklisted: false 2024-09-10T23:14:54.090 INFO:teuthology.orchestra.run.smithi090.stderr:0+1 records in 2024-09-10T23:14:54.091 INFO:teuthology.orchestra.run.smithi090.stderr:0+1 records out 2024-09-10T23:14:54.091 INFO:teuthology.orchestra.run.smithi090.stderr:70 bytes copied, 2.3336e-05 s, 3.0 MB/s 2024-09-10T23:14:54.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:54.098 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-10T23:14:54.098 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T23:14:54.098 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T23:14:54.098 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:14:54.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.200+0000 7f585529b640 1 -- 172.21.15.90:0/648013497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f585015aa30 msgr2=0x7f58500ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:54.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.200+0000 7f585529b640 1 --2- 172.21.15.90:0/648013497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f585015aa30 0x7f58500ca420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5840005fd0 tx=0x7f584002a540 comp rx=0 tx=0).stop 2024-09-10T23:14:54.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.200+0000 7f585529b640 1 -- 172.21.15.90:0/648013497 shutdown_connections 2024-09-10T23:14:54.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.200+0000 7f585529b640 1 --2- 172.21.15.90:0/648013497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f585015aa30 0x7f58500ca420 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:54.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.201+0000 7f585529b640 1 -- 172.21.15.90:0/648013497 >> 172.21.15.90:0/648013497 conn(0x7f58500cc850 msgr2=0x7f58500ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:54.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.201+0000 7f585529b640 1 -- 172.21.15.90:0/648013497 shutdown_connections 2024-09-10T23:14:54.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.201+0000 7f585529b640 1 -- 172.21.15.90:0/648013497 wait complete. 2024-09-10T23:14:54.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.202+0000 7f585529b640 1 Processor -- start 2024-09-10T23:14:54.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.202+0000 7f585529b640 1 -- start start 2024-09-10T23:14:54.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.202+0000 7f585529b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58500b1f60 0x7f58501f6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:54.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.202+0000 7f585529b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f585015aa30 0x7f58501573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:54.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f585529b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58500b54a0 0x7f5850159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:54.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f585529b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f58500ce770 con 0x7f58500b54a0 2024-09-10T23:14:54.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f585529b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f58500ce5f0 con 0x7f58500b1f60 2024-09-10T23:14:54.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f585529b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f58500ce8f0 con 0x7f585015aa30 2024-09-10T23:14:54.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f584f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58500b54a0 0x7f5850159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:54.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f584f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58500b54a0 0x7f5850159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49266/0 (socket says 172.21.15.90:49266) 2024-09-10T23:14:54.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f584f7fe640 1 -- 172.21.15.90:0/3455173817 learned_addr learned my addr 172.21.15.90:0/3455173817 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:54.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f584effd640 1 --2- 172.21.15.90:0/3455173817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58500b1f60 0x7f58501f6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:54.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f5847fff640 1 --2- 172.21.15.90:0/3455173817 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f585015aa30 0x7f58501573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:54.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f584f7fe640 1 -- 172.21.15.90:0/3455173817 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f585015aa30 msgr2=0x7f58501573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:54.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f584f7fe640 1 --2- 172.21.15.90:0/3455173817 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f585015aa30 0x7f58501573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:54.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f584f7fe640 1 -- 172.21.15.90:0/3455173817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58500b1f60 msgr2=0x7f58501f6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:54.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f584f7fe640 1 --2- 172.21.15.90:0/3455173817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58500b1f60 0x7f58501f6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:54.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f584f7fe640 1 -- 172.21.15.90:0/3455173817 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585009c3e0 con 0x7f58500b54a0 2024-09-10T23:14:54.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f584effd640 1 --2- 172.21.15.90:0/3455173817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58500b1f60 0x7f58501f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:54.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f5847fff640 1 --2- 172.21.15.90:0/3455173817 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f585015aa30 0x7f58501573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:54.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f584f7fe640 1 --2- 172.21.15.90:0/3455173817 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58500b54a0 0x7f5850159670 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f584800b9a0 tx=0x7f584800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:54.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f58477fe640 1 -- 172.21.15.90:0/3455173817 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848019070 con 0x7f58500b54a0 2024-09-10T23:14:54.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f58477fe640 1 -- 172.21.15.90:0/3455173817 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f584800cc90 con 0x7f58500b54a0 2024-09-10T23:14:54.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f58477fe640 1 -- 172.21.15.90:0/3455173817 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58480146a0 con 0x7f58500b54a0 2024-09-10T23:14:54.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f585529b640 1 -- 172.21.15.90:0/3455173817 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58500b3ea0 con 0x7f58500b54a0 2024-09-10T23:14:54.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.203+0000 7f585529b640 1 -- 172.21.15.90:0/3455173817 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58500b4460 con 0x7f58500b54a0 2024-09-10T23:14:54.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.204+0000 7f585529b640 1 -- 172.21.15.90:0/3455173817 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f585006a1b0 con 0x7f58500b54a0 2024-09-10T23:14:54.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.205+0000 7f58477fe640 1 -- 172.21.15.90:0/3455173817 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f584801e440 con 0x7f58500b54a0 2024-09-10T23:14:54.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.205+0000 7f58477fe640 1 --2- 172.21.15.90:0/3455173817 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5830077fa0 0x7f583007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:54.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.206+0000 7f58477fe640 1 -- 172.21.15.90:0/3455173817 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5848099c00 con 0x7f58500b54a0 2024-09-10T23:14:54.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.206+0000 7f584effd640 1 --2- 172.21.15.90:0/3455173817 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5830077fa0 0x7f583007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:54.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.206+0000 7f584effd640 1 --2- 172.21.15.90:0/3455173817 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5830077fa0 0x7f583007a460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5840033000 tx=0x7f5840004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:54.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.214+0000 7f58477fe640 1 -- 172.21.15.90:0/3455173817 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f585006a1b0 con 0x7f58500b54a0 2024-09-10T23:14:54.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.431+0000 7f585529b640 1 -- 172.21.15.90:0/3455173817 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f58500ca420 con 0x7f58500b54a0 2024-09-10T23:14:54.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.431+0000 7f58477fe640 1 -- 172.21.15.90:0/3455173817 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f58480a0080 con 0x7f58500b54a0 2024-09-10T23:14:54.432 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:14:54.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.433+0000 7f585529b640 1 -- 172.21.15.90:0/3455173817 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5830077fa0 msgr2=0x7f583007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:54.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.433+0000 7f585529b640 1 --2- 172.21.15.90:0/3455173817 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5830077fa0 0x7f583007a460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5840033000 tx=0x7f5840004730 comp rx=0 tx=0).stop 2024-09-10T23:14:54.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.434+0000 7f585529b640 1 -- 172.21.15.90:0/3455173817 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58500b54a0 msgr2=0x7f5850159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:54.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.434+0000 7f585529b640 1 --2- 172.21.15.90:0/3455173817 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58500b54a0 0x7f5850159670 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f584800b9a0 tx=0x7f584800be60 comp rx=0 tx=0).stop 2024-09-10T23:14:54.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.434+0000 7f585529b640 1 -- 172.21.15.90:0/3455173817 shutdown_connections 2024-09-10T23:14:54.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.434+0000 7f585529b640 1 --2- 172.21.15.90:0/3455173817 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5830077fa0 0x7f583007a460 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:54.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.434+0000 7f585529b640 1 --2- 172.21.15.90:0/3455173817 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58500b54a0 0x7f5850159670 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:54.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.434+0000 7f585529b640 1 --2- 172.21.15.90:0/3455173817 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f585015aa30 0x7f58501573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:54.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.434+0000 7f585529b640 1 --2- 172.21.15.90:0/3455173817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58500b1f60 0x7f58501f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:54.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.434+0000 7f585529b640 1 -- 172.21.15.90:0/3455173817 >> 172.21.15.90:0/3455173817 conn(0x7f58500cc850 msgr2=0x7f58500cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:54.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.434+0000 7f585529b640 1 -- 172.21.15.90:0/3455173817 shutdown_connections 2024-09-10T23:14:54.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:54.434+0000 7f585529b640 1 -- 172.21.15.90:0/3455173817 wait complete. 2024-09-10T23:14:54.443 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:14:54.445 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:14:54.446 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:14:54.447 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:14:54.447 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-09-10T23:14:54.447 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T23:14:54.447 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T23:14:54.447 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:14:54.447 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:14:54.447 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:14:54.447 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:14:54.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:54.447 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-09-10T23:14:54.467 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:14:54.467 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:14:54.467 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:14:54.467 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:54.467 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-09-10T23:14:54.467 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:54.467 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:14:54.467 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:54.467 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-09-10T23:14:54.467 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:14:54.468 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:54.468 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-09-10T23:14:54.468 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:14:54.468 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:54.468 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:14:54.468 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:54.468 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:14:54.468 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42736sec preferred_lft 42736sec 2024-09-10T23:14:54.468 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link noprefixroute 2024-09-10T23:14:54.468 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:54.468 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T23:14:54.469 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:54.469 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:14:54.469 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link add name ceph-brx type bridge 2024-09-10T23:14:54.469 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip addr flush dev ceph-brx 2024-09-10T23:14:54.469 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set ceph-brx up 2024-09-10T23:14:54.469 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T23:14:54.469 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:14:54.561 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:54.688 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:54.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:54.695 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:14:54.719 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-09-10T23:14:54.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:54.721 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-09-10T23:14:54.788 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-09-10T23:14:54.788 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:14:54.788 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:14:54.788 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:14:54.788 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:14:54.789 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:54.789 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:14:54.789 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:14:54.789 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:14:54.789 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:14:54.789 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:14:54.878 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:55.070 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:55.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:55.076 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-09-10T23:14:55.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:55.092 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list-id 2024-09-10T23:14:55.148 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:55.148 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:14:55.148 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:14:55.148 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-10T23:14:55.148 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:14:55.237 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:55.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:55.267 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-10T23:14:55.267 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:55.268 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:14:55.268 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-10T23:14:55.268 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T23:14:55.268 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-10T23:14:55.268 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-10T23:14:55.268 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-10T23:14:55.268 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:14:55.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:55.394 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:55.400 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:55.400 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:14:55.400 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-09-10T23:14:55.400 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T23:14:55.400 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:14:55.449 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:55.472 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:55.478 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:14:55.478 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T23:14:55.493 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:14:55.493 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:14:55.493 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:14:55.549 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:14:55.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:55.549 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:14:55.651 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:14:55.651 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:14:55.651 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:14:55.771 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:14:55.771 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:14:55.771 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:14:55.771 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:14:55.771 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:14:55.789 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:14:55.789 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:14:55.789 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:14:55.789 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:14:55.789 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:14:55.789 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:14:55.789 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:14:55.790 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:14:55.790 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T23:14:55.790 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:14:55.790 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:14:55.790 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:14:55.790 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:14:55.792 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:14:55.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:55.792 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:14:55.817 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:14:55.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:14:55.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:55.913 INFO:teuthology.orchestra.run.smithi171.stdout:client4701 2024-09-10T23:14:55.914 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:14:55.914 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:14:55.929 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:14:56.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:14:56.019 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:56.025 INFO:teuthology.orchestra.run.smithi171.stdout:client4701 2024-09-10T23:14:56.026 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:14:56.073 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:14:56.075 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:56.081 INFO:teuthology.orchestra.run.smithi171.stdout:client4701 2024-09-10T23:14:56.081 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd.client4701/status') 2024-09-10T23:14:56.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:56.139 INFO:teuthology.orchestra.run.smithi171.stdout:instance: client.4701 (3)172.21.15.171:0/39597104 2024-09-10T23:14:56.140 INFO:teuthology.orchestra.run.smithi171.stdout:blocklisted: false 2024-09-10T23:14:56.140 INFO:teuthology.orchestra.run.smithi171.stderr:0+1 records in 2024-09-10T23:14:56.140 INFO:teuthology.orchestra.run.smithi171.stderr:0+1 records out 2024-09-10T23:14:56.140 INFO:teuthology.orchestra.run.smithi171.stderr:69 bytes copied, 2.4517e-05 s, 2.8 MB/s 2024-09-10T23:14:56.141 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:56.147 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-10T23:14:56.147 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T23:14:56.147 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T23:14:56.148 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:14:56.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.252+0000 7f7cfe47f640 1 -- 172.21.15.90:0/2471583885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ce0003a30 msgr2=0x7f7ce0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.252+0000 7f7cfe47f640 1 --2- 172.21.15.90:0/2471583885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ce0003a30 0x7f7ce0003e50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8009b50 tx=0x7f7ce0005830 comp rx=0 tx=0).stop 2024-09-10T23:14:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.252+0000 7f7cfca1c640 1 -- 172.21.15.90:0/2471583885 reap_dead start 2024-09-10T23:14:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.252+0000 7f7cfe47f640 1 -- 172.21.15.90:0/2471583885 shutdown_connections 2024-09-10T23:14:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.252+0000 7f7cfe47f640 1 -- 172.21.15.90:0/2471583885 >> 172.21.15.90:0/2471583885 conn(0x7f7cf80cc850 msgr2=0x7f7cf80ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.252+0000 7f7cfe47f640 1 -- 172.21.15.90:0/2471583885 shutdown_connections 2024-09-10T23:14:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.252+0000 7f7cfe47f640 1 -- 172.21.15.90:0/2471583885 wait complete. 2024-09-10T23:14:56.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.253+0000 7f7cfe47f640 1 Processor -- start 2024-09-10T23:14:56.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.253+0000 7f7cfe47f640 1 -- start start 2024-09-10T23:14:56.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.254+0000 7f7cfe47f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ce0003a30 0x7f7cf81f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:56.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.254+0000 7f7cfe47f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7cf809abc0 0x7f7cf809b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:56.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.254+0000 7f7cfe47f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf80c86e0 0x7f7cf80c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:56.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.254+0000 7f7cfe47f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf80b20e0 con 0x7f7cf80c86e0 2024-09-10T23:14:56.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.254+0000 7f7cfe47f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf80b1f60 con 0x7f7ce0003a30 2024-09-10T23:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.254+0000 7f7cfe47f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf80cb7e0 con 0x7f7cf809abc0 2024-09-10T23:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.254+0000 7f7cfca1c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf80c86e0 0x7f7cf80c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.254+0000 7f7cfca1c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf80c86e0 0x7f7cf80c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49280/0 (socket says 172.21.15.90:49280) 2024-09-10T23:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.254+0000 7f7cfca1c640 1 -- 172.21.15.90:0/3153020745 learned_addr learned my addr 172.21.15.90:0/3153020745 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.254+0000 7f7cf77fe640 1 --2- 172.21.15.90:0/3153020745 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7cf809abc0 0x7f7cf809b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.254+0000 7f7cf7fff640 1 --2- 172.21.15.90:0/3153020745 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ce0003a30 0x7f7cf81f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.254+0000 7f7cfca1c640 1 -- 172.21.15.90:0/3153020745 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7cf809abc0 msgr2=0x7f7cf809b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.254+0000 7f7cfca1c640 1 --2- 172.21.15.90:0/3153020745 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7cf809abc0 0x7f7cf809b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.254+0000 7f7cfca1c640 1 -- 172.21.15.90:0/3153020745 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ce0003a30 msgr2=0x7f7cf81f2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.255+0000 7f7cfca1c640 1 --2- 172.21.15.90:0/3153020745 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ce0003a30 0x7f7cf81f2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.255+0000 7f7cfca1c640 1 -- 172.21.15.90:0/3153020745 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf809b6c0 con 0x7f7cf80c86e0 2024-09-10T23:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.255+0000 7f7cfca1c640 1 --2- 172.21.15.90:0/3153020745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf80c86e0 0x7f7cf80c8b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80b5f40 tx=0x7f7cf0006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.255+0000 7f7cf4ff9640 1 -- 172.21.15.90:0/3153020745 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0015070 con 0x7f7cf80c86e0 2024-09-10T23:14:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.255+0000 7f7cf4ff9640 1 -- 172.21.15.90:0/3153020745 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7cf0011840 con 0x7f7cf80c86e0 2024-09-10T23:14:56.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.255+0000 7f7cfe47f640 1 -- 172.21.15.90:0/3153020745 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf814c0a0 con 0x7f7cf80c86e0 2024-09-10T23:14:56.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.255+0000 7f7cf4ff9640 1 -- 172.21.15.90:0/3153020745 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0011c90 con 0x7f7cf80c86e0 2024-09-10T23:14:56.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.255+0000 7f7cfe47f640 1 -- 172.21.15.90:0/3153020745 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf814c660 con 0x7f7cf80c86e0 2024-09-10T23:14:56.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.256+0000 7f7cfe47f640 1 -- 172.21.15.90:0/3153020745 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf80c90a0 con 0x7f7cf80c86e0 2024-09-10T23:14:56.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.256+0000 7f7cf4ff9640 1 -- 172.21.15.90:0/3153020745 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7cf00103c0 con 0x7f7cf80c86e0 2024-09-10T23:14:56.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.257+0000 7f7cf4ff9640 1 --2- 172.21.15.90:0/3153020745 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7ce4077fa0 0x7f7ce407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:56.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.257+0000 7f7cf4ff9640 1 -- 172.21.15.90:0/3153020745 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7cf009ab00 con 0x7f7cf80c86e0 2024-09-10T23:14:56.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.257+0000 7f7cf7fff640 1 --2- 172.21.15.90:0/3153020745 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7ce4077fa0 0x7f7ce407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:56.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.257+0000 7f7cf7fff640 1 --2- 172.21.15.90:0/3153020745 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7ce4077fa0 0x7f7ce407a460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8035000 tx=0x7f7ce802d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:56.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.261+0000 7f7cf4ff9640 1 -- 172.21.15.90:0/3153020745 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7cf0063040 con 0x7f7cf80c86e0 2024-09-10T23:14:56.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.468+0000 7f7cfe47f640 1 -- 172.21.15.90:0/3153020745 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7cf80ca850 con 0x7f7cf80c86e0 2024-09-10T23:14:56.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.468+0000 7f7cf4ff9640 1 -- 172.21.15.90:0/3153020745 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f7cf0067a70 con 0x7f7cf80c86e0 2024-09-10T23:14:56.469 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:14:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.470+0000 7f7cfe47f640 1 -- 172.21.15.90:0/3153020745 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7ce4077fa0 msgr2=0x7f7ce407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.470+0000 7f7cfe47f640 1 --2- 172.21.15.90:0/3153020745 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7ce4077fa0 0x7f7ce407a460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8035000 tx=0x7f7ce802d040 comp rx=0 tx=0).stop 2024-09-10T23:14:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.470+0000 7f7cfe47f640 1 -- 172.21.15.90:0/3153020745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf80c86e0 msgr2=0x7f7cf80c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.470+0000 7f7cfe47f640 1 --2- 172.21.15.90:0/3153020745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf80c86e0 0x7f7cf80c8b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80b5f40 tx=0x7f7cf0006430 comp rx=0 tx=0).stop 2024-09-10T23:14:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.470+0000 7f7cfe47f640 1 -- 172.21.15.90:0/3153020745 shutdown_connections 2024-09-10T23:14:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.470+0000 7f7cfe47f640 1 --2- 172.21.15.90:0/3153020745 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7ce4077fa0 0x7f7ce407a460 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.470+0000 7f7cfe47f640 1 --2- 172.21.15.90:0/3153020745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf80c86e0 0x7f7cf80c8b60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.470+0000 7f7cfe47f640 1 --2- 172.21.15.90:0/3153020745 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7cf809abc0 0x7f7cf809b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.470+0000 7f7cfe47f640 1 --2- 172.21.15.90:0/3153020745 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ce0003a30 0x7f7cf81f2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.470+0000 7f7cfe47f640 1 -- 172.21.15.90:0/3153020745 >> 172.21.15.90:0/3153020745 conn(0x7f7cf80cc850 msgr2=0x7f7cf80aed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:56.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.471+0000 7f7cfe47f640 1 -- 172.21.15.90:0/3153020745 shutdown_connections 2024-09-10T23:14:56.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:56.471+0000 7f7cfe47f640 1 -- 172.21.15.90:0/3153020745 wait complete. 2024-09-10T23:14:56.482 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:14:56.482 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:14:56.482 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-09-10T23:14:56.482 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-10T23:14:56.482 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T23:14:56.482 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:14:56.482 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:14:56.482 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:14:56.482 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-10T23:14:56.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:56.483 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-09-10T23:14:56.499 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:14:56.499 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:14:56.500 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:14:56.500 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:56.500 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-09-10T23:14:56.500 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:56.500 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:14:56.500 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:56.500 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-09-10T23:14:56.500 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:14:56.500 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:56.500 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-09-10T23:14:56.500 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:14:56.500 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:56.500 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:14:56.501 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:56.501 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:14:56.501 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42734sec preferred_lft 42734sec 2024-09-10T23:14:56.501 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link noprefixroute 2024-09-10T23:14:56.501 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:56.501 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:14:56.501 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:14:56.501 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:14:56.501 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:56.501 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::c18:12ff:fe41:788b/64 scope link 2024-09-10T23:14:56.501 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:56.501 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:14:56.502 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:14:56.502 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a0e4:c6ff:fe48:8d44/64 scope link tentative 2024-09-10T23:14:56.502 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:56.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:56.502 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:14:56.565 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-09-10T23:14:56.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:56.566 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-09-10T23:14:56.624 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-09-10T23:14:56.624 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:14:56.624 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:14:56.624 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:14:56.624 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:14:56.625 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:56.625 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:14:56.625 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:14:56.625 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:14:56.625 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:14:56.625 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:14:56.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:56.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:56.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:56.751 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-09-10T23:14:56.767 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T23:14:56.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:56.767 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list-id 2024-09-10T23:14:56.825 INFO:teuthology.orchestra.run.smithi171.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-10T23:14:56.825 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:56.825 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:14:56.825 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:14:56.825 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-10T23:14:56.825 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:14:56.912 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:56.935 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:56.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:56.941 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T23:14:56.966 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:14:56.966 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:14:56.966 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:14:56.966 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:56.966 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-09-10T23:14:56.966 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:56.966 INFO:teuthology.orchestra.run.smithi171.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:14:56.966 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0e:9d:5f:03:56:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T23:14:56.966 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T23:14:56.966 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:56.966 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::c9d:5fff:fe03:5639/64 scope link 2024-09-10T23:14:56.967 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:56.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:56.968 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T23:14:57.033 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:14:57.033 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:14:57.033 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:14:57.033 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:57.033 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-09-10T23:14:57.033 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:57.033 INFO:teuthology.orchestra.run.smithi171.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:14:57.033 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0e:9d:5f:03:56:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T23:14:57.033 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T23:14:57.033 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:57.034 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::c9d:5fff:fe03:5639/64 scope link 2024-09-10T23:14:57.034 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:14:57.035 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-10T23:14:57.035 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:57.035 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:14:57.035 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-10T23:14:57.035 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T23:14:57.035 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-10T23:14:57.035 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-10T23:14:57.035 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-10T23:14:57.035 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:14:57.123 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:57.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:57.188 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:14:57.188 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:14:57.188 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.1 up 2024-09-10T23:14:57.188 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T23:14:57.188 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:14:57.236 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:57.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:57.265 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:14:57.265 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-10T23:14:57.280 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-10T23:14:57.280 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:14:57.280 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-10T23:14:57.334 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:14:57.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:57.335 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-10T23:14:57.418 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-10T23:14:57.418 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-10T23:14:57.418 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:14:57.427 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-10T23:14:57.427 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-10T23:14:57.427 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:14:57.427 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:14:57.427 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:14:57.438 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-10T23:14:57.438 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-10T23:14:57.438 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:14:57.438 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:14:57.438 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:14:57.438 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:14:57.438 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:14:57.438 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:14:57.439 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-10T23:14:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:14:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:14:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:14:57.439 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:14:57.440 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:14:57.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:14:57.441 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-10T23:14:57.507 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:14:57.610 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:14:57.612 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:57.618 INFO:teuthology.orchestra.run.smithi171.stdout:client4603 2024-09-10T23:14:57.618 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:14:57.618 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:14:57.634 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:14:57.722 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:14:57.724 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:57.730 INFO:teuthology.orchestra.run.smithi171.stdout:client4603 2024-09-10T23:14:57.730 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:14:57.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:14:57.780 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:57.786 INFO:teuthology.orchestra.run.smithi171.stdout:client4603 2024-09-10T23:14:57.787 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd.client4603/status') 2024-09-10T23:14:57.834 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:14:57.844 INFO:teuthology.orchestra.run.smithi171.stdout:instance: client.4603 (3)192.168.0.2:0/4239643147 2024-09-10T23:14:57.844 INFO:teuthology.orchestra.run.smithi171.stdout:blocklisted: false 2024-09-10T23:14:57.844 INFO:teuthology.orchestra.run.smithi171.stderr:0+1 records in 2024-09-10T23:14:57.844 INFO:teuthology.orchestra.run.smithi171.stderr:0+1 records out 2024-09-10T23:14:57.844 INFO:teuthology.orchestra.run.smithi171.stderr:69 bytes copied, 2.6677e-05 s, 2.6 MB/s 2024-09-10T23:14:57.845 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:14:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:14:57.851 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-10T23:14:57.898 INFO:tasks.cephfs_test_runner:Starting test: test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) That when a client unmounts, the thread count on the MDS goes back 2024-09-10T23:14:57.898 INFO:tasks.cephfs_test_runner:test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-10T23:14:57.899 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:14:58.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.012+0000 7f1dc7e62640 1 -- 172.21.15.90:0/4214149653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1da80052e0 msgr2=0x7f1da800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.012+0000 7f1dc7e62640 1 --2- 172.21.15.90:0/4214149653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1da80052e0 0x7f1da800b9c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1db8001690 tx=0x7f1da8005830 comp rx=0 tx=0).stop 2024-09-10T23:14:58.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.012+0000 7f1dc7e62640 1 -- 172.21.15.90:0/4214149653 shutdown_connections 2024-09-10T23:14:58.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.012+0000 7f1dc7e62640 1 --2- 172.21.15.90:0/4214149653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1da80052e0 0x7f1da800b9c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.012+0000 7f1dc7e62640 1 -- 172.21.15.90:0/4214149653 >> 172.21.15.90:0/4214149653 conn(0x7f1dc00cc850 msgr2=0x7f1dc00ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:58.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.012+0000 7f1dc7e62640 1 -- 172.21.15.90:0/4214149653 shutdown_connections 2024-09-10T23:14:58.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.012+0000 7f1dc7e62640 1 -- 172.21.15.90:0/4214149653 wait complete. 2024-09-10T23:14:58.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.013+0000 7f1dc7e62640 1 Processor -- start 2024-09-10T23:14:58.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.014+0000 7f1dc7e62640 1 -- start start 2024-09-10T23:14:58.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.014+0000 7f1dc7e62640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1da80052e0 0x7f1dc0072630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:58.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.014+0000 7f1dc7e62640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1dc0159480 0x7f1dc0159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:58.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.014+0000 7f1dc7e62640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1dc01f7d00 0x7f1dc01f8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:58.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.014+0000 7f1dc7e62640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc00cada0 con 0x7f1dc01f7d00 2024-09-10T23:14:58.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.014+0000 7f1dc7e62640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc00cac20 con 0x7f1dc0159480 2024-09-10T23:14:58.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.014+0000 7f1dc7e62640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc015b290 con 0x7f1da80052e0 2024-09-10T23:14:58.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.014+0000 7f1dc63ff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1dc01f7d00 0x7f1dc01f8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:58.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.014+0000 7f1dc63ff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1dc01f7d00 0x7f1dc01f8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49298/0 (socket says 172.21.15.90:49298) 2024-09-10T23:14:58.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.014+0000 7f1dc63ff640 1 -- 172.21.15.90:0/142456572 learned_addr learned my addr 172.21.15.90:0/142456572 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:58.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.015+0000 7f1dc5bfe640 1 --2- 172.21.15.90:0/142456572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1da80052e0 0x7f1dc0072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:58.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.015+0000 7f1dc53fd640 1 --2- 172.21.15.90:0/142456572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1dc0159480 0x7f1dc0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:58.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.015+0000 7f1dc63ff640 1 -- 172.21.15.90:0/142456572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1da80052e0 msgr2=0x7f1dc0072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.015+0000 7f1dc63ff640 1 --2- 172.21.15.90:0/142456572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1da80052e0 0x7f1dc0072630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.015+0000 7f1dc63ff640 1 -- 172.21.15.90:0/142456572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1dc0159480 msgr2=0x7f1dc0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.015+0000 7f1dc63ff640 1 --2- 172.21.15.90:0/142456572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1dc0159480 0x7f1dc0159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.015+0000 7f1dc63ff640 1 -- 172.21.15.90:0/142456572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc01f4840 con 0x7f1dc01f7d00 2024-09-10T23:14:58.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.015+0000 7f1dc63ff640 1 --2- 172.21.15.90:0/142456572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1dc01f7d00 0x7f1dc01f8180 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1db802a910 tx=0x7f1db8006360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:58.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.015+0000 7f1dbe7fc640 1 -- 172.21.15.90:0/142456572 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8037070 con 0x7f1dc01f7d00 2024-09-10T23:14:58.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.015+0000 7f1dbe7fc640 1 -- 172.21.15.90:0/142456572 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1db8003af0 con 0x7f1dc01f7d00 2024-09-10T23:14:58.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.015+0000 7f1dc7e62640 1 -- 172.21.15.90:0/142456572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc01f4b20 con 0x7f1dc01f7d00 2024-09-10T23:14:58.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.015+0000 7f1dbe7fc640 1 -- 172.21.15.90:0/142456572 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8032410 con 0x7f1dc01f7d00 2024-09-10T23:14:58.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.015+0000 7f1dc7e62640 1 -- 172.21.15.90:0/142456572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc01f50e0 con 0x7f1dc01f7d00 2024-09-10T23:14:58.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.016+0000 7f1dc7e62640 1 -- 172.21.15.90:0/142456572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dc00b18c0 con 0x7f1dc01f7d00 2024-09-10T23:14:58.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.017+0000 7f1dbe7fc640 1 -- 172.21.15.90:0/142456572 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1db80325b0 con 0x7f1dc01f7d00 2024-09-10T23:14:58.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.018+0000 7f1dbe7fc640 1 --2- 172.21.15.90:0/142456572 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1dac077f70 0x7f1dac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:58.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.018+0000 7f1dbe7fc640 1 -- 172.21.15.90:0/142456572 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1db80b90a0 con 0x7f1dc01f7d00 2024-09-10T23:14:58.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.018+0000 7f1dc5bfe640 1 --2- 172.21.15.90:0/142456572 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1dac077f70 0x7f1dac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:58.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.018+0000 7f1dc5bfe640 1 --2- 172.21.15.90:0/142456572 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1dac077f70 0x7f1dac07a430 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1db0006fd0 tx=0x7f1db0006b20 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:58.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.022+0000 7f1dbe7fc640 1 -- 172.21.15.90:0/142456572 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1db8081550 con 0x7f1dc01f7d00 2024-09-10T23:14:58.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.197+0000 7f1dc7e62640 1 -- 172.21.15.90:0/142456572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1dc00acf30 con 0x7f1dc01f7d00 2024-09-10T23:14:58.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.198+0000 7f1dbe7fc640 1 -- 172.21.15.90:0/142456572 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16665 (secure 0 0 0) 0x7f1db808a2c0 con 0x7f1dc01f7d00 2024-09-10T23:14:58.199 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:14:58.199 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":23,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:14:37.132353+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:14:33.985657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:14:34.420690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:14:58.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.200+0000 7f1dc7e62640 1 -- 172.21.15.90:0/142456572 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1dac077f70 msgr2=0x7f1dac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.200+0000 7f1dc7e62640 1 --2- 172.21.15.90:0/142456572 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1dac077f70 0x7f1dac07a430 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1db0006fd0 tx=0x7f1db0006b20 comp rx=0 tx=0).stop 2024-09-10T23:14:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.200+0000 7f1dc7e62640 1 -- 172.21.15.90:0/142456572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1dc01f7d00 msgr2=0x7f1dc01f8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.200+0000 7f1dc7e62640 1 --2- 172.21.15.90:0/142456572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1dc01f7d00 0x7f1dc01f8180 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1db802a910 tx=0x7f1db8006360 comp rx=0 tx=0).stop 2024-09-10T23:14:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.200+0000 7f1dc7e62640 1 -- 172.21.15.90:0/142456572 shutdown_connections 2024-09-10T23:14:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.200+0000 7f1dc7e62640 1 --2- 172.21.15.90:0/142456572 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1dac077f70 0x7f1dac07a430 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.200+0000 7f1dc7e62640 1 --2- 172.21.15.90:0/142456572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1dc0159480 0x7f1dc0159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.200+0000 7f1dc7e62640 1 --2- 172.21.15.90:0/142456572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1dc01f7d00 0x7f1dc01f8180 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.200+0000 7f1dc7e62640 1 --2- 172.21.15.90:0/142456572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1da80052e0 0x7f1dc0072630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.200+0000 7f1dc7e62640 1 -- 172.21.15.90:0/142456572 >> 172.21.15.90:0/142456572 conn(0x7f1dc00cc850 msgr2=0x7f1dc00b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.200+0000 7f1dc7e62640 1 -- 172.21.15.90:0/142456572 shutdown_connections 2024-09-10T23:14:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.200+0000 7f1dc7e62640 1 -- 172.21.15.90:0/142456572 wait complete. 2024-09-10T23:14:58.212 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:14:26.449950+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T23:14:33.985657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T23:14:34.420690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:14:58.213 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:14:58.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.315+0000 7f2416d00640 1 -- 172.21.15.90:0/490423647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f241015ab10 msgr2=0x7f241006e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.315+0000 7f2416d00640 1 --2- 172.21.15.90:0/490423647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f241015ab10 0x7f241006e680 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f240c005fd0 tx=0x7f240c02a530 comp rx=0 tx=0).stop 2024-09-10T23:14:58.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.315+0000 7f2416d00640 1 -- 172.21.15.90:0/490423647 shutdown_connections 2024-09-10T23:14:58.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.315+0000 7f2416d00640 1 --2- 172.21.15.90:0/490423647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24100cf840 0x7f241015e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.315+0000 7f2416d00640 1 --2- 172.21.15.90:0/490423647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f241015ab10 0x7f241006e680 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.315+0000 7f2416d00640 1 -- 172.21.15.90:0/490423647 >> 172.21.15.90:0/490423647 conn(0x7f24100cfc80 msgr2=0x7f24100d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:58.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.315+0000 7f2416d00640 1 -- 172.21.15.90:0/490423647 shutdown_connections 2024-09-10T23:14:58.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.315+0000 7f2416d00640 1 -- 172.21.15.90:0/490423647 wait complete. 2024-09-10T23:14:58.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.316+0000 7f2416d00640 1 Processor -- start 2024-09-10T23:14:58.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.316+0000 7f2416d00640 1 -- start start 2024-09-10T23:14:58.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f2416d00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24100cf840 0x7f24100c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:58.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f2416d00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f241015ab10 0x7f24100ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:58.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f2416d00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f241015edb0 0x7f24101f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:58.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f2416d00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f241015b780 con 0x7f241015edb0 2024-09-10T23:14:58.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f2416d00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f241015b600 con 0x7f24100cf840 2024-09-10T23:14:58.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f2416d00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f241015b900 con 0x7f241015ab10 2024-09-10T23:14:58.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f241529d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f241015edb0 0x7f24101f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:58.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f241529d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f241015edb0 0x7f24101f6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55562/0 (socket says 172.21.15.90:55562) 2024-09-10T23:14:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f241529d640 1 -- 172.21.15.90:0/6550559 learned_addr learned my addr 172.21.15.90:0/6550559 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f2414a9c640 1 --2- 172.21.15.90:0/6550559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24100cf840 0x7f24100c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f2407fff640 1 --2- 172.21.15.90:0/6550559 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f241015ab10 0x7f24100ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f241529d640 1 -- 172.21.15.90:0/6550559 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f241015ab10 msgr2=0x7f24100ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f241529d640 1 --2- 172.21.15.90:0/6550559 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f241015ab10 0x7f24100ac6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f241529d640 1 -- 172.21.15.90:0/6550559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24100cf840 msgr2=0x7f24100c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f241529d640 1 --2- 172.21.15.90:0/6550559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24100cf840 0x7f24100c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f241529d640 1 -- 172.21.15.90:0/6550559 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24100a9ed0 con 0x7f241015edb0 2024-09-10T23:14:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f2414a9c640 1 --2- 172.21.15.90:0/6550559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24100cf840 0x7f24100c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.317+0000 7f241529d640 1 --2- 172.21.15.90:0/6550559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f241015edb0 0x7f24101f6060 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f240800c780 tx=0x7f240800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.318+0000 7f24057fa640 1 -- 172.21.15.90:0/6550559 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408004b60 con 0x7f241015edb0 2024-09-10T23:14:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.318+0000 7f24057fa640 1 -- 172.21.15.90:0/6550559 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2408004df0 con 0x7f241015edb0 2024-09-10T23:14:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.318+0000 7f24057fa640 1 -- 172.21.15.90:0/6550559 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240800aa10 con 0x7f241015edb0 2024-09-10T23:14:58.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.318+0000 7f2416d00640 1 -- 172.21.15.90:0/6550559 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24100c5a30 con 0x7f241015edb0 2024-09-10T23:14:58.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.318+0000 7f2416d00640 1 -- 172.21.15.90:0/6550559 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24100c5ff0 con 0x7f241015edb0 2024-09-10T23:14:58.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.319+0000 7f2416d00640 1 -- 172.21.15.90:0/6550559 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f241015cae0 con 0x7f241015edb0 2024-09-10T23:14:58.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.319+0000 7f24057fa640 1 -- 172.21.15.90:0/6550559 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f240800abb0 con 0x7f241015edb0 2024-09-10T23:14:58.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.320+0000 7f24057fa640 1 --2- 172.21.15.90:0/6550559 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f23fc077f70 0x7f23fc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:58.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.320+0000 7f24057fa640 1 -- 172.21.15.90:0/6550559 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2408099ed0 con 0x7f241015edb0 2024-09-10T23:14:58.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.320+0000 7f2414a9c640 1 --2- 172.21.15.90:0/6550559 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f23fc077f70 0x7f23fc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:58.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.320+0000 7f2414a9c640 1 --2- 172.21.15.90:0/6550559 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f23fc077f70 0x7f23fc07a430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f240c033000 tx=0x7f240c004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:58.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.324+0000 7f24057fa640 1 -- 172.21.15.90:0/6550559 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f241015cae0 con 0x7f241015edb0 2024-09-10T23:14:58.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.496+0000 7f2416d00640 1 -- 172.21.15.90:0/6550559 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f24100aa0a0 con 0x7f241015edb0 2024-09-10T23:14:58.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.497+0000 7f24057fa640 1 -- 172.21.15.90:0/6550559 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f2408020070 con 0x7f241015edb0 2024-09-10T23:14:58.498 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-09-10T23:14:58.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.499+0000 7f2416d00640 1 -- 172.21.15.90:0/6550559 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f23fc077f70 msgr2=0x7f23fc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.499+0000 7f2416d00640 1 --2- 172.21.15.90:0/6550559 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f23fc077f70 0x7f23fc07a430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f240c033000 tx=0x7f240c004730 comp rx=0 tx=0).stop 2024-09-10T23:14:58.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.499+0000 7f2416d00640 1 -- 172.21.15.90:0/6550559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f241015edb0 msgr2=0x7f24101f6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.499+0000 7f2416d00640 1 --2- 172.21.15.90:0/6550559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f241015edb0 0x7f24101f6060 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f240800c780 tx=0x7f240800cc40 comp rx=0 tx=0).stop 2024-09-10T23:14:58.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.499+0000 7f2416d00640 1 -- 172.21.15.90:0/6550559 shutdown_connections 2024-09-10T23:14:58.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.499+0000 7f2416d00640 1 --2- 172.21.15.90:0/6550559 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f23fc077f70 0x7f23fc07a430 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.499+0000 7f2416d00640 1 --2- 172.21.15.90:0/6550559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f241015edb0 0x7f24101f6060 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.499+0000 7f2416d00640 1 --2- 172.21.15.90:0/6550559 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f241015ab10 0x7f24100ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.499+0000 7f2416d00640 1 --2- 172.21.15.90:0/6550559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24100cf840 0x7f24100c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.499+0000 7f2416d00640 1 -- 172.21.15.90:0/6550559 >> 172.21.15.90:0/6550559 conn(0x7f24100cfc80 msgr2=0x7f241015de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:58.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.499+0000 7f2416d00640 1 -- 172.21.15.90:0/6550559 shutdown_connections 2024-09-10T23:14:58.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.499+0000 7f2416d00640 1 -- 172.21.15.90:0/6550559 wait complete. 2024-09-10T23:14:58.511 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T23:14:58.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.613+0000 7f0b78ba0640 1 -- 172.21.15.90:0/3981353506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b74073800 msgr2=0x7f0b74073c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.613+0000 7f0b78ba0640 1 --2- 172.21.15.90:0/3981353506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b74073800 0x7f0b74073c40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009830 tx=0x7f0b5c02a510 comp rx=0 tx=0).stop 2024-09-10T23:14:58.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.613+0000 7f0b78ba0640 1 -- 172.21.15.90:0/3981353506 shutdown_connections 2024-09-10T23:14:58.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.613+0000 7f0b78ba0640 1 --2- 172.21.15.90:0/3981353506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b74073800 0x7f0b74073c40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.613+0000 7f0b78ba0640 1 -- 172.21.15.90:0/3981353506 >> 172.21.15.90:0/3981353506 conn(0x7f0b740b2950 msgr2=0x7f0b740b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:58.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.613+0000 7f0b78ba0640 1 -- 172.21.15.90:0/3981353506 shutdown_connections 2024-09-10T23:14:58.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.613+0000 7f0b78ba0640 1 -- 172.21.15.90:0/3981353506 wait complete. 2024-09-10T23:14:58.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.614+0000 7f0b78ba0640 1 Processor -- start 2024-09-10T23:14:58.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.614+0000 7f0b78ba0640 1 -- start start 2024-09-10T23:14:58.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.615+0000 7f0b78ba0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b74073800 0x7f0b7415de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:58.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.615+0000 7f0b78ba0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b740cba30 0x7f0b740b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:58.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.615+0000 7f0b78ba0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b7415af30 0x7f0b740b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:58.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.615+0000 7f0b78ba0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0b740cc5b0 con 0x7f0b74073800 2024-09-10T23:14:58.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.615+0000 7f0b78ba0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0b740b0690 con 0x7f0b740cba30 2024-09-10T23:14:58.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.615+0000 7f0b78ba0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0b740cc730 con 0x7f0b7415af30 2024-09-10T23:14:58.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.615+0000 7f0b7259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b74073800 0x7f0b7415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:58.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.615+0000 7f0b7259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b74073800 0x7f0b7415de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55588/0 (socket says 172.21.15.90:55588) 2024-09-10T23:14:58.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.615+0000 7f0b7259c640 1 -- 172.21.15.90:0/776952308 learned_addr learned my addr 172.21.15.90:0/776952308 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:58.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.615+0000 7f0b71d9b640 1 --2- 172.21.15.90:0/776952308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b740cba30 0x7f0b740b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:58.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.615+0000 7f0b72d9d640 1 --2- 172.21.15.90:0/776952308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b7415af30 0x7f0b740b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:58.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.616+0000 7f0b7259c640 1 -- 172.21.15.90:0/776952308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b7415af30 msgr2=0x7f0b740b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.616+0000 7f0b7259c640 1 --2- 172.21.15.90:0/776952308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b7415af30 0x7f0b740b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.616+0000 7f0b7259c640 1 -- 172.21.15.90:0/776952308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b740cba30 msgr2=0x7f0b740b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.616+0000 7f0b7259c640 1 --2- 172.21.15.90:0/776952308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b740cba30 0x7f0b740b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.616+0000 7f0b7259c640 1 -- 172.21.15.90:0/776952308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b741f34c0 con 0x7f0b74073800 2024-09-10T23:14:58.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.616+0000 7f0b7259c640 1 --2- 172.21.15.90:0/776952308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b74073800 0x7f0b7415de50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400c7d0 tx=0x7f0b6400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:58.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.616+0000 7f0b6affd640 1 -- 172.21.15.90:0/776952308 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b64017070 con 0x7f0b74073800 2024-09-10T23:14:58.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.616+0000 7f0b6affd640 1 -- 172.21.15.90:0/776952308 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b64005070 con 0x7f0b74073800 2024-09-10T23:14:58.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.616+0000 7f0b78ba0640 1 -- 172.21.15.90:0/776952308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7415d370 con 0x7f0b74073800 2024-09-10T23:14:58.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.616+0000 7f0b6affd640 1 -- 172.21.15.90:0/776952308 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b640054a0 con 0x7f0b74073800 2024-09-10T23:14:58.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.616+0000 7f0b78ba0640 1 -- 172.21.15.90:0/776952308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b7415d930 con 0x7f0b74073800 2024-09-10T23:14:58.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.617+0000 7f0b78ba0640 1 -- 172.21.15.90:0/776952308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b740ccc20 con 0x7f0b74073800 2024-09-10T23:14:58.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.618+0000 7f0b6affd640 1 -- 172.21.15.90:0/776952308 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0b64005640 con 0x7f0b74073800 2024-09-10T23:14:58.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.618+0000 7f0b6affd640 1 --2- 172.21.15.90:0/776952308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b54077f70 0x7f0b5407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:58.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.618+0000 7f0b6affd640 1 -- 172.21.15.90:0/776952308 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0b64099600 con 0x7f0b74073800 2024-09-10T23:14:58.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.618+0000 7f0b71d9b640 1 --2- 172.21.15.90:0/776952308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b54077f70 0x7f0b5407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:58.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.619+0000 7f0b71d9b640 1 --2- 172.21.15.90:0/776952308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b54077f70 0x7f0b5407a430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c034000 tx=0x7f0b5c004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:58.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.622+0000 7f0b6affd640 1 -- 172.21.15.90:0/776952308 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0b64062190 con 0x7f0b74073800 2024-09-10T23:14:58.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.798+0000 7f0b78ba0640 1 -- 172.21.15.90:0/776952308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0b7415db00 con 0x7f0b74073800 2024-09-10T23:14:58.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.798+0000 7f0b6affd640 1 -- 172.21.15.90:0/776952308 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f0b64061a90 con 0x7f0b74073800 2024-09-10T23:14:58.799 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-09-10T23:14:58.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.800+0000 7f0b78ba0640 1 -- 172.21.15.90:0/776952308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b54077f70 msgr2=0x7f0b5407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.800+0000 7f0b78ba0640 1 --2- 172.21.15.90:0/776952308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b54077f70 0x7f0b5407a430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c034000 tx=0x7f0b5c004730 comp rx=0 tx=0).stop 2024-09-10T23:14:58.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.800+0000 7f0b78ba0640 1 -- 172.21.15.90:0/776952308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b74073800 msgr2=0x7f0b7415de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.800+0000 7f0b78ba0640 1 --2- 172.21.15.90:0/776952308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b74073800 0x7f0b7415de50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400c7d0 tx=0x7f0b6400cc90 comp rx=0 tx=0).stop 2024-09-10T23:14:58.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.800+0000 7f0b78ba0640 1 -- 172.21.15.90:0/776952308 shutdown_connections 2024-09-10T23:14:58.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.800+0000 7f0b78ba0640 1 --2- 172.21.15.90:0/776952308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b54077f70 0x7f0b5407a430 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.800+0000 7f0b78ba0640 1 --2- 172.21.15.90:0/776952308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b740cba30 0x7f0b740b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.800+0000 7f0b78ba0640 1 --2- 172.21.15.90:0/776952308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b7415af30 0x7f0b740b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.800+0000 7f0b78ba0640 1 --2- 172.21.15.90:0/776952308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b74073800 0x7f0b7415de50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.800+0000 7f0b78ba0640 1 -- 172.21.15.90:0/776952308 >> 172.21.15.90:0/776952308 conn(0x7f0b740b2950 msgr2=0x7f0b740cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:58.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.800+0000 7f0b78ba0640 1 -- 172.21.15.90:0/776952308 shutdown_connections 2024-09-10T23:14:58.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.800+0000 7f0b78ba0640 1 -- 172.21.15.90:0/776952308 wait complete. 2024-09-10T23:14:58.812 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T23:14:58.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.915+0000 7faf866dd640 1 -- 172.21.15.90:0/4045639217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf68003a30 msgr2=0x7faf68003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.915+0000 7faf866dd640 1 --2- 172.21.15.90:0/4045639217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf68003a30 0x7faf68003e50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faf7000c310 tx=0x7faf68005830 comp rx=0 tx=0).stop 2024-09-10T23:14:58.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.915+0000 7faf84c7a640 1 -- 172.21.15.90:0/4045639217 reap_dead start 2024-09-10T23:14:58.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.915+0000 7faf866dd640 1 -- 172.21.15.90:0/4045639217 shutdown_connections 2024-09-10T23:14:58.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.915+0000 7faf866dd640 1 -- 172.21.15.90:0/4045639217 >> 172.21.15.90:0/4045639217 conn(0x7faf800d4190 msgr2=0x7faf800d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:58.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.915+0000 7faf866dd640 1 -- 172.21.15.90:0/4045639217 shutdown_connections 2024-09-10T23:14:58.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.915+0000 7faf866dd640 1 -- 172.21.15.90:0/4045639217 wait complete. 2024-09-10T23:14:58.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.916+0000 7faf866dd640 1 Processor -- start 2024-09-10T23:14:58.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.916+0000 7faf866dd640 1 -- start start 2024-09-10T23:14:58.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf866dd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf68003a30 0x7faf800caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:58.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf866dd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf80154740 0x7faf8014c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:58.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf866dd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf8015cbc0 0x7faf8015d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:58.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf866dd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faf800d3230 con 0x7faf68003a30 2024-09-10T23:14:58.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf866dd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faf800d30b0 con 0x7faf80154740 2024-09-10T23:14:58.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf866dd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faf800b9110 con 0x7faf8015cbc0 2024-09-10T23:14:58.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf7ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf68003a30 0x7faf800caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:58.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf7ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf68003a30 0x7faf800caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55602/0 (socket says 172.21.15.90:55602) 2024-09-10T23:14:58.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf7ffff640 1 -- 172.21.15.90:0/50950464 learned_addr learned my addr 172.21.15.90:0/50950464 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:58.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf7f7fe640 1 --2- 172.21.15.90:0/50950464 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf80154740 0x7faf8014c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:58.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf84c7a640 1 --2- 172.21.15.90:0/50950464 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf8015cbc0 0x7faf8015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:58.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf7ffff640 1 -- 172.21.15.90:0/50950464 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf8015cbc0 msgr2=0x7faf8015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf7ffff640 1 --2- 172.21.15.90:0/50950464 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf8015cbc0 0x7faf8015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf7ffff640 1 -- 172.21.15.90:0/50950464 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf80154740 msgr2=0x7faf8014c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:58.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf7ffff640 1 --2- 172.21.15.90:0/50950464 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf80154740 0x7faf8014c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:58.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf7ffff640 1 -- 172.21.15.90:0/50950464 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf800c7fa0 con 0x7faf68003a30 2024-09-10T23:14:58.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf7ffff640 1 --2- 172.21.15.90:0/50950464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf68003a30 0x7faf800caa60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faf7000c310 tx=0x7faf70001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:58.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf7cff9640 1 -- 172.21.15.90:0/50950464 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf70031040 con 0x7faf68003a30 2024-09-10T23:14:58.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf7cff9640 1 -- 172.21.15.90:0/50950464 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf700035f0 con 0x7faf68003a30 2024-09-10T23:14:58.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf866dd640 1 -- 172.21.15.90:0/50950464 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf801f87d0 con 0x7faf68003a30 2024-09-10T23:14:58.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf7cff9640 1 -- 172.21.15.90:0/50950464 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf700039e0 con 0x7faf68003a30 2024-09-10T23:14:58.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.917+0000 7faf866dd640 1 -- 172.21.15.90:0/50950464 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf801f8d90 con 0x7faf68003a30 2024-09-10T23:14:58.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.919+0000 7faf866dd640 1 -- 172.21.15.90:0/50950464 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf800b8a00 con 0x7faf68003a30 2024-09-10T23:14:58.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.919+0000 7faf7cff9640 1 -- 172.21.15.90:0/50950464 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7faf70003b80 con 0x7faf68003a30 2024-09-10T23:14:58.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.919+0000 7faf7cff9640 1 --2- 172.21.15.90:0/50950464 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faf6c077f70 0x7faf6c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:58.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.920+0000 7faf7cff9640 1 -- 172.21.15.90:0/50950464 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7faf700b9b20 con 0x7faf68003a30 2024-09-10T23:14:58.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.920+0000 7faf7f7fe640 1 --2- 172.21.15.90:0/50950464 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faf6c077f70 0x7faf6c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:58.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.920+0000 7faf7f7fe640 1 --2- 172.21.15.90:0/50950464 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faf6c077f70 0x7faf6c07a430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faf80160070 tx=0x7faf7400d410 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:58.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:58.924+0000 7faf7cff9640 1 -- 172.21.15.90:0/50950464 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7faf70082120 con 0x7faf68003a30 2024-09-10T23:14:59.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.097+0000 7faf866dd640 1 -- 172.21.15.90:0/50950464 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faf8015bec0 con 0x7faf68003a30 2024-09-10T23:14:59.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.097+0000 7faf7cff9640 1 -- 172.21.15.90:0/50950464 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7faf70086b50 con 0x7faf68003a30 2024-09-10T23:14:59.098 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-09-10T23:14:59.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.099+0000 7faf866dd640 1 -- 172.21.15.90:0/50950464 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faf6c077f70 msgr2=0x7faf6c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:59.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.099+0000 7faf866dd640 1 --2- 172.21.15.90:0/50950464 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faf6c077f70 0x7faf6c07a430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faf80160070 tx=0x7faf7400d410 comp rx=0 tx=0).stop 2024-09-10T23:14:59.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.099+0000 7faf866dd640 1 -- 172.21.15.90:0/50950464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf68003a30 msgr2=0x7faf800caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:59.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.099+0000 7faf866dd640 1 --2- 172.21.15.90:0/50950464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf68003a30 0x7faf800caa60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faf7000c310 tx=0x7faf70001da0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.099+0000 7faf866dd640 1 -- 172.21.15.90:0/50950464 shutdown_connections 2024-09-10T23:14:59.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.099+0000 7faf866dd640 1 --2- 172.21.15.90:0/50950464 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faf6c077f70 0x7faf6c07a430 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.099+0000 7faf866dd640 1 --2- 172.21.15.90:0/50950464 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf80154740 0x7faf8014c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.099+0000 7faf866dd640 1 --2- 172.21.15.90:0/50950464 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf8015cbc0 0x7faf8015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.099+0000 7faf866dd640 1 --2- 172.21.15.90:0/50950464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf68003a30 0x7faf800caa60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.099+0000 7faf866dd640 1 -- 172.21.15.90:0/50950464 >> 172.21.15.90:0/50950464 conn(0x7faf800d4190 msgr2=0x7faf8006ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:59.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.099+0000 7faf866dd640 1 -- 172.21.15.90:0/50950464 shutdown_connections 2024-09-10T23:14:59.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.099+0000 7faf866dd640 1 -- 172.21.15.90:0/50950464 wait complete. 2024-09-10T23:14:59.111 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close' 2024-09-10T23:14:59.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.211+0000 7f4a5b34b640 1 -- 172.21.15.90:0/2216122083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a540cb7e0 msgr2=0x7f4a5406f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:59.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.211+0000 7f4a5b34b640 1 --2- 172.21.15.90:0/2216122083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a540cb7e0 0x7f4a5406f850 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4a540b5f10 tx=0x7f4a4802a530 comp rx=0 tx=0).stop 2024-09-10T23:14:59.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.211+0000 7f4a5b34b640 1 -- 172.21.15.90:0/2216122083 shutdown_connections 2024-09-10T23:14:59.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.211+0000 7f4a5b34b640 1 --2- 172.21.15.90:0/2216122083 >> v2:172.21.15.171:3300/0 conn(0x7f4a540ca420 0x7f4a540ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.211+0000 7f4a5b34b640 1 --2- 172.21.15.90:0/2216122083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a540cb7e0 0x7f4a5406f850 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.211+0000 7f4a5b34b640 1 -- 172.21.15.90:0/2216122083 >> 172.21.15.90:0/2216122083 conn(0x7f4a540cc850 msgr2=0x7f4a540ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:59.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.211+0000 7f4a5b34b640 1 -- 172.21.15.90:0/2216122083 shutdown_connections 2024-09-10T23:14:59.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.211+0000 7f4a5b34b640 1 -- 172.21.15.90:0/2216122083 wait complete. 2024-09-10T23:14:59.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.212+0000 7f4a5b34b640 1 Processor -- start 2024-09-10T23:14:59.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.212+0000 7f4a5b34b640 1 -- start start 2024-09-10T23:14:59.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.213+0000 7f4a5b34b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a540ca420 0x7f4a540c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:59.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.213+0000 7f4a5b34b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a540cb7e0 0x7f4a5415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:59.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.213+0000 7f4a5b34b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a5415bcb0 0x7f4a540ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:59.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.213+0000 7f4a5b34b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5415c210 con 0x7f4a5415bcb0 2024-09-10T23:14:59.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.213+0000 7f4a5b34b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5415c090 con 0x7f4a540cb7e0 2024-09-10T23:14:59.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.213+0000 7f4a5b34b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4a540b1850 con 0x7f4a540ca420 2024-09-10T23:14:59.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.213+0000 7f4a598e8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a5415bcb0 0x7f4a540ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:59.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.213+0000 7f4a598e8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a5415bcb0 0x7f4a540ad630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55608/0 (socket says 172.21.15.90:55608) 2024-09-10T23:14:59.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.213+0000 7f4a598e8640 1 -- 172.21.15.90:0/605434069 learned_addr learned my addr 172.21.15.90:0/605434069 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:59.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.213+0000 7f4a598e8640 1 -- 172.21.15.90:0/605434069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a540ca420 msgr2=0x7f4a540c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:59.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.213+0000 7f4a598e8640 1 --2- 172.21.15.90:0/605434069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a540ca420 0x7f4a540c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.213+0000 7f4a598e8640 1 -- 172.21.15.90:0/605434069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a540cb7e0 msgr2=0x7f4a5415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:59.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.213+0000 7f4a598e8640 1 --2- 172.21.15.90:0/605434069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a540cb7e0 0x7f4a5415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.213+0000 7f4a598e8640 1 -- 172.21.15.90:0/605434069 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a541f23a0 con 0x7f4a5415bcb0 2024-09-10T23:14:59.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.213+0000 7f4a598e8640 1 --2- 172.21.15.90:0/605434069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a5415bcb0 0x7f4a540ad630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00c970 tx=0x7f4a4c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:59.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.214+0000 7f4a51ffb640 1 -- 172.21.15.90:0/605434069 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c007b50 con 0x7f4a5415bcb0 2024-09-10T23:14:59.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.214+0000 7f4a51ffb640 1 -- 172.21.15.90:0/605434069 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a4c007e00 con 0x7f4a5415bcb0 2024-09-10T23:14:59.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.214+0000 7f4a5b34b640 1 -- 172.21.15.90:0/605434069 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a540c60a0 con 0x7f4a5415bcb0 2024-09-10T23:14:59.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.214+0000 7f4a51ffb640 1 -- 172.21.15.90:0/605434069 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c00f6b0 con 0x7f4a5415bcb0 2024-09-10T23:14:59.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.214+0000 7f4a5b34b640 1 -- 172.21.15.90:0/605434069 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a540c6640 con 0x7f4a5415bcb0 2024-09-10T23:14:59.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.215+0000 7f4a5b34b640 1 -- 172.21.15.90:0/605434069 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a541f2570 con 0x7f4a5415bcb0 2024-09-10T23:14:59.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.215+0000 7f4a51ffb640 1 -- 172.21.15.90:0/605434069 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4a4c00f850 con 0x7f4a5415bcb0 2024-09-10T23:14:59.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.216+0000 7f4a51ffb640 1 --2- 172.21.15.90:0/605434069 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a40077fa0 0x7f4a4007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:59.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.216+0000 7f4a51ffb640 1 -- 172.21.15.90:0/605434069 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4a4c09a500 con 0x7f4a5415bcb0 2024-09-10T23:14:59.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.216+0000 7f4a590e7640 1 --2- 172.21.15.90:0/605434069 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a40077fa0 0x7f4a4007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:59.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.217+0000 7f4a590e7640 1 --2- 172.21.15.90:0/605434069 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a40077fa0 0x7f4a4007a460 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4a44001c10 tx=0x7f4a44007cb0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:59.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.220+0000 7f4a51ffb640 1 -- 172.21.15.90:0/605434069 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4a4c014030 con 0x7f4a5415bcb0 2024-09-10T23:14:59.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.463+0000 7f4a5b34b640 1 -- 172.21.15.90:0/605434069 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]} v 0) -- 0x7f4a540ca820 con 0x7f4a5415bcb0 2024-09-10T23:14:59.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.527+0000 7f4a51ffb640 1 -- 172.21.15.90:0/605434069 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]}]=0 v44) ==== 147+0+0 (secure 0 0 0) 0x7f4a4c063090 con 0x7f4a5415bcb0 2024-09-10T23:14:59.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.529+0000 7f4a5b34b640 1 -- 172.21.15.90:0/605434069 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a40077fa0 msgr2=0x7f4a4007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:59.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.529+0000 7f4a5b34b640 1 --2- 172.21.15.90:0/605434069 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a40077fa0 0x7f4a4007a460 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4a44001c10 tx=0x7f4a44007cb0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.529+0000 7f4a5b34b640 1 -- 172.21.15.90:0/605434069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a5415bcb0 msgr2=0x7f4a540ad630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:59.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.529+0000 7f4a5b34b640 1 --2- 172.21.15.90:0/605434069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a5415bcb0 0x7f4a540ad630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00c970 tx=0x7f4a4c00ce30 comp rx=0 tx=0).stop 2024-09-10T23:14:59.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.529+0000 7f4a5b34b640 1 -- 172.21.15.90:0/605434069 shutdown_connections 2024-09-10T23:14:59.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.529+0000 7f4a5b34b640 1 --2- 172.21.15.90:0/605434069 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a40077fa0 0x7f4a4007a460 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.529+0000 7f4a5b34b640 1 --2- 172.21.15.90:0/605434069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a540cb7e0 0x7f4a5415a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.529+0000 7f4a5b34b640 1 --2- 172.21.15.90:0/605434069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a5415bcb0 0x7f4a540ad630 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.529+0000 7f4a5b34b640 1 --2- 172.21.15.90:0/605434069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a540ca420 0x7f4a540c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.529+0000 7f4a5b34b640 1 -- 172.21.15.90:0/605434069 >> 172.21.15.90:0/605434069 conn(0x7f4a540cc850 msgr2=0x7f4a540b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:59.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.530+0000 7f4a5b34b640 1 -- 172.21.15.90:0/605434069 shutdown_connections 2024-09-10T23:14:59.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.530+0000 7f4a5b34b640 1 -- 172.21.15.90:0/605434069 wait complete. 2024-09-10T23:14:59.541 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:14:59.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.641+0000 7f5fa06ef640 1 -- 172.21.15.90:0/2195967514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f80003c10 msgr2=0x7f5f80004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:59.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.641+0000 7f5fa06ef640 1 --2- 172.21.15.90:0/2195967514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f80003c10 0x7f5f80004010 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800c640 tx=0x7f5f80005830 comp rx=0 tx=0).stop 2024-09-10T23:14:59.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.641+0000 7f5f9ec8c640 1 -- 172.21.15.90:0/2195967514 reap_dead start 2024-09-10T23:14:59.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.642+0000 7f5fa06ef640 1 -- 172.21.15.90:0/2195967514 shutdown_connections 2024-09-10T23:14:59.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.642+0000 7f5fa06ef640 1 -- 172.21.15.90:0/2195967514 >> 172.21.15.90:0/2195967514 conn(0x7f5f980d0490 msgr2=0x7f5f980d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:59.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.642+0000 7f5fa06ef640 1 -- 172.21.15.90:0/2195967514 shutdown_connections 2024-09-10T23:14:59.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.642+0000 7f5fa06ef640 1 -- 172.21.15.90:0/2195967514 wait complete. 2024-09-10T23:14:59.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.643+0000 7f5fa06ef640 1 Processor -- start 2024-09-10T23:14:59.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.643+0000 7f5fa06ef640 1 -- start start 2024-09-10T23:14:59.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5fa06ef640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f80003c10 0x7f5f980c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:59.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5fa06ef640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f980c7560 0x7f5f981f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:59.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5fa06ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f981f6400 0x7f5f980c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:59.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5fa06ef640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9815e7c0 con 0x7f5f981f6400 2024-09-10T23:14:59.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5fa06ef640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9815e640 con 0x7f5f80003c10 2024-09-10T23:14:59.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5fa06ef640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5f980ce770 con 0x7f5f980c7560 2024-09-10T23:14:59.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5f9ec8c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f981f6400 0x7f5f980c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:59.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5f9ec8c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f981f6400 0x7f5f980c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55626/0 (socket says 172.21.15.90:55626) 2024-09-10T23:14:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5f9ec8c640 1 -- 172.21.15.90:0/2984450203 learned_addr learned my addr 172.21.15.90:0/2984450203 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5f9e48b640 1 --2- 172.21.15.90:0/2984450203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f80003c10 0x7f5f980c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5f9dc8a640 1 --2- 172.21.15.90:0/2984450203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f980c7560 0x7f5f981f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5f9ec8c640 1 -- 172.21.15.90:0/2984450203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f980c7560 msgr2=0x7f5f981f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5f9ec8c640 1 --2- 172.21.15.90:0/2984450203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f980c7560 0x7f5f981f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5f9ec8c640 1 -- 172.21.15.90:0/2984450203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f80003c10 msgr2=0x7f5f980c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5f9ec8c640 1 --2- 172.21.15.90:0/2984450203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f80003c10 0x7f5f980c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5f9ec8c640 1 -- 172.21.15.90:0/2984450203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f980c9190 con 0x7f5f981f6400 2024-09-10T23:14:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5f9e48b640 1 --2- 172.21.15.90:0/2984450203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f80003c10 0x7f5f980c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:14:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5f9dc8a640 1 --2- 172.21.15.90:0/2984450203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f980c7560 0x7f5f981f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:14:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5f9ec8c640 1 --2- 172.21.15.90:0/2984450203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f981f6400 0x7f5f980c9f10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5f980af8a0 tx=0x7f5f90011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5f96ffd640 1 -- 172.21.15.90:0/2984450203 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f90004230 con 0x7f5f981f6400 2024-09-10T23:14:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5f96ffd640 1 -- 172.21.15.90:0/2984450203 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f90016070 con 0x7f5f981f6400 2024-09-10T23:14:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5fa06ef640 1 -- 172.21.15.90:0/2984450203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f980c7a20 con 0x7f5f981f6400 2024-09-10T23:14:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5f96ffd640 1 -- 172.21.15.90:0/2984450203 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9000fa90 con 0x7f5f981f6400 2024-09-10T23:14:59.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.644+0000 7f5fa06ef640 1 -- 172.21.15.90:0/2984450203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f980c9710 con 0x7f5f981f6400 2024-09-10T23:14:59.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.645+0000 7f5fa06ef640 1 -- 172.21.15.90:0/2984450203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f980ce060 con 0x7f5f981f6400 2024-09-10T23:14:59.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.646+0000 7f5f96ffd640 1 -- 172.21.15.90:0/2984450203 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5f90023030 con 0x7f5f981f6400 2024-09-10T23:14:59.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.646+0000 7f5f96ffd640 1 --2- 172.21.15.90:0/2984450203 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5f84077f70 0x7f5f8407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:59.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.647+0000 7f5f96ffd640 1 -- 172.21.15.90:0/2984450203 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5f9009a450 con 0x7f5f981f6400 2024-09-10T23:14:59.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.647+0000 7f5f9e48b640 1 --2- 172.21.15.90:0/2984450203 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5f84077f70 0x7f5f8407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:59.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.647+0000 7f5f9e48b640 1 --2- 172.21.15.90:0/2984450203 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5f84077f70 0x7f5f8407a430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5f88033000 tx=0x7f5f88038040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:59.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.651+0000 7f5f96ffd640 1 -- 172.21.15.90:0/2984450203 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5f90062f50 con 0x7f5f981f6400 2024-09-10T23:14:59.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.826+0000 7f5fa06ef640 1 -- 172.21.15.90:0/2984450203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f5f980b32c0 con 0x7f5f981f6400 2024-09-10T23:14:59.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.826+0000 7f5f96ffd640 1 -- 172.21.15.90:0/2984450203 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1998 (secure 0 0 0) 0x7f5f90062850 con 0x7f5f981f6400 2024-09-10T23:14:59.827 INFO:teuthology.orchestra.run.smithi090.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:14:59.828 INFO:teuthology.orchestra.run.smithi090.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:14:59.828 INFO:teuthology.orchestra.run.smithi090.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:14:59.828 INFO:teuthology.orchestra.run.smithi090.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:14:59.828 INFO:teuthology.orchestra.run.smithi090.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8283.895139 2024-09-10T23:14:59.828 INFO:teuthology.orchestra.run.smithi090.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5684.288500 2024-09-10T23:14:59.828 INFO:teuthology.orchestra.run.smithi090.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5960.411649 2024-09-10T23:14:59.828 INFO:teuthology.orchestra.run.smithi090.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5499.929251 2024-09-10T23:14:59.828 INFO:teuthology.orchestra.run.smithi090.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5373.806301 2024-09-10T23:14:59.828 INFO:teuthology.orchestra.run.smithi090.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5138.908279 2024-09-10T23:14:59.828 INFO:teuthology.orchestra.run.smithi090.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5181.430205 2024-09-10T23:14:59.828 INFO:teuthology.orchestra.run.smithi090.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4880.265977 2024-09-10T23:14:59.828 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_mds 20/20 2024-09-10T23:14:59.828 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:14:59.829 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_ms 2/2 2024-09-10T23:14:59.829 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_debug_frag true 2024-09-10T23:14:59.829 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:14:59.829 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:14:59.829 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_verify_scatter true 2024-09-10T23:14:59.829 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:14:59.829 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:14:59.829 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:14:59.829 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced client_mount_timeout 600 2024-09-10T23:14:59.829 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced debug_client 20/20 2024-09-10T23:14:59.829 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced debug_ms 1/1 2024-09-10T23:14:59.829 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:14:59.829 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:14:59.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.828+0000 7f5fa06ef640 1 -- 172.21.15.90:0/2984450203 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5f84077f70 msgr2=0x7f5f8407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:59.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.828+0000 7f5fa06ef640 1 --2- 172.21.15.90:0/2984450203 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5f84077f70 0x7f5f8407a430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5f88033000 tx=0x7f5f88038040 comp rx=0 tx=0).stop 2024-09-10T23:14:59.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.828+0000 7f5fa06ef640 1 -- 172.21.15.90:0/2984450203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f981f6400 msgr2=0x7f5f980c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:59.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.828+0000 7f5fa06ef640 1 --2- 172.21.15.90:0/2984450203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f981f6400 0x7f5f980c9f10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5f980af8a0 tx=0x7f5f90011b10 comp rx=0 tx=0).stop 2024-09-10T23:14:59.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.828+0000 7f5fa06ef640 1 -- 172.21.15.90:0/2984450203 shutdown_connections 2024-09-10T23:14:59.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.828+0000 7f5fa06ef640 1 --2- 172.21.15.90:0/2984450203 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5f84077f70 0x7f5f8407a430 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.828+0000 7f5fa06ef640 1 --2- 172.21.15.90:0/2984450203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f981f6400 0x7f5f980c9f10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.828+0000 7f5fa06ef640 1 --2- 172.21.15.90:0/2984450203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f980c7560 0x7f5f981f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.828+0000 7f5fa06ef640 1 --2- 172.21.15.90:0/2984450203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f80003c10 0x7f5f980c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.828+0000 7f5fa06ef640 1 -- 172.21.15.90:0/2984450203 >> 172.21.15.90:0/2984450203 conn(0x7f5f980d0490 msgr2=0x7f5f980b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:59.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.829+0000 7f5fa06ef640 1 -- 172.21.15.90:0/2984450203 shutdown_connections 2024-09-10T23:14:59.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.829+0000 7f5fa06ef640 1 -- 172.21.15.90:0/2984450203 wait complete. 2024-09-10T23:14:59.841 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:14:59.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.944+0000 7f9898d75640 1 -- 172.21.15.90:0/3842460443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9880004800 msgr2=0x7f9880004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:59.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.944+0000 7f9898d75640 1 --2- 172.21.15.90:0/3842460443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9880004800 0x7f9880004c80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f987c009b20 tx=0x7f9880005830 comp rx=0 tx=0).stop 2024-09-10T23:14:59.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.944+0000 7f9898d75640 1 -- 172.21.15.90:0/3842460443 shutdown_connections 2024-09-10T23:14:59.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.944+0000 7f9898d75640 1 --2- 172.21.15.90:0/3842460443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9880004800 0x7f9880004c80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.944+0000 7f9898d75640 1 -- 172.21.15.90:0/3842460443 >> 172.21.15.90:0/3842460443 conn(0x7f98940d4190 msgr2=0x7f98940d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:14:59.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.944+0000 7f9898d75640 1 -- 172.21.15.90:0/3842460443 shutdown_connections 2024-09-10T23:14:59.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.944+0000 7f9898d75640 1 -- 172.21.15.90:0/3842460443 wait complete. 2024-09-10T23:14:59.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.945+0000 7f9898d75640 1 Processor -- start 2024-09-10T23:14:59.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.945+0000 7f9898d75640 1 -- start start 2024-09-10T23:14:59.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.946+0000 7f9898d75640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9880004800 0x7f98940a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:59.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.946+0000 7f9898d75640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9894160870 0x7f9894160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:59.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.946+0000 7f9898d75640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98940cbac0 0x7f98940cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:59.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.946+0000 7f9898d75640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f98940d3230 con 0x7f9894160870 2024-09-10T23:14:59.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.946+0000 7f9898d75640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f98940d30b0 con 0x7f98940cbac0 2024-09-10T23:14:59.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.946+0000 7f9898d75640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f98940d1cd0 con 0x7f9880004800 2024-09-10T23:14:59.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.946+0000 7f988bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9894160870 0x7f9894160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:59.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.946+0000 7f988bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9894160870 0x7f9894160cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55640/0 (socket says 172.21.15.90:55640) 2024-09-10T23:14:59.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.946+0000 7f988bfff640 1 -- 172.21.15.90:0/57973770 learned_addr learned my addr 172.21.15.90:0/57973770 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:14:59.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.946+0000 7f9892d9d640 1 --2- 172.21.15.90:0/57973770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98940cbac0 0x7f98940cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:59.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.946+0000 7f988bfff640 1 -- 172.21.15.90:0/57973770 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9880004800 msgr2=0x7f98940a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:59.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.946+0000 7f989259c640 1 --2- 172.21.15.90:0/57973770 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9880004800 0x7f98940a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:59.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.946+0000 7f988bfff640 1 --2- 172.21.15.90:0/57973770 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9880004800 0x7f98940a1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.946+0000 7f988bfff640 1 -- 172.21.15.90:0/57973770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98940cbac0 msgr2=0x7f98940cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:14:59.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.946+0000 7f988bfff640 1 --2- 172.21.15.90:0/57973770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98940cbac0 0x7f98940cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:14:59.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.947+0000 7f988bfff640 1 -- 172.21.15.90:0/57973770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98940a1aa0 con 0x7f9894160870 2024-09-10T23:14:59.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.947+0000 7f9892d9d640 1 --2- 172.21.15.90:0/57973770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98940cbac0 0x7f98940cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:14:59.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.947+0000 7f988bfff640 1 --2- 172.21.15.90:0/57973770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9894160870 0x7f9894160cf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f987c009a70 tx=0x7f987c0336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:59.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.947+0000 7f988affd640 1 -- 172.21.15.90:0/57973770 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c038040 con 0x7f9894160870 2024-09-10T23:14:59.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.947+0000 7f988affd640 1 -- 172.21.15.90:0/57973770 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f987c041070 con 0x7f9894160870 2024-09-10T23:14:59.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.947+0000 7f9898d75640 1 -- 172.21.15.90:0/57973770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98940cc460 con 0x7f9894160870 2024-09-10T23:14:59.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.947+0000 7f988affd640 1 -- 172.21.15.90:0/57973770 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c033e50 con 0x7f9894160870 2024-09-10T23:14:59.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.947+0000 7f9898d75640 1 -- 172.21.15.90:0/57973770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98941f80b0 con 0x7f9894160870 2024-09-10T23:14:59.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.948+0000 7f9898d75640 1 -- 172.21.15.90:0/57973770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98940ced10 con 0x7f9894160870 2024-09-10T23:14:59.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.948+0000 7f988affd640 1 -- 172.21.15.90:0/57973770 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f987c03b070 con 0x7f9894160870 2024-09-10T23:14:59.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.949+0000 7f988affd640 1 --2- 172.21.15.90:0/57973770 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9874078140 0x7f987407a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:14:59.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.949+0000 7f988affd640 1 -- 172.21.15.90:0/57973770 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f987c0ba290 con 0x7f9894160870 2024-09-10T23:14:59.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.949+0000 7f989259c640 1 --2- 172.21.15.90:0/57973770 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9874078140 0x7f987407a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:14:59.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.950+0000 7f989259c640 1 --2- 172.21.15.90:0/57973770 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9874078140 0x7f987407a600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9884000c00 tx=0x7f9884006b70 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:14:59.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:14:59.953+0000 7f988affd640 1 -- 172.21.15.90:0/57973770 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f98940a1aa0 con 0x7f9894160870 2024-09-10T23:15:00.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.127+0000 7f9898d75640 1 -- 172.21.15.90:0/57973770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f98940cf730 con 0x7f9894160870 2024-09-10T23:15:00.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.130+0000 7f988affd640 1 -- 172.21.15.90:0/57973770 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f987c082da0 con 0x7f9894160870 2024-09-10T23:15:00.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.132+0000 7f9898d75640 1 -- 172.21.15.90:0/57973770 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9874078140 msgr2=0x7f987407a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:00.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.132+0000 7f9898d75640 1 --2- 172.21.15.90:0/57973770 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9874078140 0x7f987407a600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9884000c00 tx=0x7f9884006b70 comp rx=0 tx=0).stop 2024-09-10T23:15:00.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.132+0000 7f9898d75640 1 -- 172.21.15.90:0/57973770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9894160870 msgr2=0x7f9894160cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:00.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.132+0000 7f9898d75640 1 --2- 172.21.15.90:0/57973770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9894160870 0x7f9894160cf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f987c009a70 tx=0x7f987c0336f0 comp rx=0 tx=0).stop 2024-09-10T23:15:00.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.132+0000 7f9898d75640 1 -- 172.21.15.90:0/57973770 shutdown_connections 2024-09-10T23:15:00.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.132+0000 7f9898d75640 1 --2- 172.21.15.90:0/57973770 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9874078140 0x7f987407a600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:00.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.132+0000 7f9898d75640 1 --2- 172.21.15.90:0/57973770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98940cbac0 0x7f98940cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:00.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.132+0000 7f9898d75640 1 --2- 172.21.15.90:0/57973770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9894160870 0x7f9894160cf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:00.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.132+0000 7f9898d75640 1 --2- 172.21.15.90:0/57973770 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9880004800 0x7f98940a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:00.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.132+0000 7f9898d75640 1 -- 172.21.15.90:0/57973770 >> 172.21.15.90:0/57973770 conn(0x7f98940d4190 msgr2=0x7f989415ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:00.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.132+0000 7f9898d75640 1 -- 172.21.15.90:0/57973770 shutdown_connections 2024-09-10T23:15:00.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.132+0000 7f9898d75640 1 -- 172.21.15.90:0/57973770 wait complete. 2024-09-10T23:15:00.144 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:15:00.144 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:15:00.190 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:15:00.233 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:15:00.233 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:00.233 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:00.249 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:00.249 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:00.304 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:00.304 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:00.360 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:15:00.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.502+0000 7fa74cfd3640 1 -- 172.21.15.90:0/3791296749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa74815e260 msgr2=0x7fa7480b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:00.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.502+0000 7fa74cfd3640 1 --2- 172.21.15.90:0/3791296749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa74815e260 0x7fa7480b0400 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa748068c20 tx=0x7fa73802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:15:00.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.502+0000 7fa74cfd3640 1 -- 172.21.15.90:0/3791296749 shutdown_connections 2024-09-10T23:15:00.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.502+0000 7fa74cfd3640 1 --2- 172.21.15.90:0/3791296749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7480d1190 0x7fa7480caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:00.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.502+0000 7fa74cfd3640 1 --2- 172.21.15.90:0/3791296749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa74815e260 0x7fa7480b0400 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:00.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.502+0000 7fa74cfd3640 1 -- 172.21.15.90:0/3791296749 >> 172.21.15.90:0/3791296749 conn(0x7fa7480d0490 msgr2=0x7fa7480d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:00.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.502+0000 7fa74cfd3640 1 -- 172.21.15.90:0/3791296749 shutdown_connections 2024-09-10T23:15:00.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.502+0000 7fa74cfd3640 1 -- 172.21.15.90:0/3791296749 wait complete. 2024-09-10T23:15:00.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.504+0000 7fa74cfd3640 1 Processor -- start 2024-09-10T23:15:00.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.504+0000 7fa74cfd3640 1 -- start start 2024-09-10T23:15:00.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.504+0000 7fa74cfd3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7480b0940 0x7fa748158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:00.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.504+0000 7fa74cfd3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7480d1190 0x7fa7480ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:00.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.504+0000 7fa74cfd3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa74815e260 0x7fa7480aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:00.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.504+0000 7fa74cfd3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa74815e850 con 0x7fa74815e260 2024-09-10T23:15:00.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.504+0000 7fa74cfd3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa7480af750 con 0x7fa7480b0940 2024-09-10T23:15:00.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.504+0000 7fa74cfd3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa7480cf070 con 0x7fa7480d1190 2024-09-10T23:15:00.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.505+0000 7fa746d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa74815e260 0x7fa7480aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:00.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.505+0000 7fa746d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa74815e260 0x7fa7480aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55652/0 (socket says 172.21.15.90:55652) 2024-09-10T23:15:00.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.505+0000 7fa746d9d640 1 -- 172.21.15.90:0/1165451693 learned_addr learned my addr 172.21.15.90:0/1165451693 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:00.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.505+0000 7fa73ffff640 1 --2- 172.21.15.90:0/1165451693 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7480d1190 0x7fa7480ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:00.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.505+0000 7fa74659c640 1 --2- 172.21.15.90:0/1165451693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7480b0940 0x7fa748158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:00.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.505+0000 7fa746d9d640 1 -- 172.21.15.90:0/1165451693 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7480d1190 msgr2=0x7fa7480ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:00.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.505+0000 7fa746d9d640 1 --2- 172.21.15.90:0/1165451693 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7480d1190 0x7fa7480ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:00.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.505+0000 7fa746d9d640 1 -- 172.21.15.90:0/1165451693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7480b0940 msgr2=0x7fa748158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:00.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.505+0000 7fa746d9d640 1 --2- 172.21.15.90:0/1165451693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7480b0940 0x7fa748158ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:00.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.505+0000 7fa746d9d640 1 -- 172.21.15.90:0/1165451693 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7481568f0 con 0x7fa74815e260 2024-09-10T23:15:00.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.505+0000 7fa746d9d640 1 --2- 172.21.15.90:0/1165451693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa74815e260 0x7fa7480aeb80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa74000c730 tx=0x7fa74000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:00.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.505+0000 7fa73effd640 1 -- 172.21.15.90:0/1165451693 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740003da0 con 0x7fa74815e260 2024-09-10T23:15:00.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.505+0000 7fa73effd640 1 -- 172.21.15.90:0/1165451693 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa74000ce40 con 0x7fa74815e260 2024-09-10T23:15:00.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.505+0000 7fa73effd640 1 -- 172.21.15.90:0/1165451693 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7400052d0 con 0x7fa74815e260 2024-09-10T23:15:00.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.505+0000 7fa74cfd3640 1 -- 172.21.15.90:0/1165451693 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa748156450 con 0x7fa74815e260 2024-09-10T23:15:00.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.505+0000 7fa74cfd3640 1 -- 172.21.15.90:0/1165451693 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7480c37e0 con 0x7fa74815e260 2024-09-10T23:15:00.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.506+0000 7fa74cfd3640 1 -- 172.21.15.90:0/1165451693 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7480b0400 con 0x7fa74815e260 2024-09-10T23:15:00.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.507+0000 7fa73effd640 1 -- 172.21.15.90:0/1165451693 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa740005530 con 0x7fa74815e260 2024-09-10T23:15:00.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.507+0000 7fa73effd640 1 --2- 172.21.15.90:0/1165451693 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa728077f70 0x7fa72807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:00.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.507+0000 7fa73effd640 1 -- 172.21.15.90:0/1165451693 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa740099b00 con 0x7fa74815e260 2024-09-10T23:15:00.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.507+0000 7fa74659c640 1 --2- 172.21.15.90:0/1165451693 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa728077f70 0x7fa72807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:00.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.508+0000 7fa74659c640 1 --2- 172.21.15.90:0/1165451693 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa728077f70 0x7fa72807a430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa738034000 tx=0x7fa738004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:00.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.511+0000 7fa73effd640 1 -- 172.21.15.90:0/1165451693 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa740062690 con 0x7fa74815e260 2024-09-10T23:15:00.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.697+0000 7fa74cfd3640 1 -- 172.21.15.90:0/1165451693 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa74806acd0 con 0x7fa74815e260 2024-09-10T23:15:00.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.697+0000 7fa73effd640 1 -- 172.21.15.90:0/1165451693 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fa740061f90 con 0x7fa74815e260 2024-09-10T23:15:00.699 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:15:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.699+0000 7fa74cfd3640 1 -- 172.21.15.90:0/1165451693 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa728077f70 msgr2=0x7fa72807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.699+0000 7fa74cfd3640 1 --2- 172.21.15.90:0/1165451693 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa728077f70 0x7fa72807a430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa738034000 tx=0x7fa738004730 comp rx=0 tx=0).stop 2024-09-10T23:15:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.699+0000 7fa74cfd3640 1 -- 172.21.15.90:0/1165451693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa74815e260 msgr2=0x7fa7480aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.699+0000 7fa74cfd3640 1 --2- 172.21.15.90:0/1165451693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa74815e260 0x7fa7480aeb80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa74000c730 tx=0x7fa74000cbf0 comp rx=0 tx=0).stop 2024-09-10T23:15:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.700+0000 7fa74cfd3640 1 -- 172.21.15.90:0/1165451693 shutdown_connections 2024-09-10T23:15:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.700+0000 7fa74cfd3640 1 --2- 172.21.15.90:0/1165451693 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa728077f70 0x7fa72807a430 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.700+0000 7fa74cfd3640 1 --2- 172.21.15.90:0/1165451693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa74815e260 0x7fa7480aeb80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.700+0000 7fa74cfd3640 1 --2- 172.21.15.90:0/1165451693 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7480d1190 0x7fa7480ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.700+0000 7fa74cfd3640 1 --2- 172.21.15.90:0/1165451693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7480b0940 0x7fa748158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.700+0000 7fa74cfd3640 1 -- 172.21.15.90:0/1165451693 >> 172.21.15.90:0/1165451693 conn(0x7fa7480d0490 msgr2=0x7fa7480af8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.700+0000 7fa74cfd3640 1 -- 172.21.15.90:0/1165451693 shutdown_connections 2024-09-10T23:15:00.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:00.700+0000 7fa74cfd3640 1 -- 172.21.15.90:0/1165451693 wait complete. 2024-09-10T23:15:00.712 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T23:15:00.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:00.712 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-10T23:15:00.741 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:15:00.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:00.741 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:15:00.807 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:15:00.807 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:00.827 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:15:00.827 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:00.885 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:15:00.885 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:00.944 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:15:01.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.047+0000 7f69f16b0640 1 -- 172.21.15.90:0/3359798628 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69ec0d0390 msgr2=0x7f69ec0b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:01.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.047+0000 7f69f16b0640 1 --2- 172.21.15.90:0/3359798628 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69ec0d0390 0x7f69ec0b4c20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f69e4005fd0 tx=0x7f69e402a5d0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.047+0000 7f69f16b0640 1 -- 172.21.15.90:0/3359798628 shutdown_connections 2024-09-10T23:15:01.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.047+0000 7f69f16b0640 1 --2- 172.21.15.90:0/3359798628 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69ec0d0390 0x7f69ec0b4c20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.047+0000 7f69f16b0640 1 --2- 172.21.15.90:0/3359798628 >> v2:172.21.15.171:3300/0 conn(0x7f69ec0d2960 0x7f69ec0cfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.047+0000 7f69f16b0640 1 -- 172.21.15.90:0/3359798628 >> 172.21.15.90:0/3359798628 conn(0x7f69ec0d1dd0 msgr2=0x7f69ec0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:01.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.048+0000 7f69f16b0640 1 -- 172.21.15.90:0/3359798628 shutdown_connections 2024-09-10T23:15:01.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.048+0000 7f69f16b0640 1 -- 172.21.15.90:0/3359798628 wait complete. 2024-09-10T23:15:01.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.049+0000 7f69f16b0640 1 Processor -- start 2024-09-10T23:15:01.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.049+0000 7f69f16b0640 1 -- start start 2024-09-10T23:15:01.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69f16b0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69ec0d0390 0x7f69ec0afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:01.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69f16b0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69ec0d2960 0x7f69ec0cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:01.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69f16b0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69ec15c0c0 0x7f69ec0cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:01.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69f16b0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec0b54f0 con 0x7f69ec15c0c0 2024-09-10T23:15:01.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69f16b0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec0b5370 con 0x7f69ec0d0390 2024-09-10T23:15:01.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69f16b0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f69ec0b5670 con 0x7f69ec0d2960 2024-09-10T23:15:01.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69eb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69ec15c0c0 0x7f69ec0cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:01.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69eb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69ec15c0c0 0x7f69ec0cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55654/0 (socket says 172.21.15.90:55654) 2024-09-10T23:15:01.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69eb7fe640 1 -- 172.21.15.90:0/3288083802 learned_addr learned my addr 172.21.15.90:0/3288083802 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:01.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69eaffd640 1 --2- 172.21.15.90:0/3288083802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69ec0d0390 0x7f69ec0afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:01.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69ea7fc640 1 --2- 172.21.15.90:0/3288083802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69ec0d2960 0x7f69ec0cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:01.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69eb7fe640 1 -- 172.21.15.90:0/3288083802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69ec0d2960 msgr2=0x7f69ec0cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:01.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69eb7fe640 1 --2- 172.21.15.90:0/3288083802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69ec0d2960 0x7f69ec0cb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69eb7fe640 1 -- 172.21.15.90:0/3288083802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69ec0d0390 msgr2=0x7f69ec0afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:01.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69eb7fe640 1 --2- 172.21.15.90:0/3288083802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69ec0d0390 0x7f69ec0afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69eb7fe640 1 -- 172.21.15.90:0/3288083802 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ec15c740 con 0x7f69ec15c0c0 2024-09-10T23:15:01.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69eb7fe640 1 --2- 172.21.15.90:0/3288083802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69ec15c0c0 0x7f69ec0cb8a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009230 tx=0x7f69e4003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:01.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69d37fe640 1 -- 172.21.15.90:0/3288083802 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e403f070 con 0x7f69ec15c0c0 2024-09-10T23:15:01.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69d37fe640 1 -- 172.21.15.90:0/3288083802 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69e4003e10 con 0x7f69ec15c0c0 2024-09-10T23:15:01.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69f16b0640 1 -- 172.21.15.90:0/3288083802 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69ec15ca20 con 0x7f69ec15c0c0 2024-09-10T23:15:01.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69d37fe640 1 -- 172.21.15.90:0/3288083802 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e4035030 con 0x7f69ec15c0c0 2024-09-10T23:15:01.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.050+0000 7f69f16b0640 1 -- 172.21.15.90:0/3288083802 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69ec15cfe0 con 0x7f69ec15c0c0 2024-09-10T23:15:01.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.052+0000 7f69f16b0640 1 -- 172.21.15.90:0/3288083802 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69ec0b2ab0 con 0x7f69ec15c0c0 2024-09-10T23:15:01.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.052+0000 7f69d37fe640 1 -- 172.21.15.90:0/3288083802 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f69e4004a00 con 0x7f69ec15c0c0 2024-09-10T23:15:01.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.052+0000 7f69d37fe640 1 --2- 172.21.15.90:0/3288083802 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f69d8077f70 0x7f69d807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:01.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.052+0000 7f69d37fe640 1 -- 172.21.15.90:0/3288083802 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f69e40baab0 con 0x7f69ec15c0c0 2024-09-10T23:15:01.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.053+0000 7f69eaffd640 1 --2- 172.21.15.90:0/3288083802 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f69d8077f70 0x7f69d807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:01.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.053+0000 7f69eaffd640 1 --2- 172.21.15.90:0/3288083802 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f69d8077f70 0x7f69d807a430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f69dc007fd0 tx=0x7f69dc009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:01.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.056+0000 7f69d37fe640 1 -- 172.21.15.90:0/3288083802 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f69e4082ff0 con 0x7f69ec15c0c0 2024-09-10T23:15:01.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.242+0000 7f69f16b0640 1 -- 172.21.15.90:0/3288083802 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f69ec0b5b90 con 0x7f69ec15c0c0 2024-09-10T23:15:01.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.242+0000 7f69d37fe640 1 -- 172.21.15.90:0/3288083802 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f69e4087a20 con 0x7f69ec15c0c0 2024-09-10T23:15:01.243 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:15:01.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.244+0000 7f69f16b0640 1 -- 172.21.15.90:0/3288083802 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f69d8077f70 msgr2=0x7f69d807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:01.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.244+0000 7f69f16b0640 1 --2- 172.21.15.90:0/3288083802 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f69d8077f70 0x7f69d807a430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f69dc007fd0 tx=0x7f69dc009040 comp rx=0 tx=0).stop 2024-09-10T23:15:01.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.244+0000 7f69f16b0640 1 -- 172.21.15.90:0/3288083802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69ec15c0c0 msgr2=0x7f69ec0cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:01.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.244+0000 7f69f16b0640 1 --2- 172.21.15.90:0/3288083802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69ec15c0c0 0x7f69ec0cb8a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009230 tx=0x7f69e4003820 comp rx=0 tx=0).stop 2024-09-10T23:15:01.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.245+0000 7f69f16b0640 1 -- 172.21.15.90:0/3288083802 shutdown_connections 2024-09-10T23:15:01.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.245+0000 7f69f16b0640 1 --2- 172.21.15.90:0/3288083802 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f69d8077f70 0x7f69d807a430 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.245+0000 7f69f16b0640 1 --2- 172.21.15.90:0/3288083802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69ec15c0c0 0x7f69ec0cb8a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.245+0000 7f69f16b0640 1 --2- 172.21.15.90:0/3288083802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69ec0d2960 0x7f69ec0cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.245+0000 7f69f16b0640 1 --2- 172.21.15.90:0/3288083802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69ec0d0390 0x7f69ec0afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.245+0000 7f69f16b0640 1 -- 172.21.15.90:0/3288083802 >> 172.21.15.90:0/3288083802 conn(0x7f69ec0d1dd0 msgr2=0x7f69ec160210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:01.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.245+0000 7f69f16b0640 1 -- 172.21.15.90:0/3288083802 shutdown_connections 2024-09-10T23:15:01.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.245+0000 7f69f16b0640 1 -- 172.21.15.90:0/3288083802 wait complete. 2024-09-10T23:15:01.256 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T23:15:01.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:01.256 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-10T23:15:01.289 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:15:01.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:01.289 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T23:15:01.353 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:01.354 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:01.370 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:01.370 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:01.425 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:01.425 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:01.481 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:15:01.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.622+0000 7f4f77e7f640 1 -- 172.21.15.90:0/2192973161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f700d0560 msgr2=0x7f4f700b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:01.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.622+0000 7f4f77e7f640 1 --2- 172.21.15.90:0/2192973161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f700d0560 0x7f4f700b4c20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4f60005fd0 tx=0x7f4f6002aa00 comp rx=0 tx=0).stop 2024-09-10T23:15:01.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.622+0000 7f4f77e7f640 1 -- 172.21.15.90:0/2192973161 shutdown_connections 2024-09-10T23:15:01.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.622+0000 7f4f77e7f640 1 --2- 172.21.15.90:0/2192973161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f700d0560 0x7f4f700b4c20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.622+0000 7f4f77e7f640 1 --2- 172.21.15.90:0/2192973161 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f7015c0c0 0x7f4f700d2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.622+0000 7f4f77e7f640 1 -- 172.21.15.90:0/2192973161 >> 172.21.15.90:0/2192973161 conn(0x7f4f700d1dd0 msgr2=0x7f4f700d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:01.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.622+0000 7f4f77e7f640 1 -- 172.21.15.90:0/2192973161 shutdown_connections 2024-09-10T23:15:01.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.622+0000 7f4f77e7f640 1 -- 172.21.15.90:0/2192973161 wait complete. 2024-09-10T23:15:01.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.623+0000 7f4f77e7f640 1 Processor -- start 2024-09-10T23:15:01.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.623+0000 7f4f77e7f640 1 -- start start 2024-09-10T23:15:01.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.624+0000 7f4f77e7f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f700cf1f0 0x7f4f700c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:01.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.624+0000 7f4f77e7f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f700d0560 0x7f4f701f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:01.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.624+0000 7f4f77e7f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f7015c0c0 0x7f4f701f6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:01.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.624+0000 7f4f77e7f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4f700b54f0 con 0x7f4f700d0560 2024-09-10T23:15:01.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.624+0000 7f4f77e7f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4f700b5370 con 0x7f4f7015c0c0 2024-09-10T23:15:01.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.624+0000 7f4f77e7f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4f700b5670 con 0x7f4f700cf1f0 2024-09-10T23:15:01.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.624+0000 7f4f7541a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f700d0560 0x7f4f701f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:01.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.624+0000 7f4f7541a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f700d0560 0x7f4f701f5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55672/0 (socket says 172.21.15.90:55672) 2024-09-10T23:15:01.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.624+0000 7f4f7541a640 1 -- 172.21.15.90:0/1225798552 learned_addr learned my addr 172.21.15.90:0/1225798552 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:01.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.624+0000 7f4f75c1b640 1 --2- 172.21.15.90:0/1225798552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f700cf1f0 0x7f4f700c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:01.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.624+0000 7f4f7641c640 1 --2- 172.21.15.90:0/1225798552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f7015c0c0 0x7f4f701f6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:01.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.624+0000 7f4f7541a640 1 -- 172.21.15.90:0/1225798552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f700cf1f0 msgr2=0x7f4f700c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:01.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.624+0000 7f4f7541a640 1 --2- 172.21.15.90:0/1225798552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f700cf1f0 0x7f4f700c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.624+0000 7f4f7541a640 1 -- 172.21.15.90:0/1225798552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f7015c0c0 msgr2=0x7f4f701f6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:01.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.624+0000 7f4f7541a640 1 --2- 172.21.15.90:0/1225798552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f7015c0c0 0x7f4f701f6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.624+0000 7f4f7541a640 1 -- 172.21.15.90:0/1225798552 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f700ca620 con 0x7f4f700d0560 2024-09-10T23:15:01.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.624+0000 7f4f7641c640 1 --2- 172.21.15.90:0/1225798552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f7015c0c0 0x7f4f701f6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:01.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.625+0000 7f4f7541a640 1 --2- 172.21.15.90:0/1225798552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f700d0560 0x7f4f701f5f50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400c400 tx=0x7f4f6400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:01.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.625+0000 7f4f6e7fc640 1 -- 172.21.15.90:0/1225798552 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f64011790 con 0x7f4f700d0560 2024-09-10T23:15:01.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.625+0000 7f4f6e7fc640 1 -- 172.21.15.90:0/1225798552 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f64017070 con 0x7f4f700d0560 2024-09-10T23:15:01.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.625+0000 7f4f6e7fc640 1 -- 172.21.15.90:0/1225798552 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f64011d00 con 0x7f4f700d0560 2024-09-10T23:15:01.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.625+0000 7f4f77e7f640 1 -- 172.21.15.90:0/1225798552 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f700ca900 con 0x7f4f700d0560 2024-09-10T23:15:01.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.625+0000 7f4f77e7f640 1 -- 172.21.15.90:0/1225798552 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f700caec0 con 0x7f4f700d0560 2024-09-10T23:15:01.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.626+0000 7f4f77e7f640 1 -- 172.21.15.90:0/1225798552 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f70069ae0 con 0x7f4f700d0560 2024-09-10T23:15:01.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.626+0000 7f4f6e7fc640 1 -- 172.21.15.90:0/1225798552 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4f6401c460 con 0x7f4f700d0560 2024-09-10T23:15:01.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.627+0000 7f4f6e7fc640 1 --2- 172.21.15.90:0/1225798552 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4f5c077f70 0x7f4f5c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:01.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.627+0000 7f4f6e7fc640 1 -- 172.21.15.90:0/1225798552 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4f64099a80 con 0x7f4f700d0560 2024-09-10T23:15:01.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.627+0000 7f4f75c1b640 1 --2- 172.21.15.90:0/1225798552 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4f5c077f70 0x7f4f5c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:01.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.628+0000 7f4f75c1b640 1 --2- 172.21.15.90:0/1225798552 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4f5c077f70 0x7f4f5c07a430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800bb30 tx=0x7f4f6800b2e0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:01.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.631+0000 7f4f6e7fc640 1 -- 172.21.15.90:0/1225798552 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4f70069ae0 con 0x7f4f700d0560 2024-09-10T23:15:01.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.815+0000 7f4f77e7f640 1 -- 172.21.15.90:0/1225798552 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4f700b5b60 con 0x7f4f700d0560 2024-09-10T23:15:01.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.816+0000 7f4f6e7fc640 1 -- 172.21.15.90:0/1225798552 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f4f64062610 con 0x7f4f700d0560 2024-09-10T23:15:01.817 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:15:01.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.818+0000 7f4f77e7f640 1 -- 172.21.15.90:0/1225798552 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4f5c077f70 msgr2=0x7f4f5c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:01.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.818+0000 7f4f77e7f640 1 --2- 172.21.15.90:0/1225798552 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4f5c077f70 0x7f4f5c07a430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800bb30 tx=0x7f4f6800b2e0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.818+0000 7f4f77e7f640 1 -- 172.21.15.90:0/1225798552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f700d0560 msgr2=0x7f4f701f5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:01.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.818+0000 7f4f77e7f640 1 --2- 172.21.15.90:0/1225798552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f700d0560 0x7f4f701f5f50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400c400 tx=0x7f4f6400c8c0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.818+0000 7f4f77e7f640 1 -- 172.21.15.90:0/1225798552 shutdown_connections 2024-09-10T23:15:01.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.818+0000 7f4f77e7f640 1 --2- 172.21.15.90:0/1225798552 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4f5c077f70 0x7f4f5c07a430 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.818+0000 7f4f77e7f640 1 --2- 172.21.15.90:0/1225798552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f7015c0c0 0x7f4f701f6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.818+0000 7f4f77e7f640 1 --2- 172.21.15.90:0/1225798552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f700d0560 0x7f4f701f5f50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.818+0000 7f4f77e7f640 1 --2- 172.21.15.90:0/1225798552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f700cf1f0 0x7f4f700c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:01.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.818+0000 7f4f77e7f640 1 -- 172.21.15.90:0/1225798552 >> 172.21.15.90:0/1225798552 conn(0x7f4f700d1dd0 msgr2=0x7f4f70071470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:01.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.818+0000 7f4f77e7f640 1 -- 172.21.15.90:0/1225798552 shutdown_connections 2024-09-10T23:15:01.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:01.818+0000 7f4f77e7f640 1 -- 172.21.15.90:0/1225798552 wait complete. 2024-09-10T23:15:01.829 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-10T23:15:01.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:01.830 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-10T23:15:01.855 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:15:01.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:01.855 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-10T23:15:01.912 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:15:01.912 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:01.931 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:15:01.932 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:01.990 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:15:01.990 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:02.049 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:15:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.151+0000 7f4a5bced640 1 -- 172.21.15.90:0/3179498380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a3c004d40 msgr2=0x7f4a3c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.151+0000 7f4a5bced640 1 --2- 172.21.15.90:0/3179498380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a3c004d40 0x7f4a3c0051c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c001dc0 tx=0x7f4a3c005830 comp rx=0 tx=0).stop 2024-09-10T23:15:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.151+0000 7f4a5a28a640 1 -- 172.21.15.90:0/3179498380 reap_dead start 2024-09-10T23:15:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.151+0000 7f4a5bced640 1 -- 172.21.15.90:0/3179498380 shutdown_connections 2024-09-10T23:15:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.151+0000 7f4a5bced640 1 -- 172.21.15.90:0/3179498380 >> 172.21.15.90:0/3179498380 conn(0x7f4a540d0490 msgr2=0x7f4a540d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.151+0000 7f4a5bced640 1 -- 172.21.15.90:0/3179498380 shutdown_connections 2024-09-10T23:15:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.151+0000 7f4a5bced640 1 -- 172.21.15.90:0/3179498380 wait complete. 2024-09-10T23:15:02.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.152+0000 7f4a5bced640 1 Processor -- start 2024-09-10T23:15:02.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.152+0000 7f4a5bced640 1 -- start start 2024-09-10T23:15:02.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a5bced640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a3c004d40 0x7f4a541f8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:02.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a5bced640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a54152400 0x7f4a540b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:02.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a5bced640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a540b41e0 0x7f4a5415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:02.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a5bced640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a541611c0 con 0x7f4a54152400 2024-09-10T23:15:02.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a5bced640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4a54161040 con 0x7f4a540b41e0 2024-09-10T23:15:02.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a5bced640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4a54161340 con 0x7f4a3c004d40 2024-09-10T23:15:02.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a59288640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a54152400 0x7f4a540b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:02.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a59288640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a54152400 0x7f4a540b5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55694/0 (socket says 172.21.15.90:55694) 2024-09-10T23:15:02.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a59288640 1 -- 172.21.15.90:0/1179503107 learned_addr learned my addr 172.21.15.90:0/1179503107 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:02.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a5a28a640 1 --2- 172.21.15.90:0/1179503107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a540b41e0 0x7f4a5415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:02.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a59a89640 1 --2- 172.21.15.90:0/1179503107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a3c004d40 0x7f4a541f8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:02.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a59288640 1 -- 172.21.15.90:0/1179503107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a3c004d40 msgr2=0x7f4a541f8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:02.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a59288640 1 --2- 172.21.15.90:0/1179503107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a3c004d40 0x7f4a541f8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a59288640 1 -- 172.21.15.90:0/1179503107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a540b41e0 msgr2=0x7f4a5415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:02.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a59288640 1 --2- 172.21.15.90:0/1179503107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a540b41e0 0x7f4a5415e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a59288640 1 -- 172.21.15.90:0/1179503107 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a540b3460 con 0x7f4a54152400 2024-09-10T23:15:02.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a5a28a640 1 --2- 172.21.15.90:0/1179503107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a540b41e0 0x7f4a5415e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:02.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a59a89640 1 --2- 172.21.15.90:0/1179503107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a3c004d40 0x7f4a541f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:02.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a59288640 1 --2- 172.21.15.90:0/1179503107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a54152400 0x7f4a540b5d70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4a48011b40 tx=0x7f4a48009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:02.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a527fc640 1 -- 172.21.15.90:0/1179503107 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4801e070 con 0x7f4a54152400 2024-09-10T23:15:02.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a527fc640 1 -- 172.21.15.90:0/1179503107 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a4800fe70 con 0x7f4a54152400 2024-09-10T23:15:02.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a5bced640 1 -- 172.21.15.90:0/1179503107 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a540cc5e0 con 0x7f4a54152400 2024-09-10T23:15:02.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a527fc640 1 -- 172.21.15.90:0/1179503107 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a48004290 con 0x7f4a54152400 2024-09-10T23:15:02.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.153+0000 7f4a5bced640 1 -- 172.21.15.90:0/1179503107 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a540b39e0 con 0x7f4a54152400 2024-09-10T23:15:02.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.154+0000 7f4a5bced640 1 -- 172.21.15.90:0/1179503107 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a54160400 con 0x7f4a54152400 2024-09-10T23:15:02.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.155+0000 7f4a527fc640 1 -- 172.21.15.90:0/1179503107 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4a480035f0 con 0x7f4a54152400 2024-09-10T23:15:02.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.156+0000 7f4a527fc640 1 --2- 172.21.15.90:0/1179503107 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a40077fa0 0x7f4a4007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:02.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.156+0000 7f4a527fc640 1 -- 172.21.15.90:0/1179503107 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4a4809aa40 con 0x7f4a54152400 2024-09-10T23:15:02.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.156+0000 7f4a59a89640 1 --2- 172.21.15.90:0/1179503107 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a40077fa0 0x7f4a4007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:02.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.157+0000 7f4a59a89640 1 --2- 172.21.15.90:0/1179503107 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a40077fa0 0x7f4a4007a460 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4a44001010 tx=0x7f4a440067d0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:02.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.160+0000 7f4a527fc640 1 -- 172.21.15.90:0/1179503107 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4a48062fb0 con 0x7f4a54152400 2024-09-10T23:15:02.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.348+0000 7f4a5bced640 1 -- 172.21.15.90:0/1179503107 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4a540cdc90 con 0x7f4a54152400 2024-09-10T23:15:02.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.349+0000 7f4a527fc640 1 -- 172.21.15.90:0/1179503107 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f4a480679e0 con 0x7f4a54152400 2024-09-10T23:15:02.350 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:15:02.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.351+0000 7f4a5bced640 1 -- 172.21.15.90:0/1179503107 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a40077fa0 msgr2=0x7f4a4007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:02.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.351+0000 7f4a5bced640 1 --2- 172.21.15.90:0/1179503107 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a40077fa0 0x7f4a4007a460 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4a44001010 tx=0x7f4a440067d0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.351+0000 7f4a5bced640 1 -- 172.21.15.90:0/1179503107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a54152400 msgr2=0x7f4a540b5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:02.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.351+0000 7f4a5bced640 1 --2- 172.21.15.90:0/1179503107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a54152400 0x7f4a540b5d70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4a48011b40 tx=0x7f4a48009e90 comp rx=0 tx=0).stop 2024-09-10T23:15:02.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.351+0000 7f4a5bced640 1 -- 172.21.15.90:0/1179503107 shutdown_connections 2024-09-10T23:15:02.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.351+0000 7f4a5bced640 1 --2- 172.21.15.90:0/1179503107 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a40077fa0 0x7f4a4007a460 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.351+0000 7f4a5bced640 1 --2- 172.21.15.90:0/1179503107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a540b41e0 0x7f4a5415e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.351+0000 7f4a5bced640 1 --2- 172.21.15.90:0/1179503107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a54152400 0x7f4a540b5d70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.351+0000 7f4a5bced640 1 --2- 172.21.15.90:0/1179503107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a3c004d40 0x7f4a541f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.351+0000 7f4a5bced640 1 -- 172.21.15.90:0/1179503107 >> 172.21.15.90:0/1179503107 conn(0x7f4a540d0490 msgr2=0x7f4a5406f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:02.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.351+0000 7f4a5bced640 1 -- 172.21.15.90:0/1179503107 shutdown_connections 2024-09-10T23:15:02.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.351+0000 7f4a5bced640 1 -- 172.21.15.90:0/1179503107 wait complete. 2024-09-10T23:15:02.362 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-10T23:15:02.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:02.363 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-10T23:15:02.394 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:15:02.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:02.394 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-10T23:15:02.452 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:15:02.452 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:02.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.553+0000 7fd87ae33640 1 -- 172.21.15.90:0/27686226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd87415bcb0 msgr2=0x7fd8740cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:02.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.553+0000 7fd87ae33640 1 --2- 172.21.15.90:0/27686226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd87415bcb0 0x7fd8740cb7e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd864009830 tx=0x7fd86402a510 comp rx=0 tx=0).stop 2024-09-10T23:15:02.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.553+0000 7fd87ae33640 1 -- 172.21.15.90:0/27686226 shutdown_connections 2024-09-10T23:15:02.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.553+0000 7fd87ae33640 1 --2- 172.21.15.90:0/27686226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd87406f850 0x7fd87406ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.553+0000 7fd87ae33640 1 --2- 172.21.15.90:0/27686226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd87415bcb0 0x7fd8740cb7e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.553+0000 7fd87ae33640 1 -- 172.21.15.90:0/27686226 >> 172.21.15.90:0/27686226 conn(0x7fd8740cc850 msgr2=0x7fd8740ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:02.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.553+0000 7fd87ae33640 1 -- 172.21.15.90:0/27686226 shutdown_connections 2024-09-10T23:15:02.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.553+0000 7fd87ae33640 1 -- 172.21.15.90:0/27686226 wait complete. 2024-09-10T23:15:02.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.554+0000 7fd87ae33640 1 Processor -- start 2024-09-10T23:15:02.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.554+0000 7fd87ae33640 1 -- start start 2024-09-10T23:15:02.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.555+0000 7fd87ae33640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd87406f160 0x7fd87409d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:02.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.555+0000 7fd87ae33640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd87406f850 0x7fd8740b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:02.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.555+0000 7fd87ae33640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd87415bcb0 0x7fd8740b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:02.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.555+0000 7fd87ae33640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd8740b1850 con 0x7fd87406f850 2024-09-10T23:15:02.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.555+0000 7fd87ae33640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd8740cad80 con 0x7fd87406f160 2024-09-10T23:15:02.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.555+0000 7fd87ae33640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd8740b19d0 con 0x7fd87415bcb0 2024-09-10T23:15:02.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.555+0000 7fd873fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd87406f850 0x7fd8740b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:02.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.555+0000 7fd873fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd87406f850 0x7fd8740b40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55720/0 (socket says 172.21.15.90:55720) 2024-09-10T23:15:02.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.555+0000 7fd873fff640 1 -- 172.21.15.90:0/393982884 learned_addr learned my addr 172.21.15.90:0/393982884 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:02.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.555+0000 7fd8793d0640 1 --2- 172.21.15.90:0/393982884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd87415bcb0 0x7fd8740b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:02.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.555+0000 7fd878bcf640 1 --2- 172.21.15.90:0/393982884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd87406f160 0x7fd87409d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:02.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.555+0000 7fd873fff640 1 -- 172.21.15.90:0/393982884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd87415bcb0 msgr2=0x7fd8740b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:02.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.555+0000 7fd873fff640 1 --2- 172.21.15.90:0/393982884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd87415bcb0 0x7fd8740b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.555+0000 7fd873fff640 1 -- 172.21.15.90:0/393982884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd87406f160 msgr2=0x7fd87409d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:02.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.555+0000 7fd873fff640 1 --2- 172.21.15.90:0/393982884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd87406f160 0x7fd87409d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.555+0000 7fd873fff640 1 -- 172.21.15.90:0/393982884 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8740b45f0 con 0x7fd87406f850 2024-09-10T23:15:02.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.556+0000 7fd8793d0640 1 --2- 172.21.15.90:0/393982884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd87415bcb0 0x7fd8740b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:02.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.556+0000 7fd873fff640 1 --2- 172.21.15.90:0/393982884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd87406f850 0x7fd8740b40b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd86800c920 tx=0x7fd86800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:02.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.556+0000 7fd8717fa640 1 -- 172.21.15.90:0/393982884 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd868007c70 con 0x7fd87406f850 2024-09-10T23:15:02.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.556+0000 7fd8717fa640 1 -- 172.21.15.90:0/393982884 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd86800f450 con 0x7fd87406f850 2024-09-10T23:15:02.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.556+0000 7fd87ae33640 1 -- 172.21.15.90:0/393982884 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8740b1200 con 0x7fd87406f850 2024-09-10T23:15:02.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.556+0000 7fd8717fa640 1 -- 172.21.15.90:0/393982884 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86800f8a0 con 0x7fd87406f850 2024-09-10T23:15:02.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.556+0000 7fd87ae33640 1 -- 172.21.15.90:0/393982884 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd87409c9a0 con 0x7fd87406f850 2024-09-10T23:15:02.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.557+0000 7fd87ae33640 1 -- 172.21.15.90:0/393982884 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8740b1e80 con 0x7fd87406f850 2024-09-10T23:15:02.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.558+0000 7fd8717fa640 1 -- 172.21.15.90:0/393982884 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd868020030 con 0x7fd87406f850 2024-09-10T23:15:02.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.558+0000 7fd8717fa640 1 --2- 172.21.15.90:0/393982884 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd860077f70 0x7fd86007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:02.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.558+0000 7fd8717fa640 1 -- 172.21.15.90:0/393982884 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd86809a330 con 0x7fd87406f850 2024-09-10T23:15:02.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.558+0000 7fd878bcf640 1 --2- 172.21.15.90:0/393982884 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd860077f70 0x7fd86007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:02.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.559+0000 7fd878bcf640 1 --2- 172.21.15.90:0/393982884 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd860077f70 0x7fd86007a430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd864034000 tx=0x7fd864004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:02.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.562+0000 7fd8717fa640 1 -- 172.21.15.90:0/393982884 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd868014030 con 0x7fd87406f850 2024-09-10T23:15:02.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.770+0000 7fd87ae33640 1 -- 172.21.15.90:0/393982884 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd874152e10 con 0x7fd87406f850 2024-09-10T23:15:02.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.771+0000 7fd8717fa640 1 -- 172.21.15.90:0/393982884 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7fd868062e30 con 0x7fd87406f850 2024-09-10T23:15:02.772 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:02.772 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":7,"btime":"2024-09-10T23:14:39:140018+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/286705671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":286705671},{"type":"v1","addr":"172.21.15.171:6837","nonce":286705671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/604738442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":604738442},{"type":"v1","addr":"172.21.15.171:6836","nonce":604738442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/1263661165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1263661165},{"type":"v1","addr":"172.21.15.90:6834","nonce":1263661165}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:14:35.457987+0000","modified":"2024-09-10T23:14:38.235652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4368},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4368":{"gid":4368,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6835/1573070489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":1573070489},{"type":"v1","addr":"172.21.15.90:6835","nonce":1573070489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4368,"qdb_cluster":[4368]},"id":1}]} 2024-09-10T23:15:02.773 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 7 2024-09-10T23:15:02.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.773+0000 7fd87ae33640 1 -- 172.21.15.90:0/393982884 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd860077f70 msgr2=0x7fd86007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:02.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.773+0000 7fd87ae33640 1 --2- 172.21.15.90:0/393982884 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd860077f70 0x7fd86007a430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd864034000 tx=0x7fd864004730 comp rx=0 tx=0).stop 2024-09-10T23:15:02.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.773+0000 7fd87ae33640 1 -- 172.21.15.90:0/393982884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd87406f850 msgr2=0x7fd8740b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:02.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.773+0000 7fd87ae33640 1 --2- 172.21.15.90:0/393982884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd87406f850 0x7fd8740b40b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd86800c920 tx=0x7fd86800cde0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.773+0000 7fd87ae33640 1 -- 172.21.15.90:0/393982884 shutdown_connections 2024-09-10T23:15:02.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.773+0000 7fd87ae33640 1 --2- 172.21.15.90:0/393982884 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd860077f70 0x7fd86007a430 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.773+0000 7fd87ae33640 1 --2- 172.21.15.90:0/393982884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd87415bcb0 0x7fd8740b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.773+0000 7fd87ae33640 1 --2- 172.21.15.90:0/393982884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd87406f850 0x7fd8740b40b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.773+0000 7fd87ae33640 1 --2- 172.21.15.90:0/393982884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd87406f160 0x7fd87409d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.773+0000 7fd87ae33640 1 -- 172.21.15.90:0/393982884 >> 172.21.15.90:0/393982884 conn(0x7fd8740cc850 msgr2=0x7fd8740ad920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:02.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.773+0000 7fd87ae33640 1 -- 172.21.15.90:0/393982884 shutdown_connections 2024-09-10T23:15:02.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.773+0000 7fd87ae33640 1 -- 172.21.15.90:0/393982884 wait complete. 2024-09-10T23:15:02.786 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:02.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.885+0000 7f51ab0b0640 1 -- 172.21.15.90:0/98484602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f518c004800 msgr2=0x7f518c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:02.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.885+0000 7f51ab0b0640 1 --2- 172.21.15.90:0/98484602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f518c004800 0x7f518c004c80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f519400baf0 tx=0x7f518c005830 comp rx=0 tx=0).stop 2024-09-10T23:15:02.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.885+0000 7f51ab0b0640 1 -- 172.21.15.90:0/98484602 shutdown_connections 2024-09-10T23:15:02.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.885+0000 7f51ab0b0640 1 --2- 172.21.15.90:0/98484602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f518c004800 0x7f518c004c80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.885+0000 7f51ab0b0640 1 -- 172.21.15.90:0/98484602 >> 172.21.15.90:0/98484602 conn(0x7f51a40cc850 msgr2=0x7f51a40ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:02.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.885+0000 7f51ab0b0640 1 -- 172.21.15.90:0/98484602 shutdown_connections 2024-09-10T23:15:02.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.885+0000 7f51ab0b0640 1 -- 172.21.15.90:0/98484602 wait complete. 2024-09-10T23:15:02.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.886+0000 7f51ab0b0640 1 Processor -- start 2024-09-10T23:15:02.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.886+0000 7f51ab0b0640 1 -- start start 2024-09-10T23:15:02.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.887+0000 7f51ab0b0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f518c004800 0x7f51a40b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:02.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.887+0000 7f51ab0b0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51a40b52f0 0x7f51a40b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.887+0000 7f51ab0b0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51a41f47f0 0x7f51a41f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.887+0000 7f51ab0b0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51a40b19d0 con 0x7f51a41f47f0 2024-09-10T23:15:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.887+0000 7f51ab0b0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f51a40b1850 con 0x7f518c004800 2024-09-10T23:15:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.887+0000 7f51ab0b0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f51a40b1b50 con 0x7f51a40b52f0 2024-09-10T23:15:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.887+0000 7f51a964d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51a41f47f0 0x7f51a41f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.887+0000 7f51a964d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51a41f47f0 0x7f51a41f4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55740/0 (socket says 172.21.15.90:55740) 2024-09-10T23:15:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.887+0000 7f51a964d640 1 -- 172.21.15.90:0/4062669009 learned_addr learned my addr 172.21.15.90:0/4062669009 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.888+0000 7f519bfff640 1 --2- 172.21.15.90:0/4062669009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51a40b52f0 0x7f51a40b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.888+0000 7f51a8e4c640 1 --2- 172.21.15.90:0/4062669009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f518c004800 0x7f51a40b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.888+0000 7f51a964d640 1 -- 172.21.15.90:0/4062669009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51a40b52f0 msgr2=0x7f51a40b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.888+0000 7f51a964d640 1 --2- 172.21.15.90:0/4062669009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51a40b52f0 0x7f51a40b5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.888+0000 7f51a964d640 1 -- 172.21.15.90:0/4062669009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f518c004800 msgr2=0x7f51a40b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.888+0000 7f51a964d640 1 --2- 172.21.15.90:0/4062669009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f518c004800 0x7f51a40b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.888+0000 7f51a964d640 1 -- 172.21.15.90:0/4062669009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a41f5520 con 0x7f51a41f47f0 2024-09-10T23:15:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.888+0000 7f519bfff640 1 --2- 172.21.15.90:0/4062669009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51a40b52f0 0x7f51a40b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.888+0000 7f51a8e4c640 1 --2- 172.21.15.90:0/4062669009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f518c004800 0x7f51a40b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.888+0000 7f51a964d640 1 --2- 172.21.15.90:0/4062669009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51a41f47f0 0x7f51a41f4c50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f51a415e6c0 tx=0x7f519c00d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.888+0000 7f51997fa640 1 -- 172.21.15.90:0/4062669009 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c00f880 con 0x7f51a41f47f0 2024-09-10T23:15:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.888+0000 7f51997fa640 1 -- 172.21.15.90:0/4062669009 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f519c017070 con 0x7f51a41f47f0 2024-09-10T23:15:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.888+0000 7f51997fa640 1 -- 172.21.15.90:0/4062669009 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c00fdb0 con 0x7f51a41f47f0 2024-09-10T23:15:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.888+0000 7f51ab0b0640 1 -- 172.21.15.90:0/4062669009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a41f14c0 con 0x7f51a41f47f0 2024-09-10T23:15:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.888+0000 7f51ab0b0640 1 -- 172.21.15.90:0/4062669009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a41f1a80 con 0x7f51a41f47f0 2024-09-10T23:15:02.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.889+0000 7f51ab0b0640 1 -- 172.21.15.90:0/4062669009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51a40ca6e0 con 0x7f51a41f47f0 2024-09-10T23:15:02.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.890+0000 7f51997fa640 1 -- 172.21.15.90:0/4062669009 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f519c01c460 con 0x7f51a41f47f0 2024-09-10T23:15:02.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.890+0000 7f51997fa640 1 --2- 172.21.15.90:0/4062669009 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5190077fa0 0x7f519007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:02.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.890+0000 7f51997fa640 1 -- 172.21.15.90:0/4062669009 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f519c099f30 con 0x7f51a41f47f0 2024-09-10T23:15:02.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.890+0000 7f51a8e4c640 1 --2- 172.21.15.90:0/4062669009 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5190077fa0 0x7f519007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:02.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.891+0000 7f51a8e4c640 1 --2- 172.21.15.90:0/4062669009 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5190077fa0 0x7f519007a460 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f51a0001860 tx=0x7f51a0001c60 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:02.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:02.894+0000 7f51997fa640 1 -- 172.21.15.90:0/4062669009 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f519c062a40 con 0x7f51a41f47f0 2024-09-10T23:15:03.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.105+0000 7f51ab0b0640 1 -- 172.21.15.90:0/4062669009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51a41f1c50 con 0x7f51a41f47f0 2024-09-10T23:15:03.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.106+0000 7f51997fa640 1 -- 172.21.15.90:0/4062669009 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7f519c06b160 con 0x7f51a41f47f0 2024-09-10T23:15:03.107 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:03.107 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":7,"btime":"2024-09-10T23:14:39:140018+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/286705671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":286705671},{"type":"v1","addr":"172.21.15.171:6837","nonce":286705671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/604738442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":604738442},{"type":"v1","addr":"172.21.15.171:6836","nonce":604738442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/1263661165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1263661165},{"type":"v1","addr":"172.21.15.90:6834","nonce":1263661165}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:14:35.457987+0000","modified":"2024-09-10T23:14:38.235652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4368},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4368":{"gid":4368,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6835/1573070489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":1573070489},{"type":"v1","addr":"172.21.15.90:6835","nonce":1573070489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4368,"qdb_cluster":[4368]},"id":1}]} 2024-09-10T23:15:03.107 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 7 2024-09-10T23:15:03.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.108+0000 7f51ab0b0640 1 -- 172.21.15.90:0/4062669009 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5190077fa0 msgr2=0x7f519007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:03.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.108+0000 7f51ab0b0640 1 --2- 172.21.15.90:0/4062669009 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5190077fa0 0x7f519007a460 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f51a0001860 tx=0x7f51a0001c60 comp rx=0 tx=0).stop 2024-09-10T23:15:03.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.108+0000 7f51ab0b0640 1 -- 172.21.15.90:0/4062669009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51a41f47f0 msgr2=0x7f51a41f4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:03.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.108+0000 7f51ab0b0640 1 --2- 172.21.15.90:0/4062669009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51a41f47f0 0x7f51a41f4c50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f51a415e6c0 tx=0x7f519c00d970 comp rx=0 tx=0).stop 2024-09-10T23:15:03.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.108+0000 7f51ab0b0640 1 -- 172.21.15.90:0/4062669009 shutdown_connections 2024-09-10T23:15:03.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.108+0000 7f51ab0b0640 1 --2- 172.21.15.90:0/4062669009 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5190077fa0 0x7f519007a460 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.108+0000 7f51ab0b0640 1 --2- 172.21.15.90:0/4062669009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51a41f47f0 0x7f51a41f4c50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.108+0000 7f51ab0b0640 1 --2- 172.21.15.90:0/4062669009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51a40b52f0 0x7f51a40b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.108+0000 7f51ab0b0640 1 --2- 172.21.15.90:0/4062669009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f518c004800 0x7f51a40b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.108+0000 7f51ab0b0640 1 -- 172.21.15.90:0/4062669009 >> 172.21.15.90:0/4062669009 conn(0x7f51a40cc850 msgr2=0x7f51a40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:03.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.108+0000 7f51ab0b0640 1 -- 172.21.15.90:0/4062669009 shutdown_connections 2024-09-10T23:15:03.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.108+0000 7f51ab0b0640 1 -- 172.21.15.90:0/4062669009 wait complete. 2024-09-10T23:15:03.120 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.220+0000 7fb35012b640 1 -- 172.21.15.90:0/4024604527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3480b1f60 msgr2=0x7fb348073740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.220+0000 7fb35012b640 1 --2- 172.21.15.90:0/4024604527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3480b1f60 0x7fb348073740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb340005fd0 tx=0x7fb34002aa10 comp rx=0 tx=0).stop 2024-09-10T23:15:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.220+0000 7fb35012b640 1 -- 172.21.15.90:0/4024604527 shutdown_connections 2024-09-10T23:15:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.220+0000 7fb35012b640 1 --2- 172.21.15.90:0/4024604527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3480b1f60 0x7fb348073740 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.220+0000 7fb35012b640 1 --2- 172.21.15.90:0/4024604527 >> v2:172.21.15.171:3300/0 conn(0x7fb348159c90 0x7fb3480ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.220+0000 7fb35012b640 1 -- 172.21.15.90:0/4024604527 >> 172.21.15.90:0/4024604527 conn(0x7fb3480cc850 msgr2=0x7fb3480ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:03.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.220+0000 7fb35012b640 1 -- 172.21.15.90:0/4024604527 shutdown_connections 2024-09-10T23:15:03.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.220+0000 7fb35012b640 1 -- 172.21.15.90:0/4024604527 wait complete. 2024-09-10T23:15:03.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.221+0000 7fb35012b640 1 Processor -- start 2024-09-10T23:15:03.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.221+0000 7fb35012b640 1 -- start start 2024-09-10T23:15:03.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.222+0000 7fb35012b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3480b1f60 0x7fb3480b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:03.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.222+0000 7fb35012b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3480cc310 0x7fb348158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:03.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.222+0000 7fb35012b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb348159c90 0x7fb3480b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:03.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.222+0000 7fb35012b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb3480cdb40 con 0x7fb3480b1f60 2024-09-10T23:15:03.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.222+0000 7fb35012b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb348070a30 con 0x7fb348159c90 2024-09-10T23:15:03.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.222+0000 7fb35012b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb34815a070 con 0x7fb3480cc310 2024-09-10T23:15:03.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.222+0000 7fb34dec7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3480b1f60 0x7fb3480b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:03.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.222+0000 7fb34dec7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3480b1f60 0x7fb3480b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55756/0 (socket says 172.21.15.90:55756) 2024-09-10T23:15:03.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.222+0000 7fb34dec7640 1 -- 172.21.15.90:0/2762913222 learned_addr learned my addr 172.21.15.90:0/2762913222 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:03.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.222+0000 7fb34e6c8640 1 --2- 172.21.15.90:0/2762913222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb348159c90 0x7fb3480b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:03.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.222+0000 7fb34d6c6640 1 --2- 172.21.15.90:0/2762913222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3480cc310 0x7fb348158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:03.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.222+0000 7fb34dec7640 1 -- 172.21.15.90:0/2762913222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3480cc310 msgr2=0x7fb348158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.222+0000 7fb34dec7640 1 --2- 172.21.15.90:0/2762913222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3480cc310 0x7fb348158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.222+0000 7fb34dec7640 1 -- 172.21.15.90:0/2762913222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb348159c90 msgr2=0x7fb3480b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.222+0000 7fb34dec7640 1 --2- 172.21.15.90:0/2762913222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb348159c90 0x7fb3480b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.222+0000 7fb34dec7640 1 -- 172.21.15.90:0/2762913222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3480b5450 con 0x7fb3480b1f60 2024-09-10T23:15:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.223+0000 7fb34dec7640 1 --2- 172.21.15.90:0/2762913222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3480b1f60 0x7fb3480b39f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb34400e790 tx=0x7fb34400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.223+0000 7fb33e7fc640 1 -- 172.21.15.90:0/2762913222 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34400eea0 con 0x7fb3480b1f60 2024-09-10T23:15:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.223+0000 7fb33e7fc640 1 -- 172.21.15.90:0/2762913222 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb34400cdb0 con 0x7fb3480b1f60 2024-09-10T23:15:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.223+0000 7fb35012b640 1 -- 172.21.15.90:0/2762913222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3480b56c0 con 0x7fb3480b1f60 2024-09-10T23:15:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.223+0000 7fb33e7fc640 1 -- 172.21.15.90:0/2762913222 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb344010690 con 0x7fb3480b1f60 2024-09-10T23:15:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.223+0000 7fb35012b640 1 -- 172.21.15.90:0/2762913222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3481f34b0 con 0x7fb3480b1f60 2024-09-10T23:15:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.224+0000 7fb35012b640 1 -- 172.21.15.90:0/2762913222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb348073740 con 0x7fb3480b1f60 2024-09-10T23:15:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.224+0000 7fb33e7fc640 1 -- 172.21.15.90:0/2762913222 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb344010830 con 0x7fb3480b1f60 2024-09-10T23:15:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.225+0000 7fb33e7fc640 1 --2- 172.21.15.90:0/2762913222 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb32c077fa0 0x7fb32c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:03.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.225+0000 7fb33e7fc640 1 -- 172.21.15.90:0/2762913222 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb34409a690 con 0x7fb3480b1f60 2024-09-10T23:15:03.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.225+0000 7fb34d6c6640 1 --2- 172.21.15.90:0/2762913222 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb32c077fa0 0x7fb32c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:03.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.226+0000 7fb34d6c6640 1 --2- 172.21.15.90:0/2762913222 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb32c077fa0 0x7fb32c07a460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb3480b50a0 tx=0x7fb338009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:03.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.229+0000 7fb33e7fc640 1 -- 172.21.15.90:0/2762913222 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb344062b40 con 0x7fb3480b1f60 2024-09-10T23:15:03.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.403+0000 7fb35012b640 1 -- 172.21.15.90:0/2762913222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3480b5d50 con 0x7fb3480b1f60 2024-09-10T23:15:03.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.404+0000 7fb33e7fc640 1 -- 172.21.15.90:0/2762913222 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16665 (secure 0 0 0) 0x7fb344067570 con 0x7fb3480b1f60 2024-09-10T23:15:03.405 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:03.405 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":23,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:14:37.132353+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:14:33.985657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:14:34.420690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.406+0000 7fb35012b640 1 -- 172.21.15.90:0/2762913222 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb32c077fa0 msgr2=0x7fb32c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.406+0000 7fb35012b640 1 --2- 172.21.15.90:0/2762913222 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb32c077fa0 0x7fb32c07a460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb3480b50a0 tx=0x7fb338009040 comp rx=0 tx=0).stop 2024-09-10T23:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.406+0000 7fb35012b640 1 -- 172.21.15.90:0/2762913222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3480b1f60 msgr2=0x7fb3480b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.406+0000 7fb35012b640 1 --2- 172.21.15.90:0/2762913222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3480b1f60 0x7fb3480b39f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb34400e790 tx=0x7fb34400ec50 comp rx=0 tx=0).stop 2024-09-10T23:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.406+0000 7fb35012b640 1 -- 172.21.15.90:0/2762913222 shutdown_connections 2024-09-10T23:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.406+0000 7fb35012b640 1 --2- 172.21.15.90:0/2762913222 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb32c077fa0 0x7fb32c07a460 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.406+0000 7fb35012b640 1 --2- 172.21.15.90:0/2762913222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb348159c90 0x7fb3480b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.406+0000 7fb35012b640 1 --2- 172.21.15.90:0/2762913222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3480cc310 0x7fb348158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.406+0000 7fb35012b640 1 --2- 172.21.15.90:0/2762913222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3480b1f60 0x7fb3480b39f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.406+0000 7fb35012b640 1 -- 172.21.15.90:0/2762913222 >> 172.21.15.90:0/2762913222 conn(0x7fb3480cc850 msgr2=0x7fb3480cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:03.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.406+0000 7fb35012b640 1 -- 172.21.15.90:0/2762913222 shutdown_connections 2024-09-10T23:15:03.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.406+0000 7fb35012b640 1 -- 172.21.15.90:0/2762913222 wait complete. 2024-09-10T23:15:03.418 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:15:03.418 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:03.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.517+0000 7febb8d9c640 1 -- 172.21.15.90:0/3093352288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febb415aa30 msgr2=0x7febb40ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:03.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.517+0000 7febb8d9c640 1 --2- 172.21.15.90:0/3093352288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febb415aa30 0x7febb40ca420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7febb4072cb0 tx=0x7febac02a560 comp rx=0 tx=0).stop 2024-09-10T23:15:03.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.517+0000 7febb8d9c640 1 -- 172.21.15.90:0/3093352288 shutdown_connections 2024-09-10T23:15:03.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.517+0000 7febb8d9c640 1 --2- 172.21.15.90:0/3093352288 >> v2:172.21.15.171:3300/0 conn(0x7febb40b1f60 0x7febb40cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.517+0000 7febb8d9c640 1 --2- 172.21.15.90:0/3093352288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febb415aa30 0x7febb40ca420 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.517+0000 7febb8d9c640 1 -- 172.21.15.90:0/3093352288 >> 172.21.15.90:0/3093352288 conn(0x7febb40cc850 msgr2=0x7febb40ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:03.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.517+0000 7febb8d9c640 1 -- 172.21.15.90:0/3093352288 shutdown_connections 2024-09-10T23:15:03.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.517+0000 7febb8d9c640 1 -- 172.21.15.90:0/3093352288 wait complete. 2024-09-10T23:15:03.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.519+0000 7febb8d9c640 1 Processor -- start 2024-09-10T23:15:03.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.519+0000 7febb8d9c640 1 -- start start 2024-09-10T23:15:03.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.519+0000 7febb8d9c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febb40b1f60 0x7febb41492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:03.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.519+0000 7febb8d9c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febb415aa30 0x7febb40c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:03.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.519+0000 7febb8d9c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febb40c9430 0x7febb409a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:03.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.519+0000 7febb8d9c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7febb40ce390 con 0x7febb40c9430 2024-09-10T23:15:03.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.519+0000 7febb8d9c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7febb40ce210 con 0x7febb40b1f60 2024-09-10T23:15:03.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.519+0000 7febb8d9c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7febb40ce510 con 0x7febb415aa30 2024-09-10T23:15:03.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.519+0000 7febb2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febb40c9430 0x7febb409a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:03.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.520+0000 7febb2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febb40c9430 0x7febb409a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55784/0 (socket says 172.21.15.90:55784) 2024-09-10T23:15:03.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.520+0000 7febb2d9d640 1 -- 172.21.15.90:0/2083418317 learned_addr learned my addr 172.21.15.90:0/2083418317 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:03.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.520+0000 7febb259c640 1 --2- 172.21.15.90:0/2083418317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febb40b1f60 0x7febb41492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:03.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.520+0000 7febb1d9b640 1 --2- 172.21.15.90:0/2083418317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febb415aa30 0x7febb40c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:03.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.520+0000 7febb2d9d640 1 -- 172.21.15.90:0/2083418317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febb415aa30 msgr2=0x7febb40c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:03.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.520+0000 7febb2d9d640 1 --2- 172.21.15.90:0/2083418317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febb415aa30 0x7febb40c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.520+0000 7febb2d9d640 1 -- 172.21.15.90:0/2083418317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febb40b1f60 msgr2=0x7febb41492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:03.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.520+0000 7febb2d9d640 1 --2- 172.21.15.90:0/2083418317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febb40b1f60 0x7febb41492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.520+0000 7febb2d9d640 1 -- 172.21.15.90:0/2083418317 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb40c7a50 con 0x7febb40c9430 2024-09-10T23:15:03.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.520+0000 7febb1d9b640 1 --2- 172.21.15.90:0/2083418317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febb415aa30 0x7febb40c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:03.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.520+0000 7febb2d9d640 1 --2- 172.21.15.90:0/2083418317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febb40c9430 0x7febb409a9f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feba400e960 tx=0x7feba400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:03.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.520+0000 7febaaffd640 1 -- 172.21.15.90:0/2083418317 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4004d20 con 0x7febb40c9430 2024-09-10T23:15:03.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.520+0000 7febaaffd640 1 -- 172.21.15.90:0/2083418317 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feba400cb20 con 0x7febb40c9430 2024-09-10T23:15:03.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.520+0000 7febb8d9c640 1 -- 172.21.15.90:0/2083418317 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb40c7d30 con 0x7febb40c9430 2024-09-10T23:15:03.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.520+0000 7febaaffd640 1 -- 172.21.15.90:0/2083418317 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4005020 con 0x7febb40c9430 2024-09-10T23:15:03.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.520+0000 7febb8d9c640 1 -- 172.21.15.90:0/2083418317 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb40c82f0 con 0x7febb40c9430 2024-09-10T23:15:03.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.521+0000 7febb8d9c640 1 -- 172.21.15.90:0/2083418317 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb40cdcd0 con 0x7febb40c9430 2024-09-10T23:15:03.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.522+0000 7febaaffd640 1 -- 172.21.15.90:0/2083418317 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7feba400f040 con 0x7febb40c9430 2024-09-10T23:15:03.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.522+0000 7febaaffd640 1 --2- 172.21.15.90:0/2083418317 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb94077f70 0x7feb9407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:03.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.522+0000 7febaaffd640 1 -- 172.21.15.90:0/2083418317 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7feba409a320 con 0x7febb40c9430 2024-09-10T23:15:03.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.522+0000 7febb259c640 1 --2- 172.21.15.90:0/2083418317 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb94077f70 0x7feb9407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:03.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.523+0000 7febb259c640 1 --2- 172.21.15.90:0/2083418317 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb94077f70 0x7feb9407a430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7febac033000 tx=0x7febac004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:03.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.526+0000 7febaaffd640 1 -- 172.21.15.90:0/2083418317 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7feba4016030 con 0x7febb40c9430 2024-09-10T23:15:03.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.735+0000 7febb8d9c640 1 -- 172.21.15.90:0/2083418317 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febb40ca160 con 0x7febb40c9430 2024-09-10T23:15:03.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.736+0000 7febaaffd640 1 -- 172.21.15.90:0/2083418317 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7feba4062750 con 0x7febb40c9430 2024-09-10T23:15:03.737 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:03.737 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":7,"btime":"2024-09-10T23:14:39:140018+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/286705671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":286705671},{"type":"v1","addr":"172.21.15.171:6837","nonce":286705671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/604738442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":604738442},{"type":"v1","addr":"172.21.15.171:6836","nonce":604738442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/1263661165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1263661165},{"type":"v1","addr":"172.21.15.90:6834","nonce":1263661165}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:14:35.457987+0000","modified":"2024-09-10T23:14:38.235652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4368},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4368":{"gid":4368,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6835/1573070489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":1573070489},{"type":"v1","addr":"172.21.15.90:6835","nonce":1573070489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4368,"qdb_cluster":[4368]},"id":1}]} 2024-09-10T23:15:03.737 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 7 2024-09-10T23:15:03.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.738+0000 7febb8d9c640 1 -- 172.21.15.90:0/2083418317 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb94077f70 msgr2=0x7feb9407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:03.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.738+0000 7febb8d9c640 1 --2- 172.21.15.90:0/2083418317 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb94077f70 0x7feb9407a430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7febac033000 tx=0x7febac004730 comp rx=0 tx=0).stop 2024-09-10T23:15:03.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.738+0000 7febb8d9c640 1 -- 172.21.15.90:0/2083418317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febb40c9430 msgr2=0x7febb409a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:03.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.738+0000 7febb8d9c640 1 --2- 172.21.15.90:0/2083418317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febb40c9430 0x7febb409a9f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feba400e960 tx=0x7feba400ee20 comp rx=0 tx=0).stop 2024-09-10T23:15:03.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.738+0000 7febb8d9c640 1 -- 172.21.15.90:0/2083418317 shutdown_connections 2024-09-10T23:15:03.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.738+0000 7febb8d9c640 1 --2- 172.21.15.90:0/2083418317 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb94077f70 0x7feb9407a430 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.738+0000 7febb8d9c640 1 --2- 172.21.15.90:0/2083418317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febb40c9430 0x7febb409a9f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.738+0000 7febb8d9c640 1 --2- 172.21.15.90:0/2083418317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febb415aa30 0x7febb40c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.738+0000 7febb8d9c640 1 --2- 172.21.15.90:0/2083418317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febb40b1f60 0x7febb41492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.738+0000 7febb8d9c640 1 -- 172.21.15.90:0/2083418317 >> 172.21.15.90:0/2083418317 conn(0x7febb40cc850 msgr2=0x7febb40ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:03.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.738+0000 7febb8d9c640 1 -- 172.21.15.90:0/2083418317 shutdown_connections 2024-09-10T23:15:03.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.738+0000 7febb8d9c640 1 -- 172.21.15.90:0/2083418317 wait complete. 2024-09-10T23:15:03.750 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:03.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.850+0000 7f4102390640 1 -- 172.21.15.90:0/815708034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40e4003a50 msgr2=0x7f40e4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:03.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.850+0000 7f4102390640 1 --2- 172.21.15.90:0/815708034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40e4003a50 0x7f40e4003e70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009b20 tx=0x7f40e4005830 comp rx=0 tx=0).stop 2024-09-10T23:15:03.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.850+0000 7f4102390640 1 -- 172.21.15.90:0/815708034 shutdown_connections 2024-09-10T23:15:03.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.850+0000 7f4102390640 1 --2- 172.21.15.90:0/815708034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40e4003a50 0x7f40e4003e70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.850+0000 7f4102390640 1 -- 172.21.15.90:0/815708034 >> 172.21.15.90:0/815708034 conn(0x7f40fc0cc850 msgr2=0x7f40fc0ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:03.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.850+0000 7f4102390640 1 -- 172.21.15.90:0/815708034 shutdown_connections 2024-09-10T23:15:03.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.850+0000 7f4102390640 1 -- 172.21.15.90:0/815708034 wait complete. 2024-09-10T23:15:03.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.851+0000 7f4102390640 1 Processor -- start 2024-09-10T23:15:03.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.852+0000 7f4102390640 1 -- start start 2024-09-10T23:15:03.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.852+0000 7f4102390640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e4003a50 0x7f40fc156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:03.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.852+0000 7f4102390640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40fc158b60 0x7f40fc14e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:03.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.852+0000 7f4102390640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40fc15d3f0 0x7f40fc15d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:03.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.852+0000 7f4102390640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc0ca5a0 con 0x7f40fc158b60 2024-09-10T23:15:03.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.852+0000 7f4102390640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc0ca420 con 0x7f40fc15d3f0 2024-09-10T23:15:03.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.852+0000 7f4102390640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f40fc0ca720 con 0x7f40e4003a50 2024-09-10T23:15:03.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.852+0000 7f40fb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40fc158b60 0x7f40fc14e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:03.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.853+0000 7f40fb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40fc158b60 0x7f40fc14e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55796/0 (socket says 172.21.15.90:55796) 2024-09-10T23:15:03.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.853+0000 7f40fb7fe640 1 -- 172.21.15.90:0/752371925 learned_addr learned my addr 172.21.15.90:0/752371925 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:03.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.853+0000 7f40fbfff640 1 --2- 172.21.15.90:0/752371925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e4003a50 0x7f40fc156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:03.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.853+0000 7f410092d640 1 --2- 172.21.15.90:0/752371925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40fc15d3f0 0x7f40fc15d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:03.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.853+0000 7f40fb7fe640 1 -- 172.21.15.90:0/752371925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e4003a50 msgr2=0x7f40fc156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:03.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.853+0000 7f40fb7fe640 1 --2- 172.21.15.90:0/752371925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e4003a50 0x7f40fc156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.853+0000 7f40fb7fe640 1 -- 172.21.15.90:0/752371925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40fc15d3f0 msgr2=0x7f40fc15d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:03.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.853+0000 7f40fb7fe640 1 --2- 172.21.15.90:0/752371925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40fc15d3f0 0x7f40fc15d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:03.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.853+0000 7f40fb7fe640 1 -- 172.21.15.90:0/752371925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40fc158fe0 con 0x7f40fc158b60 2024-09-10T23:15:03.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.853+0000 7f40fb7fe640 1 --2- 172.21.15.90:0/752371925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40fc158b60 0x7f40fc14e120 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f40f000d5c0 tx=0x7f40f000d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:03.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.853+0000 7f40f8ff9640 1 -- 172.21.15.90:0/752371925 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f0003610 con 0x7f40fc158b60 2024-09-10T23:15:03.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.853+0000 7f40f8ff9640 1 -- 172.21.15.90:0/752371925 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40f00038a0 con 0x7f40fc158b60 2024-09-10T23:15:03.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.853+0000 7f40f8ff9640 1 -- 172.21.15.90:0/752371925 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f0003cd0 con 0x7f40fc158b60 2024-09-10T23:15:03.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.853+0000 7f4102390640 1 -- 172.21.15.90:0/752371925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40fc156a00 con 0x7f40fc158b60 2024-09-10T23:15:03.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.853+0000 7f4102390640 1 -- 172.21.15.90:0/752371925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40fc1f6080 con 0x7f40fc158b60 2024-09-10T23:15:03.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.854+0000 7f4102390640 1 -- 172.21.15.90:0/752371925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40fc0b1bd0 con 0x7f40fc158b60 2024-09-10T23:15:03.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.855+0000 7f40f8ff9640 1 -- 172.21.15.90:0/752371925 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f40f001b470 con 0x7f40fc158b60 2024-09-10T23:15:03.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.855+0000 7f40f8ff9640 1 --2- 172.21.15.90:0/752371925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f40e8077fa0 0x7f40e807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:03.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.855+0000 7f40f8ff9640 1 -- 172.21.15.90:0/752371925 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f40f0099e80 con 0x7f40fc158b60 2024-09-10T23:15:03.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.855+0000 7f40fbfff640 1 --2- 172.21.15.90:0/752371925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f40e8077fa0 0x7f40e807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:03.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.856+0000 7f40fbfff640 1 --2- 172.21.15.90:0/752371925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f40e8077fa0 0x7f40e807a460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f40ec035000 tx=0x7f40ec02d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:03.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:03.859+0000 7f40f8ff9640 1 -- 172.21.15.90:0/752371925 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f40f0062a10 con 0x7f40fc158b60 2024-09-10T23:15:04.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.070+0000 7f4102390640 1 -- 172.21.15.90:0/752371925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40fc0af2c0 con 0x7f40fc158b60 2024-09-10T23:15:04.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.071+0000 7f40f8ff9640 1 -- 172.21.15.90:0/752371925 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7f40f0062310 con 0x7f40fc158b60 2024-09-10T23:15:04.072 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:04.072 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":7,"btime":"2024-09-10T23:14:39:140018+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/286705671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":286705671},{"type":"v1","addr":"172.21.15.171:6837","nonce":286705671}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/604738442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":604738442},{"type":"v1","addr":"172.21.15.171:6836","nonce":604738442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/1263661165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1263661165},{"type":"v1","addr":"172.21.15.90:6834","nonce":1263661165}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:14:35.457987+0000","modified":"2024-09-10T23:14:38.235652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4368},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4368":{"gid":4368,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6835/1573070489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":1573070489},{"type":"v1","addr":"172.21.15.90:6835","nonce":1573070489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4368,"qdb_cluster":[4368]},"id":1}]} 2024-09-10T23:15:04.072 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 7 2024-09-10T23:15:04.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.073+0000 7f4102390640 1 -- 172.21.15.90:0/752371925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f40e8077fa0 msgr2=0x7f40e807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:04.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.073+0000 7f4102390640 1 --2- 172.21.15.90:0/752371925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f40e8077fa0 0x7f40e807a460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f40ec035000 tx=0x7f40ec02d040 comp rx=0 tx=0).stop 2024-09-10T23:15:04.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.073+0000 7f4102390640 1 -- 172.21.15.90:0/752371925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40fc158b60 msgr2=0x7f40fc14e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:04.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.073+0000 7f4102390640 1 --2- 172.21.15.90:0/752371925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40fc158b60 0x7f40fc14e120 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f40f000d5c0 tx=0x7f40f000d9c0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.074+0000 7f4102390640 1 -- 172.21.15.90:0/752371925 shutdown_connections 2024-09-10T23:15:04.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.074+0000 7f4102390640 1 --2- 172.21.15.90:0/752371925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f40e8077fa0 0x7f40e807a460 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.074+0000 7f4102390640 1 --2- 172.21.15.90:0/752371925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40fc15d3f0 0x7f40fc15d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.074+0000 7f4102390640 1 --2- 172.21.15.90:0/752371925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40fc158b60 0x7f40fc14e120 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.074+0000 7f4102390640 1 --2- 172.21.15.90:0/752371925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e4003a50 0x7f40fc156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.074+0000 7f4102390640 1 -- 172.21.15.90:0/752371925 >> 172.21.15.90:0/752371925 conn(0x7f40fc0cc850 msgr2=0x7f40fc0acd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:04.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.074+0000 7f4102390640 1 -- 172.21.15.90:0/752371925 shutdown_connections 2024-09-10T23:15:04.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.074+0000 7f4102390640 1 -- 172.21.15.90:0/752371925 wait complete. 2024-09-10T23:15:04.085 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:04.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.185+0000 7f38077db640 1 -- 172.21.15.90:0/755316371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38000d2470 msgr2=0x7f38000b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:04.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.185+0000 7f38077db640 1 --2- 172.21.15.90:0/755316371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38000d2470 0x7f38000b3490 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f37f0005fd0 tx=0x7f37f002a8b0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.185+0000 7f38077db640 1 -- 172.21.15.90:0/755316371 shutdown_connections 2024-09-10T23:15:04.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.185+0000 7f38077db640 1 --2- 172.21.15.90:0/755316371 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38000d1c70 0x7f38000d2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.185+0000 7f38077db640 1 --2- 172.21.15.90:0/755316371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38000d2470 0x7f38000b3490 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.185+0000 7f38077db640 1 -- 172.21.15.90:0/755316371 >> 172.21.15.90:0/755316371 conn(0x7f380009d2a0 msgr2=0x7f38000d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:04.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.185+0000 7f38077db640 1 -- 172.21.15.90:0/755316371 shutdown_connections 2024-09-10T23:15:04.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.185+0000 7f38077db640 1 -- 172.21.15.90:0/755316371 wait complete. 2024-09-10T23:15:04.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.186+0000 7f38077db640 1 Processor -- start 2024-09-10T23:15:04.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.187+0000 7f38077db640 1 -- start start 2024-09-10T23:15:04.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.187+0000 7f38077db640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38000d0ab0 0x7f38000caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:04.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.187+0000 7f38077db640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38000d1c70 0x7f38000b9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.187+0000 7f38077db640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38000d2470 0x7f38000c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.187+0000 7f38077db640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f380015e4a0 con 0x7f38000d0ab0 2024-09-10T23:15:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.187+0000 7f38077db640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f380015e320 con 0x7f38000d1c70 2024-09-10T23:15:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.187+0000 7f38077db640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f38000b4a10 con 0x7f38000d2470 2024-09-10T23:15:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.187+0000 7f3805577640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38000d0ab0 0x7f38000caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.187+0000 7f3805577640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38000d0ab0 0x7f38000caa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55810/0 (socket says 172.21.15.90:55810) 2024-09-10T23:15:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.187+0000 7f3805577640 1 -- 172.21.15.90:0/3391737826 learned_addr learned my addr 172.21.15.90:0/3391737826 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.188+0000 7f3805d78640 1 --2- 172.21.15.90:0/3391737826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38000d2470 0x7f38000c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.188+0000 7f3805577640 1 -- 172.21.15.90:0/3391737826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38000d2470 msgr2=0x7f38000c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.188+0000 7f3805577640 1 --2- 172.21.15.90:0/3391737826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38000d2470 0x7f38000c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.188+0000 7f3805577640 1 -- 172.21.15.90:0/3391737826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38000d1c70 msgr2=0x7f38000b9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:04.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.188+0000 7f3805577640 1 --2- 172.21.15.90:0/3391737826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38000d1c70 0x7f38000b9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.188+0000 7f3805577640 1 -- 172.21.15.90:0/3391737826 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38000c9c70 con 0x7f38000d0ab0 2024-09-10T23:15:04.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.188+0000 7f3805577640 1 --2- 172.21.15.90:0/3391737826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38000d0ab0 0x7f38000caa30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009cd0 tx=0x7f37f0003a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:04.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.188+0000 7f37fdffb640 1 -- 172.21.15.90:0/3391737826 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f0031b90 con 0x7f38000d0ab0 2024-09-10T23:15:04.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.188+0000 7f37fdffb640 1 -- 172.21.15.90:0/3391737826 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37f0031e20 con 0x7f38000d0ab0 2024-09-10T23:15:04.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.188+0000 7f38077db640 1 -- 172.21.15.90:0/3391737826 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38000c9f50 con 0x7f38000d0ab0 2024-09-10T23:15:04.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.188+0000 7f37fdffb640 1 -- 172.21.15.90:0/3391737826 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f00332d0 con 0x7f38000d0ab0 2024-09-10T23:15:04.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.188+0000 7f38077db640 1 -- 172.21.15.90:0/3391737826 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38000c98b0 con 0x7f38000d0ab0 2024-09-10T23:15:04.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.189+0000 7f38077db640 1 -- 172.21.15.90:0/3391737826 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38000d1850 con 0x7f38000d0ab0 2024-09-10T23:15:04.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.190+0000 7f37fdffb640 1 -- 172.21.15.90:0/3391737826 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f37f004b030 con 0x7f38000d0ab0 2024-09-10T23:15:04.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.190+0000 7f37fdffb640 1 --2- 172.21.15.90:0/3391737826 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f37ec077f70 0x7f37ec07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:04.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.190+0000 7f37fdffb640 1 -- 172.21.15.90:0/3391737826 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f37f00baf30 con 0x7f38000d0ab0 2024-09-10T23:15:04.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.190+0000 7f3804d76640 1 --2- 172.21.15.90:0/3391737826 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f37ec077f70 0x7f37ec07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:04.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.191+0000 7f3804d76640 1 --2- 172.21.15.90:0/3391737826 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f37ec077f70 0x7f37ec07a430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f38000b57f0 tx=0x7f37f4006c90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:04.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.194+0000 7f37fdffb640 1 -- 172.21.15.90:0/3391737826 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f37f003f030 con 0x7f38000d0ab0 2024-09-10T23:15:04.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.368+0000 7f38077db640 1 -- 172.21.15.90:0/3391737826 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38000b47d0 con 0x7f38000d0ab0 2024-09-10T23:15:04.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.369+0000 7f37fdffb640 1 -- 172.21.15.90:0/3391737826 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16665 (secure 0 0 0) 0x7f37f0083ac0 con 0x7f38000d0ab0 2024-09-10T23:15:04.370 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:04.370 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":23,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:14:37.132353+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:14:33.985657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:14:34.420690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:04.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.371+0000 7f38077db640 1 -- 172.21.15.90:0/3391737826 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f37ec077f70 msgr2=0x7f37ec07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:04.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.371+0000 7f38077db640 1 --2- 172.21.15.90:0/3391737826 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f37ec077f70 0x7f37ec07a430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f38000b57f0 tx=0x7f37f4006c90 comp rx=0 tx=0).stop 2024-09-10T23:15:04.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.371+0000 7f38077db640 1 -- 172.21.15.90:0/3391737826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38000d0ab0 msgr2=0x7f38000caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:04.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.371+0000 7f38077db640 1 --2- 172.21.15.90:0/3391737826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38000d0ab0 0x7f38000caa30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009cd0 tx=0x7f37f0003a10 comp rx=0 tx=0).stop 2024-09-10T23:15:04.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.371+0000 7f38077db640 1 -- 172.21.15.90:0/3391737826 shutdown_connections 2024-09-10T23:15:04.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.371+0000 7f38077db640 1 --2- 172.21.15.90:0/3391737826 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f37ec077f70 0x7f37ec07a430 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.371+0000 7f38077db640 1 --2- 172.21.15.90:0/3391737826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38000d1c70 0x7f38000b9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.371+0000 7f38077db640 1 --2- 172.21.15.90:0/3391737826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38000d2470 0x7f38000c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.371+0000 7f38077db640 1 --2- 172.21.15.90:0/3391737826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38000d0ab0 0x7f38000caa30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.371+0000 7f38077db640 1 -- 172.21.15.90:0/3391737826 >> 172.21.15.90:0/3391737826 conn(0x7f380009d2a0 msgr2=0x7f38000d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:04.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.371+0000 7f38077db640 1 -- 172.21.15.90:0/3391737826 shutdown_connections 2024-09-10T23:15:04.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.371+0000 7f38077db640 1 -- 172.21.15.90:0/3391737826 wait complete. 2024-09-10T23:15:04.383 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:15:04.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.484+0000 7fe06eccf640 1 -- 172.21.15.90:0/2243912351 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe050003a00 msgr2=0x7fe050003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:04.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.484+0000 7fe06eccf640 1 --2- 172.21.15.90:0/2243912351 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe050003a00 0x7fe050003e20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe064009b50 tx=0x7fe050005830 comp rx=0 tx=0).stop 2024-09-10T23:15:04.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.484+0000 7fe06d26c640 1 -- 172.21.15.90:0/2243912351 reap_dead start 2024-09-10T23:15:04.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.484+0000 7fe06eccf640 1 -- 172.21.15.90:0/2243912351 shutdown_connections 2024-09-10T23:15:04.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.484+0000 7fe06eccf640 1 -- 172.21.15.90:0/2243912351 >> 172.21.15.90:0/2243912351 conn(0x7fe0680cc850 msgr2=0x7fe0680ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:04.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.484+0000 7fe06eccf640 1 -- 172.21.15.90:0/2243912351 shutdown_connections 2024-09-10T23:15:04.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.484+0000 7fe06eccf640 1 -- 172.21.15.90:0/2243912351 wait complete. 2024-09-10T23:15:04.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.485+0000 7fe06eccf640 1 Processor -- start 2024-09-10T23:15:04.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.485+0000 7fe06eccf640 1 -- start start 2024-09-10T23:15:04.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.486+0000 7fe06eccf640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe050003a00 0x7fe068152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:04.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.486+0000 7fe06eccf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0681f5b90 0x7fe0680b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:04.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.486+0000 7fe06eccf640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0680b5080 0x7fe0680ce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:04.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.486+0000 7fe06eccf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe06815c210 con 0x7fe0681f5b90 2024-09-10T23:15:04.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.486+0000 7fe06eccf640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe06815c090 con 0x7fe0680b5080 2024-09-10T23:15:04.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.486+0000 7fe06eccf640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe0680ca820 con 0x7fe050003a00 2024-09-10T23:15:04.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.486+0000 7fe05ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0681f5b90 0x7fe0680b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:04.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.486+0000 7fe05ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0681f5b90 0x7fe0680b4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55834/0 (socket says 172.21.15.90:55834) 2024-09-10T23:15:04.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.486+0000 7fe05ffff640 1 -- 172.21.15.90:0/1477368954 learned_addr learned my addr 172.21.15.90:0/1477368954 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:04.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.487+0000 7fe06ca6b640 1 --2- 172.21.15.90:0/1477368954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe050003a00 0x7fe068152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:04.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.487+0000 7fe06d26c640 1 --2- 172.21.15.90:0/1477368954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0680b5080 0x7fe0680ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:04.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.487+0000 7fe05ffff640 1 -- 172.21.15.90:0/1477368954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe050003a00 msgr2=0x7fe068152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:04.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.487+0000 7fe05ffff640 1 --2- 172.21.15.90:0/1477368954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe050003a00 0x7fe068152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.487+0000 7fe05ffff640 1 -- 172.21.15.90:0/1477368954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0680b5080 msgr2=0x7fe0680ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:04.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.487+0000 7fe05ffff640 1 --2- 172.21.15.90:0/1477368954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0680b5080 0x7fe0680ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.487+0000 7fe05ffff640 1 -- 172.21.15.90:0/1477368954 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0680c3aa0 con 0x7fe0681f5b90 2024-09-10T23:15:04.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.487+0000 7fe06ca6b640 1 --2- 172.21.15.90:0/1477368954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe050003a00 0x7fe068152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:04.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.487+0000 7fe06d26c640 1 --2- 172.21.15.90:0/1477368954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0680b5080 0x7fe0680ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:04.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.487+0000 7fe05ffff640 1 --2- 172.21.15.90:0/1477368954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0681f5b90 0x7fe0680b4b40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe058006680 tx=0x7fe0580066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:04.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.487+0000 7fe05d7fa640 1 -- 172.21.15.90:0/1477368954 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe058015070 con 0x7fe0681f5b90 2024-09-10T23:15:04.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.487+0000 7fe05d7fa640 1 -- 172.21.15.90:0/1477368954 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe058011900 con 0x7fe0681f5b90 2024-09-10T23:15:04.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.487+0000 7fe06eccf640 1 -- 172.21.15.90:0/1477368954 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0680c3d80 con 0x7fe0681f5b90 2024-09-10T23:15:04.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.487+0000 7fe05d7fa640 1 -- 172.21.15.90:0/1477368954 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe058011d30 con 0x7fe0681f5b90 2024-09-10T23:15:04.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.487+0000 7fe06eccf640 1 -- 172.21.15.90:0/1477368954 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe068152760 con 0x7fe0681f5b90 2024-09-10T23:15:04.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.488+0000 7fe06eccf640 1 -- 172.21.15.90:0/1477368954 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0680cb7e0 con 0x7fe0681f5b90 2024-09-10T23:15:04.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.489+0000 7fe05d7fa640 1 -- 172.21.15.90:0/1477368954 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe0580103c0 con 0x7fe0681f5b90 2024-09-10T23:15:04.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.489+0000 7fe05d7fa640 1 --2- 172.21.15.90:0/1477368954 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe054077fa0 0x7fe05407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:04.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.489+0000 7fe05d7fa640 1 -- 172.21.15.90:0/1477368954 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe05809ad90 con 0x7fe0681f5b90 2024-09-10T23:15:04.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.489+0000 7fe06ca6b640 1 --2- 172.21.15.90:0/1477368954 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe054077fa0 0x7fe05407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:04.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.490+0000 7fe06ca6b640 1 --2- 172.21.15.90:0/1477368954 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe054077fa0 0x7fe05407a460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe064035000 tx=0x7fe06402d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:04.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.493+0000 7fe05d7fa640 1 -- 172.21.15.90:0/1477368954 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe058063890 con 0x7fe0681f5b90 2024-09-10T23:15:04.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.704+0000 7fe06eccf640 1 -- 172.21.15.90:0/1477368954 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe0680b5460 con 0x7fe0681f5b90 2024-09-10T23:15:04.705 INFO:tasks.ceph.mon.a.smithi090.stderr:2024-09-10T23:15:04.704+0000 7f1a0c84c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:15:04.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.706+0000 7fe05d7fa640 1 -- 172.21.15.90:0/1477368954 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7fe058063190 con 0x7fe0681f5b90 2024-09-10T23:15:04.707 INFO:teuthology.orchestra.run.smithi090.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:15:04.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.708+0000 7fe06eccf640 1 -- 172.21.15.90:0/1477368954 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe054077fa0 msgr2=0x7fe05407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:04.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.708+0000 7fe06eccf640 1 --2- 172.21.15.90:0/1477368954 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe054077fa0 0x7fe05407a460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe064035000 tx=0x7fe06402d040 comp rx=0 tx=0).stop 2024-09-10T23:15:04.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.708+0000 7fe06eccf640 1 -- 172.21.15.90:0/1477368954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0681f5b90 msgr2=0x7fe0680b4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:04.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.708+0000 7fe06eccf640 1 --2- 172.21.15.90:0/1477368954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0681f5b90 0x7fe0680b4b40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe058006680 tx=0x7fe0580066b0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.708+0000 7fe06eccf640 1 -- 172.21.15.90:0/1477368954 shutdown_connections 2024-09-10T23:15:04.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.708+0000 7fe06eccf640 1 --2- 172.21.15.90:0/1477368954 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe054077fa0 0x7fe05407a460 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.708+0000 7fe06eccf640 1 --2- 172.21.15.90:0/1477368954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0680b5080 0x7fe0680ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.708+0000 7fe06eccf640 1 --2- 172.21.15.90:0/1477368954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0681f5b90 0x7fe0680b4b40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.708+0000 7fe06eccf640 1 --2- 172.21.15.90:0/1477368954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe050003a00 0x7fe068152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.708+0000 7fe06eccf640 1 -- 172.21.15.90:0/1477368954 >> 172.21.15.90:0/1477368954 conn(0x7fe0680cc850 msgr2=0x7fe0680ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:04.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.708+0000 7fe06eccf640 1 -- 172.21.15.90:0/1477368954 shutdown_connections 2024-09-10T23:15:04.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.708+0000 7fe06eccf640 1 -- 172.21.15.90:0/1477368954 wait complete. 2024-09-10T23:15:04.715 INFO:tasks.ceph.mds.c.smithi090.stderr: -6712> 2024-09-10T23:14:41.789+0000 7f536b80a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:15:04.725 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:15:04.752 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-09-10T23:15:04.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.832+0000 7efeeb616640 1 -- 172.21.15.90:0/4077445412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efed0004d90 msgr2=0x7efed0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:04.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.832+0000 7efeeb616640 1 --2- 172.21.15.90:0/4077445412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efed0004d90 0x7efed0005210 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efee40c6d00 tx=0x7efed0005830 comp rx=0 tx=0).stop 2024-09-10T23:15:04.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.832+0000 7efee9bb3640 1 -- 172.21.15.90:0/4077445412 reap_dead start 2024-09-10T23:15:04.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.832+0000 7efeeb616640 1 -- 172.21.15.90:0/4077445412 shutdown_connections 2024-09-10T23:15:04.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.832+0000 7efeeb616640 1 -- 172.21.15.90:0/4077445412 >> 172.21.15.90:0/4077445412 conn(0x7efee40cfc80 msgr2=0x7efee40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:04.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.832+0000 7efeeb616640 1 -- 172.21.15.90:0/4077445412 shutdown_connections 2024-09-10T23:15:04.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.832+0000 7efeeb616640 1 -- 172.21.15.90:0/4077445412 wait complete. 2024-09-10T23:15:04.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.833+0000 7efeeb616640 1 Processor -- start 2024-09-10T23:15:04.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.833+0000 7efeeb616640 1 -- start start 2024-09-10T23:15:04.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.834+0000 7efeeb616640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed0004d90 0x7efee41f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:04.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.834+0000 7efeeb616640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efee41f29e0 0x7efee4073240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:04.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.834+0000 7efeeb616640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efee414de10 0x7efee414e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:04.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.834+0000 7efeeb616640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efee40caba0 con 0x7efee41f29e0 2024-09-10T23:15:04.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.834+0000 7efeeb616640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efee40caa20 con 0x7efee414de10 2024-09-10T23:15:04.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.834+0000 7efeeb616640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efee406e680 con 0x7efed0004d90 2024-09-10T23:15:04.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.834+0000 7efee8bb1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efee41f29e0 0x7efee4073240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:04.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.834+0000 7efee8bb1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efee41f29e0 0x7efee4073240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55880/0 (socket says 172.21.15.90:55880) 2024-09-10T23:15:04.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.834+0000 7efee8bb1640 1 -- 172.21.15.90:0/476907646 learned_addr learned my addr 172.21.15.90:0/476907646 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:04.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.834+0000 7efee8bb1640 1 -- 172.21.15.90:0/476907646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed0004d90 msgr2=0x7efee41f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:04.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.834+0000 7efee8bb1640 1 --2- 172.21.15.90:0/476907646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed0004d90 0x7efee41f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.834+0000 7efee8bb1640 1 -- 172.21.15.90:0/476907646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efee414de10 msgr2=0x7efee414e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:04.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.834+0000 7efee9bb3640 1 --2- 172.21.15.90:0/476907646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efee414de10 0x7efee414e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:04.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.834+0000 7efee8bb1640 1 --2- 172.21.15.90:0/476907646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efee414de10 0x7efee414e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:04.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.834+0000 7efee8bb1640 1 -- 172.21.15.90:0/476907646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee41f3180 con 0x7efee41f29e0 2024-09-10T23:15:04.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.834+0000 7efee8bb1640 1 --2- 172.21.15.90:0/476907646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efee41f29e0 0x7efee4073240 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efed4003f20 tx=0x7efed40016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:04.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.835+0000 7efed9ffb640 1 -- 172.21.15.90:0/476907646 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4011640 con 0x7efee41f29e0 2024-09-10T23:15:04.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.835+0000 7efed9ffb640 1 -- 172.21.15.90:0/476907646 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efed4016020 con 0x7efee41f29e0 2024-09-10T23:15:04.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.835+0000 7efeeb616640 1 -- 172.21.15.90:0/476907646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee41f3460 con 0x7efee41f29e0 2024-09-10T23:15:04.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.835+0000 7efed9ffb640 1 -- 172.21.15.90:0/476907646 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4011a80 con 0x7efee41f29e0 2024-09-10T23:15:04.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.835+0000 7efeeb616640 1 -- 172.21.15.90:0/476907646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee414d8f0 con 0x7efee41f29e0 2024-09-10T23:15:04.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.836+0000 7efeeb616640 1 -- 172.21.15.90:0/476907646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efee406eb80 con 0x7efee41f29e0 2024-09-10T23:15:04.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.836+0000 7efed9ffb640 1 -- 172.21.15.90:0/476907646 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7efed4011c20 con 0x7efee41f29e0 2024-09-10T23:15:04.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.837+0000 7efed9ffb640 1 --2- 172.21.15.90:0/476907646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efec8077f70 0x7efec807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:04.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.837+0000 7efed9ffb640 1 -- 172.21.15.90:0/476907646 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7efed409aa70 con 0x7efee41f29e0 2024-09-10T23:15:04.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.837+0000 7efee93b2640 1 --2- 172.21.15.90:0/476907646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efec8077f70 0x7efec807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:04.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.838+0000 7efee93b2640 1 --2- 172.21.15.90:0/476907646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efec8077f70 0x7efec807a430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efee00058c0 tx=0x7efee0005850 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:04.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:04.841+0000 7efed9ffb640 1 -- 172.21.15.90:0/476907646 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7efed4020020 con 0x7efee41f29e0 2024-09-10T23:15:05.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.050+0000 7efeeb616640 1 -- 172.21.15.90:0/476907646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7efee40b5c00 con 0x7efee41f29e0 2024-09-10T23:15:05.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.707+0000 7efed9ffb640 1 -- 172.21.15.90:0/476907646 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7efed4063500 con 0x7efee41f29e0 2024-09-10T23:15:05.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.709+0000 7efeeb616640 1 -- 172.21.15.90:0/476907646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efec8077f70 msgr2=0x7efec807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:05.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.709+0000 7efeeb616640 1 --2- 172.21.15.90:0/476907646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efec8077f70 0x7efec807a430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efee00058c0 tx=0x7efee0005850 comp rx=0 tx=0).stop 2024-09-10T23:15:05.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.710+0000 7efeeb616640 1 -- 172.21.15.90:0/476907646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efee41f29e0 msgr2=0x7efee4073240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:05.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.710+0000 7efeeb616640 1 --2- 172.21.15.90:0/476907646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efee41f29e0 0x7efee4073240 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efed4003f20 tx=0x7efed40016f0 comp rx=0 tx=0).stop 2024-09-10T23:15:05.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.710+0000 7efeeb616640 1 -- 172.21.15.90:0/476907646 shutdown_connections 2024-09-10T23:15:05.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.710+0000 7efeeb616640 1 --2- 172.21.15.90:0/476907646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efec8077f70 0x7efec807a430 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:05.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.710+0000 7efeeb616640 1 --2- 172.21.15.90:0/476907646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efee414de10 0x7efee414e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:05.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.710+0000 7efeeb616640 1 --2- 172.21.15.90:0/476907646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efee41f29e0 0x7efee4073240 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:05.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.710+0000 7efeeb616640 1 --2- 172.21.15.90:0/476907646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed0004d90 0x7efee41f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:05.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.710+0000 7efeeb616640 1 -- 172.21.15.90:0/476907646 >> 172.21.15.90:0/476907646 conn(0x7efee40cfc80 msgr2=0x7efee406fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:05.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.710+0000 7efeeb616640 1 -- 172.21.15.90:0/476907646 shutdown_connections 2024-09-10T23:15:05.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.710+0000 7efeeb616640 1 -- 172.21.15.90:0/476907646 wait complete. 2024-09-10T23:15:05.723 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:15:05.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.868+0000 7fe19673d640 1 -- 172.21.15.90:0/2023791578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe19015e120 msgr2=0x7fe1900cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:05.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.868+0000 7fe19673d640 1 --2- 172.21.15.90:0/2023791578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe19015e120 0x7fe1900cfa00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe180009830 tx=0x7fe18002a480 comp rx=0 tx=0).stop 2024-09-10T23:15:05.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.868+0000 7fe19673d640 1 -- 172.21.15.90:0/2023791578 shutdown_connections 2024-09-10T23:15:05.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.868+0000 7fe19673d640 1 --2- 172.21.15.90:0/2023791578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe19015e120 0x7fe1900cfa00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:05.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.868+0000 7fe19673d640 1 -- 172.21.15.90:0/2023791578 >> 172.21.15.90:0/2023791578 conn(0x7fe1900d4030 msgr2=0x7fe1900d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:05.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.868+0000 7fe19673d640 1 -- 172.21.15.90:0/2023791578 shutdown_connections 2024-09-10T23:15:05.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.868+0000 7fe19673d640 1 -- 172.21.15.90:0/2023791578 wait complete. 2024-09-10T23:15:05.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.869+0000 7fe19673d640 1 Processor -- start 2024-09-10T23:15:05.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.870+0000 7fe19673d640 1 -- start start 2024-09-10T23:15:05.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.870+0000 7fe19673d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1900d0770 0x7fe1901f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:05.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.870+0000 7fe19673d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1900d4b50 0x7fe1901f8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:05.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.870+0000 7fe19673d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe19015e120 0x7fe1900b90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:05.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.870+0000 7fe19673d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe1900d0f90 con 0x7fe19015e120 2024-09-10T23:15:05.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.870+0000 7fe19673d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe1900d0e10 con 0x7fe1900d0770 2024-09-10T23:15:05.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.870+0000 7fe19673d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe1901f47a0 con 0x7fe1900d4b50 2024-09-10T23:15:05.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe194cda640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe19015e120 0x7fe1900b90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:05.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe194cda640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe19015e120 0x7fe1900b90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55888/0 (socket says 172.21.15.90:55888) 2024-09-10T23:15:05.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe194cda640 1 -- 172.21.15.90:0/1396580043 learned_addr learned my addr 172.21.15.90:0/1396580043 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:05.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe18ffff640 1 --2- 172.21.15.90:0/1396580043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1900d0770 0x7fe1901f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:05.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe194cda640 1 -- 172.21.15.90:0/1396580043 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1900d4b50 msgr2=0x7fe1901f8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:05.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe18f7fe640 1 --2- 172.21.15.90:0/1396580043 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1900d4b50 0x7fe1901f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:05.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe194cda640 1 --2- 172.21.15.90:0/1396580043 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1900d4b50 0x7fe1901f8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:05.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe194cda640 1 -- 172.21.15.90:0/1396580043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1900d0770 msgr2=0x7fe1901f4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:05.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe194cda640 1 --2- 172.21.15.90:0/1396580043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1900d0770 0x7fe1901f4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:05.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe194cda640 1 -- 172.21.15.90:0/1396580043 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1900cb100 con 0x7fe19015e120 2024-09-10T23:15:05.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe18ffff640 1 --2- 172.21.15.90:0/1396580043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1900d0770 0x7fe1901f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:05.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe18f7fe640 1 --2- 172.21.15.90:0/1396580043 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1900d4b50 0x7fe1901f8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:05.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe194cda640 1 --2- 172.21.15.90:0/1396580043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe19015e120 0x7fe1900b90d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c780 tx=0x7fe18800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:05.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe18cff9640 1 -- 172.21.15.90:0/1396580043 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe188004b60 con 0x7fe19015e120 2024-09-10T23:15:05.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe18cff9640 1 -- 172.21.15.90:0/1396580043 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe188004df0 con 0x7fe19015e120 2024-09-10T23:15:05.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe19673d640 1 -- 172.21.15.90:0/1396580043 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1901f8dd0 con 0x7fe19015e120 2024-09-10T23:15:05.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe18cff9640 1 -- 172.21.15.90:0/1396580043 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18800aa70 con 0x7fe19015e120 2024-09-10T23:15:05.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.871+0000 7fe19673d640 1 -- 172.21.15.90:0/1396580043 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1900cb680 con 0x7fe19015e120 2024-09-10T23:15:05.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.872+0000 7fe19673d640 1 -- 172.21.15.90:0/1396580043 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1900b7880 con 0x7fe19015e120 2024-09-10T23:15:05.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.873+0000 7fe18cff9640 1 -- 172.21.15.90:0/1396580043 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe18800ac10 con 0x7fe19015e120 2024-09-10T23:15:05.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.873+0000 7fe18cff9640 1 --2- 172.21.15.90:0/1396580043 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe17c077f70 0x7fe17c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:05.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.873+0000 7fe18cff9640 1 -- 172.21.15.90:0/1396580043 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7fe18809a120 con 0x7fe19015e120 2024-09-10T23:15:05.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.873+0000 7fe18ffff640 1 --2- 172.21.15.90:0/1396580043 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe17c077f70 0x7fe17c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:05.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.874+0000 7fe18ffff640 1 --2- 172.21.15.90:0/1396580043 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe17c077f70 0x7fe17c07a430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe180034000 tx=0x7fe180004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:05.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:05.877+0000 7fe18cff9640 1 -- 172.21.15.90:0/1396580043 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe188020070 con 0x7fe19015e120 2024-09-10T23:15:06.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.054+0000 7fe19673d640 1 -- 172.21.15.90:0/1396580043 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe1900d15e0 con 0x7fe19015e120 2024-09-10T23:15:06.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.712+0000 7fe18cff9640 1 -- 172.21.15.90:0/1396580043 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7fe188062bc0 con 0x7fe19015e120 2024-09-10T23:15:06.715 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:15:06.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.716+0000 7fe19673d640 1 -- 172.21.15.90:0/1396580043 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe17c077f70 msgr2=0x7fe17c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:06.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.716+0000 7fe19673d640 1 --2- 172.21.15.90:0/1396580043 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe17c077f70 0x7fe17c07a430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe180034000 tx=0x7fe180004730 comp rx=0 tx=0).stop 2024-09-10T23:15:06.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.716+0000 7fe19673d640 1 -- 172.21.15.90:0/1396580043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe19015e120 msgr2=0x7fe1900b90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:06.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.716+0000 7fe19673d640 1 --2- 172.21.15.90:0/1396580043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe19015e120 0x7fe1900b90d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c780 tx=0x7fe18800cc40 comp rx=0 tx=0).stop 2024-09-10T23:15:06.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.716+0000 7fe19673d640 1 -- 172.21.15.90:0/1396580043 shutdown_connections 2024-09-10T23:15:06.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.716+0000 7fe19673d640 1 --2- 172.21.15.90:0/1396580043 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe17c077f70 0x7fe17c07a430 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:06.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.716+0000 7fe19673d640 1 --2- 172.21.15.90:0/1396580043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe19015e120 0x7fe1900b90d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:06.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.716+0000 7fe19673d640 1 --2- 172.21.15.90:0/1396580043 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1900d4b50 0x7fe1901f8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:06.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.716+0000 7fe19673d640 1 --2- 172.21.15.90:0/1396580043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1900d0770 0x7fe1901f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:06.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.716+0000 7fe19673d640 1 -- 172.21.15.90:0/1396580043 >> 172.21.15.90:0/1396580043 conn(0x7fe1900d4030 msgr2=0x7fe1900d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:06.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.716+0000 7fe19673d640 1 -- 172.21.15.90:0/1396580043 shutdown_connections 2024-09-10T23:15:06.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.716+0000 7fe19673d640 1 -- 172.21.15.90:0/1396580043 wait complete. 2024-09-10T23:15:06.731 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:15:06.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.839+0000 7fcdbba60640 1 -- 172.21.15.90:0/852848095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcda0004d40 msgr2=0x7fcda00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:06.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.839+0000 7fcdbba60640 1 --2- 172.21.15.90:0/852848095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcda0004d40 0x7fcda00051c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00c2e0 tx=0x7fcda0005830 comp rx=0 tx=0).stop 2024-09-10T23:15:06.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.839+0000 7fcdb9ffd640 1 -- 172.21.15.90:0/852848095 reap_dead start 2024-09-10T23:15:06.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.839+0000 7fcdbba60640 1 -- 172.21.15.90:0/852848095 shutdown_connections 2024-09-10T23:15:06.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.839+0000 7fcdbba60640 1 -- 172.21.15.90:0/852848095 >> 172.21.15.90:0/852848095 conn(0x7fcdb40d0400 msgr2=0x7fcdb40d0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:06.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.839+0000 7fcdbba60640 1 -- 172.21.15.90:0/852848095 shutdown_connections 2024-09-10T23:15:06.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.839+0000 7fcdbba60640 1 -- 172.21.15.90:0/852848095 wait complete. 2024-09-10T23:15:06.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.840+0000 7fcdbba60640 1 Processor -- start 2024-09-10T23:15:06.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.840+0000 7fcdbba60640 1 -- start start 2024-09-10T23:15:06.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdbba60640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcda0004d40 0x7fcdb41edc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:06.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdbba60640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcdb41f15a0 0x7fcdb40cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:06.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdbba60640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcdb40ce360 0x7fcdb41f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:06.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdbba60640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb4074af0 con 0x7fcdb40ce360 2024-09-10T23:15:06.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdbba60640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb4074970 con 0x7fcdb41f15a0 2024-09-10T23:15:06.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdbba60640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb4074c70 con 0x7fcda0004d40 2024-09-10T23:15:06.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdb9ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcdb40ce360 0x7fcdb41f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:06.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdb9ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcdb40ce360 0x7fcdb41f3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55916/0 (socket says 172.21.15.90:55916) 2024-09-10T23:15:06.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdb9ffd640 1 -- 172.21.15.90:0/2302668061 learned_addr learned my addr 172.21.15.90:0/2302668061 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:06.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdb8ffb640 1 --2- 172.21.15.90:0/2302668061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcdb41f15a0 0x7fcdb40cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:06.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdb97fc640 1 --2- 172.21.15.90:0/2302668061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcda0004d40 0x7fcdb41edc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:06.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdb9ffd640 1 -- 172.21.15.90:0/2302668061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcda0004d40 msgr2=0x7fcdb41edc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:06.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdb9ffd640 1 --2- 172.21.15.90:0/2302668061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcda0004d40 0x7fcdb41edc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:06.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdb9ffd640 1 -- 172.21.15.90:0/2302668061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcdb41f15a0 msgr2=0x7fcdb40cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:06.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdb9ffd640 1 --2- 172.21.15.90:0/2302668061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcdb41f15a0 0x7fcdb40cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:06.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdb9ffd640 1 -- 172.21.15.90:0/2302668061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb41f4bb0 con 0x7fcdb40ce360 2024-09-10T23:15:06.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdb8ffb640 1 --2- 172.21.15.90:0/2302668061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcdb41f15a0 0x7fcdb40cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:06.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdb9ffd640 1 --2- 172.21.15.90:0/2302668061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcdb40ce360 0x7fcdb41f3ea0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00c3d0 tx=0x7fcdac02cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:06.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcda9ffb640 1 -- 172.21.15.90:0/2302668061 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac031050 con 0x7fcdb40ce360 2024-09-10T23:15:06.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcda9ffb640 1 -- 172.21.15.90:0/2302668061 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdac006420 con 0x7fcdb40ce360 2024-09-10T23:15:06.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcdbba60640 1 -- 172.21.15.90:0/2302668061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb41f0ac0 con 0x7fcdb40ce360 2024-09-10T23:15:06.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.841+0000 7fcda9ffb640 1 -- 172.21.15.90:0/2302668061 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac006c70 con 0x7fcdb40ce360 2024-09-10T23:15:06.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.842+0000 7fcdbba60640 1 -- 172.21.15.90:0/2302668061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb41f1080 con 0x7fcdb40ce360 2024-09-10T23:15:06.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.842+0000 7fcdbba60640 1 -- 172.21.15.90:0/2302668061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdb406a030 con 0x7fcdb40ce360 2024-09-10T23:15:06.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.843+0000 7fcda9ffb640 1 -- 172.21.15.90:0/2302668061 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcdac003610 con 0x7fcdb40ce360 2024-09-10T23:15:06.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.843+0000 7fcda9ffb640 1 --2- 172.21.15.90:0/2302668061 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcd98077f70 0x7fcd9807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:06.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.844+0000 7fcda9ffb640 1 -- 172.21.15.90:0/2302668061 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5357+0+0 (secure 0 0 0) 0x7fcdac0b9770 con 0x7fcdb40ce360 2024-09-10T23:15:06.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.844+0000 7fcdb97fc640 1 --2- 172.21.15.90:0/2302668061 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcd98077f70 0x7fcd9807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:06.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.844+0000 7fcdb97fc640 1 --2- 172.21.15.90:0/2302668061 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcd98077f70 0x7fcd9807a430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0005fd0 tx=0x7fcdb0009530 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:06.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:06.848+0000 7fcda9ffb640 1 -- 172.21.15.90:0/2302668061 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcdb406a030 con 0x7fcdb40ce360 2024-09-10T23:15:07.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.022+0000 7fcdbba60640 1 -- 172.21.15.90:0/2302668061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcdb41f08b0 con 0x7fcdb40ce360 2024-09-10T23:15:07.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.718+0000 7fcda9ffb640 1 -- 172.21.15.90:0/2302668061 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7fcdac045030 con 0x7fcdb40ce360 2024-09-10T23:15:07.721 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' removed 2024-09-10T23:15:07.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.721+0000 7fcdbba60640 1 -- 172.21.15.90:0/2302668061 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcd98077f70 msgr2=0x7fcd9807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:07.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.721+0000 7fcdbba60640 1 --2- 172.21.15.90:0/2302668061 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcd98077f70 0x7fcd9807a430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0005fd0 tx=0x7fcdb0009530 comp rx=0 tx=0).stop 2024-09-10T23:15:07.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.721+0000 7fcdbba60640 1 -- 172.21.15.90:0/2302668061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcdb40ce360 msgr2=0x7fcdb41f3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:07.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.721+0000 7fcdbba60640 1 --2- 172.21.15.90:0/2302668061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcdb40ce360 0x7fcdb41f3ea0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00c3d0 tx=0x7fcdac02cc40 comp rx=0 tx=0).stop 2024-09-10T23:15:07.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.722+0000 7fcdbba60640 1 -- 172.21.15.90:0/2302668061 shutdown_connections 2024-09-10T23:15:07.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.722+0000 7fcdbba60640 1 --2- 172.21.15.90:0/2302668061 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcd98077f70 0x7fcd9807a430 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:07.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.722+0000 7fcdbba60640 1 --2- 172.21.15.90:0/2302668061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcdb41f15a0 0x7fcdb40cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:07.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.722+0000 7fcdbba60640 1 --2- 172.21.15.90:0/2302668061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcdb40ce360 0x7fcdb41f3ea0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:07.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.722+0000 7fcdbba60640 1 --2- 172.21.15.90:0/2302668061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcda0004d40 0x7fcdb41edc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:07.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.722+0000 7fcdbba60640 1 -- 172.21.15.90:0/2302668061 >> 172.21.15.90:0/2302668061 conn(0x7fcdb40d0400 msgr2=0x7fcdb415ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:07.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.722+0000 7fcdbba60640 1 -- 172.21.15.90:0/2302668061 shutdown_connections 2024-09-10T23:15:07.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.722+0000 7fcdbba60640 1 -- 172.21.15.90:0/2302668061 wait complete. 2024-09-10T23:15:07.738 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:15:07.739 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:15:07.739 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:15:07.739 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:15:07.739 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:15:07.739 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:15:07.739 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:15:07.739 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:15:07.740 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:15:07.740 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:15:07.740 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:15:07.740 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:15:07.740 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:15:07.740 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:15:07.741 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:15:07.741 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:15:07.749 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:15:07.750 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:15:07.751 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:15:07.751 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:15:07.753 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:15:07.753 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:15:07.754 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:15:07.754 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:15:07.792 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:15:07.793 DEBUG:teuthology.parallel:result is None 2024-09-10T23:15:07.794 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:15:07.794 DEBUG:teuthology.parallel:result is None 2024-09-10T23:15:07.796 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:15:07.796 DEBUG:teuthology.parallel:result is None 2024-09-10T23:15:07.797 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:15:07.797 DEBUG:teuthology.parallel:result is None 2024-09-10T23:15:07.797 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:15:07.869 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-09-10T23:15:07.870 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-09-10T23:15:07.877 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-09-10T23:15:07.877 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-09-10T23:15:07.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.904+0000 7f4e4d54b640 1 -- 172.21.15.90:0/1269958210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e480b3a00 msgr2=0x7f4e480b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:07.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.904+0000 7f4e4d54b640 1 --2- 172.21.15.90:0/1269958210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e480b3a00 0x7f4e480b3eb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4e40005fd0 tx=0x7f4e4002aa90 comp rx=0 tx=0).stop 2024-09-10T23:15:07.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.904+0000 7f4e4d54b640 1 -- 172.21.15.90:0/1269958210 shutdown_connections 2024-09-10T23:15:07.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.904+0000 7f4e4d54b640 1 --2- 172.21.15.90:0/1269958210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e480b3a00 0x7f4e480b3eb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.904+0000 7f4e4d54b640 1 --2- 172.21.15.90:0/1269958210 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e480d1c70 0x7f4e480b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.904+0000 7f4e4d54b640 1 -- 172.21.15.90:0/1269958210 >> 172.21.15.90:0/1269958210 conn(0x7f4e4809d2a0 msgr2=0x7f4e480d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.904+0000 7f4e4d54b640 1 -- 172.21.15.90:0/1269958210 shutdown_connections 2024-09-10T23:15:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.904+0000 7f4e4d54b640 1 -- 172.21.15.90:0/1269958210 wait complete. 2024-09-10T23:15:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.905+0000 7f4e4d54b640 1 Processor -- start 2024-09-10T23:15:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.906+0000 7f4e4d54b640 1 -- start start 2024-09-10T23:15:07.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.906+0000 7f4e4d54b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e480b3a00 0x7f4e48150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:07.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.906+0000 7f4e4d54b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e480d1c70 0x7f4e480c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:07.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.906+0000 7f4e4d54b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e480d2470 0x7f4e480cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:07.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.906+0000 7f4e4d54b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4e480b4570 con 0x7f4e480d2470 2024-09-10T23:15:07.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.906+0000 7f4e4d54b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4e480b43f0 con 0x7f4e480b3a00 2024-09-10T23:15:07.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.906+0000 7f4e4d54b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4e480b46f0 con 0x7f4e480d1c70 2024-09-10T23:15:07.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.906+0000 7f4e477fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e480d2470 0x7f4e480cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:07.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.906+0000 7f4e477fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e480d2470 0x7f4e480cc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55970/0 (socket says 172.21.15.90:55970) 2024-09-10T23:15:07.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.906+0000 7f4e477fe640 1 -- 172.21.15.90:0/1997303727 learned_addr learned my addr 172.21.15.90:0/1997303727 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:07.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.906+0000 7f4e467fc640 1 --2- 172.21.15.90:0/1997303727 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e480d1c70 0x7f4e480c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:07.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.906+0000 7f4e46ffd640 1 --2- 172.21.15.90:0/1997303727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e480b3a00 0x7f4e48150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:07.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.907+0000 7f4e477fe640 1 -- 172.21.15.90:0/1997303727 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e480d1c70 msgr2=0x7f4e480c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:07.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.907+0000 7f4e477fe640 1 --2- 172.21.15.90:0/1997303727 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e480d1c70 0x7f4e480c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:07.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.907+0000 7f4e477fe640 1 -- 172.21.15.90:0/1997303727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e480b3a00 msgr2=0x7f4e48150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:07.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.907+0000 7f4e477fe640 1 --2- 172.21.15.90:0/1997303727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e480b3a00 0x7f4e48150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:07.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.907+0000 7f4e477fe640 1 -- 172.21.15.90:0/1997303727 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e480b7280 con 0x7f4e480d2470 2024-09-10T23:15:07.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.907+0000 7f4e477fe640 1 --2- 172.21.15.90:0/1997303727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e480d2470 0x7f4e480cc880 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009d90 tx=0x7f4e40003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:07.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.907+0000 7f4e2f7fe640 1 -- 172.21.15.90:0/1997303727 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40046070 con 0x7f4e480d2470 2024-09-10T23:15:07.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.907+0000 7f4e2f7fe640 1 -- 172.21.15.90:0/1997303727 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e40004040 con 0x7f4e480d2470 2024-09-10T23:15:07.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.907+0000 7f4e4d54b640 1 -- 172.21.15.90:0/1997303727 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e480b7560 con 0x7f4e480d2470 2024-09-10T23:15:07.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.907+0000 7f4e2f7fe640 1 -- 172.21.15.90:0/1997303727 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40004450 con 0x7f4e480d2470 2024-09-10T23:15:07.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.907+0000 7f4e4d54b640 1 -- 172.21.15.90:0/1997303727 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e480b7b20 con 0x7f4e480d2470 2024-09-10T23:15:07.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.908+0000 7f4e4d54b640 1 -- 172.21.15.90:0/1997303727 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e480ce3b0 con 0x7f4e480d2470 2024-09-10T23:15:07.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.909+0000 7f4e2f7fe640 1 -- 172.21.15.90:0/1997303727 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4e400045f0 con 0x7f4e480d2470 2024-09-10T23:15:07.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.909+0000 7f4e2f7fe640 1 --2- 172.21.15.90:0/1997303727 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e34077fa0 0x7f4e3407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:07.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.909+0000 7f4e2f7fe640 1 -- 172.21.15.90:0/1997303727 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7f4e400baa80 con 0x7f4e480d2470 2024-09-10T23:15:07.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.909+0000 7f4e46ffd640 1 --2- 172.21.15.90:0/1997303727 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e34077fa0 0x7f4e3407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:07.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.910+0000 7f4e46ffd640 1 --2- 172.21.15.90:0/1997303727 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e34077fa0 0x7f4e3407a460 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4e38001720 tx=0x7f4e38009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:07.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:07.913+0000 7f4e2f7fe640 1 -- 172.21.15.90:0/1997303727 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4e480ce3b0 con 0x7f4e480d2470 2024-09-10T23:15:08.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.101+0000 7f4e4d54b640 1 -- 172.21.15.90:0/1997303727 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f4e480b3eb0 con 0x7f4e480d2470 2024-09-10T23:15:08.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.733+0000 7f4e2f7fe640 1 -- 172.21.15.90:0/1997303727 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7f4e40032030 con 0x7f4e480d2470 2024-09-10T23:15:08.736 INFO:teuthology.orchestra.run.smithi090.stderr: removed all blocklist entries 2024-09-10T23:15:08.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.736+0000 7f4e4d54b640 1 -- 172.21.15.90:0/1997303727 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e34077fa0 msgr2=0x7f4e3407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:08.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.736+0000 7f4e4d54b640 1 --2- 172.21.15.90:0/1997303727 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e34077fa0 0x7f4e3407a460 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4e38001720 tx=0x7f4e38009040 comp rx=0 tx=0).stop 2024-09-10T23:15:08.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.736+0000 7f4e4d54b640 1 -- 172.21.15.90:0/1997303727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e480d2470 msgr2=0x7f4e480cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:08.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.736+0000 7f4e4d54b640 1 --2- 172.21.15.90:0/1997303727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e480d2470 0x7f4e480cc880 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009d90 tx=0x7f4e40003ba0 comp rx=0 tx=0).stop 2024-09-10T23:15:08.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.736+0000 7f4e4d54b640 1 -- 172.21.15.90:0/1997303727 shutdown_connections 2024-09-10T23:15:08.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.736+0000 7f4e4d54b640 1 --2- 172.21.15.90:0/1997303727 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e34077fa0 0x7f4e3407a460 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:08.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.736+0000 7f4e4d54b640 1 --2- 172.21.15.90:0/1997303727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e480d2470 0x7f4e480cc880 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:08.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.736+0000 7f4e4d54b640 1 --2- 172.21.15.90:0/1997303727 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e480d1c70 0x7f4e480c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:08.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.736+0000 7f4e4d54b640 1 --2- 172.21.15.90:0/1997303727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e480b3a00 0x7f4e48150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:08.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.736+0000 7f4e4d54b640 1 -- 172.21.15.90:0/1997303727 >> 172.21.15.90:0/1997303727 conn(0x7f4e4809d2a0 msgr2=0x7f4e480d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:08.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.736+0000 7f4e4d54b640 1 -- 172.21.15.90:0/1997303727 shutdown_connections 2024-09-10T23:15:08.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.736+0000 7f4e4d54b640 1 -- 172.21.15.90:0/1997303727 wait complete. 2024-09-10T23:15:08.751 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:15:08.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.852+0000 7f8a83ccd640 1 -- 172.21.15.90:0/2573158251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c0ca960 msgr2=0x7f8a7c0b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:08.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.852+0000 7f8a83ccd640 1 --2- 172.21.15.90:0/2573158251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c0ca960 0x7f8a7c0b1850 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c070620 tx=0x7f8a7002a510 comp rx=0 tx=0).stop 2024-09-10T23:15:08.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.852+0000 7f8a83ccd640 1 -- 172.21.15.90:0/2573158251 shutdown_connections 2024-09-10T23:15:08.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.852+0000 7f8a83ccd640 1 --2- 172.21.15.90:0/2573158251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c0ca960 0x7f8a7c0b1850 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:08.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.852+0000 7f8a83ccd640 1 --2- 172.21.15.90:0/2573158251 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a7c15aa30 0x7f8a7c0ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:08.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.852+0000 7f8a83ccd640 1 -- 172.21.15.90:0/2573158251 >> 172.21.15.90:0/2573158251 conn(0x7f8a7c0cc850 msgr2=0x7f8a7c0ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:08.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.852+0000 7f8a83ccd640 1 -- 172.21.15.90:0/2573158251 shutdown_connections 2024-09-10T23:15:08.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.852+0000 7f8a83ccd640 1 -- 172.21.15.90:0/2573158251 wait complete. 2024-09-10T23:15:08.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.853+0000 7f8a83ccd640 1 Processor -- start 2024-09-10T23:15:08.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.853+0000 7f8a83ccd640 1 -- start start 2024-09-10T23:15:08.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a83ccd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a7c15aa30 0x7f8a7c1f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:08.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a83ccd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a7c15ae10 0x7f8a7c1f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:08.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a83ccd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c1f2910 0x7f8a7c0c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:08.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a83ccd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c0b2120 con 0x7f8a7c1f2910 2024-09-10T23:15:08.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a83ccd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c0b1fa0 con 0x7f8a7c15aa30 2024-09-10T23:15:08.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a83ccd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7c06fcd0 con 0x7f8a7c15ae10 2024-09-10T23:15:08.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a8226a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c1f2910 0x7f8a7c0c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:08.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a8226a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c1f2910 0x7f8a7c0c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59366/0 (socket says 172.21.15.90:59366) 2024-09-10T23:15:08.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a8226a640 1 -- 172.21.15.90:0/2086459360 learned_addr learned my addr 172.21.15.90:0/2086459360 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:08.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a81268640 1 --2- 172.21.15.90:0/2086459360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a7c15ae10 0x7f8a7c1f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:08.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a81a69640 1 --2- 172.21.15.90:0/2086459360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a7c15aa30 0x7f8a7c1f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:08.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a8226a640 1 -- 172.21.15.90:0/2086459360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a7c15ae10 msgr2=0x7f8a7c1f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:08.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a8226a640 1 --2- 172.21.15.90:0/2086459360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a7c15ae10 0x7f8a7c1f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:08.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a8226a640 1 -- 172.21.15.90:0/2086459360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a7c15aa30 msgr2=0x7f8a7c1f63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:08.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a8226a640 1 --2- 172.21.15.90:0/2086459360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a7c15aa30 0x7f8a7c1f63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:08.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a8226a640 1 -- 172.21.15.90:0/2086459360 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c1f2e20 con 0x7f8a7c1f2910 2024-09-10T23:15:08.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a81268640 1 --2- 172.21.15.90:0/2086459360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a7c15ae10 0x7f8a7c1f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:08.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.854+0000 7f8a81a69640 1 --2- 172.21.15.90:0/2086459360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a7c15aa30 0x7f8a7c1f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:08.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.855+0000 7f8a8226a640 1 --2- 172.21.15.90:0/2086459360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c1f2910 0x7f8a7c0c5f20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400c410 tx=0x7f8a7400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:08.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.855+0000 7f8a7a7fc640 1 -- 172.21.15.90:0/2086459360 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74011790 con 0x7f8a7c1f2910 2024-09-10T23:15:08.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.855+0000 7f8a7a7fc640 1 -- 172.21.15.90:0/2086459360 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a74017070 con 0x7f8a7c1f2910 2024-09-10T23:15:08.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.855+0000 7f8a83ccd640 1 -- 172.21.15.90:0/2086459360 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7c1f3100 con 0x7f8a7c1f2910 2024-09-10T23:15:08.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.855+0000 7f8a7a7fc640 1 -- 172.21.15.90:0/2086459360 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74011cc0 con 0x7f8a7c1f2910 2024-09-10T23:15:08.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.855+0000 7f8a83ccd640 1 -- 172.21.15.90:0/2086459360 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a7c0c5a00 con 0x7f8a7c1f2910 2024-09-10T23:15:08.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.856+0000 7f8a83ccd640 1 -- 172.21.15.90:0/2086459360 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a7c0c5540 con 0x7f8a7c1f2910 2024-09-10T23:15:08.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.856+0000 7f8a7a7fc640 1 -- 172.21.15.90:0/2086459360 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8a7401c460 con 0x7f8a7c1f2910 2024-09-10T23:15:08.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.857+0000 7f8a7a7fc640 1 --2- 172.21.15.90:0/2086459360 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8a68077f70 0x7f8a6807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:08.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.857+0000 7f8a7a7fc640 1 -- 172.21.15.90:0/2086459360 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f8a74099550 con 0x7f8a7c1f2910 2024-09-10T23:15:08.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.858+0000 7f8a81a69640 1 --2- 172.21.15.90:0/2086459360 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8a68077f70 0x7f8a6807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:08.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.858+0000 7f8a81a69640 1 --2- 172.21.15.90:0/2086459360 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8a68077f70 0x7f8a6807a430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0c51c0 tx=0x7f8a6c009400 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:08.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:08.861+0000 7f8a7a7fc640 1 -- 172.21.15.90:0/2086459360 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8a7c0c5540 con 0x7f8a7c1f2910 2024-09-10T23:15:09.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.100+0000 7f8a83ccd640 1 -- 172.21.15.90:0/2086459360 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8a7c070250 con 0x7f8a7c1f2910 2024-09-10T23:15:09.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.101+0000 7f8a7a7fc640 1 -- 172.21.15.90:0/2086459360 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+6645 (secure 0 0 0) 0x7f8a74021020 con 0x7f8a7c1f2910 2024-09-10T23:15:09.103 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:09.103 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:15:09.103 INFO:teuthology.orchestra.run.smithi090.stdout: "auth_dump": [ 2024-09-10T23:15:09.103 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.103 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.a", 2024-09-10T23:15:09.103 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBm/QY6KxAAKT1mZg/6ZcszcNrPmouZfw==", 2024-09-10T23:15:09.104 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.104 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:15:09.104 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:15:09.104 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:15:09.104 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:09.104 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.104 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.105 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.105 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.b", 2024-09-10T23:15:09.105 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmSqPhNhAA3flpsOGFszFMeaPUoHAtJg==", 2024-09-10T23:15:09.105 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.105 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:15:09.106 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:15:09.106 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:15:09.106 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:09.106 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.106 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.106 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.107 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.c", 2024-09-10T23:15:09.107 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmDVE4MhAAHal/PtI10hL4nKdTUO5BiQ==", 2024-09-10T23:15:09.107 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.107 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:15:09.107 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:15:09.107 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:15:09.107 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:09.107 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.107 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.107 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.107 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.d", 2024-09-10T23:15:09.107 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmr3lfAhAAFdZ7zvJmGNFHRwCr+mdY7w==", 2024-09-10T23:15:09.107 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.107 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:15:09.108 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:15:09.108 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:15:09.108 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:09.108 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.108 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.108 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.108 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.0", 2024-09-10T23:15:09.108 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCa0uBmZKxTJRAAfEBB/vykopmDbmREyy227g==", 2024-09-10T23:15:09.108 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.108 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:15:09.109 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:15:09.109 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:09.109 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.109 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.109 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.109 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.1", 2024-09-10T23:15:09.109 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCd0uBmJHG8NRAAS8QD8Zgrxrxddq7kN4P9Ag==", 2024-09-10T23:15:09.109 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.109 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:15:09.109 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:15:09.109 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:09.109 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.109 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.109 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.110 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.2", 2024-09-10T23:15:09.110 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCh0uBmtUUmDBAAmYRv9P/wjX8HLVkLatoXuQ==", 2024-09-10T23:15:09.110 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.110 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:15:09.110 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:15:09.110 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:09.110 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.110 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.110 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.110 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.3", 2024-09-10T23:15:09.110 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCk0uBm4397HBAAGZK0ktD0ORY/0CPlMprYFg==", 2024-09-10T23:15:09.110 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.110 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:15:09.110 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:15:09.111 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:09.111 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.111 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.111 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.111 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.4", 2024-09-10T23:15:09.111 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCq0uBmBaMINBAAkuhNrc4YFAYQfcxMQenCBQ==", 2024-09-10T23:15:09.111 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.111 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:15:09.111 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:15:09.111 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:09.111 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.111 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.111 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.112 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.5", 2024-09-10T23:15:09.112 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCu0uBmLOrnCBAAwZTy+62ZN3g5jfH20jB4qw==", 2024-09-10T23:15:09.112 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.112 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:15:09.112 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:15:09.112 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:09.112 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.112 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.112 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.112 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.6", 2024-09-10T23:15:09.112 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCx0uBmr4bYChAAdWog9uHnYgiiXniefs25DA==", 2024-09-10T23:15:09.112 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.112 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:15:09.112 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:15:09.113 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:09.113 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.113 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.113 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.113 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.7", 2024-09-10T23:15:09.113 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQC00uBmhU7+DBAAEagAuXuCs1v/vDhIkapi+g==", 2024-09-10T23:15:09.113 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.113 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:15:09.113 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:15:09.113 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:09.113 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.113 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.113 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.113 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.0", 2024-09-10T23:15:09.114 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmiYBwBhAABMV9erpQ+KZlTmf0kDZ0gw==", 2024-09-10T23:15:09.114 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.114 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:15:09.114 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:15:09.114 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:15:09.114 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:15:09.114 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.114 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.114 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.114 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.1", 2024-09-10T23:15:09.114 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBm+TBDDxAA4o+iZ4PwpBRpY++ATzt+wg==", 2024-09-10T23:15:09.114 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.114 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:15:09.114 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:15:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:15:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:15:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.2", 2024-09-10T23:15:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmJYcKDBAArXISnuT+R9uzuQnL3V+wSg==", 2024-09-10T23:15:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:15:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:15:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:15:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:15:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.3", 2024-09-10T23:15:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmPQvkFBAAaCikPByOvk5xUzTWXdcFPA==", 2024-09-10T23:15:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:15:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:15:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:15:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:15:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.117 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.117 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.117 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.admin", 2024-09-10T23:15:09.117 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmVVIQEBAAY7yzFxxQCyV1YCM3xYC7Og==", 2024-09-10T23:15:09.117 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.117 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:15:09.117 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:15:09.117 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:15:09.117 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:09.117 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.117 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.117 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.117 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-mds", 2024-09-10T23:15:09.117 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDE0uBmWPKgBhAAT8/kCPlf0ObSWqFZUI/hAA==", 2024-09-10T23:15:09.118 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.118 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-mds" 2024-09-10T23:15:09.118 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.118 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.118 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.118 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-mgr", 2024-09-10T23:15:09.118 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDE0uBm6v2gBhAATZWdpv3L7Qs6aj8efwpgWA==", 2024-09-10T23:15:09.118 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.118 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-10T23:15:09.118 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.118 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.118 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.118 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-osd", 2024-09-10T23:15:09.118 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDE0uBmaC2hBhAA/LcSWJTkQwOFa7tmdgbbmQ==", 2024-09-10T23:15:09.118 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.119 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-osd" 2024-09-10T23:15:09.119 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.119 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.119 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.119 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-rbd", 2024-09-10T23:15:09.119 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDE0uBmAzWhBhAAgCrjUWcHXWbWVqQduVH4/A==", 2024-09-10T23:15:09.119 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.119 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-10T23:15:09.119 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.120 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.120 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.120 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-10T23:15:09.120 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDE0uBmLTyhBhAAzfEIhyoKuFhg6wrkVcV5zQ==", 2024-09-10T23:15:09.120 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.120 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-10T23:15:09.120 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.120 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.120 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.120 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-rgw", 2024-09-10T23:15:09.120 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDE0uBmEUShBhAA+P7nuajSoHASQfuZM+cPnw==", 2024-09-10T23:15:09.120 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.121 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-10T23:15:09.121 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.121 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.121 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.121 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.x", 2024-09-10T23:15:09.121 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBm4r0EKBAAIZ4VjoTsUpdB6KFbi7EQLQ==", 2024-09-10T23:15:09.121 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.121 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:15:09.121 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2024-09-10T23:15:09.121 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:09.121 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.121 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:09.121 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:09.121 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.y", 2024-09-10T23:15:09.122 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmkRSfJBAAWPpV5e4zeX0Es78Xqh9pYw==", 2024-09-10T23:15:09.122 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:09.122 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:15:09.122 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2024-09-10T23:15:09.122 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:09.122 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.122 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:09.122 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-10T23:15:09.123 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:15:09.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.103+0000 7f8a83ccd640 1 -- 172.21.15.90:0/2086459360 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8a68077f70 msgr2=0x7f8a6807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:09.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.103+0000 7f8a83ccd640 1 --2- 172.21.15.90:0/2086459360 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8a68077f70 0x7f8a6807a430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0c51c0 tx=0x7f8a6c009400 comp rx=0 tx=0).stop 2024-09-10T23:15:09.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.103+0000 7f8a83ccd640 1 -- 172.21.15.90:0/2086459360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c1f2910 msgr2=0x7f8a7c0c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:09.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.103+0000 7f8a83ccd640 1 --2- 172.21.15.90:0/2086459360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c1f2910 0x7f8a7c0c5f20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400c410 tx=0x7f8a7400c8d0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.103+0000 7f8a83ccd640 1 -- 172.21.15.90:0/2086459360 shutdown_connections 2024-09-10T23:15:09.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.103+0000 7f8a83ccd640 1 --2- 172.21.15.90:0/2086459360 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8a68077f70 0x7f8a6807a430 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.103+0000 7f8a83ccd640 1 --2- 172.21.15.90:0/2086459360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c1f2910 0x7f8a7c0c5f20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.103+0000 7f8a83ccd640 1 --2- 172.21.15.90:0/2086459360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a7c15ae10 0x7f8a7c1f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.103+0000 7f8a83ccd640 1 --2- 172.21.15.90:0/2086459360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a7c15aa30 0x7f8a7c1f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.103+0000 7f8a83ccd640 1 -- 172.21.15.90:0/2086459360 >> 172.21.15.90:0/2086459360 conn(0x7f8a7c0cc850 msgr2=0x7f8a7c0ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:09.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.103+0000 7f8a83ccd640 1 -- 172.21.15.90:0/2086459360 shutdown_connections 2024-09-10T23:15:09.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.103+0000 7f8a83ccd640 1 -- 172.21.15.90:0/2086459360 wait complete. 2024-09-10T23:15:09.125 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-10T23:15:09.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.225+0000 7faac1b91640 1 -- 172.21.15.90:0/1867024501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faabc15e290 msgr2=0x7faabc06f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:09.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.225+0000 7faac1b91640 1 --2- 172.21.15.90:0/1867024501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faabc15e290 0x7faabc06f7c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faaac005fd0 tx=0x7faaac02a820 comp rx=0 tx=0).stop 2024-09-10T23:15:09.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.225+0000 7faac1b91640 1 -- 172.21.15.90:0/1867024501 shutdown_connections 2024-09-10T23:15:09.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.225+0000 7faac1b91640 1 --2- 172.21.15.90:0/1867024501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faabc074210 0x7faabc0cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.225+0000 7faac1b91640 1 --2- 172.21.15.90:0/1867024501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faabc15e290 0x7faabc06f7c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.225+0000 7faac1b91640 1 -- 172.21.15.90:0/1867024501 >> 172.21.15.90:0/1867024501 conn(0x7faabc0cca50 msgr2=0x7faabc0cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:09.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.225+0000 7faac1b91640 1 -- 172.21.15.90:0/1867024501 shutdown_connections 2024-09-10T23:15:09.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.225+0000 7faac1b91640 1 -- 172.21.15.90:0/1867024501 wait complete. 2024-09-10T23:15:09.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.226+0000 7faac1b91640 1 Processor -- start 2024-09-10T23:15:09.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.226+0000 7faac1b91640 1 -- start start 2024-09-10T23:15:09.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.227+0000 7faac1b91640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc074210 0x7faabc1f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:09.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.227+0000 7faac1b91640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faabc0cb730 0x7faabc1f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:09.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.227+0000 7faac1b91640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faabc1595c0 0x7faabc15cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:09.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.227+0000 7faac1b91640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faabc0cf670 con 0x7faabc0cb730 2024-09-10T23:15:09.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.227+0000 7faac1b91640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faabc0cf4f0 con 0x7faabc074210 2024-09-10T23:15:09.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.227+0000 7faac1b91640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faabc0cf7f0 con 0x7faabc1595c0 2024-09-10T23:15:09.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.227+0000 7faabaffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faabc0cb730 0x7faabc1f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:09.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.227+0000 7faabaffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faabc0cb730 0x7faabc1f6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59394/0 (socket says 172.21.15.90:59394) 2024-09-10T23:15:09.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.227+0000 7faabaffd640 1 -- 172.21.15.90:0/146185470 learned_addr learned my addr 172.21.15.90:0/146185470 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:09.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.227+0000 7faabbfff640 1 --2- 172.21.15.90:0/146185470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faabc1595c0 0x7faabc15cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:09.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.227+0000 7faabb7fe640 1 --2- 172.21.15.90:0/146185470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc074210 0x7faabc1f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:09.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.228+0000 7faabaffd640 1 -- 172.21.15.90:0/146185470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faabc1595c0 msgr2=0x7faabc15cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:09.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.228+0000 7faabaffd640 1 --2- 172.21.15.90:0/146185470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faabc1595c0 0x7faabc15cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.228+0000 7faabaffd640 1 -- 172.21.15.90:0/146185470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc074210 msgr2=0x7faabc1f30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:09.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.228+0000 7faabaffd640 1 --2- 172.21.15.90:0/146185470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc074210 0x7faabc1f30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.228+0000 7faabaffd640 1 -- 172.21.15.90:0/146185470 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faabc159a50 con 0x7faabc0cb730 2024-09-10T23:15:09.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.228+0000 7faabb7fe640 1 --2- 172.21.15.90:0/146185470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc074210 0x7faabc1f30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:09.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.228+0000 7faabaffd640 1 --2- 172.21.15.90:0/146185470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faabc0cb730 0x7faabc1f6560 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faab000c480 tx=0x7faab000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:09.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.228+0000 7faaa3fff640 1 -- 172.21.15.90:0/146185470 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0016020 con 0x7faabc0cb730 2024-09-10T23:15:09.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.228+0000 7faaa3fff640 1 -- 172.21.15.90:0/146185470 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faab0012940 con 0x7faabc0cb730 2024-09-10T23:15:09.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.228+0000 7faac1b91640 1 -- 172.21.15.90:0/146185470 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faabc15d290 con 0x7faabc0cb730 2024-09-10T23:15:09.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.228+0000 7faaa3fff640 1 -- 172.21.15.90:0/146185470 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0012d90 con 0x7faabc0cb730 2024-09-10T23:15:09.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.228+0000 7faac1b91640 1 -- 172.21.15.90:0/146185470 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faabc1f28b0 con 0x7faabc0cb730 2024-09-10T23:15:09.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.229+0000 7faac1b91640 1 -- 172.21.15.90:0/146185470 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faabc0cfd80 con 0x7faabc0cb730 2024-09-10T23:15:09.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.230+0000 7faaa3fff640 1 -- 172.21.15.90:0/146185470 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7faab001a3b0 con 0x7faabc0cb730 2024-09-10T23:15:09.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.230+0000 7faaa3fff640 1 --2- 172.21.15.90:0/146185470 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faaa8077f70 0x7faaa807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:09.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.230+0000 7faaa3fff640 1 -- 172.21.15.90:0/146185470 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7faab0099a10 con 0x7faabc0cb730 2024-09-10T23:15:09.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.230+0000 7faabb7fe640 1 --2- 172.21.15.90:0/146185470 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faaa8077f70 0x7faaa807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:09.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.231+0000 7faabb7fe640 1 --2- 172.21.15.90:0/146185470 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faaa8077f70 0x7faaa807a430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faaac034000 tx=0x7faaac004ab0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:09.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.234+0000 7faaa3fff640 1 -- 172.21.15.90:0/146185470 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7faab0020030 con 0x7faabc0cb730 2024-09-10T23:15:09.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.476+0000 7faac1b91640 1 -- 172.21.15.90:0/146185470 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7faabc0b5f50 con 0x7faabc0cb730 2024-09-10T23:15:09.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.478+0000 7faaa3fff640 1 -- 172.21.15.90:0/146185470 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v19) ==== 90+0+0 (secure 0 0 0) 0x7faab00629b0 con 0x7faabc0cb730 2024-09-10T23:15:09.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.480+0000 7faac1b91640 1 -- 172.21.15.90:0/146185470 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faaa8077f70 msgr2=0x7faaa807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:09.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.480+0000 7faac1b91640 1 --2- 172.21.15.90:0/146185470 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faaa8077f70 0x7faaa807a430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faaac034000 tx=0x7faaac004ab0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.480+0000 7faac1b91640 1 -- 172.21.15.90:0/146185470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faabc0cb730 msgr2=0x7faabc1f6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:09.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.480+0000 7faac1b91640 1 --2- 172.21.15.90:0/146185470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faabc0cb730 0x7faabc1f6560 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faab000c480 tx=0x7faab000c940 comp rx=0 tx=0).stop 2024-09-10T23:15:09.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.480+0000 7faac1b91640 1 -- 172.21.15.90:0/146185470 shutdown_connections 2024-09-10T23:15:09.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.480+0000 7faac1b91640 1 --2- 172.21.15.90:0/146185470 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faaa8077f70 0x7faaa807a430 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.480+0000 7faac1b91640 1 --2- 172.21.15.90:0/146185470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faabc1595c0 0x7faabc15cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.480+0000 7faac1b91640 1 --2- 172.21.15.90:0/146185470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faabc0cb730 0x7faabc1f6560 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.480+0000 7faac1b91640 1 --2- 172.21.15.90:0/146185470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc074210 0x7faabc1f30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.480+0000 7faac1b91640 1 -- 172.21.15.90:0/146185470 >> 172.21.15.90:0/146185470 conn(0x7faabc0cca50 msgr2=0x7faabc0afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:09.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.480+0000 7faac1b91640 1 -- 172.21.15.90:0/146185470 shutdown_connections 2024-09-10T23:15:09.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.481+0000 7faac1b91640 1 -- 172.21.15.90:0/146185470 wait complete. 2024-09-10T23:15:09.493 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-10T23:15:09.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.592+0000 7f1cef191640 1 -- 172.21.15.90:0/3913216253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce815e260 msgr2=0x7f1ce80b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:09.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.592+0000 7f1cef191640 1 --2- 172.21.15.90:0/3913216253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce815e260 0x7f1ce80b0400 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4009830 tx=0x7f1ce402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.592+0000 7f1cef191640 1 -- 172.21.15.90:0/3913216253 shutdown_connections 2024-09-10T23:15:09.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.592+0000 7f1cef191640 1 --2- 172.21.15.90:0/3913216253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ce80b0940 0x7f1ce80cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.592+0000 7f1cef191640 1 --2- 172.21.15.90:0/3913216253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce815e260 0x7f1ce80b0400 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.592+0000 7f1cef191640 1 -- 172.21.15.90:0/3913216253 >> 172.21.15.90:0/3913216253 conn(0x7f1ce80d0490 msgr2=0x7f1ce80d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:09.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.592+0000 7f1cef191640 1 -- 172.21.15.90:0/3913216253 shutdown_connections 2024-09-10T23:15:09.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.592+0000 7f1cef191640 1 -- 172.21.15.90:0/3913216253 wait complete. 2024-09-10T23:15:09.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.594+0000 7f1cef191640 1 Processor -- start 2024-09-10T23:15:09.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.594+0000 7f1cef191640 1 -- start start 2024-09-10T23:15:09.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.594+0000 7f1cef191640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ce80b0940 0x7f1ce80b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:09.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.594+0000 7f1cef191640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ce80d1190 0x7f1ce81f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:09.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1cef191640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce815e260 0x7f1ce815c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:09.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1cef191640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce80af6f0 con 0x7f1ce815e260 2024-09-10T23:15:09.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1cef191640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce815e850 con 0x7f1ce80b0940 2024-09-10T23:15:09.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1cef191640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce80cf070 con 0x7f1ce80d1190 2024-09-10T23:15:09.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1ced72e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce815e260 0x7f1ce815c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:09.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1ced72e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce815e260 0x7f1ce815c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59414/0 (socket says 172.21.15.90:59414) 2024-09-10T23:15:09.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1ced72e640 1 -- 172.21.15.90:0/811036727 learned_addr learned my addr 172.21.15.90:0/811036727 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:09.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1cdffff640 1 --2- 172.21.15.90:0/811036727 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ce80d1190 0x7f1ce81f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:09.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1cecf2d640 1 --2- 172.21.15.90:0/811036727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ce80b0940 0x7f1ce80b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:09.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1ced72e640 1 -- 172.21.15.90:0/811036727 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ce80d1190 msgr2=0x7f1ce81f2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:09.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1ced72e640 1 --2- 172.21.15.90:0/811036727 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ce80d1190 0x7f1ce81f2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1ced72e640 1 -- 172.21.15.90:0/811036727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ce80b0940 msgr2=0x7f1ce80b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:09.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1ced72e640 1 --2- 172.21.15.90:0/811036727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ce80b0940 0x7f1ce80b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1ced72e640 1 -- 172.21.15.90:0/811036727 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce80b4210 con 0x7f1ce815e260 2024-09-10T23:15:09.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1cdffff640 1 --2- 172.21.15.90:0/811036727 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ce80d1190 0x7f1ce81f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:09.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1ced72e640 1 --2- 172.21.15.90:0/811036727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce815e260 0x7f1ce815c800 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000cab0 tx=0x7f1ce000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:09.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1cdd7fa640 1 -- 172.21.15.90:0/811036727 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000ae20 con 0x7f1ce815e260 2024-09-10T23:15:09.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1cdd7fa640 1 -- 172.21.15.90:0/811036727 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ce0003990 con 0x7f1ce815e260 2024-09-10T23:15:09.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1cef191640 1 -- 172.21.15.90:0/811036727 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce80b5e30 con 0x7f1ce815e260 2024-09-10T23:15:09.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1cdd7fa640 1 -- 172.21.15.90:0/811036727 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0003d80 con 0x7f1ce815e260 2024-09-10T23:15:09.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.595+0000 7f1cef191640 1 -- 172.21.15.90:0/811036727 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce80b5870 con 0x7f1ce815e260 2024-09-10T23:15:09.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.596+0000 7f1cef191640 1 -- 172.21.15.90:0/811036727 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce80728d0 con 0x7f1ce815e260 2024-09-10T23:15:09.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.597+0000 7f1cdd7fa640 1 -- 172.21.15.90:0/811036727 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1ce0003f40 con 0x7f1ce815e260 2024-09-10T23:15:09.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.597+0000 7f1cdd7fa640 1 --2- 172.21.15.90:0/811036727 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1cd4077fa0 0x7f1cd407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:09.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.597+0000 7f1cdd7fa640 1 -- 172.21.15.90:0/811036727 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f1ce009a1a0 con 0x7f1ce815e260 2024-09-10T23:15:09.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.598+0000 7f1cecf2d640 1 --2- 172.21.15.90:0/811036727 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1cd4077fa0 0x7f1cd407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:09.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.598+0000 7f1cecf2d640 1 --2- 172.21.15.90:0/811036727 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1cd4077fa0 0x7f1cd407a460 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4034000 tx=0x7f1ce4004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:09.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.602+0000 7f1cdd7fa640 1 -- 172.21.15.90:0/811036727 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1ce80728d0 con 0x7f1ce815e260 2024-09-10T23:15:09.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.846+0000 7f1cef191640 1 -- 172.21.15.90:0/811036727 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f1ce8159210 con 0x7f1ce815e260 2024-09-10T23:15:09.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.849+0000 7f1cdd7fa640 1 -- 172.21.15.90:0/811036727 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v20) ==== 90+0+0 (secure 0 0 0) 0x7f1ce0014030 con 0x7f1ce815e260 2024-09-10T23:15:09.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.852+0000 7f1cef191640 1 -- 172.21.15.90:0/811036727 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1cd4077fa0 msgr2=0x7f1cd407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:09.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.852+0000 7f1cef191640 1 --2- 172.21.15.90:0/811036727 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1cd4077fa0 0x7f1cd407a460 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4034000 tx=0x7f1ce4004730 comp rx=0 tx=0).stop 2024-09-10T23:15:09.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.852+0000 7f1cef191640 1 -- 172.21.15.90:0/811036727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce815e260 msgr2=0x7f1ce815c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:09.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.852+0000 7f1cef191640 1 --2- 172.21.15.90:0/811036727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce815e260 0x7f1ce815c800 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000cab0 tx=0x7f1ce000cf70 comp rx=0 tx=0).stop 2024-09-10T23:15:09.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.852+0000 7f1cef191640 1 -- 172.21.15.90:0/811036727 shutdown_connections 2024-09-10T23:15:09.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.852+0000 7f1cef191640 1 --2- 172.21.15.90:0/811036727 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1cd4077fa0 0x7f1cd407a460 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.852+0000 7f1cef191640 1 --2- 172.21.15.90:0/811036727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce815e260 0x7f1ce815c800 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.852+0000 7f1cef191640 1 --2- 172.21.15.90:0/811036727 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ce80d1190 0x7f1ce81f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.852+0000 7f1cef191640 1 --2- 172.21.15.90:0/811036727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ce80b0940 0x7f1ce80b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.852+0000 7f1cef191640 1 -- 172.21.15.90:0/811036727 >> 172.21.15.90:0/811036727 conn(0x7f1ce80d0490 msgr2=0x7f1ce8070320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:09.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.852+0000 7f1cef191640 1 -- 172.21.15.90:0/811036727 shutdown_connections 2024-09-10T23:15:09.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.852+0000 7f1cef191640 1 -- 172.21.15.90:0/811036727 wait complete. 2024-09-10T23:15:09.864 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-10T23:15:09.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.964+0000 7f20e90d4640 1 -- 172.21.15.90:0/690407282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20e40b3a00 msgr2=0x7f20e40b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:09.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.964+0000 7f20e90d4640 1 --2- 172.21.15.90:0/690407282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20e40b3a00 0x7f20e40b3eb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f20dc005fd0 tx=0x7f20dc02a530 comp rx=0 tx=0).stop 2024-09-10T23:15:09.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.964+0000 7f20e90d4640 1 -- 172.21.15.90:0/690407282 shutdown_connections 2024-09-10T23:15:09.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.964+0000 7f20e90d4640 1 --2- 172.21.15.90:0/690407282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20e40b3a00 0x7f20e40b3eb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.964+0000 7f20e90d4640 1 --2- 172.21.15.90:0/690407282 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20e40d2470 0x7f20e40b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.964+0000 7f20e90d4640 1 -- 172.21.15.90:0/690407282 >> 172.21.15.90:0/690407282 conn(0x7f20e409d2a0 msgr2=0x7f20e40d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:09.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.964+0000 7f20e90d4640 1 -- 172.21.15.90:0/690407282 shutdown_connections 2024-09-10T23:15:09.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.964+0000 7f20e90d4640 1 -- 172.21.15.90:0/690407282 wait complete. 2024-09-10T23:15:09.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.965+0000 7f20e90d4640 1 Processor -- start 2024-09-10T23:15:09.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.966+0000 7f20e90d4640 1 -- start start 2024-09-10T23:15:09.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.966+0000 7f20e90d4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20e40b3a00 0x7f20e41f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:09.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.966+0000 7f20e90d4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20e40d1c70 0x7f20e415fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:09.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.966+0000 7f20e90d4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20e40d2470 0x7f20e40b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:09.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.966+0000 7f20e90d4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f20e40b4570 con 0x7f20e40d2470 2024-09-10T23:15:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.966+0000 7f20e90d4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f20e40b43f0 con 0x7f20e40d1c70 2024-09-10T23:15:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.966+0000 7f20e90d4640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f20e40b46f0 con 0x7f20e40b3a00 2024-09-10T23:15:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.966+0000 7f20e359e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20e40d2470 0x7f20e40b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.966+0000 7f20e359e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20e40d2470 0x7f20e40b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59428/0 (socket says 172.21.15.90:59428) 2024-09-10T23:15:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.966+0000 7f20e359e640 1 -- 172.21.15.90:0/537292944 learned_addr learned my addr 172.21.15.90:0/537292944 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.967+0000 7f20e259c640 1 --2- 172.21.15.90:0/537292944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20e40d1c70 0x7f20e415fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.967+0000 7f20e2d9d640 1 --2- 172.21.15.90:0/537292944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20e40b3a00 0x7f20e41f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.967+0000 7f20e359e640 1 -- 172.21.15.90:0/537292944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20e40b3a00 msgr2=0x7f20e41f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.967+0000 7f20e359e640 1 --2- 172.21.15.90:0/537292944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20e40b3a00 0x7f20e41f5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.967+0000 7f20e359e640 1 -- 172.21.15.90:0/537292944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20e40d1c70 msgr2=0x7f20e415fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.967+0000 7f20e359e640 1 --2- 172.21.15.90:0/537292944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20e40d1c70 0x7f20e415fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.967+0000 7f20e359e640 1 -- 172.21.15.90:0/537292944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e415e530 con 0x7f20e40d2470 2024-09-10T23:15:09.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.967+0000 7f20e259c640 1 --2- 172.21.15.90:0/537292944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20e40d1c70 0x7f20e415fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:09.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.967+0000 7f20e2d9d640 1 --2- 172.21.15.90:0/537292944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20e40b3a00 0x7f20e41f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:09.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.967+0000 7f20e359e640 1 --2- 172.21.15.90:0/537292944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20e40d2470 0x7f20e40b26f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f20dc006010 tx=0x7f20dc003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:09.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.967+0000 7f20cb7fe640 1 -- 172.21.15.90:0/537292944 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20dc03f070 con 0x7f20e40d2470 2024-09-10T23:15:09.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.967+0000 7f20cb7fe640 1 -- 172.21.15.90:0/537292944 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20dc004890 con 0x7f20e40d2470 2024-09-10T23:15:09.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.967+0000 7f20e90d4640 1 -- 172.21.15.90:0/537292944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e415e810 con 0x7f20e40d2470 2024-09-10T23:15:09.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.967+0000 7f20cb7fe640 1 -- 172.21.15.90:0/537292944 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20dc035030 con 0x7f20e40d2470 2024-09-10T23:15:09.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.967+0000 7f20e90d4640 1 -- 172.21.15.90:0/537292944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e415edd0 con 0x7f20e40d2470 2024-09-10T23:15:09.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.968+0000 7f20e90d4640 1 -- 172.21.15.90:0/537292944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20e40b3eb0 con 0x7f20e40d2470 2024-09-10T23:15:09.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.969+0000 7f20cb7fe640 1 -- 172.21.15.90:0/537292944 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f20dc004ce0 con 0x7f20e40d2470 2024-09-10T23:15:09.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.969+0000 7f20cb7fe640 1 --2- 172.21.15.90:0/537292944 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f20d0077f70 0x7f20d007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:09.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.970+0000 7f20cb7fe640 1 -- 172.21.15.90:0/537292944 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f20dc0bac00 con 0x7f20e40d2470 2024-09-10T23:15:09.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.970+0000 7f20e2d9d640 1 --2- 172.21.15.90:0/537292944 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f20d0077f70 0x7f20d007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:09.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.970+0000 7f20e2d9d640 1 --2- 172.21.15.90:0/537292944 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f20d0077f70 0x7f20d007a430 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f20d4009fa0 tx=0x7f20d4009570 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:09.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:09.974+0000 7f20cb7fe640 1 -- 172.21.15.90:0/537292944 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f20dc0c1080 con 0x7f20e40d2470 2024-09-10T23:15:10.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.221+0000 7f20e90d4640 1 -- 172.21.15.90:0/537292944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f20e41613f0 con 0x7f20e40d2470 2024-09-10T23:15:10.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.225+0000 7f20cb7fe640 1 -- 172.21.15.90:0/537292944 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v21) ==== 90+0+0 (secure 0 0 0) 0x7f20e40cff60 con 0x7f20e40d2470 2024-09-10T23:15:10.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.227+0000 7f20e90d4640 1 -- 172.21.15.90:0/537292944 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f20d0077f70 msgr2=0x7f20d007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:10.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.227+0000 7f20e90d4640 1 --2- 172.21.15.90:0/537292944 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f20d0077f70 0x7f20d007a430 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f20d4009fa0 tx=0x7f20d4009570 comp rx=0 tx=0).stop 2024-09-10T23:15:10.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.227+0000 7f20e90d4640 1 -- 172.21.15.90:0/537292944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20e40d2470 msgr2=0x7f20e40b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:10.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.227+0000 7f20e90d4640 1 --2- 172.21.15.90:0/537292944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20e40d2470 0x7f20e40b26f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f20dc006010 tx=0x7f20dc003960 comp rx=0 tx=0).stop 2024-09-10T23:15:10.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.227+0000 7f20e90d4640 1 -- 172.21.15.90:0/537292944 shutdown_connections 2024-09-10T23:15:10.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.227+0000 7f20e90d4640 1 --2- 172.21.15.90:0/537292944 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f20d0077f70 0x7f20d007a430 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.227+0000 7f20e90d4640 1 --2- 172.21.15.90:0/537292944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20e40d1c70 0x7f20e415fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.227+0000 7f20e90d4640 1 --2- 172.21.15.90:0/537292944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20e40d2470 0x7f20e40b26f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.227+0000 7f20e90d4640 1 --2- 172.21.15.90:0/537292944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20e40b3a00 0x7f20e41f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.227+0000 7f20e90d4640 1 -- 172.21.15.90:0/537292944 >> 172.21.15.90:0/537292944 conn(0x7f20e409d2a0 msgr2=0x7f20e406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:10.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.227+0000 7f20e90d4640 1 -- 172.21.15.90:0/537292944 shutdown_connections 2024-09-10T23:15:10.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.227+0000 7f20e90d4640 1 -- 172.21.15.90:0/537292944 wait complete. 2024-09-10T23:15:10.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-10T23:15:10.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.340+0000 7ff74a917640 1 -- 172.21.15.90:0/2854724836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7440b1f60 msgr2=0x7ff7440cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:10.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.340+0000 7ff74a917640 1 --2- 172.21.15.90:0/2854724836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7440b1f60 0x7ff7440cdcd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff73c005fd0 tx=0x7ff73c02aa90 comp rx=0 tx=0).stop 2024-09-10T23:15:10.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.340+0000 7ff74a917640 1 -- 172.21.15.90:0/2854724836 shutdown_connections 2024-09-10T23:15:10.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.340+0000 7ff74a917640 1 --2- 172.21.15.90:0/2854724836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7440b1f60 0x7ff7440cdcd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.340+0000 7ff74a917640 1 --2- 172.21.15.90:0/2854724836 >> v2:172.21.15.171:3300/0 conn(0x7ff74415aa30 0x7ff7440ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.340+0000 7ff74a917640 1 -- 172.21.15.90:0/2854724836 >> 172.21.15.90:0/2854724836 conn(0x7ff7440cc850 msgr2=0x7ff7440ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:10.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.340+0000 7ff74a917640 1 -- 172.21.15.90:0/2854724836 shutdown_connections 2024-09-10T23:15:10.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.340+0000 7ff74a917640 1 -- 172.21.15.90:0/2854724836 wait complete. 2024-09-10T23:15:10.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.341+0000 7ff74a917640 1 Processor -- start 2024-09-10T23:15:10.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.341+0000 7ff74a917640 1 -- start start 2024-09-10T23:15:10.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.342+0000 7ff74a917640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7440b1f60 0x7ff7441f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:10.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.342+0000 7ff74a917640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff74415aa30 0x7ff74415db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:10.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.342+0000 7ff74a917640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7440d0290 0x7ff7440b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:10.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.342+0000 7ff74a917640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff7440ce5a0 con 0x7ff7440d0290 2024-09-10T23:15:10.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.342+0000 7ff74a917640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff7440ce420 con 0x7ff7440b1f60 2024-09-10T23:15:10.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.342+0000 7ff74a917640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff7440ce720 con 0x7ff74415aa30 2024-09-10T23:15:10.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.342+0000 7ff748eb4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7440d0290 0x7ff7440b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:10.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.342+0000 7ff748eb4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7440d0290 0x7ff7440b4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59442/0 (socket says 172.21.15.90:59442) 2024-09-10T23:15:10.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.342+0000 7ff748eb4640 1 -- 172.21.15.90:0/4188261967 learned_addr learned my addr 172.21.15.90:0/4188261967 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:10.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.342+0000 7ff7437fe640 1 --2- 172.21.15.90:0/4188261967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff74415aa30 0x7ff74415db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:10.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.342+0000 7ff743fff640 1 --2- 172.21.15.90:0/4188261967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7440b1f60 0x7ff7441f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:10.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.342+0000 7ff748eb4640 1 -- 172.21.15.90:0/4188261967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff74415aa30 msgr2=0x7ff74415db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:10.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.342+0000 7ff748eb4640 1 --2- 172.21.15.90:0/4188261967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff74415aa30 0x7ff74415db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.342+0000 7ff748eb4640 1 -- 172.21.15.90:0/4188261967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7440b1f60 msgr2=0x7ff7441f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:10.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.342+0000 7ff748eb4640 1 --2- 172.21.15.90:0/4188261967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7440b1f60 0x7ff7441f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.342+0000 7ff748eb4640 1 -- 172.21.15.90:0/4188261967 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7441f1530 con 0x7ff7440d0290 2024-09-10T23:15:10.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.343+0000 7ff748eb4640 1 --2- 172.21.15.90:0/4188261967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7440d0290 0x7ff7440b4280 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff73c006010 tx=0x7ff73c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:10.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.343+0000 7ff740ff9640 1 -- 172.21.15.90:0/4188261967 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c044070 con 0x7ff7440d0290 2024-09-10T23:15:10.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.343+0000 7ff740ff9640 1 -- 172.21.15.90:0/4188261967 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff73c004040 con 0x7ff7440d0290 2024-09-10T23:15:10.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.343+0000 7ff74a917640 1 -- 172.21.15.90:0/4188261967 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7441f1810 con 0x7ff7440d0290 2024-09-10T23:15:10.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.343+0000 7ff740ff9640 1 -- 172.21.15.90:0/4188261967 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c004430 con 0x7ff7440d0290 2024-09-10T23:15:10.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.343+0000 7ff74a917640 1 -- 172.21.15.90:0/4188261967 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7441f1dd0 con 0x7ff7440d0290 2024-09-10T23:15:10.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.344+0000 7ff74a917640 1 -- 172.21.15.90:0/4188261967 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7440b0270 con 0x7ff7440d0290 2024-09-10T23:15:10.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.344+0000 7ff740ff9640 1 -- 172.21.15.90:0/4188261967 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff73c0045d0 con 0x7ff7440d0290 2024-09-10T23:15:10.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.345+0000 7ff740ff9640 1 --2- 172.21.15.90:0/4188261967 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff730077f70 0x7ff73007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:10.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.345+0000 7ff740ff9640 1 -- 172.21.15.90:0/4188261967 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7ff73c0ba920 con 0x7ff7440d0290 2024-09-10T23:15:10.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.345+0000 7ff743fff640 1 --2- 172.21.15.90:0/4188261967 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff730077f70 0x7ff73007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:10.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.346+0000 7ff743fff640 1 --2- 172.21.15.90:0/4188261967 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff730077f70 0x7ff73007a430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff734009bd0 tx=0x7ff734005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:10.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.349+0000 7ff740ff9640 1 -- 172.21.15.90:0/4188261967 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff7440b0270 con 0x7ff7440d0290 2024-09-10T23:15:10.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.594+0000 7ff74a917640 1 -- 172.21.15.90:0/4188261967 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7ff7440cc3a0 con 0x7ff7440d0290 2024-09-10T23:15:10.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.597+0000 7ff740ff9640 1 -- 172.21.15.90:0/4188261967 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v22) ==== 90+0+0 (secure 0 0 0) 0x7ff7440cc3a0 con 0x7ff7440d0290 2024-09-10T23:15:10.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.599+0000 7ff74a917640 1 -- 172.21.15.90:0/4188261967 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff730077f70 msgr2=0x7ff73007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:10.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.599+0000 7ff74a917640 1 --2- 172.21.15.90:0/4188261967 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff730077f70 0x7ff73007a430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff734009bd0 tx=0x7ff734005f90 comp rx=0 tx=0).stop 2024-09-10T23:15:10.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.599+0000 7ff74a917640 1 -- 172.21.15.90:0/4188261967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7440d0290 msgr2=0x7ff7440b4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:10.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.599+0000 7ff74a917640 1 --2- 172.21.15.90:0/4188261967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7440d0290 0x7ff7440b4280 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff73c006010 tx=0x7ff73c003ce0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.599+0000 7ff74a917640 1 -- 172.21.15.90:0/4188261967 shutdown_connections 2024-09-10T23:15:10.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.599+0000 7ff74a917640 1 --2- 172.21.15.90:0/4188261967 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff730077f70 0x7ff73007a430 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.599+0000 7ff74a917640 1 --2- 172.21.15.90:0/4188261967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7440d0290 0x7ff7440b4280 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.599+0000 7ff74a917640 1 --2- 172.21.15.90:0/4188261967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff74415aa30 0x7ff74415db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.599+0000 7ff74a917640 1 --2- 172.21.15.90:0/4188261967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7440b1f60 0x7ff7441f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.599+0000 7ff74a917640 1 -- 172.21.15.90:0/4188261967 >> 172.21.15.90:0/4188261967 conn(0x7ff7440cc850 msgr2=0x7ff7440af730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:10.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.599+0000 7ff74a917640 1 -- 172.21.15.90:0/4188261967 shutdown_connections 2024-09-10T23:15:10.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.599+0000 7ff74a917640 1 -- 172.21.15.90:0/4188261967 wait complete. 2024-09-10T23:15:10.612 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-10T23:15:10.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.712+0000 7f91d9471640 1 -- 172.21.15.90:0/4248654884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91d40b1f60 msgr2=0x7f91d40cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:10.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.712+0000 7f91d9471640 1 --2- 172.21.15.90:0/4248654884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91d40b1f60 0x7f91d40cdcd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f91d40707c0 tx=0x7f91cc02a4d0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.712+0000 7f91d9471640 1 -- 172.21.15.90:0/4248654884 shutdown_connections 2024-09-10T23:15:10.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.712+0000 7f91d9471640 1 --2- 172.21.15.90:0/4248654884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91d40b1f60 0x7f91d40cdcd0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.712+0000 7f91d9471640 1 --2- 172.21.15.90:0/4248654884 >> v2:172.21.15.171:3300/0 conn(0x7f91d415aa30 0x7f91d40ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.712+0000 7f91d9471640 1 -- 172.21.15.90:0/4248654884 >> 172.21.15.90:0/4248654884 conn(0x7f91d40cc850 msgr2=0x7f91d40ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:10.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.712+0000 7f91d9471640 1 -- 172.21.15.90:0/4248654884 shutdown_connections 2024-09-10T23:15:10.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.712+0000 7f91d9471640 1 -- 172.21.15.90:0/4248654884 wait complete. 2024-09-10T23:15:10.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.714+0000 7f91d9471640 1 Processor -- start 2024-09-10T23:15:10.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.714+0000 7f91d9471640 1 -- start start 2024-09-10T23:15:10.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.714+0000 7f91d9471640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91d40b1f60 0x7f91d4159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:10.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.714+0000 7f91d9471640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91d415aa30 0x7f91d40b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:10.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.714+0000 7f91d9471640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91d414e230 0x7f91d40c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:10.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.714+0000 7f91d9471640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f91d40ce390 con 0x7f91d415aa30 2024-09-10T23:15:10.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.714+0000 7f91d9471640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f91d40ce210 con 0x7f91d40b1f60 2024-09-10T23:15:10.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.714+0000 7f91d9471640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f91d40ce510 con 0x7f91d414e230 2024-09-10T23:15:10.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91d27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91d415aa30 0x7f91d40b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:10.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91d27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91d415aa30 0x7f91d40b4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59456/0 (socket says 172.21.15.90:59456) 2024-09-10T23:15:10.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91d27fc640 1 -- 172.21.15.90:0/972933920 learned_addr learned my addr 172.21.15.90:0/972933920 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:10.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91d2ffd640 1 --2- 172.21.15.90:0/972933920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91d40b1f60 0x7f91d4159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:10.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91d37fe640 1 --2- 172.21.15.90:0/972933920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91d414e230 0x7f91d40c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:10.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91d27fc640 1 -- 172.21.15.90:0/972933920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91d414e230 msgr2=0x7f91d40c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:10.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91d27fc640 1 --2- 172.21.15.90:0/972933920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91d414e230 0x7f91d40c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91d27fc640 1 -- 172.21.15.90:0/972933920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91d40b1f60 msgr2=0x7f91d4159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:10.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91d27fc640 1 --2- 172.21.15.90:0/972933920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91d40b1f60 0x7f91d4159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91d27fc640 1 -- 172.21.15.90:0/972933920 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d4159920 con 0x7f91d415aa30 2024-09-10T23:15:10.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91d2ffd640 1 --2- 172.21.15.90:0/972933920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91d40b1f60 0x7f91d4159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:10.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91d37fe640 1 --2- 172.21.15.90:0/972933920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91d414e230 0x7f91d40c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:10.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91d27fc640 1 --2- 172.21.15.90:0/972933920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91d415aa30 0x7f91d40b4af0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00c430 tx=0x7f91bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:10.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91cb7fe640 1 -- 172.21.15.90:0/972933920 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc011790 con 0x7f91d415aa30 2024-09-10T23:15:10.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91cb7fe640 1 -- 172.21.15.90:0/972933920 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91bc017070 con 0x7f91d415aa30 2024-09-10T23:15:10.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91d9471640 1 -- 172.21.15.90:0/972933920 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d40b5180 con 0x7f91d415aa30 2024-09-10T23:15:10.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91cb7fe640 1 -- 172.21.15.90:0/972933920 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc011cc0 con 0x7f91d415aa30 2024-09-10T23:15:10.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.715+0000 7f91d9471640 1 -- 172.21.15.90:0/972933920 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d40b5740 con 0x7f91d415aa30 2024-09-10T23:15:10.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.716+0000 7f91d9471640 1 -- 172.21.15.90:0/972933920 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91d406f000 con 0x7f91d415aa30 2024-09-10T23:15:10.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.717+0000 7f91cb7fe640 1 -- 172.21.15.90:0/972933920 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f91bc01c460 con 0x7f91d415aa30 2024-09-10T23:15:10.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.717+0000 7f91cb7fe640 1 --2- 172.21.15.90:0/972933920 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f91b4077fa0 0x7f91b407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:10.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.717+0000 7f91cb7fe640 1 -- 172.21.15.90:0/972933920 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f91bc099830 con 0x7f91d415aa30 2024-09-10T23:15:10.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.718+0000 7f91d2ffd640 1 --2- 172.21.15.90:0/972933920 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f91b4077fa0 0x7f91b407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:10.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.718+0000 7f91d2ffd640 1 --2- 172.21.15.90:0/972933920 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f91b4077fa0 0x7f91b407a460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f91c4005fd0 tx=0x7f91c4009520 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:10.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.721+0000 7f91cb7fe640 1 -- 172.21.15.90:0/972933920 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f91d406f000 con 0x7f91d415aa30 2024-09-10T23:15:10.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.963+0000 7f91d9471640 1 -- 172.21.15.90:0/972933920 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f91d40cdcd0 con 0x7f91d415aa30 2024-09-10T23:15:10.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.965+0000 7f91cb7fe640 1 -- 172.21.15.90:0/972933920 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v23) ==== 97+0+0 (secure 0 0 0) 0x7f91bc062690 con 0x7f91d415aa30 2024-09-10T23:15:10.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.967+0000 7f91d9471640 1 -- 172.21.15.90:0/972933920 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f91b4077fa0 msgr2=0x7f91b407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:10.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.967+0000 7f91d9471640 1 --2- 172.21.15.90:0/972933920 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f91b4077fa0 0x7f91b407a460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f91c4005fd0 tx=0x7f91c4009520 comp rx=0 tx=0).stop 2024-09-10T23:15:10.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.967+0000 7f91d9471640 1 -- 172.21.15.90:0/972933920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91d415aa30 msgr2=0x7f91d40b4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:10.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.967+0000 7f91d9471640 1 --2- 172.21.15.90:0/972933920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91d415aa30 0x7f91d40b4af0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00c430 tx=0x7f91bc00c8f0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.967+0000 7f91d9471640 1 -- 172.21.15.90:0/972933920 shutdown_connections 2024-09-10T23:15:10.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.967+0000 7f91d9471640 1 --2- 172.21.15.90:0/972933920 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f91b4077fa0 0x7f91b407a460 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.967+0000 7f91d9471640 1 --2- 172.21.15.90:0/972933920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91d414e230 0x7f91d40c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.967+0000 7f91d9471640 1 --2- 172.21.15.90:0/972933920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91d415aa30 0x7f91d40b4af0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.967+0000 7f91d9471640 1 --2- 172.21.15.90:0/972933920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91d40b1f60 0x7f91d4159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:10.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.967+0000 7f91d9471640 1 -- 172.21.15.90:0/972933920 >> 172.21.15.90:0/972933920 conn(0x7f91d40cc850 msgr2=0x7f91d40ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:10.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.967+0000 7f91d9471640 1 -- 172.21.15.90:0/972933920 shutdown_connections 2024-09-10T23:15:10.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:10.967+0000 7f91d9471640 1 -- 172.21.15.90:0/972933920 wait complete. 2024-09-10T23:15:10.980 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-10T23:15:11.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.080+0000 7f8d28bb4640 1 -- 172.21.15.90:0/1221526621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d10003fd0 msgr2=0x7f8d10004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.080+0000 7f8d28bb4640 1 --2- 172.21.15.90:0/1221526621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d10003fd0 0x7f8d10004800 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009b50 tx=0x7f8d10005830 comp rx=0 tx=0).stop 2024-09-10T23:15:11.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.080+0000 7f8d22d9d640 1 -- 172.21.15.90:0/1221526621 reap_dead start 2024-09-10T23:15:11.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.080+0000 7f8d28bb4640 1 -- 172.21.15.90:0/1221526621 shutdown_connections 2024-09-10T23:15:11.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.080+0000 7f8d28bb4640 1 -- 172.21.15.90:0/1221526621 >> 172.21.15.90:0/1221526621 conn(0x7f8d240cc850 msgr2=0x7f8d240ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.080+0000 7f8d28bb4640 1 -- 172.21.15.90:0/1221526621 shutdown_connections 2024-09-10T23:15:11.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.080+0000 7f8d28bb4640 1 -- 172.21.15.90:0/1221526621 wait complete. 2024-09-10T23:15:11.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.081+0000 7f8d28bb4640 1 Processor -- start 2024-09-10T23:15:11.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.081+0000 7f8d28bb4640 1 -- start start 2024-09-10T23:15:11.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d28bb4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d10003fd0 0x7f8d240b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d28bb4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d2406ffe0 0x7f8d2415c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d28bb4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d240c62f0 0x7f8d2415ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d28bb4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8d240ca630 con 0x7f8d240c62f0 2024-09-10T23:15:11.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d28bb4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8d240747c0 con 0x7f8d2406ffe0 2024-09-10T23:15:11.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d28bb4640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8d240ca7b0 con 0x7f8d10003fd0 2024-09-10T23:15:11.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d22d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d240c62f0 0x7f8d2415ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d22d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d240c62f0 0x7f8d2415ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59478/0 (socket says 172.21.15.90:59478) 2024-09-10T23:15:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d22d9d640 1 -- 172.21.15.90:0/1356684966 learned_addr learned my addr 172.21.15.90:0/1356684966 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d2259c640 1 --2- 172.21.15.90:0/1356684966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d10003fd0 0x7f8d240b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d21d9b640 1 --2- 172.21.15.90:0/1356684966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d2406ffe0 0x7f8d2415c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d22d9d640 1 -- 172.21.15.90:0/1356684966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d10003fd0 msgr2=0x7f8d240b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d22d9d640 1 --2- 172.21.15.90:0/1356684966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d10003fd0 0x7f8d240b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d22d9d640 1 -- 172.21.15.90:0/1356684966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d2406ffe0 msgr2=0x7f8d2415c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d22d9d640 1 --2- 172.21.15.90:0/1356684966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d2406ffe0 0x7f8d2415c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d22d9d640 1 -- 172.21.15.90:0/1356684966 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d240b4b30 con 0x7f8d240c62f0 2024-09-10T23:15:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d2259c640 1 --2- 172.21.15.90:0/1356684966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d10003fd0 0x7f8d240b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d22d9d640 1 --2- 172.21.15.90:0/1356684966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d240c62f0 0x7f8d2415ce20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8d240cbfc0 tx=0x7f8d1c00e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d1affd640 1 -- 172.21.15.90:0/1356684966 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c011870 con 0x7f8d240c62f0 2024-09-10T23:15:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.082+0000 7f8d1affd640 1 -- 172.21.15.90:0/1356684966 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d1c017070 con 0x7f8d240c62f0 2024-09-10T23:15:11.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.083+0000 7f8d28bb4640 1 -- 172.21.15.90:0/1356684966 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d240b4e10 con 0x7f8d240c62f0 2024-09-10T23:15:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.083+0000 7f8d1affd640 1 -- 172.21.15.90:0/1356684966 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c011da0 con 0x7f8d240c62f0 2024-09-10T23:15:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.083+0000 7f8d28bb4640 1 -- 172.21.15.90:0/1356684966 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d240b53d0 con 0x7f8d240c62f0 2024-09-10T23:15:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.084+0000 7f8d28bb4640 1 -- 172.21.15.90:0/1356684966 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d240b2170 con 0x7f8d240c62f0 2024-09-10T23:15:11.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.084+0000 7f8d1affd640 1 -- 172.21.15.90:0/1356684966 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8d1c01c460 con 0x7f8d240c62f0 2024-09-10T23:15:11.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.084+0000 7f8d1affd640 1 --2- 172.21.15.90:0/1356684966 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8d04077f70 0x7f8d0407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.085+0000 7f8d1affd640 1 -- 172.21.15.90:0/1356684966 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f8d1c099d10 con 0x7f8d240c62f0 2024-09-10T23:15:11.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.085+0000 7f8d2259c640 1 --2- 172.21.15.90:0/1356684966 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8d04077f70 0x7f8d0407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.085+0000 7f8d2259c640 1 --2- 172.21.15.90:0/1356684966 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8d04077f70 0x7f8d0407a430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d14005fd0 tx=0x7f8d14009500 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.090+0000 7f8d1affd640 1 -- 172.21.15.90:0/1356684966 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8d1c062b60 con 0x7f8d240c62f0 2024-09-10T23:15:11.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.332+0000 7f8d28bb4640 1 -- 172.21.15.90:0/1356684966 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f8d2415a710 con 0x7f8d240c62f0 2024-09-10T23:15:11.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.334+0000 7f8d1affd640 1 -- 172.21.15.90:0/1356684966 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v24) ==== 90+0+0 (secure 0 0 0) 0x7f8d1c06b280 con 0x7f8d240c62f0 2024-09-10T23:15:11.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.337+0000 7f8d28bb4640 1 -- 172.21.15.90:0/1356684966 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8d04077f70 msgr2=0x7f8d0407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.337+0000 7f8d28bb4640 1 --2- 172.21.15.90:0/1356684966 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8d04077f70 0x7f8d0407a430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d14005fd0 tx=0x7f8d14009500 comp rx=0 tx=0).stop 2024-09-10T23:15:11.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.337+0000 7f8d28bb4640 1 -- 172.21.15.90:0/1356684966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d240c62f0 msgr2=0x7f8d2415ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.337+0000 7f8d28bb4640 1 --2- 172.21.15.90:0/1356684966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d240c62f0 0x7f8d2415ce20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8d240cbfc0 tx=0x7f8d1c00e9a0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.337+0000 7f8d28bb4640 1 -- 172.21.15.90:0/1356684966 shutdown_connections 2024-09-10T23:15:11.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.337+0000 7f8d28bb4640 1 --2- 172.21.15.90:0/1356684966 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8d04077f70 0x7f8d0407a430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.337+0000 7f8d28bb4640 1 --2- 172.21.15.90:0/1356684966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d2406ffe0 0x7f8d2415c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.337+0000 7f8d28bb4640 1 --2- 172.21.15.90:0/1356684966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d240c62f0 0x7f8d2415ce20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.337+0000 7f8d28bb4640 1 --2- 172.21.15.90:0/1356684966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d10003fd0 0x7f8d240b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.337+0000 7f8d28bb4640 1 -- 172.21.15.90:0/1356684966 >> 172.21.15.90:0/1356684966 conn(0x7f8d240cc850 msgr2=0x7f8d2415d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.337+0000 7f8d28bb4640 1 -- 172.21.15.90:0/1356684966 shutdown_connections 2024-09-10T23:15:11.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.337+0000 7f8d28bb4640 1 -- 172.21.15.90:0/1356684966 wait complete. 2024-09-10T23:15:11.350 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:15:11.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.448+0000 7f533759e640 1 -- 172.21.15.90:0/3755522129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5320003a30 msgr2=0x7f5320003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.448+0000 7f533759e640 1 --2- 172.21.15.90:0/3755522129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5320003a30 0x7f5320003e50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f53280013d0 tx=0x7f5320005830 comp rx=0 tx=0).stop 2024-09-10T23:15:11.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.448+0000 7f5336d9d640 1 -- 172.21.15.90:0/3755522129 reap_dead start 2024-09-10T23:15:11.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.449+0000 7f533759e640 1 -- 172.21.15.90:0/3755522129 shutdown_connections 2024-09-10T23:15:11.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.449+0000 7f533759e640 1 -- 172.21.15.90:0/3755522129 >> 172.21.15.90:0/3755522129 conn(0x7f53380d1be0 msgr2=0x7f53380d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.449+0000 7f533759e640 1 -- 172.21.15.90:0/3755522129 shutdown_connections 2024-09-10T23:15:11.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.449+0000 7f533759e640 1 -- 172.21.15.90:0/3755522129 wait complete. 2024-09-10T23:15:11.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.450+0000 7f533759e640 1 Processor -- start 2024-09-10T23:15:11.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.450+0000 7f533759e640 1 -- start start 2024-09-10T23:15:11.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f533759e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5320003a30 0x7f53380cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f533759e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53380cbc60 0x7f53381f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f533759e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53381f67c0 0x7f53381f6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f533759e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f53380b3370 con 0x7f53381f67c0 2024-09-10T23:15:11.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f533759e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f53380b31f0 con 0x7f53380cbc60 2024-09-10T23:15:11.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f533759e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f53380b0510 con 0x7f5320003a30 2024-09-10T23:15:11.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f5336d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53381f67c0 0x7f53381f6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f5336d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53381f67c0 0x7f53381f6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59486/0 (socket says 172.21.15.90:59486) 2024-09-10T23:15:11.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f5336d9d640 1 -- 172.21.15.90:0/2156900119 learned_addr learned my addr 172.21.15.90:0/2156900119 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:11.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f5335d9b640 1 --2- 172.21.15.90:0/2156900119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53380cbc60 0x7f53381f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f533659c640 1 --2- 172.21.15.90:0/2156900119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5320003a30 0x7f53380cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f5336d9d640 1 -- 172.21.15.90:0/2156900119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5320003a30 msgr2=0x7f53380cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f5336d9d640 1 --2- 172.21.15.90:0/2156900119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5320003a30 0x7f53380cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f5336d9d640 1 -- 172.21.15.90:0/2156900119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53380cbc60 msgr2=0x7f53381f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f5336d9d640 1 --2- 172.21.15.90:0/2156900119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53380cbc60 0x7f53381f6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f5336d9d640 1 -- 172.21.15.90:0/2156900119 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53380cc0c0 con 0x7f53381f67c0 2024-09-10T23:15:11.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f5336d9d640 1 --2- 172.21.15.90:0/2156900119 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53381f67c0 0x7f53381f6c70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f53380705b0 tx=0x7f533000fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f5326ffd640 1 -- 172.21.15.90:0/2156900119 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5330005220 con 0x7f53381f67c0 2024-09-10T23:15:11.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f5326ffd640 1 -- 172.21.15.90:0/2156900119 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53300054b0 con 0x7f53381f67c0 2024-09-10T23:15:11.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f533759e640 1 -- 172.21.15.90:0/2156900119 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53380c7770 con 0x7f53381f67c0 2024-09-10T23:15:11.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f5326ffd640 1 -- 172.21.15.90:0/2156900119 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5330004a00 con 0x7f53381f67c0 2024-09-10T23:15:11.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.451+0000 7f533759e640 1 -- 172.21.15.90:0/2156900119 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53380c91e0 con 0x7f53381f67c0 2024-09-10T23:15:11.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.452+0000 7f533759e640 1 -- 172.21.15.90:0/2156900119 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53380b1210 con 0x7f53381f67c0 2024-09-10T23:15:11.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.453+0000 7f5326ffd640 1 -- 172.21.15.90:0/2156900119 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5330004ba0 con 0x7f53381f67c0 2024-09-10T23:15:11.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.453+0000 7f5326ffd640 1 --2- 172.21.15.90:0/2156900119 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5318077fa0 0x7f531807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.453+0000 7f5326ffd640 1 -- 172.21.15.90:0/2156900119 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f5330099ed0 con 0x7f53381f67c0 2024-09-10T23:15:11.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.454+0000 7f533659c640 1 --2- 172.21.15.90:0/2156900119 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5318077fa0 0x7f531807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.454+0000 7f533659c640 1 --2- 172.21.15.90:0/2156900119 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5318077fa0 0x7f531807a460 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5328033000 tx=0x7f5328001360 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.457+0000 7f5326ffd640 1 -- 172.21.15.90:0/2156900119 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5330062760 con 0x7f53381f67c0 2024-09-10T23:15:11.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.631+0000 7f533759e640 1 -- 172.21.15.90:0/2156900119 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5338069660 con 0x7f53381f67c0 2024-09-10T23:15:11.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.632+0000 7f5326ffd640 1 -- 172.21.15.90:0/2156900119 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) ==== 84+0+65 (secure 0 0 0) 0x7f5330067190 con 0x7f53381f67c0 2024-09-10T23:15:11.634 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:11.634 INFO:teuthology.orchestra.run.smithi090.stdout:[ 2024-09-10T23:15:11.634 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:11.634 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 1, 2024-09-10T23:15:11.634 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": ".mgr" 2024-09-10T23:15:11.634 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:11.635 INFO:teuthology.orchestra.run.smithi090.stdout:] 2024-09-10T23:15:11.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.634+0000 7f533759e640 1 -- 172.21.15.90:0/2156900119 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5318077fa0 msgr2=0x7f531807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.634+0000 7f533759e640 1 --2- 172.21.15.90:0/2156900119 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5318077fa0 0x7f531807a460 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5328033000 tx=0x7f5328001360 comp rx=0 tx=0).stop 2024-09-10T23:15:11.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.634+0000 7f533759e640 1 -- 172.21.15.90:0/2156900119 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53381f67c0 msgr2=0x7f53381f6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.634+0000 7f533759e640 1 --2- 172.21.15.90:0/2156900119 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53381f67c0 0x7f53381f6c70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f53380705b0 tx=0x7f533000fa20 comp rx=0 tx=0).stop 2024-09-10T23:15:11.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.634+0000 7f533759e640 1 -- 172.21.15.90:0/2156900119 shutdown_connections 2024-09-10T23:15:11.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.634+0000 7f533759e640 1 --2- 172.21.15.90:0/2156900119 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5318077fa0 0x7f531807a460 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.634+0000 7f533759e640 1 --2- 172.21.15.90:0/2156900119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53380cbc60 0x7f53381f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.634+0000 7f533759e640 1 --2- 172.21.15.90:0/2156900119 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53381f67c0 0x7f53381f6c70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.634+0000 7f533759e640 1 --2- 172.21.15.90:0/2156900119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5320003a30 0x7f53380cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.634+0000 7f533759e640 1 -- 172.21.15.90:0/2156900119 >> 172.21.15.90:0/2156900119 conn(0x7f53380d1be0 msgr2=0x7f5338070670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.634+0000 7f533759e640 1 -- 172.21.15.90:0/2156900119 shutdown_connections 2024-09-10T23:15:11.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.634+0000 7f533759e640 1 -- 172.21.15.90:0/2156900119 wait complete. 2024-09-10T23:15:11.647 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:15:11.647 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:15:11.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.751+0000 7fb1c2764640 1 -- 172.21.15.90:0/4049855188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1bc15f1f0 msgr2=0x7fb1bc074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.751+0000 7fb1c2764640 1 --2- 172.21.15.90:0/4049855188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1bc15f1f0 0x7fb1bc074220 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0d1120 tx=0x7fb1ac02a560 comp rx=0 tx=0).stop 2024-09-10T23:15:11.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.751+0000 7fb1c2764640 1 -- 172.21.15.90:0/4049855188 shutdown_connections 2024-09-10T23:15:11.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.751+0000 7fb1c2764640 1 --2- 172.21.15.90:0/4049855188 >> v2:172.21.15.171:3300/0 conn(0x7fb1bc15f5d0 0x7fb1bc074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.751+0000 7fb1c2764640 1 --2- 172.21.15.90:0/4049855188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1bc15f1f0 0x7fb1bc074220 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.751+0000 7fb1c2764640 1 -- 172.21.15.90:0/4049855188 >> 172.21.15.90:0/4049855188 conn(0x7fb1bc0d0400 msgr2=0x7fb1bc0d0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.751+0000 7fb1c2764640 1 -- 172.21.15.90:0/4049855188 shutdown_connections 2024-09-10T23:15:11.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.751+0000 7fb1c2764640 1 -- 172.21.15.90:0/4049855188 wait complete. 2024-09-10T23:15:11.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.752+0000 7fb1c2764640 1 Processor -- start 2024-09-10T23:15:11.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.752+0000 7fb1c2764640 1 -- start start 2024-09-10T23:15:11.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.753+0000 7fb1c2764640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1bc0b1100 0x7fb1bc0c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.753+0000 7fb1c2764640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1bc15f1f0 0x7fb1bc0c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.753+0000 7fb1c2764640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1bc15f5d0 0x7fb1bc0c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.753+0000 7fb1c2764640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc074eb0 con 0x7fb1bc15f1f0 2024-09-10T23:15:11.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.753+0000 7fb1c2764640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc0cc0c0 con 0x7fb1bc0b1100 2024-09-10T23:15:11.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.753+0000 7fb1c2764640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb1bc075030 con 0x7fb1bc15f5d0 2024-09-10T23:15:11.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.753+0000 7fb1bb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1bc15f1f0 0x7fb1bc0c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.753+0000 7fb1bb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1bc15f1f0 0x7fb1bc0c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59510/0 (socket says 172.21.15.90:59510) 2024-09-10T23:15:11.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.753+0000 7fb1bb7fe640 1 -- 172.21.15.90:0/4091280399 learned_addr learned my addr 172.21.15.90:0/4091280399 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:11.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.753+0000 7fb1bbfff640 1 --2- 172.21.15.90:0/4091280399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1bc0b1100 0x7fb1bc0c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.753+0000 7fb1c0d01640 1 --2- 172.21.15.90:0/4091280399 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1bc15f5d0 0x7fb1bc0c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.753+0000 7fb1bb7fe640 1 -- 172.21.15.90:0/4091280399 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1bc15f5d0 msgr2=0x7fb1bc0c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.753+0000 7fb1bb7fe640 1 --2- 172.21.15.90:0/4091280399 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1bc15f5d0 0x7fb1bc0c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.753+0000 7fb1bb7fe640 1 -- 172.21.15.90:0/4091280399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1bc0b1100 msgr2=0x7fb1bc0c5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.753+0000 7fb1bb7fe640 1 --2- 172.21.15.90:0/4091280399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1bc0b1100 0x7fb1bc0c5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.753+0000 7fb1bb7fe640 1 -- 172.21.15.90:0/4091280399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1bc1f1920 con 0x7fb1bc15f1f0 2024-09-10T23:15:11.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.754+0000 7fb1bb7fe640 1 --2- 172.21.15.90:0/4091280399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1bc15f1f0 0x7fb1bc0c6360 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009a00 tx=0x7fb1a4009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.754+0000 7fb1b8ff9640 1 -- 172.21.15.90:0/4091280399 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400bab0 con 0x7fb1bc15f1f0 2024-09-10T23:15:11.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.754+0000 7fb1b8ff9640 1 -- 172.21.15.90:0/4091280399 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1a400bc50 con 0x7fb1bc15f1f0 2024-09-10T23:15:11.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.754+0000 7fb1b8ff9640 1 -- 172.21.15.90:0/4091280399 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4004020 con 0x7fb1bc15f1f0 2024-09-10T23:15:11.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.754+0000 7fb1c2764640 1 -- 172.21.15.90:0/4091280399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1bc1f1c00 con 0x7fb1bc15f1f0 2024-09-10T23:15:11.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.754+0000 7fb1c2764640 1 -- 172.21.15.90:0/4091280399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1bc0b61c0 con 0x7fb1bc15f1f0 2024-09-10T23:15:11.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.755+0000 7fb1c2764640 1 -- 172.21.15.90:0/4091280399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1bc1f16a0 con 0x7fb1bc15f1f0 2024-09-10T23:15:11.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.755+0000 7fb1b8ff9640 1 -- 172.21.15.90:0/4091280399 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb1a40041c0 con 0x7fb1bc15f1f0 2024-09-10T23:15:11.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.756+0000 7fb1b8ff9640 1 --2- 172.21.15.90:0/4091280399 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb19c077f70 0x7fb19c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.756+0000 7fb1b8ff9640 1 -- 172.21.15.90:0/4091280399 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fb1a409b600 con 0x7fb1bc15f1f0 2024-09-10T23:15:11.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.756+0000 7fb1bbfff640 1 --2- 172.21.15.90:0/4091280399 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb19c077f70 0x7fb19c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.757+0000 7fb1bbfff640 1 --2- 172.21.15.90:0/4091280399 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb19c077f70 0x7fb19c07a430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac033000 tx=0x7fb1ac004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.761+0000 7fb1b8ff9640 1 -- 172.21.15.90:0/4091280399 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb1bc1f16a0 con 0x7fb1bc15f1f0 2024-09-10T23:15:11.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:11.936+0000 7fb1c2764640 1 -- 172.21.15.90:0/4091280399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb1bc0ce1e0 con 0x7fb1bc15f1f0 2024-09-10T23:15:12.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.748+0000 7fb1b8ff9640 1 -- 172.21.15.90:0/4091280399 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) ==== 138+0+0 (secure 0 0 0) 0x7fb1a4063e90 con 0x7fb1bc15f1f0 2024-09-10T23:15:12.749 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' created 2024-09-10T23:15:12.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.751+0000 7fb1c2764640 1 -- 172.21.15.90:0/4091280399 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb19c077f70 msgr2=0x7fb19c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:12.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.751+0000 7fb1c2764640 1 --2- 172.21.15.90:0/4091280399 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb19c077f70 0x7fb19c07a430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac033000 tx=0x7fb1ac004730 comp rx=0 tx=0).stop 2024-09-10T23:15:12.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.751+0000 7fb1c2764640 1 -- 172.21.15.90:0/4091280399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1bc15f1f0 msgr2=0x7fb1bc0c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:12.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.751+0000 7fb1c2764640 1 --2- 172.21.15.90:0/4091280399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1bc15f1f0 0x7fb1bc0c6360 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009a00 tx=0x7fb1a4009ec0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.751+0000 7fb1c2764640 1 -- 172.21.15.90:0/4091280399 shutdown_connections 2024-09-10T23:15:12.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.751+0000 7fb1c2764640 1 --2- 172.21.15.90:0/4091280399 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb19c077f70 0x7fb19c07a430 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.751+0000 7fb1c2764640 1 --2- 172.21.15.90:0/4091280399 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1bc15f5d0 0x7fb1bc0c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.751+0000 7fb1c2764640 1 --2- 172.21.15.90:0/4091280399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1bc15f1f0 0x7fb1bc0c6360 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.751+0000 7fb1c2764640 1 --2- 172.21.15.90:0/4091280399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1bc0b1100 0x7fb1bc0c5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.751+0000 7fb1c2764640 1 -- 172.21.15.90:0/4091280399 >> 172.21.15.90:0/4091280399 conn(0x7fb1bc0d0400 msgr2=0x7fb1bc0b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:12.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.752+0000 7fb1c2764640 1 -- 172.21.15.90:0/4091280399 shutdown_connections 2024-09-10T23:15:12.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.752+0000 7fb1c2764640 1 -- 172.21.15.90:0/4091280399 wait complete. 2024-09-10T23:15:12.769 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:15:12.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.881+0000 7fa44948c640 1 -- 172.21.15.90:0/2091235387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4441616b0 msgr2=0x7fa4440b6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:12.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.881+0000 7fa44948c640 1 --2- 172.21.15.90:0/2091235387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4441616b0 0x7fa4440b6e90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa4440696f0 tx=0x7fa43402a4d0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.881+0000 7fa44948c640 1 -- 172.21.15.90:0/2091235387 shutdown_connections 2024-09-10T23:15:12.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.881+0000 7fa44948c640 1 --2- 172.21.15.90:0/2091235387 >> v2:172.21.15.171:3300/0 conn(0x7fa4440d2a20 0x7fa444161eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.881+0000 7fa44948c640 1 --2- 172.21.15.90:0/2091235387 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4440b5600 0x7fa4440d24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.881+0000 7fa44948c640 1 --2- 172.21.15.90:0/2091235387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4441616b0 0x7fa4440b6e90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.881+0000 7fa44948c640 1 -- 172.21.15.90:0/2091235387 >> 172.21.15.90:0/2091235387 conn(0x7fa4440d4040 msgr2=0x7fa4440d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:12.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.881+0000 7fa44948c640 1 -- 172.21.15.90:0/2091235387 shutdown_connections 2024-09-10T23:15:12.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.881+0000 7fa44948c640 1 -- 172.21.15.90:0/2091235387 wait complete. 2024-09-10T23:15:12.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.883+0000 7fa44948c640 1 Processor -- start 2024-09-10T23:15:12.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.883+0000 7fa44948c640 1 -- start start 2024-09-10T23:15:12.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.883+0000 7fa44948c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4440b5600 0x7fa4441f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:12.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.883+0000 7fa44948c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4440d2a20 0x7fa44415dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:12.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.883+0000 7fa44948c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4441616b0 0x7fa4440cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:12.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.883+0000 7fa44948c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa4440cf7e0 con 0x7fa4441616b0 2024-09-10T23:15:12.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.883+0000 7fa44948c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa4440cf660 con 0x7fa4440d2a20 2024-09-10T23:15:12.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.883+0000 7fa44948c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa444161a90 con 0x7fa4440b5600 2024-09-10T23:15:12.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.884+0000 7fa4437fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4441616b0 0x7fa4440cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:12.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.884+0000 7fa4437fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4441616b0 0x7fa4440cd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59522/0 (socket says 172.21.15.90:59522) 2024-09-10T23:15:12.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.884+0000 7fa4437fe640 1 -- 172.21.15.90:0/1814675447 learned_addr learned my addr 172.21.15.90:0/1814675447 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:12.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.884+0000 7fa442ffd640 1 --2- 172.21.15.90:0/1814675447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4440b5600 0x7fa4441f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:12.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.884+0000 7fa4427fc640 1 --2- 172.21.15.90:0/1814675447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4440d2a20 0x7fa44415dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:12.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.884+0000 7fa4437fe640 1 -- 172.21.15.90:0/1814675447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4440b5600 msgr2=0x7fa4441f4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:12.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.884+0000 7fa4437fe640 1 --2- 172.21.15.90:0/1814675447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4440b5600 0x7fa4441f4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.884+0000 7fa4437fe640 1 -- 172.21.15.90:0/1814675447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4440d2a20 msgr2=0x7fa44415dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:12.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.884+0000 7fa4437fe640 1 --2- 172.21.15.90:0/1814675447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4440d2a20 0x7fa44415dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.884+0000 7fa4437fe640 1 -- 172.21.15.90:0/1814675447 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44409e0d0 con 0x7fa4441616b0 2024-09-10T23:15:12.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.884+0000 7fa4427fc640 1 --2- 172.21.15.90:0/1814675447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4440d2a20 0x7fa44415dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:12.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.884+0000 7fa4437fe640 1 --2- 172.21.15.90:0/1814675447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4441616b0 0x7fa4440cd190 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00eaa0 tx=0x7fa43c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:12.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.884+0000 7fa42b7fe640 1 -- 172.21.15.90:0/1814675447 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00cdb0 con 0x7fa4441616b0 2024-09-10T23:15:12.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.884+0000 7fa42b7fe640 1 -- 172.21.15.90:0/1814675447 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa43c004c10 con 0x7fa4441616b0 2024-09-10T23:15:12.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.884+0000 7fa44948c640 1 -- 172.21.15.90:0/1814675447 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa44409e3b0 con 0x7fa4441616b0 2024-09-10T23:15:12.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.884+0000 7fa42b7fe640 1 -- 172.21.15.90:0/1814675447 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c005020 con 0x7fa4441616b0 2024-09-10T23:15:12.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.884+0000 7fa44948c640 1 -- 172.21.15.90:0/1814675447 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa44409ec50 con 0x7fa4441616b0 2024-09-10T23:15:12.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.885+0000 7fa44948c640 1 -- 172.21.15.90:0/1814675447 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa444161eb0 con 0x7fa4441616b0 2024-09-10T23:15:12.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.886+0000 7fa42b7fe640 1 -- 172.21.15.90:0/1814675447 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa43c00f040 con 0x7fa4441616b0 2024-09-10T23:15:12.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.887+0000 7fa42b7fe640 1 --2- 172.21.15.90:0/1814675447 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa430077f70 0x7fa43007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:12.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.887+0000 7fa42b7fe640 1 -- 172.21.15.90:0/1814675447 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5227+0+0 (secure 0 0 0) 0x7fa43c09a120 con 0x7fa4441616b0 2024-09-10T23:15:12.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.887+0000 7fa442ffd640 1 --2- 172.21.15.90:0/1814675447 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa430077f70 0x7fa43007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:12.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.887+0000 7fa442ffd640 1 --2- 172.21.15.90:0/1814675447 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa430077f70 0x7fa43007a430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa434033000 tx=0x7fa434004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:12.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:12.891+0000 7fa42b7fe640 1 -- 172.21.15.90:0/1814675447 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa43c016030 con 0x7fa4441616b0 2024-09-10T23:15:13.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.065+0000 7fa44948c640 1 -- 172.21.15.90:0/1814675447 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa44409ee20 con 0x7fa4441616b0 2024-09-10T23:15:13.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.751+0000 7fa42b7fe640 1 -- 172.21.15.90:0/1814675447 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) ==== 170+0+0 (secure 0 0 0) 0x7fa43c062840 con 0x7fa4441616b0 2024-09-10T23:15:13.752 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' created 2024-09-10T23:15:13.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.754+0000 7fa44948c640 1 -- 172.21.15.90:0/1814675447 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa430077f70 msgr2=0x7fa43007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.754+0000 7fa44948c640 1 --2- 172.21.15.90:0/1814675447 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa430077f70 0x7fa43007a430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa434033000 tx=0x7fa434004730 comp rx=0 tx=0).stop 2024-09-10T23:15:13.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.754+0000 7fa44948c640 1 -- 172.21.15.90:0/1814675447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4441616b0 msgr2=0x7fa4440cd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.754+0000 7fa44948c640 1 --2- 172.21.15.90:0/1814675447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4441616b0 0x7fa4440cd190 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00eaa0 tx=0x7fa43c00ef60 comp rx=0 tx=0).stop 2024-09-10T23:15:13.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.755+0000 7fa44948c640 1 -- 172.21.15.90:0/1814675447 shutdown_connections 2024-09-10T23:15:13.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.755+0000 7fa44948c640 1 --2- 172.21.15.90:0/1814675447 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa430077f70 0x7fa43007a430 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.755+0000 7fa44948c640 1 --2- 172.21.15.90:0/1814675447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4440d2a20 0x7fa44415dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.755+0000 7fa44948c640 1 --2- 172.21.15.90:0/1814675447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4441616b0 0x7fa4440cd190 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.755+0000 7fa44948c640 1 --2- 172.21.15.90:0/1814675447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4440b5600 0x7fa4441f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.755+0000 7fa44948c640 1 -- 172.21.15.90:0/1814675447 >> 172.21.15.90:0/1814675447 conn(0x7fa4440d4040 msgr2=0x7fa4440cec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:13.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.756+0000 7fa44948c640 1 -- 172.21.15.90:0/1814675447 shutdown_connections 2024-09-10T23:15:13.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.757+0000 7fa44948c640 1 -- 172.21.15.90:0/1814675447 wait complete. 2024-09-10T23:15:13.782 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:15:13.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.888+0000 7ff100f65640 1 -- 172.21.15.90:0/143828885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e8003a00 msgr2=0x7ff0e8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.888+0000 7ff100f65640 1 --2- 172.21.15.90:0/143828885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e8003a00 0x7ff0e8003e00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00c6e0 tx=0x7ff0e8005830 comp rx=0 tx=0).stop 2024-09-10T23:15:13.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.888+0000 7ff100f65640 1 -- 172.21.15.90:0/143828885 shutdown_connections 2024-09-10T23:15:13.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.888+0000 7ff100f65640 1 --2- 172.21.15.90:0/143828885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e8003a00 0x7ff0e8003e00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.888+0000 7ff100f65640 1 -- 172.21.15.90:0/143828885 >> 172.21.15.90:0/143828885 conn(0x7ff0fc0cfc80 msgr2=0x7ff0fc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:13.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.888+0000 7ff100f65640 1 -- 172.21.15.90:0/143828885 shutdown_connections 2024-09-10T23:15:13.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.888+0000 7ff100f65640 1 -- 172.21.15.90:0/143828885 wait complete. 2024-09-10T23:15:13.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.889+0000 7ff100f65640 1 Processor -- start 2024-09-10T23:15:13.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.889+0000 7ff100f65640 1 -- start start 2024-09-10T23:15:13.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.890+0000 7ff100f65640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e8003a00 0x7ff0fc0ce860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:13.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.890+0000 7ff100f65640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0fc0b2010 0x7ff0fc0cf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:13.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.890+0000 7ff100f65640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0fc1f4fb0 0x7ff0fc15a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:13.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.890+0000 7ff100f65640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff0fc0ca830 con 0x7ff0e8003a00 2024-09-10T23:15:13.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.890+0000 7ff100f65640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff0fc0ca6b0 con 0x7ff0fc1f4fb0 2024-09-10T23:15:13.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.890+0000 7ff100f65640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff0fc0ca9b0 con 0x7ff0fc0b2010 2024-09-10T23:15:13.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.890+0000 7ff0fa59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e8003a00 0x7ff0fc0ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:13.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.890+0000 7ff0fa59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e8003a00 0x7ff0fc0ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59536/0 (socket says 172.21.15.90:59536) 2024-09-10T23:15:13.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.890+0000 7ff0fa59c640 1 -- 172.21.15.90:0/3082335168 learned_addr learned my addr 172.21.15.90:0/3082335168 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:13.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.890+0000 7ff0f1d9b640 1 --2- 172.21.15.90:0/3082335168 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0fc0b2010 0x7ff0fc0cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:13.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.890+0000 7ff0fad9d640 1 --2- 172.21.15.90:0/3082335168 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0fc1f4fb0 0x7ff0fc15a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:13.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.890+0000 7ff0fa59c640 1 -- 172.21.15.90:0/3082335168 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0fc0b2010 msgr2=0x7ff0fc0cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.891+0000 7ff0fa59c640 1 --2- 172.21.15.90:0/3082335168 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0fc0b2010 0x7ff0fc0cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.891+0000 7ff0fa59c640 1 -- 172.21.15.90:0/3082335168 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0fc1f4fb0 msgr2=0x7ff0fc15a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.891+0000 7ff0fa59c640 1 --2- 172.21.15.90:0/3082335168 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0fc1f4fb0 0x7ff0fc15a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.891+0000 7ff0fa59c640 1 -- 172.21.15.90:0/3082335168 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0fc0cdaa0 con 0x7ff0e8003a00 2024-09-10T23:15:13.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.891+0000 7ff0fa59c640 1 --2- 172.21.15.90:0/3082335168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e8003a00 0x7ff0fc0ce860 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec02a840 tx=0x7ff0ec006380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:13.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.891+0000 7ff0f37fe640 1 -- 172.21.15.90:0/3082335168 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec004830 con 0x7ff0e8003a00 2024-09-10T23:15:13.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.891+0000 7ff0f37fe640 1 -- 172.21.15.90:0/3082335168 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0ec039070 con 0x7ff0e8003a00 2024-09-10T23:15:13.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.891+0000 7ff100f65640 1 -- 172.21.15.90:0/3082335168 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0fc0cdd80 con 0x7ff0e8003a00 2024-09-10T23:15:13.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.891+0000 7ff0f37fe640 1 -- 172.21.15.90:0/3082335168 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec004c90 con 0x7ff0e8003a00 2024-09-10T23:15:13.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.891+0000 7ff100f65640 1 -- 172.21.15.90:0/3082335168 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0fc0cf670 con 0x7ff0e8003a00 2024-09-10T23:15:13.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.892+0000 7ff100f65640 1 -- 172.21.15.90:0/3082335168 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0fc0cab90 con 0x7ff0e8003a00 2024-09-10T23:15:13.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.893+0000 7ff0f37fe640 1 -- 172.21.15.90:0/3082335168 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff0ec033470 con 0x7ff0e8003a00 2024-09-10T23:15:13.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.893+0000 7ff0f37fe640 1 --2- 172.21.15.90:0/3082335168 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff0dc077fa0 0x7ff0dc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:13.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.893+0000 7ff0f37fe640 1 -- 172.21.15.90:0/3082335168 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5609+0+0 (secure 0 0 0) 0x7ff0ec0b9930 con 0x7ff0e8003a00 2024-09-10T23:15:13.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.893+0000 7ff0f1d9b640 1 --2- 172.21.15.90:0/3082335168 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff0dc077fa0 0x7ff0dc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:13.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.894+0000 7ff0f1d9b640 1 --2- 172.21.15.90:0/3082335168 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff0dc077fa0 0x7ff0dc07a460 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0c6990 tx=0x7ff0e400b260 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:13.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:13.897+0000 7ff0f37fe640 1 -- 172.21.15.90:0/3082335168 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff0ec04a020 con 0x7ff0e8003a00 2024-09-10T23:15:14.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.106+0000 7ff100f65640 1 -- 172.21.15.90:0/3082335168 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff0fc075c70 con 0x7ff0e8003a00 2024-09-10T23:15:14.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.773+0000 7ff0f37fe640 1 -- 172.21.15.90:0/3082335168 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7ff0ec082520 con 0x7ff0e8003a00 2024-09-10T23:15:14.775 INFO:teuthology.orchestra.run.smithi090.stderr:new fs with metadata pool 4 and data pool 5 2024-09-10T23:15:14.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.781+0000 7ff100f65640 1 -- 172.21.15.90:0/3082335168 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff0dc077fa0 msgr2=0x7ff0dc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.781+0000 7ff100f65640 1 --2- 172.21.15.90:0/3082335168 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff0dc077fa0 0x7ff0dc07a460 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0c6990 tx=0x7ff0e400b260 comp rx=0 tx=0).stop 2024-09-10T23:15:14.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.781+0000 7ff100f65640 1 -- 172.21.15.90:0/3082335168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e8003a00 msgr2=0x7ff0fc0ce860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.781+0000 7ff100f65640 1 --2- 172.21.15.90:0/3082335168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e8003a00 0x7ff0fc0ce860 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec02a840 tx=0x7ff0ec006380 comp rx=0 tx=0).stop 2024-09-10T23:15:14.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.781+0000 7ff100f65640 1 -- 172.21.15.90:0/3082335168 shutdown_connections 2024-09-10T23:15:14.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.781+0000 7ff100f65640 1 --2- 172.21.15.90:0/3082335168 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff0dc077fa0 0x7ff0dc07a460 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0c6990 tx=0x7ff0e400b260 comp rx=0 tx=0).stop 2024-09-10T23:15:14.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.781+0000 7ff100f65640 1 --2- 172.21.15.90:0/3082335168 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0fc1f4fb0 0x7ff0fc15a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.781+0000 7ff100f65640 1 --2- 172.21.15.90:0/3082335168 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0fc0b2010 0x7ff0fc0cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.781+0000 7ff100f65640 1 --2- 172.21.15.90:0/3082335168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e8003a00 0x7ff0fc0ce860 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.781+0000 7ff100f65640 1 -- 172.21.15.90:0/3082335168 >> 172.21.15.90:0/3082335168 conn(0x7ff0fc0cfc80 msgr2=0x7ff0fc159700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:14.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.781+0000 7ff100f65640 1 -- 172.21.15.90:0/3082335168 shutdown_connections 2024-09-10T23:15:14.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.781+0000 7ff100f65640 1 -- 172.21.15.90:0/3082335168 wait complete. 2024-09-10T23:15:14.802 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:14.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.903+0000 7f5ae54ed640 1 -- 172.21.15.90:0/3581519855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ae00d0ab0 msgr2=0x7f5ae00d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.903+0000 7f5ae54ed640 1 --2- 172.21.15.90:0/3581519855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ae00d0ab0 0x7f5ae00d0f60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5ae008d0d0 tx=0x7f5ad802a560 comp rx=0 tx=0).stop 2024-09-10T23:15:14.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.903+0000 7f5ae54ed640 1 -- 172.21.15.90:0/3581519855 shutdown_connections 2024-09-10T23:15:14.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.903+0000 7f5ae54ed640 1 --2- 172.21.15.90:0/3581519855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ae00d0ab0 0x7f5ae00d0f60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.903+0000 7f5ae54ed640 1 --2- 172.21.15.90:0/3581519855 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ae00d1c70 0x7f5ae00d2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.903+0000 7f5ae54ed640 1 --2- 172.21.15.90:0/3581519855 >> v2:172.21.15.171:3300/0 conn(0x7f5ae00d2470 0x7f5ae00b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.903+0000 7f5ae54ed640 1 -- 172.21.15.90:0/3581519855 >> 172.21.15.90:0/3581519855 conn(0x7f5ae009d2a0 msgr2=0x7f5ae00d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:14.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.903+0000 7f5ae54ed640 1 -- 172.21.15.90:0/3581519855 shutdown_connections 2024-09-10T23:15:14.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.903+0000 7f5ae54ed640 1 -- 172.21.15.90:0/3581519855 wait complete. 2024-09-10T23:15:14.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.905+0000 7f5ae54ed640 1 Processor -- start 2024-09-10T23:15:14.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.905+0000 7f5ae54ed640 1 -- start start 2024-09-10T23:15:14.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.905+0000 7f5ae54ed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ae00d0ab0 0x7f5ae015c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:14.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.905+0000 7f5ae54ed640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ae00d1c70 0x7f5ae01597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:14.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.905+0000 7f5ae54ed640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ae00d2470 0x7f5ae01f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:14.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.905+0000 7f5ae54ed640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae015e4a0 con 0x7f5ae00d0ab0 2024-09-10T23:15:14.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.905+0000 7f5ae54ed640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae015e320 con 0x7f5ae00d2470 2024-09-10T23:15:14.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.905+0000 7f5ae54ed640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5ae00d14a0 con 0x7f5ae00d1c70 2024-09-10T23:15:14.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.905+0000 7f5adeffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ae00d0ab0 0x7f5ae015c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:14.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.905+0000 7f5adeffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ae00d0ab0 0x7f5ae015c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59550/0 (socket says 172.21.15.90:59550) 2024-09-10T23:15:14.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.905+0000 7f5adeffd640 1 -- 172.21.15.90:0/3545718538 learned_addr learned my addr 172.21.15.90:0/3545718538 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:14.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.906+0000 7f5ade7fc640 1 --2- 172.21.15.90:0/3545718538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ae00d1c70 0x7f5ae01597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:14.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.906+0000 7f5adf7fe640 1 --2- 172.21.15.90:0/3545718538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ae00d2470 0x7f5ae01f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:14.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.906+0000 7f5adeffd640 1 -- 172.21.15.90:0/3545718538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ae00d1c70 msgr2=0x7f5ae01597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.906+0000 7f5adeffd640 1 --2- 172.21.15.90:0/3545718538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ae00d1c70 0x7f5ae01597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.906+0000 7f5adeffd640 1 -- 172.21.15.90:0/3545718538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ae00d2470 msgr2=0x7f5ae01f7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.906+0000 7f5adeffd640 1 --2- 172.21.15.90:0/3545718538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ae00d2470 0x7f5ae01f7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.906+0000 7f5adeffd640 1 -- 172.21.15.90:0/3545718538 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ae015b530 con 0x7f5ae00d0ab0 2024-09-10T23:15:14.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.906+0000 7f5adeffd640 1 --2- 172.21.15.90:0/3545718538 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ae00d0ab0 0x7f5ae015c5d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000ea20 tx=0x7f5ad000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:14.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.906+0000 7f5ad77fe640 1 -- 172.21.15.90:0/3545718538 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000cd80 con 0x7f5ae00d0ab0 2024-09-10T23:15:14.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.906+0000 7f5ad77fe640 1 -- 172.21.15.90:0/3545718538 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ad0011560 con 0x7f5ae00d0ab0 2024-09-10T23:15:14.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.906+0000 7f5ad77fe640 1 -- 172.21.15.90:0/3545718538 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0011990 con 0x7f5ae00d0ab0 2024-09-10T23:15:14.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.906+0000 7f5ae54ed640 1 -- 172.21.15.90:0/3545718538 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ae015b810 con 0x7f5ae00d0ab0 2024-09-10T23:15:14.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.906+0000 7f5ae54ed640 1 -- 172.21.15.90:0/3545718538 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ae015bdd0 con 0x7f5ae00d0ab0 2024-09-10T23:15:14.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.907+0000 7f5ae54ed640 1 -- 172.21.15.90:0/3545718538 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ae00d0f60 con 0x7f5ae00d0ab0 2024-09-10T23:15:14.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.908+0000 7f5ad77fe640 1 -- 172.21.15.90:0/3545718538 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5ad0022030 con 0x7f5ae00d0ab0 2024-09-10T23:15:14.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.908+0000 7f5ad77fe640 1 --2- 172.21.15.90:0/3545718538 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ac0077f70 0x7f5ac007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:14.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.908+0000 7f5ad77fe640 1 -- 172.21.15.90:0/3545718538 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f5ad009a470 con 0x7f5ae00d0ab0 2024-09-10T23:15:14.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.908+0000 7f5ade7fc640 1 --2- 172.21.15.90:0/3545718538 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ac0077f70 0x7f5ac007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:14.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.909+0000 7f5ade7fc640 1 --2- 172.21.15.90:0/3545718538 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ac0077f70 0x7f5ac007a430 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00c78d0 tx=0x7f5ac800b310 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:14.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:14.912+0000 7f5ad77fe640 1 -- 172.21.15.90:0/3545718538 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5ad0016030 con 0x7f5ae00d0ab0 2024-09-10T23:15:15.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.088+0000 7f5ae54ed640 1 -- 172.21.15.90:0/3545718538 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ae00d2b70 con 0x7f5ae00d0ab0 2024-09-10T23:15:15.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.089+0000 7f5ad77fe640 1 -- 172.21.15.90:0/3545718538 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16742 (secure 0 0 0) 0x7f5ad0062920 con 0x7f5ae00d0ab0 2024-09-10T23:15:15.090 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:15.090 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":33,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:15:14.107955+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:11.940848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:13.069613+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:15.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.091+0000 7f5ae54ed640 1 -- 172.21.15.90:0/3545718538 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ac0077f70 msgr2=0x7f5ac007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.091+0000 7f5ae54ed640 1 --2- 172.21.15.90:0/3545718538 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ac0077f70 0x7f5ac007a430 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00c78d0 tx=0x7f5ac800b310 comp rx=0 tx=0).stop 2024-09-10T23:15:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.091+0000 7f5ae54ed640 1 -- 172.21.15.90:0/3545718538 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ae00d0ab0 msgr2=0x7f5ae015c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.091+0000 7f5ae54ed640 1 --2- 172.21.15.90:0/3545718538 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ae00d0ab0 0x7f5ae015c5d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000ea20 tx=0x7f5ad000eee0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.091+0000 7f5ae54ed640 1 -- 172.21.15.90:0/3545718538 shutdown_connections 2024-09-10T23:15:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.091+0000 7f5ae54ed640 1 --2- 172.21.15.90:0/3545718538 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ac0077f70 0x7f5ac007a430 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.091+0000 7f5ae54ed640 1 --2- 172.21.15.90:0/3545718538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ae00d2470 0x7f5ae01f7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.091+0000 7f5ae54ed640 1 --2- 172.21.15.90:0/3545718538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ae00d1c70 0x7f5ae01597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.091+0000 7f5ae54ed640 1 --2- 172.21.15.90:0/3545718538 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ae00d0ab0 0x7f5ae015c5d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.091+0000 7f5ae54ed640 1 -- 172.21.15.90:0/3545718538 >> 172.21.15.90:0/3545718538 conn(0x7f5ae009d2a0 msgr2=0x7f5ae00cb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.091+0000 7f5ae54ed640 1 -- 172.21.15.90:0/3545718538 shutdown_connections 2024-09-10T23:15:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.091+0000 7f5ae54ed640 1 -- 172.21.15.90:0/3545718538 wait complete. 2024-09-10T23:15:15.103 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:15.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.204+0000 7ffa9fdf3640 1 -- 172.21.15.90:0/1780790550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa980ca960 msgr2=0x7ffa980b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.204+0000 7ffa9fdf3640 1 --2- 172.21.15.90:0/1780790550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa980ca960 0x7ffa980b1850 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009830 tx=0x7ffa8802a510 comp rx=0 tx=0).stop 2024-09-10T23:15:15.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.204+0000 7ffa9fdf3640 1 -- 172.21.15.90:0/1780790550 shutdown_connections 2024-09-10T23:15:15.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.204+0000 7ffa9fdf3640 1 --2- 172.21.15.90:0/1780790550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa980ca960 0x7ffa980b1850 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.204+0000 7ffa9fdf3640 1 --2- 172.21.15.90:0/1780790550 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa9815aa30 0x7ffa980ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.204+0000 7ffa9fdf3640 1 -- 172.21.15.90:0/1780790550 >> 172.21.15.90:0/1780790550 conn(0x7ffa980cc850 msgr2=0x7ffa980ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:15.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.204+0000 7ffa9fdf3640 1 -- 172.21.15.90:0/1780790550 shutdown_connections 2024-09-10T23:15:15.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.204+0000 7ffa9fdf3640 1 -- 172.21.15.90:0/1780790550 wait complete. 2024-09-10T23:15:15.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.205+0000 7ffa9fdf3640 1 Processor -- start 2024-09-10T23:15:15.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.206+0000 7ffa9fdf3640 1 -- start start 2024-09-10T23:15:15.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.206+0000 7ffa9fdf3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa9815aa30 0x7ffa980c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:15.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.206+0000 7ffa9fdf3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa9815ae10 0x7ffa981f8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:15.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.206+0000 7ffa9fdf3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa980c63a0 0x7ffa981f8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:15.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.206+0000 7ffa9fdf3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffa980b2120 con 0x7ffa9815aa30 2024-09-10T23:15:15.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.206+0000 7ffa9fdf3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffa980b1fa0 con 0x7ffa9815ae10 2024-09-10T23:15:15.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.206+0000 7ffa9fdf3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffa9806fcd0 con 0x7ffa980c63a0 2024-09-10T23:15:15.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.206+0000 7ffa9db8f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa9815aa30 0x7ffa980c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:15.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.206+0000 7ffa9db8f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa9815aa30 0x7ffa980c5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59552/0 (socket says 172.21.15.90:59552) 2024-09-10T23:15:15.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.206+0000 7ffa9db8f640 1 -- 172.21.15.90:0/3685395301 learned_addr learned my addr 172.21.15.90:0/3685395301 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:15.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.206+0000 7ffa9e390640 1 --2- 172.21.15.90:0/3685395301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa980c63a0 0x7ffa981f8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:15.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.206+0000 7ffa9d38e640 1 --2- 172.21.15.90:0/3685395301 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa9815ae10 0x7ffa981f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:15.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.207+0000 7ffa9db8f640 1 -- 172.21.15.90:0/3685395301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa980c63a0 msgr2=0x7ffa981f8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.207+0000 7ffa9db8f640 1 --2- 172.21.15.90:0/3685395301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa980c63a0 0x7ffa981f8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.207+0000 7ffa9db8f640 1 -- 172.21.15.90:0/3685395301 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa9815ae10 msgr2=0x7ffa981f8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.207+0000 7ffa9db8f640 1 --2- 172.21.15.90:0/3685395301 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa9815ae10 0x7ffa981f8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.207+0000 7ffa9db8f640 1 -- 172.21.15.90:0/3685395301 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa981f4740 con 0x7ffa9815aa30 2024-09-10T23:15:15.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.207+0000 7ffa9db8f640 1 --2- 172.21.15.90:0/3685395301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa9815aa30 0x7ffa980c5e60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400e9c0 tx=0x7ffa9400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:15.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.207+0000 7ffa8e7fc640 1 -- 172.21.15.90:0/3685395301 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400ccc0 con 0x7ffa9815aa30 2024-09-10T23:15:15.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.207+0000 7ffa8e7fc640 1 -- 172.21.15.90:0/3685395301 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa94005020 con 0x7ffa9815aa30 2024-09-10T23:15:15.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.207+0000 7ffa9fdf3640 1 -- 172.21.15.90:0/3685395301 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa981f4a00 con 0x7ffa9815aa30 2024-09-10T23:15:15.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.207+0000 7ffa8e7fc640 1 -- 172.21.15.90:0/3685395301 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400ce60 con 0x7ffa9815aa30 2024-09-10T23:15:15.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.207+0000 7ffa9fdf3640 1 -- 172.21.15.90:0/3685395301 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa981f4fc0 con 0x7ffa9815aa30 2024-09-10T23:15:15.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.208+0000 7ffa9fdf3640 1 -- 172.21.15.90:0/3685395301 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa980701f0 con 0x7ffa9815aa30 2024-09-10T23:15:15.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.209+0000 7ffa8e7fc640 1 -- 172.21.15.90:0/3685395301 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ffa94005450 con 0x7ffa9815aa30 2024-09-10T23:15:15.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.209+0000 7ffa8e7fc640 1 --2- 172.21.15.90:0/3685395301 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa7c077f70 0x7ffa7c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:15.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.209+0000 7ffa8e7fc640 1 -- 172.21.15.90:0/3685395301 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ffa9409a5c0 con 0x7ffa9815aa30 2024-09-10T23:15:15.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.210+0000 7ffa9d38e640 1 --2- 172.21.15.90:0/3685395301 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa7c077f70 0x7ffa7c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:15.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.210+0000 7ffa9d38e640 1 --2- 172.21.15.90:0/3685395301 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa7c077f70 0x7ffa7c07a430 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa88034000 tx=0x7ffa88004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:15.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.213+0000 7ffa8e7fc640 1 -- 172.21.15.90:0/3685395301 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ffa94062a80 con 0x7ffa9815aa30 2024-09-10T23:15:15.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.388+0000 7ffa9fdf3640 1 -- 172.21.15.90:0/3685395301 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa9809e090 con 0x7ffa9815aa30 2024-09-10T23:15:15.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.389+0000 7ffa8e7fc640 1 -- 172.21.15.90:0/3685395301 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16742 (secure 0 0 0) 0x7ffa940674b0 con 0x7ffa9815aa30 2024-09-10T23:15:15.390 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:15.390 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":33,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:15:14.107955+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:11.940848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:13.069613+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:15.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.391+0000 7ffa9fdf3640 1 -- 172.21.15.90:0/3685395301 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa7c077f70 msgr2=0x7ffa7c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.391+0000 7ffa9fdf3640 1 --2- 172.21.15.90:0/3685395301 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa7c077f70 0x7ffa7c07a430 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa88034000 tx=0x7ffa88004730 comp rx=0 tx=0).stop 2024-09-10T23:15:15.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.391+0000 7ffa9fdf3640 1 -- 172.21.15.90:0/3685395301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa9815aa30 msgr2=0x7ffa980c5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.391+0000 7ffa9fdf3640 1 --2- 172.21.15.90:0/3685395301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa9815aa30 0x7ffa980c5e60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400e9c0 tx=0x7ffa9400ee80 comp rx=0 tx=0).stop 2024-09-10T23:15:15.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.391+0000 7ffa9fdf3640 1 -- 172.21.15.90:0/3685395301 shutdown_connections 2024-09-10T23:15:15.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.391+0000 7ffa9fdf3640 1 --2- 172.21.15.90:0/3685395301 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa7c077f70 0x7ffa7c07a430 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.391+0000 7ffa9fdf3640 1 --2- 172.21.15.90:0/3685395301 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa9815ae10 0x7ffa981f8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.391+0000 7ffa9fdf3640 1 --2- 172.21.15.90:0/3685395301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa980c63a0 0x7ffa981f8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.391+0000 7ffa9fdf3640 1 --2- 172.21.15.90:0/3685395301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa9815aa30 0x7ffa980c5e60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.391+0000 7ffa9fdf3640 1 -- 172.21.15.90:0/3685395301 >> 172.21.15.90:0/3685395301 conn(0x7ffa980cc850 msgr2=0x7ffa980ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:15.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.391+0000 7ffa9fdf3640 1 -- 172.21.15.90:0/3685395301 shutdown_connections 2024-09-10T23:15:15.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.391+0000 7ffa9fdf3640 1 -- 172.21.15.90:0/3685395301 wait complete. 2024-09-10T23:15:15.403 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:15:15.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.506+0000 7f63b00bd640 1 -- 172.21.15.90:0/1645164916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63940051c0 msgr2=0x7f639400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.506+0000 7f63b00bd640 1 --2- 172.21.15.90:0/1645164916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63940051c0 0x7f639400b9c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009ed0 tx=0x7f6394005830 comp rx=0 tx=0).stop 2024-09-10T23:15:15.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.506+0000 7f63b00bd640 1 -- 172.21.15.90:0/1645164916 shutdown_connections 2024-09-10T23:15:15.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.506+0000 7f63b00bd640 1 --2- 172.21.15.90:0/1645164916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63940051c0 0x7f639400b9c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.506+0000 7f63b00bd640 1 -- 172.21.15.90:0/1645164916 >> 172.21.15.90:0/1645164916 conn(0x7f63a80cfc80 msgr2=0x7f63a80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:15.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.506+0000 7f63b00bd640 1 -- 172.21.15.90:0/1645164916 shutdown_connections 2024-09-10T23:15:15.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.506+0000 7f63b00bd640 1 -- 172.21.15.90:0/1645164916 wait complete. 2024-09-10T23:15:15.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.507+0000 7f63b00bd640 1 Processor -- start 2024-09-10T23:15:15.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.507+0000 7f63b00bd640 1 -- start start 2024-09-10T23:15:15.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.508+0000 7f63b00bd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63940051c0 0x7f63a81f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.508+0000 7f63b00bd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63a81e9650 0x7f63a8153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.508+0000 7f63b00bd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a81e88c0 0x7f63a80c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.508+0000 7f63b00bd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f63a80cf770 con 0x7f63a81e88c0 2024-09-10T23:15:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.508+0000 7f63b00bd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f63a80cf5f0 con 0x7f63940051c0 2024-09-10T23:15:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.508+0000 7f63b00bd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f63a80ca2d0 con 0x7f63a81e9650 2024-09-10T23:15:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.508+0000 7f63ae65a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a81e88c0 0x7f63a80c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.508+0000 7f63ae65a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a81e88c0 0x7f63a80c37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59570/0 (socket says 172.21.15.90:59570) 2024-09-10T23:15:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.508+0000 7f63ae65a640 1 -- 172.21.15.90:0/228677449 learned_addr learned my addr 172.21.15.90:0/228677449 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.508+0000 7f63ad658640 1 --2- 172.21.15.90:0/228677449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63a81e9650 0x7f63a8153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.508+0000 7f63ade59640 1 --2- 172.21.15.90:0/228677449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63940051c0 0x7f63a81f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.508+0000 7f63ae65a640 1 -- 172.21.15.90:0/228677449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63a81e9650 msgr2=0x7f63a8153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.508+0000 7f63ae65a640 1 --2- 172.21.15.90:0/228677449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63a81e9650 0x7f63a8153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.508+0000 7f63ae65a640 1 -- 172.21.15.90:0/228677449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63940051c0 msgr2=0x7f63a81f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.508+0000 7f63ae65a640 1 --2- 172.21.15.90:0/228677449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63940051c0 0x7f63a81f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.509+0000 7f63ae65a640 1 -- 172.21.15.90:0/228677449 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a81e7b20 con 0x7f63a81e88c0 2024-09-10T23:15:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.509+0000 7f63ade59640 1 --2- 172.21.15.90:0/228677449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63940051c0 0x7f63a81f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.509+0000 7f63ae65a640 1 --2- 172.21.15.90:0/228677449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a81e88c0 0x7f63a80c37b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009e20 tx=0x7f63a00042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.509+0000 7f639e7fc640 1 -- 172.21.15.90:0/228677449 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a00046d0 con 0x7f63a81e88c0 2024-09-10T23:15:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.509+0000 7f639e7fc640 1 -- 172.21.15.90:0/228677449 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63a003c480 con 0x7f63a81e88c0 2024-09-10T23:15:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.509+0000 7f639e7fc640 1 -- 172.21.15.90:0/228677449 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a003c890 con 0x7f63a81e88c0 2024-09-10T23:15:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.509+0000 7f63b00bd640 1 -- 172.21.15.90:0/228677449 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a81e7e00 con 0x7f63a81e88c0 2024-09-10T23:15:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.509+0000 7f63b00bd640 1 -- 172.21.15.90:0/228677449 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a81e83c0 con 0x7f63a81e88c0 2024-09-10T23:15:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.510+0000 7f63b00bd640 1 -- 172.21.15.90:0/228677449 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a806e680 con 0x7f63a81e88c0 2024-09-10T23:15:15.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.511+0000 7f639e7fc640 1 -- 172.21.15.90:0/228677449 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f63a003ca30 con 0x7f63a81e88c0 2024-09-10T23:15:15.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.511+0000 7f639e7fc640 1 --2- 172.21.15.90:0/228677449 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f638c077fa0 0x7f638c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:15.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.511+0000 7f639e7fc640 1 -- 172.21.15.90:0/228677449 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f63a00badb0 con 0x7f63a81e88c0 2024-09-10T23:15:15.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.511+0000 7f63ade59640 1 --2- 172.21.15.90:0/228677449 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f638c077fa0 0x7f638c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:15.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.512+0000 7f63ade59640 1 --2- 172.21.15.90:0/228677449 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f638c077fa0 0x7f638c07a460 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f63a4000c00 tx=0x7f63a4006130 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:15.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.515+0000 7f639e7fc640 1 -- 172.21.15.90:0/228677449 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f63a004b020 con 0x7f63a81e88c0 2024-09-10T23:15:15.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.724+0000 7f63b00bd640 1 -- 172.21.15.90:0/228677449 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f63a81ea750 con 0x7f63a81e88c0 2024-09-10T23:15:15.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.779+0000 7f639e7fc640 1 -- 172.21.15.90:0/228677449 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7f63a0083940 con 0x7f63a81e88c0 2024-09-10T23:15:15.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.782+0000 7f63b00bd640 1 -- 172.21.15.90:0/228677449 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f638c077fa0 msgr2=0x7f638c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.782+0000 7f63b00bd640 1 --2- 172.21.15.90:0/228677449 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f638c077fa0 0x7f638c07a460 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f63a4000c00 tx=0x7f63a4006130 comp rx=0 tx=0).stop 2024-09-10T23:15:15.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.782+0000 7f63b00bd640 1 -- 172.21.15.90:0/228677449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a81e88c0 msgr2=0x7f63a80c37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.782+0000 7f63b00bd640 1 --2- 172.21.15.90:0/228677449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a81e88c0 0x7f63a80c37b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009e20 tx=0x7f63a00042d0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.782+0000 7f63b00bd640 1 -- 172.21.15.90:0/228677449 shutdown_connections 2024-09-10T23:15:15.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.782+0000 7f63b00bd640 1 --2- 172.21.15.90:0/228677449 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f638c077fa0 0x7f638c07a460 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.782+0000 7f63b00bd640 1 --2- 172.21.15.90:0/228677449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63a81e88c0 0x7f63a80c37b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.782+0000 7f63b00bd640 1 --2- 172.21.15.90:0/228677449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63a81e9650 0x7f63a8153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.782+0000 7f63b00bd640 1 --2- 172.21.15.90:0/228677449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63940051c0 0x7f63a81f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.782+0000 7f63b00bd640 1 -- 172.21.15.90:0/228677449 >> 172.21.15.90:0/228677449 conn(0x7f63a80cfc80 msgr2=0x7f63a80725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:15.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.782+0000 7f63b00bd640 1 -- 172.21.15.90:0/228677449 shutdown_connections 2024-09-10T23:15:15.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.782+0000 7f63b00bd640 1 -- 172.21.15.90:0/228677449 wait complete. 2024-09-10T23:15:15.794 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:15:15.794 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:15:15.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.899+0000 7f82c56b8640 1 -- 172.21.15.90:0/1525257282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a8003a50 msgr2=0x7f82a8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.899+0000 7f82c56b8640 1 --2- 172.21.15.90:0/1525257282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a8003a50 0x7f82a8003e70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009ed0 tx=0x7f82a8005830 comp rx=0 tx=0).stop 2024-09-10T23:15:15.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.899+0000 7f82c56b8640 1 -- 172.21.15.90:0/1525257282 shutdown_connections 2024-09-10T23:15:15.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.899+0000 7f82c56b8640 1 --2- 172.21.15.90:0/1525257282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a8003a50 0x7f82a8003e70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.899+0000 7f82c56b8640 1 -- 172.21.15.90:0/1525257282 >> 172.21.15.90:0/1525257282 conn(0x7f82c00d1f20 msgr2=0x7f82c00d2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:15.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.899+0000 7f82c56b8640 1 -- 172.21.15.90:0/1525257282 shutdown_connections 2024-09-10T23:15:15.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.899+0000 7f82c56b8640 1 -- 172.21.15.90:0/1525257282 wait complete. 2024-09-10T23:15:15.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.900+0000 7f82c56b8640 1 Processor -- start 2024-09-10T23:15:15.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.900+0000 7f82c56b8640 1 -- start start 2024-09-10T23:15:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82c56b8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a8003a50 0x7f82c015c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82c56b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82c00c47f0 0x7f82c0151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82c56b8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82c00c4d40 0x7f82c0071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82c56b8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f82c00cce20 con 0x7f82a8003a50 2024-09-10T23:15:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82c56b8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f82c00ccca0 con 0x7f82c00c4d40 2024-09-10T23:15:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82c56b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f82c00ccfa0 con 0x7f82c00c47f0 2024-09-10T23:15:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82beffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a8003a50 0x7f82c015c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82beffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a8003a50 0x7f82c015c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59588/0 (socket says 172.21.15.90:59588) 2024-09-10T23:15:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82beffd640 1 -- 172.21.15.90:0/3092113254 learned_addr learned my addr 172.21.15.90:0/3092113254 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82be7fc640 1 --2- 172.21.15.90:0/3092113254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82c00c47f0 0x7f82c0151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82bf7fe640 1 --2- 172.21.15.90:0/3092113254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82c00c4d40 0x7f82c0071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82beffd640 1 -- 172.21.15.90:0/3092113254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82c00c47f0 msgr2=0x7f82c0151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82beffd640 1 --2- 172.21.15.90:0/3092113254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82c00c47f0 0x7f82c0151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82beffd640 1 -- 172.21.15.90:0/3092113254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82c00c4d40 msgr2=0x7f82c0071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82beffd640 1 --2- 172.21.15.90:0/3092113254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82c00c4d40 0x7f82c0071cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82beffd640 1 -- 172.21.15.90:0/3092113254 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c006dce0 con 0x7f82a8003a50 2024-09-10T23:15:15.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82bf7fe640 1 --2- 172.21.15.90:0/3092113254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82c00c4d40 0x7f82c0071cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:15.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82beffd640 1 --2- 172.21.15.90:0/3092113254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a8003a50 0x7f82c015c9f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009e20 tx=0x7f82b0033cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:15.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82a77fe640 1 -- 172.21.15.90:0/3092113254 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0038040 con 0x7f82a8003a50 2024-09-10T23:15:15.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82a77fe640 1 -- 172.21.15.90:0/3092113254 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82b0041070 con 0x7f82a8003a50 2024-09-10T23:15:15.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82c56b8640 1 -- 172.21.15.90:0/3092113254 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c006dfc0 con 0x7f82a8003a50 2024-09-10T23:15:15.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82a77fe640 1 -- 172.21.15.90:0/3092113254 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b003c690 con 0x7f82a8003a50 2024-09-10T23:15:15.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.901+0000 7f82c56b8640 1 -- 172.21.15.90:0/3092113254 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c006e580 con 0x7f82a8003a50 2024-09-10T23:15:15.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.902+0000 7f82c56b8640 1 -- 172.21.15.90:0/3092113254 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c00ce760 con 0x7f82a8003a50 2024-09-10T23:15:15.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.903+0000 7f82a77fe640 1 -- 172.21.15.90:0/3092113254 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f82b003b070 con 0x7f82a8003a50 2024-09-10T23:15:15.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.903+0000 7f82a77fe640 1 --2- 172.21.15.90:0/3092113254 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f82ac077f70 0x7f82ac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:15.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.904+0000 7f82a77fe640 1 -- 172.21.15.90:0/3092113254 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f82b00ba720 con 0x7f82a8003a50 2024-09-10T23:15:15.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.904+0000 7f82be7fc640 1 --2- 172.21.15.90:0/3092113254 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f82ac077f70 0x7f82ac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:15.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.904+0000 7f82be7fc640 1 --2- 172.21.15.90:0/3092113254 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f82ac077f70 0x7f82ac07a430 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f82c00b7e90 tx=0x7f82b4006b80 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:15.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:15.908+0000 7f82a77fe640 1 -- 172.21.15.90:0/3092113254 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f82b0083190 con 0x7f82a8003a50 2024-09-10T23:15:16.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.119+0000 7f82c56b8640 1 -- 172.21.15.90:0/3092113254 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f82c0050ee0 con 0x7f82a8003a50 2024-09-10T23:15:16.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.785+0000 7f82a77fe640 1 -- 172.21.15.90:0/3092113254 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f82b0082a90 con 0x7f82a8003a50 2024-09-10T23:15:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.787+0000 7f82c56b8640 1 -- 172.21.15.90:0/3092113254 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f82ac077f70 msgr2=0x7f82ac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.787+0000 7f82c56b8640 1 --2- 172.21.15.90:0/3092113254 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f82ac077f70 0x7f82ac07a430 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f82c00b7e90 tx=0x7f82b4006b80 comp rx=0 tx=0).stop 2024-09-10T23:15:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.787+0000 7f82c56b8640 1 -- 172.21.15.90:0/3092113254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a8003a50 msgr2=0x7f82c015c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.787+0000 7f82c56b8640 1 --2- 172.21.15.90:0/3092113254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a8003a50 0x7f82c015c9f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009e20 tx=0x7f82b0033cb0 comp rx=0 tx=0).stop 2024-09-10T23:15:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.787+0000 7f82c56b8640 1 -- 172.21.15.90:0/3092113254 shutdown_connections 2024-09-10T23:15:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.787+0000 7f82c56b8640 1 --2- 172.21.15.90:0/3092113254 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f82ac077f70 0x7f82ac07a430 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.787+0000 7f82c56b8640 1 --2- 172.21.15.90:0/3092113254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82c00c4d40 0x7f82c0071cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.787+0000 7f82c56b8640 1 --2- 172.21.15.90:0/3092113254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82c00c47f0 0x7f82c0151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.787+0000 7f82c56b8640 1 --2- 172.21.15.90:0/3092113254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a8003a50 0x7f82c015c9f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.787+0000 7f82c56b8640 1 -- 172.21.15.90:0/3092113254 >> 172.21.15.90:0/3092113254 conn(0x7f82c00d1f20 msgr2=0x7f82c015a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.788+0000 7f82c56b8640 1 -- 172.21.15.90:0/3092113254 shutdown_connections 2024-09-10T23:15:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.788+0000 7f82c56b8640 1 -- 172.21.15.90:0/3092113254 wait complete. 2024-09-10T23:15:16.801 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:15:16.801 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.904+0000 7f55ac518640 1 -- 172.21.15.90:0/2101195353 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f558c003a30 msgr2=0x7f558c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.904+0000 7f55ac518640 1 --2- 172.21.15.90:0/2101195353 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f558c003a30 0x7f558c003e50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5594001dc0 tx=0x7f558c005830 comp rx=0 tx=0).stop 2024-09-10T23:15:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.904+0000 7f55aaab5640 1 -- 172.21.15.90:0/2101195353 reap_dead start 2024-09-10T23:15:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.904+0000 7f55ac518640 1 -- 172.21.15.90:0/2101195353 shutdown_connections 2024-09-10T23:15:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.904+0000 7f55ac518640 1 -- 172.21.15.90:0/2101195353 >> 172.21.15.90:0/2101195353 conn(0x7f55a40d0c20 msgr2=0x7f55a40d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.904+0000 7f55ac518640 1 -- 172.21.15.90:0/2101195353 shutdown_connections 2024-09-10T23:15:16.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.904+0000 7f55ac518640 1 -- 172.21.15.90:0/2101195353 wait complete. 2024-09-10T23:15:16.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.905+0000 7f55ac518640 1 Processor -- start 2024-09-10T23:15:16.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.905+0000 7f55ac518640 1 -- start start 2024-09-10T23:15:16.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55ac518640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f558c003a30 0x7f55a41efd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:16.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55ac518640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55a40b5a60 0x7f55a40b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:16.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55ac518640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55a41f2b50 0x7f55a41f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:16.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55ac518640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f55a415f000 con 0x7f55a41f2b50 2024-09-10T23:15:16.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55ac518640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f55a415ee80 con 0x7f558c003a30 2024-09-10T23:15:16.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55ac518640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f55a415f180 con 0x7f55a40b5a60 2024-09-10T23:15:16.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55aaab5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55a41f2b50 0x7f55a41f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:16.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55aaab5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55a41f2b50 0x7f55a41f3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59594/0 (socket says 172.21.15.90:59594) 2024-09-10T23:15:16.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55aaab5640 1 -- 172.21.15.90:0/2549193942 learned_addr learned my addr 172.21.15.90:0/2549193942 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:16.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55a9ab3640 1 --2- 172.21.15.90:0/2549193942 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55a40b5a60 0x7f55a40b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55aa2b4640 1 --2- 172.21.15.90:0/2549193942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f558c003a30 0x7f55a41efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55aaab5640 1 -- 172.21.15.90:0/2549193942 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55a40b5a60 msgr2=0x7f55a40b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55aaab5640 1 --2- 172.21.15.90:0/2549193942 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55a40b5a60 0x7f55a40b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55aaab5640 1 -- 172.21.15.90:0/2549193942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f558c003a30 msgr2=0x7f55a41efd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55aaab5640 1 --2- 172.21.15.90:0/2549193942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f558c003a30 0x7f55a41efd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55aaab5640 1 -- 172.21.15.90:0/2549193942 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a41f3880 con 0x7f55a41f2b50 2024-09-10T23:15:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55aa2b4640 1 --2- 172.21.15.90:0/2549193942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f558c003a30 0x7f55a41efd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55aaab5640 1 --2- 172.21.15.90:0/2549193942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55a41f2b50 0x7f55a41f3000 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f55a406f9a0 tx=0x7f559c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55a2ffd640 1 -- 172.21.15.90:0/2549193942 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c015070 con 0x7f55a41f2b50 2024-09-10T23:15:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55a2ffd640 1 -- 172.21.15.90:0/2549193942 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f559c011840 con 0x7f55a41f2b50 2024-09-10T23:15:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55ac518640 1 -- 172.21.15.90:0/2549193942 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a4144a20 con 0x7f55a41f2b50 2024-09-10T23:15:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.906+0000 7f55a2ffd640 1 -- 172.21.15.90:0/2549193942 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c011c90 con 0x7f55a41f2b50 2024-09-10T23:15:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.907+0000 7f55ac518640 1 -- 172.21.15.90:0/2549193942 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a4143c60 con 0x7f55a41f2b50 2024-09-10T23:15:16.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.907+0000 7f55ac518640 1 -- 172.21.15.90:0/2549193942 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a40c7240 con 0x7f55a41f2b50 2024-09-10T23:15:16.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.908+0000 7f55a2ffd640 1 -- 172.21.15.90:0/2549193942 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f559c0103c0 con 0x7f55a41f2b50 2024-09-10T23:15:16.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.909+0000 7f55a2ffd640 1 --2- 172.21.15.90:0/2549193942 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5590077f70 0x7f559007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:16.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.909+0000 7f55a2ffd640 1 -- 172.21.15.90:0/2549193942 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f559c09ac00 con 0x7f55a41f2b50 2024-09-10T23:15:16.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.909+0000 7f55aa2b4640 1 --2- 172.21.15.90:0/2549193942 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5590077f70 0x7f559007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:16.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.909+0000 7f55aa2b4640 1 --2- 172.21.15.90:0/2549193942 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5590077f70 0x7f559007a430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5594032000 tx=0x7f5594001510 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:16.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:16.913+0000 7f55a2ffd640 1 -- 172.21.15.90:0/2549193942 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f55a40c7240 con 0x7f55a41f2b50 2024-09-10T23:15:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.120+0000 7f55ac518640 1 -- 172.21.15.90:0/2549193942 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55a40b6ba0 con 0x7f55a41f2b50 2024-09-10T23:15:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.121+0000 7f55a2ffd640 1 -- 172.21.15.90:0/2549193942 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5220 (secure 0 0 0) 0x7f559c0a1080 con 0x7f55a41f2b50 2024-09-10T23:15:17.122 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:17.122 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"btime":"2024-09-10T23:15:16:780866+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/464675823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":464675823},{"type":"v1","addr":"172.21.15.90:6835","nonce":464675823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/28851721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":28851721},{"type":"v1","addr":"172.21.15.171:6836","nonce":28851721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/3538341252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3538341252},{"type":"v1","addr":"172.21.15.90:6834","nonce":3538341252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:14.107910+0000","modified":"2024-09-10T23:15:16.120228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4881":{"gid":4881,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/2513837234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2513837234},{"type":"v1","addr":"172.21.15.171:6837","nonce":2513837234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4881,"qdb_cluster":[4881]},"id":2}]} 2024-09-10T23:15:17.122 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2024-09-10T23:15:17.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.123+0000 7f55ac518640 1 -- 172.21.15.90:0/2549193942 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5590077f70 msgr2=0x7f559007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:17.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.123+0000 7f55ac518640 1 --2- 172.21.15.90:0/2549193942 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5590077f70 0x7f559007a430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5594032000 tx=0x7f5594001510 comp rx=0 tx=0).stop 2024-09-10T23:15:17.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.123+0000 7f55ac518640 1 -- 172.21.15.90:0/2549193942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55a41f2b50 msgr2=0x7f55a41f3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:17.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.123+0000 7f55ac518640 1 --2- 172.21.15.90:0/2549193942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55a41f2b50 0x7f55a41f3000 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f55a406f9a0 tx=0x7f559c0039c0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.123+0000 7f55ac518640 1 -- 172.21.15.90:0/2549193942 shutdown_connections 2024-09-10T23:15:17.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.123+0000 7f55ac518640 1 --2- 172.21.15.90:0/2549193942 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5590077f70 0x7f559007a430 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.123+0000 7f55ac518640 1 --2- 172.21.15.90:0/2549193942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55a41f2b50 0x7f55a41f3000 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.123+0000 7f55ac518640 1 --2- 172.21.15.90:0/2549193942 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55a40b5a60 0x7f55a40b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.123+0000 7f55ac518640 1 --2- 172.21.15.90:0/2549193942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f558c003a30 0x7f55a41efd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.123+0000 7f55ac518640 1 -- 172.21.15.90:0/2549193942 >> 172.21.15.90:0/2549193942 conn(0x7f55a40d0c20 msgr2=0x7f55a40ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:17.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.123+0000 7f55ac518640 1 -- 172.21.15.90:0/2549193942 shutdown_connections 2024-09-10T23:15:17.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.123+0000 7f55ac518640 1 -- 172.21.15.90:0/2549193942 wait complete. 2024-09-10T23:15:17.135 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:17.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.235+0000 7fc985375640 1 -- 172.21.15.90:0/2798080753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc968003a80 msgr2=0x7fc968003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:17.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.235+0000 7fc985375640 1 --2- 172.21.15.90:0/2798080753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc968003a80 0x7fc968003ea0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc970009b50 tx=0x7fc968005830 comp rx=0 tx=0).stop 2024-09-10T23:15:17.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.235+0000 7fc97f7fe640 1 -- 172.21.15.90:0/2798080753 reap_dead start 2024-09-10T23:15:17.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.235+0000 7fc985375640 1 -- 172.21.15.90:0/2798080753 shutdown_connections 2024-09-10T23:15:17.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.235+0000 7fc985375640 1 -- 172.21.15.90:0/2798080753 >> 172.21.15.90:0/2798080753 conn(0x7fc98009d2a0 msgr2=0x7fc9800d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:17.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.235+0000 7fc985375640 1 -- 172.21.15.90:0/2798080753 shutdown_connections 2024-09-10T23:15:17.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.235+0000 7fc985375640 1 -- 172.21.15.90:0/2798080753 wait complete. 2024-09-10T23:15:17.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.237+0000 7fc985375640 1 Processor -- start 2024-09-10T23:15:17.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.237+0000 7fc985375640 1 -- start start 2024-09-10T23:15:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.237+0000 7fc985375640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc968003a80 0x7fc9801f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.237+0000 7fc985375640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc980160780 0x7fc9801f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.237+0000 7fc985375640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9800d3dd0 0x7fc9800d4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.237+0000 7fc985375640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc9800b3610 con 0x7fc9800d3dd0 2024-09-10T23:15:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.237+0000 7fc985375640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc9800b3490 con 0x7fc980160780 2024-09-10T23:15:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.237+0000 7fc985375640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc9800b3790 con 0x7fc968003a80 2024-09-10T23:15:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.238+0000 7fc97f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9800d3dd0 0x7fc9800d4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.238+0000 7fc97f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9800d3dd0 0x7fc9800d4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59608/0 (socket says 172.21.15.90:59608) 2024-09-10T23:15:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.238+0000 7fc97f7fe640 1 -- 172.21.15.90:0/1211623925 learned_addr learned my addr 172.21.15.90:0/1211623925 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.238+0000 7fc97effd640 1 --2- 172.21.15.90:0/1211623925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc968003a80 0x7fc9801f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.238+0000 7fc97e7fc640 1 --2- 172.21.15.90:0/1211623925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc980160780 0x7fc9801f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.238+0000 7fc97f7fe640 1 -- 172.21.15.90:0/1211623925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc968003a80 msgr2=0x7fc9801f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.238+0000 7fc97f7fe640 1 --2- 172.21.15.90:0/1211623925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc968003a80 0x7fc9801f2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.238+0000 7fc97f7fe640 1 -- 172.21.15.90:0/1211623925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc980160780 msgr2=0x7fc9801f8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:17.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.238+0000 7fc97f7fe640 1 --2- 172.21.15.90:0/1211623925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc980160780 0x7fc9801f8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.238+0000 7fc97f7fe640 1 -- 172.21.15.90:0/1211623925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9801f4dc0 con 0x7fc9800d3dd0 2024-09-10T23:15:17.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.238+0000 7fc97f7fe640 1 --2- 172.21.15.90:0/1211623925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9800d3dd0 0x7fc9800d4280 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc98008d0d0 tx=0x7fc9780019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:17.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.238+0000 7fc9677fe640 1 -- 172.21.15.90:0/1211623925 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978011870 con 0x7fc9800d3dd0 2024-09-10T23:15:17.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.238+0000 7fc9677fe640 1 -- 172.21.15.90:0/1211623925 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc978017070 con 0x7fc9800d3dd0 2024-09-10T23:15:17.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.238+0000 7fc9677fe640 1 -- 172.21.15.90:0/1211623925 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978011dc0 con 0x7fc9800d3dd0 2024-09-10T23:15:17.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.238+0000 7fc985375640 1 -- 172.21.15.90:0/1211623925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9801f50a0 con 0x7fc9800d3dd0 2024-09-10T23:15:17.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.238+0000 7fc985375640 1 -- 172.21.15.90:0/1211623925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9801f5660 con 0x7fc9800d3dd0 2024-09-10T23:15:17.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.239+0000 7fc985375640 1 -- 172.21.15.90:0/1211623925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9800b47d0 con 0x7fc9800d3dd0 2024-09-10T23:15:17.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.240+0000 7fc9677fe640 1 -- 172.21.15.90:0/1211623925 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc97801c460 con 0x7fc9800d3dd0 2024-09-10T23:15:17.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.240+0000 7fc9677fe640 1 --2- 172.21.15.90:0/1211623925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc96c077f70 0x7fc96c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:17.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.240+0000 7fc9677fe640 1 -- 172.21.15.90:0/1211623925 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc97809a490 con 0x7fc9800d3dd0 2024-09-10T23:15:17.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.240+0000 7fc97effd640 1 --2- 172.21.15.90:0/1211623925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc96c077f70 0x7fc96c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:17.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.241+0000 7fc97effd640 1 --2- 172.21.15.90:0/1211623925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc96c077f70 0x7fc96c07a430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc970009b50 tx=0x7fc97002d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:17.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.244+0000 7fc9677fe640 1 -- 172.21.15.90:0/1211623925 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc978062940 con 0x7fc9800d3dd0 2024-09-10T23:15:17.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.419+0000 7fc985375640 1 -- 172.21.15.90:0/1211623925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9800b1ee0 con 0x7fc9800d3dd0 2024-09-10T23:15:17.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.420+0000 7fc9677fe640 1 -- 172.21.15.90:0/1211623925 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16729 (secure 0 0 0) 0x7fc978067370 con 0x7fc9800d3dd0 2024-09-10T23:15:17.421 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:17.421 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":34,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:15:15.773619+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:11.940848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:13.069613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:17.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.422+0000 7fc985375640 1 -- 172.21.15.90:0/1211623925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc96c077f70 msgr2=0x7fc96c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:17.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.422+0000 7fc985375640 1 --2- 172.21.15.90:0/1211623925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc96c077f70 0x7fc96c07a430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc970009b50 tx=0x7fc97002d040 comp rx=0 tx=0).stop 2024-09-10T23:15:17.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.422+0000 7fc985375640 1 -- 172.21.15.90:0/1211623925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9800d3dd0 msgr2=0x7fc9800d4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:17.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.422+0000 7fc985375640 1 --2- 172.21.15.90:0/1211623925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9800d3dd0 0x7fc9800d4280 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc98008d0d0 tx=0x7fc9780019b0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.422+0000 7fc985375640 1 -- 172.21.15.90:0/1211623925 shutdown_connections 2024-09-10T23:15:17.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.422+0000 7fc985375640 1 --2- 172.21.15.90:0/1211623925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc96c077f70 0x7fc96c07a430 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.422+0000 7fc985375640 1 --2- 172.21.15.90:0/1211623925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc980160780 0x7fc9801f8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.422+0000 7fc985375640 1 --2- 172.21.15.90:0/1211623925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9800d3dd0 0x7fc9800d4280 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.422+0000 7fc985375640 1 --2- 172.21.15.90:0/1211623925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc968003a80 0x7fc9801f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.422+0000 7fc985375640 1 -- 172.21.15.90:0/1211623925 >> 172.21.15.90:0/1211623925 conn(0x7fc98009d2a0 msgr2=0x7fc9800b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:17.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.422+0000 7fc985375640 1 -- 172.21.15.90:0/1211623925 shutdown_connections 2024-09-10T23:15:17.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.422+0000 7fc985375640 1 -- 172.21.15.90:0/1211623925 wait complete. 2024-09-10T23:15:17.435 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:15:17.435 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:15:17.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.535+0000 7fb50b68c640 1 -- 172.21.15.90:0/3739546829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4f00099b0 msgr2=0x7fb4f000bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:17.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.535+0000 7fb50b68c640 1 --2- 172.21.15.90:0/3739546829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4f00099b0 0x7fb4f000bda0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009ed0 tx=0x7fb4f0005830 comp rx=0 tx=0).stop 2024-09-10T23:15:17.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.535+0000 7fb509c29640 1 -- 172.21.15.90:0/3739546829 reap_dead start 2024-09-10T23:15:17.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.535+0000 7fb50b68c640 1 -- 172.21.15.90:0/3739546829 shutdown_connections 2024-09-10T23:15:17.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.535+0000 7fb50b68c640 1 -- 172.21.15.90:0/3739546829 >> 172.21.15.90:0/3739546829 conn(0x7fb5040cc850 msgr2=0x7fb5040ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:17.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.535+0000 7fb50b68c640 1 -- 172.21.15.90:0/3739546829 shutdown_connections 2024-09-10T23:15:17.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.535+0000 7fb50b68c640 1 -- 172.21.15.90:0/3739546829 wait complete. 2024-09-10T23:15:17.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.536+0000 7fb50b68c640 1 Processor -- start 2024-09-10T23:15:17.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.537+0000 7fb50b68c640 1 -- start start 2024-09-10T23:15:17.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.537+0000 7fb50b68c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4f00099b0 0x7fb5040b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:17.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.537+0000 7fb50b68c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5041f8810 0x7fb5040adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:17.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.537+0000 7fb50b68c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5040ae3e0 0x7fb50415c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:17.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.537+0000 7fb50b68c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5040709a0 con 0x7fb4f00099b0 2024-09-10T23:15:17.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.537+0000 7fb50b68c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb504070820 con 0x7fb5041f8810 2024-09-10T23:15:17.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.537+0000 7fb50b68c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb504073740 con 0x7fb5040ae3e0 2024-09-10T23:15:17.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.537+0000 7fb509428640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4f00099b0 0x7fb5040b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:17.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.537+0000 7fb509428640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4f00099b0 0x7fb5040b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59638/0 (socket says 172.21.15.90:59638) 2024-09-10T23:15:17.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.537+0000 7fb509428640 1 -- 172.21.15.90:0/3366263378 learned_addr learned my addr 172.21.15.90:0/3366263378 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:17.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.538+0000 7fb509428640 1 -- 172.21.15.90:0/3366263378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5040ae3e0 msgr2=0x7fb50415c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:17.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.538+0000 7fb509c29640 1 --2- 172.21.15.90:0/3366263378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5040ae3e0 0x7fb50415c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:17.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.538+0000 7fb508c27640 1 --2- 172.21.15.90:0/3366263378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5041f8810 0x7fb5040adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:17.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.538+0000 7fb509428640 1 --2- 172.21.15.90:0/3366263378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5040ae3e0 0x7fb50415c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.538+0000 7fb509428640 1 -- 172.21.15.90:0/3366263378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5041f8810 msgr2=0x7fb5040adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:17.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.538+0000 7fb509428640 1 --2- 172.21.15.90:0/3366263378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5041f8810 0x7fb5040adea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.538+0000 7fb509428640 1 -- 172.21.15.90:0/3366263378 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5041f4bb0 con 0x7fb4f00099b0 2024-09-10T23:15:17.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.538+0000 7fb509428640 1 --2- 172.21.15.90:0/3366263378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4f00099b0 0x7fb5040b4620 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb50000e690 tx=0x7fb50000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:17.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.538+0000 7fb4f9ffb640 1 -- 172.21.15.90:0/3366263378 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50000ee60 con 0x7fb4f00099b0 2024-09-10T23:15:17.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.538+0000 7fb4f9ffb640 1 -- 172.21.15.90:0/3366263378 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb500016070 con 0x7fb4f00099b0 2024-09-10T23:15:17.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.538+0000 7fb50b68c640 1 -- 172.21.15.90:0/3366263378 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5041f4e90 con 0x7fb4f00099b0 2024-09-10T23:15:17.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.538+0000 7fb4f9ffb640 1 -- 172.21.15.90:0/3366263378 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50000caa0 con 0x7fb4f00099b0 2024-09-10T23:15:17.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.538+0000 7fb50b68c640 1 -- 172.21.15.90:0/3366263378 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5041f5450 con 0x7fb4f00099b0 2024-09-10T23:15:17.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.539+0000 7fb50b68c640 1 -- 172.21.15.90:0/3366263378 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5040b1850 con 0x7fb4f00099b0 2024-09-10T23:15:17.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.540+0000 7fb4f9ffb640 1 -- 172.21.15.90:0/3366263378 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb50000cc40 con 0x7fb4f00099b0 2024-09-10T23:15:17.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.540+0000 7fb4f9ffb640 1 --2- 172.21.15.90:0/3366263378 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb4e8077f70 0x7fb4e807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:17.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.540+0000 7fb4f9ffb640 1 -- 172.21.15.90:0/3366263378 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb50009a2c0 con 0x7fb4f00099b0 2024-09-10T23:15:17.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.540+0000 7fb508c27640 1 --2- 172.21.15.90:0/3366263378 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb4e8077f70 0x7fb4e807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:17.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.541+0000 7fb508c27640 1 --2- 172.21.15.90:0/3366263378 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb4e8077f70 0x7fb4e807a430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb5041595d0 tx=0x7fb4f40060d0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:17.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.544+0000 7fb4f9ffb640 1 -- 172.21.15.90:0/3366263378 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb500062dc0 con 0x7fb4f00099b0 2024-09-10T23:15:17.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.715+0000 7fb50b68c640 1 -- 172.21.15.90:0/3366263378 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5040ae7c0 con 0x7fb4e8077f70 2024-09-10T23:15:17.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.720+0000 7fb4f9ffb640 1 -- 172.21.15.90:0/3366263378 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250843 (secure 0 0 0) 0x7fb5040ae7c0 con 0x7fb4e8077f70 2024-09-10T23:15:17.723 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:17.725 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:15:17.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.723+0000 7fb50b68c640 1 -- 172.21.15.90:0/3366263378 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb4e8077f70 msgr2=0x7fb4e807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:17.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.723+0000 7fb50b68c640 1 --2- 172.21.15.90:0/3366263378 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb4e8077f70 0x7fb4e807a430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb5041595d0 tx=0x7fb4f40060d0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.723+0000 7fb50b68c640 1 -- 172.21.15.90:0/3366263378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4f00099b0 msgr2=0x7fb5040b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:17.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.723+0000 7fb50b68c640 1 --2- 172.21.15.90:0/3366263378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4f00099b0 0x7fb5040b4620 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb50000e690 tx=0x7fb50000eb50 comp rx=0 tx=0).stop 2024-09-10T23:15:17.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.723+0000 7fb50b68c640 1 -- 172.21.15.90:0/3366263378 shutdown_connections 2024-09-10T23:15:17.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.723+0000 7fb50b68c640 1 --2- 172.21.15.90:0/3366263378 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb4e8077f70 0x7fb4e807a430 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.723+0000 7fb50b68c640 1 --2- 172.21.15.90:0/3366263378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5041f8810 0x7fb5040adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.723+0000 7fb50b68c640 1 --2- 172.21.15.90:0/3366263378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5040ae3e0 0x7fb50415c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.723+0000 7fb50b68c640 1 --2- 172.21.15.90:0/3366263378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4f00099b0 0x7fb5040b4620 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.723+0000 7fb50b68c640 1 -- 172.21.15.90:0/3366263378 >> 172.21.15.90:0/3366263378 conn(0x7fb5040cc850 msgr2=0x7fb5040ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:17.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.723+0000 7fb50b68c640 1 -- 172.21.15.90:0/3366263378 shutdown_connections 2024-09-10T23:15:17.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.723+0000 7fb50b68c640 1 -- 172.21.15.90:0/3366263378 wait complete. 2024-09-10T23:15:17.734 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-10T23:15:16.442105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":144,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220264,"kb_used_data":4012,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754456,"statfs":{"total":773094113280,"available":772868562944,"internally_reserved":0,"allocated":4108288,"data_stored":2269017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000768"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785950+0000","last_change":"2024-09-10T23:15:14.782590+0000","last_active":"2024-09-10T23:15:14.785950+0000","last_peered":"2024-09-10T23:15:14.785950+0000","last_clean":"2024-09-10T23:15:14.785950+0000","last_became_active":"2024-09-10T23:15:14.782279+0000","last_became_peered":"2024-09-10T23:15:14.782279+0000","last_unstale":"2024-09-10T23:15:14.785950+0000","last_undegraded":"2024-09-10T23:15:14.785950+0000","last_fullsized":"2024-09-10T23:15:14.785950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:29.232671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795199+0000","last_change":"2024-09-10T23:15:14.784084+0000","last_active":"2024-09-10T23:15:14.795199+0000","last_peered":"2024-09-10T23:15:14.795199+0000","last_clean":"2024-09-10T23:15:14.795199+0000","last_became_active":"2024-09-10T23:15:14.783797+0000","last_became_peered":"2024-09-10T23:15:14.783797+0000","last_unstale":"2024-09-10T23:15:14.795199+0000","last_undegraded":"2024-09-10T23:15:14.795199+0000","last_fullsized":"2024-09-10T23:15:14.795199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:05.732071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785174+0000","last_change":"2024-09-10T23:15:14.777426+0000","last_active":"2024-09-10T23:15:14.785174+0000","last_peered":"2024-09-10T23:15:14.785174+0000","last_clean":"2024-09-10T23:15:14.785174+0000","last_became_active":"2024-09-10T23:15:14.777146+0000","last_became_peered":"2024-09-10T23:15:14.777146+0000","last_unstale":"2024-09-10T23:15:14.785174+0000","last_undegraded":"2024-09-10T23:15:14.785174+0000","last_fullsized":"2024-09-10T23:15:14.785174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:59.921943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.790290+0000","last_change":"2024-09-10T23:15:14.786653+0000","last_active":"2024-09-10T23:15:14.790290+0000","last_peered":"2024-09-10T23:15:14.790290+0000","last_clean":"2024-09-10T23:15:14.790290+0000","last_became_active":"2024-09-10T23:15:14.786388+0000","last_became_peered":"2024-09-10T23:15:14.786388+0000","last_unstale":"2024-09-10T23:15:14.790290+0000","last_undegraded":"2024-09-10T23:15:14.790290+0000","last_fullsized":"2024-09-10T23:15:14.790290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:57.739458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.780047+0000","last_change":"2024-09-10T23:15:14.777568+0000","last_active":"2024-09-10T23:15:14.780047+0000","last_peered":"2024-09-10T23:15:14.780047+0000","last_clean":"2024-09-10T23:15:14.780047+0000","last_became_active":"2024-09-10T23:15:14.777316+0000","last_became_peered":"2024-09-10T23:15:14.777316+0000","last_unstale":"2024-09-10T23:15:14.780047+0000","last_undegraded":"2024-09-10T23:15:14.780047+0000","last_fullsized":"2024-09-10T23:15:14.780047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:48.058773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796029+0000","last_change":"2024-09-10T23:15:14.787768+0000","last_active":"2024-09-10T23:15:14.796029+0000","last_peered":"2024-09-10T23:15:14.796029+0000","last_clean":"2024-09-10T23:15:14.796029+0000","last_became_active":"2024-09-10T23:15:14.787494+0000","last_became_peered":"2024-09-10T23:15:14.787494+0000","last_unstale":"2024-09-10T23:15:14.796029+0000","last_undegraded":"2024-09-10T23:15:14.796029+0000","last_fullsized":"2024-09-10T23:15:14.796029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:51.822103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788683+0000","last_change":"2024-09-10T23:15:14.786512+0000","last_active":"2024-09-10T23:15:14.788683+0000","last_peered":"2024-09-10T23:15:14.788683+0000","last_clean":"2024-09-10T23:15:14.788683+0000","last_became_active":"2024-09-10T23:15:14.786226+0000","last_became_peered":"2024-09-10T23:15:14.786226+0000","last_unstale":"2024-09-10T23:15:14.788683+0000","last_undegraded":"2024-09-10T23:15:14.788683+0000","last_fullsized":"2024-09-10T23:15:14.788683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:26.578923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786982+0000","last_change":"2024-09-10T23:15:14.779115+0000","last_active":"2024-09-10T23:15:14.786982+0000","last_peered":"2024-09-10T23:15:14.786982+0000","last_clean":"2024-09-10T23:15:14.786982+0000","last_became_active":"2024-09-10T23:15:14.778811+0000","last_became_peered":"2024-09-10T23:15:14.778811+0000","last_unstale":"2024-09-10T23:15:14.786982+0000","last_undegraded":"2024-09-10T23:15:14.786982+0000","last_fullsized":"2024-09-10T23:15:14.786982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:59.921943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.791973+0000","last_change":"2024-09-10T23:15:14.784909+0000","last_active":"2024-09-10T23:15:14.791973+0000","last_peered":"2024-09-10T23:15:14.791973+0000","last_clean":"2024-09-10T23:15:14.791973+0000","last_became_active":"2024-09-10T23:15:14.784511+0000","last_became_peered":"2024-09-10T23:15:14.784511+0000","last_unstale":"2024-09-10T23:15:14.791973+0000","last_undegraded":"2024-09-10T23:15:14.791973+0000","last_fullsized":"2024-09-10T23:15:14.791973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:05.158732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.787382+0000","last_change":"2024-09-10T23:15:14.785521+0000","last_active":"2024-09-10T23:15:14.787382+0000","last_peered":"2024-09-10T23:15:14.787382+0000","last_clean":"2024-09-10T23:15:14.787382+0000","last_became_active":"2024-09-10T23:15:14.785042+0000","last_became_peered":"2024-09-10T23:15:14.785042+0000","last_unstale":"2024-09-10T23:15:14.787382+0000","last_undegraded":"2024-09-10T23:15:14.787382+0000","last_fullsized":"2024-09-10T23:15:14.787382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:11.616236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788226+0000","last_change":"2024-09-10T23:15:14.783123+0000","last_active":"2024-09-10T23:15:14.788226+0000","last_peered":"2024-09-10T23:15:14.788226+0000","last_clean":"2024-09-10T23:15:14.788226+0000","last_became_active":"2024-09-10T23:15:14.782839+0000","last_became_peered":"2024-09-10T23:15:14.782839+0000","last_unstale":"2024-09-10T23:15:14.788226+0000","last_undegraded":"2024-09-10T23:15:14.788226+0000","last_fullsized":"2024-09-10T23:15:14.788226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:01.426667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785981+0000","last_change":"2024-09-10T23:15:14.780626+0000","last_active":"2024-09-10T23:15:14.785981+0000","last_peered":"2024-09-10T23:15:14.785981+0000","last_clean":"2024-09-10T23:15:14.785981+0000","last_became_active":"2024-09-10T23:15:14.780319+0000","last_became_peered":"2024-09-10T23:15:14.780319+0000","last_unstale":"2024-09-10T23:15:14.785981+0000","last_undegraded":"2024-09-10T23:15:14.785981+0000","last_fullsized":"2024-09-10T23:15:14.785981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:43.885268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.779991+0000","last_change":"2024-09-10T23:15:14.775829+0000","last_active":"2024-09-10T23:15:14.779991+0000","last_peered":"2024-09-10T23:15:14.779991+0000","last_clean":"2024-09-10T23:15:14.779991+0000","last_became_active":"2024-09-10T23:15:14.775197+0000","last_became_peered":"2024-09-10T23:15:14.775197+0000","last_unstale":"2024-09-10T23:15:14.779991+0000","last_undegraded":"2024-09-10T23:15:14.779991+0000","last_fullsized":"2024-09-10T23:15:14.779991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:05.633943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.777970+0000","last_change":"2024-09-10T23:15:14.776541+0000","last_active":"2024-09-10T23:15:14.777970+0000","last_peered":"2024-09-10T23:15:14.777970+0000","last_clean":"2024-09-10T23:15:14.777970+0000","last_became_active":"2024-09-10T23:15:14.776297+0000","last_became_peered":"2024-09-10T23:15:14.776297+0000","last_unstale":"2024-09-10T23:15:14.777970+0000","last_undegraded":"2024-09-10T23:15:14.777970+0000","last_fullsized":"2024-09-10T23:15:14.777970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:04.984362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786416+0000","last_change":"2024-09-10T23:15:14.784278+0000","last_active":"2024-09-10T23:15:14.786416+0000","last_peered":"2024-09-10T23:15:14.786416+0000","last_clean":"2024-09-10T23:15:14.786416+0000","last_became_active":"2024-09-10T23:15:14.784023+0000","last_became_peered":"2024-09-10T23:15:14.784023+0000","last_unstale":"2024-09-10T23:15:14.786416+0000","last_undegraded":"2024-09-10T23:15:14.786416+0000","last_fullsized":"2024-09-10T23:15:14.786416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:40.651240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786958+0000","last_change":"2024-09-10T23:15:14.778174+0000","last_active":"2024-09-10T23:15:14.786958+0000","last_peered":"2024-09-10T23:15:14.786958+0000","last_clean":"2024-09-10T23:15:14.786958+0000","last_became_active":"2024-09-10T23:15:14.777911+0000","last_became_peered":"2024-09-10T23:15:14.777911+0000","last_unstale":"2024-09-10T23:15:14.786958+0000","last_undegraded":"2024-09-10T23:15:14.786958+0000","last_fullsized":"2024-09-10T23:15:14.786958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:20.582304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788259+0000","last_change":"2024-09-10T23:15:14.784036+0000","last_active":"2024-09-10T23:15:14.788259+0000","last_peered":"2024-09-10T23:15:14.788259+0000","last_clean":"2024-09-10T23:15:14.788259+0000","last_became_active":"2024-09-10T23:15:14.783780+0000","last_became_peered":"2024-09-10T23:15:14.783780+0000","last_unstale":"2024-09-10T23:15:14.788259+0000","last_undegraded":"2024-09-10T23:15:14.788259+0000","last_fullsized":"2024-09-10T23:15:14.788259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:43.885268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.789823+0000","last_change":"2024-09-10T23:15:14.782310+0000","last_active":"2024-09-10T23:15:14.789823+0000","last_peered":"2024-09-10T23:15:14.789823+0000","last_clean":"2024-09-10T23:15:14.789823+0000","last_became_active":"2024-09-10T23:15:14.782047+0000","last_became_peered":"2024-09-10T23:15:14.782047+0000","last_unstale":"2024-09-10T23:15:14.789823+0000","last_undegraded":"2024-09-10T23:15:14.789823+0000","last_fullsized":"2024-09-10T23:15:14.789823+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:40.651240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.778031+0000","last_change":"2024-09-10T23:15:14.776242+0000","last_active":"2024-09-10T23:15:14.778031+0000","last_peered":"2024-09-10T23:15:14.778031+0000","last_clean":"2024-09-10T23:15:14.778031+0000","last_became_active":"2024-09-10T23:15:14.776016+0000","last_became_peered":"2024-09-10T23:15:14.776016+0000","last_unstale":"2024-09-10T23:15:14.778031+0000","last_undegraded":"2024-09-10T23:15:14.778031+0000","last_fullsized":"2024-09-10T23:15:14.778031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:43.885268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.779028+0000","last_change":"2024-09-10T23:15:14.773759+0000","last_active":"2024-09-10T23:15:14.779028+0000","last_peered":"2024-09-10T23:15:14.779028+0000","last_clean":"2024-09-10T23:15:14.779028+0000","last_became_active":"2024-09-10T23:15:14.773146+0000","last_became_peered":"2024-09-10T23:15:14.773146+0000","last_unstale":"2024-09-10T23:15:14.779028+0000","last_undegraded":"2024-09-10T23:15:14.779028+0000","last_fullsized":"2024-09-10T23:15:14.779028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:00.613653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.793605+0000","last_change":"2024-09-10T23:15:14.790230+0000","last_active":"2024-09-10T23:15:14.793605+0000","last_peered":"2024-09-10T23:15:14.793605+0000","last_clean":"2024-09-10T23:15:14.793605+0000","last_became_active":"2024-09-10T23:15:14.785734+0000","last_became_peered":"2024-09-10T23:15:14.785734+0000","last_unstale":"2024-09-10T23:15:14.793605+0000","last_undegraded":"2024-09-10T23:15:14.793605+0000","last_fullsized":"2024-09-10T23:15:14.793605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:21.092694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797068+0000","last_change":"2024-09-10T23:15:14.796057+0000","last_active":"2024-09-10T23:15:14.797068+0000","last_peered":"2024-09-10T23:15:14.797068+0000","last_clean":"2024-09-10T23:15:14.797068+0000","last_became_active":"2024-09-10T23:15:14.795690+0000","last_became_peered":"2024-09-10T23:15:14.795690+0000","last_unstale":"2024-09-10T23:15:14.797068+0000","last_undegraded":"2024-09-10T23:15:14.797068+0000","last_fullsized":"2024-09-10T23:15:14.797068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:20.633732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:15:13.749502+0000","last_change":"2024-09-10T23:15:13.749502+0000","last_active":"2024-09-10T23:15:13.749502+0000","last_peered":"2024-09-10T23:15:13.749502+0000","last_clean":"2024-09-10T23:15:13.749502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:13.749502+0000","last_undegraded":"2024-09-10T23:15:13.749502+0000","last_fullsized":"2024-09-10T23:15:13.749502+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.780102+0000","last_change":"2024-09-10T23:15:14.775294+0000","last_active":"2024-09-10T23:15:14.780102+0000","last_peered":"2024-09-10T23:15:14.780102+0000","last_clean":"2024-09-10T23:15:14.780102+0000","last_became_active":"2024-09-10T23:15:14.775007+0000","last_became_peered":"2024-09-10T23:15:14.775007+0000","last_unstale":"2024-09-10T23:15:14.780102+0000","last_undegraded":"2024-09-10T23:15:14.780102+0000","last_fullsized":"2024-09-10T23:15:14.780102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:20.582304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796002+0000","last_change":"2024-09-10T23:15:14.790930+0000","last_active":"2024-09-10T23:15:14.796002+0000","last_peered":"2024-09-10T23:15:14.796002+0000","last_clean":"2024-09-10T23:15:14.796002+0000","last_became_active":"2024-09-10T23:15:14.790611+0000","last_became_peered":"2024-09-10T23:15:14.790611+0000","last_unstale":"2024-09-10T23:15:14.796002+0000","last_undegraded":"2024-09-10T23:15:14.796002+0000","last_fullsized":"2024-09-10T23:15:14.796002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:46.414579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795942+0000","last_change":"2024-09-10T23:15:14.785099+0000","last_active":"2024-09-10T23:15:14.795942+0000","last_peered":"2024-09-10T23:15:14.795942+0000","last_clean":"2024-09-10T23:15:14.795942+0000","last_became_active":"2024-09-10T23:15:14.784771+0000","last_became_peered":"2024-09-10T23:15:14.784771+0000","last_unstale":"2024-09-10T23:15:14.795942+0000","last_undegraded":"2024-09-10T23:15:14.795942+0000","last_fullsized":"2024-09-10T23:15:14.795942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:14.428600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796553+0000","last_change":"2024-09-10T23:15:14.793856+0000","last_active":"2024-09-10T23:15:14.796553+0000","last_peered":"2024-09-10T23:15:14.796553+0000","last_clean":"2024-09-10T23:15:14.796553+0000","last_became_active":"2024-09-10T23:15:14.793367+0000","last_became_peered":"2024-09-10T23:15:14.793367+0000","last_unstale":"2024-09-10T23:15:14.796553+0000","last_undegraded":"2024-09-10T23:15:14.796553+0000","last_fullsized":"2024-09-10T23:15:14.796553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:18.746412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.787300+0000","last_change":"2024-09-10T23:15:14.785755+0000","last_active":"2024-09-10T23:15:14.787300+0000","last_peered":"2024-09-10T23:15:14.787300+0000","last_clean":"2024-09-10T23:15:14.787300+0000","last_became_active":"2024-09-10T23:15:14.782572+0000","last_became_peered":"2024-09-10T23:15:14.782572+0000","last_unstale":"2024-09-10T23:15:14.787300+0000","last_undegraded":"2024-09-10T23:15:14.787300+0000","last_fullsized":"2024-09-10T23:15:14.787300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:09.218654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797495+0000","last_change":"2024-09-10T23:15:14.796654+0000","last_active":"2024-09-10T23:15:14.797495+0000","last_peered":"2024-09-10T23:15:14.797495+0000","last_clean":"2024-09-10T23:15:14.797495+0000","last_became_active":"2024-09-10T23:15:14.796438+0000","last_became_peered":"2024-09-10T23:15:14.796438+0000","last_unstale":"2024-09-10T23:15:14.797495+0000","last_undegraded":"2024-09-10T23:15:14.797495+0000","last_fullsized":"2024-09-10T23:15:14.797495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:36.736865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788177+0000","last_change":"2024-09-10T23:15:14.785696+0000","last_active":"2024-09-10T23:15:14.788177+0000","last_peered":"2024-09-10T23:15:14.788177+0000","last_clean":"2024-09-10T23:15:14.788177+0000","last_became_active":"2024-09-10T23:15:14.785439+0000","last_became_peered":"2024-09-10T23:15:14.785439+0000","last_unstale":"2024-09-10T23:15:14.788177+0000","last_undegraded":"2024-09-10T23:15:14.788177+0000","last_fullsized":"2024-09-10T23:15:14.788177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:04.984362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786699+0000","last_change":"2024-09-10T23:15:14.784069+0000","last_active":"2024-09-10T23:15:14.786699+0000","last_peered":"2024-09-10T23:15:14.786699+0000","last_clean":"2024-09-10T23:15:14.786699+0000","last_became_active":"2024-09-10T23:15:14.783809+0000","last_became_peered":"2024-09-10T23:15:14.783809+0000","last_unstale":"2024-09-10T23:15:14.786699+0000","last_undegraded":"2024-09-10T23:15:14.786699+0000","last_fullsized":"2024-09-10T23:15:14.786699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:34.228563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795168+0000","last_change":"2024-09-10T23:15:14.792638+0000","last_active":"2024-09-10T23:15:14.795168+0000","last_peered":"2024-09-10T23:15:14.795168+0000","last_clean":"2024-09-10T23:15:14.795168+0000","last_became_active":"2024-09-10T23:15:14.792122+0000","last_became_peered":"2024-09-10T23:15:14.792122+0000","last_unstale":"2024-09-10T23:15:14.795168+0000","last_undegraded":"2024-09-10T23:15:14.795168+0000","last_fullsized":"2024-09-10T23:15:14.795168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:05.732071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:15:13.749502+0000","last_change":"2024-09-10T23:15:13.749502+0000","last_active":"2024-09-10T23:15:13.749502+0000","last_peered":"2024-09-10T23:15:13.749502+0000","last_clean":"2024-09-10T23:15:13.749502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:13.749502+0000","last_undegraded":"2024-09-10T23:15:13.749502+0000","last_fullsized":"2024-09-10T23:15:13.749502+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.792354+0000","last_change":"2024-09-10T23:15:13.778953+0000","last_active":"2024-09-10T23:15:14.792354+0000","last_peered":"2024-09-10T23:15:14.792354+0000","last_clean":"2024-09-10T23:15:14.792354+0000","last_became_active":"2024-09-10T23:15:13.778585+0000","last_became_peered":"2024-09-10T23:15:13.778585+0000","last_unstale":"2024-09-10T23:15:14.792354+0000","last_undegraded":"2024-09-10T23:15:14.792354+0000","last_fullsized":"2024-09-10T23:15:14.792354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:04.980386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795415+0000","last_change":"2024-09-10T23:15:14.793437+0000","last_active":"2024-09-10T23:15:14.795415+0000","last_peered":"2024-09-10T23:15:14.795415+0000","last_clean":"2024-09-10T23:15:14.795415+0000","last_became_active":"2024-09-10T23:15:14.792867+0000","last_became_peered":"2024-09-10T23:15:14.792867+0000","last_unstale":"2024-09-10T23:15:14.795415+0000","last_undegraded":"2024-09-10T23:15:14.795415+0000","last_fullsized":"2024-09-10T23:15:14.795415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:11.616236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.755568+0000","last_change":"2024-09-10T23:15:12.755568+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.755568+0000","last_undegraded":"2024-09-10T23:15:12.755568+0000","last_fullsized":"2024-09-10T23:15:12.755568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797736+0000","last_change":"2024-09-10T23:15:14.797080+0000","last_active":"2024-09-10T23:15:14.797736+0000","last_peered":"2024-09-10T23:15:14.797736+0000","last_clean":"2024-09-10T23:15:14.797736+0000","last_became_active":"2024-09-10T23:15:14.796799+0000","last_became_peered":"2024-09-10T23:15:14.796799+0000","last_unstale":"2024-09-10T23:15:14.797736+0000","last_undegraded":"2024-09-10T23:15:14.797736+0000","last_fullsized":"2024-09-10T23:15:14.797736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:20.582304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796219+0000","last_change":"2024-09-10T23:15:13.767284+0000","last_active":"2024-09-10T23:15:14.796219+0000","last_peered":"2024-09-10T23:15:14.796219+0000","last_clean":"2024-09-10T23:15:14.796219+0000","last_became_active":"2024-09-10T23:15:13.766807+0000","last_became_peered":"2024-09-10T23:15:13.766807+0000","last_unstale":"2024-09-10T23:15:14.796219+0000","last_undegraded":"2024-09-10T23:15:14.796219+0000","last_fullsized":"2024-09-10T23:15:14.796219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:19.628277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796527+0000","last_change":"2024-09-10T23:15:14.793249+0000","last_active":"2024-09-10T23:15:14.796527+0000","last_peered":"2024-09-10T23:15:14.796527+0000","last_clean":"2024-09-10T23:15:14.796527+0000","last_became_active":"2024-09-10T23:15:14.792976+0000","last_became_peered":"2024-09-10T23:15:14.792976+0000","last_unstale":"2024-09-10T23:15:14.796527+0000","last_undegraded":"2024-09-10T23:15:14.796527+0000","last_fullsized":"2024-09-10T23:15:14.796527+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:37.902288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795887+0000","last_change":"2024-09-10T23:15:13.769588+0000","last_active":"2024-09-10T23:15:14.795887+0000","last_peered":"2024-09-10T23:15:14.795887+0000","last_clean":"2024-09-10T23:15:14.795887+0000","last_became_active":"2024-09-10T23:15:13.769325+0000","last_became_peered":"2024-09-10T23:15:13.769325+0000","last_unstale":"2024-09-10T23:15:14.795887+0000","last_undegraded":"2024-09-10T23:15:14.795887+0000","last_fullsized":"2024-09-10T23:15:14.795887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:48.670108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795061+0000","last_change":"2024-09-10T23:15:14.791220+0000","last_active":"2024-09-10T23:15:14.795061+0000","last_peered":"2024-09-10T23:15:14.795061+0000","last_clean":"2024-09-10T23:15:14.795061+0000","last_became_active":"2024-09-10T23:15:14.790957+0000","last_became_peered":"2024-09-10T23:15:14.790957+0000","last_unstale":"2024-09-10T23:15:14.795061+0000","last_undegraded":"2024-09-10T23:15:14.795061+0000","last_fullsized":"2024-09-10T23:15:14.795061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:09.218654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796822+0000","last_change":"2024-09-10T23:15:13.768504+0000","last_active":"2024-09-10T23:15:14.796822+0000","last_peered":"2024-09-10T23:15:14.796822+0000","last_clean":"2024-09-10T23:15:14.796822+0000","last_became_active":"2024-09-10T23:15:13.768242+0000","last_became_peered":"2024-09-10T23:15:13.768242+0000","last_unstale":"2024-09-10T23:15:14.796822+0000","last_undegraded":"2024-09-10T23:15:14.796822+0000","last_fullsized":"2024-09-10T23:15:14.796822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:50.630257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786107+0000","last_change":"2024-09-10T23:15:14.783536+0000","last_active":"2024-09-10T23:15:14.786107+0000","last_peered":"2024-09-10T23:15:14.786107+0000","last_clean":"2024-09-10T23:15:14.786107+0000","last_became_active":"2024-09-10T23:15:14.783266+0000","last_became_peered":"2024-09-10T23:15:14.783266+0000","last_unstale":"2024-09-10T23:15:14.786107+0000","last_undegraded":"2024-09-10T23:15:14.786107+0000","last_fullsized":"2024-09-10T23:15:14.786107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:26.578923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796747+0000","last_change":"2024-09-10T23:15:13.771424+0000","last_active":"2024-09-10T23:15:14.796747+0000","last_peered":"2024-09-10T23:15:14.796747+0000","last_clean":"2024-09-10T23:15:14.796747+0000","last_became_active":"2024-09-10T23:15:13.771113+0000","last_became_peered":"2024-09-10T23:15:13.771113+0000","last_unstale":"2024-09-10T23:15:14.796747+0000","last_undegraded":"2024-09-10T23:15:14.796747+0000","last_fullsized":"2024-09-10T23:15:14.796747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:41.926490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.794838+0000","last_change":"2024-09-10T23:15:14.792338+0000","last_active":"2024-09-10T23:15:14.794838+0000","last_peered":"2024-09-10T23:15:14.794838+0000","last_clean":"2024-09-10T23:15:14.794838+0000","last_became_active":"2024-09-10T23:15:14.792063+0000","last_became_peered":"2024-09-10T23:15:14.792063+0000","last_unstale":"2024-09-10T23:15:14.794838+0000","last_undegraded":"2024-09-10T23:15:14.794838+0000","last_fullsized":"2024-09-10T23:15:14.794838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:20.660730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.771600+0000","last_change":"2024-09-10T23:15:13.765543+0000","last_active":"2024-09-10T23:15:14.771600+0000","last_peered":"2024-09-10T23:15:14.771600+0000","last_clean":"2024-09-10T23:15:14.771600+0000","last_became_active":"2024-09-10T23:15:13.765131+0000","last_became_peered":"2024-09-10T23:15:13.765131+0000","last_unstale":"2024-09-10T23:15:14.771600+0000","last_undegraded":"2024-09-10T23:15:14.771600+0000","last_fullsized":"2024-09-10T23:15:14.771600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:33.558724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.792513+0000","last_change":"2024-09-10T23:15:14.787696+0000","last_active":"2024-09-10T23:15:14.792513+0000","last_peered":"2024-09-10T23:15:14.792513+0000","last_clean":"2024-09-10T23:15:14.792513+0000","last_became_active":"2024-09-10T23:15:14.787375+0000","last_became_peered":"2024-09-10T23:15:14.787375+0000","last_unstale":"2024-09-10T23:15:14.792513+0000","last_undegraded":"2024-09-10T23:15:14.792513+0000","last_fullsized":"2024-09-10T23:15:14.792513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:03.746624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.776996+0000","last_change":"2024-09-10T23:15:13.773878+0000","last_active":"2024-09-10T23:15:14.776996+0000","last_peered":"2024-09-10T23:15:14.776996+0000","last_clean":"2024-09-10T23:15:14.776996+0000","last_became_active":"2024-09-10T23:15:13.773575+0000","last_became_peered":"2024-09-10T23:15:13.773575+0000","last_unstale":"2024-09-10T23:15:14.776996+0000","last_undegraded":"2024-09-10T23:15:14.776996+0000","last_fullsized":"2024-09-10T23:15:14.776996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:45.659964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785270+0000","last_change":"2024-09-10T23:15:14.780963+0000","last_active":"2024-09-10T23:15:14.785270+0000","last_peered":"2024-09-10T23:15:14.785270+0000","last_clean":"2024-09-10T23:15:14.785270+0000","last_became_active":"2024-09-10T23:15:14.780623+0000","last_became_peered":"2024-09-10T23:15:14.780623+0000","last_unstale":"2024-09-10T23:15:14.785270+0000","last_undegraded":"2024-09-10T23:15:14.785270+0000","last_fullsized":"2024-09-10T23:15:14.785270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:04.984362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.771644+0000","last_change":"2024-09-10T23:15:13.772352+0000","last_active":"2024-09-10T23:15:14.771644+0000","last_peered":"2024-09-10T23:15:14.771644+0000","last_clean":"2024-09-10T23:15:14.771644+0000","last_became_active":"2024-09-10T23:15:13.772076+0000","last_became_peered":"2024-09-10T23:15:13.772076+0000","last_unstale":"2024-09-10T23:15:14.771644+0000","last_undegraded":"2024-09-10T23:15:14.771644+0000","last_fullsized":"2024-09-10T23:15:14.771644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:35.731410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795126+0000","last_change":"2024-09-10T23:15:14.783374+0000","last_active":"2024-09-10T23:15:14.795126+0000","last_peered":"2024-09-10T23:15:14.795126+0000","last_clean":"2024-09-10T23:15:14.795126+0000","last_became_active":"2024-09-10T23:15:14.783108+0000","last_became_peered":"2024-09-10T23:15:14.783108+0000","last_unstale":"2024-09-10T23:15:14.795126+0000","last_undegraded":"2024-09-10T23:15:14.795126+0000","last_fullsized":"2024-09-10T23:15:14.795126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:19.491880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.754945+0000","last_change":"2024-09-10T23:15:12.754945+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.754945+0000","last_undegraded":"2024-09-10T23:15:12.754945+0000","last_fullsized":"2024-09-10T23:15:12.754945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796664+0000","last_change":"2024-09-10T23:15:14.793078+0000","last_active":"2024-09-10T23:15:14.796664+0000","last_peered":"2024-09-10T23:15:14.796664+0000","last_clean":"2024-09-10T23:15:14.796664+0000","last_became_active":"2024-09-10T23:15:14.792740+0000","last_became_peered":"2024-09-10T23:15:14.792740+0000","last_unstale":"2024-09-10T23:15:14.796664+0000","last_undegraded":"2024-09-10T23:15:14.796664+0000","last_fullsized":"2024-09-10T23:15:14.796664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:57.702941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.794243+0000","last_change":"2024-09-10T23:15:13.770511+0000","last_active":"2024-09-10T23:15:14.794243+0000","last_peered":"2024-09-10T23:15:14.794243+0000","last_clean":"2024-09-10T23:15:14.794243+0000","last_became_active":"2024-09-10T23:15:13.770081+0000","last_became_peered":"2024-09-10T23:15:13.770081+0000","last_unstale":"2024-09-10T23:15:14.794243+0000","last_undegraded":"2024-09-10T23:15:14.794243+0000","last_fullsized":"2024-09-10T23:15:14.794243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:33.558724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785216+0000","last_change":"2024-09-10T23:15:14.777889+0000","last_active":"2024-09-10T23:15:14.785216+0000","last_peered":"2024-09-10T23:15:14.785216+0000","last_clean":"2024-09-10T23:15:14.785216+0000","last_became_active":"2024-09-10T23:15:14.777600+0000","last_became_peered":"2024-09-10T23:15:14.777600+0000","last_unstale":"2024-09-10T23:15:14.785216+0000","last_undegraded":"2024-09-10T23:15:14.785216+0000","last_fullsized":"2024-09-10T23:15:14.785216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:34.197656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.798926+0000","last_change":"2024-09-10T23:15:13.766440+0000","last_active":"2024-09-10T23:15:14.798926+0000","last_peered":"2024-09-10T23:15:14.798926+0000","last_clean":"2024-09-10T23:15:14.798926+0000","last_became_active":"2024-09-10T23:15:13.765980+0000","last_became_peered":"2024-09-10T23:15:13.765980+0000","last_unstale":"2024-09-10T23:15:14.798926+0000","last_undegraded":"2024-09-10T23:15:14.798926+0000","last_fullsized":"2024-09-10T23:15:14.798926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:00.421211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.790675+0000","last_change":"2024-09-10T23:15:14.786936+0000","last_active":"2024-09-10T23:15:14.790675+0000","last_peered":"2024-09-10T23:15:14.790675+0000","last_clean":"2024-09-10T23:15:14.790675+0000","last_became_active":"2024-09-10T23:15:14.786650+0000","last_became_peered":"2024-09-10T23:15:14.786650+0000","last_unstale":"2024-09-10T23:15:14.790675+0000","last_undegraded":"2024-09-10T23:15:14.790675+0000","last_fullsized":"2024-09-10T23:15:14.790675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:13.688354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796061+0000","last_change":"2024-09-10T23:15:13.773637+0000","last_active":"2024-09-10T23:15:14.796061+0000","last_peered":"2024-09-10T23:15:14.796061+0000","last_clean":"2024-09-10T23:15:14.796061+0000","last_became_active":"2024-09-10T23:15:13.773364+0000","last_became_peered":"2024-09-10T23:15:13.773364+0000","last_unstale":"2024-09-10T23:15:14.796061+0000","last_undegraded":"2024-09-10T23:15:14.796061+0000","last_fullsized":"2024-09-10T23:15:14.796061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:54.026868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.789786+0000","last_change":"2024-09-10T23:15:14.782668+0000","last_active":"2024-09-10T23:15:14.789786+0000","last_peered":"2024-09-10T23:15:14.789786+0000","last_clean":"2024-09-10T23:15:14.789786+0000","last_became_active":"2024-09-10T23:15:14.782405+0000","last_became_peered":"2024-09-10T23:15:14.782405+0000","last_unstale":"2024-09-10T23:15:14.789786+0000","last_undegraded":"2024-09-10T23:15:14.789786+0000","last_fullsized":"2024-09-10T23:15:14.789786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:09.218654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.769474+0000","last_change":"2024-09-10T23:15:13.773432+0000","last_active":"2024-09-10T23:15:14.769474+0000","last_peered":"2024-09-10T23:15:14.769474+0000","last_clean":"2024-09-10T23:15:14.769474+0000","last_became_active":"2024-09-10T23:15:13.773136+0000","last_became_peered":"2024-09-10T23:15:13.773136+0000","last_unstale":"2024-09-10T23:15:14.769474+0000","last_undegraded":"2024-09-10T23:15:14.769474+0000","last_fullsized":"2024-09-10T23:15:14.769474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:04.980386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795142+0000","last_change":"2024-09-10T23:15:14.792375+0000","last_active":"2024-09-10T23:15:14.795142+0000","last_peered":"2024-09-10T23:15:14.795142+0000","last_clean":"2024-09-10T23:15:14.795142+0000","last_became_active":"2024-09-10T23:15:14.791810+0000","last_became_peered":"2024-09-10T23:15:14.791810+0000","last_unstale":"2024-09-10T23:15:14.795142+0000","last_undegraded":"2024-09-10T23:15:14.795142+0000","last_fullsized":"2024-09-10T23:15:14.795142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:19.491880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.771808+0000","last_change":"2024-09-10T23:15:13.771529+0000","last_active":"2024-09-10T23:15:14.771808+0000","last_peered":"2024-09-10T23:15:14.771808+0000","last_clean":"2024-09-10T23:15:14.771808+0000","last_became_active":"2024-09-10T23:15:13.771101+0000","last_became_peered":"2024-09-10T23:15:13.771101+0000","last_unstale":"2024-09-10T23:15:14.771808+0000","last_undegraded":"2024-09-10T23:15:14.771808+0000","last_fullsized":"2024-09-10T23:15:14.771808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:19.576849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.794227+0000","last_change":"2024-09-10T23:15:14.793264+0000","last_active":"2024-09-10T23:15:14.794227+0000","last_peered":"2024-09-10T23:15:14.794227+0000","last_clean":"2024-09-10T23:15:14.794227+0000","last_became_active":"2024-09-10T23:15:14.792985+0000","last_became_peered":"2024-09-10T23:15:14.792985+0000","last_unstale":"2024-09-10T23:15:14.794227+0000","last_undegraded":"2024-09-10T23:15:14.794227+0000","last_fullsized":"2024-09-10T23:15:14.794227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:47.421144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797571+0000","last_change":"2024-09-10T23:15:13.764689+0000","last_active":"2024-09-10T23:15:14.797571+0000","last_peered":"2024-09-10T23:15:14.797571+0000","last_clean":"2024-09-10T23:15:14.797571+0000","last_became_active":"2024-09-10T23:15:13.764433+0000","last_became_peered":"2024-09-10T23:15:13.764433+0000","last_unstale":"2024-09-10T23:15:14.797571+0000","last_undegraded":"2024-09-10T23:15:14.797571+0000","last_fullsized":"2024-09-10T23:15:14.797571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:58.916488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.794877+0000","last_change":"2024-09-10T23:15:14.792824+0000","last_active":"2024-09-10T23:15:14.794877+0000","last_peered":"2024-09-10T23:15:14.794877+0000","last_clean":"2024-09-10T23:15:14.794877+0000","last_became_active":"2024-09-10T23:15:14.792525+0000","last_became_peered":"2024-09-10T23:15:14.792525+0000","last_unstale":"2024-09-10T23:15:14.794877+0000","last_undegraded":"2024-09-10T23:15:14.794877+0000","last_fullsized":"2024-09-10T23:15:14.794877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:21.730415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797008+0000","last_change":"2024-09-10T23:15:13.766624+0000","last_active":"2024-09-10T23:15:14.797008+0000","last_peered":"2024-09-10T23:15:14.797008+0000","last_clean":"2024-09-10T23:15:14.797008+0000","last_became_active":"2024-09-10T23:15:13.766374+0000","last_became_peered":"2024-09-10T23:15:13.766374+0000","last_unstale":"2024-09-10T23:15:14.797008+0000","last_undegraded":"2024-09-10T23:15:14.797008+0000","last_fullsized":"2024-09-10T23:15:14.797008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:20.087239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.789947+0000","last_change":"2024-09-10T23:15:14.787164+0000","last_active":"2024-09-10T23:15:14.789947+0000","last_peered":"2024-09-10T23:15:14.789947+0000","last_clean":"2024-09-10T23:15:14.789947+0000","last_became_active":"2024-09-10T23:15:14.786906+0000","last_became_peered":"2024-09-10T23:15:14.786906+0000","last_unstale":"2024-09-10T23:15:14.789947+0000","last_undegraded":"2024-09-10T23:15:14.789947+0000","last_fullsized":"2024-09-10T23:15:14.789947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:19.491880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796153+0000","last_change":"2024-09-10T23:15:13.773007+0000","last_active":"2024-09-10T23:15:14.796153+0000","last_peered":"2024-09-10T23:15:14.796153+0000","last_clean":"2024-09-10T23:15:14.796153+0000","last_became_active":"2024-09-10T23:15:13.772559+0000","last_became_peered":"2024-09-10T23:15:13.772559+0000","last_unstale":"2024-09-10T23:15:14.796153+0000","last_undegraded":"2024-09-10T23:15:14.796153+0000","last_fullsized":"2024-09-10T23:15:14.796153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:31.568535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788033+0000","last_change":"2024-09-10T23:15:14.785689+0000","last_active":"2024-09-10T23:15:14.788033+0000","last_peered":"2024-09-10T23:15:14.788033+0000","last_clean":"2024-09-10T23:15:14.788033+0000","last_became_active":"2024-09-10T23:15:14.785429+0000","last_became_peered":"2024-09-10T23:15:14.785429+0000","last_unstale":"2024-09-10T23:15:14.788033+0000","last_undegraded":"2024-09-10T23:15:14.788033+0000","last_fullsized":"2024-09-10T23:15:14.788033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:39.168497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796698+0000","last_change":"2024-09-10T23:15:13.767364+0000","last_active":"2024-09-10T23:15:14.796698+0000","last_peered":"2024-09-10T23:15:14.796698+0000","last_clean":"2024-09-10T23:15:14.796698+0000","last_became_active":"2024-09-10T23:15:13.767058+0000","last_became_peered":"2024-09-10T23:15:13.767058+0000","last_unstale":"2024-09-10T23:15:14.796698+0000","last_undegraded":"2024-09-10T23:15:14.796698+0000","last_fullsized":"2024-09-10T23:15:14.796698+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:56.499318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.787001+0000","last_change":"2024-09-10T23:15:14.785805+0000","last_active":"2024-09-10T23:15:14.787001+0000","last_peered":"2024-09-10T23:15:14.787001+0000","last_clean":"2024-09-10T23:15:14.787001+0000","last_became_active":"2024-09-10T23:15:14.785505+0000","last_became_peered":"2024-09-10T23:15:14.785505+0000","last_unstale":"2024-09-10T23:15:14.787001+0000","last_undegraded":"2024-09-10T23:15:14.787001+0000","last_fullsized":"2024-09-10T23:15:14.787001+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:20.643452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.776632+0000","last_change":"2024-09-10T23:15:13.771804+0000","last_active":"2024-09-10T23:15:14.776632+0000","last_peered":"2024-09-10T23:15:14.776632+0000","last_clean":"2024-09-10T23:15:14.776632+0000","last_became_active":"2024-09-10T23:15:13.771498+0000","last_became_peered":"2024-09-10T23:15:13.771498+0000","last_unstale":"2024-09-10T23:15:14.776632+0000","last_undegraded":"2024-09-10T23:15:14.776632+0000","last_fullsized":"2024-09-10T23:15:14.776632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:20.145398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795063+0000","last_change":"2024-09-10T23:15:14.791708+0000","last_active":"2024-09-10T23:15:14.795063+0000","last_peered":"2024-09-10T23:15:14.795063+0000","last_clean":"2024-09-10T23:15:14.795063+0000","last_became_active":"2024-09-10T23:15:14.791412+0000","last_became_peered":"2024-09-10T23:15:14.791412+0000","last_unstale":"2024-09-10T23:15:14.795063+0000","last_undegraded":"2024-09-10T23:15:14.795063+0000","last_fullsized":"2024-09-10T23:15:14.795063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:09.924821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.754184+0000","last_change":"2024-09-10T23:15:12.754184+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.754184+0000","last_undegraded":"2024-09-10T23:15:12.754184+0000","last_fullsized":"2024-09-10T23:15:12.754184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.780069+0000","last_change":"2024-09-10T23:15:14.778395+0000","last_active":"2024-09-10T23:15:14.780069+0000","last_peered":"2024-09-10T23:15:14.780069+0000","last_clean":"2024-09-10T23:15:14.780069+0000","last_became_active":"2024-09-10T23:15:14.778134+0000","last_became_peered":"2024-09-10T23:15:14.778134+0000","last_unstale":"2024-09-10T23:15:14.780069+0000","last_undegraded":"2024-09-10T23:15:14.780069+0000","last_fullsized":"2024-09-10T23:15:14.780069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:22.766998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.775182+0000","last_change":"2024-09-10T23:15:13.772451+0000","last_active":"2024-09-10T23:15:14.775182+0000","last_peered":"2024-09-10T23:15:14.775182+0000","last_clean":"2024-09-10T23:15:14.775182+0000","last_became_active":"2024-09-10T23:15:13.772151+0000","last_became_peered":"2024-09-10T23:15:13.772151+0000","last_unstale":"2024-09-10T23:15:14.775182+0000","last_undegraded":"2024-09-10T23:15:14.775182+0000","last_fullsized":"2024-09-10T23:15:14.775182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:36.129380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.783151+0000","last_change":"2024-09-10T23:15:14.779020+0000","last_active":"2024-09-10T23:15:14.783151+0000","last_peered":"2024-09-10T23:15:14.783151+0000","last_clean":"2024-09-10T23:15:14.783151+0000","last_became_active":"2024-09-10T23:15:14.778786+0000","last_became_peered":"2024-09-10T23:15:14.778786+0000","last_unstale":"2024-09-10T23:15:14.783151+0000","last_undegraded":"2024-09-10T23:15:14.783151+0000","last_fullsized":"2024-09-10T23:15:14.783151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:52.746909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.775246+0000","last_change":"2024-09-10T23:15:13.772463+0000","last_active":"2024-09-10T23:15:14.775246+0000","last_peered":"2024-09-10T23:15:14.775246+0000","last_clean":"2024-09-10T23:15:14.775246+0000","last_became_active":"2024-09-10T23:15:13.772215+0000","last_became_peered":"2024-09-10T23:15:13.772215+0000","last_unstale":"2024-09-10T23:15:14.775246+0000","last_undegraded":"2024-09-10T23:15:14.775246+0000","last_fullsized":"2024-09-10T23:15:14.775246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:22.421760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788707+0000","last_change":"2024-09-10T23:15:14.787638+0000","last_active":"2024-09-10T23:15:14.788707+0000","last_peered":"2024-09-10T23:15:14.788707+0000","last_clean":"2024-09-10T23:15:14.788707+0000","last_became_active":"2024-09-10T23:15:14.787332+0000","last_became_peered":"2024-09-10T23:15:14.787332+0000","last_unstale":"2024-09-10T23:15:14.788707+0000","last_undegraded":"2024-09-10T23:15:14.788707+0000","last_fullsized":"2024-09-10T23:15:14.788707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:40.651240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.770466+0000","last_change":"2024-09-10T23:15:13.772780+0000","last_active":"2024-09-10T23:15:14.770466+0000","last_peered":"2024-09-10T23:15:14.770466+0000","last_clean":"2024-09-10T23:15:14.770466+0000","last_became_active":"2024-09-10T23:15:13.770367+0000","last_became_peered":"2024-09-10T23:15:13.770367+0000","last_unstale":"2024-09-10T23:15:14.770466+0000","last_undegraded":"2024-09-10T23:15:14.770466+0000","last_fullsized":"2024-09-10T23:15:14.770466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:35.731410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.780074+0000","last_change":"2024-09-10T23:15:14.778452+0000","last_active":"2024-09-10T23:15:14.780074+0000","last_peered":"2024-09-10T23:15:14.780074+0000","last_clean":"2024-09-10T23:15:14.780074+0000","last_became_active":"2024-09-10T23:15:14.778193+0000","last_became_peered":"2024-09-10T23:15:14.778193+0000","last_unstale":"2024-09-10T23:15:14.780074+0000","last_undegraded":"2024-09-10T23:15:14.780074+0000","last_fullsized":"2024-09-10T23:15:14.780074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:09.145185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795882+0000","last_change":"2024-09-10T23:15:13.769520+0000","last_active":"2024-09-10T23:15:14.795882+0000","last_peered":"2024-09-10T23:15:14.795882+0000","last_clean":"2024-09-10T23:15:14.795882+0000","last_became_active":"2024-09-10T23:15:13.769237+0000","last_became_peered":"2024-09-10T23:15:13.769237+0000","last_unstale":"2024-09-10T23:15:14.795882+0000","last_undegraded":"2024-09-10T23:15:14.795882+0000","last_fullsized":"2024-09-10T23:15:14.795882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:27.770813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785637+0000","last_change":"2024-09-10T23:15:14.777929+0000","last_active":"2024-09-10T23:15:14.785637+0000","last_peered":"2024-09-10T23:15:14.785637+0000","last_clean":"2024-09-10T23:15:14.785637+0000","last_became_active":"2024-09-10T23:15:14.777655+0000","last_became_peered":"2024-09-10T23:15:14.777655+0000","last_unstale":"2024-09-10T23:15:14.785637+0000","last_undegraded":"2024-09-10T23:15:14.785637+0000","last_fullsized":"2024-09-10T23:15:14.785637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:01.426667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.753512+0000","last_change":"2024-09-10T23:15:12.753512+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.753512+0000","last_undegraded":"2024-09-10T23:15:12.753512+0000","last_fullsized":"2024-09-10T23:15:12.753512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:15:13.749502+0000","last_change":"2024-09-10T23:15:13.749502+0000","last_active":"2024-09-10T23:15:13.749502+0000","last_peered":"2024-09-10T23:15:13.749502+0000","last_clean":"2024-09-10T23:15:13.749502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:13.749502+0000","last_undegraded":"2024-09-10T23:15:13.749502+0000","last_fullsized":"2024-09-10T23:15:13.749502+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.770483+0000","last_change":"2024-09-10T23:15:13.765968+0000","last_active":"2024-09-10T23:15:14.770483+0000","last_peered":"2024-09-10T23:15:14.770483+0000","last_clean":"2024-09-10T23:15:14.770483+0000","last_became_active":"2024-09-10T23:15:13.765648+0000","last_became_peered":"2024-09-10T23:15:13.765648+0000","last_unstale":"2024-09-10T23:15:14.770483+0000","last_undegraded":"2024-09-10T23:15:14.770483+0000","last_fullsized":"2024-09-10T23:15:14.770483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:33.223107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786838+0000","last_change":"2024-09-10T23:15:14.784737+0000","last_active":"2024-09-10T23:15:14.786838+0000","last_peered":"2024-09-10T23:15:14.786838+0000","last_clean":"2024-09-10T23:15:14.786838+0000","last_became_active":"2024-09-10T23:15:14.784476+0000","last_became_peered":"2024-09-10T23:15:14.784476+0000","last_unstale":"2024-09-10T23:15:14.786838+0000","last_undegraded":"2024-09-10T23:15:14.786838+0000","last_fullsized":"2024-09-10T23:15:14.786838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:28.776268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.753410+0000","last_change":"2024-09-10T23:15:12.753410+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.753410+0000","last_undegraded":"2024-09-10T23:15:12.753410+0000","last_fullsized":"2024-09-10T23:15:12.753410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:15:13.749502+0000","last_change":"2024-09-10T23:15:13.749502+0000","last_active":"2024-09-10T23:15:13.749502+0000","last_peered":"2024-09-10T23:15:13.749502+0000","last_clean":"2024-09-10T23:15:13.749502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:13.749502+0000","last_undegraded":"2024-09-10T23:15:13.749502+0000","last_fullsized":"2024-09-10T23:15:13.749502+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.769689+0000","last_change":"2024-09-10T23:15:13.769954+0000","last_active":"2024-09-10T23:15:14.769689+0000","last_peered":"2024-09-10T23:15:14.769689+0000","last_clean":"2024-09-10T23:15:14.769689+0000","last_became_active":"2024-09-10T23:15:13.769701+0000","last_became_peered":"2024-09-10T23:15:13.769701+0000","last_unstale":"2024-09-10T23:15:14.769689+0000","last_undegraded":"2024-09-10T23:15:14.769689+0000","last_fullsized":"2024-09-10T23:15:14.769689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:28.227215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.790292+0000","last_change":"2024-09-10T23:15:14.781851+0000","last_active":"2024-09-10T23:15:14.790292+0000","last_peered":"2024-09-10T23:15:14.790292+0000","last_clean":"2024-09-10T23:15:14.790292+0000","last_became_active":"2024-09-10T23:15:14.781580+0000","last_became_peered":"2024-09-10T23:15:14.781580+0000","last_unstale":"2024-09-10T23:15:14.790292+0000","last_undegraded":"2024-09-10T23:15:14.790292+0000","last_fullsized":"2024-09-10T23:15:14.790292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:26.578923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.775442+0000","last_change":"2024-09-10T23:15:13.774703+0000","last_active":"2024-09-10T23:15:14.775442+0000","last_peered":"2024-09-10T23:15:14.775442+0000","last_clean":"2024-09-10T23:15:14.775442+0000","last_became_active":"2024-09-10T23:15:13.774437+0000","last_became_peered":"2024-09-10T23:15:13.774437+0000","last_unstale":"2024-09-10T23:15:14.775442+0000","last_undegraded":"2024-09-10T23:15:14.775442+0000","last_fullsized":"2024-09-10T23:15:14.775442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:30.064030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797066+0000","last_change":"2024-09-10T23:15:14.796113+0000","last_active":"2024-09-10T23:15:14.797066+0000","last_peered":"2024-09-10T23:15:14.797066+0000","last_clean":"2024-09-10T23:15:14.797066+0000","last_became_active":"2024-09-10T23:15:14.795826+0000","last_became_peered":"2024-09-10T23:15:14.795826+0000","last_unstale":"2024-09-10T23:15:14.797066+0000","last_undegraded":"2024-09-10T23:15:14.797066+0000","last_fullsized":"2024-09-10T23:15:14.797066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:34.564180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.772154+0000","last_change":"2024-09-10T23:15:13.772145+0000","last_active":"2024-09-10T23:15:14.772154+0000","last_peered":"2024-09-10T23:15:14.772154+0000","last_clean":"2024-09-10T23:15:14.772154+0000","last_became_active":"2024-09-10T23:15:13.771823+0000","last_became_peered":"2024-09-10T23:15:13.771823+0000","last_unstale":"2024-09-10T23:15:14.772154+0000","last_undegraded":"2024-09-10T23:15:14.772154+0000","last_fullsized":"2024-09-10T23:15:14.772154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:33.192200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786802+0000","last_change":"2024-09-10T23:15:14.782850+0000","last_active":"2024-09-10T23:15:14.786802+0000","last_peered":"2024-09-10T23:15:14.786802+0000","last_clean":"2024-09-10T23:15:14.786802+0000","last_became_active":"2024-09-10T23:15:14.782571+0000","last_became_peered":"2024-09-10T23:15:14.782571+0000","last_unstale":"2024-09-10T23:15:14.786802+0000","last_undegraded":"2024-09-10T23:15:14.786802+0000","last_fullsized":"2024-09-10T23:15:14.786802+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:34.197656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.774786+0000","last_change":"2024-09-10T23:15:13.775030+0000","last_active":"2024-09-10T23:15:14.774786+0000","last_peered":"2024-09-10T23:15:14.774786+0000","last_clean":"2024-09-10T23:15:14.774786+0000","last_became_active":"2024-09-10T23:15:13.774722+0000","last_became_peered":"2024-09-10T23:15:13.774722+0000","last_unstale":"2024-09-10T23:15:14.774786+0000","last_undegraded":"2024-09-10T23:15:14.774786+0000","last_fullsized":"2024-09-10T23:15:14.774786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:37.882903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":128,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.770056+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:15:14.770056+0000","last_peered":"2024-09-10T23:15:14.770056+0000","last_clean":"2024-09-10T23:15:14.770056+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:15:14.770056+0000","last_undegraded":"2024-09-10T23:15:14.770056+0000","last_fullsized":"2024-09-10T23:15:14.770056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":962560,"data_stored":728585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":138743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":138799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":364544,"data_stored":138127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":352256,"data_stored":131352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":138197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":380928,"data_stored":139761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:15:17.739 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:15:17.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.876+0000 7fd7717ad640 1 -- 172.21.15.90:0/1969000068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7580052e0 msgr2=0x7fd75800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:17.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.876+0000 7fd7717ad640 1 --2- 172.21.15.90:0/1969000068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7580052e0 0x7fd75800b9c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd764001d90 tx=0x7fd758005830 comp rx=0 tx=0).stop 2024-09-10T23:15:17.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.876+0000 7fd7717ad640 1 -- 172.21.15.90:0/1969000068 shutdown_connections 2024-09-10T23:15:17.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.876+0000 7fd7717ad640 1 --2- 172.21.15.90:0/1969000068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7580052e0 0x7fd75800b9c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.876+0000 7fd7717ad640 1 -- 172.21.15.90:0/1969000068 >> 172.21.15.90:0/1969000068 conn(0x7fd76c09d2a0 msgr2=0x7fd76c0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:17.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.876+0000 7fd7717ad640 1 -- 172.21.15.90:0/1969000068 shutdown_connections 2024-09-10T23:15:17.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.876+0000 7fd7717ad640 1 -- 172.21.15.90:0/1969000068 wait complete. 2024-09-10T23:15:17.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.877+0000 7fd7717ad640 1 Processor -- start 2024-09-10T23:15:17.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.877+0000 7fd7717ad640 1 -- start start 2024-09-10T23:15:17.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.878+0000 7fd7717ad640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7580052e0 0x7fd76c0b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:17.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.878+0000 7fd7717ad640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd76c0c7bd0 0x7fd76c0cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:17.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.878+0000 7fd7717ad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd76c1f7e60 0x7fd76c1f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:17.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.878+0000 7fd7717ad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c0b3610 con 0x7fd76c1f7e60 2024-09-10T23:15:17.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.878+0000 7fd7717ad640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c0b3490 con 0x7fd7580052e0 2024-09-10T23:15:17.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.878+0000 7fd7717ad640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd76c0b3790 con 0x7fd76c0c7bd0 2024-09-10T23:15:17.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.878+0000 7fd76b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd76c1f7e60 0x7fd76c1f82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:17.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.878+0000 7fd76b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd76c1f7e60 0x7fd76c1f82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59662/0 (socket says 172.21.15.90:59662) 2024-09-10T23:15:17.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.878+0000 7fd76b7fe640 1 -- 172.21.15.90:0/1012589637 learned_addr learned my addr 172.21.15.90:0/1012589637 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:17.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.878+0000 7fd76b7fe640 1 -- 172.21.15.90:0/1012589637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd76c0c7bd0 msgr2=0x7fd76c0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:17.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.878+0000 7fd76b7fe640 1 --2- 172.21.15.90:0/1012589637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd76c0c7bd0 0x7fd76c0cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.878+0000 7fd76b7fe640 1 -- 172.21.15.90:0/1012589637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7580052e0 msgr2=0x7fd76c0b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:17.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.878+0000 7fd76affd640 1 --2- 172.21.15.90:0/1012589637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7580052e0 0x7fd76c0b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:17.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.878+0000 7fd76b7fe640 1 --2- 172.21.15.90:0/1012589637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7580052e0 0x7fd76c0b6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:17.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.878+0000 7fd76b7fe640 1 -- 172.21.15.90:0/1012589637 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76c0b7410 con 0x7fd76c1f7e60 2024-09-10T23:15:17.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.879+0000 7fd76b7fe640 1 --2- 172.21.15.90:0/1012589637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd76c1f7e60 0x7fd76c1f82f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd76402ac80 tx=0x7fd764001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:17.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.879+0000 7fd7637fe640 1 -- 172.21.15.90:0/1012589637 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd764003b80 con 0x7fd76c1f7e60 2024-09-10T23:15:17.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.879+0000 7fd7637fe640 1 -- 172.21.15.90:0/1012589637 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd764003e10 con 0x7fd76c1f7e60 2024-09-10T23:15:17.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.879+0000 7fd7717ad640 1 -- 172.21.15.90:0/1012589637 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd76c0b76e0 con 0x7fd76c1f7e60 2024-09-10T23:15:17.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.879+0000 7fd7637fe640 1 -- 172.21.15.90:0/1012589637 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7640326b0 con 0x7fd76c1f7e60 2024-09-10T23:15:17.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.879+0000 7fd7717ad640 1 -- 172.21.15.90:0/1012589637 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd76c0b7ca0 con 0x7fd76c1f7e60 2024-09-10T23:15:17.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.880+0000 7fd7717ad640 1 -- 172.21.15.90:0/1012589637 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd76c0d29c0 con 0x7fd76c1f7e60 2024-09-10T23:15:17.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.880+0000 7fd7637fe640 1 -- 172.21.15.90:0/1012589637 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd764032850 con 0x7fd76c1f7e60 2024-09-10T23:15:17.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.881+0000 7fd7637fe640 1 --2- 172.21.15.90:0/1012589637 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd74c077f70 0x7fd74c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:17.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.881+0000 7fd7637fe640 1 -- 172.21.15.90:0/1012589637 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd7640b9d80 con 0x7fd76c1f7e60 2024-09-10T23:15:17.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.881+0000 7fd76affd640 1 --2- 172.21.15.90:0/1012589637 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd74c077f70 0x7fd74c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:17.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.882+0000 7fd76affd640 1 --2- 172.21.15.90:0/1012589637 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd74c077f70 0x7fd74c07a430 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd75c005fd0 tx=0x7fd75c005890 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:17.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:17.885+0000 7fd7637fe640 1 -- 172.21.15.90:0/1012589637 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd764044060 con 0x7fd76c1f7e60 2024-09-10T23:15:18.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.057+0000 7fd7717ad640 1 -- 172.21.15.90:0/1012589637 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd76c0b1ed0 con 0x7fd74c077f70 2024-09-10T23:15:18.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.061+0000 7fd7637fe640 1 -- 172.21.15.90:0/1012589637 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250843 (secure 0 0 0) 0x7fd76c0b1ed0 con 0x7fd74c077f70 2024-09-10T23:15:18.287 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:18.288 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:15:18.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.064+0000 7fd7717ad640 1 -- 172.21.15.90:0/1012589637 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd74c077f70 msgr2=0x7fd74c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:18.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.064+0000 7fd7717ad640 1 --2- 172.21.15.90:0/1012589637 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd74c077f70 0x7fd74c07a430 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd75c005fd0 tx=0x7fd75c005890 comp rx=0 tx=0).stop 2024-09-10T23:15:18.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.064+0000 7fd7717ad640 1 -- 172.21.15.90:0/1012589637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd76c1f7e60 msgr2=0x7fd76c1f82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:18.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.064+0000 7fd7717ad640 1 --2- 172.21.15.90:0/1012589637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd76c1f7e60 0x7fd76c1f82f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd76402ac80 tx=0x7fd764001ae0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.064+0000 7fd7717ad640 1 -- 172.21.15.90:0/1012589637 shutdown_connections 2024-09-10T23:15:18.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.064+0000 7fd7717ad640 1 --2- 172.21.15.90:0/1012589637 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd74c077f70 0x7fd74c07a430 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.064+0000 7fd7717ad640 1 --2- 172.21.15.90:0/1012589637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd76c1f7e60 0x7fd76c1f82f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.064+0000 7fd7717ad640 1 --2- 172.21.15.90:0/1012589637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd76c0c7bd0 0x7fd76c0cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.064+0000 7fd7717ad640 1 --2- 172.21.15.90:0/1012589637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7580052e0 0x7fd76c0b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.064+0000 7fd7717ad640 1 -- 172.21.15.90:0/1012589637 >> 172.21.15.90:0/1012589637 conn(0x7fd76c09d2a0 msgr2=0x7fd76c15d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:18.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.064+0000 7fd7717ad640 1 -- 172.21.15.90:0/1012589637 shutdown_connections 2024-09-10T23:15:18.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.064+0000 7fd7717ad640 1 -- 172.21.15.90:0/1012589637 wait complete. 2024-09-10T23:15:18.292 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-10T23:15:16.442105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":144,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220264,"kb_used_data":4012,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754456,"statfs":{"total":773094113280,"available":772868562944,"internally_reserved":0,"allocated":4108288,"data_stored":2269017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000768"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785950+0000","last_change":"2024-09-10T23:15:14.782590+0000","last_active":"2024-09-10T23:15:14.785950+0000","last_peered":"2024-09-10T23:15:14.785950+0000","last_clean":"2024-09-10T23:15:14.785950+0000","last_became_active":"2024-09-10T23:15:14.782279+0000","last_became_peered":"2024-09-10T23:15:14.782279+0000","last_unstale":"2024-09-10T23:15:14.785950+0000","last_undegraded":"2024-09-10T23:15:14.785950+0000","last_fullsized":"2024-09-10T23:15:14.785950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:29.232671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795199+0000","last_change":"2024-09-10T23:15:14.784084+0000","last_active":"2024-09-10T23:15:14.795199+0000","last_peered":"2024-09-10T23:15:14.795199+0000","last_clean":"2024-09-10T23:15:14.795199+0000","last_became_active":"2024-09-10T23:15:14.783797+0000","last_became_peered":"2024-09-10T23:15:14.783797+0000","last_unstale":"2024-09-10T23:15:14.795199+0000","last_undegraded":"2024-09-10T23:15:14.795199+0000","last_fullsized":"2024-09-10T23:15:14.795199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:05.732071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785174+0000","last_change":"2024-09-10T23:15:14.777426+0000","last_active":"2024-09-10T23:15:14.785174+0000","last_peered":"2024-09-10T23:15:14.785174+0000","last_clean":"2024-09-10T23:15:14.785174+0000","last_became_active":"2024-09-10T23:15:14.777146+0000","last_became_peered":"2024-09-10T23:15:14.777146+0000","last_unstale":"2024-09-10T23:15:14.785174+0000","last_undegraded":"2024-09-10T23:15:14.785174+0000","last_fullsized":"2024-09-10T23:15:14.785174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:59.921943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.790290+0000","last_change":"2024-09-10T23:15:14.786653+0000","last_active":"2024-09-10T23:15:14.790290+0000","last_peered":"2024-09-10T23:15:14.790290+0000","last_clean":"2024-09-10T23:15:14.790290+0000","last_became_active":"2024-09-10T23:15:14.786388+0000","last_became_peered":"2024-09-10T23:15:14.786388+0000","last_unstale":"2024-09-10T23:15:14.790290+0000","last_undegraded":"2024-09-10T23:15:14.790290+0000","last_fullsized":"2024-09-10T23:15:14.790290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:57.739458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.780047+0000","last_change":"2024-09-10T23:15:14.777568+0000","last_active":"2024-09-10T23:15:14.780047+0000","last_peered":"2024-09-10T23:15:14.780047+0000","last_clean":"2024-09-10T23:15:14.780047+0000","last_became_active":"2024-09-10T23:15:14.777316+0000","last_became_peered":"2024-09-10T23:15:14.777316+0000","last_unstale":"2024-09-10T23:15:14.780047+0000","last_undegraded":"2024-09-10T23:15:14.780047+0000","last_fullsized":"2024-09-10T23:15:14.780047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:48.058773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796029+0000","last_change":"2024-09-10T23:15:14.787768+0000","last_active":"2024-09-10T23:15:14.796029+0000","last_peered":"2024-09-10T23:15:14.796029+0000","last_clean":"2024-09-10T23:15:14.796029+0000","last_became_active":"2024-09-10T23:15:14.787494+0000","last_became_peered":"2024-09-10T23:15:14.787494+0000","last_unstale":"2024-09-10T23:15:14.796029+0000","last_undegraded":"2024-09-10T23:15:14.796029+0000","last_fullsized":"2024-09-10T23:15:14.796029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:51.822103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788683+0000","last_change":"2024-09-10T23:15:14.786512+0000","last_active":"2024-09-10T23:15:14.788683+0000","last_peered":"2024-09-10T23:15:14.788683+0000","last_clean":"2024-09-10T23:15:14.788683+0000","last_became_active":"2024-09-10T23:15:14.786226+0000","last_became_peered":"2024-09-10T23:15:14.786226+0000","last_unstale":"2024-09-10T23:15:14.788683+0000","last_undegraded":"2024-09-10T23:15:14.788683+0000","last_fullsized":"2024-09-10T23:15:14.788683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:26.578923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786982+0000","last_change":"2024-09-10T23:15:14.779115+0000","last_active":"2024-09-10T23:15:14.786982+0000","last_peered":"2024-09-10T23:15:14.786982+0000","last_clean":"2024-09-10T23:15:14.786982+0000","last_became_active":"2024-09-10T23:15:14.778811+0000","last_became_peered":"2024-09-10T23:15:14.778811+0000","last_unstale":"2024-09-10T23:15:14.786982+0000","last_undegraded":"2024-09-10T23:15:14.786982+0000","last_fullsized":"2024-09-10T23:15:14.786982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:59.921943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.791973+0000","last_change":"2024-09-10T23:15:14.784909+0000","last_active":"2024-09-10T23:15:14.791973+0000","last_peered":"2024-09-10T23:15:14.791973+0000","last_clean":"2024-09-10T23:15:14.791973+0000","last_became_active":"2024-09-10T23:15:14.784511+0000","last_became_peered":"2024-09-10T23:15:14.784511+0000","last_unstale":"2024-09-10T23:15:14.791973+0000","last_undegraded":"2024-09-10T23:15:14.791973+0000","last_fullsized":"2024-09-10T23:15:14.791973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:05.158732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.787382+0000","last_change":"2024-09-10T23:15:14.785521+0000","last_active":"2024-09-10T23:15:14.787382+0000","last_peered":"2024-09-10T23:15:14.787382+0000","last_clean":"2024-09-10T23:15:14.787382+0000","last_became_active":"2024-09-10T23:15:14.785042+0000","last_became_peered":"2024-09-10T23:15:14.785042+0000","last_unstale":"2024-09-10T23:15:14.787382+0000","last_undegraded":"2024-09-10T23:15:14.787382+0000","last_fullsized":"2024-09-10T23:15:14.787382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:11.616236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788226+0000","last_change":"2024-09-10T23:15:14.783123+0000","last_active":"2024-09-10T23:15:14.788226+0000","last_peered":"2024-09-10T23:15:14.788226+0000","last_clean":"2024-09-10T23:15:14.788226+0000","last_became_active":"2024-09-10T23:15:14.782839+0000","last_became_peered":"2024-09-10T23:15:14.782839+0000","last_unstale":"2024-09-10T23:15:14.788226+0000","last_undegraded":"2024-09-10T23:15:14.788226+0000","last_fullsized":"2024-09-10T23:15:14.788226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:01.426667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785981+0000","last_change":"2024-09-10T23:15:14.780626+0000","last_active":"2024-09-10T23:15:14.785981+0000","last_peered":"2024-09-10T23:15:14.785981+0000","last_clean":"2024-09-10T23:15:14.785981+0000","last_became_active":"2024-09-10T23:15:14.780319+0000","last_became_peered":"2024-09-10T23:15:14.780319+0000","last_unstale":"2024-09-10T23:15:14.785981+0000","last_undegraded":"2024-09-10T23:15:14.785981+0000","last_fullsized":"2024-09-10T23:15:14.785981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:43.885268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.779991+0000","last_change":"2024-09-10T23:15:14.775829+0000","last_active":"2024-09-10T23:15:14.779991+0000","last_peered":"2024-09-10T23:15:14.779991+0000","last_clean":"2024-09-10T23:15:14.779991+0000","last_became_active":"2024-09-10T23:15:14.775197+0000","last_became_peered":"2024-09-10T23:15:14.775197+0000","last_unstale":"2024-09-10T23:15:14.779991+0000","last_undegraded":"2024-09-10T23:15:14.779991+0000","last_fullsized":"2024-09-10T23:15:14.779991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:05.633943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.777970+0000","last_change":"2024-09-10T23:15:14.776541+0000","last_active":"2024-09-10T23:15:14.777970+0000","last_peered":"2024-09-10T23:15:14.777970+0000","last_clean":"2024-09-10T23:15:14.777970+0000","last_became_active":"2024-09-10T23:15:14.776297+0000","last_became_peered":"2024-09-10T23:15:14.776297+0000","last_unstale":"2024-09-10T23:15:14.777970+0000","last_undegraded":"2024-09-10T23:15:14.777970+0000","last_fullsized":"2024-09-10T23:15:14.777970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:04.984362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786416+0000","last_change":"2024-09-10T23:15:14.784278+0000","last_active":"2024-09-10T23:15:14.786416+0000","last_peered":"2024-09-10T23:15:14.786416+0000","last_clean":"2024-09-10T23:15:14.786416+0000","last_became_active":"2024-09-10T23:15:14.784023+0000","last_became_peered":"2024-09-10T23:15:14.784023+0000","last_unstale":"2024-09-10T23:15:14.786416+0000","last_undegraded":"2024-09-10T23:15:14.786416+0000","last_fullsized":"2024-09-10T23:15:14.786416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:40.651240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786958+0000","last_change":"2024-09-10T23:15:14.778174+0000","last_active":"2024-09-10T23:15:14.786958+0000","last_peered":"2024-09-10T23:15:14.786958+0000","last_clean":"2024-09-10T23:15:14.786958+0000","last_became_active":"2024-09-10T23:15:14.777911+0000","last_became_peered":"2024-09-10T23:15:14.777911+0000","last_unstale":"2024-09-10T23:15:14.786958+0000","last_undegraded":"2024-09-10T23:15:14.786958+0000","last_fullsized":"2024-09-10T23:15:14.786958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:20.582304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788259+0000","last_change":"2024-09-10T23:15:14.784036+0000","last_active":"2024-09-10T23:15:14.788259+0000","last_peered":"2024-09-10T23:15:14.788259+0000","last_clean":"2024-09-10T23:15:14.788259+0000","last_became_active":"2024-09-10T23:15:14.783780+0000","last_became_peered":"2024-09-10T23:15:14.783780+0000","last_unstale":"2024-09-10T23:15:14.788259+0000","last_undegraded":"2024-09-10T23:15:14.788259+0000","last_fullsized":"2024-09-10T23:15:14.788259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:43.885268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.789823+0000","last_change":"2024-09-10T23:15:14.782310+0000","last_active":"2024-09-10T23:15:14.789823+0000","last_peered":"2024-09-10T23:15:14.789823+0000","last_clean":"2024-09-10T23:15:14.789823+0000","last_became_active":"2024-09-10T23:15:14.782047+0000","last_became_peered":"2024-09-10T23:15:14.782047+0000","last_unstale":"2024-09-10T23:15:14.789823+0000","last_undegraded":"2024-09-10T23:15:14.789823+0000","last_fullsized":"2024-09-10T23:15:14.789823+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:40.651240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.778031+0000","last_change":"2024-09-10T23:15:14.776242+0000","last_active":"2024-09-10T23:15:14.778031+0000","last_peered":"2024-09-10T23:15:14.778031+0000","last_clean":"2024-09-10T23:15:14.778031+0000","last_became_active":"2024-09-10T23:15:14.776016+0000","last_became_peered":"2024-09-10T23:15:14.776016+0000","last_unstale":"2024-09-10T23:15:14.778031+0000","last_undegraded":"2024-09-10T23:15:14.778031+0000","last_fullsized":"2024-09-10T23:15:14.778031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:43.885268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.779028+0000","last_change":"2024-09-10T23:15:14.773759+0000","last_active":"2024-09-10T23:15:14.779028+0000","last_peered":"2024-09-10T23:15:14.779028+0000","last_clean":"2024-09-10T23:15:14.779028+0000","last_became_active":"2024-09-10T23:15:14.773146+0000","last_became_peered":"2024-09-10T23:15:14.773146+0000","last_unstale":"2024-09-10T23:15:14.779028+0000","last_undegraded":"2024-09-10T23:15:14.779028+0000","last_fullsized":"2024-09-10T23:15:14.779028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:00.613653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.793605+0000","last_change":"2024-09-10T23:15:14.790230+0000","last_active":"2024-09-10T23:15:14.793605+0000","last_peered":"2024-09-10T23:15:14.793605+0000","last_clean":"2024-09-10T23:15:14.793605+0000","last_became_active":"2024-09-10T23:15:14.785734+0000","last_became_peered":"2024-09-10T23:15:14.785734+0000","last_unstale":"2024-09-10T23:15:14.793605+0000","last_undegraded":"2024-09-10T23:15:14.793605+0000","last_fullsized":"2024-09-10T23:15:14.793605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:21.092694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797068+0000","last_change":"2024-09-10T23:15:14.796057+0000","last_active":"2024-09-10T23:15:14.797068+0000","last_peered":"2024-09-10T23:15:14.797068+0000","last_clean":"2024-09-10T23:15:14.797068+0000","last_became_active":"2024-09-10T23:15:14.795690+0000","last_became_peered":"2024-09-10T23:15:14.795690+0000","last_unstale":"2024-09-10T23:15:14.797068+0000","last_undegraded":"2024-09-10T23:15:14.797068+0000","last_fullsized":"2024-09-10T23:15:14.797068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:20.633732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:15:13.749502+0000","last_change":"2024-09-10T23:15:13.749502+0000","last_active":"2024-09-10T23:15:13.749502+0000","last_peered":"2024-09-10T23:15:13.749502+0000","last_clean":"2024-09-10T23:15:13.749502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:13.749502+0000","last_undegraded":"2024-09-10T23:15:13.749502+0000","last_fullsized":"2024-09-10T23:15:13.749502+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.780102+0000","last_change":"2024-09-10T23:15:14.775294+0000","last_active":"2024-09-10T23:15:14.780102+0000","last_peered":"2024-09-10T23:15:14.780102+0000","last_clean":"2024-09-10T23:15:14.780102+0000","last_became_active":"2024-09-10T23:15:14.775007+0000","last_became_peered":"2024-09-10T23:15:14.775007+0000","last_unstale":"2024-09-10T23:15:14.780102+0000","last_undegraded":"2024-09-10T23:15:14.780102+0000","last_fullsized":"2024-09-10T23:15:14.780102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:20.582304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796002+0000","last_change":"2024-09-10T23:15:14.790930+0000","last_active":"2024-09-10T23:15:14.796002+0000","last_peered":"2024-09-10T23:15:14.796002+0000","last_clean":"2024-09-10T23:15:14.796002+0000","last_became_active":"2024-09-10T23:15:14.790611+0000","last_became_peered":"2024-09-10T23:15:14.790611+0000","last_unstale":"2024-09-10T23:15:14.796002+0000","last_undegraded":"2024-09-10T23:15:14.796002+0000","last_fullsized":"2024-09-10T23:15:14.796002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:46.414579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795942+0000","last_change":"2024-09-10T23:15:14.785099+0000","last_active":"2024-09-10T23:15:14.795942+0000","last_peered":"2024-09-10T23:15:14.795942+0000","last_clean":"2024-09-10T23:15:14.795942+0000","last_became_active":"2024-09-10T23:15:14.784771+0000","last_became_peered":"2024-09-10T23:15:14.784771+0000","last_unstale":"2024-09-10T23:15:14.795942+0000","last_undegraded":"2024-09-10T23:15:14.795942+0000","last_fullsized":"2024-09-10T23:15:14.795942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:14.428600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796553+0000","last_change":"2024-09-10T23:15:14.793856+0000","last_active":"2024-09-10T23:15:14.796553+0000","last_peered":"2024-09-10T23:15:14.796553+0000","last_clean":"2024-09-10T23:15:14.796553+0000","last_became_active":"2024-09-10T23:15:14.793367+0000","last_became_peered":"2024-09-10T23:15:14.793367+0000","last_unstale":"2024-09-10T23:15:14.796553+0000","last_undegraded":"2024-09-10T23:15:14.796553+0000","last_fullsized":"2024-09-10T23:15:14.796553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:18.746412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.787300+0000","last_change":"2024-09-10T23:15:14.785755+0000","last_active":"2024-09-10T23:15:14.787300+0000","last_peered":"2024-09-10T23:15:14.787300+0000","last_clean":"2024-09-10T23:15:14.787300+0000","last_became_active":"2024-09-10T23:15:14.782572+0000","last_became_peered":"2024-09-10T23:15:14.782572+0000","last_unstale":"2024-09-10T23:15:14.787300+0000","last_undegraded":"2024-09-10T23:15:14.787300+0000","last_fullsized":"2024-09-10T23:15:14.787300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:09.218654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797495+0000","last_change":"2024-09-10T23:15:14.796654+0000","last_active":"2024-09-10T23:15:14.797495+0000","last_peered":"2024-09-10T23:15:14.797495+0000","last_clean":"2024-09-10T23:15:14.797495+0000","last_became_active":"2024-09-10T23:15:14.796438+0000","last_became_peered":"2024-09-10T23:15:14.796438+0000","last_unstale":"2024-09-10T23:15:14.797495+0000","last_undegraded":"2024-09-10T23:15:14.797495+0000","last_fullsized":"2024-09-10T23:15:14.797495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:36.736865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788177+0000","last_change":"2024-09-10T23:15:14.785696+0000","last_active":"2024-09-10T23:15:14.788177+0000","last_peered":"2024-09-10T23:15:14.788177+0000","last_clean":"2024-09-10T23:15:14.788177+0000","last_became_active":"2024-09-10T23:15:14.785439+0000","last_became_peered":"2024-09-10T23:15:14.785439+0000","last_unstale":"2024-09-10T23:15:14.788177+0000","last_undegraded":"2024-09-10T23:15:14.788177+0000","last_fullsized":"2024-09-10T23:15:14.788177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:04.984362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786699+0000","last_change":"2024-09-10T23:15:14.784069+0000","last_active":"2024-09-10T23:15:14.786699+0000","last_peered":"2024-09-10T23:15:14.786699+0000","last_clean":"2024-09-10T23:15:14.786699+0000","last_became_active":"2024-09-10T23:15:14.783809+0000","last_became_peered":"2024-09-10T23:15:14.783809+0000","last_unstale":"2024-09-10T23:15:14.786699+0000","last_undegraded":"2024-09-10T23:15:14.786699+0000","last_fullsized":"2024-09-10T23:15:14.786699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:34.228563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795168+0000","last_change":"2024-09-10T23:15:14.792638+0000","last_active":"2024-09-10T23:15:14.795168+0000","last_peered":"2024-09-10T23:15:14.795168+0000","last_clean":"2024-09-10T23:15:14.795168+0000","last_became_active":"2024-09-10T23:15:14.792122+0000","last_became_peered":"2024-09-10T23:15:14.792122+0000","last_unstale":"2024-09-10T23:15:14.795168+0000","last_undegraded":"2024-09-10T23:15:14.795168+0000","last_fullsized":"2024-09-10T23:15:14.795168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:05.732071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:15:13.749502+0000","last_change":"2024-09-10T23:15:13.749502+0000","last_active":"2024-09-10T23:15:13.749502+0000","last_peered":"2024-09-10T23:15:13.749502+0000","last_clean":"2024-09-10T23:15:13.749502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:13.749502+0000","last_undegraded":"2024-09-10T23:15:13.749502+0000","last_fullsized":"2024-09-10T23:15:13.749502+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.792354+0000","last_change":"2024-09-10T23:15:13.778953+0000","last_active":"2024-09-10T23:15:14.792354+0000","last_peered":"2024-09-10T23:15:14.792354+0000","last_clean":"2024-09-10T23:15:14.792354+0000","last_became_active":"2024-09-10T23:15:13.778585+0000","last_became_peered":"2024-09-10T23:15:13.778585+0000","last_unstale":"2024-09-10T23:15:14.792354+0000","last_undegraded":"2024-09-10T23:15:14.792354+0000","last_fullsized":"2024-09-10T23:15:14.792354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:04.980386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795415+0000","last_change":"2024-09-10T23:15:14.793437+0000","last_active":"2024-09-10T23:15:14.795415+0000","last_peered":"2024-09-10T23:15:14.795415+0000","last_clean":"2024-09-10T23:15:14.795415+0000","last_became_active":"2024-09-10T23:15:14.792867+0000","last_became_peered":"2024-09-10T23:15:14.792867+0000","last_unstale":"2024-09-10T23:15:14.795415+0000","last_undegraded":"2024-09-10T23:15:14.795415+0000","last_fullsized":"2024-09-10T23:15:14.795415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:11.616236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.755568+0000","last_change":"2024-09-10T23:15:12.755568+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.755568+0000","last_undegraded":"2024-09-10T23:15:12.755568+0000","last_fullsized":"2024-09-10T23:15:12.755568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797736+0000","last_change":"2024-09-10T23:15:14.797080+0000","last_active":"2024-09-10T23:15:14.797736+0000","last_peered":"2024-09-10T23:15:14.797736+0000","last_clean":"2024-09-10T23:15:14.797736+0000","last_became_active":"2024-09-10T23:15:14.796799+0000","last_became_peered":"2024-09-10T23:15:14.796799+0000","last_unstale":"2024-09-10T23:15:14.797736+0000","last_undegraded":"2024-09-10T23:15:14.797736+0000","last_fullsized":"2024-09-10T23:15:14.797736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:20.582304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796219+0000","last_change":"2024-09-10T23:15:13.767284+0000","last_active":"2024-09-10T23:15:14.796219+0000","last_peered":"2024-09-10T23:15:14.796219+0000","last_clean":"2024-09-10T23:15:14.796219+0000","last_became_active":"2024-09-10T23:15:13.766807+0000","last_became_peered":"2024-09-10T23:15:13.766807+0000","last_unstale":"2024-09-10T23:15:14.796219+0000","last_undegraded":"2024-09-10T23:15:14.796219+0000","last_fullsized":"2024-09-10T23:15:14.796219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:19.628277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796527+0000","last_change":"2024-09-10T23:15:14.793249+0000","last_active":"2024-09-10T23:15:14.796527+0000","last_peered":"2024-09-10T23:15:14.796527+0000","last_clean":"2024-09-10T23:15:14.796527+0000","last_became_active":"2024-09-10T23:15:14.792976+0000","last_became_peered":"2024-09-10T23:15:14.792976+0000","last_unstale":"2024-09-10T23:15:14.796527+0000","last_undegraded":"2024-09-10T23:15:14.796527+0000","last_fullsized":"2024-09-10T23:15:14.796527+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:37.902288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795887+0000","last_change":"2024-09-10T23:15:13.769588+0000","last_active":"2024-09-10T23:15:14.795887+0000","last_peered":"2024-09-10T23:15:14.795887+0000","last_clean":"2024-09-10T23:15:14.795887+0000","last_became_active":"2024-09-10T23:15:13.769325+0000","last_became_peered":"2024-09-10T23:15:13.769325+0000","last_unstale":"2024-09-10T23:15:14.795887+0000","last_undegraded":"2024-09-10T23:15:14.795887+0000","last_fullsized":"2024-09-10T23:15:14.795887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:48.670108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795061+0000","last_change":"2024-09-10T23:15:14.791220+0000","last_active":"2024-09-10T23:15:14.795061+0000","last_peered":"2024-09-10T23:15:14.795061+0000","last_clean":"2024-09-10T23:15:14.795061+0000","last_became_active":"2024-09-10T23:15:14.790957+0000","last_became_peered":"2024-09-10T23:15:14.790957+0000","last_unstale":"2024-09-10T23:15:14.795061+0000","last_undegraded":"2024-09-10T23:15:14.795061+0000","last_fullsized":"2024-09-10T23:15:14.795061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:09.218654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796822+0000","last_change":"2024-09-10T23:15:13.768504+0000","last_active":"2024-09-10T23:15:14.796822+0000","last_peered":"2024-09-10T23:15:14.796822+0000","last_clean":"2024-09-10T23:15:14.796822+0000","last_became_active":"2024-09-10T23:15:13.768242+0000","last_became_peered":"2024-09-10T23:15:13.768242+0000","last_unstale":"2024-09-10T23:15:14.796822+0000","last_undegraded":"2024-09-10T23:15:14.796822+0000","last_fullsized":"2024-09-10T23:15:14.796822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:50.630257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786107+0000","last_change":"2024-09-10T23:15:14.783536+0000","last_active":"2024-09-10T23:15:14.786107+0000","last_peered":"2024-09-10T23:15:14.786107+0000","last_clean":"2024-09-10T23:15:14.786107+0000","last_became_active":"2024-09-10T23:15:14.783266+0000","last_became_peered":"2024-09-10T23:15:14.783266+0000","last_unstale":"2024-09-10T23:15:14.786107+0000","last_undegraded":"2024-09-10T23:15:14.786107+0000","last_fullsized":"2024-09-10T23:15:14.786107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:26.578923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796747+0000","last_change":"2024-09-10T23:15:13.771424+0000","last_active":"2024-09-10T23:15:14.796747+0000","last_peered":"2024-09-10T23:15:14.796747+0000","last_clean":"2024-09-10T23:15:14.796747+0000","last_became_active":"2024-09-10T23:15:13.771113+0000","last_became_peered":"2024-09-10T23:15:13.771113+0000","last_unstale":"2024-09-10T23:15:14.796747+0000","last_undegraded":"2024-09-10T23:15:14.796747+0000","last_fullsized":"2024-09-10T23:15:14.796747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:41.926490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.794838+0000","last_change":"2024-09-10T23:15:14.792338+0000","last_active":"2024-09-10T23:15:14.794838+0000","last_peered":"2024-09-10T23:15:14.794838+0000","last_clean":"2024-09-10T23:15:14.794838+0000","last_became_active":"2024-09-10T23:15:14.792063+0000","last_became_peered":"2024-09-10T23:15:14.792063+0000","last_unstale":"2024-09-10T23:15:14.794838+0000","last_undegraded":"2024-09-10T23:15:14.794838+0000","last_fullsized":"2024-09-10T23:15:14.794838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:20.660730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.771600+0000","last_change":"2024-09-10T23:15:13.765543+0000","last_active":"2024-09-10T23:15:14.771600+0000","last_peered":"2024-09-10T23:15:14.771600+0000","last_clean":"2024-09-10T23:15:14.771600+0000","last_became_active":"2024-09-10T23:15:13.765131+0000","last_became_peered":"2024-09-10T23:15:13.765131+0000","last_unstale":"2024-09-10T23:15:14.771600+0000","last_undegraded":"2024-09-10T23:15:14.771600+0000","last_fullsized":"2024-09-10T23:15:14.771600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:33.558724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.792513+0000","last_change":"2024-09-10T23:15:14.787696+0000","last_active":"2024-09-10T23:15:14.792513+0000","last_peered":"2024-09-10T23:15:14.792513+0000","last_clean":"2024-09-10T23:15:14.792513+0000","last_became_active":"2024-09-10T23:15:14.787375+0000","last_became_peered":"2024-09-10T23:15:14.787375+0000","last_unstale":"2024-09-10T23:15:14.792513+0000","last_undegraded":"2024-09-10T23:15:14.792513+0000","last_fullsized":"2024-09-10T23:15:14.792513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:03.746624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.776996+0000","last_change":"2024-09-10T23:15:13.773878+0000","last_active":"2024-09-10T23:15:14.776996+0000","last_peered":"2024-09-10T23:15:14.776996+0000","last_clean":"2024-09-10T23:15:14.776996+0000","last_became_active":"2024-09-10T23:15:13.773575+0000","last_became_peered":"2024-09-10T23:15:13.773575+0000","last_unstale":"2024-09-10T23:15:14.776996+0000","last_undegraded":"2024-09-10T23:15:14.776996+0000","last_fullsized":"2024-09-10T23:15:14.776996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:45.659964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785270+0000","last_change":"2024-09-10T23:15:14.780963+0000","last_active":"2024-09-10T23:15:14.785270+0000","last_peered":"2024-09-10T23:15:14.785270+0000","last_clean":"2024-09-10T23:15:14.785270+0000","last_became_active":"2024-09-10T23:15:14.780623+0000","last_became_peered":"2024-09-10T23:15:14.780623+0000","last_unstale":"2024-09-10T23:15:14.785270+0000","last_undegraded":"2024-09-10T23:15:14.785270+0000","last_fullsized":"2024-09-10T23:15:14.785270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:04.984362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.771644+0000","last_change":"2024-09-10T23:15:13.772352+0000","last_active":"2024-09-10T23:15:14.771644+0000","last_peered":"2024-09-10T23:15:14.771644+0000","last_clean":"2024-09-10T23:15:14.771644+0000","last_became_active":"2024-09-10T23:15:13.772076+0000","last_became_peered":"2024-09-10T23:15:13.772076+0000","last_unstale":"2024-09-10T23:15:14.771644+0000","last_undegraded":"2024-09-10T23:15:14.771644+0000","last_fullsized":"2024-09-10T23:15:14.771644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:35.731410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795126+0000","last_change":"2024-09-10T23:15:14.783374+0000","last_active":"2024-09-10T23:15:14.795126+0000","last_peered":"2024-09-10T23:15:14.795126+0000","last_clean":"2024-09-10T23:15:14.795126+0000","last_became_active":"2024-09-10T23:15:14.783108+0000","last_became_peered":"2024-09-10T23:15:14.783108+0000","last_unstale":"2024-09-10T23:15:14.795126+0000","last_undegraded":"2024-09-10T23:15:14.795126+0000","last_fullsized":"2024-09-10T23:15:14.795126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:19.491880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.754945+0000","last_change":"2024-09-10T23:15:12.754945+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.754945+0000","last_undegraded":"2024-09-10T23:15:12.754945+0000","last_fullsized":"2024-09-10T23:15:12.754945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796664+0000","last_change":"2024-09-10T23:15:14.793078+0000","last_active":"2024-09-10T23:15:14.796664+0000","last_peered":"2024-09-10T23:15:14.796664+0000","last_clean":"2024-09-10T23:15:14.796664+0000","last_became_active":"2024-09-10T23:15:14.792740+0000","last_became_peered":"2024-09-10T23:15:14.792740+0000","last_unstale":"2024-09-10T23:15:14.796664+0000","last_undegraded":"2024-09-10T23:15:14.796664+0000","last_fullsized":"2024-09-10T23:15:14.796664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:57.702941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.794243+0000","last_change":"2024-09-10T23:15:13.770511+0000","last_active":"2024-09-10T23:15:14.794243+0000","last_peered":"2024-09-10T23:15:14.794243+0000","last_clean":"2024-09-10T23:15:14.794243+0000","last_became_active":"2024-09-10T23:15:13.770081+0000","last_became_peered":"2024-09-10T23:15:13.770081+0000","last_unstale":"2024-09-10T23:15:14.794243+0000","last_undegraded":"2024-09-10T23:15:14.794243+0000","last_fullsized":"2024-09-10T23:15:14.794243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:33.558724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785216+0000","last_change":"2024-09-10T23:15:14.777889+0000","last_active":"2024-09-10T23:15:14.785216+0000","last_peered":"2024-09-10T23:15:14.785216+0000","last_clean":"2024-09-10T23:15:14.785216+0000","last_became_active":"2024-09-10T23:15:14.777600+0000","last_became_peered":"2024-09-10T23:15:14.777600+0000","last_unstale":"2024-09-10T23:15:14.785216+0000","last_undegraded":"2024-09-10T23:15:14.785216+0000","last_fullsized":"2024-09-10T23:15:14.785216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:34.197656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.798926+0000","last_change":"2024-09-10T23:15:13.766440+0000","last_active":"2024-09-10T23:15:14.798926+0000","last_peered":"2024-09-10T23:15:14.798926+0000","last_clean":"2024-09-10T23:15:14.798926+0000","last_became_active":"2024-09-10T23:15:13.765980+0000","last_became_peered":"2024-09-10T23:15:13.765980+0000","last_unstale":"2024-09-10T23:15:14.798926+0000","last_undegraded":"2024-09-10T23:15:14.798926+0000","last_fullsized":"2024-09-10T23:15:14.798926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:00.421211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.790675+0000","last_change":"2024-09-10T23:15:14.786936+0000","last_active":"2024-09-10T23:15:14.790675+0000","last_peered":"2024-09-10T23:15:14.790675+0000","last_clean":"2024-09-10T23:15:14.790675+0000","last_became_active":"2024-09-10T23:15:14.786650+0000","last_became_peered":"2024-09-10T23:15:14.786650+0000","last_unstale":"2024-09-10T23:15:14.790675+0000","last_undegraded":"2024-09-10T23:15:14.790675+0000","last_fullsized":"2024-09-10T23:15:14.790675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:13.688354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796061+0000","last_change":"2024-09-10T23:15:13.773637+0000","last_active":"2024-09-10T23:15:14.796061+0000","last_peered":"2024-09-10T23:15:14.796061+0000","last_clean":"2024-09-10T23:15:14.796061+0000","last_became_active":"2024-09-10T23:15:13.773364+0000","last_became_peered":"2024-09-10T23:15:13.773364+0000","last_unstale":"2024-09-10T23:15:14.796061+0000","last_undegraded":"2024-09-10T23:15:14.796061+0000","last_fullsized":"2024-09-10T23:15:14.796061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:54.026868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.789786+0000","last_change":"2024-09-10T23:15:14.782668+0000","last_active":"2024-09-10T23:15:14.789786+0000","last_peered":"2024-09-10T23:15:14.789786+0000","last_clean":"2024-09-10T23:15:14.789786+0000","last_became_active":"2024-09-10T23:15:14.782405+0000","last_became_peered":"2024-09-10T23:15:14.782405+0000","last_unstale":"2024-09-10T23:15:14.789786+0000","last_undegraded":"2024-09-10T23:15:14.789786+0000","last_fullsized":"2024-09-10T23:15:14.789786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:09.218654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.769474+0000","last_change":"2024-09-10T23:15:13.773432+0000","last_active":"2024-09-10T23:15:14.769474+0000","last_peered":"2024-09-10T23:15:14.769474+0000","last_clean":"2024-09-10T23:15:14.769474+0000","last_became_active":"2024-09-10T23:15:13.773136+0000","last_became_peered":"2024-09-10T23:15:13.773136+0000","last_unstale":"2024-09-10T23:15:14.769474+0000","last_undegraded":"2024-09-10T23:15:14.769474+0000","last_fullsized":"2024-09-10T23:15:14.769474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:04.980386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795142+0000","last_change":"2024-09-10T23:15:14.792375+0000","last_active":"2024-09-10T23:15:14.795142+0000","last_peered":"2024-09-10T23:15:14.795142+0000","last_clean":"2024-09-10T23:15:14.795142+0000","last_became_active":"2024-09-10T23:15:14.791810+0000","last_became_peered":"2024-09-10T23:15:14.791810+0000","last_unstale":"2024-09-10T23:15:14.795142+0000","last_undegraded":"2024-09-10T23:15:14.795142+0000","last_fullsized":"2024-09-10T23:15:14.795142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:19.491880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.771808+0000","last_change":"2024-09-10T23:15:13.771529+0000","last_active":"2024-09-10T23:15:14.771808+0000","last_peered":"2024-09-10T23:15:14.771808+0000","last_clean":"2024-09-10T23:15:14.771808+0000","last_became_active":"2024-09-10T23:15:13.771101+0000","last_became_peered":"2024-09-10T23:15:13.771101+0000","last_unstale":"2024-09-10T23:15:14.771808+0000","last_undegraded":"2024-09-10T23:15:14.771808+0000","last_fullsized":"2024-09-10T23:15:14.771808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:19.576849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.794227+0000","last_change":"2024-09-10T23:15:14.793264+0000","last_active":"2024-09-10T23:15:14.794227+0000","last_peered":"2024-09-10T23:15:14.794227+0000","last_clean":"2024-09-10T23:15:14.794227+0000","last_became_active":"2024-09-10T23:15:14.792985+0000","last_became_peered":"2024-09-10T23:15:14.792985+0000","last_unstale":"2024-09-10T23:15:14.794227+0000","last_undegraded":"2024-09-10T23:15:14.794227+0000","last_fullsized":"2024-09-10T23:15:14.794227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:47.421144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797571+0000","last_change":"2024-09-10T23:15:13.764689+0000","last_active":"2024-09-10T23:15:14.797571+0000","last_peered":"2024-09-10T23:15:14.797571+0000","last_clean":"2024-09-10T23:15:14.797571+0000","last_became_active":"2024-09-10T23:15:13.764433+0000","last_became_peered":"2024-09-10T23:15:13.764433+0000","last_unstale":"2024-09-10T23:15:14.797571+0000","last_undegraded":"2024-09-10T23:15:14.797571+0000","last_fullsized":"2024-09-10T23:15:14.797571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:58.916488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.794877+0000","last_change":"2024-09-10T23:15:14.792824+0000","last_active":"2024-09-10T23:15:14.794877+0000","last_peered":"2024-09-10T23:15:14.794877+0000","last_clean":"2024-09-10T23:15:14.794877+0000","last_became_active":"2024-09-10T23:15:14.792525+0000","last_became_peered":"2024-09-10T23:15:14.792525+0000","last_unstale":"2024-09-10T23:15:14.794877+0000","last_undegraded":"2024-09-10T23:15:14.794877+0000","last_fullsized":"2024-09-10T23:15:14.794877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:21.730415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797008+0000","last_change":"2024-09-10T23:15:13.766624+0000","last_active":"2024-09-10T23:15:14.797008+0000","last_peered":"2024-09-10T23:15:14.797008+0000","last_clean":"2024-09-10T23:15:14.797008+0000","last_became_active":"2024-09-10T23:15:13.766374+0000","last_became_peered":"2024-09-10T23:15:13.766374+0000","last_unstale":"2024-09-10T23:15:14.797008+0000","last_undegraded":"2024-09-10T23:15:14.797008+0000","last_fullsized":"2024-09-10T23:15:14.797008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:20.087239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.789947+0000","last_change":"2024-09-10T23:15:14.787164+0000","last_active":"2024-09-10T23:15:14.789947+0000","last_peered":"2024-09-10T23:15:14.789947+0000","last_clean":"2024-09-10T23:15:14.789947+0000","last_became_active":"2024-09-10T23:15:14.786906+0000","last_became_peered":"2024-09-10T23:15:14.786906+0000","last_unstale":"2024-09-10T23:15:14.789947+0000","last_undegraded":"2024-09-10T23:15:14.789947+0000","last_fullsized":"2024-09-10T23:15:14.789947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:19.491880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796153+0000","last_change":"2024-09-10T23:15:13.773007+0000","last_active":"2024-09-10T23:15:14.796153+0000","last_peered":"2024-09-10T23:15:14.796153+0000","last_clean":"2024-09-10T23:15:14.796153+0000","last_became_active":"2024-09-10T23:15:13.772559+0000","last_became_peered":"2024-09-10T23:15:13.772559+0000","last_unstale":"2024-09-10T23:15:14.796153+0000","last_undegraded":"2024-09-10T23:15:14.796153+0000","last_fullsized":"2024-09-10T23:15:14.796153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:31.568535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788033+0000","last_change":"2024-09-10T23:15:14.785689+0000","last_active":"2024-09-10T23:15:14.788033+0000","last_peered":"2024-09-10T23:15:14.788033+0000","last_clean":"2024-09-10T23:15:14.788033+0000","last_became_active":"2024-09-10T23:15:14.785429+0000","last_became_peered":"2024-09-10T23:15:14.785429+0000","last_unstale":"2024-09-10T23:15:14.788033+0000","last_undegraded":"2024-09-10T23:15:14.788033+0000","last_fullsized":"2024-09-10T23:15:14.788033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:39.168497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796698+0000","last_change":"2024-09-10T23:15:13.767364+0000","last_active":"2024-09-10T23:15:14.796698+0000","last_peered":"2024-09-10T23:15:14.796698+0000","last_clean":"2024-09-10T23:15:14.796698+0000","last_became_active":"2024-09-10T23:15:13.767058+0000","last_became_peered":"2024-09-10T23:15:13.767058+0000","last_unstale":"2024-09-10T23:15:14.796698+0000","last_undegraded":"2024-09-10T23:15:14.796698+0000","last_fullsized":"2024-09-10T23:15:14.796698+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:56.499318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.787001+0000","last_change":"2024-09-10T23:15:14.785805+0000","last_active":"2024-09-10T23:15:14.787001+0000","last_peered":"2024-09-10T23:15:14.787001+0000","last_clean":"2024-09-10T23:15:14.787001+0000","last_became_active":"2024-09-10T23:15:14.785505+0000","last_became_peered":"2024-09-10T23:15:14.785505+0000","last_unstale":"2024-09-10T23:15:14.787001+0000","last_undegraded":"2024-09-10T23:15:14.787001+0000","last_fullsized":"2024-09-10T23:15:14.787001+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:20.643452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.776632+0000","last_change":"2024-09-10T23:15:13.771804+0000","last_active":"2024-09-10T23:15:14.776632+0000","last_peered":"2024-09-10T23:15:14.776632+0000","last_clean":"2024-09-10T23:15:14.776632+0000","last_became_active":"2024-09-10T23:15:13.771498+0000","last_became_peered":"2024-09-10T23:15:13.771498+0000","last_unstale":"2024-09-10T23:15:14.776632+0000","last_undegraded":"2024-09-10T23:15:14.776632+0000","last_fullsized":"2024-09-10T23:15:14.776632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:20.145398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795063+0000","last_change":"2024-09-10T23:15:14.791708+0000","last_active":"2024-09-10T23:15:14.795063+0000","last_peered":"2024-09-10T23:15:14.795063+0000","last_clean":"2024-09-10T23:15:14.795063+0000","last_became_active":"2024-09-10T23:15:14.791412+0000","last_became_peered":"2024-09-10T23:15:14.791412+0000","last_unstale":"2024-09-10T23:15:14.795063+0000","last_undegraded":"2024-09-10T23:15:14.795063+0000","last_fullsized":"2024-09-10T23:15:14.795063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:09.924821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.754184+0000","last_change":"2024-09-10T23:15:12.754184+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.754184+0000","last_undegraded":"2024-09-10T23:15:12.754184+0000","last_fullsized":"2024-09-10T23:15:12.754184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.780069+0000","last_change":"2024-09-10T23:15:14.778395+0000","last_active":"2024-09-10T23:15:14.780069+0000","last_peered":"2024-09-10T23:15:14.780069+0000","last_clean":"2024-09-10T23:15:14.780069+0000","last_became_active":"2024-09-10T23:15:14.778134+0000","last_became_peered":"2024-09-10T23:15:14.778134+0000","last_unstale":"2024-09-10T23:15:14.780069+0000","last_undegraded":"2024-09-10T23:15:14.780069+0000","last_fullsized":"2024-09-10T23:15:14.780069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:22.766998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.775182+0000","last_change":"2024-09-10T23:15:13.772451+0000","last_active":"2024-09-10T23:15:14.775182+0000","last_peered":"2024-09-10T23:15:14.775182+0000","last_clean":"2024-09-10T23:15:14.775182+0000","last_became_active":"2024-09-10T23:15:13.772151+0000","last_became_peered":"2024-09-10T23:15:13.772151+0000","last_unstale":"2024-09-10T23:15:14.775182+0000","last_undegraded":"2024-09-10T23:15:14.775182+0000","last_fullsized":"2024-09-10T23:15:14.775182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:36.129380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.783151+0000","last_change":"2024-09-10T23:15:14.779020+0000","last_active":"2024-09-10T23:15:14.783151+0000","last_peered":"2024-09-10T23:15:14.783151+0000","last_clean":"2024-09-10T23:15:14.783151+0000","last_became_active":"2024-09-10T23:15:14.778786+0000","last_became_peered":"2024-09-10T23:15:14.778786+0000","last_unstale":"2024-09-10T23:15:14.783151+0000","last_undegraded":"2024-09-10T23:15:14.783151+0000","last_fullsized":"2024-09-10T23:15:14.783151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:52.746909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.775246+0000","last_change":"2024-09-10T23:15:13.772463+0000","last_active":"2024-09-10T23:15:14.775246+0000","last_peered":"2024-09-10T23:15:14.775246+0000","last_clean":"2024-09-10T23:15:14.775246+0000","last_became_active":"2024-09-10T23:15:13.772215+0000","last_became_peered":"2024-09-10T23:15:13.772215+0000","last_unstale":"2024-09-10T23:15:14.775246+0000","last_undegraded":"2024-09-10T23:15:14.775246+0000","last_fullsized":"2024-09-10T23:15:14.775246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:22.421760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788707+0000","last_change":"2024-09-10T23:15:14.787638+0000","last_active":"2024-09-10T23:15:14.788707+0000","last_peered":"2024-09-10T23:15:14.788707+0000","last_clean":"2024-09-10T23:15:14.788707+0000","last_became_active":"2024-09-10T23:15:14.787332+0000","last_became_peered":"2024-09-10T23:15:14.787332+0000","last_unstale":"2024-09-10T23:15:14.788707+0000","last_undegraded":"2024-09-10T23:15:14.788707+0000","last_fullsized":"2024-09-10T23:15:14.788707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:40.651240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.770466+0000","last_change":"2024-09-10T23:15:13.772780+0000","last_active":"2024-09-10T23:15:14.770466+0000","last_peered":"2024-09-10T23:15:14.770466+0000","last_clean":"2024-09-10T23:15:14.770466+0000","last_became_active":"2024-09-10T23:15:13.770367+0000","last_became_peered":"2024-09-10T23:15:13.770367+0000","last_unstale":"2024-09-10T23:15:14.770466+0000","last_undegraded":"2024-09-10T23:15:14.770466+0000","last_fullsized":"2024-09-10T23:15:14.770466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:35.731410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.780074+0000","last_change":"2024-09-10T23:15:14.778452+0000","last_active":"2024-09-10T23:15:14.780074+0000","last_peered":"2024-09-10T23:15:14.780074+0000","last_clean":"2024-09-10T23:15:14.780074+0000","last_became_active":"2024-09-10T23:15:14.778193+0000","last_became_peered":"2024-09-10T23:15:14.778193+0000","last_unstale":"2024-09-10T23:15:14.780074+0000","last_undegraded":"2024-09-10T23:15:14.780074+0000","last_fullsized":"2024-09-10T23:15:14.780074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:09.145185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795882+0000","last_change":"2024-09-10T23:15:13.769520+0000","last_active":"2024-09-10T23:15:14.795882+0000","last_peered":"2024-09-10T23:15:14.795882+0000","last_clean":"2024-09-10T23:15:14.795882+0000","last_became_active":"2024-09-10T23:15:13.769237+0000","last_became_peered":"2024-09-10T23:15:13.769237+0000","last_unstale":"2024-09-10T23:15:14.795882+0000","last_undegraded":"2024-09-10T23:15:14.795882+0000","last_fullsized":"2024-09-10T23:15:14.795882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:27.770813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785637+0000","last_change":"2024-09-10T23:15:14.777929+0000","last_active":"2024-09-10T23:15:14.785637+0000","last_peered":"2024-09-10T23:15:14.785637+0000","last_clean":"2024-09-10T23:15:14.785637+0000","last_became_active":"2024-09-10T23:15:14.777655+0000","last_became_peered":"2024-09-10T23:15:14.777655+0000","last_unstale":"2024-09-10T23:15:14.785637+0000","last_undegraded":"2024-09-10T23:15:14.785637+0000","last_fullsized":"2024-09-10T23:15:14.785637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:01.426667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.753512+0000","last_change":"2024-09-10T23:15:12.753512+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.753512+0000","last_undegraded":"2024-09-10T23:15:12.753512+0000","last_fullsized":"2024-09-10T23:15:12.753512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:15:13.749502+0000","last_change":"2024-09-10T23:15:13.749502+0000","last_active":"2024-09-10T23:15:13.749502+0000","last_peered":"2024-09-10T23:15:13.749502+0000","last_clean":"2024-09-10T23:15:13.749502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:13.749502+0000","last_undegraded":"2024-09-10T23:15:13.749502+0000","last_fullsized":"2024-09-10T23:15:13.749502+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.770483+0000","last_change":"2024-09-10T23:15:13.765968+0000","last_active":"2024-09-10T23:15:14.770483+0000","last_peered":"2024-09-10T23:15:14.770483+0000","last_clean":"2024-09-10T23:15:14.770483+0000","last_became_active":"2024-09-10T23:15:13.765648+0000","last_became_peered":"2024-09-10T23:15:13.765648+0000","last_unstale":"2024-09-10T23:15:14.770483+0000","last_undegraded":"2024-09-10T23:15:14.770483+0000","last_fullsized":"2024-09-10T23:15:14.770483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:33.223107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786838+0000","last_change":"2024-09-10T23:15:14.784737+0000","last_active":"2024-09-10T23:15:14.786838+0000","last_peered":"2024-09-10T23:15:14.786838+0000","last_clean":"2024-09-10T23:15:14.786838+0000","last_became_active":"2024-09-10T23:15:14.784476+0000","last_became_peered":"2024-09-10T23:15:14.784476+0000","last_unstale":"2024-09-10T23:15:14.786838+0000","last_undegraded":"2024-09-10T23:15:14.786838+0000","last_fullsized":"2024-09-10T23:15:14.786838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:28.776268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.753410+0000","last_change":"2024-09-10T23:15:12.753410+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.753410+0000","last_undegraded":"2024-09-10T23:15:12.753410+0000","last_fullsized":"2024-09-10T23:15:12.753410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:15:13.749502+0000","last_change":"2024-09-10T23:15:13.749502+0000","last_active":"2024-09-10T23:15:13.749502+0000","last_peered":"2024-09-10T23:15:13.749502+0000","last_clean":"2024-09-10T23:15:13.749502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:13.749502+0000","last_undegraded":"2024-09-10T23:15:13.749502+0000","last_fullsized":"2024-09-10T23:15:13.749502+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.769689+0000","last_change":"2024-09-10T23:15:13.769954+0000","last_active":"2024-09-10T23:15:14.769689+0000","last_peered":"2024-09-10T23:15:14.769689+0000","last_clean":"2024-09-10T23:15:14.769689+0000","last_became_active":"2024-09-10T23:15:13.769701+0000","last_became_peered":"2024-09-10T23:15:13.769701+0000","last_unstale":"2024-09-10T23:15:14.769689+0000","last_undegraded":"2024-09-10T23:15:14.769689+0000","last_fullsized":"2024-09-10T23:15:14.769689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:28.227215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.790292+0000","last_change":"2024-09-10T23:15:14.781851+0000","last_active":"2024-09-10T23:15:14.790292+0000","last_peered":"2024-09-10T23:15:14.790292+0000","last_clean":"2024-09-10T23:15:14.790292+0000","last_became_active":"2024-09-10T23:15:14.781580+0000","last_became_peered":"2024-09-10T23:15:14.781580+0000","last_unstale":"2024-09-10T23:15:14.790292+0000","last_undegraded":"2024-09-10T23:15:14.790292+0000","last_fullsized":"2024-09-10T23:15:14.790292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:26.578923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.775442+0000","last_change":"2024-09-10T23:15:13.774703+0000","last_active":"2024-09-10T23:15:14.775442+0000","last_peered":"2024-09-10T23:15:14.775442+0000","last_clean":"2024-09-10T23:15:14.775442+0000","last_became_active":"2024-09-10T23:15:13.774437+0000","last_became_peered":"2024-09-10T23:15:13.774437+0000","last_unstale":"2024-09-10T23:15:14.775442+0000","last_undegraded":"2024-09-10T23:15:14.775442+0000","last_fullsized":"2024-09-10T23:15:14.775442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:30.064030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797066+0000","last_change":"2024-09-10T23:15:14.796113+0000","last_active":"2024-09-10T23:15:14.797066+0000","last_peered":"2024-09-10T23:15:14.797066+0000","last_clean":"2024-09-10T23:15:14.797066+0000","last_became_active":"2024-09-10T23:15:14.795826+0000","last_became_peered":"2024-09-10T23:15:14.795826+0000","last_unstale":"2024-09-10T23:15:14.797066+0000","last_undegraded":"2024-09-10T23:15:14.797066+0000","last_fullsized":"2024-09-10T23:15:14.797066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:34.564180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.772154+0000","last_change":"2024-09-10T23:15:13.772145+0000","last_active":"2024-09-10T23:15:14.772154+0000","last_peered":"2024-09-10T23:15:14.772154+0000","last_clean":"2024-09-10T23:15:14.772154+0000","last_became_active":"2024-09-10T23:15:13.771823+0000","last_became_peered":"2024-09-10T23:15:13.771823+0000","last_unstale":"2024-09-10T23:15:14.772154+0000","last_undegraded":"2024-09-10T23:15:14.772154+0000","last_fullsized":"2024-09-10T23:15:14.772154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:33.192200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786802+0000","last_change":"2024-09-10T23:15:14.782850+0000","last_active":"2024-09-10T23:15:14.786802+0000","last_peered":"2024-09-10T23:15:14.786802+0000","last_clean":"2024-09-10T23:15:14.786802+0000","last_became_active":"2024-09-10T23:15:14.782571+0000","last_became_peered":"2024-09-10T23:15:14.782571+0000","last_unstale":"2024-09-10T23:15:14.786802+0000","last_undegraded":"2024-09-10T23:15:14.786802+0000","last_fullsized":"2024-09-10T23:15:14.786802+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:34.197656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.774786+0000","last_change":"2024-09-10T23:15:13.775030+0000","last_active":"2024-09-10T23:15:14.774786+0000","last_peered":"2024-09-10T23:15:14.774786+0000","last_clean":"2024-09-10T23:15:14.774786+0000","last_became_active":"2024-09-10T23:15:13.774722+0000","last_became_peered":"2024-09-10T23:15:13.774722+0000","last_unstale":"2024-09-10T23:15:14.774786+0000","last_undegraded":"2024-09-10T23:15:14.774786+0000","last_fullsized":"2024-09-10T23:15:14.774786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:37.882903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":128,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.770056+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:15:14.770056+0000","last_peered":"2024-09-10T23:15:14.770056+0000","last_clean":"2024-09-10T23:15:14.770056+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:15:14.770056+0000","last_undegraded":"2024-09-10T23:15:14.770056+0000","last_fullsized":"2024-09-10T23:15:14.770056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":962560,"data_stored":728585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":138743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":138799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":364544,"data_stored":138127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":352256,"data_stored":131352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":138197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":380928,"data_stored":139761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:15:18.295 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:15:18.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.396+0000 7f4fc66c5640 1 -- 172.21.15.90:0/3249750005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fa8003a30 msgr2=0x7f4fa8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:18.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.396+0000 7f4fc66c5640 1 --2- 172.21.15.90:0/3249750005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fa8003a30 0x7f4fa8003e50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4fb000c2e0 tx=0x7f4fa8005830 comp rx=0 tx=0).stop 2024-09-10T23:15:18.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.396+0000 7f4fc4c62640 1 -- 172.21.15.90:0/3249750005 reap_dead start 2024-09-10T23:15:18.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.396+0000 7f4fc66c5640 1 -- 172.21.15.90:0/3249750005 shutdown_connections 2024-09-10T23:15:18.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.396+0000 7f4fc66c5640 1 -- 172.21.15.90:0/3249750005 >> 172.21.15.90:0/3249750005 conn(0x7f4fc00d0490 msgr2=0x7f4fc00d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:18.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.396+0000 7f4fc66c5640 1 -- 172.21.15.90:0/3249750005 shutdown_connections 2024-09-10T23:15:18.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.396+0000 7f4fc66c5640 1 -- 172.21.15.90:0/3249750005 wait complete. 2024-09-10T23:15:18.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.397+0000 7f4fc66c5640 1 Processor -- start 2024-09-10T23:15:18.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.398+0000 7f4fc66c5640 1 -- start start 2024-09-10T23:15:18.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.398+0000 7f4fc66c5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fa8003a30 0x7f4fc0156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:18.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.398+0000 7f4fc66c5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fc00b5c50 0x7f4fc00cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:18.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.398+0000 7f4fc66c5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fc00b60d0 0x7f4fc00cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:18.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.398+0000 7f4fc66c5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc01611c0 con 0x7f4fc00b60d0 2024-09-10T23:15:18.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.398+0000 7f4fc66c5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc0161040 con 0x7f4fa8003a30 2024-09-10T23:15:18.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.398+0000 7f4fc66c5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4fc0161340 con 0x7f4fc00b5c50 2024-09-10T23:15:18.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.398+0000 7f4fc4c62640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fc00b60d0 0x7f4fc00cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:18.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.398+0000 7f4fc4c62640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fc00b60d0 0x7f4fc00cd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37278/0 (socket says 172.21.15.90:37278) 2024-09-10T23:15:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.398+0000 7f4fc4c62640 1 -- 172.21.15.90:0/971789075 learned_addr learned my addr 172.21.15.90:0/971789075 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.398+0000 7f4fbf7fe640 1 --2- 172.21.15.90:0/971789075 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fc00b5c50 0x7f4fc00cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.399+0000 7f4fbffff640 1 --2- 172.21.15.90:0/971789075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fa8003a30 0x7f4fc0156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.399+0000 7f4fc4c62640 1 -- 172.21.15.90:0/971789075 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fc00b5c50 msgr2=0x7f4fc00cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.399+0000 7f4fc4c62640 1 --2- 172.21.15.90:0/971789075 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fc00b5c50 0x7f4fc00cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.399+0000 7f4fc4c62640 1 -- 172.21.15.90:0/971789075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fa8003a30 msgr2=0x7f4fc0156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.399+0000 7f4fc4c62640 1 --2- 172.21.15.90:0/971789075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fa8003a30 0x7f4fc0156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.399+0000 7f4fc4c62640 1 -- 172.21.15.90:0/971789075 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc00b3940 con 0x7f4fc00b60d0 2024-09-10T23:15:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.399+0000 7f4fc4c62640 1 --2- 172.21.15.90:0/971789075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fc00b60d0 0x7f4fc00cd340 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00ca2e0 tx=0x7f4fb80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.399+0000 7f4fbcff9640 1 -- 172.21.15.90:0/971789075 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8011870 con 0x7f4fc00b60d0 2024-09-10T23:15:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.399+0000 7f4fbcff9640 1 -- 172.21.15.90:0/971789075 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fb8017070 con 0x7f4fc00b60d0 2024-09-10T23:15:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.399+0000 7f4fc66c5640 1 -- 172.21.15.90:0/971789075 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc01f62d0 con 0x7f4fc00b60d0 2024-09-10T23:15:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.399+0000 7f4fbcff9640 1 -- 172.21.15.90:0/971789075 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8011de0 con 0x7f4fc00b60d0 2024-09-10T23:15:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.399+0000 7f4fc66c5640 1 -- 172.21.15.90:0/971789075 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc01f6890 con 0x7f4fc00b60d0 2024-09-10T23:15:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.400+0000 7f4fc66c5640 1 -- 172.21.15.90:0/971789075 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc0160400 con 0x7f4fc00b60d0 2024-09-10T23:15:18.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.401+0000 7f4fbcff9640 1 -- 172.21.15.90:0/971789075 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4fb801c460 con 0x7f4fc00b60d0 2024-09-10T23:15:18.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.401+0000 7f4fbcff9640 1 --2- 172.21.15.90:0/971789075 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4fac077f70 0x7f4fac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:18.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.401+0000 7f4fbcff9640 1 -- 172.21.15.90:0/971789075 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4fb809a3b0 con 0x7f4fc00b60d0 2024-09-10T23:15:18.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.401+0000 7f4fbffff640 1 --2- 172.21.15.90:0/971789075 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4fac077f70 0x7f4fac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:18.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.402+0000 7f4fbffff640 1 --2- 172.21.15.90:0/971789075 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4fac077f70 0x7f4fac07a430 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0033000 tx=0x7f4fb002d000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:18.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.405+0000 7f4fbcff9640 1 -- 172.21.15.90:0/971789075 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4fb8062860 con 0x7f4fc00b60d0 2024-09-10T23:15:18.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.577+0000 7f4fc66c5640 1 -- 172.21.15.90:0/971789075 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4fc00c3d80 con 0x7f4fac077f70 2024-09-10T23:15:18.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.582+0000 7f4fbcff9640 1 -- 172.21.15.90:0/971789075 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250843 (secure 0 0 0) 0x7f4fc00c3d80 con 0x7f4fac077f70 2024-09-10T23:15:18.585 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:18.586 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:15:18.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.585+0000 7f4fc66c5640 1 -- 172.21.15.90:0/971789075 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4fac077f70 msgr2=0x7f4fac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:18.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.585+0000 7f4fc66c5640 1 --2- 172.21.15.90:0/971789075 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4fac077f70 0x7f4fac07a430 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0033000 tx=0x7f4fb002d000 comp rx=0 tx=0).stop 2024-09-10T23:15:18.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.585+0000 7f4fc66c5640 1 -- 172.21.15.90:0/971789075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fc00b60d0 msgr2=0x7f4fc00cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:18.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.585+0000 7f4fc66c5640 1 --2- 172.21.15.90:0/971789075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fc00b60d0 0x7f4fc00cd340 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00ca2e0 tx=0x7f4fb80019b0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.585+0000 7f4fc66c5640 1 -- 172.21.15.90:0/971789075 shutdown_connections 2024-09-10T23:15:18.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.585+0000 7f4fc66c5640 1 --2- 172.21.15.90:0/971789075 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4fac077f70 0x7f4fac07a430 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.585+0000 7f4fc66c5640 1 --2- 172.21.15.90:0/971789075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4fc00b60d0 0x7f4fc00cd340 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.585+0000 7f4fc66c5640 1 --2- 172.21.15.90:0/971789075 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fc00b5c50 0x7f4fc00cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.585+0000 7f4fc66c5640 1 --2- 172.21.15.90:0/971789075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fa8003a30 0x7f4fc0156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.585+0000 7f4fc66c5640 1 -- 172.21.15.90:0/971789075 >> 172.21.15.90:0/971789075 conn(0x7f4fc00d0490 msgr2=0x7f4fc00cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:18.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.585+0000 7f4fc66c5640 1 -- 172.21.15.90:0/971789075 shutdown_connections 2024-09-10T23:15:18.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.585+0000 7f4fc66c5640 1 -- 172.21.15.90:0/971789075 wait complete. 2024-09-10T23:15:18.597 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-10T23:15:18.442561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":144,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220264,"kb_used_data":4012,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754456,"statfs":{"total":773094113280,"available":772868562944,"internally_reserved":0,"allocated":4108288,"data_stored":2269017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.692272"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785950+0000","last_change":"2024-09-10T23:15:14.782590+0000","last_active":"2024-09-10T23:15:14.785950+0000","last_peered":"2024-09-10T23:15:14.785950+0000","last_clean":"2024-09-10T23:15:14.785950+0000","last_became_active":"2024-09-10T23:15:14.782279+0000","last_became_peered":"2024-09-10T23:15:14.782279+0000","last_unstale":"2024-09-10T23:15:14.785950+0000","last_undegraded":"2024-09-10T23:15:14.785950+0000","last_fullsized":"2024-09-10T23:15:14.785950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:29.232671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795199+0000","last_change":"2024-09-10T23:15:14.784084+0000","last_active":"2024-09-10T23:15:14.795199+0000","last_peered":"2024-09-10T23:15:14.795199+0000","last_clean":"2024-09-10T23:15:14.795199+0000","last_became_active":"2024-09-10T23:15:14.783797+0000","last_became_peered":"2024-09-10T23:15:14.783797+0000","last_unstale":"2024-09-10T23:15:14.795199+0000","last_undegraded":"2024-09-10T23:15:14.795199+0000","last_fullsized":"2024-09-10T23:15:14.795199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:05.732071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785174+0000","last_change":"2024-09-10T23:15:14.777426+0000","last_active":"2024-09-10T23:15:14.785174+0000","last_peered":"2024-09-10T23:15:14.785174+0000","last_clean":"2024-09-10T23:15:14.785174+0000","last_became_active":"2024-09-10T23:15:14.777146+0000","last_became_peered":"2024-09-10T23:15:14.777146+0000","last_unstale":"2024-09-10T23:15:14.785174+0000","last_undegraded":"2024-09-10T23:15:14.785174+0000","last_fullsized":"2024-09-10T23:15:14.785174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:59.921943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.790290+0000","last_change":"2024-09-10T23:15:14.786653+0000","last_active":"2024-09-10T23:15:14.790290+0000","last_peered":"2024-09-10T23:15:14.790290+0000","last_clean":"2024-09-10T23:15:14.790290+0000","last_became_active":"2024-09-10T23:15:14.786388+0000","last_became_peered":"2024-09-10T23:15:14.786388+0000","last_unstale":"2024-09-10T23:15:14.790290+0000","last_undegraded":"2024-09-10T23:15:14.790290+0000","last_fullsized":"2024-09-10T23:15:14.790290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:57.739458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.780047+0000","last_change":"2024-09-10T23:15:14.777568+0000","last_active":"2024-09-10T23:15:14.780047+0000","last_peered":"2024-09-10T23:15:14.780047+0000","last_clean":"2024-09-10T23:15:14.780047+0000","last_became_active":"2024-09-10T23:15:14.777316+0000","last_became_peered":"2024-09-10T23:15:14.777316+0000","last_unstale":"2024-09-10T23:15:14.780047+0000","last_undegraded":"2024-09-10T23:15:14.780047+0000","last_fullsized":"2024-09-10T23:15:14.780047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:48.058773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796029+0000","last_change":"2024-09-10T23:15:14.787768+0000","last_active":"2024-09-10T23:15:14.796029+0000","last_peered":"2024-09-10T23:15:14.796029+0000","last_clean":"2024-09-10T23:15:14.796029+0000","last_became_active":"2024-09-10T23:15:14.787494+0000","last_became_peered":"2024-09-10T23:15:14.787494+0000","last_unstale":"2024-09-10T23:15:14.796029+0000","last_undegraded":"2024-09-10T23:15:14.796029+0000","last_fullsized":"2024-09-10T23:15:14.796029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:51.822103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788683+0000","last_change":"2024-09-10T23:15:14.786512+0000","last_active":"2024-09-10T23:15:14.788683+0000","last_peered":"2024-09-10T23:15:14.788683+0000","last_clean":"2024-09-10T23:15:14.788683+0000","last_became_active":"2024-09-10T23:15:14.786226+0000","last_became_peered":"2024-09-10T23:15:14.786226+0000","last_unstale":"2024-09-10T23:15:14.788683+0000","last_undegraded":"2024-09-10T23:15:14.788683+0000","last_fullsized":"2024-09-10T23:15:14.788683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:26.578923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786982+0000","last_change":"2024-09-10T23:15:14.779115+0000","last_active":"2024-09-10T23:15:14.786982+0000","last_peered":"2024-09-10T23:15:14.786982+0000","last_clean":"2024-09-10T23:15:14.786982+0000","last_became_active":"2024-09-10T23:15:14.778811+0000","last_became_peered":"2024-09-10T23:15:14.778811+0000","last_unstale":"2024-09-10T23:15:14.786982+0000","last_undegraded":"2024-09-10T23:15:14.786982+0000","last_fullsized":"2024-09-10T23:15:14.786982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:59.921943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.791973+0000","last_change":"2024-09-10T23:15:14.784909+0000","last_active":"2024-09-10T23:15:14.791973+0000","last_peered":"2024-09-10T23:15:14.791973+0000","last_clean":"2024-09-10T23:15:14.791973+0000","last_became_active":"2024-09-10T23:15:14.784511+0000","last_became_peered":"2024-09-10T23:15:14.784511+0000","last_unstale":"2024-09-10T23:15:14.791973+0000","last_undegraded":"2024-09-10T23:15:14.791973+0000","last_fullsized":"2024-09-10T23:15:14.791973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:05.158732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.787382+0000","last_change":"2024-09-10T23:15:14.785521+0000","last_active":"2024-09-10T23:15:14.787382+0000","last_peered":"2024-09-10T23:15:14.787382+0000","last_clean":"2024-09-10T23:15:14.787382+0000","last_became_active":"2024-09-10T23:15:14.785042+0000","last_became_peered":"2024-09-10T23:15:14.785042+0000","last_unstale":"2024-09-10T23:15:14.787382+0000","last_undegraded":"2024-09-10T23:15:14.787382+0000","last_fullsized":"2024-09-10T23:15:14.787382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:11.616236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788226+0000","last_change":"2024-09-10T23:15:14.783123+0000","last_active":"2024-09-10T23:15:14.788226+0000","last_peered":"2024-09-10T23:15:14.788226+0000","last_clean":"2024-09-10T23:15:14.788226+0000","last_became_active":"2024-09-10T23:15:14.782839+0000","last_became_peered":"2024-09-10T23:15:14.782839+0000","last_unstale":"2024-09-10T23:15:14.788226+0000","last_undegraded":"2024-09-10T23:15:14.788226+0000","last_fullsized":"2024-09-10T23:15:14.788226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:01.426667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785981+0000","last_change":"2024-09-10T23:15:14.780626+0000","last_active":"2024-09-10T23:15:14.785981+0000","last_peered":"2024-09-10T23:15:14.785981+0000","last_clean":"2024-09-10T23:15:14.785981+0000","last_became_active":"2024-09-10T23:15:14.780319+0000","last_became_peered":"2024-09-10T23:15:14.780319+0000","last_unstale":"2024-09-10T23:15:14.785981+0000","last_undegraded":"2024-09-10T23:15:14.785981+0000","last_fullsized":"2024-09-10T23:15:14.785981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:43.885268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.779991+0000","last_change":"2024-09-10T23:15:14.775829+0000","last_active":"2024-09-10T23:15:14.779991+0000","last_peered":"2024-09-10T23:15:14.779991+0000","last_clean":"2024-09-10T23:15:14.779991+0000","last_became_active":"2024-09-10T23:15:14.775197+0000","last_became_peered":"2024-09-10T23:15:14.775197+0000","last_unstale":"2024-09-10T23:15:14.779991+0000","last_undegraded":"2024-09-10T23:15:14.779991+0000","last_fullsized":"2024-09-10T23:15:14.779991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:05.633943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.777970+0000","last_change":"2024-09-10T23:15:14.776541+0000","last_active":"2024-09-10T23:15:14.777970+0000","last_peered":"2024-09-10T23:15:14.777970+0000","last_clean":"2024-09-10T23:15:14.777970+0000","last_became_active":"2024-09-10T23:15:14.776297+0000","last_became_peered":"2024-09-10T23:15:14.776297+0000","last_unstale":"2024-09-10T23:15:14.777970+0000","last_undegraded":"2024-09-10T23:15:14.777970+0000","last_fullsized":"2024-09-10T23:15:14.777970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:04.984362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786416+0000","last_change":"2024-09-10T23:15:14.784278+0000","last_active":"2024-09-10T23:15:14.786416+0000","last_peered":"2024-09-10T23:15:14.786416+0000","last_clean":"2024-09-10T23:15:14.786416+0000","last_became_active":"2024-09-10T23:15:14.784023+0000","last_became_peered":"2024-09-10T23:15:14.784023+0000","last_unstale":"2024-09-10T23:15:14.786416+0000","last_undegraded":"2024-09-10T23:15:14.786416+0000","last_fullsized":"2024-09-10T23:15:14.786416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:40.651240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786958+0000","last_change":"2024-09-10T23:15:14.778174+0000","last_active":"2024-09-10T23:15:14.786958+0000","last_peered":"2024-09-10T23:15:14.786958+0000","last_clean":"2024-09-10T23:15:14.786958+0000","last_became_active":"2024-09-10T23:15:14.777911+0000","last_became_peered":"2024-09-10T23:15:14.777911+0000","last_unstale":"2024-09-10T23:15:14.786958+0000","last_undegraded":"2024-09-10T23:15:14.786958+0000","last_fullsized":"2024-09-10T23:15:14.786958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:20.582304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788259+0000","last_change":"2024-09-10T23:15:14.784036+0000","last_active":"2024-09-10T23:15:14.788259+0000","last_peered":"2024-09-10T23:15:14.788259+0000","last_clean":"2024-09-10T23:15:14.788259+0000","last_became_active":"2024-09-10T23:15:14.783780+0000","last_became_peered":"2024-09-10T23:15:14.783780+0000","last_unstale":"2024-09-10T23:15:14.788259+0000","last_undegraded":"2024-09-10T23:15:14.788259+0000","last_fullsized":"2024-09-10T23:15:14.788259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:43.885268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.789823+0000","last_change":"2024-09-10T23:15:14.782310+0000","last_active":"2024-09-10T23:15:14.789823+0000","last_peered":"2024-09-10T23:15:14.789823+0000","last_clean":"2024-09-10T23:15:14.789823+0000","last_became_active":"2024-09-10T23:15:14.782047+0000","last_became_peered":"2024-09-10T23:15:14.782047+0000","last_unstale":"2024-09-10T23:15:14.789823+0000","last_undegraded":"2024-09-10T23:15:14.789823+0000","last_fullsized":"2024-09-10T23:15:14.789823+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:40.651240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.778031+0000","last_change":"2024-09-10T23:15:14.776242+0000","last_active":"2024-09-10T23:15:14.778031+0000","last_peered":"2024-09-10T23:15:14.778031+0000","last_clean":"2024-09-10T23:15:14.778031+0000","last_became_active":"2024-09-10T23:15:14.776016+0000","last_became_peered":"2024-09-10T23:15:14.776016+0000","last_unstale":"2024-09-10T23:15:14.778031+0000","last_undegraded":"2024-09-10T23:15:14.778031+0000","last_fullsized":"2024-09-10T23:15:14.778031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:43.885268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.779028+0000","last_change":"2024-09-10T23:15:14.773759+0000","last_active":"2024-09-10T23:15:14.779028+0000","last_peered":"2024-09-10T23:15:14.779028+0000","last_clean":"2024-09-10T23:15:14.779028+0000","last_became_active":"2024-09-10T23:15:14.773146+0000","last_became_peered":"2024-09-10T23:15:14.773146+0000","last_unstale":"2024-09-10T23:15:14.779028+0000","last_undegraded":"2024-09-10T23:15:14.779028+0000","last_fullsized":"2024-09-10T23:15:14.779028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:00.613653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.793605+0000","last_change":"2024-09-10T23:15:14.790230+0000","last_active":"2024-09-10T23:15:14.793605+0000","last_peered":"2024-09-10T23:15:14.793605+0000","last_clean":"2024-09-10T23:15:14.793605+0000","last_became_active":"2024-09-10T23:15:14.785734+0000","last_became_peered":"2024-09-10T23:15:14.785734+0000","last_unstale":"2024-09-10T23:15:14.793605+0000","last_undegraded":"2024-09-10T23:15:14.793605+0000","last_fullsized":"2024-09-10T23:15:14.793605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:21.092694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797068+0000","last_change":"2024-09-10T23:15:14.796057+0000","last_active":"2024-09-10T23:15:14.797068+0000","last_peered":"2024-09-10T23:15:14.797068+0000","last_clean":"2024-09-10T23:15:14.797068+0000","last_became_active":"2024-09-10T23:15:14.795690+0000","last_became_peered":"2024-09-10T23:15:14.795690+0000","last_unstale":"2024-09-10T23:15:14.797068+0000","last_undegraded":"2024-09-10T23:15:14.797068+0000","last_fullsized":"2024-09-10T23:15:14.797068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:20.633732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:15:13.749502+0000","last_change":"2024-09-10T23:15:13.749502+0000","last_active":"2024-09-10T23:15:13.749502+0000","last_peered":"2024-09-10T23:15:13.749502+0000","last_clean":"2024-09-10T23:15:13.749502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:13.749502+0000","last_undegraded":"2024-09-10T23:15:13.749502+0000","last_fullsized":"2024-09-10T23:15:13.749502+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.780102+0000","last_change":"2024-09-10T23:15:14.775294+0000","last_active":"2024-09-10T23:15:14.780102+0000","last_peered":"2024-09-10T23:15:14.780102+0000","last_clean":"2024-09-10T23:15:14.780102+0000","last_became_active":"2024-09-10T23:15:14.775007+0000","last_became_peered":"2024-09-10T23:15:14.775007+0000","last_unstale":"2024-09-10T23:15:14.780102+0000","last_undegraded":"2024-09-10T23:15:14.780102+0000","last_fullsized":"2024-09-10T23:15:14.780102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:20.582304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796002+0000","last_change":"2024-09-10T23:15:14.790930+0000","last_active":"2024-09-10T23:15:14.796002+0000","last_peered":"2024-09-10T23:15:14.796002+0000","last_clean":"2024-09-10T23:15:14.796002+0000","last_became_active":"2024-09-10T23:15:14.790611+0000","last_became_peered":"2024-09-10T23:15:14.790611+0000","last_unstale":"2024-09-10T23:15:14.796002+0000","last_undegraded":"2024-09-10T23:15:14.796002+0000","last_fullsized":"2024-09-10T23:15:14.796002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:46.414579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795942+0000","last_change":"2024-09-10T23:15:14.785099+0000","last_active":"2024-09-10T23:15:14.795942+0000","last_peered":"2024-09-10T23:15:14.795942+0000","last_clean":"2024-09-10T23:15:14.795942+0000","last_became_active":"2024-09-10T23:15:14.784771+0000","last_became_peered":"2024-09-10T23:15:14.784771+0000","last_unstale":"2024-09-10T23:15:14.795942+0000","last_undegraded":"2024-09-10T23:15:14.795942+0000","last_fullsized":"2024-09-10T23:15:14.795942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:14.428600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796553+0000","last_change":"2024-09-10T23:15:14.793856+0000","last_active":"2024-09-10T23:15:14.796553+0000","last_peered":"2024-09-10T23:15:14.796553+0000","last_clean":"2024-09-10T23:15:14.796553+0000","last_became_active":"2024-09-10T23:15:14.793367+0000","last_became_peered":"2024-09-10T23:15:14.793367+0000","last_unstale":"2024-09-10T23:15:14.796553+0000","last_undegraded":"2024-09-10T23:15:14.796553+0000","last_fullsized":"2024-09-10T23:15:14.796553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:18.746412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.787300+0000","last_change":"2024-09-10T23:15:14.785755+0000","last_active":"2024-09-10T23:15:14.787300+0000","last_peered":"2024-09-10T23:15:14.787300+0000","last_clean":"2024-09-10T23:15:14.787300+0000","last_became_active":"2024-09-10T23:15:14.782572+0000","last_became_peered":"2024-09-10T23:15:14.782572+0000","last_unstale":"2024-09-10T23:15:14.787300+0000","last_undegraded":"2024-09-10T23:15:14.787300+0000","last_fullsized":"2024-09-10T23:15:14.787300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:09.218654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797495+0000","last_change":"2024-09-10T23:15:14.796654+0000","last_active":"2024-09-10T23:15:14.797495+0000","last_peered":"2024-09-10T23:15:14.797495+0000","last_clean":"2024-09-10T23:15:14.797495+0000","last_became_active":"2024-09-10T23:15:14.796438+0000","last_became_peered":"2024-09-10T23:15:14.796438+0000","last_unstale":"2024-09-10T23:15:14.797495+0000","last_undegraded":"2024-09-10T23:15:14.797495+0000","last_fullsized":"2024-09-10T23:15:14.797495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:36.736865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788177+0000","last_change":"2024-09-10T23:15:14.785696+0000","last_active":"2024-09-10T23:15:14.788177+0000","last_peered":"2024-09-10T23:15:14.788177+0000","last_clean":"2024-09-10T23:15:14.788177+0000","last_became_active":"2024-09-10T23:15:14.785439+0000","last_became_peered":"2024-09-10T23:15:14.785439+0000","last_unstale":"2024-09-10T23:15:14.788177+0000","last_undegraded":"2024-09-10T23:15:14.788177+0000","last_fullsized":"2024-09-10T23:15:14.788177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:04.984362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786699+0000","last_change":"2024-09-10T23:15:14.784069+0000","last_active":"2024-09-10T23:15:14.786699+0000","last_peered":"2024-09-10T23:15:14.786699+0000","last_clean":"2024-09-10T23:15:14.786699+0000","last_became_active":"2024-09-10T23:15:14.783809+0000","last_became_peered":"2024-09-10T23:15:14.783809+0000","last_unstale":"2024-09-10T23:15:14.786699+0000","last_undegraded":"2024-09-10T23:15:14.786699+0000","last_fullsized":"2024-09-10T23:15:14.786699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:34.228563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795168+0000","last_change":"2024-09-10T23:15:14.792638+0000","last_active":"2024-09-10T23:15:14.795168+0000","last_peered":"2024-09-10T23:15:14.795168+0000","last_clean":"2024-09-10T23:15:14.795168+0000","last_became_active":"2024-09-10T23:15:14.792122+0000","last_became_peered":"2024-09-10T23:15:14.792122+0000","last_unstale":"2024-09-10T23:15:14.795168+0000","last_undegraded":"2024-09-10T23:15:14.795168+0000","last_fullsized":"2024-09-10T23:15:14.795168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:05.732071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:15:13.749502+0000","last_change":"2024-09-10T23:15:13.749502+0000","last_active":"2024-09-10T23:15:13.749502+0000","last_peered":"2024-09-10T23:15:13.749502+0000","last_clean":"2024-09-10T23:15:13.749502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:13.749502+0000","last_undegraded":"2024-09-10T23:15:13.749502+0000","last_fullsized":"2024-09-10T23:15:13.749502+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.792354+0000","last_change":"2024-09-10T23:15:13.778953+0000","last_active":"2024-09-10T23:15:14.792354+0000","last_peered":"2024-09-10T23:15:14.792354+0000","last_clean":"2024-09-10T23:15:14.792354+0000","last_became_active":"2024-09-10T23:15:13.778585+0000","last_became_peered":"2024-09-10T23:15:13.778585+0000","last_unstale":"2024-09-10T23:15:14.792354+0000","last_undegraded":"2024-09-10T23:15:14.792354+0000","last_fullsized":"2024-09-10T23:15:14.792354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:04.980386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795415+0000","last_change":"2024-09-10T23:15:14.793437+0000","last_active":"2024-09-10T23:15:14.795415+0000","last_peered":"2024-09-10T23:15:14.795415+0000","last_clean":"2024-09-10T23:15:14.795415+0000","last_became_active":"2024-09-10T23:15:14.792867+0000","last_became_peered":"2024-09-10T23:15:14.792867+0000","last_unstale":"2024-09-10T23:15:14.795415+0000","last_undegraded":"2024-09-10T23:15:14.795415+0000","last_fullsized":"2024-09-10T23:15:14.795415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:11.616236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.755568+0000","last_change":"2024-09-10T23:15:12.755568+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.755568+0000","last_undegraded":"2024-09-10T23:15:12.755568+0000","last_fullsized":"2024-09-10T23:15:12.755568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797736+0000","last_change":"2024-09-10T23:15:14.797080+0000","last_active":"2024-09-10T23:15:14.797736+0000","last_peered":"2024-09-10T23:15:14.797736+0000","last_clean":"2024-09-10T23:15:14.797736+0000","last_became_active":"2024-09-10T23:15:14.796799+0000","last_became_peered":"2024-09-10T23:15:14.796799+0000","last_unstale":"2024-09-10T23:15:14.797736+0000","last_undegraded":"2024-09-10T23:15:14.797736+0000","last_fullsized":"2024-09-10T23:15:14.797736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:20.582304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796219+0000","last_change":"2024-09-10T23:15:13.767284+0000","last_active":"2024-09-10T23:15:14.796219+0000","last_peered":"2024-09-10T23:15:14.796219+0000","last_clean":"2024-09-10T23:15:14.796219+0000","last_became_active":"2024-09-10T23:15:13.766807+0000","last_became_peered":"2024-09-10T23:15:13.766807+0000","last_unstale":"2024-09-10T23:15:14.796219+0000","last_undegraded":"2024-09-10T23:15:14.796219+0000","last_fullsized":"2024-09-10T23:15:14.796219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:19.628277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796527+0000","last_change":"2024-09-10T23:15:14.793249+0000","last_active":"2024-09-10T23:15:14.796527+0000","last_peered":"2024-09-10T23:15:14.796527+0000","last_clean":"2024-09-10T23:15:14.796527+0000","last_became_active":"2024-09-10T23:15:14.792976+0000","last_became_peered":"2024-09-10T23:15:14.792976+0000","last_unstale":"2024-09-10T23:15:14.796527+0000","last_undegraded":"2024-09-10T23:15:14.796527+0000","last_fullsized":"2024-09-10T23:15:14.796527+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:37.902288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795887+0000","last_change":"2024-09-10T23:15:13.769588+0000","last_active":"2024-09-10T23:15:14.795887+0000","last_peered":"2024-09-10T23:15:14.795887+0000","last_clean":"2024-09-10T23:15:14.795887+0000","last_became_active":"2024-09-10T23:15:13.769325+0000","last_became_peered":"2024-09-10T23:15:13.769325+0000","last_unstale":"2024-09-10T23:15:14.795887+0000","last_undegraded":"2024-09-10T23:15:14.795887+0000","last_fullsized":"2024-09-10T23:15:14.795887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:48.670108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795061+0000","last_change":"2024-09-10T23:15:14.791220+0000","last_active":"2024-09-10T23:15:14.795061+0000","last_peered":"2024-09-10T23:15:14.795061+0000","last_clean":"2024-09-10T23:15:14.795061+0000","last_became_active":"2024-09-10T23:15:14.790957+0000","last_became_peered":"2024-09-10T23:15:14.790957+0000","last_unstale":"2024-09-10T23:15:14.795061+0000","last_undegraded":"2024-09-10T23:15:14.795061+0000","last_fullsized":"2024-09-10T23:15:14.795061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:09.218654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796822+0000","last_change":"2024-09-10T23:15:13.768504+0000","last_active":"2024-09-10T23:15:14.796822+0000","last_peered":"2024-09-10T23:15:14.796822+0000","last_clean":"2024-09-10T23:15:14.796822+0000","last_became_active":"2024-09-10T23:15:13.768242+0000","last_became_peered":"2024-09-10T23:15:13.768242+0000","last_unstale":"2024-09-10T23:15:14.796822+0000","last_undegraded":"2024-09-10T23:15:14.796822+0000","last_fullsized":"2024-09-10T23:15:14.796822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:50.630257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786107+0000","last_change":"2024-09-10T23:15:14.783536+0000","last_active":"2024-09-10T23:15:14.786107+0000","last_peered":"2024-09-10T23:15:14.786107+0000","last_clean":"2024-09-10T23:15:14.786107+0000","last_became_active":"2024-09-10T23:15:14.783266+0000","last_became_peered":"2024-09-10T23:15:14.783266+0000","last_unstale":"2024-09-10T23:15:14.786107+0000","last_undegraded":"2024-09-10T23:15:14.786107+0000","last_fullsized":"2024-09-10T23:15:14.786107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:26.578923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796747+0000","last_change":"2024-09-10T23:15:13.771424+0000","last_active":"2024-09-10T23:15:14.796747+0000","last_peered":"2024-09-10T23:15:14.796747+0000","last_clean":"2024-09-10T23:15:14.796747+0000","last_became_active":"2024-09-10T23:15:13.771113+0000","last_became_peered":"2024-09-10T23:15:13.771113+0000","last_unstale":"2024-09-10T23:15:14.796747+0000","last_undegraded":"2024-09-10T23:15:14.796747+0000","last_fullsized":"2024-09-10T23:15:14.796747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:41.926490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.794838+0000","last_change":"2024-09-10T23:15:14.792338+0000","last_active":"2024-09-10T23:15:14.794838+0000","last_peered":"2024-09-10T23:15:14.794838+0000","last_clean":"2024-09-10T23:15:14.794838+0000","last_became_active":"2024-09-10T23:15:14.792063+0000","last_became_peered":"2024-09-10T23:15:14.792063+0000","last_unstale":"2024-09-10T23:15:14.794838+0000","last_undegraded":"2024-09-10T23:15:14.794838+0000","last_fullsized":"2024-09-10T23:15:14.794838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:20.660730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.771600+0000","last_change":"2024-09-10T23:15:13.765543+0000","last_active":"2024-09-10T23:15:14.771600+0000","last_peered":"2024-09-10T23:15:14.771600+0000","last_clean":"2024-09-10T23:15:14.771600+0000","last_became_active":"2024-09-10T23:15:13.765131+0000","last_became_peered":"2024-09-10T23:15:13.765131+0000","last_unstale":"2024-09-10T23:15:14.771600+0000","last_undegraded":"2024-09-10T23:15:14.771600+0000","last_fullsized":"2024-09-10T23:15:14.771600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:33.558724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.792513+0000","last_change":"2024-09-10T23:15:14.787696+0000","last_active":"2024-09-10T23:15:14.792513+0000","last_peered":"2024-09-10T23:15:14.792513+0000","last_clean":"2024-09-10T23:15:14.792513+0000","last_became_active":"2024-09-10T23:15:14.787375+0000","last_became_peered":"2024-09-10T23:15:14.787375+0000","last_unstale":"2024-09-10T23:15:14.792513+0000","last_undegraded":"2024-09-10T23:15:14.792513+0000","last_fullsized":"2024-09-10T23:15:14.792513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:03.746624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.776996+0000","last_change":"2024-09-10T23:15:13.773878+0000","last_active":"2024-09-10T23:15:14.776996+0000","last_peered":"2024-09-10T23:15:14.776996+0000","last_clean":"2024-09-10T23:15:14.776996+0000","last_became_active":"2024-09-10T23:15:13.773575+0000","last_became_peered":"2024-09-10T23:15:13.773575+0000","last_unstale":"2024-09-10T23:15:14.776996+0000","last_undegraded":"2024-09-10T23:15:14.776996+0000","last_fullsized":"2024-09-10T23:15:14.776996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:45.659964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785270+0000","last_change":"2024-09-10T23:15:14.780963+0000","last_active":"2024-09-10T23:15:14.785270+0000","last_peered":"2024-09-10T23:15:14.785270+0000","last_clean":"2024-09-10T23:15:14.785270+0000","last_became_active":"2024-09-10T23:15:14.780623+0000","last_became_peered":"2024-09-10T23:15:14.780623+0000","last_unstale":"2024-09-10T23:15:14.785270+0000","last_undegraded":"2024-09-10T23:15:14.785270+0000","last_fullsized":"2024-09-10T23:15:14.785270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:04.984362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.771644+0000","last_change":"2024-09-10T23:15:13.772352+0000","last_active":"2024-09-10T23:15:14.771644+0000","last_peered":"2024-09-10T23:15:14.771644+0000","last_clean":"2024-09-10T23:15:14.771644+0000","last_became_active":"2024-09-10T23:15:13.772076+0000","last_became_peered":"2024-09-10T23:15:13.772076+0000","last_unstale":"2024-09-10T23:15:14.771644+0000","last_undegraded":"2024-09-10T23:15:14.771644+0000","last_fullsized":"2024-09-10T23:15:14.771644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:35.731410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795126+0000","last_change":"2024-09-10T23:15:14.783374+0000","last_active":"2024-09-10T23:15:14.795126+0000","last_peered":"2024-09-10T23:15:14.795126+0000","last_clean":"2024-09-10T23:15:14.795126+0000","last_became_active":"2024-09-10T23:15:14.783108+0000","last_became_peered":"2024-09-10T23:15:14.783108+0000","last_unstale":"2024-09-10T23:15:14.795126+0000","last_undegraded":"2024-09-10T23:15:14.795126+0000","last_fullsized":"2024-09-10T23:15:14.795126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:19.491880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.754945+0000","last_change":"2024-09-10T23:15:12.754945+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.754945+0000","last_undegraded":"2024-09-10T23:15:12.754945+0000","last_fullsized":"2024-09-10T23:15:12.754945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796664+0000","last_change":"2024-09-10T23:15:14.793078+0000","last_active":"2024-09-10T23:15:14.796664+0000","last_peered":"2024-09-10T23:15:14.796664+0000","last_clean":"2024-09-10T23:15:14.796664+0000","last_became_active":"2024-09-10T23:15:14.792740+0000","last_became_peered":"2024-09-10T23:15:14.792740+0000","last_unstale":"2024-09-10T23:15:14.796664+0000","last_undegraded":"2024-09-10T23:15:14.796664+0000","last_fullsized":"2024-09-10T23:15:14.796664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:57.702941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.794243+0000","last_change":"2024-09-10T23:15:13.770511+0000","last_active":"2024-09-10T23:15:14.794243+0000","last_peered":"2024-09-10T23:15:14.794243+0000","last_clean":"2024-09-10T23:15:14.794243+0000","last_became_active":"2024-09-10T23:15:13.770081+0000","last_became_peered":"2024-09-10T23:15:13.770081+0000","last_unstale":"2024-09-10T23:15:14.794243+0000","last_undegraded":"2024-09-10T23:15:14.794243+0000","last_fullsized":"2024-09-10T23:15:14.794243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:33.558724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785216+0000","last_change":"2024-09-10T23:15:14.777889+0000","last_active":"2024-09-10T23:15:14.785216+0000","last_peered":"2024-09-10T23:15:14.785216+0000","last_clean":"2024-09-10T23:15:14.785216+0000","last_became_active":"2024-09-10T23:15:14.777600+0000","last_became_peered":"2024-09-10T23:15:14.777600+0000","last_unstale":"2024-09-10T23:15:14.785216+0000","last_undegraded":"2024-09-10T23:15:14.785216+0000","last_fullsized":"2024-09-10T23:15:14.785216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:34.197656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.798926+0000","last_change":"2024-09-10T23:15:13.766440+0000","last_active":"2024-09-10T23:15:14.798926+0000","last_peered":"2024-09-10T23:15:14.798926+0000","last_clean":"2024-09-10T23:15:14.798926+0000","last_became_active":"2024-09-10T23:15:13.765980+0000","last_became_peered":"2024-09-10T23:15:13.765980+0000","last_unstale":"2024-09-10T23:15:14.798926+0000","last_undegraded":"2024-09-10T23:15:14.798926+0000","last_fullsized":"2024-09-10T23:15:14.798926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:00.421211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.790675+0000","last_change":"2024-09-10T23:15:14.786936+0000","last_active":"2024-09-10T23:15:14.790675+0000","last_peered":"2024-09-10T23:15:14.790675+0000","last_clean":"2024-09-10T23:15:14.790675+0000","last_became_active":"2024-09-10T23:15:14.786650+0000","last_became_peered":"2024-09-10T23:15:14.786650+0000","last_unstale":"2024-09-10T23:15:14.790675+0000","last_undegraded":"2024-09-10T23:15:14.790675+0000","last_fullsized":"2024-09-10T23:15:14.790675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:13.688354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796061+0000","last_change":"2024-09-10T23:15:13.773637+0000","last_active":"2024-09-10T23:15:14.796061+0000","last_peered":"2024-09-10T23:15:14.796061+0000","last_clean":"2024-09-10T23:15:14.796061+0000","last_became_active":"2024-09-10T23:15:13.773364+0000","last_became_peered":"2024-09-10T23:15:13.773364+0000","last_unstale":"2024-09-10T23:15:14.796061+0000","last_undegraded":"2024-09-10T23:15:14.796061+0000","last_fullsized":"2024-09-10T23:15:14.796061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:54.026868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.789786+0000","last_change":"2024-09-10T23:15:14.782668+0000","last_active":"2024-09-10T23:15:14.789786+0000","last_peered":"2024-09-10T23:15:14.789786+0000","last_clean":"2024-09-10T23:15:14.789786+0000","last_became_active":"2024-09-10T23:15:14.782405+0000","last_became_peered":"2024-09-10T23:15:14.782405+0000","last_unstale":"2024-09-10T23:15:14.789786+0000","last_undegraded":"2024-09-10T23:15:14.789786+0000","last_fullsized":"2024-09-10T23:15:14.789786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:09.218654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.769474+0000","last_change":"2024-09-10T23:15:13.773432+0000","last_active":"2024-09-10T23:15:14.769474+0000","last_peered":"2024-09-10T23:15:14.769474+0000","last_clean":"2024-09-10T23:15:14.769474+0000","last_became_active":"2024-09-10T23:15:13.773136+0000","last_became_peered":"2024-09-10T23:15:13.773136+0000","last_unstale":"2024-09-10T23:15:14.769474+0000","last_undegraded":"2024-09-10T23:15:14.769474+0000","last_fullsized":"2024-09-10T23:15:14.769474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:04.980386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795142+0000","last_change":"2024-09-10T23:15:14.792375+0000","last_active":"2024-09-10T23:15:14.795142+0000","last_peered":"2024-09-10T23:15:14.795142+0000","last_clean":"2024-09-10T23:15:14.795142+0000","last_became_active":"2024-09-10T23:15:14.791810+0000","last_became_peered":"2024-09-10T23:15:14.791810+0000","last_unstale":"2024-09-10T23:15:14.795142+0000","last_undegraded":"2024-09-10T23:15:14.795142+0000","last_fullsized":"2024-09-10T23:15:14.795142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:19.491880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.771808+0000","last_change":"2024-09-10T23:15:13.771529+0000","last_active":"2024-09-10T23:15:14.771808+0000","last_peered":"2024-09-10T23:15:14.771808+0000","last_clean":"2024-09-10T23:15:14.771808+0000","last_became_active":"2024-09-10T23:15:13.771101+0000","last_became_peered":"2024-09-10T23:15:13.771101+0000","last_unstale":"2024-09-10T23:15:14.771808+0000","last_undegraded":"2024-09-10T23:15:14.771808+0000","last_fullsized":"2024-09-10T23:15:14.771808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:19.576849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.794227+0000","last_change":"2024-09-10T23:15:14.793264+0000","last_active":"2024-09-10T23:15:14.794227+0000","last_peered":"2024-09-10T23:15:14.794227+0000","last_clean":"2024-09-10T23:15:14.794227+0000","last_became_active":"2024-09-10T23:15:14.792985+0000","last_became_peered":"2024-09-10T23:15:14.792985+0000","last_unstale":"2024-09-10T23:15:14.794227+0000","last_undegraded":"2024-09-10T23:15:14.794227+0000","last_fullsized":"2024-09-10T23:15:14.794227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:47.421144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797571+0000","last_change":"2024-09-10T23:15:13.764689+0000","last_active":"2024-09-10T23:15:14.797571+0000","last_peered":"2024-09-10T23:15:14.797571+0000","last_clean":"2024-09-10T23:15:14.797571+0000","last_became_active":"2024-09-10T23:15:13.764433+0000","last_became_peered":"2024-09-10T23:15:13.764433+0000","last_unstale":"2024-09-10T23:15:14.797571+0000","last_undegraded":"2024-09-10T23:15:14.797571+0000","last_fullsized":"2024-09-10T23:15:14.797571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:58.916488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.794877+0000","last_change":"2024-09-10T23:15:14.792824+0000","last_active":"2024-09-10T23:15:14.794877+0000","last_peered":"2024-09-10T23:15:14.794877+0000","last_clean":"2024-09-10T23:15:14.794877+0000","last_became_active":"2024-09-10T23:15:14.792525+0000","last_became_peered":"2024-09-10T23:15:14.792525+0000","last_unstale":"2024-09-10T23:15:14.794877+0000","last_undegraded":"2024-09-10T23:15:14.794877+0000","last_fullsized":"2024-09-10T23:15:14.794877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:21.730415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797008+0000","last_change":"2024-09-10T23:15:13.766624+0000","last_active":"2024-09-10T23:15:14.797008+0000","last_peered":"2024-09-10T23:15:14.797008+0000","last_clean":"2024-09-10T23:15:14.797008+0000","last_became_active":"2024-09-10T23:15:13.766374+0000","last_became_peered":"2024-09-10T23:15:13.766374+0000","last_unstale":"2024-09-10T23:15:14.797008+0000","last_undegraded":"2024-09-10T23:15:14.797008+0000","last_fullsized":"2024-09-10T23:15:14.797008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:20.087239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.789947+0000","last_change":"2024-09-10T23:15:14.787164+0000","last_active":"2024-09-10T23:15:14.789947+0000","last_peered":"2024-09-10T23:15:14.789947+0000","last_clean":"2024-09-10T23:15:14.789947+0000","last_became_active":"2024-09-10T23:15:14.786906+0000","last_became_peered":"2024-09-10T23:15:14.786906+0000","last_unstale":"2024-09-10T23:15:14.789947+0000","last_undegraded":"2024-09-10T23:15:14.789947+0000","last_fullsized":"2024-09-10T23:15:14.789947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:19.491880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796153+0000","last_change":"2024-09-10T23:15:13.773007+0000","last_active":"2024-09-10T23:15:14.796153+0000","last_peered":"2024-09-10T23:15:14.796153+0000","last_clean":"2024-09-10T23:15:14.796153+0000","last_became_active":"2024-09-10T23:15:13.772559+0000","last_became_peered":"2024-09-10T23:15:13.772559+0000","last_unstale":"2024-09-10T23:15:14.796153+0000","last_undegraded":"2024-09-10T23:15:14.796153+0000","last_fullsized":"2024-09-10T23:15:14.796153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:31.568535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788033+0000","last_change":"2024-09-10T23:15:14.785689+0000","last_active":"2024-09-10T23:15:14.788033+0000","last_peered":"2024-09-10T23:15:14.788033+0000","last_clean":"2024-09-10T23:15:14.788033+0000","last_became_active":"2024-09-10T23:15:14.785429+0000","last_became_peered":"2024-09-10T23:15:14.785429+0000","last_unstale":"2024-09-10T23:15:14.788033+0000","last_undegraded":"2024-09-10T23:15:14.788033+0000","last_fullsized":"2024-09-10T23:15:14.788033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:39.168497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796698+0000","last_change":"2024-09-10T23:15:13.767364+0000","last_active":"2024-09-10T23:15:14.796698+0000","last_peered":"2024-09-10T23:15:14.796698+0000","last_clean":"2024-09-10T23:15:14.796698+0000","last_became_active":"2024-09-10T23:15:13.767058+0000","last_became_peered":"2024-09-10T23:15:13.767058+0000","last_unstale":"2024-09-10T23:15:14.796698+0000","last_undegraded":"2024-09-10T23:15:14.796698+0000","last_fullsized":"2024-09-10T23:15:14.796698+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:56.499318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.787001+0000","last_change":"2024-09-10T23:15:14.785805+0000","last_active":"2024-09-10T23:15:14.787001+0000","last_peered":"2024-09-10T23:15:14.787001+0000","last_clean":"2024-09-10T23:15:14.787001+0000","last_became_active":"2024-09-10T23:15:14.785505+0000","last_became_peered":"2024-09-10T23:15:14.785505+0000","last_unstale":"2024-09-10T23:15:14.787001+0000","last_undegraded":"2024-09-10T23:15:14.787001+0000","last_fullsized":"2024-09-10T23:15:14.787001+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:20.643452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.776632+0000","last_change":"2024-09-10T23:15:13.771804+0000","last_active":"2024-09-10T23:15:14.776632+0000","last_peered":"2024-09-10T23:15:14.776632+0000","last_clean":"2024-09-10T23:15:14.776632+0000","last_became_active":"2024-09-10T23:15:13.771498+0000","last_became_peered":"2024-09-10T23:15:13.771498+0000","last_unstale":"2024-09-10T23:15:14.776632+0000","last_undegraded":"2024-09-10T23:15:14.776632+0000","last_fullsized":"2024-09-10T23:15:14.776632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:20.145398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795063+0000","last_change":"2024-09-10T23:15:14.791708+0000","last_active":"2024-09-10T23:15:14.795063+0000","last_peered":"2024-09-10T23:15:14.795063+0000","last_clean":"2024-09-10T23:15:14.795063+0000","last_became_active":"2024-09-10T23:15:14.791412+0000","last_became_peered":"2024-09-10T23:15:14.791412+0000","last_unstale":"2024-09-10T23:15:14.795063+0000","last_undegraded":"2024-09-10T23:15:14.795063+0000","last_fullsized":"2024-09-10T23:15:14.795063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:09.924821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.754184+0000","last_change":"2024-09-10T23:15:12.754184+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.754184+0000","last_undegraded":"2024-09-10T23:15:12.754184+0000","last_fullsized":"2024-09-10T23:15:12.754184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.780069+0000","last_change":"2024-09-10T23:15:14.778395+0000","last_active":"2024-09-10T23:15:14.780069+0000","last_peered":"2024-09-10T23:15:14.780069+0000","last_clean":"2024-09-10T23:15:14.780069+0000","last_became_active":"2024-09-10T23:15:14.778134+0000","last_became_peered":"2024-09-10T23:15:14.778134+0000","last_unstale":"2024-09-10T23:15:14.780069+0000","last_undegraded":"2024-09-10T23:15:14.780069+0000","last_fullsized":"2024-09-10T23:15:14.780069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:22.766998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.775182+0000","last_change":"2024-09-10T23:15:13.772451+0000","last_active":"2024-09-10T23:15:14.775182+0000","last_peered":"2024-09-10T23:15:14.775182+0000","last_clean":"2024-09-10T23:15:14.775182+0000","last_became_active":"2024-09-10T23:15:13.772151+0000","last_became_peered":"2024-09-10T23:15:13.772151+0000","last_unstale":"2024-09-10T23:15:14.775182+0000","last_undegraded":"2024-09-10T23:15:14.775182+0000","last_fullsized":"2024-09-10T23:15:14.775182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:36.129380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.783151+0000","last_change":"2024-09-10T23:15:14.779020+0000","last_active":"2024-09-10T23:15:14.783151+0000","last_peered":"2024-09-10T23:15:14.783151+0000","last_clean":"2024-09-10T23:15:14.783151+0000","last_became_active":"2024-09-10T23:15:14.778786+0000","last_became_peered":"2024-09-10T23:15:14.778786+0000","last_unstale":"2024-09-10T23:15:14.783151+0000","last_undegraded":"2024-09-10T23:15:14.783151+0000","last_fullsized":"2024-09-10T23:15:14.783151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:52.746909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.775246+0000","last_change":"2024-09-10T23:15:13.772463+0000","last_active":"2024-09-10T23:15:14.775246+0000","last_peered":"2024-09-10T23:15:14.775246+0000","last_clean":"2024-09-10T23:15:14.775246+0000","last_became_active":"2024-09-10T23:15:13.772215+0000","last_became_peered":"2024-09-10T23:15:13.772215+0000","last_unstale":"2024-09-10T23:15:14.775246+0000","last_undegraded":"2024-09-10T23:15:14.775246+0000","last_fullsized":"2024-09-10T23:15:14.775246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:22.421760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788707+0000","last_change":"2024-09-10T23:15:14.787638+0000","last_active":"2024-09-10T23:15:14.788707+0000","last_peered":"2024-09-10T23:15:14.788707+0000","last_clean":"2024-09-10T23:15:14.788707+0000","last_became_active":"2024-09-10T23:15:14.787332+0000","last_became_peered":"2024-09-10T23:15:14.787332+0000","last_unstale":"2024-09-10T23:15:14.788707+0000","last_undegraded":"2024-09-10T23:15:14.788707+0000","last_fullsized":"2024-09-10T23:15:14.788707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:40.651240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.770466+0000","last_change":"2024-09-10T23:15:13.772780+0000","last_active":"2024-09-10T23:15:14.770466+0000","last_peered":"2024-09-10T23:15:14.770466+0000","last_clean":"2024-09-10T23:15:14.770466+0000","last_became_active":"2024-09-10T23:15:13.770367+0000","last_became_peered":"2024-09-10T23:15:13.770367+0000","last_unstale":"2024-09-10T23:15:14.770466+0000","last_undegraded":"2024-09-10T23:15:14.770466+0000","last_fullsized":"2024-09-10T23:15:14.770466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:35.731410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.780074+0000","last_change":"2024-09-10T23:15:14.778452+0000","last_active":"2024-09-10T23:15:14.780074+0000","last_peered":"2024-09-10T23:15:14.780074+0000","last_clean":"2024-09-10T23:15:14.780074+0000","last_became_active":"2024-09-10T23:15:14.778193+0000","last_became_peered":"2024-09-10T23:15:14.778193+0000","last_unstale":"2024-09-10T23:15:14.780074+0000","last_undegraded":"2024-09-10T23:15:14.780074+0000","last_fullsized":"2024-09-10T23:15:14.780074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:09.145185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795882+0000","last_change":"2024-09-10T23:15:13.769520+0000","last_active":"2024-09-10T23:15:14.795882+0000","last_peered":"2024-09-10T23:15:14.795882+0000","last_clean":"2024-09-10T23:15:14.795882+0000","last_became_active":"2024-09-10T23:15:13.769237+0000","last_became_peered":"2024-09-10T23:15:13.769237+0000","last_unstale":"2024-09-10T23:15:14.795882+0000","last_undegraded":"2024-09-10T23:15:14.795882+0000","last_fullsized":"2024-09-10T23:15:14.795882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:27.770813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785637+0000","last_change":"2024-09-10T23:15:14.777929+0000","last_active":"2024-09-10T23:15:14.785637+0000","last_peered":"2024-09-10T23:15:14.785637+0000","last_clean":"2024-09-10T23:15:14.785637+0000","last_became_active":"2024-09-10T23:15:14.777655+0000","last_became_peered":"2024-09-10T23:15:14.777655+0000","last_unstale":"2024-09-10T23:15:14.785637+0000","last_undegraded":"2024-09-10T23:15:14.785637+0000","last_fullsized":"2024-09-10T23:15:14.785637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:01.426667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.753512+0000","last_change":"2024-09-10T23:15:12.753512+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.753512+0000","last_undegraded":"2024-09-10T23:15:12.753512+0000","last_fullsized":"2024-09-10T23:15:12.753512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:15:13.749502+0000","last_change":"2024-09-10T23:15:13.749502+0000","last_active":"2024-09-10T23:15:13.749502+0000","last_peered":"2024-09-10T23:15:13.749502+0000","last_clean":"2024-09-10T23:15:13.749502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:13.749502+0000","last_undegraded":"2024-09-10T23:15:13.749502+0000","last_fullsized":"2024-09-10T23:15:13.749502+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.770483+0000","last_change":"2024-09-10T23:15:13.765968+0000","last_active":"2024-09-10T23:15:14.770483+0000","last_peered":"2024-09-10T23:15:14.770483+0000","last_clean":"2024-09-10T23:15:14.770483+0000","last_became_active":"2024-09-10T23:15:13.765648+0000","last_became_peered":"2024-09-10T23:15:13.765648+0000","last_unstale":"2024-09-10T23:15:14.770483+0000","last_undegraded":"2024-09-10T23:15:14.770483+0000","last_fullsized":"2024-09-10T23:15:14.770483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:33.223107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786838+0000","last_change":"2024-09-10T23:15:14.784737+0000","last_active":"2024-09-10T23:15:14.786838+0000","last_peered":"2024-09-10T23:15:14.786838+0000","last_clean":"2024-09-10T23:15:14.786838+0000","last_became_active":"2024-09-10T23:15:14.784476+0000","last_became_peered":"2024-09-10T23:15:14.784476+0000","last_unstale":"2024-09-10T23:15:14.786838+0000","last_undegraded":"2024-09-10T23:15:14.786838+0000","last_fullsized":"2024-09-10T23:15:14.786838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:28.776268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.753410+0000","last_change":"2024-09-10T23:15:12.753410+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.753410+0000","last_undegraded":"2024-09-10T23:15:12.753410+0000","last_fullsized":"2024-09-10T23:15:12.753410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:15:13.749502+0000","last_change":"2024-09-10T23:15:13.749502+0000","last_active":"2024-09-10T23:15:13.749502+0000","last_peered":"2024-09-10T23:15:13.749502+0000","last_clean":"2024-09-10T23:15:13.749502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:13.749502+0000","last_undegraded":"2024-09-10T23:15:13.749502+0000","last_fullsized":"2024-09-10T23:15:13.749502+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.769689+0000","last_change":"2024-09-10T23:15:13.769954+0000","last_active":"2024-09-10T23:15:14.769689+0000","last_peered":"2024-09-10T23:15:14.769689+0000","last_clean":"2024-09-10T23:15:14.769689+0000","last_became_active":"2024-09-10T23:15:13.769701+0000","last_became_peered":"2024-09-10T23:15:13.769701+0000","last_unstale":"2024-09-10T23:15:14.769689+0000","last_undegraded":"2024-09-10T23:15:14.769689+0000","last_fullsized":"2024-09-10T23:15:14.769689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:28.227215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.790292+0000","last_change":"2024-09-10T23:15:14.781851+0000","last_active":"2024-09-10T23:15:14.790292+0000","last_peered":"2024-09-10T23:15:14.790292+0000","last_clean":"2024-09-10T23:15:14.790292+0000","last_became_active":"2024-09-10T23:15:14.781580+0000","last_became_peered":"2024-09-10T23:15:14.781580+0000","last_unstale":"2024-09-10T23:15:14.790292+0000","last_undegraded":"2024-09-10T23:15:14.790292+0000","last_fullsized":"2024-09-10T23:15:14.790292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:26.578923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.775442+0000","last_change":"2024-09-10T23:15:13.774703+0000","last_active":"2024-09-10T23:15:14.775442+0000","last_peered":"2024-09-10T23:15:14.775442+0000","last_clean":"2024-09-10T23:15:14.775442+0000","last_became_active":"2024-09-10T23:15:13.774437+0000","last_became_peered":"2024-09-10T23:15:13.774437+0000","last_unstale":"2024-09-10T23:15:14.775442+0000","last_undegraded":"2024-09-10T23:15:14.775442+0000","last_fullsized":"2024-09-10T23:15:14.775442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:30.064030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797066+0000","last_change":"2024-09-10T23:15:14.796113+0000","last_active":"2024-09-10T23:15:14.797066+0000","last_peered":"2024-09-10T23:15:14.797066+0000","last_clean":"2024-09-10T23:15:14.797066+0000","last_became_active":"2024-09-10T23:15:14.795826+0000","last_became_peered":"2024-09-10T23:15:14.795826+0000","last_unstale":"2024-09-10T23:15:14.797066+0000","last_undegraded":"2024-09-10T23:15:14.797066+0000","last_fullsized":"2024-09-10T23:15:14.797066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:34.564180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.772154+0000","last_change":"2024-09-10T23:15:13.772145+0000","last_active":"2024-09-10T23:15:14.772154+0000","last_peered":"2024-09-10T23:15:14.772154+0000","last_clean":"2024-09-10T23:15:14.772154+0000","last_became_active":"2024-09-10T23:15:13.771823+0000","last_became_peered":"2024-09-10T23:15:13.771823+0000","last_unstale":"2024-09-10T23:15:14.772154+0000","last_undegraded":"2024-09-10T23:15:14.772154+0000","last_fullsized":"2024-09-10T23:15:14.772154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:33.192200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786802+0000","last_change":"2024-09-10T23:15:14.782850+0000","last_active":"2024-09-10T23:15:14.786802+0000","last_peered":"2024-09-10T23:15:14.786802+0000","last_clean":"2024-09-10T23:15:14.786802+0000","last_became_active":"2024-09-10T23:15:14.782571+0000","last_became_peered":"2024-09-10T23:15:14.782571+0000","last_unstale":"2024-09-10T23:15:14.786802+0000","last_undegraded":"2024-09-10T23:15:14.786802+0000","last_fullsized":"2024-09-10T23:15:14.786802+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:34.197656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.774786+0000","last_change":"2024-09-10T23:15:13.775030+0000","last_active":"2024-09-10T23:15:14.774786+0000","last_peered":"2024-09-10T23:15:14.774786+0000","last_clean":"2024-09-10T23:15:14.774786+0000","last_became_active":"2024-09-10T23:15:13.774722+0000","last_became_peered":"2024-09-10T23:15:13.774722+0000","last_unstale":"2024-09-10T23:15:14.774786+0000","last_undegraded":"2024-09-10T23:15:14.774786+0000","last_fullsized":"2024-09-10T23:15:14.774786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:37.882903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":128,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.770056+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:15:14.770056+0000","last_peered":"2024-09-10T23:15:14.770056+0000","last_clean":"2024-09-10T23:15:14.770056+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:15:14.770056+0000","last_undegraded":"2024-09-10T23:15:14.770056+0000","last_fullsized":"2024-09-10T23:15:14.770056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":962560,"data_stored":728585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":138743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":138799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":364544,"data_stored":138127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":352256,"data_stored":131352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":138197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":380928,"data_stored":139761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:15:18.600 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-09-10T23:15:18.600 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:15:13.749502+0000', 'last_change': '2024-09-10T23:15:13.749502+0000', 'last_active': '2024-09-10T23:15:13.749502+0000', 'last_peered': '2024-09-10T23:15:13.749502+0000', 'last_clean': '2024-09-10T23:15:13.749502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:13.749502+0000', 'last_undegraded': '2024-09-10T23:15:13.749502+0000', 'last_fullsized': '2024-09-10T23:15:13.749502+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:13.749502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:13.749502+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:13.749502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:15:18.601 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-10T23:15:18.601 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:15:13.749502+0000', 'last_change': '2024-09-10T23:15:13.749502+0000', 'last_active': '2024-09-10T23:15:13.749502+0000', 'last_peered': '2024-09-10T23:15:13.749502+0000', 'last_clean': '2024-09-10T23:15:13.749502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:13.749502+0000', 'last_undegraded': '2024-09-10T23:15:13.749502+0000', 'last_fullsized': '2024-09-10T23:15:13.749502+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:13.749502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:13.749502+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:13.749502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:15:18.601 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-09-10T23:15:18.601 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:12.755568+0000', 'last_change': '2024-09-10T23:15:12.755568+0000', 'last_active': '2024-09-10T23:15:12.744046+0000', 'last_peered': '2024-09-10T23:15:12.744046+0000', 'last_clean': '2024-09-10T23:15:12.744046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:12.755568+0000', 'last_undegraded': '2024-09-10T23:15:12.755568+0000', 'last_fullsized': '2024-09-10T23:15:12.755568+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:12.744046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:12.744046+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:12.744046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:18.601 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-09-10T23:15:18.601 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:12.754945+0000', 'last_change': '2024-09-10T23:15:12.754945+0000', 'last_active': '2024-09-10T23:15:12.744046+0000', 'last_peered': '2024-09-10T23:15:12.744046+0000', 'last_clean': '2024-09-10T23:15:12.744046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:12.754945+0000', 'last_undegraded': '2024-09-10T23:15:12.754945+0000', 'last_fullsized': '2024-09-10T23:15:12.754945+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:12.744046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:12.744046+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:12.744046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:18.601 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-09-10T23:15:18.601 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:12.754184+0000', 'last_change': '2024-09-10T23:15:12.754184+0000', 'last_active': '2024-09-10T23:15:12.744046+0000', 'last_peered': '2024-09-10T23:15:12.744046+0000', 'last_clean': '2024-09-10T23:15:12.744046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:12.754184+0000', 'last_undegraded': '2024-09-10T23:15:12.754184+0000', 'last_fullsized': '2024-09-10T23:15:12.754184+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:12.744046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:12.744046+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:12.744046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:18.601 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-10T23:15:18.601 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:12.753512+0000', 'last_change': '2024-09-10T23:15:12.753512+0000', 'last_active': '2024-09-10T23:15:12.744046+0000', 'last_peered': '2024-09-10T23:15:12.744046+0000', 'last_clean': '2024-09-10T23:15:12.744046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:12.753512+0000', 'last_undegraded': '2024-09-10T23:15:12.753512+0000', 'last_fullsized': '2024-09-10T23:15:12.753512+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:12.744046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:12.744046+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:12.744046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:18.601 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-10T23:15:18.602 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:15:13.749502+0000', 'last_change': '2024-09-10T23:15:13.749502+0000', 'last_active': '2024-09-10T23:15:13.749502+0000', 'last_peered': '2024-09-10T23:15:13.749502+0000', 'last_clean': '2024-09-10T23:15:13.749502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:13.749502+0000', 'last_undegraded': '2024-09-10T23:15:13.749502+0000', 'last_fullsized': '2024-09-10T23:15:13.749502+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:13.749502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:13.749502+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:13.749502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:15:18.602 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-09-10T23:15:18.602 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:12.753410+0000', 'last_change': '2024-09-10T23:15:12.753410+0000', 'last_active': '2024-09-10T23:15:12.744046+0000', 'last_peered': '2024-09-10T23:15:12.744046+0000', 'last_clean': '2024-09-10T23:15:12.744046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:12.753410+0000', 'last_undegraded': '2024-09-10T23:15:12.753410+0000', 'last_fullsized': '2024-09-10T23:15:12.753410+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:12.744046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:12.744046+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:12.744046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:18.602 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-10T23:15:18.602 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:15:13.749502+0000', 'last_change': '2024-09-10T23:15:13.749502+0000', 'last_active': '2024-09-10T23:15:13.749502+0000', 'last_peered': '2024-09-10T23:15:13.749502+0000', 'last_clean': '2024-09-10T23:15:13.749502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:13.749502+0000', 'last_undegraded': '2024-09-10T23:15:13.749502+0000', 'last_fullsized': '2024-09-10T23:15:13.749502+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:13.749502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:13.749502+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:13.749502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:15:18.602 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:15:18.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.735+0000 7fc3d4d17640 1 -- 172.21.15.90:0/750184773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3d00d0ab0 msgr2=0x7fc3d00d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.735+0000 7fc3d4d17640 1 --2- 172.21.15.90:0/750184773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3d00d0ab0 0x7fc3d00d0f60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc3d008e660 tx=0x7fc3c002a560 comp rx=0 tx=0).stop 2024-09-10T23:15:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.735+0000 7fc3d4d17640 1 -- 172.21.15.90:0/750184773 shutdown_connections 2024-09-10T23:15:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.735+0000 7fc3d4d17640 1 --2- 172.21.15.90:0/750184773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3d00d0ab0 0x7fc3d00d0f60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.735+0000 7fc3d4d17640 1 --2- 172.21.15.90:0/750184773 >> v2:172.21.15.171:3300/0 conn(0x7fc3d00d1c70 0x7fc3d00d2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.735+0000 7fc3d4d17640 1 --2- 172.21.15.90:0/750184773 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3d00d2470 0x7fc3d00b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.735+0000 7fc3d4d17640 1 -- 172.21.15.90:0/750184773 >> 172.21.15.90:0/750184773 conn(0x7fc3d009d2a0 msgr2=0x7fc3d00d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.735+0000 7fc3d4d17640 1 -- 172.21.15.90:0/750184773 shutdown_connections 2024-09-10T23:15:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.735+0000 7fc3d4d17640 1 -- 172.21.15.90:0/750184773 wait complete. 2024-09-10T23:15:18.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.737+0000 7fc3d4d17640 1 Processor -- start 2024-09-10T23:15:18.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.737+0000 7fc3d4d17640 1 -- start start 2024-09-10T23:15:18.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.737+0000 7fc3d4d17640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3d00d0ab0 0x7fc3d01f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:18.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.737+0000 7fc3d4d17640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3d00d1c70 0x7fc3d00ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.737+0000 7fc3d4d17640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc3d00d2470 0x7fc3d01f8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.737+0000 7fc3d4d17640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d015e4a0 con 0x7fc3d00d0ab0 2024-09-10T23:15:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.737+0000 7fc3d4d17640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d015e320 con 0x7fc3d00d2470 2024-09-10T23:15:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.737+0000 7fc3d4d17640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d00d14a0 con 0x7fc3d00d1c70 2024-09-10T23:15:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.737+0000 7fc3ce59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3d00d0ab0 0x7fc3d01f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.737+0000 7fc3ce59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3d00d0ab0 0x7fc3d01f54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37292/0 (socket says 172.21.15.90:37292) 2024-09-10T23:15:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.737+0000 7fc3ce59c640 1 -- 172.21.15.90:0/1711145735 learned_addr learned my addr 172.21.15.90:0/1711145735 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.738+0000 7fc3ced9d640 1 --2- 172.21.15.90:0/1711145735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc3d00d2470 0x7fc3d01f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.738+0000 7fc3cdd9b640 1 --2- 172.21.15.90:0/1711145735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3d00d1c70 0x7fc3d00ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.738+0000 7fc3ce59c640 1 -- 172.21.15.90:0/1711145735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3d00d1c70 msgr2=0x7fc3d00ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.738+0000 7fc3ce59c640 1 --2- 172.21.15.90:0/1711145735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3d00d1c70 0x7fc3d00ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.738+0000 7fc3ce59c640 1 -- 172.21.15.90:0/1711145735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc3d00d2470 msgr2=0x7fc3d01f8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:18.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.738+0000 7fc3ce59c640 1 --2- 172.21.15.90:0/1711145735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc3d00d2470 0x7fc3d01f8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.738+0000 7fc3ce59c640 1 -- 172.21.15.90:0/1711145735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d01f5a20 con 0x7fc3d00d0ab0 2024-09-10T23:15:18.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.738+0000 7fc3ced9d640 1 --2- 172.21.15.90:0/1711145735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc3d00d2470 0x7fc3d01f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:18.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.738+0000 7fc3ce59c640 1 --2- 172.21.15.90:0/1711145735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3d00d0ab0 0x7fc3d01f54e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800cce0 tx=0x7fc3c8007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:18.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.738+0000 7fc3c6ffd640 1 -- 172.21.15.90:0/1711145735 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8004b20 con 0x7fc3d00d0ab0 2024-09-10T23:15:18.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.738+0000 7fc3c6ffd640 1 -- 172.21.15.90:0/1711145735 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3c8004cc0 con 0x7fc3d00d0ab0 2024-09-10T23:15:18.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.738+0000 7fc3d4d17640 1 -- 172.21.15.90:0/1711145735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d015b4b0 con 0x7fc3d00d0ab0 2024-09-10T23:15:18.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.738+0000 7fc3c6ffd640 1 -- 172.21.15.90:0/1711145735 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8005280 con 0x7fc3d00d0ab0 2024-09-10T23:15:18.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.738+0000 7fc3d4d17640 1 -- 172.21.15.90:0/1711145735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d015bd50 con 0x7fc3d00d0ab0 2024-09-10T23:15:18.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.739+0000 7fc3d4d17640 1 -- 172.21.15.90:0/1711145735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d00d0f60 con 0x7fc3d00d0ab0 2024-09-10T23:15:18.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.740+0000 7fc3c6ffd640 1 -- 172.21.15.90:0/1711145735 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc3c8005420 con 0x7fc3d00d0ab0 2024-09-10T23:15:18.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.740+0000 7fc3c6ffd640 1 --2- 172.21.15.90:0/1711145735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc3b0077f70 0x7fc3b007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:18.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.740+0000 7fc3c6ffd640 1 -- 172.21.15.90:0/1711145735 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc3c809a440 con 0x7fc3d00d0ab0 2024-09-10T23:15:18.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.740+0000 7fc3cdd9b640 1 --2- 172.21.15.90:0/1711145735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc3b0077f70 0x7fc3b007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:18.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.741+0000 7fc3cdd9b640 1 --2- 172.21.15.90:0/1711145735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc3b0077f70 0x7fc3b007a430 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc3d006eb90 tx=0x7fc3b8009110 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:18.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.744+0000 7fc3c6ffd640 1 -- 172.21.15.90:0/1711145735 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc3d01f5a20 con 0x7fc3d00d0ab0 2024-09-10T23:15:18.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.984+0000 7fc3d4d17640 1 -- 172.21.15.90:0/1711145735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc3d015d460 con 0x7fc3d00d0ab0 2024-09-10T23:15:18.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.984+0000 7fc3c6ffd640 1 -- 172.21.15.90:0/1711145735 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2830 (secure 0 0 0) 0x7fc3c8014030 con 0x7fc3d00d0ab0 2024-09-10T23:15:18.985 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:18.985 INFO:teuthology.orchestra.run.smithi090.stdout:{"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":66,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010065,"num_in_osds":8,"osd_in_since":1726010055,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":88},{"state_name":"creating+peering","count":5},{"state_name":"unknown","count":4}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592778,"bytes_used":225550336,"bytes_avail":772868562944,"bytes_total":773094113280,"unknown_pgs_ratio":0.041237112134695053,"inactive_pgs_ratio":0.051546391099691391,"write_bytes_sec":2518,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":14,"btime":"2024-09-10T23:15:16:780866+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":4881}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-10T23:15:18.442608+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:15:18.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.986+0000 7fc3d4d17640 1 -- 172.21.15.90:0/1711145735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc3b0077f70 msgr2=0x7fc3b007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:18.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.986+0000 7fc3d4d17640 1 --2- 172.21.15.90:0/1711145735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc3b0077f70 0x7fc3b007a430 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc3d006eb90 tx=0x7fc3b8009110 comp rx=0 tx=0).stop 2024-09-10T23:15:18.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.986+0000 7fc3d4d17640 1 -- 172.21.15.90:0/1711145735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3d00d0ab0 msgr2=0x7fc3d01f54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:18.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.986+0000 7fc3d4d17640 1 --2- 172.21.15.90:0/1711145735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3d00d0ab0 0x7fc3d01f54e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800cce0 tx=0x7fc3c8007610 comp rx=0 tx=0).stop 2024-09-10T23:15:18.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.986+0000 7fc3d4d17640 1 -- 172.21.15.90:0/1711145735 shutdown_connections 2024-09-10T23:15:18.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.986+0000 7fc3d4d17640 1 --2- 172.21.15.90:0/1711145735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc3b0077f70 0x7fc3b007a430 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.986+0000 7fc3d4d17640 1 --2- 172.21.15.90:0/1711145735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc3d00d2470 0x7fc3d01f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.986+0000 7fc3d4d17640 1 --2- 172.21.15.90:0/1711145735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3d00d1c70 0x7fc3d00ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.986+0000 7fc3d4d17640 1 --2- 172.21.15.90:0/1711145735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3d00d0ab0 0x7fc3d01f54e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:18.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.986+0000 7fc3d4d17640 1 -- 172.21.15.90:0/1711145735 >> 172.21.15.90:0/1711145735 conn(0x7fc3d009d2a0 msgr2=0x7fc3d00cb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:18.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.986+0000 7fc3d4d17640 1 -- 172.21.15.90:0/1711145735 shutdown_connections 2024-09-10T23:15:18.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:18.986+0000 7fc3d4d17640 1 -- 172.21.15.90:0/1711145735 wait complete. 2024-09-10T23:15:18.998 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T23:15:18.998 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:15:19.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.099+0000 7f184119f640 1 -- 172.21.15.90:0/845904335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1824003a80 msgr2=0x7f1824003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:19.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.099+0000 7f184119f640 1 --2- 172.21.15.90:0/845904335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1824003a80 0x7f1824003ea0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f182c00c290 tx=0x7f1824005830 comp rx=0 tx=0).stop 2024-09-10T23:15:19.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.099+0000 7f184119f640 1 -- 172.21.15.90:0/845904335 shutdown_connections 2024-09-10T23:15:19.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.099+0000 7f184119f640 1 --2- 172.21.15.90:0/845904335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1824003a80 0x7f1824003ea0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:19.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.099+0000 7f184119f640 1 -- 172.21.15.90:0/845904335 >> 172.21.15.90:0/845904335 conn(0x7f183c0d0b60 msgr2=0x7f183c0d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:19.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.099+0000 7f184119f640 1 -- 172.21.15.90:0/845904335 shutdown_connections 2024-09-10T23:15:19.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.099+0000 7f184119f640 1 -- 172.21.15.90:0/845904335 wait complete. 2024-09-10T23:15:19.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.100+0000 7f184119f640 1 Processor -- start 2024-09-10T23:15:19.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.100+0000 7f184119f640 1 -- start start 2024-09-10T23:15:19.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f184119f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1824003a80 0x7f183c157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:19.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f184119f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f183c1f59c0 0x7f183c152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:19.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f184119f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f183c0b1a20 0x7f183c0b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:19.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f184119f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f183c070ce0 con 0x7f183c1f59c0 2024-09-10T23:15:19.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f184119f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f183c15b980 con 0x7f1824003a80 2024-09-10T23:15:19.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f184119f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f183c070e60 con 0x7f183c0b1a20 2024-09-10T23:15:19.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f183b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f183c1f59c0 0x7f183c152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:19.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f183b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f183c1f59c0 0x7f183c152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37316/0 (socket says 172.21.15.90:37316) 2024-09-10T23:15:19.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f183b7fe640 1 -- 172.21.15.90:0/33019310 learned_addr learned my addr 172.21.15.90:0/33019310 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:19.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f184099e640 1 --2- 172.21.15.90:0/33019310 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f183c0b1a20 0x7f183c0b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:19.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f183bfff640 1 --2- 172.21.15.90:0/33019310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1824003a80 0x7f183c157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:19.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f183b7fe640 1 -- 172.21.15.90:0/33019310 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f183c0b1a20 msgr2=0x7f183c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:19.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f183b7fe640 1 --2- 172.21.15.90:0/33019310 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f183c0b1a20 0x7f183c0b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:19.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f183b7fe640 1 -- 172.21.15.90:0/33019310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1824003a80 msgr2=0x7f183c157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:19.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f183b7fe640 1 --2- 172.21.15.90:0/33019310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1824003a80 0x7f183c157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:19.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f183b7fe640 1 -- 172.21.15.90:0/33019310 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c1f1710 con 0x7f183c1f59c0 2024-09-10T23:15:19.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f184099e640 1 --2- 172.21.15.90:0/33019310 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f183c0b1a20 0x7f183c0b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:19.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.101+0000 7f183b7fe640 1 --2- 172.21.15.90:0/33019310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f183c1f59c0 0x7f183c152150 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f183000b660 tx=0x7f183000bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:19.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.102+0000 7f1838ff9640 1 -- 172.21.15.90:0/33019310 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1830010bb0 con 0x7f183c1f59c0 2024-09-10T23:15:19.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.102+0000 7f1838ff9640 1 -- 172.21.15.90:0/33019310 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1830015070 con 0x7f183c1f59c0 2024-09-10T23:15:19.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.102+0000 7f184119f640 1 -- 172.21.15.90:0/33019310 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183c152af0 con 0x7f183c1f59c0 2024-09-10T23:15:19.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.102+0000 7f1838ff9640 1 -- 172.21.15.90:0/33019310 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183001a470 con 0x7f183c1f59c0 2024-09-10T23:15:19.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.102+0000 7f184119f640 1 -- 172.21.15.90:0/33019310 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f183c1f1cb0 con 0x7f183c1f59c0 2024-09-10T23:15:19.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.103+0000 7f184119f640 1 -- 172.21.15.90:0/33019310 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f183c15e590 con 0x7f183c1f59c0 2024-09-10T23:15:19.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.103+0000 7f1838ff9640 1 -- 172.21.15.90:0/33019310 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1830022030 con 0x7f183c1f59c0 2024-09-10T23:15:19.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.104+0000 7f1838ff9640 1 --2- 172.21.15.90:0/33019310 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1828077fa0 0x7f182807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:19.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.104+0000 7f1838ff9640 1 -- 172.21.15.90:0/33019310 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f183009a520 con 0x7f183c1f59c0 2024-09-10T23:15:19.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.104+0000 7f183bfff640 1 --2- 172.21.15.90:0/33019310 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1828077fa0 0x7f182807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:19.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.104+0000 7f183bfff640 1 --2- 172.21.15.90:0/33019310 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1828077fa0 0x7f182807a460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f182c033000 tx=0x7f182c038040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:19.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.108+0000 7f1838ff9640 1 -- 172.21.15.90:0/33019310 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1830063020 con 0x7f183c1f59c0 2024-09-10T23:15:19.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.279+0000 7f184119f640 1 -- 172.21.15.90:0/33019310 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f183c1580d0 con 0x7f1828077fa0 2024-09-10T23:15:19.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.284+0000 7f1838ff9640 1 -- 172.21.15.90:0/33019310 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250843 (secure 0 0 0) 0x7f182c0813f0 con 0x7f1828077fa0 2024-09-10T23:15:19.287 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:19.289 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:15:19.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.287+0000 7f184119f640 1 -- 172.21.15.90:0/33019310 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1828077fa0 msgr2=0x7f182807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:19.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.287+0000 7f184119f640 1 --2- 172.21.15.90:0/33019310 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1828077fa0 0x7f182807a460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f182c033000 tx=0x7f182c038040 comp rx=0 tx=0).stop 2024-09-10T23:15:19.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.287+0000 7f184119f640 1 -- 172.21.15.90:0/33019310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f183c1f59c0 msgr2=0x7f183c152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:19.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.287+0000 7f184119f640 1 --2- 172.21.15.90:0/33019310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f183c1f59c0 0x7f183c152150 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f183000b660 tx=0x7f183000bb20 comp rx=0 tx=0).stop 2024-09-10T23:15:19.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.288+0000 7f184119f640 1 -- 172.21.15.90:0/33019310 shutdown_connections 2024-09-10T23:15:19.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.288+0000 7f184119f640 1 --2- 172.21.15.90:0/33019310 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1828077fa0 0x7f182807a460 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:19.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.288+0000 7f184119f640 1 --2- 172.21.15.90:0/33019310 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f183c0b1a20 0x7f183c0b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:19.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.288+0000 7f184119f640 1 --2- 172.21.15.90:0/33019310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f183c1f59c0 0x7f183c152150 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:19.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.288+0000 7f184119f640 1 --2- 172.21.15.90:0/33019310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1824003a80 0x7f183c157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:19.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.288+0000 7f184119f640 1 -- 172.21.15.90:0/33019310 >> 172.21.15.90:0/33019310 conn(0x7f183c0d0b60 msgr2=0x7f183c14fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:19.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.288+0000 7f184119f640 1 -- 172.21.15.90:0/33019310 shutdown_connections 2024-09-10T23:15:19.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:19.288+0000 7f184119f640 1 -- 172.21.15.90:0/33019310 wait complete. 2024-09-10T23:15:19.300 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-10T23:15:18.442561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":144,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220264,"kb_used_data":4012,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754456,"statfs":{"total":773094113280,"available":772868562944,"internally_reserved":0,"allocated":4108288,"data_stored":2269017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.692272"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785950+0000","last_change":"2024-09-10T23:15:14.782590+0000","last_active":"2024-09-10T23:15:14.785950+0000","last_peered":"2024-09-10T23:15:14.785950+0000","last_clean":"2024-09-10T23:15:14.785950+0000","last_became_active":"2024-09-10T23:15:14.782279+0000","last_became_peered":"2024-09-10T23:15:14.782279+0000","last_unstale":"2024-09-10T23:15:14.785950+0000","last_undegraded":"2024-09-10T23:15:14.785950+0000","last_fullsized":"2024-09-10T23:15:14.785950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:29.232671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795199+0000","last_change":"2024-09-10T23:15:14.784084+0000","last_active":"2024-09-10T23:15:14.795199+0000","last_peered":"2024-09-10T23:15:14.795199+0000","last_clean":"2024-09-10T23:15:14.795199+0000","last_became_active":"2024-09-10T23:15:14.783797+0000","last_became_peered":"2024-09-10T23:15:14.783797+0000","last_unstale":"2024-09-10T23:15:14.795199+0000","last_undegraded":"2024-09-10T23:15:14.795199+0000","last_fullsized":"2024-09-10T23:15:14.795199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:05.732071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785174+0000","last_change":"2024-09-10T23:15:14.777426+0000","last_active":"2024-09-10T23:15:14.785174+0000","last_peered":"2024-09-10T23:15:14.785174+0000","last_clean":"2024-09-10T23:15:14.785174+0000","last_became_active":"2024-09-10T23:15:14.777146+0000","last_became_peered":"2024-09-10T23:15:14.777146+0000","last_unstale":"2024-09-10T23:15:14.785174+0000","last_undegraded":"2024-09-10T23:15:14.785174+0000","last_fullsized":"2024-09-10T23:15:14.785174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:59.921943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.790290+0000","last_change":"2024-09-10T23:15:14.786653+0000","last_active":"2024-09-10T23:15:14.790290+0000","last_peered":"2024-09-10T23:15:14.790290+0000","last_clean":"2024-09-10T23:15:14.790290+0000","last_became_active":"2024-09-10T23:15:14.786388+0000","last_became_peered":"2024-09-10T23:15:14.786388+0000","last_unstale":"2024-09-10T23:15:14.790290+0000","last_undegraded":"2024-09-10T23:15:14.790290+0000","last_fullsized":"2024-09-10T23:15:14.790290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:57.739458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.780047+0000","last_change":"2024-09-10T23:15:14.777568+0000","last_active":"2024-09-10T23:15:14.780047+0000","last_peered":"2024-09-10T23:15:14.780047+0000","last_clean":"2024-09-10T23:15:14.780047+0000","last_became_active":"2024-09-10T23:15:14.777316+0000","last_became_peered":"2024-09-10T23:15:14.777316+0000","last_unstale":"2024-09-10T23:15:14.780047+0000","last_undegraded":"2024-09-10T23:15:14.780047+0000","last_fullsized":"2024-09-10T23:15:14.780047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:48.058773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796029+0000","last_change":"2024-09-10T23:15:14.787768+0000","last_active":"2024-09-10T23:15:14.796029+0000","last_peered":"2024-09-10T23:15:14.796029+0000","last_clean":"2024-09-10T23:15:14.796029+0000","last_became_active":"2024-09-10T23:15:14.787494+0000","last_became_peered":"2024-09-10T23:15:14.787494+0000","last_unstale":"2024-09-10T23:15:14.796029+0000","last_undegraded":"2024-09-10T23:15:14.796029+0000","last_fullsized":"2024-09-10T23:15:14.796029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:51.822103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788683+0000","last_change":"2024-09-10T23:15:14.786512+0000","last_active":"2024-09-10T23:15:14.788683+0000","last_peered":"2024-09-10T23:15:14.788683+0000","last_clean":"2024-09-10T23:15:14.788683+0000","last_became_active":"2024-09-10T23:15:14.786226+0000","last_became_peered":"2024-09-10T23:15:14.786226+0000","last_unstale":"2024-09-10T23:15:14.788683+0000","last_undegraded":"2024-09-10T23:15:14.788683+0000","last_fullsized":"2024-09-10T23:15:14.788683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:26.578923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786982+0000","last_change":"2024-09-10T23:15:14.779115+0000","last_active":"2024-09-10T23:15:14.786982+0000","last_peered":"2024-09-10T23:15:14.786982+0000","last_clean":"2024-09-10T23:15:14.786982+0000","last_became_active":"2024-09-10T23:15:14.778811+0000","last_became_peered":"2024-09-10T23:15:14.778811+0000","last_unstale":"2024-09-10T23:15:14.786982+0000","last_undegraded":"2024-09-10T23:15:14.786982+0000","last_fullsized":"2024-09-10T23:15:14.786982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:59.921943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.791973+0000","last_change":"2024-09-10T23:15:14.784909+0000","last_active":"2024-09-10T23:15:14.791973+0000","last_peered":"2024-09-10T23:15:14.791973+0000","last_clean":"2024-09-10T23:15:14.791973+0000","last_became_active":"2024-09-10T23:15:14.784511+0000","last_became_peered":"2024-09-10T23:15:14.784511+0000","last_unstale":"2024-09-10T23:15:14.791973+0000","last_undegraded":"2024-09-10T23:15:14.791973+0000","last_fullsized":"2024-09-10T23:15:14.791973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:05.158732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.787382+0000","last_change":"2024-09-10T23:15:14.785521+0000","last_active":"2024-09-10T23:15:14.787382+0000","last_peered":"2024-09-10T23:15:14.787382+0000","last_clean":"2024-09-10T23:15:14.787382+0000","last_became_active":"2024-09-10T23:15:14.785042+0000","last_became_peered":"2024-09-10T23:15:14.785042+0000","last_unstale":"2024-09-10T23:15:14.787382+0000","last_undegraded":"2024-09-10T23:15:14.787382+0000","last_fullsized":"2024-09-10T23:15:14.787382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:11.616236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788226+0000","last_change":"2024-09-10T23:15:14.783123+0000","last_active":"2024-09-10T23:15:14.788226+0000","last_peered":"2024-09-10T23:15:14.788226+0000","last_clean":"2024-09-10T23:15:14.788226+0000","last_became_active":"2024-09-10T23:15:14.782839+0000","last_became_peered":"2024-09-10T23:15:14.782839+0000","last_unstale":"2024-09-10T23:15:14.788226+0000","last_undegraded":"2024-09-10T23:15:14.788226+0000","last_fullsized":"2024-09-10T23:15:14.788226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:01.426667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785981+0000","last_change":"2024-09-10T23:15:14.780626+0000","last_active":"2024-09-10T23:15:14.785981+0000","last_peered":"2024-09-10T23:15:14.785981+0000","last_clean":"2024-09-10T23:15:14.785981+0000","last_became_active":"2024-09-10T23:15:14.780319+0000","last_became_peered":"2024-09-10T23:15:14.780319+0000","last_unstale":"2024-09-10T23:15:14.785981+0000","last_undegraded":"2024-09-10T23:15:14.785981+0000","last_fullsized":"2024-09-10T23:15:14.785981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:43.885268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.779991+0000","last_change":"2024-09-10T23:15:14.775829+0000","last_active":"2024-09-10T23:15:14.779991+0000","last_peered":"2024-09-10T23:15:14.779991+0000","last_clean":"2024-09-10T23:15:14.779991+0000","last_became_active":"2024-09-10T23:15:14.775197+0000","last_became_peered":"2024-09-10T23:15:14.775197+0000","last_unstale":"2024-09-10T23:15:14.779991+0000","last_undegraded":"2024-09-10T23:15:14.779991+0000","last_fullsized":"2024-09-10T23:15:14.779991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:05.633943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.777970+0000","last_change":"2024-09-10T23:15:14.776541+0000","last_active":"2024-09-10T23:15:14.777970+0000","last_peered":"2024-09-10T23:15:14.777970+0000","last_clean":"2024-09-10T23:15:14.777970+0000","last_became_active":"2024-09-10T23:15:14.776297+0000","last_became_peered":"2024-09-10T23:15:14.776297+0000","last_unstale":"2024-09-10T23:15:14.777970+0000","last_undegraded":"2024-09-10T23:15:14.777970+0000","last_fullsized":"2024-09-10T23:15:14.777970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:04.984362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786416+0000","last_change":"2024-09-10T23:15:14.784278+0000","last_active":"2024-09-10T23:15:14.786416+0000","last_peered":"2024-09-10T23:15:14.786416+0000","last_clean":"2024-09-10T23:15:14.786416+0000","last_became_active":"2024-09-10T23:15:14.784023+0000","last_became_peered":"2024-09-10T23:15:14.784023+0000","last_unstale":"2024-09-10T23:15:14.786416+0000","last_undegraded":"2024-09-10T23:15:14.786416+0000","last_fullsized":"2024-09-10T23:15:14.786416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:40.651240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786958+0000","last_change":"2024-09-10T23:15:14.778174+0000","last_active":"2024-09-10T23:15:14.786958+0000","last_peered":"2024-09-10T23:15:14.786958+0000","last_clean":"2024-09-10T23:15:14.786958+0000","last_became_active":"2024-09-10T23:15:14.777911+0000","last_became_peered":"2024-09-10T23:15:14.777911+0000","last_unstale":"2024-09-10T23:15:14.786958+0000","last_undegraded":"2024-09-10T23:15:14.786958+0000","last_fullsized":"2024-09-10T23:15:14.786958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:20.582304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788259+0000","last_change":"2024-09-10T23:15:14.784036+0000","last_active":"2024-09-10T23:15:14.788259+0000","last_peered":"2024-09-10T23:15:14.788259+0000","last_clean":"2024-09-10T23:15:14.788259+0000","last_became_active":"2024-09-10T23:15:14.783780+0000","last_became_peered":"2024-09-10T23:15:14.783780+0000","last_unstale":"2024-09-10T23:15:14.788259+0000","last_undegraded":"2024-09-10T23:15:14.788259+0000","last_fullsized":"2024-09-10T23:15:14.788259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:43.885268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.789823+0000","last_change":"2024-09-10T23:15:14.782310+0000","last_active":"2024-09-10T23:15:14.789823+0000","last_peered":"2024-09-10T23:15:14.789823+0000","last_clean":"2024-09-10T23:15:14.789823+0000","last_became_active":"2024-09-10T23:15:14.782047+0000","last_became_peered":"2024-09-10T23:15:14.782047+0000","last_unstale":"2024-09-10T23:15:14.789823+0000","last_undegraded":"2024-09-10T23:15:14.789823+0000","last_fullsized":"2024-09-10T23:15:14.789823+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:40.651240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.778031+0000","last_change":"2024-09-10T23:15:14.776242+0000","last_active":"2024-09-10T23:15:14.778031+0000","last_peered":"2024-09-10T23:15:14.778031+0000","last_clean":"2024-09-10T23:15:14.778031+0000","last_became_active":"2024-09-10T23:15:14.776016+0000","last_became_peered":"2024-09-10T23:15:14.776016+0000","last_unstale":"2024-09-10T23:15:14.778031+0000","last_undegraded":"2024-09-10T23:15:14.778031+0000","last_fullsized":"2024-09-10T23:15:14.778031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:43.885268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.779028+0000","last_change":"2024-09-10T23:15:14.773759+0000","last_active":"2024-09-10T23:15:14.779028+0000","last_peered":"2024-09-10T23:15:14.779028+0000","last_clean":"2024-09-10T23:15:14.779028+0000","last_became_active":"2024-09-10T23:15:14.773146+0000","last_became_peered":"2024-09-10T23:15:14.773146+0000","last_unstale":"2024-09-10T23:15:14.779028+0000","last_undegraded":"2024-09-10T23:15:14.779028+0000","last_fullsized":"2024-09-10T23:15:14.779028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:00.613653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.793605+0000","last_change":"2024-09-10T23:15:14.790230+0000","last_active":"2024-09-10T23:15:14.793605+0000","last_peered":"2024-09-10T23:15:14.793605+0000","last_clean":"2024-09-10T23:15:14.793605+0000","last_became_active":"2024-09-10T23:15:14.785734+0000","last_became_peered":"2024-09-10T23:15:14.785734+0000","last_unstale":"2024-09-10T23:15:14.793605+0000","last_undegraded":"2024-09-10T23:15:14.793605+0000","last_fullsized":"2024-09-10T23:15:14.793605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:21.092694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797068+0000","last_change":"2024-09-10T23:15:14.796057+0000","last_active":"2024-09-10T23:15:14.797068+0000","last_peered":"2024-09-10T23:15:14.797068+0000","last_clean":"2024-09-10T23:15:14.797068+0000","last_became_active":"2024-09-10T23:15:14.795690+0000","last_became_peered":"2024-09-10T23:15:14.795690+0000","last_unstale":"2024-09-10T23:15:14.797068+0000","last_undegraded":"2024-09-10T23:15:14.797068+0000","last_fullsized":"2024-09-10T23:15:14.797068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:20.633732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:15:13.749502+0000","last_change":"2024-09-10T23:15:13.749502+0000","last_active":"2024-09-10T23:15:13.749502+0000","last_peered":"2024-09-10T23:15:13.749502+0000","last_clean":"2024-09-10T23:15:13.749502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:13.749502+0000","last_undegraded":"2024-09-10T23:15:13.749502+0000","last_fullsized":"2024-09-10T23:15:13.749502+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.780102+0000","last_change":"2024-09-10T23:15:14.775294+0000","last_active":"2024-09-10T23:15:14.780102+0000","last_peered":"2024-09-10T23:15:14.780102+0000","last_clean":"2024-09-10T23:15:14.780102+0000","last_became_active":"2024-09-10T23:15:14.775007+0000","last_became_peered":"2024-09-10T23:15:14.775007+0000","last_unstale":"2024-09-10T23:15:14.780102+0000","last_undegraded":"2024-09-10T23:15:14.780102+0000","last_fullsized":"2024-09-10T23:15:14.780102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:20.582304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796002+0000","last_change":"2024-09-10T23:15:14.790930+0000","last_active":"2024-09-10T23:15:14.796002+0000","last_peered":"2024-09-10T23:15:14.796002+0000","last_clean":"2024-09-10T23:15:14.796002+0000","last_became_active":"2024-09-10T23:15:14.790611+0000","last_became_peered":"2024-09-10T23:15:14.790611+0000","last_unstale":"2024-09-10T23:15:14.796002+0000","last_undegraded":"2024-09-10T23:15:14.796002+0000","last_fullsized":"2024-09-10T23:15:14.796002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:46.414579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795942+0000","last_change":"2024-09-10T23:15:14.785099+0000","last_active":"2024-09-10T23:15:14.795942+0000","last_peered":"2024-09-10T23:15:14.795942+0000","last_clean":"2024-09-10T23:15:14.795942+0000","last_became_active":"2024-09-10T23:15:14.784771+0000","last_became_peered":"2024-09-10T23:15:14.784771+0000","last_unstale":"2024-09-10T23:15:14.795942+0000","last_undegraded":"2024-09-10T23:15:14.795942+0000","last_fullsized":"2024-09-10T23:15:14.795942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:14.428600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796553+0000","last_change":"2024-09-10T23:15:14.793856+0000","last_active":"2024-09-10T23:15:14.796553+0000","last_peered":"2024-09-10T23:15:14.796553+0000","last_clean":"2024-09-10T23:15:14.796553+0000","last_became_active":"2024-09-10T23:15:14.793367+0000","last_became_peered":"2024-09-10T23:15:14.793367+0000","last_unstale":"2024-09-10T23:15:14.796553+0000","last_undegraded":"2024-09-10T23:15:14.796553+0000","last_fullsized":"2024-09-10T23:15:14.796553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:18.746412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.787300+0000","last_change":"2024-09-10T23:15:14.785755+0000","last_active":"2024-09-10T23:15:14.787300+0000","last_peered":"2024-09-10T23:15:14.787300+0000","last_clean":"2024-09-10T23:15:14.787300+0000","last_became_active":"2024-09-10T23:15:14.782572+0000","last_became_peered":"2024-09-10T23:15:14.782572+0000","last_unstale":"2024-09-10T23:15:14.787300+0000","last_undegraded":"2024-09-10T23:15:14.787300+0000","last_fullsized":"2024-09-10T23:15:14.787300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:09.218654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797495+0000","last_change":"2024-09-10T23:15:14.796654+0000","last_active":"2024-09-10T23:15:14.797495+0000","last_peered":"2024-09-10T23:15:14.797495+0000","last_clean":"2024-09-10T23:15:14.797495+0000","last_became_active":"2024-09-10T23:15:14.796438+0000","last_became_peered":"2024-09-10T23:15:14.796438+0000","last_unstale":"2024-09-10T23:15:14.797495+0000","last_undegraded":"2024-09-10T23:15:14.797495+0000","last_fullsized":"2024-09-10T23:15:14.797495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:36.736865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788177+0000","last_change":"2024-09-10T23:15:14.785696+0000","last_active":"2024-09-10T23:15:14.788177+0000","last_peered":"2024-09-10T23:15:14.788177+0000","last_clean":"2024-09-10T23:15:14.788177+0000","last_became_active":"2024-09-10T23:15:14.785439+0000","last_became_peered":"2024-09-10T23:15:14.785439+0000","last_unstale":"2024-09-10T23:15:14.788177+0000","last_undegraded":"2024-09-10T23:15:14.788177+0000","last_fullsized":"2024-09-10T23:15:14.788177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:04.984362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786699+0000","last_change":"2024-09-10T23:15:14.784069+0000","last_active":"2024-09-10T23:15:14.786699+0000","last_peered":"2024-09-10T23:15:14.786699+0000","last_clean":"2024-09-10T23:15:14.786699+0000","last_became_active":"2024-09-10T23:15:14.783809+0000","last_became_peered":"2024-09-10T23:15:14.783809+0000","last_unstale":"2024-09-10T23:15:14.786699+0000","last_undegraded":"2024-09-10T23:15:14.786699+0000","last_fullsized":"2024-09-10T23:15:14.786699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:34.228563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795168+0000","last_change":"2024-09-10T23:15:14.792638+0000","last_active":"2024-09-10T23:15:14.795168+0000","last_peered":"2024-09-10T23:15:14.795168+0000","last_clean":"2024-09-10T23:15:14.795168+0000","last_became_active":"2024-09-10T23:15:14.792122+0000","last_became_peered":"2024-09-10T23:15:14.792122+0000","last_unstale":"2024-09-10T23:15:14.795168+0000","last_undegraded":"2024-09-10T23:15:14.795168+0000","last_fullsized":"2024-09-10T23:15:14.795168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:05.732071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:15:13.749502+0000","last_change":"2024-09-10T23:15:13.749502+0000","last_active":"2024-09-10T23:15:13.749502+0000","last_peered":"2024-09-10T23:15:13.749502+0000","last_clean":"2024-09-10T23:15:13.749502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:13.749502+0000","last_undegraded":"2024-09-10T23:15:13.749502+0000","last_fullsized":"2024-09-10T23:15:13.749502+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.792354+0000","last_change":"2024-09-10T23:15:13.778953+0000","last_active":"2024-09-10T23:15:14.792354+0000","last_peered":"2024-09-10T23:15:14.792354+0000","last_clean":"2024-09-10T23:15:14.792354+0000","last_became_active":"2024-09-10T23:15:13.778585+0000","last_became_peered":"2024-09-10T23:15:13.778585+0000","last_unstale":"2024-09-10T23:15:14.792354+0000","last_undegraded":"2024-09-10T23:15:14.792354+0000","last_fullsized":"2024-09-10T23:15:14.792354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:04.980386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795415+0000","last_change":"2024-09-10T23:15:14.793437+0000","last_active":"2024-09-10T23:15:14.795415+0000","last_peered":"2024-09-10T23:15:14.795415+0000","last_clean":"2024-09-10T23:15:14.795415+0000","last_became_active":"2024-09-10T23:15:14.792867+0000","last_became_peered":"2024-09-10T23:15:14.792867+0000","last_unstale":"2024-09-10T23:15:14.795415+0000","last_undegraded":"2024-09-10T23:15:14.795415+0000","last_fullsized":"2024-09-10T23:15:14.795415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:11.616236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.755568+0000","last_change":"2024-09-10T23:15:12.755568+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.755568+0000","last_undegraded":"2024-09-10T23:15:12.755568+0000","last_fullsized":"2024-09-10T23:15:12.755568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797736+0000","last_change":"2024-09-10T23:15:14.797080+0000","last_active":"2024-09-10T23:15:14.797736+0000","last_peered":"2024-09-10T23:15:14.797736+0000","last_clean":"2024-09-10T23:15:14.797736+0000","last_became_active":"2024-09-10T23:15:14.796799+0000","last_became_peered":"2024-09-10T23:15:14.796799+0000","last_unstale":"2024-09-10T23:15:14.797736+0000","last_undegraded":"2024-09-10T23:15:14.797736+0000","last_fullsized":"2024-09-10T23:15:14.797736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:20.582304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796219+0000","last_change":"2024-09-10T23:15:13.767284+0000","last_active":"2024-09-10T23:15:14.796219+0000","last_peered":"2024-09-10T23:15:14.796219+0000","last_clean":"2024-09-10T23:15:14.796219+0000","last_became_active":"2024-09-10T23:15:13.766807+0000","last_became_peered":"2024-09-10T23:15:13.766807+0000","last_unstale":"2024-09-10T23:15:14.796219+0000","last_undegraded":"2024-09-10T23:15:14.796219+0000","last_fullsized":"2024-09-10T23:15:14.796219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:19.628277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796527+0000","last_change":"2024-09-10T23:15:14.793249+0000","last_active":"2024-09-10T23:15:14.796527+0000","last_peered":"2024-09-10T23:15:14.796527+0000","last_clean":"2024-09-10T23:15:14.796527+0000","last_became_active":"2024-09-10T23:15:14.792976+0000","last_became_peered":"2024-09-10T23:15:14.792976+0000","last_unstale":"2024-09-10T23:15:14.796527+0000","last_undegraded":"2024-09-10T23:15:14.796527+0000","last_fullsized":"2024-09-10T23:15:14.796527+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:37.902288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795887+0000","last_change":"2024-09-10T23:15:13.769588+0000","last_active":"2024-09-10T23:15:14.795887+0000","last_peered":"2024-09-10T23:15:14.795887+0000","last_clean":"2024-09-10T23:15:14.795887+0000","last_became_active":"2024-09-10T23:15:13.769325+0000","last_became_peered":"2024-09-10T23:15:13.769325+0000","last_unstale":"2024-09-10T23:15:14.795887+0000","last_undegraded":"2024-09-10T23:15:14.795887+0000","last_fullsized":"2024-09-10T23:15:14.795887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:48.670108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795061+0000","last_change":"2024-09-10T23:15:14.791220+0000","last_active":"2024-09-10T23:15:14.795061+0000","last_peered":"2024-09-10T23:15:14.795061+0000","last_clean":"2024-09-10T23:15:14.795061+0000","last_became_active":"2024-09-10T23:15:14.790957+0000","last_became_peered":"2024-09-10T23:15:14.790957+0000","last_unstale":"2024-09-10T23:15:14.795061+0000","last_undegraded":"2024-09-10T23:15:14.795061+0000","last_fullsized":"2024-09-10T23:15:14.795061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:09.218654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796822+0000","last_change":"2024-09-10T23:15:13.768504+0000","last_active":"2024-09-10T23:15:14.796822+0000","last_peered":"2024-09-10T23:15:14.796822+0000","last_clean":"2024-09-10T23:15:14.796822+0000","last_became_active":"2024-09-10T23:15:13.768242+0000","last_became_peered":"2024-09-10T23:15:13.768242+0000","last_unstale":"2024-09-10T23:15:14.796822+0000","last_undegraded":"2024-09-10T23:15:14.796822+0000","last_fullsized":"2024-09-10T23:15:14.796822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:50.630257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786107+0000","last_change":"2024-09-10T23:15:14.783536+0000","last_active":"2024-09-10T23:15:14.786107+0000","last_peered":"2024-09-10T23:15:14.786107+0000","last_clean":"2024-09-10T23:15:14.786107+0000","last_became_active":"2024-09-10T23:15:14.783266+0000","last_became_peered":"2024-09-10T23:15:14.783266+0000","last_unstale":"2024-09-10T23:15:14.786107+0000","last_undegraded":"2024-09-10T23:15:14.786107+0000","last_fullsized":"2024-09-10T23:15:14.786107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:26.578923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796747+0000","last_change":"2024-09-10T23:15:13.771424+0000","last_active":"2024-09-10T23:15:14.796747+0000","last_peered":"2024-09-10T23:15:14.796747+0000","last_clean":"2024-09-10T23:15:14.796747+0000","last_became_active":"2024-09-10T23:15:13.771113+0000","last_became_peered":"2024-09-10T23:15:13.771113+0000","last_unstale":"2024-09-10T23:15:14.796747+0000","last_undegraded":"2024-09-10T23:15:14.796747+0000","last_fullsized":"2024-09-10T23:15:14.796747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:41.926490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.794838+0000","last_change":"2024-09-10T23:15:14.792338+0000","last_active":"2024-09-10T23:15:14.794838+0000","last_peered":"2024-09-10T23:15:14.794838+0000","last_clean":"2024-09-10T23:15:14.794838+0000","last_became_active":"2024-09-10T23:15:14.792063+0000","last_became_peered":"2024-09-10T23:15:14.792063+0000","last_unstale":"2024-09-10T23:15:14.794838+0000","last_undegraded":"2024-09-10T23:15:14.794838+0000","last_fullsized":"2024-09-10T23:15:14.794838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:20.660730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.771600+0000","last_change":"2024-09-10T23:15:13.765543+0000","last_active":"2024-09-10T23:15:14.771600+0000","last_peered":"2024-09-10T23:15:14.771600+0000","last_clean":"2024-09-10T23:15:14.771600+0000","last_became_active":"2024-09-10T23:15:13.765131+0000","last_became_peered":"2024-09-10T23:15:13.765131+0000","last_unstale":"2024-09-10T23:15:14.771600+0000","last_undegraded":"2024-09-10T23:15:14.771600+0000","last_fullsized":"2024-09-10T23:15:14.771600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:33.558724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.792513+0000","last_change":"2024-09-10T23:15:14.787696+0000","last_active":"2024-09-10T23:15:14.792513+0000","last_peered":"2024-09-10T23:15:14.792513+0000","last_clean":"2024-09-10T23:15:14.792513+0000","last_became_active":"2024-09-10T23:15:14.787375+0000","last_became_peered":"2024-09-10T23:15:14.787375+0000","last_unstale":"2024-09-10T23:15:14.792513+0000","last_undegraded":"2024-09-10T23:15:14.792513+0000","last_fullsized":"2024-09-10T23:15:14.792513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:03.746624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.776996+0000","last_change":"2024-09-10T23:15:13.773878+0000","last_active":"2024-09-10T23:15:14.776996+0000","last_peered":"2024-09-10T23:15:14.776996+0000","last_clean":"2024-09-10T23:15:14.776996+0000","last_became_active":"2024-09-10T23:15:13.773575+0000","last_became_peered":"2024-09-10T23:15:13.773575+0000","last_unstale":"2024-09-10T23:15:14.776996+0000","last_undegraded":"2024-09-10T23:15:14.776996+0000","last_fullsized":"2024-09-10T23:15:14.776996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:45.659964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785270+0000","last_change":"2024-09-10T23:15:14.780963+0000","last_active":"2024-09-10T23:15:14.785270+0000","last_peered":"2024-09-10T23:15:14.785270+0000","last_clean":"2024-09-10T23:15:14.785270+0000","last_became_active":"2024-09-10T23:15:14.780623+0000","last_became_peered":"2024-09-10T23:15:14.780623+0000","last_unstale":"2024-09-10T23:15:14.785270+0000","last_undegraded":"2024-09-10T23:15:14.785270+0000","last_fullsized":"2024-09-10T23:15:14.785270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:04.984362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.771644+0000","last_change":"2024-09-10T23:15:13.772352+0000","last_active":"2024-09-10T23:15:14.771644+0000","last_peered":"2024-09-10T23:15:14.771644+0000","last_clean":"2024-09-10T23:15:14.771644+0000","last_became_active":"2024-09-10T23:15:13.772076+0000","last_became_peered":"2024-09-10T23:15:13.772076+0000","last_unstale":"2024-09-10T23:15:14.771644+0000","last_undegraded":"2024-09-10T23:15:14.771644+0000","last_fullsized":"2024-09-10T23:15:14.771644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:35.731410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795126+0000","last_change":"2024-09-10T23:15:14.783374+0000","last_active":"2024-09-10T23:15:14.795126+0000","last_peered":"2024-09-10T23:15:14.795126+0000","last_clean":"2024-09-10T23:15:14.795126+0000","last_became_active":"2024-09-10T23:15:14.783108+0000","last_became_peered":"2024-09-10T23:15:14.783108+0000","last_unstale":"2024-09-10T23:15:14.795126+0000","last_undegraded":"2024-09-10T23:15:14.795126+0000","last_fullsized":"2024-09-10T23:15:14.795126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:19.491880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.754945+0000","last_change":"2024-09-10T23:15:12.754945+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.754945+0000","last_undegraded":"2024-09-10T23:15:12.754945+0000","last_fullsized":"2024-09-10T23:15:12.754945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796664+0000","last_change":"2024-09-10T23:15:14.793078+0000","last_active":"2024-09-10T23:15:14.796664+0000","last_peered":"2024-09-10T23:15:14.796664+0000","last_clean":"2024-09-10T23:15:14.796664+0000","last_became_active":"2024-09-10T23:15:14.792740+0000","last_became_peered":"2024-09-10T23:15:14.792740+0000","last_unstale":"2024-09-10T23:15:14.796664+0000","last_undegraded":"2024-09-10T23:15:14.796664+0000","last_fullsized":"2024-09-10T23:15:14.796664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:57.702941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.794243+0000","last_change":"2024-09-10T23:15:13.770511+0000","last_active":"2024-09-10T23:15:14.794243+0000","last_peered":"2024-09-10T23:15:14.794243+0000","last_clean":"2024-09-10T23:15:14.794243+0000","last_became_active":"2024-09-10T23:15:13.770081+0000","last_became_peered":"2024-09-10T23:15:13.770081+0000","last_unstale":"2024-09-10T23:15:14.794243+0000","last_undegraded":"2024-09-10T23:15:14.794243+0000","last_fullsized":"2024-09-10T23:15:14.794243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:33.558724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785216+0000","last_change":"2024-09-10T23:15:14.777889+0000","last_active":"2024-09-10T23:15:14.785216+0000","last_peered":"2024-09-10T23:15:14.785216+0000","last_clean":"2024-09-10T23:15:14.785216+0000","last_became_active":"2024-09-10T23:15:14.777600+0000","last_became_peered":"2024-09-10T23:15:14.777600+0000","last_unstale":"2024-09-10T23:15:14.785216+0000","last_undegraded":"2024-09-10T23:15:14.785216+0000","last_fullsized":"2024-09-10T23:15:14.785216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:34.197656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.798926+0000","last_change":"2024-09-10T23:15:13.766440+0000","last_active":"2024-09-10T23:15:14.798926+0000","last_peered":"2024-09-10T23:15:14.798926+0000","last_clean":"2024-09-10T23:15:14.798926+0000","last_became_active":"2024-09-10T23:15:13.765980+0000","last_became_peered":"2024-09-10T23:15:13.765980+0000","last_unstale":"2024-09-10T23:15:14.798926+0000","last_undegraded":"2024-09-10T23:15:14.798926+0000","last_fullsized":"2024-09-10T23:15:14.798926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:00.421211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.790675+0000","last_change":"2024-09-10T23:15:14.786936+0000","last_active":"2024-09-10T23:15:14.790675+0000","last_peered":"2024-09-10T23:15:14.790675+0000","last_clean":"2024-09-10T23:15:14.790675+0000","last_became_active":"2024-09-10T23:15:14.786650+0000","last_became_peered":"2024-09-10T23:15:14.786650+0000","last_unstale":"2024-09-10T23:15:14.790675+0000","last_undegraded":"2024-09-10T23:15:14.790675+0000","last_fullsized":"2024-09-10T23:15:14.790675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:13.688354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796061+0000","last_change":"2024-09-10T23:15:13.773637+0000","last_active":"2024-09-10T23:15:14.796061+0000","last_peered":"2024-09-10T23:15:14.796061+0000","last_clean":"2024-09-10T23:15:14.796061+0000","last_became_active":"2024-09-10T23:15:13.773364+0000","last_became_peered":"2024-09-10T23:15:13.773364+0000","last_unstale":"2024-09-10T23:15:14.796061+0000","last_undegraded":"2024-09-10T23:15:14.796061+0000","last_fullsized":"2024-09-10T23:15:14.796061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:54.026868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.789786+0000","last_change":"2024-09-10T23:15:14.782668+0000","last_active":"2024-09-10T23:15:14.789786+0000","last_peered":"2024-09-10T23:15:14.789786+0000","last_clean":"2024-09-10T23:15:14.789786+0000","last_became_active":"2024-09-10T23:15:14.782405+0000","last_became_peered":"2024-09-10T23:15:14.782405+0000","last_unstale":"2024-09-10T23:15:14.789786+0000","last_undegraded":"2024-09-10T23:15:14.789786+0000","last_fullsized":"2024-09-10T23:15:14.789786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:09.218654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.769474+0000","last_change":"2024-09-10T23:15:13.773432+0000","last_active":"2024-09-10T23:15:14.769474+0000","last_peered":"2024-09-10T23:15:14.769474+0000","last_clean":"2024-09-10T23:15:14.769474+0000","last_became_active":"2024-09-10T23:15:13.773136+0000","last_became_peered":"2024-09-10T23:15:13.773136+0000","last_unstale":"2024-09-10T23:15:14.769474+0000","last_undegraded":"2024-09-10T23:15:14.769474+0000","last_fullsized":"2024-09-10T23:15:14.769474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:04.980386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795142+0000","last_change":"2024-09-10T23:15:14.792375+0000","last_active":"2024-09-10T23:15:14.795142+0000","last_peered":"2024-09-10T23:15:14.795142+0000","last_clean":"2024-09-10T23:15:14.795142+0000","last_became_active":"2024-09-10T23:15:14.791810+0000","last_became_peered":"2024-09-10T23:15:14.791810+0000","last_unstale":"2024-09-10T23:15:14.795142+0000","last_undegraded":"2024-09-10T23:15:14.795142+0000","last_fullsized":"2024-09-10T23:15:14.795142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:19.491880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.771808+0000","last_change":"2024-09-10T23:15:13.771529+0000","last_active":"2024-09-10T23:15:14.771808+0000","last_peered":"2024-09-10T23:15:14.771808+0000","last_clean":"2024-09-10T23:15:14.771808+0000","last_became_active":"2024-09-10T23:15:13.771101+0000","last_became_peered":"2024-09-10T23:15:13.771101+0000","last_unstale":"2024-09-10T23:15:14.771808+0000","last_undegraded":"2024-09-10T23:15:14.771808+0000","last_fullsized":"2024-09-10T23:15:14.771808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:19.576849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.794227+0000","last_change":"2024-09-10T23:15:14.793264+0000","last_active":"2024-09-10T23:15:14.794227+0000","last_peered":"2024-09-10T23:15:14.794227+0000","last_clean":"2024-09-10T23:15:14.794227+0000","last_became_active":"2024-09-10T23:15:14.792985+0000","last_became_peered":"2024-09-10T23:15:14.792985+0000","last_unstale":"2024-09-10T23:15:14.794227+0000","last_undegraded":"2024-09-10T23:15:14.794227+0000","last_fullsized":"2024-09-10T23:15:14.794227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:47.421144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797571+0000","last_change":"2024-09-10T23:15:13.764689+0000","last_active":"2024-09-10T23:15:14.797571+0000","last_peered":"2024-09-10T23:15:14.797571+0000","last_clean":"2024-09-10T23:15:14.797571+0000","last_became_active":"2024-09-10T23:15:13.764433+0000","last_became_peered":"2024-09-10T23:15:13.764433+0000","last_unstale":"2024-09-10T23:15:14.797571+0000","last_undegraded":"2024-09-10T23:15:14.797571+0000","last_fullsized":"2024-09-10T23:15:14.797571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:58.916488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.794877+0000","last_change":"2024-09-10T23:15:14.792824+0000","last_active":"2024-09-10T23:15:14.794877+0000","last_peered":"2024-09-10T23:15:14.794877+0000","last_clean":"2024-09-10T23:15:14.794877+0000","last_became_active":"2024-09-10T23:15:14.792525+0000","last_became_peered":"2024-09-10T23:15:14.792525+0000","last_unstale":"2024-09-10T23:15:14.794877+0000","last_undegraded":"2024-09-10T23:15:14.794877+0000","last_fullsized":"2024-09-10T23:15:14.794877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:21.730415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797008+0000","last_change":"2024-09-10T23:15:13.766624+0000","last_active":"2024-09-10T23:15:14.797008+0000","last_peered":"2024-09-10T23:15:14.797008+0000","last_clean":"2024-09-10T23:15:14.797008+0000","last_became_active":"2024-09-10T23:15:13.766374+0000","last_became_peered":"2024-09-10T23:15:13.766374+0000","last_unstale":"2024-09-10T23:15:14.797008+0000","last_undegraded":"2024-09-10T23:15:14.797008+0000","last_fullsized":"2024-09-10T23:15:14.797008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:20.087239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.789947+0000","last_change":"2024-09-10T23:15:14.787164+0000","last_active":"2024-09-10T23:15:14.789947+0000","last_peered":"2024-09-10T23:15:14.789947+0000","last_clean":"2024-09-10T23:15:14.789947+0000","last_became_active":"2024-09-10T23:15:14.786906+0000","last_became_peered":"2024-09-10T23:15:14.786906+0000","last_unstale":"2024-09-10T23:15:14.789947+0000","last_undegraded":"2024-09-10T23:15:14.789947+0000","last_fullsized":"2024-09-10T23:15:14.789947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:19.491880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796153+0000","last_change":"2024-09-10T23:15:13.773007+0000","last_active":"2024-09-10T23:15:14.796153+0000","last_peered":"2024-09-10T23:15:14.796153+0000","last_clean":"2024-09-10T23:15:14.796153+0000","last_became_active":"2024-09-10T23:15:13.772559+0000","last_became_peered":"2024-09-10T23:15:13.772559+0000","last_unstale":"2024-09-10T23:15:14.796153+0000","last_undegraded":"2024-09-10T23:15:14.796153+0000","last_fullsized":"2024-09-10T23:15:14.796153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:31.568535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788033+0000","last_change":"2024-09-10T23:15:14.785689+0000","last_active":"2024-09-10T23:15:14.788033+0000","last_peered":"2024-09-10T23:15:14.788033+0000","last_clean":"2024-09-10T23:15:14.788033+0000","last_became_active":"2024-09-10T23:15:14.785429+0000","last_became_peered":"2024-09-10T23:15:14.785429+0000","last_unstale":"2024-09-10T23:15:14.788033+0000","last_undegraded":"2024-09-10T23:15:14.788033+0000","last_fullsized":"2024-09-10T23:15:14.788033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:39.168497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.796698+0000","last_change":"2024-09-10T23:15:13.767364+0000","last_active":"2024-09-10T23:15:14.796698+0000","last_peered":"2024-09-10T23:15:14.796698+0000","last_clean":"2024-09-10T23:15:14.796698+0000","last_became_active":"2024-09-10T23:15:13.767058+0000","last_became_peered":"2024-09-10T23:15:13.767058+0000","last_unstale":"2024-09-10T23:15:14.796698+0000","last_undegraded":"2024-09-10T23:15:14.796698+0000","last_fullsized":"2024-09-10T23:15:14.796698+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:56.499318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.787001+0000","last_change":"2024-09-10T23:15:14.785805+0000","last_active":"2024-09-10T23:15:14.787001+0000","last_peered":"2024-09-10T23:15:14.787001+0000","last_clean":"2024-09-10T23:15:14.787001+0000","last_became_active":"2024-09-10T23:15:14.785505+0000","last_became_peered":"2024-09-10T23:15:14.785505+0000","last_unstale":"2024-09-10T23:15:14.787001+0000","last_undegraded":"2024-09-10T23:15:14.787001+0000","last_fullsized":"2024-09-10T23:15:14.787001+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:20.643452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.776632+0000","last_change":"2024-09-10T23:15:13.771804+0000","last_active":"2024-09-10T23:15:14.776632+0000","last_peered":"2024-09-10T23:15:14.776632+0000","last_clean":"2024-09-10T23:15:14.776632+0000","last_became_active":"2024-09-10T23:15:13.771498+0000","last_became_peered":"2024-09-10T23:15:13.771498+0000","last_unstale":"2024-09-10T23:15:14.776632+0000","last_undegraded":"2024-09-10T23:15:14.776632+0000","last_fullsized":"2024-09-10T23:15:14.776632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:20.145398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795063+0000","last_change":"2024-09-10T23:15:14.791708+0000","last_active":"2024-09-10T23:15:14.795063+0000","last_peered":"2024-09-10T23:15:14.795063+0000","last_clean":"2024-09-10T23:15:14.795063+0000","last_became_active":"2024-09-10T23:15:14.791412+0000","last_became_peered":"2024-09-10T23:15:14.791412+0000","last_unstale":"2024-09-10T23:15:14.795063+0000","last_undegraded":"2024-09-10T23:15:14.795063+0000","last_fullsized":"2024-09-10T23:15:14.795063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:09.924821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.754184+0000","last_change":"2024-09-10T23:15:12.754184+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.754184+0000","last_undegraded":"2024-09-10T23:15:12.754184+0000","last_fullsized":"2024-09-10T23:15:12.754184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.780069+0000","last_change":"2024-09-10T23:15:14.778395+0000","last_active":"2024-09-10T23:15:14.780069+0000","last_peered":"2024-09-10T23:15:14.780069+0000","last_clean":"2024-09-10T23:15:14.780069+0000","last_became_active":"2024-09-10T23:15:14.778134+0000","last_became_peered":"2024-09-10T23:15:14.778134+0000","last_unstale":"2024-09-10T23:15:14.780069+0000","last_undegraded":"2024-09-10T23:15:14.780069+0000","last_fullsized":"2024-09-10T23:15:14.780069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:22.766998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.775182+0000","last_change":"2024-09-10T23:15:13.772451+0000","last_active":"2024-09-10T23:15:14.775182+0000","last_peered":"2024-09-10T23:15:14.775182+0000","last_clean":"2024-09-10T23:15:14.775182+0000","last_became_active":"2024-09-10T23:15:13.772151+0000","last_became_peered":"2024-09-10T23:15:13.772151+0000","last_unstale":"2024-09-10T23:15:14.775182+0000","last_undegraded":"2024-09-10T23:15:14.775182+0000","last_fullsized":"2024-09-10T23:15:14.775182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:36.129380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.783151+0000","last_change":"2024-09-10T23:15:14.779020+0000","last_active":"2024-09-10T23:15:14.783151+0000","last_peered":"2024-09-10T23:15:14.783151+0000","last_clean":"2024-09-10T23:15:14.783151+0000","last_became_active":"2024-09-10T23:15:14.778786+0000","last_became_peered":"2024-09-10T23:15:14.778786+0000","last_unstale":"2024-09-10T23:15:14.783151+0000","last_undegraded":"2024-09-10T23:15:14.783151+0000","last_fullsized":"2024-09-10T23:15:14.783151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:52.746909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.775246+0000","last_change":"2024-09-10T23:15:13.772463+0000","last_active":"2024-09-10T23:15:14.775246+0000","last_peered":"2024-09-10T23:15:14.775246+0000","last_clean":"2024-09-10T23:15:14.775246+0000","last_became_active":"2024-09-10T23:15:13.772215+0000","last_became_peered":"2024-09-10T23:15:13.772215+0000","last_unstale":"2024-09-10T23:15:14.775246+0000","last_undegraded":"2024-09-10T23:15:14.775246+0000","last_fullsized":"2024-09-10T23:15:14.775246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:22.421760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.788707+0000","last_change":"2024-09-10T23:15:14.787638+0000","last_active":"2024-09-10T23:15:14.788707+0000","last_peered":"2024-09-10T23:15:14.788707+0000","last_clean":"2024-09-10T23:15:14.788707+0000","last_became_active":"2024-09-10T23:15:14.787332+0000","last_became_peered":"2024-09-10T23:15:14.787332+0000","last_unstale":"2024-09-10T23:15:14.788707+0000","last_undegraded":"2024-09-10T23:15:14.788707+0000","last_fullsized":"2024-09-10T23:15:14.788707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:40.651240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.770466+0000","last_change":"2024-09-10T23:15:13.772780+0000","last_active":"2024-09-10T23:15:14.770466+0000","last_peered":"2024-09-10T23:15:14.770466+0000","last_clean":"2024-09-10T23:15:14.770466+0000","last_became_active":"2024-09-10T23:15:13.770367+0000","last_became_peered":"2024-09-10T23:15:13.770367+0000","last_unstale":"2024-09-10T23:15:14.770466+0000","last_undegraded":"2024-09-10T23:15:14.770466+0000","last_fullsized":"2024-09-10T23:15:14.770466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:35.731410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.780074+0000","last_change":"2024-09-10T23:15:14.778452+0000","last_active":"2024-09-10T23:15:14.780074+0000","last_peered":"2024-09-10T23:15:14.780074+0000","last_clean":"2024-09-10T23:15:14.780074+0000","last_became_active":"2024-09-10T23:15:14.778193+0000","last_became_peered":"2024-09-10T23:15:14.778193+0000","last_unstale":"2024-09-10T23:15:14.780074+0000","last_undegraded":"2024-09-10T23:15:14.780074+0000","last_fullsized":"2024-09-10T23:15:14.780074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:09.145185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.795882+0000","last_change":"2024-09-10T23:15:13.769520+0000","last_active":"2024-09-10T23:15:14.795882+0000","last_peered":"2024-09-10T23:15:14.795882+0000","last_clean":"2024-09-10T23:15:14.795882+0000","last_became_active":"2024-09-10T23:15:13.769237+0000","last_became_peered":"2024-09-10T23:15:13.769237+0000","last_unstale":"2024-09-10T23:15:14.795882+0000","last_undegraded":"2024-09-10T23:15:14.795882+0000","last_fullsized":"2024-09-10T23:15:14.795882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:27.770813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.785637+0000","last_change":"2024-09-10T23:15:14.777929+0000","last_active":"2024-09-10T23:15:14.785637+0000","last_peered":"2024-09-10T23:15:14.785637+0000","last_clean":"2024-09-10T23:15:14.785637+0000","last_became_active":"2024-09-10T23:15:14.777655+0000","last_became_peered":"2024-09-10T23:15:14.777655+0000","last_unstale":"2024-09-10T23:15:14.785637+0000","last_undegraded":"2024-09-10T23:15:14.785637+0000","last_fullsized":"2024-09-10T23:15:14.785637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:01.426667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.753512+0000","last_change":"2024-09-10T23:15:12.753512+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.753512+0000","last_undegraded":"2024-09-10T23:15:12.753512+0000","last_fullsized":"2024-09-10T23:15:12.753512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:15:13.749502+0000","last_change":"2024-09-10T23:15:13.749502+0000","last_active":"2024-09-10T23:15:13.749502+0000","last_peered":"2024-09-10T23:15:13.749502+0000","last_clean":"2024-09-10T23:15:13.749502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:13.749502+0000","last_undegraded":"2024-09-10T23:15:13.749502+0000","last_fullsized":"2024-09-10T23:15:13.749502+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.770483+0000","last_change":"2024-09-10T23:15:13.765968+0000","last_active":"2024-09-10T23:15:14.770483+0000","last_peered":"2024-09-10T23:15:14.770483+0000","last_clean":"2024-09-10T23:15:14.770483+0000","last_became_active":"2024-09-10T23:15:13.765648+0000","last_became_peered":"2024-09-10T23:15:13.765648+0000","last_unstale":"2024-09-10T23:15:14.770483+0000","last_undegraded":"2024-09-10T23:15:14.770483+0000","last_fullsized":"2024-09-10T23:15:14.770483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:33.223107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786838+0000","last_change":"2024-09-10T23:15:14.784737+0000","last_active":"2024-09-10T23:15:14.786838+0000","last_peered":"2024-09-10T23:15:14.786838+0000","last_clean":"2024-09-10T23:15:14.786838+0000","last_became_active":"2024-09-10T23:15:14.784476+0000","last_became_peered":"2024-09-10T23:15:14.784476+0000","last_unstale":"2024-09-10T23:15:14.786838+0000","last_undegraded":"2024-09-10T23:15:14.786838+0000","last_fullsized":"2024-09-10T23:15:14.786838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:28.776268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T23:15:12.753410+0000","last_change":"2024-09-10T23:15:12.753410+0000","last_active":"2024-09-10T23:15:12.744046+0000","last_peered":"2024-09-10T23:15:12.744046+0000","last_clean":"2024-09-10T23:15:12.744046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:12.753410+0000","last_undegraded":"2024-09-10T23:15:12.753410+0000","last_fullsized":"2024-09-10T23:15:12.753410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:15:13.749502+0000","last_change":"2024-09-10T23:15:13.749502+0000","last_active":"2024-09-10T23:15:13.749502+0000","last_peered":"2024-09-10T23:15:13.749502+0000","last_clean":"2024-09-10T23:15:13.749502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:13.749502+0000","last_undegraded":"2024-09-10T23:15:13.749502+0000","last_fullsized":"2024-09-10T23:15:13.749502+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.769689+0000","last_change":"2024-09-10T23:15:13.769954+0000","last_active":"2024-09-10T23:15:14.769689+0000","last_peered":"2024-09-10T23:15:14.769689+0000","last_clean":"2024-09-10T23:15:14.769689+0000","last_became_active":"2024-09-10T23:15:13.769701+0000","last_became_peered":"2024-09-10T23:15:13.769701+0000","last_unstale":"2024-09-10T23:15:14.769689+0000","last_undegraded":"2024-09-10T23:15:14.769689+0000","last_fullsized":"2024-09-10T23:15:14.769689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:28.227215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.790292+0000","last_change":"2024-09-10T23:15:14.781851+0000","last_active":"2024-09-10T23:15:14.790292+0000","last_peered":"2024-09-10T23:15:14.790292+0000","last_clean":"2024-09-10T23:15:14.790292+0000","last_became_active":"2024-09-10T23:15:14.781580+0000","last_became_peered":"2024-09-10T23:15:14.781580+0000","last_unstale":"2024-09-10T23:15:14.790292+0000","last_undegraded":"2024-09-10T23:15:14.790292+0000","last_fullsized":"2024-09-10T23:15:14.790292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:26.578923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.775442+0000","last_change":"2024-09-10T23:15:13.774703+0000","last_active":"2024-09-10T23:15:14.775442+0000","last_peered":"2024-09-10T23:15:14.775442+0000","last_clean":"2024-09-10T23:15:14.775442+0000","last_became_active":"2024-09-10T23:15:13.774437+0000","last_became_peered":"2024-09-10T23:15:13.774437+0000","last_unstale":"2024-09-10T23:15:14.775442+0000","last_undegraded":"2024-09-10T23:15:14.775442+0000","last_fullsized":"2024-09-10T23:15:14.775442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:30.064030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.797066+0000","last_change":"2024-09-10T23:15:14.796113+0000","last_active":"2024-09-10T23:15:14.797066+0000","last_peered":"2024-09-10T23:15:14.797066+0000","last_clean":"2024-09-10T23:15:14.797066+0000","last_became_active":"2024-09-10T23:15:14.795826+0000","last_became_peered":"2024-09-10T23:15:14.795826+0000","last_unstale":"2024-09-10T23:15:14.797066+0000","last_undegraded":"2024-09-10T23:15:14.797066+0000","last_fullsized":"2024-09-10T23:15:14.797066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:34.564180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.772154+0000","last_change":"2024-09-10T23:15:13.772145+0000","last_active":"2024-09-10T23:15:14.772154+0000","last_peered":"2024-09-10T23:15:14.772154+0000","last_clean":"2024-09-10T23:15:14.772154+0000","last_became_active":"2024-09-10T23:15:13.771823+0000","last_became_peered":"2024-09-10T23:15:13.771823+0000","last_unstale":"2024-09-10T23:15:14.772154+0000","last_undegraded":"2024-09-10T23:15:14.772154+0000","last_fullsized":"2024-09-10T23:15:14.772154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:33.192200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.786802+0000","last_change":"2024-09-10T23:15:14.782850+0000","last_active":"2024-09-10T23:15:14.786802+0000","last_peered":"2024-09-10T23:15:14.786802+0000","last_clean":"2024-09-10T23:15:14.786802+0000","last_became_active":"2024-09-10T23:15:14.782571+0000","last_became_peered":"2024-09-10T23:15:14.782571+0000","last_unstale":"2024-09-10T23:15:14.786802+0000","last_undegraded":"2024-09-10T23:15:14.786802+0000","last_fullsized":"2024-09-10T23:15:14.786802+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:34.197656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.774786+0000","last_change":"2024-09-10T23:15:13.775030+0000","last_active":"2024-09-10T23:15:14.774786+0000","last_peered":"2024-09-10T23:15:14.774786+0000","last_clean":"2024-09-10T23:15:14.774786+0000","last_became_active":"2024-09-10T23:15:13.774722+0000","last_became_peered":"2024-09-10T23:15:13.774722+0000","last_unstale":"2024-09-10T23:15:14.774786+0000","last_undegraded":"2024-09-10T23:15:14.774786+0000","last_fullsized":"2024-09-10T23:15:14.774786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:37.882903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":128,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T23:15:14.770056+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:15:14.770056+0000","last_peered":"2024-09-10T23:15:14.770056+0000","last_clean":"2024-09-10T23:15:14.770056+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:15:14.770056+0000","last_undegraded":"2024-09-10T23:15:14.770056+0000","last_fullsized":"2024-09-10T23:15:14.770056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":962560,"data_stored":728585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":138743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":138799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":364544,"data_stored":138127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":352256,"data_stored":131352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":138197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":380928,"data_stored":139761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:15:19.747 INFO:tasks.ceph.mds.d.smithi171.stderr:2024-09-10T23:15:19.746+0000 7f63c18bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:15:22.305 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:15:22.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.418+0000 7f09e8bd3640 1 -- 172.21.15.90:0/4006679886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09d0004d40 msgr2=0x7f09d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:22.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.418+0000 7f09e8bd3640 1 --2- 172.21.15.90:0/4006679886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09d0004d40 0x7f09d00051c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00c640 tx=0x7f09d0005830 comp rx=0 tx=0).stop 2024-09-10T23:15:22.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.418+0000 7f09e2d9d640 1 -- 172.21.15.90:0/4006679886 reap_dead start 2024-09-10T23:15:22.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.418+0000 7f09e8bd3640 1 -- 172.21.15.90:0/4006679886 shutdown_connections 2024-09-10T23:15:22.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.418+0000 7f09e8bd3640 1 -- 172.21.15.90:0/4006679886 >> 172.21.15.90:0/4006679886 conn(0x7f09e40cc850 msgr2=0x7f09e40ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:22.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.418+0000 7f09e8bd3640 1 -- 172.21.15.90:0/4006679886 shutdown_connections 2024-09-10T23:15:22.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.418+0000 7f09e8bd3640 1 -- 172.21.15.90:0/4006679886 wait complete. 2024-09-10T23:15:22.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.419+0000 7f09e8bd3640 1 Processor -- start 2024-09-10T23:15:22.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.419+0000 7f09e8bd3640 1 -- start start 2024-09-10T23:15:22.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.420+0000 7f09e8bd3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09d0004d40 0x7f09e415a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:22.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.420+0000 7f09e8bd3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09e40cf500 0x7f09e40cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:22.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.420+0000 7f09e8bd3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09e40cdee0 0x7f09e40c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:22.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.420+0000 7f09e8bd3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f09e40b20e0 con 0x7f09d0004d40 2024-09-10T23:15:22.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.420+0000 7f09e8bd3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f09e40b1f60 con 0x7f09e40cf500 2024-09-10T23:15:22.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.420+0000 7f09e8bd3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f09e406f850 con 0x7f09e40cdee0 2024-09-10T23:15:22.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.420+0000 7f09e259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09d0004d40 0x7f09e415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:22.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.420+0000 7f09e259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09d0004d40 0x7f09e415a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37338/0 (socket says 172.21.15.90:37338) 2024-09-10T23:15:22.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.420+0000 7f09e259c640 1 -- 172.21.15.90:0/2985082107 learned_addr learned my addr 172.21.15.90:0/2985082107 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:22.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.420+0000 7f09e2d9d640 1 --2- 172.21.15.90:0/2985082107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09e40cdee0 0x7f09e40c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:22.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.420+0000 7f09e1d9b640 1 --2- 172.21.15.90:0/2985082107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09e40cf500 0x7f09e40cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:22.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.421+0000 7f09e259c640 1 -- 172.21.15.90:0/2985082107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09e40cdee0 msgr2=0x7f09e40c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:22.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.421+0000 7f09e259c640 1 --2- 172.21.15.90:0/2985082107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09e40cdee0 0x7f09e40c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:22.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.421+0000 7f09e259c640 1 -- 172.21.15.90:0/2985082107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09e40cf500 msgr2=0x7f09e40cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:22.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.421+0000 7f09e259c640 1 --2- 172.21.15.90:0/2985082107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09e40cf500 0x7f09e40cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:22.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.421+0000 7f09e259c640 1 -- 172.21.15.90:0/2985082107 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e40ce460 con 0x7f09d0004d40 2024-09-10T23:15:22.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.421+0000 7f09e2d9d640 1 --2- 172.21.15.90:0/2985082107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09e40cdee0 0x7f09e40c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:22.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.421+0000 7f09e1d9b640 1 --2- 172.21.15.90:0/2985082107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09e40cf500 0x7f09e40cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:22.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.421+0000 7f09e259c640 1 --2- 172.21.15.90:0/2985082107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09d0004d40 0x7f09e415a630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f09d4003ec0 tx=0x7f09d4001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:22.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.421+0000 7f09daffd640 1 -- 172.21.15.90:0/2985082107 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4015020 con 0x7f09d0004d40 2024-09-10T23:15:22.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.421+0000 7f09daffd640 1 -- 172.21.15.90:0/2985082107 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09d4011840 con 0x7f09d0004d40 2024-09-10T23:15:22.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.421+0000 7f09e8bd3640 1 -- 172.21.15.90:0/2985082107 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e40ce740 con 0x7f09d0004d40 2024-09-10T23:15:22.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.421+0000 7f09daffd640 1 -- 172.21.15.90:0/2985082107 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4011c50 con 0x7f09d0004d40 2024-09-10T23:15:22.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.421+0000 7f09e8bd3640 1 -- 172.21.15.90:0/2985082107 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e40ced00 con 0x7f09d0004d40 2024-09-10T23:15:22.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.422+0000 7f09e8bd3640 1 -- 172.21.15.90:0/2985082107 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09e40ca850 con 0x7f09d0004d40 2024-09-10T23:15:22.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.423+0000 7f09daffd640 1 -- 172.21.15.90:0/2985082107 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f09d401a400 con 0x7f09d0004d40 2024-09-10T23:15:22.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.423+0000 7f09daffd640 1 --2- 172.21.15.90:0/2985082107 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f09c4077fa0 0x7f09c407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:22.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.423+0000 7f09daffd640 1 -- 172.21.15.90:0/2985082107 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f09d409aa70 con 0x7f09d0004d40 2024-09-10T23:15:22.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.423+0000 7f09e1d9b640 1 --2- 172.21.15.90:0/2985082107 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f09c4077fa0 0x7f09c407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:22.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.424+0000 7f09e1d9b640 1 --2- 172.21.15.90:0/2985082107 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f09c4077fa0 0x7f09c407a460 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f09e40c63d0 tx=0x7f09cc005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:22.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.427+0000 7f09daffd640 1 -- 172.21.15.90:0/2985082107 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f09d401f020 con 0x7f09d0004d40 2024-09-10T23:15:22.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.602+0000 7f09e8bd3640 1 -- 172.21.15.90:0/2985082107 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09e40ccf70 con 0x7f09c4077fa0 2024-09-10T23:15:22.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.606+0000 7f09daffd640 1 -- 172.21.15.90:0/2985082107 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251912 (secure 0 0 0) 0x7f09e40ccf70 con 0x7f09c4077fa0 2024-09-10T23:15:22.610 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:22.612 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:15:22.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.609+0000 7f09e8bd3640 1 -- 172.21.15.90:0/2985082107 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f09c4077fa0 msgr2=0x7f09c407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:22.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.609+0000 7f09e8bd3640 1 --2- 172.21.15.90:0/2985082107 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f09c4077fa0 0x7f09c407a460 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f09e40c63d0 tx=0x7f09cc005f90 comp rx=0 tx=0).stop 2024-09-10T23:15:22.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.609+0000 7f09e8bd3640 1 -- 172.21.15.90:0/2985082107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09d0004d40 msgr2=0x7f09e415a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:22.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.609+0000 7f09e8bd3640 1 --2- 172.21.15.90:0/2985082107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09d0004d40 0x7f09e415a630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f09d4003ec0 tx=0x7f09d4001630 comp rx=0 tx=0).stop 2024-09-10T23:15:22.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.609+0000 7f09e8bd3640 1 -- 172.21.15.90:0/2985082107 shutdown_connections 2024-09-10T23:15:22.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.609+0000 7f09e8bd3640 1 --2- 172.21.15.90:0/2985082107 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f09c4077fa0 0x7f09c407a460 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:22.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.609+0000 7f09e8bd3640 1 --2- 172.21.15.90:0/2985082107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09e40cf500 0x7f09e40cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:22.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.609+0000 7f09e8bd3640 1 --2- 172.21.15.90:0/2985082107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09e40cdee0 0x7f09e40c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:22.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.609+0000 7f09e8bd3640 1 --2- 172.21.15.90:0/2985082107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09d0004d40 0x7f09e415a630 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:22.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.609+0000 7f09e8bd3640 1 -- 172.21.15.90:0/2985082107 >> 172.21.15.90:0/2985082107 conn(0x7f09e40cc850 msgr2=0x7f09e415b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:22.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.609+0000 7f09e8bd3640 1 -- 172.21.15.90:0/2985082107 shutdown_connections 2024-09-10T23:15:22.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.609+0000 7f09e8bd3640 1 -- 172.21.15.90:0/2985082107 wait complete. 2024-09-10T23:15:22.621 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-10T23:15:22.443608+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220412,"kb_used_data":4168,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754308,"statfs":{"total":773094113280,"available":772868411392,"internally_reserved":0,"allocated":4268032,"data_stored":2340972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001887"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.779699+0000","last_change":"2024-09-10T23:15:14.782590+0000","last_active":"2024-09-10T23:15:15.779699+0000","last_peered":"2024-09-10T23:15:15.779699+0000","last_clean":"2024-09-10T23:15:15.779699+0000","last_became_active":"2024-09-10T23:15:14.782279+0000","last_became_peered":"2024-09-10T23:15:14.782279+0000","last_unstale":"2024-09-10T23:15:15.779699+0000","last_undegraded":"2024-09-10T23:15:15.779699+0000","last_fullsized":"2024-09-10T23:15:15.779699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:20.582304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.777741+0000","last_change":"2024-09-10T23:15:14.784084+0000","last_active":"2024-09-10T23:15:15.777741+0000","last_peered":"2024-09-10T23:15:15.777741+0000","last_clean":"2024-09-10T23:15:15.777741+0000","last_became_active":"2024-09-10T23:15:14.783797+0000","last_became_peered":"2024-09-10T23:15:14.783797+0000","last_unstale":"2024-09-10T23:15:15.777741+0000","last_undegraded":"2024-09-10T23:15:15.777741+0000","last_fullsized":"2024-09-10T23:15:15.777741+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:02:35.357570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.779334+0000","last_change":"2024-09-10T23:15:14.777426+0000","last_active":"2024-09-10T23:15:15.779334+0000","last_peered":"2024-09-10T23:15:15.779334+0000","last_clean":"2024-09-10T23:15:15.779334+0000","last_became_active":"2024-09-10T23:15:14.777146+0000","last_became_peered":"2024-09-10T23:15:14.777146+0000","last_unstale":"2024-09-10T23:15:15.779334+0000","last_undegraded":"2024-09-10T23:15:15.779334+0000","last_fullsized":"2024-09-10T23:15:15.779334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:52.237251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.785253+0000","last_change":"2024-09-10T23:15:14.786653+0000","last_active":"2024-09-10T23:15:16.785253+0000","last_peered":"2024-09-10T23:15:16.785253+0000","last_clean":"2024-09-10T23:15:16.785253+0000","last_became_active":"2024-09-10T23:15:14.786388+0000","last_became_peered":"2024-09-10T23:15:14.786388+0000","last_unstale":"2024-09-10T23:15:16.785253+0000","last_undegraded":"2024-09-10T23:15:16.785253+0000","last_fullsized":"2024-09-10T23:15:16.785253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:25.168070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.027557+0000","last_change":"2024-09-10T23:15:14.777568+0000","last_active":"2024-09-10T23:15:17.027557+0000","last_peered":"2024-09-10T23:15:17.027557+0000","last_clean":"2024-09-10T23:15:17.027557+0000","last_became_active":"2024-09-10T23:15:14.777316+0000","last_became_peered":"2024-09-10T23:15:14.777316+0000","last_unstale":"2024-09-10T23:15:17.027557+0000","last_undegraded":"2024-09-10T23:15:17.027557+0000","last_fullsized":"2024-09-10T23:15:17.027557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:21.150853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.777264+0000","last_change":"2024-09-10T23:15:14.787768+0000","last_active":"2024-09-10T23:15:15.777264+0000","last_peered":"2024-09-10T23:15:15.777264+0000","last_clean":"2024-09-10T23:15:15.777264+0000","last_became_active":"2024-09-10T23:15:14.787494+0000","last_became_peered":"2024-09-10T23:15:14.787494+0000","last_unstale":"2024-09-10T23:15:15.777264+0000","last_undegraded":"2024-09-10T23:15:15.777264+0000","last_fullsized":"2024-09-10T23:15:15.777264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:52.237251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028533+0000","last_change":"2024-09-10T23:15:14.786512+0000","last_active":"2024-09-10T23:15:17.028533+0000","last_peered":"2024-09-10T23:15:17.028533+0000","last_clean":"2024-09-10T23:15:17.028533+0000","last_became_active":"2024-09-10T23:15:14.786226+0000","last_became_peered":"2024-09-10T23:15:14.786226+0000","last_unstale":"2024-09-10T23:15:17.028533+0000","last_undegraded":"2024-09-10T23:15:17.028533+0000","last_fullsized":"2024-09-10T23:15:17.028533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:13.803515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028044+0000","last_change":"2024-09-10T23:15:14.779115+0000","last_active":"2024-09-10T23:15:17.028044+0000","last_peered":"2024-09-10T23:15:17.028044+0000","last_clean":"2024-09-10T23:15:17.028044+0000","last_became_active":"2024-09-10T23:15:14.778811+0000","last_became_peered":"2024-09-10T23:15:14.778811+0000","last_unstale":"2024-09-10T23:15:17.028044+0000","last_undegraded":"2024-09-10T23:15:17.028044+0000","last_fullsized":"2024-09-10T23:15:17.028044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:13.712965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.029272+0000","last_change":"2024-09-10T23:15:14.784909+0000","last_active":"2024-09-10T23:15:17.029272+0000","last_peered":"2024-09-10T23:15:17.029272+0000","last_clean":"2024-09-10T23:15:17.029272+0000","last_became_active":"2024-09-10T23:15:14.784511+0000","last_became_peered":"2024-09-10T23:15:14.784511+0000","last_unstale":"2024-09-10T23:15:17.029272+0000","last_undegraded":"2024-09-10T23:15:17.029272+0000","last_fullsized":"2024-09-10T23:15:17.029272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:32.060450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.785270+0000","last_change":"2024-09-10T23:15:14.785521+0000","last_active":"2024-09-10T23:15:16.785270+0000","last_peered":"2024-09-10T23:15:16.785270+0000","last_clean":"2024-09-10T23:15:16.785270+0000","last_became_active":"2024-09-10T23:15:14.785042+0000","last_became_peered":"2024-09-10T23:15:14.785042+0000","last_unstale":"2024-09-10T23:15:16.785270+0000","last_undegraded":"2024-09-10T23:15:16.785270+0000","last_fullsized":"2024-09-10T23:15:16.785270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:26.578923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.029024+0000","last_change":"2024-09-10T23:15:14.783123+0000","last_active":"2024-09-10T23:15:17.029024+0000","last_peered":"2024-09-10T23:15:17.029024+0000","last_clean":"2024-09-10T23:15:17.029024+0000","last_became_active":"2024-09-10T23:15:14.782839+0000","last_became_peered":"2024-09-10T23:15:14.782839+0000","last_unstale":"2024-09-10T23:15:17.029024+0000","last_undegraded":"2024-09-10T23:15:17.029024+0000","last_fullsized":"2024-09-10T23:15:17.029024+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:32.887880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.779112+0000","last_change":"2024-09-10T23:15:14.780626+0000","last_active":"2024-09-10T23:15:15.779112+0000","last_peered":"2024-09-10T23:15:15.779112+0000","last_clean":"2024-09-10T23:15:15.779112+0000","last_became_active":"2024-09-10T23:15:14.780319+0000","last_became_peered":"2024-09-10T23:15:14.780319+0000","last_unstale":"2024-09-10T23:15:15.779112+0000","last_undegraded":"2024-09-10T23:15:15.779112+0000","last_fullsized":"2024-09-10T23:15:15.779112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:21.251683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.027527+0000","last_change":"2024-09-10T23:15:14.775829+0000","last_active":"2024-09-10T23:15:17.027527+0000","last_peered":"2024-09-10T23:15:17.027527+0000","last_clean":"2024-09-10T23:15:17.027527+0000","last_became_active":"2024-09-10T23:15:14.775197+0000","last_became_peered":"2024-09-10T23:15:14.775197+0000","last_unstale":"2024-09-10T23:15:17.027527+0000","last_undegraded":"2024-09-10T23:15:17.027527+0000","last_fullsized":"2024-09-10T23:15:17.027527+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:32.573990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.777269+0000","last_change":"2024-09-10T23:15:14.776541+0000","last_active":"2024-09-10T23:15:15.777269+0000","last_peered":"2024-09-10T23:15:15.777269+0000","last_clean":"2024-09-10T23:15:15.777269+0000","last_became_active":"2024-09-10T23:15:14.776297+0000","last_became_peered":"2024-09-10T23:15:14.776297+0000","last_unstale":"2024-09-10T23:15:15.777269+0000","last_undegraded":"2024-09-10T23:15:15.777269+0000","last_fullsized":"2024-09-10T23:15:15.777269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:28.084465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.778739+0000","last_change":"2024-09-10T23:15:14.784278+0000","last_active":"2024-09-10T23:15:15.778739+0000","last_peered":"2024-09-10T23:15:15.778739+0000","last_clean":"2024-09-10T23:15:15.778739+0000","last_became_active":"2024-09-10T23:15:14.784023+0000","last_became_peered":"2024-09-10T23:15:14.784023+0000","last_unstale":"2024-09-10T23:15:15.778739+0000","last_undegraded":"2024-09-10T23:15:15.778739+0000","last_fullsized":"2024-09-10T23:15:15.778739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:51.822103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028603+0000","last_change":"2024-09-10T23:15:14.778174+0000","last_active":"2024-09-10T23:15:17.028603+0000","last_peered":"2024-09-10T23:15:17.028603+0000","last_clean":"2024-09-10T23:15:17.028603+0000","last_became_active":"2024-09-10T23:15:14.777911+0000","last_became_peered":"2024-09-10T23:15:14.777911+0000","last_unstale":"2024-09-10T23:15:17.028603+0000","last_undegraded":"2024-09-10T23:15:17.028603+0000","last_fullsized":"2024-09-10T23:15:17.028603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:56:39.914436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.029340+0000","last_change":"2024-09-10T23:15:14.784036+0000","last_active":"2024-09-10T23:15:17.029340+0000","last_peered":"2024-09-10T23:15:17.029340+0000","last_clean":"2024-09-10T23:15:17.029340+0000","last_became_active":"2024-09-10T23:15:14.783780+0000","last_became_peered":"2024-09-10T23:15:14.783780+0000","last_unstale":"2024-09-10T23:15:17.029340+0000","last_undegraded":"2024-09-10T23:15:17.029340+0000","last_fullsized":"2024-09-10T23:15:17.029340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:13.336940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.777818+0000","last_change":"2024-09-10T23:15:14.782310+0000","last_active":"2024-09-10T23:15:15.777818+0000","last_peered":"2024-09-10T23:15:15.777818+0000","last_clean":"2024-09-10T23:15:15.777818+0000","last_became_active":"2024-09-10T23:15:14.782047+0000","last_became_peered":"2024-09-10T23:15:14.782047+0000","last_unstale":"2024-09-10T23:15:15.777818+0000","last_undegraded":"2024-09-10T23:15:15.777818+0000","last_fullsized":"2024-09-10T23:15:15.777818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:07.877992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.777549+0000","last_change":"2024-09-10T23:15:14.776242+0000","last_active":"2024-09-10T23:15:15.777549+0000","last_peered":"2024-09-10T23:15:15.777549+0000","last_clean":"2024-09-10T23:15:15.777549+0000","last_became_active":"2024-09-10T23:15:14.776016+0000","last_became_peered":"2024-09-10T23:15:14.776016+0000","last_unstale":"2024-09-10T23:15:15.777549+0000","last_undegraded":"2024-09-10T23:15:15.777549+0000","last_fullsized":"2024-09-10T23:15:15.777549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:53.803235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.027666+0000","last_change":"2024-09-10T23:15:14.773759+0000","last_active":"2024-09-10T23:15:17.027666+0000","last_peered":"2024-09-10T23:15:17.027666+0000","last_clean":"2024-09-10T23:15:17.027666+0000","last_became_active":"2024-09-10T23:15:14.773146+0000","last_became_peered":"2024-09-10T23:15:14.773146+0000","last_unstale":"2024-09-10T23:15:17.027666+0000","last_undegraded":"2024-09-10T23:15:17.027666+0000","last_fullsized":"2024-09-10T23:15:17.027666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:29.232671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028588+0000","last_change":"2024-09-10T23:15:14.790230+0000","last_active":"2024-09-10T23:15:17.028588+0000","last_peered":"2024-09-10T23:15:17.028588+0000","last_clean":"2024-09-10T23:15:17.028588+0000","last_became_active":"2024-09-10T23:15:14.785734+0000","last_became_peered":"2024-09-10T23:15:14.785734+0000","last_unstale":"2024-09-10T23:15:17.028588+0000","last_undegraded":"2024-09-10T23:15:17.028588+0000","last_fullsized":"2024-09-10T23:15:17.028588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:34.342604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.029066+0000","last_change":"2024-09-10T23:15:14.796057+0000","last_active":"2024-09-10T23:15:17.029066+0000","last_peered":"2024-09-10T23:15:17.029066+0000","last_clean":"2024-09-10T23:15:17.029066+0000","last_became_active":"2024-09-10T23:15:14.795690+0000","last_became_peered":"2024-09-10T23:15:14.795690+0000","last_unstale":"2024-09-10T23:15:17.029066+0000","last_undegraded":"2024-09-10T23:15:17.029066+0000","last_fullsized":"2024-09-10T23:15:17.029066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:25.168070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.781555+0000","last_change":"2024-09-10T23:15:14.778165+0000","last_active":"2024-09-10T23:15:16.781555+0000","last_peered":"2024-09-10T23:15:16.781555+0000","last_clean":"2024-09-10T23:15:16.781555+0000","last_became_active":"2024-09-10T23:15:14.777809+0000","last_became_peered":"2024-09-10T23:15:14.777809+0000","last_unstale":"2024-09-10T23:15:16.781555+0000","last_undegraded":"2024-09-10T23:15:16.781555+0000","last_fullsized":"2024-09-10T23:15:16.781555+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:26.676107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.778392+0000","last_change":"2024-09-10T23:15:14.775294+0000","last_active":"2024-09-10T23:15:15.778392+0000","last_peered":"2024-09-10T23:15:15.778392+0000","last_clean":"2024-09-10T23:15:15.778392+0000","last_became_active":"2024-09-10T23:15:14.775007+0000","last_became_peered":"2024-09-10T23:15:14.775007+0000","last_unstale":"2024-09-10T23:15:15.778392+0000","last_undegraded":"2024-09-10T23:15:15.778392+0000","last_fullsized":"2024-09-10T23:15:15.778392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:05.732071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.785340+0000","last_change":"2024-09-10T23:15:14.790930+0000","last_active":"2024-09-10T23:15:16.785340+0000","last_peered":"2024-09-10T23:15:16.785340+0000","last_clean":"2024-09-10T23:15:16.785340+0000","last_became_active":"2024-09-10T23:15:14.790611+0000","last_became_peered":"2024-09-10T23:15:14.790611+0000","last_unstale":"2024-09-10T23:15:16.785340+0000","last_undegraded":"2024-09-10T23:15:16.785340+0000","last_fullsized":"2024-09-10T23:15:16.785340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:32.060450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.777950+0000","last_change":"2024-09-10T23:15:14.785099+0000","last_active":"2024-09-10T23:15:15.777950+0000","last_peered":"2024-09-10T23:15:15.777950+0000","last_clean":"2024-09-10T23:15:15.777950+0000","last_became_active":"2024-09-10T23:15:14.784771+0000","last_became_peered":"2024-09-10T23:15:14.784771+0000","last_unstale":"2024-09-10T23:15:15.777950+0000","last_undegraded":"2024-09-10T23:15:15.777950+0000","last_fullsized":"2024-09-10T23:15:15.777950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:04.052552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.785424+0000","last_change":"2024-09-10T23:15:14.793856+0000","last_active":"2024-09-10T23:15:16.785424+0000","last_peered":"2024-09-10T23:15:16.785424+0000","last_clean":"2024-09-10T23:15:16.785424+0000","last_became_active":"2024-09-10T23:15:14.793367+0000","last_became_peered":"2024-09-10T23:15:14.793367+0000","last_unstale":"2024-09-10T23:15:16.785424+0000","last_undegraded":"2024-09-10T23:15:16.785424+0000","last_fullsized":"2024-09-10T23:15:16.785424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:16.561866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.779344+0000","last_change":"2024-09-10T23:15:14.785755+0000","last_active":"2024-09-10T23:15:15.779344+0000","last_peered":"2024-09-10T23:15:15.779344+0000","last_clean":"2024-09-10T23:15:15.779344+0000","last_became_active":"2024-09-10T23:15:14.782572+0000","last_became_peered":"2024-09-10T23:15:14.782572+0000","last_unstale":"2024-09-10T23:15:15.779344+0000","last_undegraded":"2024-09-10T23:15:15.779344+0000","last_fullsized":"2024-09-10T23:15:15.779344+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:53.355361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028697+0000","last_change":"2024-09-10T23:15:14.796654+0000","last_active":"2024-09-10T23:15:17.028697+0000","last_peered":"2024-09-10T23:15:17.028697+0000","last_clean":"2024-09-10T23:15:17.028697+0000","last_became_active":"2024-09-10T23:15:14.796438+0000","last_became_peered":"2024-09-10T23:15:14.796438+0000","last_unstale":"2024-09-10T23:15:17.028697+0000","last_undegraded":"2024-09-10T23:15:17.028697+0000","last_fullsized":"2024-09-10T23:15:17.028697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:18.746412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028406+0000","last_change":"2024-09-10T23:15:14.785696+0000","last_active":"2024-09-10T23:15:17.028406+0000","last_peered":"2024-09-10T23:15:17.028406+0000","last_clean":"2024-09-10T23:15:17.028406+0000","last_became_active":"2024-09-10T23:15:14.785439+0000","last_became_peered":"2024-09-10T23:15:14.785439+0000","last_unstale":"2024-09-10T23:15:17.028406+0000","last_undegraded":"2024-09-10T23:15:17.028406+0000","last_fullsized":"2024-09-10T23:15:17.028406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:48.806325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.778944+0000","last_change":"2024-09-10T23:15:14.784069+0000","last_active":"2024-09-10T23:15:15.778944+0000","last_peered":"2024-09-10T23:15:15.778944+0000","last_clean":"2024-09-10T23:15:15.778944+0000","last_became_active":"2024-09-10T23:15:14.783809+0000","last_became_peered":"2024-09-10T23:15:14.783809+0000","last_unstale":"2024-09-10T23:15:15.778944+0000","last_undegraded":"2024-09-10T23:15:15.778944+0000","last_fullsized":"2024-09-10T23:15:15.778944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:20.633732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028060+0000","last_change":"2024-09-10T23:15:14.792638+0000","last_active":"2024-09-10T23:15:17.028060+0000","last_peered":"2024-09-10T23:15:17.028060+0000","last_clean":"2024-09-10T23:15:17.028060+0000","last_became_active":"2024-09-10T23:15:14.792122+0000","last_became_peered":"2024-09-10T23:15:14.792122+0000","last_unstale":"2024-09-10T23:15:17.028060+0000","last_undegraded":"2024-09-10T23:15:17.028060+0000","last_fullsized":"2024-09-10T23:15:17.028060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:21.312811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.781762+0000","last_change":"2024-09-10T23:15:14.777085+0000","last_active":"2024-09-10T23:15:16.781762+0000","last_peered":"2024-09-10T23:15:16.781762+0000","last_clean":"2024-09-10T23:15:16.781762+0000","last_became_active":"2024-09-10T23:15:14.776806+0000","last_became_peered":"2024-09-10T23:15:14.776806+0000","last_unstale":"2024-09-10T23:15:16.781762+0000","last_undegraded":"2024-09-10T23:15:16.781762+0000","last_fullsized":"2024-09-10T23:15:16.781762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:58.245609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.779394+0000","last_change":"2024-09-10T23:15:13.778953+0000","last_active":"2024-09-10T23:15:15.779394+0000","last_peered":"2024-09-10T23:15:15.779394+0000","last_clean":"2024-09-10T23:15:15.779394+0000","last_became_active":"2024-09-10T23:15:13.778585+0000","last_became_peered":"2024-09-10T23:15:13.778585+0000","last_unstale":"2024-09-10T23:15:15.779394+0000","last_undegraded":"2024-09-10T23:15:15.779394+0000","last_fullsized":"2024-09-10T23:15:15.779394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:04.980386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.779210+0000","last_change":"2024-09-10T23:15:14.793437+0000","last_active":"2024-09-10T23:15:15.779210+0000","last_peered":"2024-09-10T23:15:15.779210+0000","last_clean":"2024-09-10T23:15:15.779210+0000","last_became_active":"2024-09-10T23:15:14.792867+0000","last_became_peered":"2024-09-10T23:15:14.792867+0000","last_unstale":"2024-09-10T23:15:15.779210+0000","last_undegraded":"2024-09-10T23:15:15.779210+0000","last_fullsized":"2024-09-10T23:15:15.779210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:36.736865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.781594+0000","last_change":"2024-09-10T23:15:13.771801+0000","last_active":"2024-09-10T23:15:16.781594+0000","last_peered":"2024-09-10T23:15:16.781594+0000","last_clean":"2024-09-10T23:15:16.781594+0000","last_became_active":"2024-09-10T23:15:13.771534+0000","last_became_peered":"2024-09-10T23:15:13.771534+0000","last_unstale":"2024-09-10T23:15:16.781594+0000","last_undegraded":"2024-09-10T23:15:16.781594+0000","last_fullsized":"2024-09-10T23:15:16.781594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:01.259596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028583+0000","last_change":"2024-09-10T23:15:14.797080+0000","last_active":"2024-09-10T23:15:17.028583+0000","last_peered":"2024-09-10T23:15:17.028583+0000","last_clean":"2024-09-10T23:15:17.028583+0000","last_became_active":"2024-09-10T23:15:14.796799+0000","last_became_peered":"2024-09-10T23:15:14.796799+0000","last_unstale":"2024-09-10T23:15:17.028583+0000","last_undegraded":"2024-09-10T23:15:17.028583+0000","last_fullsized":"2024-09-10T23:15:17.028583+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:37.902288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.777513+0000","last_change":"2024-09-10T23:15:13.767284+0000","last_active":"2024-09-10T23:15:15.777513+0000","last_peered":"2024-09-10T23:15:15.777513+0000","last_clean":"2024-09-10T23:15:15.777513+0000","last_became_active":"2024-09-10T23:15:13.766807+0000","last_became_peered":"2024-09-10T23:15:13.766807+0000","last_unstale":"2024-09-10T23:15:15.777513+0000","last_undegraded":"2024-09-10T23:15:15.777513+0000","last_fullsized":"2024-09-10T23:15:15.777513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:19.628277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.785482+0000","last_change":"2024-09-10T23:15:14.793249+0000","last_active":"2024-09-10T23:15:16.785482+0000","last_peered":"2024-09-10T23:15:16.785482+0000","last_clean":"2024-09-10T23:15:16.785482+0000","last_became_active":"2024-09-10T23:15:14.792976+0000","last_became_peered":"2024-09-10T23:15:14.792976+0000","last_unstale":"2024-09-10T23:15:16.785482+0000","last_undegraded":"2024-09-10T23:15:16.785482+0000","last_fullsized":"2024-09-10T23:15:16.785482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:26.403088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.027822+0000","last_change":"2024-09-10T23:15:13.769588+0000","last_active":"2024-09-10T23:15:17.027822+0000","last_peered":"2024-09-10T23:15:17.027822+0000","last_clean":"2024-09-10T23:15:17.027822+0000","last_became_active":"2024-09-10T23:15:13.769325+0000","last_became_peered":"2024-09-10T23:15:13.769325+0000","last_unstale":"2024-09-10T23:15:17.027822+0000","last_undegraded":"2024-09-10T23:15:17.027822+0000","last_fullsized":"2024-09-10T23:15:17.027822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:48.670108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028313+0000","last_change":"2024-09-10T23:15:14.791220+0000","last_active":"2024-09-10T23:15:17.028313+0000","last_peered":"2024-09-10T23:15:17.028313+0000","last_clean":"2024-09-10T23:15:17.028313+0000","last_became_active":"2024-09-10T23:15:14.790957+0000","last_became_peered":"2024-09-10T23:15:14.790957+0000","last_unstale":"2024-09-10T23:15:17.028313+0000","last_undegraded":"2024-09-10T23:15:17.028313+0000","last_fullsized":"2024-09-10T23:15:17.028313+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:28.084465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028879+0000","last_change":"2024-09-10T23:15:13.768504+0000","last_active":"2024-09-10T23:15:17.028879+0000","last_peered":"2024-09-10T23:15:17.028879+0000","last_clean":"2024-09-10T23:15:17.028879+0000","last_became_active":"2024-09-10T23:15:13.768242+0000","last_became_peered":"2024-09-10T23:15:13.768242+0000","last_unstale":"2024-09-10T23:15:17.028879+0000","last_undegraded":"2024-09-10T23:15:17.028879+0000","last_fullsized":"2024-09-10T23:15:17.028879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:50.630257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.778945+0000","last_change":"2024-09-10T23:15:14.783536+0000","last_active":"2024-09-10T23:15:15.778945+0000","last_peered":"2024-09-10T23:15:15.778945+0000","last_clean":"2024-09-10T23:15:15.778945+0000","last_became_active":"2024-09-10T23:15:14.783266+0000","last_became_peered":"2024-09-10T23:15:14.783266+0000","last_unstale":"2024-09-10T23:15:15.778945+0000","last_undegraded":"2024-09-10T23:15:15.778945+0000","last_fullsized":"2024-09-10T23:15:15.778945+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:57.702941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.029242+0000","last_change":"2024-09-10T23:15:13.771424+0000","last_active":"2024-09-10T23:15:17.029242+0000","last_peered":"2024-09-10T23:15:17.029242+0000","last_clean":"2024-09-10T23:15:17.029242+0000","last_became_active":"2024-09-10T23:15:13.771113+0000","last_became_peered":"2024-09-10T23:15:13.771113+0000","last_unstale":"2024-09-10T23:15:17.029242+0000","last_undegraded":"2024-09-10T23:15:17.029242+0000","last_fullsized":"2024-09-10T23:15:17.029242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:41.926490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.029084+0000","last_change":"2024-09-10T23:15:14.792338+0000","last_active":"2024-09-10T23:15:17.029084+0000","last_peered":"2024-09-10T23:15:17.029084+0000","last_clean":"2024-09-10T23:15:17.029084+0000","last_became_active":"2024-09-10T23:15:14.792063+0000","last_became_peered":"2024-09-10T23:15:14.792063+0000","last_unstale":"2024-09-10T23:15:17.029084+0000","last_undegraded":"2024-09-10T23:15:17.029084+0000","last_fullsized":"2024-09-10T23:15:17.029084+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:48.739613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.777019+0000","last_change":"2024-09-10T23:15:13.765543+0000","last_active":"2024-09-10T23:15:15.777019+0000","last_peered":"2024-09-10T23:15:15.777019+0000","last_clean":"2024-09-10T23:15:15.777019+0000","last_became_active":"2024-09-10T23:15:13.765131+0000","last_became_peered":"2024-09-10T23:15:13.765131+0000","last_unstale":"2024-09-10T23:15:15.777019+0000","last_undegraded":"2024-09-10T23:15:15.777019+0000","last_fullsized":"2024-09-10T23:15:15.777019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:33.558724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.785010+0000","last_change":"2024-09-10T23:15:14.787696+0000","last_active":"2024-09-10T23:15:16.785010+0000","last_peered":"2024-09-10T23:15:16.785010+0000","last_clean":"2024-09-10T23:15:16.785010+0000","last_became_active":"2024-09-10T23:15:14.787375+0000","last_became_peered":"2024-09-10T23:15:14.787375+0000","last_unstale":"2024-09-10T23:15:16.785010+0000","last_undegraded":"2024-09-10T23:15:16.785010+0000","last_fullsized":"2024-09-10T23:15:16.785010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:34.342604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.029275+0000","last_change":"2024-09-10T23:15:13.773878+0000","last_active":"2024-09-10T23:15:17.029275+0000","last_peered":"2024-09-10T23:15:17.029275+0000","last_clean":"2024-09-10T23:15:17.029275+0000","last_became_active":"2024-09-10T23:15:13.773575+0000","last_became_peered":"2024-09-10T23:15:13.773575+0000","last_unstale":"2024-09-10T23:15:17.029275+0000","last_undegraded":"2024-09-10T23:15:17.029275+0000","last_fullsized":"2024-09-10T23:15:17.029275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:45.659964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.779044+0000","last_change":"2024-09-10T23:15:14.780963+0000","last_active":"2024-09-10T23:15:15.779044+0000","last_peered":"2024-09-10T23:15:15.779044+0000","last_clean":"2024-09-10T23:15:15.779044+0000","last_became_active":"2024-09-10T23:15:14.780623+0000","last_became_peered":"2024-09-10T23:15:14.780623+0000","last_unstale":"2024-09-10T23:15:15.779044+0000","last_undegraded":"2024-09-10T23:15:15.779044+0000","last_fullsized":"2024-09-10T23:15:15.779044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:20.690304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.777771+0000","last_change":"2024-09-10T23:15:13.772352+0000","last_active":"2024-09-10T23:15:15.777771+0000","last_peered":"2024-09-10T23:15:15.777771+0000","last_clean":"2024-09-10T23:15:15.777771+0000","last_became_active":"2024-09-10T23:15:13.772076+0000","last_became_peered":"2024-09-10T23:15:13.772076+0000","last_unstale":"2024-09-10T23:15:15.777771+0000","last_undegraded":"2024-09-10T23:15:15.777771+0000","last_fullsized":"2024-09-10T23:15:15.777771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:35.731410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.777729+0000","last_change":"2024-09-10T23:15:14.783374+0000","last_active":"2024-09-10T23:15:15.777729+0000","last_peered":"2024-09-10T23:15:15.777729+0000","last_clean":"2024-09-10T23:15:15.777729+0000","last_became_active":"2024-09-10T23:15:14.783108+0000","last_became_peered":"2024-09-10T23:15:14.783108+0000","last_unstale":"2024-09-10T23:15:15.777729+0000","last_undegraded":"2024-09-10T23:15:15.777729+0000","last_fullsized":"2024-09-10T23:15:15.777729+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:00.507518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.781710+0000","last_change":"2024-09-10T23:15:13.769458+0000","last_active":"2024-09-10T23:15:16.781710+0000","last_peered":"2024-09-10T23:15:16.781710+0000","last_clean":"2024-09-10T23:15:16.781710+0000","last_became_active":"2024-09-10T23:15:13.769155+0000","last_became_peered":"2024-09-10T23:15:13.769155+0000","last_unstale":"2024-09-10T23:15:16.781710+0000","last_undegraded":"2024-09-10T23:15:16.781710+0000","last_fullsized":"2024-09-10T23:15:16.781710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:10.168363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.777559+0000","last_change":"2024-09-10T23:15:14.793078+0000","last_active":"2024-09-10T23:15:15.777559+0000","last_peered":"2024-09-10T23:15:15.777559+0000","last_clean":"2024-09-10T23:15:15.777559+0000","last_became_active":"2024-09-10T23:15:14.792740+0000","last_became_peered":"2024-09-10T23:15:14.792740+0000","last_unstale":"2024-09-10T23:15:15.777559+0000","last_undegraded":"2024-09-10T23:15:15.777559+0000","last_fullsized":"2024-09-10T23:15:15.777559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:41.653041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.779408+0000","last_change":"2024-09-10T23:15:13.770511+0000","last_active":"2024-09-10T23:15:15.779408+0000","last_peered":"2024-09-10T23:15:15.779408+0000","last_clean":"2024-09-10T23:15:15.779408+0000","last_became_active":"2024-09-10T23:15:13.770081+0000","last_became_peered":"2024-09-10T23:15:13.770081+0000","last_unstale":"2024-09-10T23:15:15.779408+0000","last_undegraded":"2024-09-10T23:15:15.779408+0000","last_fullsized":"2024-09-10T23:15:15.779408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:33.558724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.778527+0000","last_change":"2024-09-10T23:15:14.777889+0000","last_active":"2024-09-10T23:15:15.778527+0000","last_peered":"2024-09-10T23:15:15.778527+0000","last_clean":"2024-09-10T23:15:15.778527+0000","last_became_active":"2024-09-10T23:15:14.777600+0000","last_became_peered":"2024-09-10T23:15:14.777600+0000","last_unstale":"2024-09-10T23:15:15.778527+0000","last_undegraded":"2024-09-10T23:15:15.778527+0000","last_fullsized":"2024-09-10T23:15:15.778527+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:14.428600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.777531+0000","last_change":"2024-09-10T23:15:13.766440+0000","last_active":"2024-09-10T23:15:15.777531+0000","last_peered":"2024-09-10T23:15:15.777531+0000","last_clean":"2024-09-10T23:15:15.777531+0000","last_became_active":"2024-09-10T23:15:13.765980+0000","last_became_peered":"2024-09-10T23:15:13.765980+0000","last_unstale":"2024-09-10T23:15:15.777531+0000","last_undegraded":"2024-09-10T23:15:15.777531+0000","last_fullsized":"2024-09-10T23:15:15.777531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:00.421211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.784998+0000","last_change":"2024-09-10T23:15:14.786936+0000","last_active":"2024-09-10T23:15:16.784998+0000","last_peered":"2024-09-10T23:15:16.784998+0000","last_clean":"2024-09-10T23:15:16.784998+0000","last_became_active":"2024-09-10T23:15:14.786650+0000","last_became_peered":"2024-09-10T23:15:14.786650+0000","last_unstale":"2024-09-10T23:15:16.784998+0000","last_undegraded":"2024-09-10T23:15:16.784998+0000","last_fullsized":"2024-09-10T23:15:16.784998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:41.599007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028952+0000","last_change":"2024-09-10T23:15:13.773637+0000","last_active":"2024-09-10T23:15:17.028952+0000","last_peered":"2024-09-10T23:15:17.028952+0000","last_clean":"2024-09-10T23:15:17.028952+0000","last_became_active":"2024-09-10T23:15:13.773364+0000","last_became_peered":"2024-09-10T23:15:13.773364+0000","last_unstale":"2024-09-10T23:15:17.028952+0000","last_undegraded":"2024-09-10T23:15:17.028952+0000","last_fullsized":"2024-09-10T23:15:17.028952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:54.026868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.777274+0000","last_change":"2024-09-10T23:15:14.782668+0000","last_active":"2024-09-10T23:15:15.777274+0000","last_peered":"2024-09-10T23:15:15.777274+0000","last_clean":"2024-09-10T23:15:15.777274+0000","last_became_active":"2024-09-10T23:15:14.782405+0000","last_became_peered":"2024-09-10T23:15:14.782405+0000","last_unstale":"2024-09-10T23:15:15.777274+0000","last_undegraded":"2024-09-10T23:15:15.777274+0000","last_fullsized":"2024-09-10T23:15:15.777274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:02.633883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.785000+0000","last_change":"2024-09-10T23:15:13.773432+0000","last_active":"2024-09-10T23:15:16.785000+0000","last_peered":"2024-09-10T23:15:16.785000+0000","last_clean":"2024-09-10T23:15:16.785000+0000","last_became_active":"2024-09-10T23:15:13.773136+0000","last_became_peered":"2024-09-10T23:15:13.773136+0000","last_unstale":"2024-09-10T23:15:16.785000+0000","last_undegraded":"2024-09-10T23:15:16.785000+0000","last_fullsized":"2024-09-10T23:15:16.785000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:04.980386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028277+0000","last_change":"2024-09-10T23:15:14.792375+0000","last_active":"2024-09-10T23:15:17.028277+0000","last_peered":"2024-09-10T23:15:17.028277+0000","last_clean":"2024-09-10T23:15:17.028277+0000","last_became_active":"2024-09-10T23:15:14.791810+0000","last_became_peered":"2024-09-10T23:15:14.791810+0000","last_unstale":"2024-09-10T23:15:17.028277+0000","last_undegraded":"2024-09-10T23:15:17.028277+0000","last_fullsized":"2024-09-10T23:15:17.028277+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:20.690304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.777102+0000","last_change":"2024-09-10T23:15:13.771529+0000","last_active":"2024-09-10T23:15:15.777102+0000","last_peered":"2024-09-10T23:15:15.777102+0000","last_clean":"2024-09-10T23:15:15.777102+0000","last_became_active":"2024-09-10T23:15:13.771101+0000","last_became_peered":"2024-09-10T23:15:13.771101+0000","last_unstale":"2024-09-10T23:15:15.777102+0000","last_undegraded":"2024-09-10T23:15:15.777102+0000","last_fullsized":"2024-09-10T23:15:15.777102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:19.576849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.779163+0000","last_change":"2024-09-10T23:15:14.793264+0000","last_active":"2024-09-10T23:15:15.779163+0000","last_peered":"2024-09-10T23:15:15.779163+0000","last_clean":"2024-09-10T23:15:15.779163+0000","last_became_active":"2024-09-10T23:15:14.792985+0000","last_became_peered":"2024-09-10T23:15:14.792985+0000","last_unstale":"2024-09-10T23:15:15.779163+0000","last_undegraded":"2024-09-10T23:15:15.779163+0000","last_fullsized":"2024-09-10T23:15:15.779163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:34.564180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.777052+0000","last_change":"2024-09-10T23:15:13.764689+0000","last_active":"2024-09-10T23:15:15.777052+0000","last_peered":"2024-09-10T23:15:15.777052+0000","last_clean":"2024-09-10T23:15:15.777052+0000","last_became_active":"2024-09-10T23:15:13.764433+0000","last_became_peered":"2024-09-10T23:15:13.764433+0000","last_unstale":"2024-09-10T23:15:15.777052+0000","last_undegraded":"2024-09-10T23:15:15.777052+0000","last_fullsized":"2024-09-10T23:15:15.777052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:58.916488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.029150+0000","last_change":"2024-09-10T23:15:14.792824+0000","last_active":"2024-09-10T23:15:17.029150+0000","last_peered":"2024-09-10T23:15:17.029150+0000","last_clean":"2024-09-10T23:15:17.029150+0000","last_became_active":"2024-09-10T23:15:14.792525+0000","last_became_peered":"2024-09-10T23:15:14.792525+0000","last_unstale":"2024-09-10T23:15:17.029150+0000","last_undegraded":"2024-09-10T23:15:17.029150+0000","last_fullsized":"2024-09-10T23:15:17.029150+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:04.465134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.785461+0000","last_change":"2024-09-10T23:15:13.766624+0000","last_active":"2024-09-10T23:15:16.785461+0000","last_peered":"2024-09-10T23:15:16.785461+0000","last_clean":"2024-09-10T23:15:16.785461+0000","last_became_active":"2024-09-10T23:15:13.766374+0000","last_became_peered":"2024-09-10T23:15:13.766374+0000","last_unstale":"2024-09-10T23:15:16.785461+0000","last_undegraded":"2024-09-10T23:15:16.785461+0000","last_fullsized":"2024-09-10T23:15:16.785461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:20.087239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.779738+0000","last_change":"2024-09-10T23:15:14.787164+0000","last_active":"2024-09-10T23:15:15.779738+0000","last_peered":"2024-09-10T23:15:15.779738+0000","last_clean":"2024-09-10T23:15:15.779738+0000","last_became_active":"2024-09-10T23:15:14.786906+0000","last_became_peered":"2024-09-10T23:15:14.786906+0000","last_unstale":"2024-09-10T23:15:15.779738+0000","last_undegraded":"2024-09-10T23:15:15.779738+0000","last_fullsized":"2024-09-10T23:15:15.779738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:53.803235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.029329+0000","last_change":"2024-09-10T23:15:13.773007+0000","last_active":"2024-09-10T23:15:17.029329+0000","last_peered":"2024-09-10T23:15:17.029329+0000","last_clean":"2024-09-10T23:15:17.029329+0000","last_became_active":"2024-09-10T23:15:13.772559+0000","last_became_peered":"2024-09-10T23:15:13.772559+0000","last_unstale":"2024-09-10T23:15:17.029329+0000","last_undegraded":"2024-09-10T23:15:17.029329+0000","last_fullsized":"2024-09-10T23:15:17.029329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:31.568535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.785296+0000","last_change":"2024-09-10T23:15:14.785689+0000","last_active":"2024-09-10T23:15:16.785296+0000","last_peered":"2024-09-10T23:15:16.785296+0000","last_clean":"2024-09-10T23:15:16.785296+0000","last_became_active":"2024-09-10T23:15:14.785429+0000","last_became_peered":"2024-09-10T23:15:14.785429+0000","last_unstale":"2024-09-10T23:15:16.785296+0000","last_undegraded":"2024-09-10T23:15:16.785296+0000","last_fullsized":"2024-09-10T23:15:16.785296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:04.465134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028585+0000","last_change":"2024-09-10T23:15:13.767364+0000","last_active":"2024-09-10T23:15:17.028585+0000","last_peered":"2024-09-10T23:15:17.028585+0000","last_clean":"2024-09-10T23:15:17.028585+0000","last_became_active":"2024-09-10T23:15:13.767058+0000","last_became_peered":"2024-09-10T23:15:13.767058+0000","last_unstale":"2024-09-10T23:15:17.028585+0000","last_undegraded":"2024-09-10T23:15:17.028585+0000","last_fullsized":"2024-09-10T23:15:17.028585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:56.499318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.027727+0000","last_change":"2024-09-10T23:15:14.785805+0000","last_active":"2024-09-10T23:15:17.027727+0000","last_peered":"2024-09-10T23:15:17.027727+0000","last_clean":"2024-09-10T23:15:17.027727+0000","last_became_active":"2024-09-10T23:15:14.785505+0000","last_became_peered":"2024-09-10T23:15:14.785505+0000","last_unstale":"2024-09-10T23:15:17.027727+0000","last_undegraded":"2024-09-10T23:15:17.027727+0000","last_fullsized":"2024-09-10T23:15:17.027727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:28.776268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028746+0000","last_change":"2024-09-10T23:15:13.771804+0000","last_active":"2024-09-10T23:15:17.028746+0000","last_peered":"2024-09-10T23:15:17.028746+0000","last_clean":"2024-09-10T23:15:17.028746+0000","last_became_active":"2024-09-10T23:15:13.771498+0000","last_became_peered":"2024-09-10T23:15:13.771498+0000","last_unstale":"2024-09-10T23:15:17.028746+0000","last_undegraded":"2024-09-10T23:15:17.028746+0000","last_fullsized":"2024-09-10T23:15:17.028746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:20.145398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.027573+0000","last_change":"2024-09-10T23:15:14.791708+0000","last_active":"2024-09-10T23:15:17.027573+0000","last_peered":"2024-09-10T23:15:17.027573+0000","last_clean":"2024-09-10T23:15:17.027573+0000","last_became_active":"2024-09-10T23:15:14.791412+0000","last_became_peered":"2024-09-10T23:15:14.791412+0000","last_unstale":"2024-09-10T23:15:17.027573+0000","last_undegraded":"2024-09-10T23:15:17.027573+0000","last_fullsized":"2024-09-10T23:15:17.027573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:37.134836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.781594+0000","last_change":"2024-09-10T23:15:13.771498+0000","last_active":"2024-09-10T23:15:16.781594+0000","last_peered":"2024-09-10T23:15:16.781594+0000","last_clean":"2024-09-10T23:15:16.781594+0000","last_became_active":"2024-09-10T23:15:13.771237+0000","last_became_peered":"2024-09-10T23:15:13.771237+0000","last_unstale":"2024-09-10T23:15:16.781594+0000","last_undegraded":"2024-09-10T23:15:16.781594+0000","last_fullsized":"2024-09-10T23:15:16.781594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:23.686077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.027727+0000","last_change":"2024-09-10T23:15:14.778395+0000","last_active":"2024-09-10T23:15:17.027727+0000","last_peered":"2024-09-10T23:15:17.027727+0000","last_clean":"2024-09-10T23:15:17.027727+0000","last_became_active":"2024-09-10T23:15:14.778134+0000","last_became_peered":"2024-09-10T23:15:14.778134+0000","last_unstale":"2024-09-10T23:15:17.027727+0000","last_undegraded":"2024-09-10T23:15:17.027727+0000","last_fullsized":"2024-09-10T23:15:17.027727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:34.228563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.779926+0000","last_change":"2024-09-10T23:15:13.772451+0000","last_active":"2024-09-10T23:15:15.779926+0000","last_peered":"2024-09-10T23:15:15.779926+0000","last_clean":"2024-09-10T23:15:15.779926+0000","last_became_active":"2024-09-10T23:15:13.772151+0000","last_became_peered":"2024-09-10T23:15:13.772151+0000","last_unstale":"2024-09-10T23:15:15.779926+0000","last_undegraded":"2024-09-10T23:15:15.779926+0000","last_fullsized":"2024-09-10T23:15:15.779926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:36.129380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.027524+0000","last_change":"2024-09-10T23:15:14.779020+0000","last_active":"2024-09-10T23:15:17.027524+0000","last_peered":"2024-09-10T23:15:17.027524+0000","last_clean":"2024-09-10T23:15:17.027524+0000","last_became_active":"2024-09-10T23:15:14.778786+0000","last_became_peered":"2024-09-10T23:15:14.778786+0000","last_unstale":"2024-09-10T23:15:17.027524+0000","last_undegraded":"2024-09-10T23:15:17.027524+0000","last_fullsized":"2024-09-10T23:15:17.027524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:01.532579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.029203+0000","last_change":"2024-09-10T23:15:13.772463+0000","last_active":"2024-09-10T23:15:17.029203+0000","last_peered":"2024-09-10T23:15:17.029203+0000","last_clean":"2024-09-10T23:15:17.029203+0000","last_became_active":"2024-09-10T23:15:13.772215+0000","last_became_peered":"2024-09-10T23:15:13.772215+0000","last_unstale":"2024-09-10T23:15:17.029203+0000","last_undegraded":"2024-09-10T23:15:17.029203+0000","last_fullsized":"2024-09-10T23:15:17.029203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:22.421760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028110+0000","last_change":"2024-09-10T23:15:14.787638+0000","last_active":"2024-09-10T23:15:17.028110+0000","last_peered":"2024-09-10T23:15:17.028110+0000","last_clean":"2024-09-10T23:15:17.028110+0000","last_became_active":"2024-09-10T23:15:14.787332+0000","last_became_peered":"2024-09-10T23:15:14.787332+0000","last_unstale":"2024-09-10T23:15:17.028110+0000","last_undegraded":"2024-09-10T23:15:17.028110+0000","last_fullsized":"2024-09-10T23:15:17.028110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:12.636781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.778801+0000","last_change":"2024-09-10T23:15:13.772780+0000","last_active":"2024-09-10T23:15:15.778801+0000","last_peered":"2024-09-10T23:15:15.778801+0000","last_clean":"2024-09-10T23:15:15.778801+0000","last_became_active":"2024-09-10T23:15:13.770367+0000","last_became_peered":"2024-09-10T23:15:13.770367+0000","last_unstale":"2024-09-10T23:15:15.778801+0000","last_undegraded":"2024-09-10T23:15:15.778801+0000","last_fullsized":"2024-09-10T23:15:15.778801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:35.731410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.027652+0000","last_change":"2024-09-10T23:15:14.778452+0000","last_active":"2024-09-10T23:15:17.027652+0000","last_peered":"2024-09-10T23:15:17.027652+0000","last_clean":"2024-09-10T23:15:17.027652+0000","last_became_active":"2024-09-10T23:15:14.778193+0000","last_became_peered":"2024-09-10T23:15:14.778193+0000","last_unstale":"2024-09-10T23:15:17.027652+0000","last_undegraded":"2024-09-10T23:15:17.027652+0000","last_fullsized":"2024-09-10T23:15:17.027652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:05.985841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.785540+0000","last_change":"2024-09-10T23:15:13.769520+0000","last_active":"2024-09-10T23:15:16.785540+0000","last_peered":"2024-09-10T23:15:16.785540+0000","last_clean":"2024-09-10T23:15:16.785540+0000","last_became_active":"2024-09-10T23:15:13.769237+0000","last_became_peered":"2024-09-10T23:15:13.769237+0000","last_unstale":"2024-09-10T23:15:16.785540+0000","last_undegraded":"2024-09-10T23:15:16.785540+0000","last_fullsized":"2024-09-10T23:15:16.785540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:27.770813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.779878+0000","last_change":"2024-09-10T23:15:14.777929+0000","last_active":"2024-09-10T23:15:15.779878+0000","last_peered":"2024-09-10T23:15:15.779878+0000","last_clean":"2024-09-10T23:15:15.779878+0000","last_became_active":"2024-09-10T23:15:14.777655+0000","last_became_peered":"2024-09-10T23:15:14.777655+0000","last_unstale":"2024-09-10T23:15:15.779878+0000","last_undegraded":"2024-09-10T23:15:15.779878+0000","last_fullsized":"2024-09-10T23:15:15.779878+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:41.653041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.781842+0000","last_change":"2024-09-10T23:15:13.768777+0000","last_active":"2024-09-10T23:15:16.781842+0000","last_peered":"2024-09-10T23:15:16.781842+0000","last_clean":"2024-09-10T23:15:16.781842+0000","last_became_active":"2024-09-10T23:15:13.768495+0000","last_became_peered":"2024-09-10T23:15:13.768495+0000","last_unstale":"2024-09-10T23:15:16.781842+0000","last_undegraded":"2024-09-10T23:15:16.781842+0000","last_fullsized":"2024-09-10T23:15:16.781842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:28.311087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.781731+0000","last_change":"2024-09-10T23:15:14.775232+0000","last_active":"2024-09-10T23:15:16.781731+0000","last_peered":"2024-09-10T23:15:16.781731+0000","last_clean":"2024-09-10T23:15:16.781731+0000","last_became_active":"2024-09-10T23:15:14.774963+0000","last_became_peered":"2024-09-10T23:15:14.774963+0000","last_unstale":"2024-09-10T23:15:16.781731+0000","last_undegraded":"2024-09-10T23:15:16.781731+0000","last_fullsized":"2024-09-10T23:15:16.781731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:19:44.516395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.785523+0000","last_change":"2024-09-10T23:15:13.765968+0000","last_active":"2024-09-10T23:15:16.785523+0000","last_peered":"2024-09-10T23:15:16.785523+0000","last_clean":"2024-09-10T23:15:16.785523+0000","last_became_active":"2024-09-10T23:15:13.765648+0000","last_became_peered":"2024-09-10T23:15:13.765648+0000","last_unstale":"2024-09-10T23:15:16.785523+0000","last_undegraded":"2024-09-10T23:15:16.785523+0000","last_fullsized":"2024-09-10T23:15:16.785523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:33.223107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.779749+0000","last_change":"2024-09-10T23:15:14.784737+0000","last_active":"2024-09-10T23:15:15.779749+0000","last_peered":"2024-09-10T23:15:15.779749+0000","last_clean":"2024-09-10T23:15:15.779749+0000","last_became_active":"2024-09-10T23:15:14.784476+0000","last_became_peered":"2024-09-10T23:15:14.784476+0000","last_unstale":"2024-09-10T23:15:15.779749+0000","last_undegraded":"2024-09-10T23:15:15.779749+0000","last_fullsized":"2024-09-10T23:15:15.779749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:59.921943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.781806+0000","last_change":"2024-09-10T23:15:13.770181+0000","last_active":"2024-09-10T23:15:16.781806+0000","last_peered":"2024-09-10T23:15:16.781806+0000","last_clean":"2024-09-10T23:15:16.781806+0000","last_became_active":"2024-09-10T23:15:13.769931+0000","last_became_peered":"2024-09-10T23:15:13.769931+0000","last_unstale":"2024-09-10T23:15:16.781806+0000","last_undegraded":"2024-09-10T23:15:16.781806+0000","last_fullsized":"2024-09-10T23:15:16.781806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:07.056987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.781751+0000","last_change":"2024-09-10T23:15:14.776662+0000","last_active":"2024-09-10T23:15:16.781751+0000","last_peered":"2024-09-10T23:15:16.781751+0000","last_clean":"2024-09-10T23:15:16.781751+0000","last_became_active":"2024-09-10T23:15:14.776354+0000","last_became_peered":"2024-09-10T23:15:14.776354+0000","last_unstale":"2024-09-10T23:15:16.781751+0000","last_undegraded":"2024-09-10T23:15:16.781751+0000","last_fullsized":"2024-09-10T23:15:16.781751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:27.973171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:16.785107+0000","last_change":"2024-09-10T23:15:13.769954+0000","last_active":"2024-09-10T23:15:16.785107+0000","last_peered":"2024-09-10T23:15:16.785107+0000","last_clean":"2024-09-10T23:15:16.785107+0000","last_became_active":"2024-09-10T23:15:13.769701+0000","last_became_peered":"2024-09-10T23:15:13.769701+0000","last_unstale":"2024-09-10T23:15:16.785107+0000","last_undegraded":"2024-09-10T23:15:16.785107+0000","last_fullsized":"2024-09-10T23:15:16.785107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:28.227215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.777032+0000","last_change":"2024-09-10T23:15:14.781851+0000","last_active":"2024-09-10T23:15:15.777032+0000","last_peered":"2024-09-10T23:15:15.777032+0000","last_clean":"2024-09-10T23:15:15.777032+0000","last_became_active":"2024-09-10T23:15:14.781580+0000","last_became_peered":"2024-09-10T23:15:14.781580+0000","last_unstale":"2024-09-10T23:15:15.777032+0000","last_undegraded":"2024-09-10T23:15:15.777032+0000","last_fullsized":"2024-09-10T23:15:15.777032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:21.251683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.029296+0000","last_change":"2024-09-10T23:15:13.774703+0000","last_active":"2024-09-10T23:15:17.029296+0000","last_peered":"2024-09-10T23:15:17.029296+0000","last_clean":"2024-09-10T23:15:17.029296+0000","last_became_active":"2024-09-10T23:15:13.774437+0000","last_became_peered":"2024-09-10T23:15:13.774437+0000","last_unstale":"2024-09-10T23:15:17.029296+0000","last_undegraded":"2024-09-10T23:15:17.029296+0000","last_fullsized":"2024-09-10T23:15:17.029296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:30.064030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028407+0000","last_change":"2024-09-10T23:15:14.796113+0000","last_active":"2024-09-10T23:15:17.028407+0000","last_peered":"2024-09-10T23:15:17.028407+0000","last_clean":"2024-09-10T23:15:17.028407+0000","last_became_active":"2024-09-10T23:15:14.795826+0000","last_became_peered":"2024-09-10T23:15:14.795826+0000","last_unstale":"2024-09-10T23:15:17.028407+0000","last_undegraded":"2024-09-10T23:15:17.028407+0000","last_fullsized":"2024-09-10T23:15:17.028407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:41.599007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.777157+0000","last_change":"2024-09-10T23:15:13.772145+0000","last_active":"2024-09-10T23:15:15.777157+0000","last_peered":"2024-09-10T23:15:15.777157+0000","last_clean":"2024-09-10T23:15:15.777157+0000","last_became_active":"2024-09-10T23:15:13.771823+0000","last_became_peered":"2024-09-10T23:15:13.771823+0000","last_unstale":"2024-09-10T23:15:15.777157+0000","last_undegraded":"2024-09-10T23:15:15.777157+0000","last_fullsized":"2024-09-10T23:15:15.777157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:33.192200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028747+0000","last_change":"2024-09-10T23:15:14.782850+0000","last_active":"2024-09-10T23:15:17.028747+0000","last_peered":"2024-09-10T23:15:17.028747+0000","last_clean":"2024-09-10T23:15:17.028747+0000","last_became_active":"2024-09-10T23:15:14.782571+0000","last_became_peered":"2024-09-10T23:15:14.782571+0000","last_unstale":"2024-09-10T23:15:17.028747+0000","last_undegraded":"2024-09-10T23:15:17.028747+0000","last_fullsized":"2024-09-10T23:15:17.028747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:13.749502+0000","last_clean_scrub_stamp":"2024-09-10T23:15:13.749502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:23.939001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:15.778485+0000","last_change":"2024-09-10T23:15:13.775030+0000","last_active":"2024-09-10T23:15:15.778485+0000","last_peered":"2024-09-10T23:15:15.778485+0000","last_clean":"2024-09-10T23:15:15.778485+0000","last_became_active":"2024-09-10T23:15:13.774722+0000","last_became_peered":"2024-09-10T23:15:13.774722+0000","last_unstale":"2024-09-10T23:15:15.778485+0000","last_undegraded":"2024-09-10T23:15:15.778485+0000","last_fullsized":"2024-09-10T23:15:15.778485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:12.744046+0000","last_clean_scrub_stamp":"2024-09-10T23:15:12.744046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:37.882903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":130,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T23:15:17.028767+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:15:17.028767+0000","last_peered":"2024-09-10T23:15:17.028767+0000","last_clean":"2024-09-10T23:15:17.028767+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:15:17.028767+0000","last_undegraded":"2024-09-10T23:15:17.028767+0000","last_fullsized":"2024-09-10T23:15:17.028767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":974848,"data_stored":734885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":145043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":145099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":144531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":393216,"data_stored":146061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":380928,"data_stored":144497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":146061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":970752,"data_stored":734795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:15:22.625 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:15:22.625 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:15:22.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.768+0000 7ff22e48c640 1 -- 172.21.15.90:0/2189000461 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2280caa70 msgr2=0x7ff22815a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:22.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.768+0000 7ff22e48c640 1 --2- 172.21.15.90:0/2189000461 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2280caa70 0x7ff22815a870 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00a940 tx=0x7ff21c02b850 comp rx=0 tx=0).stop 2024-09-10T23:15:22.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.769+0000 7ff22e48c640 1 -- 172.21.15.90:0/2189000461 shutdown_connections 2024-09-10T23:15:22.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.769+0000 7ff22e48c640 1 --2- 172.21.15.90:0/2189000461 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2280caa70 0x7ff22815a870 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:22.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.769+0000 7ff22e48c640 1 -- 172.21.15.90:0/2189000461 >> 172.21.15.90:0/2189000461 conn(0x7ff2280cfbc0 msgr2=0x7ff2280cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:22.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.769+0000 7ff22e48c640 1 -- 172.21.15.90:0/2189000461 shutdown_connections 2024-09-10T23:15:22.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.769+0000 7ff22e48c640 1 -- 172.21.15.90:0/2189000461 wait complete. 2024-09-10T23:15:22.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.770+0000 7ff22e48c640 1 Processor -- start 2024-09-10T23:15:22.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.770+0000 7ff22e48c640 1 -- start start 2024-09-10T23:15:22.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff22e48c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2280caa70 0x7ff2281e8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:22.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff22e48c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2280cdca0 0x7ff2281e9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:22.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff22e48c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2281547c0 0x7ff2281e9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:22.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff22e48c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff22806eb10 con 0x7ff2280caa70 2024-09-10T23:15:22.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff22e48c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff22806e990 con 0x7ff2281547c0 2024-09-10T23:15:22.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff22e48c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff22806ec90 con 0x7ff2280cdca0 2024-09-10T23:15:22.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff227fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2280caa70 0x7ff2281e8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:22.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff227fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2280caa70 0x7ff2281e8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37366/0 (socket says 172.21.15.90:37366) 2024-09-10T23:15:22.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff227fff640 1 -- 172.21.15.90:0/2282620604 learned_addr learned my addr 172.21.15.90:0/2282620604 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:22.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff2277fe640 1 --2- 172.21.15.90:0/2282620604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2280cdca0 0x7ff2281e9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:22.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff227fff640 1 -- 172.21.15.90:0/2282620604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2280cdca0 msgr2=0x7ff2281e9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:22.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff227fff640 1 --2- 172.21.15.90:0/2282620604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2280cdca0 0x7ff2281e9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:22.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff22ca29640 1 --2- 172.21.15.90:0/2282620604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2281547c0 0x7ff2281e9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:22.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff227fff640 1 -- 172.21.15.90:0/2282620604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2281547c0 msgr2=0x7ff2281e9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:22.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff227fff640 1 --2- 172.21.15.90:0/2282620604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2281547c0 0x7ff2281e9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:22.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff227fff640 1 -- 172.21.15.90:0/2282620604 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2281f4fd0 con 0x7ff2280caa70 2024-09-10T23:15:22.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff2277fe640 1 --2- 172.21.15.90:0/2282620604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2280cdca0 0x7ff2281e9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:22.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff227fff640 1 --2- 172.21.15.90:0/2282620604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2280caa70 0x7ff2281e8770 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff21800c3a0 tx=0x7ff21800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:22.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff224ff9640 1 -- 172.21.15.90:0/2282620604 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218011790 con 0x7ff2280caa70 2024-09-10T23:15:22.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff224ff9640 1 -- 172.21.15.90:0/2282620604 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff218017070 con 0x7ff2280caa70 2024-09-10T23:15:22.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff22e48c640 1 -- 172.21.15.90:0/2282620604 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2281f52b0 con 0x7ff2280caa70 2024-09-10T23:15:22.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff224ff9640 1 -- 172.21.15.90:0/2282620604 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218011cc0 con 0x7ff2280caa70 2024-09-10T23:15:22.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.771+0000 7ff22e48c640 1 -- 172.21.15.90:0/2282620604 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2281f5870 con 0x7ff2280caa70 2024-09-10T23:15:22.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.772+0000 7ff22e48c640 1 -- 172.21.15.90:0/2282620604 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2280cf370 con 0x7ff2280caa70 2024-09-10T23:15:22.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.773+0000 7ff224ff9640 1 -- 172.21.15.90:0/2282620604 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff21801c460 con 0x7ff2280caa70 2024-09-10T23:15:22.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.773+0000 7ff224ff9640 1 --2- 172.21.15.90:0/2282620604 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff214077f70 0x7ff21407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:22.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.774+0000 7ff224ff9640 1 -- 172.21.15.90:0/2282620604 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff218099af0 con 0x7ff2280caa70 2024-09-10T23:15:22.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.774+0000 7ff2277fe640 1 --2- 172.21.15.90:0/2282620604 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff214077f70 0x7ff21407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:22.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.774+0000 7ff2277fe640 1 --2- 172.21.15.90:0/2282620604 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff214077f70 0x7ff21407a430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff21c036000 tx=0x7ff21c004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:22.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:22.778+0000 7ff224ff9640 1 -- 172.21.15.90:0/2282620604 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff2280cf370 con 0x7ff2280caa70 2024-09-10T23:15:23.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.023+0000 7ff22e48c640 1 -- 172.21.15.90:0/2282620604 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff2280d0ad0 con 0x7ff2280caa70 2024-09-10T23:15:23.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.027+0000 7ff224ff9640 1 -- 172.21.15.90:0/2282620604 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) ==== 190+0+147 (secure 0 0 0) 0x7ff2180625f0 con 0x7ff2280caa70 2024-09-10T23:15:23.028 INFO:teuthology.orchestra.run.smithi090.stdout:[client.0] 2024-09-10T23:15:23.029 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCX0uBmiYBwBhAABMV9erpQ+KZlTmf0kDZ0gw== 2024-09-10T23:15:23.029 INFO:teuthology.orchestra.run.smithi090.stdout: caps mds = "allow" 2024-09-10T23:15:23.029 INFO:teuthology.orchestra.run.smithi090.stdout: caps mon = "allow r" 2024-09-10T23:15:23.029 INFO:teuthology.orchestra.run.smithi090.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:15:23.029 INFO:teuthology.orchestra.run.smithi090.stderr:updated caps for client.0 2024-09-10T23:15:23.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.029+0000 7ff22e48c640 1 -- 172.21.15.90:0/2282620604 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff214077f70 msgr2=0x7ff21407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.029+0000 7ff22e48c640 1 --2- 172.21.15.90:0/2282620604 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff214077f70 0x7ff21407a430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff21c036000 tx=0x7ff21c004730 comp rx=0 tx=0).stop 2024-09-10T23:15:23.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.029+0000 7ff22e48c640 1 -- 172.21.15.90:0/2282620604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2280caa70 msgr2=0x7ff2281e8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.029+0000 7ff22e48c640 1 --2- 172.21.15.90:0/2282620604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2280caa70 0x7ff2281e8770 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff21800c3a0 tx=0x7ff21800c860 comp rx=0 tx=0).stop 2024-09-10T23:15:23.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.029+0000 7ff22e48c640 1 -- 172.21.15.90:0/2282620604 shutdown_connections 2024-09-10T23:15:23.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.030+0000 7ff22e48c640 1 --2- 172.21.15.90:0/2282620604 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff214077f70 0x7ff21407a430 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.030+0000 7ff22e48c640 1 --2- 172.21.15.90:0/2282620604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2281547c0 0x7ff2281e9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.030+0000 7ff22e48c640 1 --2- 172.21.15.90:0/2282620604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2280cdca0 0x7ff2281e9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.030+0000 7ff22e48c640 1 --2- 172.21.15.90:0/2282620604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2280caa70 0x7ff2281e8770 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.030+0000 7ff22e48c640 1 -- 172.21.15.90:0/2282620604 >> 172.21.15.90:0/2282620604 conn(0x7ff2280cfbc0 msgr2=0x7ff22815a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:23.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.030+0000 7ff22e48c640 1 -- 172.21.15.90:0/2282620604 shutdown_connections 2024-09-10T23:15:23.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.030+0000 7ff22e48c640 1 -- 172.21.15.90:0/2282620604 wait complete. 2024-09-10T23:15:23.041 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:23.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.141+0000 7f8f4416c640 1 -- 172.21.15.90:0/3119070132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f3c0d1c70 msgr2=0x7f8f3c0b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.141+0000 7f8f4416c640 1 --2- 172.21.15.90:0/3119070132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f3c0d1c70 0x7f8f3c0b3490 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8f30009830 tx=0x7f8f3002a510 comp rx=0 tx=0).stop 2024-09-10T23:15:23.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.141+0000 7f8f4416c640 1 -- 172.21.15.90:0/3119070132 shutdown_connections 2024-09-10T23:15:23.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.141+0000 7f8f4416c640 1 --2- 172.21.15.90:0/3119070132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f3c0d1c70 0x7f8f3c0b3490 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.141+0000 7f8f4416c640 1 -- 172.21.15.90:0/3119070132 >> 172.21.15.90:0/3119070132 conn(0x7f8f3c09d2a0 msgr2=0x7f8f3c0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:23.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.141+0000 7f8f4416c640 1 -- 172.21.15.90:0/3119070132 shutdown_connections 2024-09-10T23:15:23.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.141+0000 7f8f4416c640 1 -- 172.21.15.90:0/3119070132 wait complete. 2024-09-10T23:15:23.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.142+0000 7f8f4416c640 1 Processor -- start 2024-09-10T23:15:23.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.143+0000 7f8f4416c640 1 -- start start 2024-09-10T23:15:23.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.143+0000 7f8f4416c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f3c0b3a00 0x7f8f3c1f4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.143+0000 7f8f4416c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f3c0d1c70 0x7f8f3c06e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.143+0000 7f8f4416c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f3c0d2470 0x7f8f3c14eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.143+0000 7f8f4416c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c0b4740 con 0x7f8f3c0b3a00 2024-09-10T23:15:23.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.143+0000 7f8f4416c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c0b45c0 con 0x7f8f3c0d2470 2024-09-10T23:15:23.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.143+0000 7f8f4416c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8f3c0b48c0 con 0x7f8f3c0d1c70 2024-09-10T23:15:23.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.143+0000 7f8f41f08640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f3c0b3a00 0x7f8f3c1f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.143+0000 7f8f41f08640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f3c0b3a00 0x7f8f3c1f4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37388/0 (socket says 172.21.15.90:37388) 2024-09-10T23:15:23.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.143+0000 7f8f41f08640 1 -- 172.21.15.90:0/3708932491 learned_addr learned my addr 172.21.15.90:0/3708932491 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:23.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.144+0000 7f8f41707640 1 --2- 172.21.15.90:0/3708932491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f3c0d1c70 0x7f8f3c06e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.144+0000 7f8f42709640 1 --2- 172.21.15.90:0/3708932491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f3c0d2470 0x7f8f3c14eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.144+0000 7f8f41f08640 1 -- 172.21.15.90:0/3708932491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f3c0d1c70 msgr2=0x7f8f3c06e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.144+0000 7f8f41f08640 1 --2- 172.21.15.90:0/3708932491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f3c0d1c70 0x7f8f3c06e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.144+0000 7f8f41f08640 1 -- 172.21.15.90:0/3708932491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f3c0d2470 msgr2=0x7f8f3c14eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.144+0000 7f8f41f08640 1 --2- 172.21.15.90:0/3708932491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f3c0d2470 0x7f8f3c14eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.144+0000 7f8f41f08640 1 -- 172.21.15.90:0/3708932491 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3c0c9170 con 0x7f8f3c0b3a00 2024-09-10T23:15:23.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.144+0000 7f8f42709640 1 --2- 172.21.15.90:0/3708932491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f3c0d2470 0x7f8f3c14eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:23.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.144+0000 7f8f41f08640 1 --2- 172.21.15.90:0/3708932491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f3c0b3a00 0x7f8f3c1f4c60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00c7a0 tx=0x7f8f2c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:23.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.144+0000 7f8f3a7fc640 1 -- 172.21.15.90:0/3708932491 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c017070 con 0x7f8f3c0b3a00 2024-09-10T23:15:23.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.144+0000 7f8f3a7fc640 1 -- 172.21.15.90:0/3708932491 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f2c00ce50 con 0x7f8f3c0b3a00 2024-09-10T23:15:23.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.144+0000 7f8f4416c640 1 -- 172.21.15.90:0/3708932491 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f3c0c9450 con 0x7f8f3c0b3a00 2024-09-10T23:15:23.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.144+0000 7f8f3a7fc640 1 -- 172.21.15.90:0/3708932491 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c0052d0 con 0x7f8f3c0b3a00 2024-09-10T23:15:23.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.144+0000 7f8f4416c640 1 -- 172.21.15.90:0/3708932491 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f3c0c9a10 con 0x7f8f3c0b3a00 2024-09-10T23:15:23.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.145+0000 7f8f4416c640 1 -- 172.21.15.90:0/3708932491 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f3c0b3490 con 0x7f8f3c0b3a00 2024-09-10T23:15:23.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.146+0000 7f8f3a7fc640 1 -- 172.21.15.90:0/3708932491 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8f2c005470 con 0x7f8f3c0b3a00 2024-09-10T23:15:23.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.146+0000 7f8f3a7fc640 1 --2- 172.21.15.90:0/3708932491 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8f28077f70 0x7f8f2807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.146+0000 7f8f3a7fc640 1 -- 172.21.15.90:0/3708932491 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8f2c099660 con 0x7f8f3c0b3a00 2024-09-10T23:15:23.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.146+0000 7f8f41707640 1 --2- 172.21.15.90:0/3708932491 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8f28077f70 0x7f8f2807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.147+0000 7f8f41707640 1 --2- 172.21.15.90:0/3708932491 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8f28077f70 0x7f8f2807a430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8f30034000 tx=0x7f8f30004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:23.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.150+0000 7f8f3a7fc640 1 -- 172.21.15.90:0/3708932491 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8f3c0cff60 con 0x7f8f3c0b3a00 2024-09-10T23:15:23.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.357+0000 7f8f4416c640 1 -- 172.21.15.90:0/3708932491 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f3c0b1920 con 0x7f8f3c0b3a00 2024-09-10T23:15:23.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.358+0000 7f8f3a7fc640 1 -- 172.21.15.90:0/3708932491 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5220 (secure 0 0 0) 0x7f8f2c0621f0 con 0x7f8f3c0b3a00 2024-09-10T23:15:23.359 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:23.359 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"btime":"2024-09-10T23:15:16:780866+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/464675823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":464675823},{"type":"v1","addr":"172.21.15.90:6835","nonce":464675823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/28851721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":28851721},{"type":"v1","addr":"172.21.15.171:6836","nonce":28851721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/3538341252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3538341252},{"type":"v1","addr":"172.21.15.90:6834","nonce":3538341252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:14.107910+0000","modified":"2024-09-10T23:15:16.120228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4881":{"gid":4881,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/2513837234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2513837234},{"type":"v1","addr":"172.21.15.171:6837","nonce":2513837234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4881,"qdb_cluster":[4881]},"id":2}]} 2024-09-10T23:15:23.359 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2024-09-10T23:15:23.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.360+0000 7f8f4416c640 1 -- 172.21.15.90:0/3708932491 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8f28077f70 msgr2=0x7f8f2807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.360+0000 7f8f4416c640 1 --2- 172.21.15.90:0/3708932491 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8f28077f70 0x7f8f2807a430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8f30034000 tx=0x7f8f30004730 comp rx=0 tx=0).stop 2024-09-10T23:15:23.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.360+0000 7f8f4416c640 1 -- 172.21.15.90:0/3708932491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f3c0b3a00 msgr2=0x7f8f3c1f4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.360+0000 7f8f4416c640 1 --2- 172.21.15.90:0/3708932491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f3c0b3a00 0x7f8f3c1f4c60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00c7a0 tx=0x7f8f2c00cc60 comp rx=0 tx=0).stop 2024-09-10T23:15:23.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.360+0000 7f8f4416c640 1 -- 172.21.15.90:0/3708932491 shutdown_connections 2024-09-10T23:15:23.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.360+0000 7f8f4416c640 1 --2- 172.21.15.90:0/3708932491 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8f28077f70 0x7f8f2807a430 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.360+0000 7f8f4416c640 1 --2- 172.21.15.90:0/3708932491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f3c0d2470 0x7f8f3c14eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.360+0000 7f8f4416c640 1 --2- 172.21.15.90:0/3708932491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f3c0d1c70 0x7f8f3c06e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.360+0000 7f8f4416c640 1 --2- 172.21.15.90:0/3708932491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f3c0b3a00 0x7f8f3c1f4c60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.360+0000 7f8f4416c640 1 -- 172.21.15.90:0/3708932491 >> 172.21.15.90:0/3708932491 conn(0x7f8f3c09d2a0 msgr2=0x7f8f3c0b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:23.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.360+0000 7f8f4416c640 1 -- 172.21.15.90:0/3708932491 shutdown_connections 2024-09-10T23:15:23.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.360+0000 7f8f4416c640 1 -- 172.21.15.90:0/3708932491 wait complete. 2024-09-10T23:15:23.774 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:15:14.107910+0000', 'modified': '2024-09-10T23:15:16.120228+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4881}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4881': {'gid': 4881, 'name': 'd', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.171:6837/2513837234', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6835', 'nonce': 2513837234}, {'type': 'v1', 'addr': '172.21.15.171:6837', 'nonce': 2513837234}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4881, 'qdb_cluster': [4881]} 2024-09-10T23:15:23.775 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:15:23.775 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T23:15:23.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.877+0000 7f1512e3c640 1 -- 172.21.15.90:0/4243184751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150c0d0180 msgr2=0x7f150c0d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.877+0000 7f1512e3c640 1 --2- 172.21.15.90:0/4243184751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150c0d0180 0x7f150c0d0610 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f150c0d1da0 tx=0x7f14fc02a560 comp rx=0 tx=0).stop 2024-09-10T23:15:23.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.878+0000 7f1512e3c640 1 -- 172.21.15.90:0/4243184751 shutdown_connections 2024-09-10T23:15:23.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.878+0000 7f1512e3c640 1 --2- 172.21.15.90:0/4243184751 >> v2:172.21.15.171:3300/0 conn(0x7f150c0b55a0 0x7f150c0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.878+0000 7f1512e3c640 1 --2- 172.21.15.90:0/4243184751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150c0d0180 0x7f150c0d0610 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.878+0000 7f1512e3c640 1 -- 172.21.15.90:0/4243184751 >> 172.21.15.90:0/4243184751 conn(0x7f150c0d1dd0 msgr2=0x7f150c0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:23.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.878+0000 7f1512e3c640 1 -- 172.21.15.90:0/4243184751 shutdown_connections 2024-09-10T23:15:23.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.878+0000 7f1512e3c640 1 -- 172.21.15.90:0/4243184751 wait complete. 2024-09-10T23:15:23.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.879+0000 7f1512e3c640 1 Processor -- start 2024-09-10T23:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.879+0000 7f1512e3c640 1 -- start start 2024-09-10T23:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f1512e3c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f150c0b55a0 0x7f150c0ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f1512e3c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150c0d0180 0x7f150c144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f1512e3c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f150c15bec0 0x7f150c158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f1512e3c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f150c0b6090 con 0x7f150c0d0180 2024-09-10T23:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f1512e3c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f150c0b5f10 con 0x7f150c0b55a0 2024-09-10T23:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f1512e3c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f150c0b6210 con 0x7f150c15bec0 2024-09-10T23:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f1503fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150c0d0180 0x7f150c144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f1503fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150c0d0180 0x7f150c144600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37402/0 (socket says 172.21.15.90:37402) 2024-09-10T23:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f1503fff640 1 -- 172.21.15.90:0/765263577 learned_addr learned my addr 172.21.15.90:0/765263577 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f1503fff640 1 -- 172.21.15.90:0/765263577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f150c15bec0 msgr2=0x7f150c158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f1503fff640 1 --2- 172.21.15.90:0/765263577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f150c15bec0 0x7f150c158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f1503fff640 1 -- 172.21.15.90:0/765263577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f150c0b55a0 msgr2=0x7f150c0ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f1503fff640 1 --2- 172.21.15.90:0/765263577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f150c0b55a0 0x7f150c0ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f1503fff640 1 -- 172.21.15.90:0/765263577 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150c144b40 con 0x7f150c0d0180 2024-09-10T23:15:23.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f1503fff640 1 --2- 172.21.15.90:0/765263577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150c0d0180 0x7f150c144600 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0099c0 tx=0x7f14fc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:23.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f15017fa640 1 -- 172.21.15.90:0/765263577 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc03f070 con 0x7f150c0d0180 2024-09-10T23:15:23.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f15017fa640 1 -- 172.21.15.90:0/765263577 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14fc004890 con 0x7f150c0d0180 2024-09-10T23:15:23.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f1512e3c640 1 -- 172.21.15.90:0/765263577 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f150c0cae40 con 0x7f150c0d0180 2024-09-10T23:15:23.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f15017fa640 1 -- 172.21.15.90:0/765263577 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc035030 con 0x7f150c0d0180 2024-09-10T23:15:23.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.880+0000 7f1512e3c640 1 -- 172.21.15.90:0/765263577 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f150c0cb400 con 0x7f150c0d0180 2024-09-10T23:15:23.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.882+0000 7f15017fa640 1 -- 172.21.15.90:0/765263577 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f14fc004ce0 con 0x7f150c0d0180 2024-09-10T23:15:23.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.882+0000 7f15017fa640 1 --2- 172.21.15.90:0/765263577 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14f8077f70 0x7f14f807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.883+0000 7f15017fa640 1 -- 172.21.15.90:0/765263577 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f14fc0bafd0 con 0x7f150c0d0180 2024-09-10T23:15:23.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.883+0000 7f1510bd8640 1 --2- 172.21.15.90:0/765263577 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14f8077f70 0x7f14f807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.883+0000 7f1510bd8640 1 --2- 172.21.15.90:0/765263577 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14f8077f70 0x7f14f807a430 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f150800abb0 tx=0x7f1508009250 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:23.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.883+0000 7f1515c08740 1 Processor -- start 2024-09-10T23:15:23.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.883+0000 7f1515c08740 1 -- start start 2024-09-10T23:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.884+0000 7f1515c08740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e868831b0 0x557e8685ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.884+0000 7f1515c08740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868a2df0 0x557e868a31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.884+0000 7f1515c08740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e868585f0 0x557e86858a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.884+0000 7f1515c08740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557e867cf820 con 0x557e868a2df0 2024-09-10T23:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.884+0000 7f1515c08740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x557e867bec50 con 0x557e868831b0 2024-09-10T23:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.884+0000 7f1515c08740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x557e867c2a60 con 0x557e868585f0 2024-09-10T23:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.884+0000 7f1503fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868a2df0 0x557e868a31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.884+0000 7f1503fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868a2df0 0x557e868a31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37418/0 (socket says 172.21.15.90:37418) 2024-09-10T23:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.884+0000 7f1503fff640 1 -- 172.21.15.90:0/873455140 learned_addr learned my addr 172.21.15.90:0/873455140 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.884+0000 7f15113d9640 1 --2- 172.21.15.90:0/873455140 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e868585f0 0x557e86858a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.884+0000 7f1510bd8640 1 --2- 172.21.15.90:0/873455140 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e868831b0 0x557e8685ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.884+0000 7f1503fff640 1 -- 172.21.15.90:0/873455140 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e868585f0 msgr2=0x557e86858a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.884+0000 7f1503fff640 1 --2- 172.21.15.90:0/873455140 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e868585f0 0x557e86858a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.884+0000 7f1503fff640 1 -- 172.21.15.90:0/873455140 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e868831b0 msgr2=0x557e8685ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.884+0000 7f1503fff640 1 --2- 172.21.15.90:0/873455140 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e868831b0 0x557e8685ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.884+0000 7f1503fff640 1 -- 172.21.15.90:0/873455140 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e86520850 con 0x557e868a2df0 2024-09-10T23:15:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.884+0000 7f1503fff640 1 --2- 172.21.15.90:0/873455140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868a2df0 0x557e868a31f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0b9500 tx=0x7f14fc082b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5923a46f01a88ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.885+0000 7f14f27fc640 1 -- 172.21.15.90:0/873455140 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc049040 con 0x557e868a2df0 2024-09-10T23:15:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.885+0000 7f14f27fc640 1 -- 172.21.15.90:0/873455140 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14fc0a91c0 con 0x557e868a2df0 2024-09-10T23:15:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.885+0000 7f14f27fc640 1 -- 172.21.15.90:0/873455140 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0a52e0 con 0x557e868a2df0 2024-09-10T23:15:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.885+0000 7f1515c08740 1 -- 172.21.15.90:0/873455140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868a2df0 msgr2=0x557e868a31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.885+0000 7f1515c08740 1 --2- 172.21.15.90:0/873455140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868a2df0 0x557e868a31f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0b9500 tx=0x7f14fc082b50 comp rx=0 tx=0).stop 2024-09-10T23:15:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.885+0000 7f1515c08740 1 -- 172.21.15.90:0/873455140 shutdown_connections 2024-09-10T23:15:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.885+0000 7f1515c08740 1 --2- 172.21.15.90:0/873455140 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e868585f0 0x557e86858a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.885+0000 7f1515c08740 1 --2- 172.21.15.90:0/873455140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868a2df0 0x557e868a31f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.885+0000 7f1515c08740 1 --2- 172.21.15.90:0/873455140 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e868831b0 0x557e8685ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.885+0000 7f1515c08740 1 -- 172.21.15.90:0/873455140 >> 172.21.15.90:0/873455140 conn(0x557e868596a0 msgr2=0x557e8685d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:23.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.885+0000 7f1515c08740 1 -- 172.21.15.90:0/873455140 shutdown_connections 2024-09-10T23:15:23.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.885+0000 7f1515c08740 1 -- 172.21.15.90:0/873455140 wait complete. 2024-09-10T23:15:23.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.886+0000 7f1515c08740 1 -- start start 2024-09-10T23:15:23.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.886+0000 7f1515c08740 1 Processor -- start 2024-09-10T23:15:23.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f1515c08740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e868831b0 0x557e86881e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f1515c08740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868a2df0 0x557e868b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f1515c08740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e86882380 0x557e868b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f1515c08740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557e8652f620 con 0x557e868a2df0 2024-09-10T23:15:23.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f1515c08740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x557e867645f0 con 0x557e86882380 2024-09-10T23:15:23.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f1515c08740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x557e86857850 con 0x557e868831b0 2024-09-10T23:15:23.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f1515c08740 10 client.0 _ll_register_callbacks cb 0x557e867680a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:15:23.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f1503fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868a2df0 0x557e868b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f1503fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868a2df0 0x557e868b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37424/0 (socket says 172.21.15.90:37424) 2024-09-10T23:15:23.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f1503fff640 1 -- 172.21.15.90:0/1464927349 learned_addr learned my addr 172.21.15.90:0/1464927349 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:23.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f1510bd8640 1 --2- 172.21.15.90:0/1464927349 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e868831b0 0x557e86881e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f15113d9640 1 --2- 172.21.15.90:0/1464927349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e86882380 0x557e868b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f1503fff640 1 -- 172.21.15.90:0/1464927349 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e868831b0 msgr2=0x557e86881e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:23.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f1503fff640 1 --2- 172.21.15.90:0/1464927349 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e868831b0 0x557e86881e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f1503fff640 1 -- 172.21.15.90:0/1464927349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e86882380 msgr2=0x557e868b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:23.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f1503fff640 1 --2- 172.21.15.90:0/1464927349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e86882380 0x557e868b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f1503fff640 1 -- 172.21.15.90:0/1464927349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e865976b0 con 0x557e868a2df0 2024-09-10T23:15:23.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f15113d9640 1 --2- 172.21.15.90:0/1464927349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e86882380 0x557e868b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:23.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f1503fff640 1 --2- 172.21.15.90:0/1464927349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868a2df0 0x557e868b1b20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f14fc07f960 tx=0x7f14fc0838f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3e499be7ac7ccb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:23.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f14eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:15:23.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.887+0000 7f14eb7fe640 1 -- 172.21.15.90:0/1464927349 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc049070 con 0x557e868a2df0 2024-09-10T23:15:23.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.888+0000 7f14eb7fe640 1 -- 172.21.15.90:0/1464927349 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f14fc0a5260 con 0x557e868a2df0 2024-09-10T23:15:23.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.888+0000 7f1515c08740 1 -- 172.21.15.90:0/1464927349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14fc0a91c0 con 0x557e868a2df0 2024-09-10T23:15:23.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.888+0000 7f14eb7fe640 1 -- 172.21.15.90:0/1464927349 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f14fc0833e0 con 0x557e868a2df0 2024-09-10T23:15:23.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.888+0000 7f1515c08740 10 client.5055 fetch_fsmap learned FSMap version 14 2024-09-10T23:15:23.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.888+0000 7f1515c08740 1 -- 172.21.15.90:0/1464927349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x557e8686a3d0 con 0x557e868a2df0 2024-09-10T23:15:23.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.888+0000 7f14eb7fe640 1 -- 172.21.15.90:0/1464927349 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14fc0a91c0 con 0x557e868a2df0 2024-09-10T23:15:23.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.888+0000 7f14eb7fe640 1 -- 172.21.15.90:0/1464927349 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7f14fc08c450 con 0x557e868a2df0 2024-09-10T23:15:23.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.888+0000 7f1515c08740 10 client.5055 fetch_fsmap finished waiting for FSMap version 14 2024-09-10T23:15:23.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.888+0000 7f1515c08740 10 client.5055 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:15:23.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.888+0000 7f1515c08740 20 client.5055 populate_metadata read hostname 'smithi090' 2024-09-10T23:15:23.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.888+0000 7f1515c08740 1 --2- 172.21.15.90:0/1464927349 >> [v2:172.21.15.171:6835/2513837234,v1:172.21.15.171:6837/2513837234] conn(0x557e8687b1a0 0x557e8687d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.888+0000 7f1515c08740 4 client.5055 mds_command: new command op to 4881 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:15:23.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.888+0000 7f1515c08740 1 -- 172.21.15.90:0/1464927349 --> [v2:172.21.15.171:6835/2513837234,v1:172.21.15.171:6837/2513837234] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e867d1770 con 0x557e8687b1a0 2024-09-10T23:15:23.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.888+0000 7f1510bd8640 1 --2- 172.21.15.90:0/1464927349 >> [v2:172.21.15.171:6835/2513837234,v1:172.21.15.171:6837/2513837234] conn(0x557e8687b1a0 0x557e8687d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.889+0000 7f1510bd8640 1 --2- 172.21.15.90:0/1464927349 >> [v2:172.21.15.171:6835/2513837234,v1:172.21.15.171:6837/2513837234] conn(0x557e8687b1a0 0x557e8687d2b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75c946bb0b61e41e server_cookie=bc6bcb58a03a2131 in_seq=0 out_seq=0 2024-09-10T23:15:23.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.889+0000 7f14eb7fe640 10 client.5055 ms_handle_connect on v2:172.21.15.171:6835/2513837234 2024-09-10T23:15:23.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.889+0000 7f14eb7fe640 1 -- 172.21.15.90:0/1464927349 <== mds.0 v2:172.21.15.171:6835/2513837234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557e867d1770 con 0x557e8687b1a0 2024-09-10T23:15:23.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.889+0000 7f14eb7fe640 10 client.5055 handle_command_reply: tid=0 2024-09-10T23:15:23.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.889+0000 7f1515c08740 1 client.5055 shutdown 2024-09-10T23:15:23.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.890+0000 7f1515c08740 1 -- 172.21.15.90:0/1464927349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868a2df0 msgr2=0x557e868b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.890+0000 7f1515c08740 1 --2- 172.21.15.90:0/1464927349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868a2df0 0x557e868b1b20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f14fc07f960 tx=0x7f14fc0838f0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.890+0000 7f1515c08740 1 -- 172.21.15.90:0/1464927349 shutdown_connections 2024-09-10T23:15:23.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.890+0000 7f1515c08740 1 --2- 172.21.15.90:0/1464927349 >> [v2:172.21.15.171:6835/2513837234,v1:172.21.15.171:6837/2513837234] conn(0x557e8687b1a0 0x557e8687d2b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.890+0000 7f1515c08740 1 --2- 172.21.15.90:0/1464927349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e86882380 0x557e868b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.890+0000 7f1515c08740 1 --2- 172.21.15.90:0/1464927349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868a2df0 0x557e868b1b20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.890+0000 7f14eb7fe640 0 client.5055 ms_handle_reset on v2:172.21.15.171:6835/2513837234 2024-09-10T23:15:23.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.890+0000 7f1515c08740 1 --2- 172.21.15.90:0/1464927349 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e868831b0 0x557e86881e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.890+0000 7f1515c08740 1 -- 172.21.15.90:0/1464927349 >> 172.21.15.90:0/1464927349 conn(0x557e868585f0 msgr2=0x557e8685cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:23.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.890+0000 7f1515c08740 1 -- 172.21.15.90:0/1464927349 shutdown_connections 2024-09-10T23:15:23.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.890+0000 7f1515c08740 1 -- 172.21.15.90:0/1464927349 wait complete. 2024-09-10T23:15:23.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.890+0000 7f1515c08740 20 client.5055 trim_cache size 0 max 16384 2024-09-10T23:15:23.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.908+0000 7f1515c08740 1 Processor -- start 2024-09-10T23:15:23.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.908+0000 7f1515c08740 1 -- start start 2024-09-10T23:15:23.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.908+0000 7f1515c08740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e86882380 0x557e86883c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.908+0000 7f1515c08740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868831b0 0x557e8685e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.908+0000 7f1515c08740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e868a2df0 0x557e8689b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.908+0000 7f1515c08740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f150c1fe140 con 0x557e868831b0 2024-09-10T23:15:23.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.908+0000 7f1515c08740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f150c0c76d0 con 0x557e868a2df0 2024-09-10T23:15:23.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.908+0000 7f1515c08740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f150c1f3220 con 0x557e86882380 2024-09-10T23:15:23.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.908+0000 7f1503fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868831b0 0x557e8685e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.908+0000 7f1503fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868831b0 0x557e8685e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37438/0 (socket says 172.21.15.90:37438) 2024-09-10T23:15:23.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.908+0000 7f1503fff640 1 -- 172.21.15.90:0/2584486781 learned_addr learned my addr 172.21.15.90:0/2584486781 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:23.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.909+0000 7f1503fff640 1 -- 172.21.15.90:0/2584486781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e86882380 msgr2=0x557e86883c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:23.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.909+0000 7f1503fff640 1 --2- 172.21.15.90:0/2584486781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e86882380 0x557e86883c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.909+0000 7f1503fff640 1 -- 172.21.15.90:0/2584486781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e868a2df0 msgr2=0x557e8689b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:23.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.909+0000 7f1503fff640 1 --2- 172.21.15.90:0/2584486781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e868a2df0 0x557e8689b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.909+0000 7f1503fff640 1 -- 172.21.15.90:0/2584486781 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e8686bc40 con 0x557e868831b0 2024-09-10T23:15:23.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.909+0000 7f1503fff640 1 --2- 172.21.15.90:0/2584486781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868831b0 0x557e8685e0a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0b94d0 tx=0x7f14fc088000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91db13abc46714e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:23.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.909+0000 7f14f1ffb640 1 -- 172.21.15.90:0/2584486781 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc049070 con 0x557e868831b0 2024-09-10T23:15:23.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.909+0000 7f14f1ffb640 1 -- 172.21.15.90:0/2584486781 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14fc08c220 con 0x557e868831b0 2024-09-10T23:15:23.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.909+0000 7f14f1ffb640 1 -- 172.21.15.90:0/2584486781 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc07fa30 con 0x557e868831b0 2024-09-10T23:15:23.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.909+0000 7f1515c08740 1 -- 172.21.15.90:0/2584486781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868831b0 msgr2=0x557e8685e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.909+0000 7f1515c08740 1 --2- 172.21.15.90:0/2584486781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868831b0 0x557e8685e0a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0b94d0 tx=0x7f14fc088000 comp rx=0 tx=0).stop 2024-09-10T23:15:23.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.909+0000 7f1515c08740 1 -- 172.21.15.90:0/2584486781 shutdown_connections 2024-09-10T23:15:23.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.909+0000 7f1515c08740 1 --2- 172.21.15.90:0/2584486781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e868a2df0 0x557e8689b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.909+0000 7f1515c08740 1 --2- 172.21.15.90:0/2584486781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e868831b0 0x557e8685e0a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.909+0000 7f1515c08740 1 --2- 172.21.15.90:0/2584486781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e86882380 0x557e86883c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.909+0000 7f1515c08740 1 -- 172.21.15.90:0/2584486781 >> 172.21.15.90:0/2584486781 conn(0x557e868585f0 msgr2=0x557e86881c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:23.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.909+0000 7f1515c08740 1 -- 172.21.15.90:0/2584486781 shutdown_connections 2024-09-10T23:15:23.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.910+0000 7f1515c08740 1 -- 172.21.15.90:0/2584486781 wait complete. 2024-09-10T23:15:23.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.910+0000 7f1515c08740 1 -- start start 2024-09-10T23:15:23.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.910+0000 7f1515c08740 1 Processor -- start 2024-09-10T23:15:23.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f1515c08740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e86882380 0x557e8687d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f1515c08740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e868831b0 0x557e869220b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f1515c08740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e868a2df0 0x557e868b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f1515c08740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557e8652f620 con 0x557e86882380 2024-09-10T23:15:23.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f1515c08740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x557e867645f0 con 0x557e868831b0 2024-09-10T23:15:23.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f1515c08740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x557e8687b620 con 0x557e868a2df0 2024-09-10T23:15:23.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f1515c08740 10 client.0 _ll_register_callbacks cb 0x7f14fc07f330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:15:23.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f1510bd8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e86882380 0x557e8687d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f1510bd8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e86882380 0x557e8687d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37450/0 (socket says 172.21.15.90:37450) 2024-09-10T23:15:23.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f1510bd8640 1 -- 172.21.15.90:0/2861902815 learned_addr learned my addr 172.21.15.90:0/2861902815 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:23.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f1503fff640 1 --2- 172.21.15.90:0/2861902815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e868831b0 0x557e869220b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f15113d9640 1 --2- 172.21.15.90:0/2861902815 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e868a2df0 0x557e868b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f1510bd8640 1 -- 172.21.15.90:0/2861902815 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e868a2df0 msgr2=0x557e868b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:23.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f1510bd8640 1 --2- 172.21.15.90:0/2861902815 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e868a2df0 0x557e868b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f1510bd8640 1 -- 172.21.15.90:0/2861902815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e868831b0 msgr2=0x557e869220b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:23.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f1510bd8640 1 --2- 172.21.15.90:0/2861902815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e868831b0 0x557e869220b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f1510bd8640 1 -- 172.21.15.90:0/2861902815 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e8687a4e0 con 0x557e86882380 2024-09-10T23:15:23.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.911+0000 7f1503fff640 1 --2- 172.21.15.90:0/2861902815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e868831b0 0x557e869220b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:23.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.912+0000 7f1510bd8640 1 --2- 172.21.15.90:0/2861902815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e86882380 0x557e8687d350 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x557e868b5a00 tx=0x7f1508004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b7f9449fbdcdef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:23.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.912+0000 7f14eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:15:23.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.912+0000 7f14eb7fe640 1 -- 172.21.15.90:0/2861902815 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1508019810 con 0x557e86882380 2024-09-10T23:15:23.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.912+0000 7f14eb7fe640 1 -- 172.21.15.90:0/2861902815 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f15080199b0 con 0x557e86882380 2024-09-10T23:15:23.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.912+0000 7f1515c08740 1 -- 172.21.15.90:0/2861902815 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557e867cd220 con 0x557e86882380 2024-09-10T23:15:23.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.912+0000 7f14eb7fe640 1 -- 172.21.15.90:0/2861902815 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f1508036050 con 0x557e86882380 2024-09-10T23:15:23.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.912+0000 7f1515c08740 10 client.5061 fetch_fsmap learned FSMap version 14 2024-09-10T23:15:23.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.912+0000 7f1515c08740 1 -- 172.21.15.90:0/2861902815 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x557e8689bf30 con 0x557e86882380 2024-09-10T23:15:23.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.912+0000 7f14eb7fe640 1 -- 172.21.15.90:0/2861902815 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x557e867cd220 con 0x557e86882380 2024-09-10T23:15:23.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.912+0000 7f14eb7fe640 1 -- 172.21.15.90:0/2861902815 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7f1508039020 con 0x557e86882380 2024-09-10T23:15:23.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.912+0000 7f1515c08740 10 client.5061 fetch_fsmap finished waiting for FSMap version 14 2024-09-10T23:15:23.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.912+0000 7f1515c08740 10 client.5061 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:15:23.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.912+0000 7f1515c08740 20 client.5061 populate_metadata read hostname 'smithi090' 2024-09-10T23:15:23.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.912+0000 7f1515c08740 1 --2- 172.21.15.90:0/2861902815 >> [v2:172.21.15.171:6835/2513837234,v1:172.21.15.171:6837/2513837234] conn(0x557e868a2500 0x557e8689a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:23.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.912+0000 7f1515c08740 4 client.5061 mds_command: new command op to 4881 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:15:23.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.912+0000 7f1515c08740 1 -- 172.21.15.90:0/2861902815 --> [v2:172.21.15.171:6835/2513837234,v1:172.21.15.171:6837/2513837234] -- command(tid 0: {"prefix": "status"}) -- 0x557e867ca650 con 0x557e868a2500 2024-09-10T23:15:23.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.912+0000 7f1503fff640 1 --2- 172.21.15.90:0/2861902815 >> [v2:172.21.15.171:6835/2513837234,v1:172.21.15.171:6837/2513837234] conn(0x557e868a2500 0x557e8689a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:23.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.913+0000 7f1503fff640 1 --2- 172.21.15.90:0/2861902815 >> [v2:172.21.15.171:6835/2513837234,v1:172.21.15.171:6837/2513837234] conn(0x557e868a2500 0x557e8689a6f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e497b4acb5523bfa server_cookie=c24c33a32876ade8 in_seq=0 out_seq=0 2024-09-10T23:15:23.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.913+0000 7f14eb7fe640 10 client.5061 ms_handle_connect on v2:172.21.15.171:6835/2513837234 2024-09-10T23:15:23.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.913+0000 7f14eb7fe640 1 -- 172.21.15.90:0/2861902815 <== mds.0 v2:172.21.15.171:6835/2513837234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x557e867ca650 con 0x557e868a2500 2024-09-10T23:15:23.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.913+0000 7f14eb7fe640 10 client.5061 handle_command_reply: tid=0 2024-09-10T23:15:23.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.913+0000 7f1515c08740 1 client.5061 shutdown 2024-09-10T23:15:23.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.913+0000 7f1515c08740 1 -- 172.21.15.90:0/2861902815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e86882380 msgr2=0x557e8687d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.913+0000 7f1515c08740 1 --2- 172.21.15.90:0/2861902815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e86882380 0x557e8687d350 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x557e868b5a00 tx=0x7f1508004a30 comp rx=0 tx=0).stop 2024-09-10T23:15:23.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.913+0000 7f1515c08740 1 -- 172.21.15.90:0/2861902815 shutdown_connections 2024-09-10T23:15:23.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.913+0000 7f1515c08740 1 --2- 172.21.15.90:0/2861902815 >> [v2:172.21.15.171:6835/2513837234,v1:172.21.15.171:6837/2513837234] conn(0x557e868a2500 0x557e8689a6f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.913+0000 7f1515c08740 1 --2- 172.21.15.90:0/2861902815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557e868831b0 0x557e869220b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.913+0000 7f1515c08740 1 --2- 172.21.15.90:0/2861902815 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557e868a2df0 0x557e868b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.913+0000 7f14eb7fe640 0 client.5061 ms_handle_reset on v2:172.21.15.171:6835/2513837234 2024-09-10T23:15:23.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.913+0000 7f1515c08740 1 --2- 172.21.15.90:0/2861902815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557e86882380 0x557e8687d350 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.913+0000 7f1515c08740 1 -- 172.21.15.90:0/2861902815 >> 172.21.15.90:0/2861902815 conn(0x557e868585f0 msgr2=0x557e8685e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:23.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.913+0000 7f1515c08740 1 -- 172.21.15.90:0/2861902815 shutdown_connections 2024-09-10T23:15:23.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.913+0000 7f1515c08740 1 -- 172.21.15.90:0/2861902815 wait complete. 2024-09-10T23:15:23.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.913+0000 7f1515c08740 20 client.5061 trim_cache size 0 max 16384 2024-09-10T23:15:23.929 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:15:23.929 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd", 2024-09-10T23:15:23.929 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2024-09-10T23:15:23.930 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4881, 2024-09-10T23:15:23.930 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-09-10T23:15:23.930 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-09-10T23:15:23.930 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2024-09-10T23:15:23.930 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 9.1388420610000001, 2024-09-10T23:15:23.930 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 14, 2024-09-10T23:15:23.931 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 34, 2024-09-10T23:15:23.931 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 34, 2024-09-10T23:15:23.931 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 16.034849812000001 2024-09-10T23:15:23.931 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:15:23.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.914+0000 7f1512e3c640 1 -- 172.21.15.90:0/765263577 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14f8077f70 msgr2=0x7f14f807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.914+0000 7f1512e3c640 1 --2- 172.21.15.90:0/765263577 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14f8077f70 0x7f14f807a430 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f150800abb0 tx=0x7f1508009250 comp rx=0 tx=0).stop 2024-09-10T23:15:23.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.914+0000 7f1512e3c640 1 -- 172.21.15.90:0/765263577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150c0d0180 msgr2=0x7f150c144600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.914+0000 7f1512e3c640 1 --2- 172.21.15.90:0/765263577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150c0d0180 0x7f150c144600 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0099c0 tx=0x7f14fc0039e0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.914+0000 7f1512e3c640 1 -- 172.21.15.90:0/765263577 shutdown_connections 2024-09-10T23:15:23.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.914+0000 7f1512e3c640 1 --2- 172.21.15.90:0/765263577 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14f8077f70 0x7f14f807a430 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.914+0000 7f1512e3c640 1 --2- 172.21.15.90:0/765263577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f150c15bec0 0x7f150c158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.914+0000 7f1512e3c640 1 --2- 172.21.15.90:0/765263577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150c0d0180 0x7f150c144600 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.914+0000 7f1512e3c640 1 --2- 172.21.15.90:0/765263577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f150c0b55a0 0x7f150c0ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.914+0000 7f1512e3c640 1 -- 172.21.15.90:0/765263577 >> 172.21.15.90:0/765263577 conn(0x7f150c0d1dd0 msgr2=0x7f150c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:23.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.914+0000 7f1512e3c640 1 -- 172.21.15.90:0/765263577 shutdown_connections 2024-09-10T23:15:23.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:23.914+0000 7f1512e3c640 1 -- 172.21.15.90:0/765263577 wait complete. 2024-09-10T23:15:23.937 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:15:24.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.037+0000 7f687629b640 1 -- 172.21.15.90:0/4262387983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68700d2470 msgr2=0x7f68700b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:24.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.037+0000 7f687629b640 1 --2- 172.21.15.90:0/4262387983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68700d2470 0x7f68700b3490 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6860009830 tx=0x7f686002a510 comp rx=0 tx=0).stop 2024-09-10T23:15:24.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.037+0000 7f687629b640 1 -- 172.21.15.90:0/4262387983 shutdown_connections 2024-09-10T23:15:24.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.037+0000 7f687629b640 1 --2- 172.21.15.90:0/4262387983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68700d2470 0x7f68700b3490 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:24.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.037+0000 7f687629b640 1 -- 172.21.15.90:0/4262387983 >> 172.21.15.90:0/4262387983 conn(0x7f687009d2a0 msgr2=0x7f68700d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:24.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.037+0000 7f687629b640 1 -- 172.21.15.90:0/4262387983 shutdown_connections 2024-09-10T23:15:24.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.037+0000 7f687629b640 1 -- 172.21.15.90:0/4262387983 wait complete. 2024-09-10T23:15:24.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.038+0000 7f687629b640 1 Processor -- start 2024-09-10T23:15:24.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.038+0000 7f687629b640 1 -- start start 2024-09-10T23:15:24.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.039+0000 7f687629b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68700b3a00 0x7f68701f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:24.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.039+0000 7f687629b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68700d1c70 0x7f68700c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:24.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.039+0000 7f687629b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68700d2470 0x7f68700c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:24.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.039+0000 7f687629b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f68700b4740 con 0x7f68700b3a00 2024-09-10T23:15:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.039+0000 7f687629b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f68700b45c0 con 0x7f68700d2470 2024-09-10T23:15:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.039+0000 7f687629b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f68700b48c0 con 0x7f68700d1c70 2024-09-10T23:15:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.039+0000 7f686ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68700b3a00 0x7f68701f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.039+0000 7f686ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68700b3a00 0x7f68701f5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37478/0 (socket says 172.21.15.90:37478) 2024-09-10T23:15:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.039+0000 7f686ffff640 1 -- 172.21.15.90:0/4087293313 learned_addr learned my addr 172.21.15.90:0/4087293313 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.039+0000 7f6867fff640 1 --2- 172.21.15.90:0/4087293313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68700d1c70 0x7f68700c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.039+0000 7f6874838640 1 --2- 172.21.15.90:0/4087293313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68700d2470 0x7f68700c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.039+0000 7f686ffff640 1 -- 172.21.15.90:0/4087293313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68700d1c70 msgr2=0x7f68700c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.039+0000 7f686ffff640 1 --2- 172.21.15.90:0/4087293313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68700d1c70 0x7f68700c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.039+0000 7f686ffff640 1 -- 172.21.15.90:0/4087293313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68700d2470 msgr2=0x7f68700c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.039+0000 7f686ffff640 1 --2- 172.21.15.90:0/4087293313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68700d2470 0x7f68700c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.039+0000 7f686ffff640 1 -- 172.21.15.90:0/4087293313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68700c7e20 con 0x7f68700b3a00 2024-09-10T23:15:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.039+0000 7f6874838640 1 --2- 172.21.15.90:0/4087293313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68700d2470 0x7f68700c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:24.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.040+0000 7f686ffff640 1 --2- 172.21.15.90:0/4087293313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68700b3a00 0x7f68701f5280 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6860009950 tx=0x7f6860033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:24.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.040+0000 7f686d7fa640 1 -- 172.21.15.90:0/4087293313 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860031d60 con 0x7f68700b3a00 2024-09-10T23:15:24.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.040+0000 7f686d7fa640 1 -- 172.21.15.90:0/4087293313 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6860033e10 con 0x7f68700b3a00 2024-09-10T23:15:24.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.040+0000 7f686d7fa640 1 -- 172.21.15.90:0/4087293313 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860005260 con 0x7f68700b3a00 2024-09-10T23:15:24.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.040+0000 7f687629b640 1 -- 172.21.15.90:0/4087293313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68700c8100 con 0x7f68700b3a00 2024-09-10T23:15:24.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.040+0000 7f687629b640 1 -- 172.21.15.90:0/4087293313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68700c86c0 con 0x7f68700b3a00 2024-09-10T23:15:24.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.041+0000 7f687629b640 1 -- 172.21.15.90:0/4087293313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68700b3490 con 0x7f68700b3a00 2024-09-10T23:15:24.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.042+0000 7f686d7fa640 1 -- 172.21.15.90:0/4087293313 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6860005400 con 0x7f68700b3a00 2024-09-10T23:15:24.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.042+0000 7f686d7fa640 1 --2- 172.21.15.90:0/4087293313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6850077fa0 0x7f685007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:24.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.042+0000 7f686d7fa640 1 -- 172.21.15.90:0/4087293313 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f68600baed0 con 0x7f68700b3a00 2024-09-10T23:15:24.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.042+0000 7f6867fff640 1 --2- 172.21.15.90:0/4087293313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6850077fa0 0x7f685007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:24.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.043+0000 7f6867fff640 1 --2- 172.21.15.90:0/4087293313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6850077fa0 0x7f685007a460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f68700c9340 tx=0x7f6858009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:24.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.046+0000 7f686d7fa640 1 -- 172.21.15.90:0/4087293313 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f686003f030 con 0x7f68700b3a00 2024-09-10T23:15:24.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.258+0000 7f687629b640 1 -- 172.21.15.90:0/4087293313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f68700b20f0 con 0x7f68700b3a00 2024-09-10T23:15:24.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.258+0000 7f686d7fa640 1 -- 172.21.15.90:0/4087293313 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f68600839d0 con 0x7f68700b3a00 2024-09-10T23:15:24.259 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:15:24.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.260+0000 7f687629b640 1 -- 172.21.15.90:0/4087293313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6850077fa0 msgr2=0x7f685007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:24.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.260+0000 7f687629b640 1 --2- 172.21.15.90:0/4087293313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6850077fa0 0x7f685007a460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f68700c9340 tx=0x7f6858009040 comp rx=0 tx=0).stop 2024-09-10T23:15:24.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.260+0000 7f687629b640 1 -- 172.21.15.90:0/4087293313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68700b3a00 msgr2=0x7f68701f5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:24.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.260+0000 7f687629b640 1 --2- 172.21.15.90:0/4087293313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68700b3a00 0x7f68701f5280 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6860009950 tx=0x7f6860033c20 comp rx=0 tx=0).stop 2024-09-10T23:15:24.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.260+0000 7f687629b640 1 -- 172.21.15.90:0/4087293313 shutdown_connections 2024-09-10T23:15:24.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.260+0000 7f687629b640 1 --2- 172.21.15.90:0/4087293313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6850077fa0 0x7f685007a460 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:24.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.260+0000 7f687629b640 1 --2- 172.21.15.90:0/4087293313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68700d2470 0x7f68700c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:24.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.260+0000 7f687629b640 1 --2- 172.21.15.90:0/4087293313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68700d1c70 0x7f68700c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:24.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.260+0000 7f687629b640 1 --2- 172.21.15.90:0/4087293313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68700b3a00 0x7f68701f5280 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:24.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.260+0000 7f687629b640 1 -- 172.21.15.90:0/4087293313 >> 172.21.15.90:0/4087293313 conn(0x7f687009d2a0 msgr2=0x7f68700b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:24.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.260+0000 7f687629b640 1 -- 172.21.15.90:0/4087293313 shutdown_connections 2024-09-10T23:15:24.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24.260+0000 7f687629b640 1 -- 172.21.15.90:0/4087293313 wait complete. 2024-09-10T23:15:24.272 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:15:24.272 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:15:24.272 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2024-09-10T23:15:24.272 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:15:24.272 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:15:24.272 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:15:24.272 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:15:24.272 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:15:24.272 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:15:24.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:24.273 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2024-09-10T23:15:24.289 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:15:24.289 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:15:24.289 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:15:24.289 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:24.289 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-10T23:15:24.289 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:24.289 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:15:24.289 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:24.289 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2024-09-10T23:15:24.289 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:15:24.289 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:24.289 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2024-09-10T23:15:24.290 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:15:24.290 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:24.290 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:15:24.290 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:24.290 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:15:24.290 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42724sec preferred_lft 42724sec 2024-09-10T23:15:24.290 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link noprefixroute 2024-09-10T23:15:24.290 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:24.290 INFO:teuthology.orchestra.run.smithi090.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:15:24.290 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:24.290 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:15:24.290 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:24.290 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::882a:a9ff:fefc:893f/64 scope link 2024-09-10T23:15:24.291 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:24.291 INFO:teuthology.orchestra.run.smithi090.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:15:24.291 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 76:ad:51:1a:2a:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:15:24.291 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::74ad:51ff:fe1a:2a60/64 scope link 2024-09-10T23:15:24.291 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:24.291 INFO:teuthology.orchestra.run.smithi090.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:15:24.291 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:15:24.291 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::3414:abff:fe49:366c/64 scope link 2024-09-10T23:15:24.291 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:24.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:24.292 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:15:24.353 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-09-10T23:15:24.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:24.354 DEBUG:teuthology.orchestra.run.smithi090:> route 2024-09-10T23:15:24.411 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2024-09-10T23:15:24.411 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:15:24.411 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:15:24.411 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:15:24.411 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:15:24.412 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:15:24.412 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:15:24.412 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:15:24.412 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:15:24.412 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:15:24.412 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:15:24.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:15:24.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:15:24.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:24.538 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-10T23:15:24.553 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:15:24.554 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:15:24.554 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:15:24.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:24.554 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2024-09-10T23:15:24.590 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:15:24.597 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:15:24.619 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:15:24.619 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:15:24.704 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:15:24.705 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:15:24.705 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:15:24.760 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:15:24.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:24.760 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:15:24.843 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:15:24.843 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:15:24.843 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:15:24.852 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:15:24.852 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:15:24.852 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:15:24.853 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:15:24.853 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:15:24.857 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:15:24.858 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:15:24.858 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:15:24.858 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:15:24.858 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:15:24.858 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:15:24.859 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:15:24.859 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:15:24.860 INFO:teuthology.orchestra.run.smithi090.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T23:15:24.860 INFO:teuthology.orchestra.run.smithi090.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:15:24.861 INFO:teuthology.orchestra.run.smithi090.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:15:24.861 INFO:teuthology.orchestra.run.smithi090.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:15:24.861 INFO:teuthology.orchestra.run.smithi090.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:15:24.861 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:15:24.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:24.862 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:15:24.926 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:15:25.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:15:25.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:15:25.029 INFO:teuthology.orchestra.run.smithi090.stdout:client5073 2024-09-10T23:15:25.029 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:25.029 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:25.046 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:15:25.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.186+0000 7f8c246fe640 1 -- 172.21.15.90:0/3432703830 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c06f850 msgr2=0x7f8c1c06ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:25.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.186+0000 7f8c246fe640 1 --2- 172.21.15.90:0/3432703830 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c06f850 0x7f8c1c06ec20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009830 tx=0x7f8c0c02a510 comp rx=0 tx=0).stop 2024-09-10T23:15:25.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.186+0000 7f8c246fe640 1 -- 172.21.15.90:0/3432703830 shutdown_connections 2024-09-10T23:15:25.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.186+0000 7f8c246fe640 1 --2- 172.21.15.90:0/3432703830 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c06f850 0x7f8c1c06ec20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:25.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.186+0000 7f8c246fe640 1 --2- 172.21.15.90:0/3432703830 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c1c15bcb0 0x7f8c1c0cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:25.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.186+0000 7f8c246fe640 1 -- 172.21.15.90:0/3432703830 >> 172.21.15.90:0/3432703830 conn(0x7f8c1c0cc850 msgr2=0x7f8c1c0ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:25.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.186+0000 7f8c246fe640 1 -- 172.21.15.90:0/3432703830 shutdown_connections 2024-09-10T23:15:25.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.186+0000 7f8c246fe640 1 -- 172.21.15.90:0/3432703830 wait complete. 2024-09-10T23:15:25.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.187+0000 7f8c246fe640 1 Processor -- start 2024-09-10T23:15:25.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.187+0000 7f8c246fe640 1 -- start start 2024-09-10T23:15:25.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.188+0000 7f8c246fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c06f160 0x7f8c1c1f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:25.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.188+0000 7f8c246fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c1c06f850 0x7f8c1c0b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:25.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.188+0000 7f8c246fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c1c15bcb0 0x7f8c1c09cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:25.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.188+0000 7f8c246fe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c0b1850 con 0x7f8c1c06f850 2024-09-10T23:15:25.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.188+0000 7f8c246fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c0cad80 con 0x7f8c1c06f160 2024-09-10T23:15:25.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.188+0000 7f8c246fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1c0b19d0 con 0x7f8c1c15bcb0 2024-09-10T23:15:25.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.188+0000 7f8c21c99640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c1c06f850 0x7f8c1c0b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:25.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.188+0000 7f8c21c99640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c1c06f850 0x7f8c1c0b4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37490/0 (socket says 172.21.15.90:37490) 2024-09-10T23:15:25.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.188+0000 7f8c21c99640 1 -- 172.21.15.90:0/1361293993 learned_addr learned my addr 172.21.15.90:0/1361293993 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:25.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.188+0000 7f8c2249a640 1 --2- 172.21.15.90:0/1361293993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c06f160 0x7f8c1c1f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:25.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.188+0000 7f8c22c9b640 1 --2- 172.21.15.90:0/1361293993 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c1c15bcb0 0x7f8c1c09cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:25.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.189+0000 7f8c21c99640 1 -- 172.21.15.90:0/1361293993 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c1c15bcb0 msgr2=0x7f8c1c09cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:25.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.189+0000 7f8c21c99640 1 --2- 172.21.15.90:0/1361293993 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c1c15bcb0 0x7f8c1c09cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:25.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.189+0000 7f8c21c99640 1 -- 172.21.15.90:0/1361293993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c06f160 msgr2=0x7f8c1c1f2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:25.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.189+0000 7f8c21c99640 1 --2- 172.21.15.90:0/1361293993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c06f160 0x7f8c1c1f2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:25.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.189+0000 7f8c21c99640 1 -- 172.21.15.90:0/1361293993 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c0b4ca0 con 0x7f8c1c06f850 2024-09-10T23:15:25.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.189+0000 7f8c21c99640 1 --2- 172.21.15.90:0/1361293993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c1c06f850 0x7f8c1c0b4370 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c000c00 tx=0x7f8c0c032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:25.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.189+0000 7f8c12ffd640 1 -- 172.21.15.90:0/1361293993 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c040070 con 0x7f8c1c06f850 2024-09-10T23:15:25.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.189+0000 7f8c12ffd640 1 -- 172.21.15.90:0/1361293993 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c0c0038e0 con 0x7f8c1c06f850 2024-09-10T23:15:25.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.189+0000 7f8c12ffd640 1 -- 172.21.15.90:0/1361293993 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c003d30 con 0x7f8c1c06f850 2024-09-10T23:15:25.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.189+0000 7f8c246fe640 1 -- 172.21.15.90:0/1361293993 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c1c0c3b50 con 0x7f8c1c06f850 2024-09-10T23:15:25.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.189+0000 7f8c246fe640 1 -- 172.21.15.90:0/1361293993 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c1c1f3340 con 0x7f8c1c06f850 2024-09-10T23:15:25.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.190+0000 7f8c246fe640 1 -- 172.21.15.90:0/1361293993 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c1c06a1b0 con 0x7f8c1c06f850 2024-09-10T23:15:25.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.191+0000 7f8c12ffd640 1 -- 172.21.15.90:0/1361293993 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8c0c04d030 con 0x7f8c1c06f850 2024-09-10T23:15:25.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.191+0000 7f8c12ffd640 1 --2- 172.21.15.90:0/1361293993 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8c00077f70 0x7f8c0007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:25.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.191+0000 7f8c12ffd640 1 -- 172.21.15.90:0/1361293993 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8c0c0bb280 con 0x7f8c1c06f850 2024-09-10T23:15:25.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.191+0000 7f8c2249a640 1 --2- 172.21.15.90:0/1361293993 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8c00077f70 0x7f8c0007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:25.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.192+0000 7f8c2249a640 1 --2- 172.21.15.90:0/1361293993 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8c00077f70 0x7f8c0007a430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009b30 tx=0x7f8c18005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:25.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.195+0000 7f8c12ffd640 1 -- 172.21.15.90:0/1361293993 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8c1c06a1b0 con 0x7f8c1c06f850 2024-09-10T23:15:25.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.404+0000 7f8c246fe640 1 -- 172.21.15.90:0/1361293993 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8c1c0b1e80 con 0x7f8c1c06f850 2024-09-10T23:15:25.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.405+0000 7f8c12ffd640 1 -- 172.21.15.90:0/1361293993 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f8c0c0837c0 con 0x7f8c1c06f850 2024-09-10T23:15:25.406 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:15:25.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.407+0000 7f8c246fe640 1 -- 172.21.15.90:0/1361293993 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8c00077f70 msgr2=0x7f8c0007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:25.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.407+0000 7f8c246fe640 1 --2- 172.21.15.90:0/1361293993 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8c00077f70 0x7f8c0007a430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009b30 tx=0x7f8c18005f90 comp rx=0 tx=0).stop 2024-09-10T23:15:25.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.407+0000 7f8c246fe640 1 -- 172.21.15.90:0/1361293993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c1c06f850 msgr2=0x7f8c1c0b4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:25.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.407+0000 7f8c246fe640 1 --2- 172.21.15.90:0/1361293993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c1c06f850 0x7f8c1c0b4370 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c000c00 tx=0x7f8c0c032c10 comp rx=0 tx=0).stop 2024-09-10T23:15:25.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.407+0000 7f8c246fe640 1 -- 172.21.15.90:0/1361293993 shutdown_connections 2024-09-10T23:15:25.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.407+0000 7f8c246fe640 1 --2- 172.21.15.90:0/1361293993 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8c00077f70 0x7f8c0007a430 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:25.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.407+0000 7f8c246fe640 1 --2- 172.21.15.90:0/1361293993 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c1c15bcb0 0x7f8c1c09cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:25.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.407+0000 7f8c246fe640 1 --2- 172.21.15.90:0/1361293993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c1c06f850 0x7f8c1c0b4370 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:25.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.407+0000 7f8c246fe640 1 --2- 172.21.15.90:0/1361293993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c06f160 0x7f8c1c1f2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:25.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.407+0000 7f8c246fe640 1 -- 172.21.15.90:0/1361293993 >> 172.21.15.90:0/1361293993 conn(0x7f8c1c0cc850 msgr2=0x7f8c1c0ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:25.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.407+0000 7f8c246fe640 1 -- 172.21.15.90:0/1361293993 shutdown_connections 2024-09-10T23:15:25.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:25.407+0000 7f8c246fe640 1 -- 172.21.15.90:0/1361293993 wait complete. 2024-09-10T23:15:25.419 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:15:25.419 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:15:25.419 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-09-10T23:15:25.419 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T23:15:25.419 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T23:15:25.419 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:15:25.420 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:15:25.420 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:15:25.420 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:15:25.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:25.420 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-09-10T23:15:25.440 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:15:25.440 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:15:25.440 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:15:25.440 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:25.441 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-09-10T23:15:25.441 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:25.441 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:15:25.441 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:25.441 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-09-10T23:15:25.441 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:15:25.441 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:25.441 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-09-10T23:15:25.441 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:15:25.441 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:25.441 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:15:25.441 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:25.442 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:15:25.442 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42705sec preferred_lft 42705sec 2024-09-10T23:15:25.442 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link noprefixroute 2024-09-10T23:15:25.442 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:25.442 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:15:25.442 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:25.442 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:15:25.442 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:25.442 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::c18:12ff:fe41:788b/64 scope link 2024-09-10T23:15:25.442 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:25.442 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:15:25.442 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:15:25.442 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a0e4:c6ff:fe48:8d44/64 scope link 2024-09-10T23:15:25.443 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:25.444 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:15:25.444 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a6:c9:8b:0f:78:86 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:15:25.444 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a4c9:8bff:fe0f:7886/64 scope link 2024-09-10T23:15:25.444 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:25.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:25.444 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:15:25.507 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-09-10T23:15:25.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:25.509 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-09-10T23:15:25.566 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-09-10T23:15:25.566 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:15:25.566 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:15:25.566 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:15:25.566 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:15:25.567 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:15:25.567 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:15:25.567 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:15:25.567 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:15:25.567 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:15:25.567 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:15:25.655 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:15:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:15:25.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:15:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:15:25.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:25.695 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-09-10T23:15:25.710 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T23:15:25.711 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T23:15:25.711 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:15:25.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:25.711 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-09-10T23:15:25.776 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:15:25.776 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T23:15:25.831 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:15:25.831 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:15:25.831 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:15:25.886 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:15:25.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:25.886 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:15:25.970 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:15:25.971 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:15:25.971 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:15:25.980 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:15:25.980 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:15:25.980 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:15:25.980 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:15:25.980 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:15:25.985 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:15:25.985 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:15:25.985 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:15:25.985 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:15:25.985 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:15:25.986 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:15:25.986 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:15:25.986 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:15:25.986 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T23:15:25.986 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:15:25.986 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:15:25.987 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:15:25.987 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:15:25.988 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:15:25.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:25.989 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:15:26.013 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:15:26.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:15:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:15:26.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:15:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:15:26.113 INFO:teuthology.orchestra.run.smithi171.stdout:client5079 2024-09-10T23:15:26.114 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:15:26.114 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:26.130 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds ms_async_reap_threshold 1 2024-09-10T23:15:26.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.238+0000 7fe38e4ed640 1 -- 172.21.15.90:0/3668105756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe38815e0f0 msgr2=0x7fe3880d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:26.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.238+0000 7fe38e4ed640 1 --2- 172.21.15.90:0/3668105756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe38815e0f0 0x7fe3880d2ea0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe378009830 tx=0x7fe37802a510 comp rx=0 tx=0).stop 2024-09-10T23:15:26.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.238+0000 7fe38e4ed640 1 -- 172.21.15.90:0/3668105756 shutdown_connections 2024-09-10T23:15:26.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.238+0000 7fe38e4ed640 1 --2- 172.21.15.90:0/3668105756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe38815e0f0 0x7fe3880d2ea0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:26.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.238+0000 7fe38e4ed640 1 -- 172.21.15.90:0/3668105756 >> 172.21.15.90:0/3668105756 conn(0x7fe3880d4190 msgr2=0x7fe3880d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:26.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.238+0000 7fe38e4ed640 1 -- 172.21.15.90:0/3668105756 shutdown_connections 2024-09-10T23:15:26.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.238+0000 7fe38e4ed640 1 -- 172.21.15.90:0/3668105756 wait complete. 2024-09-10T23:15:26.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.239+0000 7fe38e4ed640 1 Processor -- start 2024-09-10T23:15:26.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.240+0000 7fe38e4ed640 1 -- start start 2024-09-10T23:15:26.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.240+0000 7fe38e4ed640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3880cfd20 0x7fe3881f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:26.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.240+0000 7fe38e4ed640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3880d1cd0 0x7fe388149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:26.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.240+0000 7fe38e4ed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe38815e0f0 0x7fe3880c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:26.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.240+0000 7fe38e4ed640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe3880b94a0 con 0x7fe38815e0f0 2024-09-10T23:15:26.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.240+0000 7fe38e4ed640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe3880b9320 con 0x7fe3880cfd20 2024-09-10T23:15:26.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.240+0000 7fe38e4ed640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe3880b9620 con 0x7fe3880d1cd0 2024-09-10T23:15:26.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.240+0000 7fe38ca8a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe38815e0f0 0x7fe3880c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:26.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.241+0000 7fe387fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3880cfd20 0x7fe3881f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:26.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.241+0000 7fe38ca8a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe38815e0f0 0x7fe3880c7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37494/0 (socket says 172.21.15.90:37494) 2024-09-10T23:15:26.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.241+0000 7fe38ca8a640 1 -- 172.21.15.90:0/732334815 learned_addr learned my addr 172.21.15.90:0/732334815 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:26.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.241+0000 7fe3877fe640 1 --2- 172.21.15.90:0/732334815 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3880d1cd0 0x7fe388149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:26.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.241+0000 7fe38ca8a640 1 -- 172.21.15.90:0/732334815 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3880d1cd0 msgr2=0x7fe388149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:26.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.241+0000 7fe38ca8a640 1 --2- 172.21.15.90:0/732334815 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3880d1cd0 0x7fe388149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:26.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.241+0000 7fe38ca8a640 1 -- 172.21.15.90:0/732334815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3880cfd20 msgr2=0x7fe3881f8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:26.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.241+0000 7fe38ca8a640 1 --2- 172.21.15.90:0/732334815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3880cfd20 0x7fe3881f8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:26.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.241+0000 7fe38ca8a640 1 -- 172.21.15.90:0/732334815 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3881f9170 con 0x7fe38815e0f0 2024-09-10T23:15:26.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.241+0000 7fe38ca8a640 1 --2- 172.21.15.90:0/732334815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe38815e0f0 0x7fe3880c7c30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe38000b930 tx=0x7fe38000bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:26.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.241+0000 7fe384ff9640 1 -- 172.21.15.90:0/732334815 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe380019070 con 0x7fe38815e0f0 2024-09-10T23:15:26.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.241+0000 7fe384ff9640 1 -- 172.21.15.90:0/732334815 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe38000cc50 con 0x7fe38815e0f0 2024-09-10T23:15:26.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.241+0000 7fe38e4ed640 1 -- 172.21.15.90:0/732334815 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38814a460 con 0x7fe38815e0f0 2024-09-10T23:15:26.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.241+0000 7fe384ff9640 1 -- 172.21.15.90:0/732334815 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3800146a0 con 0x7fe38815e0f0 2024-09-10T23:15:26.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.241+0000 7fe38e4ed640 1 -- 172.21.15.90:0/732334815 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe388156810 con 0x7fe38815e0f0 2024-09-10T23:15:26.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.242+0000 7fe38e4ed640 1 -- 172.21.15.90:0/732334815 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3880b9aa0 con 0x7fe38815e0f0 2024-09-10T23:15:26.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.243+0000 7fe384ff9640 1 -- 172.21.15.90:0/732334815 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe380014840 con 0x7fe38815e0f0 2024-09-10T23:15:26.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.243+0000 7fe384ff9640 1 --2- 172.21.15.90:0/732334815 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe374077f70 0x7fe37407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:26.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.244+0000 7fe384ff9640 1 -- 172.21.15.90:0/732334815 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe380099c00 con 0x7fe38815e0f0 2024-09-10T23:15:26.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.244+0000 7fe387fff640 1 --2- 172.21.15.90:0/732334815 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe374077f70 0x7fe37407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:26.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.244+0000 7fe387fff640 1 --2- 172.21.15.90:0/732334815 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe374077f70 0x7fe37407a430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe378034000 tx=0x7fe378004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:26.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.248+0000 7fe384ff9640 1 -- 172.21.15.90:0/732334815 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe3800a0080 con 0x7fe38815e0f0 2024-09-10T23:15:26.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.424+0000 7fe38e4ed640 1 -- 172.21.15.90:0/732334815 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=ms_async_reap_threshold}] v 0) -- 0x7fe3880d17f0 con 0x7fe38815e0f0 2024-09-10T23:15:26.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.427+0000 7fe384ff9640 1 -- 172.21.15.90:0/732334815 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=ms_async_reap_threshold}]=0 v29)=0 v29) ==== 121+0+0 (secure 0 0 0) 0x7fe3881f9170 con 0x7fe38815e0f0 2024-09-10T23:15:26.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.429+0000 7fe38e4ed640 1 -- 172.21.15.90:0/732334815 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe374077f70 msgr2=0x7fe37407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:26.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.429+0000 7fe38e4ed640 1 --2- 172.21.15.90:0/732334815 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe374077f70 0x7fe37407a430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe378034000 tx=0x7fe378004730 comp rx=0 tx=0).stop 2024-09-10T23:15:26.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.429+0000 7fe38e4ed640 1 -- 172.21.15.90:0/732334815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe38815e0f0 msgr2=0x7fe3880c7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:26.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.429+0000 7fe38e4ed640 1 --2- 172.21.15.90:0/732334815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe38815e0f0 0x7fe3880c7c30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe38000b930 tx=0x7fe38000bdf0 comp rx=0 tx=0).stop 2024-09-10T23:15:26.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.429+0000 7fe38e4ed640 1 -- 172.21.15.90:0/732334815 shutdown_connections 2024-09-10T23:15:26.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.429+0000 7fe38e4ed640 1 --2- 172.21.15.90:0/732334815 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe374077f70 0x7fe37407a430 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:26.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.429+0000 7fe38e4ed640 1 --2- 172.21.15.90:0/732334815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe38815e0f0 0x7fe3880c7c30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:26.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.429+0000 7fe38e4ed640 1 --2- 172.21.15.90:0/732334815 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3880d1cd0 0x7fe388149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:26.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.429+0000 7fe38e4ed640 1 --2- 172.21.15.90:0/732334815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3880cfd20 0x7fe3881f8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:26.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.429+0000 7fe38e4ed640 1 -- 172.21.15.90:0/732334815 >> 172.21.15.90:0/732334815 conn(0x7fe3880d4190 msgr2=0x7fe3880b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:26.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.430+0000 7fe38e4ed640 1 -- 172.21.15.90:0/732334815 shutdown_connections 2024-09-10T23:15:26.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.430+0000 7fe38e4ed640 1 -- 172.21.15.90:0/732334815 wait complete. 2024-09-10T23:15:26.441 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:26.442 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:26.458 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:26.458 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:26.514 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:15:26.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.654+0000 7fc7970b8640 1 -- 172.21.15.90:0/2328310887 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc77c003a00 msgr2=0x7fc77c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:26.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.654+0000 7fc7970b8640 1 --2- 172.21.15.90:0/2328310887 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc77c003a00 0x7fc77c003e20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc78000c610 tx=0x7fc77c005830 comp rx=0 tx=0).stop 2024-09-10T23:15:26.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.654+0000 7fc795655640 1 -- 172.21.15.90:0/2328310887 reap_dead start 2024-09-10T23:15:26.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.654+0000 7fc7970b8640 1 -- 172.21.15.90:0/2328310887 shutdown_connections 2024-09-10T23:15:26.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.654+0000 7fc7970b8640 1 -- 172.21.15.90:0/2328310887 >> 172.21.15.90:0/2328310887 conn(0x7fc7900cc850 msgr2=0x7fc7900ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:26.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.655+0000 7fc7970b8640 1 -- 172.21.15.90:0/2328310887 shutdown_connections 2024-09-10T23:15:26.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.655+0000 7fc7970b8640 1 -- 172.21.15.90:0/2328310887 wait complete. 2024-09-10T23:15:26.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.656+0000 7fc7970b8640 1 Processor -- start 2024-09-10T23:15:26.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.656+0000 7fc7970b8640 1 -- start start 2024-09-10T23:15:26.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc7970b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc77c003a00 0x7fc79014d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:26.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc7970b8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc790155360 0x7fc7900b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:26.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc7970b8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7900b4190 0x7fc7900b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:26.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc7970b8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc7900b19d0 con 0x7fc790155360 2024-09-10T23:15:26.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc7970b8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc7900b1850 con 0x7fc7900b4190 2024-09-10T23:15:26.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc7970b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc7900b1b50 con 0x7fc77c003a00 2024-09-10T23:15:26.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc78ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc790155360 0x7fc7900b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:26.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc78ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc790155360 0x7fc7900b3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37506/0 (socket says 172.21.15.90:37506) 2024-09-10T23:15:26.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc78ffff640 1 -- 172.21.15.90:0/3500785019 learned_addr learned my addr 172.21.15.90:0/3500785019 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:26.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc794e54640 1 --2- 172.21.15.90:0/3500785019 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc77c003a00 0x7fc79014d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:26.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc795655640 1 --2- 172.21.15.90:0/3500785019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7900b4190 0x7fc7900b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:26.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc78ffff640 1 -- 172.21.15.90:0/3500785019 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc77c003a00 msgr2=0x7fc79014d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:26.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc78ffff640 1 --2- 172.21.15.90:0/3500785019 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc77c003a00 0x7fc79014d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:26.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc78ffff640 1 -- 172.21.15.90:0/3500785019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7900b4190 msgr2=0x7fc7900b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:26.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc78ffff640 1 --2- 172.21.15.90:0/3500785019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7900b4190 0x7fc7900b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:26.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc78ffff640 1 -- 172.21.15.90:0/3500785019 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc790158980 con 0x7fc790155360 2024-09-10T23:15:26.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc78ffff640 1 --2- 172.21.15.90:0/3500785019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc790155360 0x7fc7900b3c50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc778011ae0 tx=0x7fc778011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:26.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc78d7fa640 1 -- 172.21.15.90:0/3500785019 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778004460 con 0x7fc790155360 2024-09-10T23:15:26.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc78d7fa640 1 -- 172.21.15.90:0/3500785019 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc77800f940 con 0x7fc790155360 2024-09-10T23:15:26.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc7970b8640 1 -- 172.21.15.90:0/3500785019 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc79014d650 con 0x7fc790155360 2024-09-10T23:15:26.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc78d7fa640 1 -- 172.21.15.90:0/3500785019 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77800fd70 con 0x7fc790155360 2024-09-10T23:15:26.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.657+0000 7fc7970b8640 1 -- 172.21.15.90:0/3500785019 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7901f1840 con 0x7fc790155360 2024-09-10T23:15:26.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.658+0000 7fc7970b8640 1 -- 172.21.15.90:0/3500785019 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc790074940 con 0x7fc790155360 2024-09-10T23:15:26.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.659+0000 7fc78d7fa640 1 -- 172.21.15.90:0/3500785019 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc7780035f0 con 0x7fc790155360 2024-09-10T23:15:26.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.659+0000 7fc78d7fa640 1 --2- 172.21.15.90:0/3500785019 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc770077f70 0x7fc77007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:26.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.660+0000 7fc78d7fa640 1 -- 172.21.15.90:0/3500785019 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc77809a8e0 con 0x7fc790155360 2024-09-10T23:15:26.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.660+0000 7fc794e54640 1 --2- 172.21.15.90:0/3500785019 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc770077f70 0x7fc77007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:26.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.660+0000 7fc794e54640 1 --2- 172.21.15.90:0/3500785019 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc770077f70 0x7fc77007a430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc780033000 tx=0x7fc780038040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:26.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.664+0000 7fc78d7fa640 1 -- 172.21.15.90:0/3500785019 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc778062d90 con 0x7fc790155360 2024-09-10T23:15:26.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.849+0000 7fc7970b8640 1 -- 172.21.15.90:0/3500785019 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc7900af5e0 con 0x7fc790155360 2024-09-10T23:15:26.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.849+0000 7fc78d7fa640 1 -- 172.21.15.90:0/3500785019 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7fc7780677c0 con 0x7fc790155360 2024-09-10T23:15:26.850 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:15:26.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.851+0000 7fc7970b8640 1 -- 172.21.15.90:0/3500785019 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc770077f70 msgr2=0x7fc77007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:26.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.851+0000 7fc7970b8640 1 --2- 172.21.15.90:0/3500785019 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc770077f70 0x7fc77007a430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc780033000 tx=0x7fc780038040 comp rx=0 tx=0).stop 2024-09-10T23:15:26.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.851+0000 7fc7970b8640 1 -- 172.21.15.90:0/3500785019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc790155360 msgr2=0x7fc7900b3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:26.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.851+0000 7fc7970b8640 1 --2- 172.21.15.90:0/3500785019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc790155360 0x7fc7900b3c50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc778011ae0 tx=0x7fc778011ee0 comp rx=0 tx=0).stop 2024-09-10T23:15:26.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.851+0000 7fc7970b8640 1 -- 172.21.15.90:0/3500785019 shutdown_connections 2024-09-10T23:15:26.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.851+0000 7fc7970b8640 1 --2- 172.21.15.90:0/3500785019 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc770077f70 0x7fc77007a430 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:26.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.851+0000 7fc7970b8640 1 --2- 172.21.15.90:0/3500785019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7900b4190 0x7fc7900b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:26.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.851+0000 7fc7970b8640 1 --2- 172.21.15.90:0/3500785019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc790155360 0x7fc7900b3c50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:26.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.851+0000 7fc7970b8640 1 --2- 172.21.15.90:0/3500785019 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc77c003a00 0x7fc79014d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:26.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.851+0000 7fc7970b8640 1 -- 172.21.15.90:0/3500785019 >> 172.21.15.90:0/3500785019 conn(0x7fc7900cc850 msgr2=0x7fc7900adae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:26.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.851+0000 7fc7970b8640 1 -- 172.21.15.90:0/3500785019 shutdown_connections 2024-09-10T23:15:26.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:26.851+0000 7fc7970b8640 1 -- 172.21.15.90:0/3500785019 wait complete. 2024-09-10T23:15:26.863 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T23:15:26.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:26.863 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T23:15:26.891 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:15:26.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:26.892 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:15:26.947 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:15:26.947 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:26.965 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:15:26.965 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:27.021 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:15:27.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.122+0000 7f8c06fcd640 1 -- 172.21.15.90:0/1868385942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c000d1c70 msgr2=0x7f8c000b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:27.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.122+0000 7f8c06fcd640 1 --2- 172.21.15.90:0/1868385942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c000d1c70 0x7f8c000b3490 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8be8005fd0 tx=0x7f8be802a670 comp rx=0 tx=0).stop 2024-09-10T23:15:27.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.122+0000 7f8c06fcd640 1 -- 172.21.15.90:0/1868385942 shutdown_connections 2024-09-10T23:15:27.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.122+0000 7f8c06fcd640 1 --2- 172.21.15.90:0/1868385942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c000d1c70 0x7f8c000b3490 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:27.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.122+0000 7f8c06fcd640 1 -- 172.21.15.90:0/1868385942 >> 172.21.15.90:0/1868385942 conn(0x7f8c0009d2a0 msgr2=0x7f8c000d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:27.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.122+0000 7f8c06fcd640 1 -- 172.21.15.90:0/1868385942 shutdown_connections 2024-09-10T23:15:27.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.122+0000 7f8c06fcd640 1 -- 172.21.15.90:0/1868385942 wait complete. 2024-09-10T23:15:27.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.123+0000 7f8c06fcd640 1 Processor -- start 2024-09-10T23:15:27.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.123+0000 7f8c06fcd640 1 -- start start 2024-09-10T23:15:27.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.124+0000 7f8c06fcd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c000b3a00 0x7f8c000b9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:27.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.124+0000 7f8c06fcd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c000d1c70 0x7f8c0015e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:27.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.124+0000 7f8c06fcd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c000d2470 0x7f8c0015ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:27.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.124+0000 7f8c06fcd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8c000b4740 con 0x7f8c000b3a00 2024-09-10T23:15:27.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.124+0000 7f8c06fcd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8c000b45c0 con 0x7f8c000d2470 2024-09-10T23:15:27.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.124+0000 7f8c06fcd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8c000b48c0 con 0x7f8c000d1c70 2024-09-10T23:15:27.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.124+0000 7f8c04d69640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c000b3a00 0x7f8c000b9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:27.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.124+0000 7f8c04d69640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c000b3a00 0x7f8c000b9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37526/0 (socket says 172.21.15.90:37526) 2024-09-10T23:15:27.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.124+0000 7f8c04d69640 1 -- 172.21.15.90:0/3055363925 learned_addr learned my addr 172.21.15.90:0/3055363925 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:27.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.125+0000 7f8bfffff640 1 --2- 172.21.15.90:0/3055363925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c000d1c70 0x7f8c0015e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:27.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.125+0000 7f8c0556a640 1 --2- 172.21.15.90:0/3055363925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c000d2470 0x7f8c0015ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:27.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.125+0000 7f8c04d69640 1 -- 172.21.15.90:0/3055363925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c000d1c70 msgr2=0x7f8c0015e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:27.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.125+0000 7f8c04d69640 1 --2- 172.21.15.90:0/3055363925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c000d1c70 0x7f8c0015e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:27.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.125+0000 7f8c04d69640 1 -- 172.21.15.90:0/3055363925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c000d2470 msgr2=0x7f8c0015ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:27.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.125+0000 7f8c04d69640 1 --2- 172.21.15.90:0/3055363925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c000d2470 0x7f8c0015ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:27.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.125+0000 7f8c04d69640 1 -- 172.21.15.90:0/3055363925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c00155580 con 0x7f8c000b3a00 2024-09-10T23:15:27.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.125+0000 7f8bfffff640 1 --2- 172.21.15.90:0/3055363925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c000d1c70 0x7f8c0015e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:27.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.125+0000 7f8c04d69640 1 --2- 172.21.15.90:0/3055363925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c000b3a00 0x7f8c000b9640 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000c780 tx=0x7f8bf000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:27.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.125+0000 7f8bfd7fa640 1 -- 172.21.15.90:0/3055363925 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0003b70 con 0x7f8c000b3a00 2024-09-10T23:15:27.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.125+0000 7f8bfd7fa640 1 -- 172.21.15.90:0/3055363925 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bf0003d10 con 0x7f8c000b3a00 2024-09-10T23:15:27.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.125+0000 7f8c06fcd640 1 -- 172.21.15.90:0/3055363925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c0014c840 con 0x7f8c000b3a00 2024-09-10T23:15:27.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.125+0000 7f8bfd7fa640 1 -- 172.21.15.90:0/3055363925 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000aab0 con 0x7f8c000b3a00 2024-09-10T23:15:27.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.125+0000 7f8c06fcd640 1 -- 172.21.15.90:0/3055363925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c00155de0 con 0x7f8c000b3a00 2024-09-10T23:15:27.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.126+0000 7f8c06fcd640 1 -- 172.21.15.90:0/3055363925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c000b3490 con 0x7f8c000b3a00 2024-09-10T23:15:27.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.127+0000 7f8bfd7fa640 1 -- 172.21.15.90:0/3055363925 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8bf000ac50 con 0x7f8c000b3a00 2024-09-10T23:15:27.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.127+0000 7f8bfd7fa640 1 --2- 172.21.15.90:0/3055363925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8be0077fa0 0x7f8be007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:27.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.127+0000 7f8bfd7fa640 1 -- 172.21.15.90:0/3055363925 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8bf0099c00 con 0x7f8c000b3a00 2024-09-10T23:15:27.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.127+0000 7f8bfffff640 1 --2- 172.21.15.90:0/3055363925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8be0077fa0 0x7f8be007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:27.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.128+0000 7f8bfffff640 1 --2- 172.21.15.90:0/3055363925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8be0077fa0 0x7f8be007a460 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8be8033000 tx=0x7f8be8004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:27.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.131+0000 7f8bfd7fa640 1 -- 172.21.15.90:0/3055363925 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8bf00a0080 con 0x7f8c000b3a00 2024-09-10T23:15:27.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.317+0000 7f8c06fcd640 1 -- 172.21.15.90:0/3055363925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8c00155fb0 con 0x7f8c000b3a00 2024-09-10T23:15:27.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.317+0000 7f8bfd7fa640 1 -- 172.21.15.90:0/3055363925 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f8c0014c840 con 0x7f8c000b3a00 2024-09-10T23:15:27.318 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:15:27.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.319+0000 7f8c06fcd640 1 -- 172.21.15.90:0/3055363925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8be0077fa0 msgr2=0x7f8be007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:27.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.319+0000 7f8c06fcd640 1 --2- 172.21.15.90:0/3055363925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8be0077fa0 0x7f8be007a460 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8be8033000 tx=0x7f8be8004730 comp rx=0 tx=0).stop 2024-09-10T23:15:27.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.319+0000 7f8c06fcd640 1 -- 172.21.15.90:0/3055363925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c000b3a00 msgr2=0x7f8c000b9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:27.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.319+0000 7f8c06fcd640 1 --2- 172.21.15.90:0/3055363925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c000b3a00 0x7f8c000b9640 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000c780 tx=0x7f8bf000cc40 comp rx=0 tx=0).stop 2024-09-10T23:15:27.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.319+0000 7f8c06fcd640 1 -- 172.21.15.90:0/3055363925 shutdown_connections 2024-09-10T23:15:27.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.319+0000 7f8c06fcd640 1 --2- 172.21.15.90:0/3055363925 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8be0077fa0 0x7f8be007a460 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:27.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.319+0000 7f8c06fcd640 1 --2- 172.21.15.90:0/3055363925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c000d2470 0x7f8c0015ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:27.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.319+0000 7f8c06fcd640 1 --2- 172.21.15.90:0/3055363925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c000d1c70 0x7f8c0015e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:27.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.319+0000 7f8c06fcd640 1 --2- 172.21.15.90:0/3055363925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c000b3a00 0x7f8c000b9640 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:27.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.319+0000 7f8c06fcd640 1 -- 172.21.15.90:0/3055363925 >> 172.21.15.90:0/3055363925 conn(0x7f8c0009d2a0 msgr2=0x7f8c000b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:27.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.319+0000 7f8c06fcd640 1 -- 172.21.15.90:0/3055363925 shutdown_connections 2024-09-10T23:15:27.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.319+0000 7f8c06fcd640 1 -- 172.21.15.90:0/3055363925 wait complete. 2024-09-10T23:15:27.331 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T23:15:27.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:27.331 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T23:15:27.362 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:15:27.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:27.362 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T23:15:27.419 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:27.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.520+0000 7f8154a5a640 1 -- 172.21.15.90:0/731630959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f813c004000 msgr2=0x7f813c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:27.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.520+0000 7f8154a5a640 1 --2- 172.21.15.90:0/731630959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f813c004000 0x7f813c004800 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8150072e50 tx=0x7f813c005830 comp rx=0 tx=0).stop 2024-09-10T23:15:27.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.520+0000 7f814ed9d640 1 -- 172.21.15.90:0/731630959 reap_dead start 2024-09-10T23:15:27.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.520+0000 7f8154a5a640 1 -- 172.21.15.90:0/731630959 shutdown_connections 2024-09-10T23:15:27.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.520+0000 7f8154a5a640 1 -- 172.21.15.90:0/731630959 >> 172.21.15.90:0/731630959 conn(0x7f81500cc850 msgr2=0x7f81500ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:27.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.520+0000 7f8154a5a640 1 -- 172.21.15.90:0/731630959 shutdown_connections 2024-09-10T23:15:27.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.520+0000 7f8154a5a640 1 -- 172.21.15.90:0/731630959 wait complete. 2024-09-10T23:15:27.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.521+0000 7f8154a5a640 1 Processor -- start 2024-09-10T23:15:27.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.521+0000 7f8154a5a640 1 -- start start 2024-09-10T23:15:27.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.522+0000 7f8154a5a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f813c004000 0x7f815009b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:27.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.522+0000 7f8154a5a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8150156460 0x7f815009cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:27.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.522+0000 7f8154a5a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f815009d430 0x7f81500c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:27.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.522+0000 7f8154a5a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8150163930 con 0x7f8150156460 2024-09-10T23:15:27.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.522+0000 7f8154a5a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f81501637b0 con 0x7f813c004000 2024-09-10T23:15:27.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.522+0000 7f8154a5a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8150163ab0 con 0x7f815009d430 2024-09-10T23:15:27.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.522+0000 7f814dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8150156460 0x7f815009cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:27.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.522+0000 7f814dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8150156460 0x7f815009cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37538/0 (socket says 172.21.15.90:37538) 2024-09-10T23:15:27.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.522+0000 7f814dd9b640 1 -- 172.21.15.90:0/2948290441 learned_addr learned my addr 172.21.15.90:0/2948290441 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:27.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.522+0000 7f814e59c640 1 --2- 172.21.15.90:0/2948290441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f813c004000 0x7f815009b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:27.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.522+0000 7f814ed9d640 1 --2- 172.21.15.90:0/2948290441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f815009d430 0x7f81500c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:27.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.523+0000 7f814dd9b640 1 -- 172.21.15.90:0/2948290441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f815009d430 msgr2=0x7f81500c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:27.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.523+0000 7f814dd9b640 1 --2- 172.21.15.90:0/2948290441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f815009d430 0x7f81500c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:27.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.523+0000 7f814dd9b640 1 -- 172.21.15.90:0/2948290441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f813c004000 msgr2=0x7f815009b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:27.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.523+0000 7f814dd9b640 1 --2- 172.21.15.90:0/2948290441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f813c004000 0x7f815009b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:27.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.523+0000 7f814dd9b640 1 -- 172.21.15.90:0/2948290441 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815009ba90 con 0x7f8150156460 2024-09-10T23:15:27.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.523+0000 7f814dd9b640 1 --2- 172.21.15.90:0/2948290441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8150156460 0x7f815009cef0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8138001260 tx=0x7f8138006c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:27.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.523+0000 7f8146ffd640 1 -- 172.21.15.90:0/2948290441 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8138031070 con 0x7f8150156460 2024-09-10T23:15:27.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.523+0000 7f8146ffd640 1 -- 172.21.15.90:0/2948290441 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8138003610 con 0x7f8150156460 2024-09-10T23:15:27.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.523+0000 7f8146ffd640 1 -- 172.21.15.90:0/2948290441 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8138003a60 con 0x7f8150156460 2024-09-10T23:15:27.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.523+0000 7f8154a5a640 1 -- 172.21.15.90:0/2948290441 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81500b4db0 con 0x7f8150156460 2024-09-10T23:15:27.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.523+0000 7f8154a5a640 1 -- 172.21.15.90:0/2948290441 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81500b5370 con 0x7f8150156460 2024-09-10T23:15:27.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.524+0000 7f8154a5a640 1 -- 172.21.15.90:0/2948290441 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81500ca420 con 0x7f8150156460 2024-09-10T23:15:27.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.525+0000 7f8146ffd640 1 -- 172.21.15.90:0/2948290441 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8138003c00 con 0x7f8150156460 2024-09-10T23:15:27.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.525+0000 7f8146ffd640 1 --2- 172.21.15.90:0/2948290441 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8130077fa0 0x7f813007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:27.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.525+0000 7f8146ffd640 1 -- 172.21.15.90:0/2948290441 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f81380b9f30 con 0x7f8150156460 2024-09-10T23:15:27.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.525+0000 7f814e59c640 1 --2- 172.21.15.90:0/2948290441 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8130077fa0 0x7f813007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:27.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.526+0000 7f814e59c640 1 --2- 172.21.15.90:0/2948290441 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8130077fa0 0x7f813007a460 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8140000c00 tx=0x7f8140006b70 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:27.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.529+0000 7f8146ffd640 1 -- 172.21.15.90:0/2948290441 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f815009ba90 con 0x7f8150156460 2024-09-10T23:15:27.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.737+0000 7f8154a5a640 1 -- 172.21.15.90:0/2948290441 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81500ae080 con 0x7f8150156460 2024-09-10T23:15:27.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.738+0000 7f8146ffd640 1 -- 172.21.15.90:0/2948290441 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5220 (secure 0 0 0) 0x7f813808b230 con 0x7f8150156460 2024-09-10T23:15:27.739 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:27.739 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"btime":"2024-09-10T23:15:16:780866+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/464675823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":464675823},{"type":"v1","addr":"172.21.15.90:6835","nonce":464675823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/28851721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":28851721},{"type":"v1","addr":"172.21.15.171:6836","nonce":28851721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/3538341252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3538341252},{"type":"v1","addr":"172.21.15.90:6834","nonce":3538341252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:14.107910+0000","modified":"2024-09-10T23:15:16.120228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4881":{"gid":4881,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/2513837234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2513837234},{"type":"v1","addr":"172.21.15.171:6837","nonce":2513837234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4881,"qdb_cluster":[4881]},"id":2}]} 2024-09-10T23:15:27.740 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2024-09-10T23:15:27.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.740+0000 7f8154a5a640 1 -- 172.21.15.90:0/2948290441 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8130077fa0 msgr2=0x7f813007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:27.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.740+0000 7f8154a5a640 1 --2- 172.21.15.90:0/2948290441 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8130077fa0 0x7f813007a460 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8140000c00 tx=0x7f8140006b70 comp rx=0 tx=0).stop 2024-09-10T23:15:27.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.740+0000 7f8154a5a640 1 -- 172.21.15.90:0/2948290441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8150156460 msgr2=0x7f815009cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:27.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.740+0000 7f8154a5a640 1 --2- 172.21.15.90:0/2948290441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8150156460 0x7f815009cef0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8138001260 tx=0x7f8138006c50 comp rx=0 tx=0).stop 2024-09-10T23:15:27.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.740+0000 7f8154a5a640 1 -- 172.21.15.90:0/2948290441 shutdown_connections 2024-09-10T23:15:27.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.740+0000 7f8154a5a640 1 --2- 172.21.15.90:0/2948290441 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8130077fa0 0x7f813007a460 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:27.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.740+0000 7f8154a5a640 1 --2- 172.21.15.90:0/2948290441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f815009d430 0x7f81500c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:27.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.740+0000 7f8154a5a640 1 --2- 172.21.15.90:0/2948290441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8150156460 0x7f815009cef0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:27.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.740+0000 7f8154a5a640 1 --2- 172.21.15.90:0/2948290441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f813c004000 0x7f815009b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:27.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.740+0000 7f8154a5a640 1 -- 172.21.15.90:0/2948290441 >> 172.21.15.90:0/2948290441 conn(0x7f81500cc850 msgr2=0x7f8150159340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:27.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.740+0000 7f8154a5a640 1 -- 172.21.15.90:0/2948290441 shutdown_connections 2024-09-10T23:15:27.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.740+0000 7f8154a5a640 1 -- 172.21.15.90:0/2948290441 wait complete. 2024-09-10T23:15:27.752 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json perf dump 2024-09-10T23:15:27.877 INFO:teuthology.orchestra.run.smithi171.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":64,"msgr_send_messages":59,"msgr_recv_bytes":124959,"msgr_send_bytes":14730,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.007532197,"msgr_running_send_time":0.001899821,"msgr_running_recv_time":0.006475508,"msgr_running_fast_dispatch_time":0.000247388,"msgr_send_messages_queue_lat":{"avgcount":59,"sum":0.033520783,"avgtime":0.000568148},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":123104,"msgr_send_encrypted_bytes":11728},"AsyncMessenger::Worker-1":{"msgr_recv_messages":37,"msgr_send_messages":42,"msgr_recv_bytes":9017,"msgr_send_bytes":134136,"msgr_created_connections":8,"msgr_active_connections":3,"msgr_running_total_time":0.008584643,"msgr_running_send_time":0.001645073,"msgr_running_recv_time":0.006888288,"msgr_running_fast_dispatch_time":0.000217035,"msgr_send_messages_queue_lat":{"avgcount":40,"sum":0.037905735,"avgtime":0.000947643},"msgr_handle_ack_lat":{"avgcount":29,"sum":0.000010981,"avgtime":0.000000378},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":94160},"AsyncMessenger::Worker-2":{"msgr_recv_messages":43,"msgr_send_messages":41,"msgr_recv_bytes":12063,"msgr_send_bytes":25766,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.008737806,"msgr_running_send_time":0.001706789,"msgr_running_recv_time":0.006361633,"msgr_running_fast_dispatch_time":0.000653994,"msgr_send_messages_queue_lat":{"avgcount":40,"sum":0.179843227,"avgtime":0.004496080},"msgr_handle_ack_lat":{"avgcount":5,"sum":0.000003337,"avgtime":0.000000667},"msgr_recv_encrypted_bytes":1872,"msgr_send_encrypted_bytes":448},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":42,"sum":0.002624257,"avgtime":0.000062482}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000010479,"avgtime":0.000005239}},"mds":{"request":29,"reply":29,"reply_latency":{"avgcount":29,"sum":0.004932354,"avgtime":0.000170081},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":2,"subtrees":2,"traverse":55,"traverse_hit":53,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":8,"evex":0,"evtrm":0,"ev":8,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197025,"rdpos":0,"jlat":{"avgcount":5,"sum":0.007866754,"avgtime":0.001573350},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":0,"cap+":2,"cap-":2,"rss":44992,"heap":266149888},"mds_server":{"dispatch_client_request":29,"dispatch_server_request":0,"handle_client_request":29,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":26,"sum":0.004225110,"avgtime":0.000162504},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":2,"sum":0.000287363,"avgtime":0.000143681},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000419881,"avgtime":0.000419881},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":28,"average_load":14,"avg_session_uptime":0,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":222693,"buffer_anon_items":59,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5312,"osdmap_items":75,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":52624,"mds_co_items":205,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":43,"op_send_bytes":13841,"op_resend":37,"op_reply":43,"op_latency":{"avgcount":43,"sum":0.548988648,"avgtime":0.012767177},"op_inflight":0,"oplen_avg":{"avgcount":43,"sum":67},"op":43,"op_r":0,"op_w":43,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":34,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":140,"get_sum":129469,"get_or_fail_fail":0,"get_or_fail_success":140,"take":0,"take_sum":0,"put":140,"put_sum":129469,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":13841,"put":43,"put_sum":13841,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":43,"put":43,"put_sum":43,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55f30e07c960":{"val":0,"max":3758096384,"get_started":0,"get":8,"get_sum":2721,"get_or_fail_fail":0,"get_or_fail_success":8,"take":0,"take_sum":0,"put":5,"put_sum":2721,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":0}} 2024-09-10T23:15:27.879 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 124959, "msgr_recv_encrypted_bytes": 123104, "msgr_recv_messages": 64, "msgr_running_fast_dispatch_time": 0.000247388, "msgr_running_recv_time": 0.006475508, "msgr_running_send_time": 0.001899821, "msgr_running_total_time": 0.007532197, "msgr_send_bytes": 14730, "msgr_send_encrypted_bytes": 11728, "msgr_send_messages": 59, "msgr_send_messages_queue_lat": { "avgcount": 59, "avgtime": 0.000568148, "sum": 0.033520783 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 29, "avgtime": 3.78e-07, "sum": 1.0981e-05 }, "msgr_recv_bytes": 9017, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 37, "msgr_running_fast_dispatch_time": 0.000217035, "msgr_running_recv_time": 0.006888288, "msgr_running_send_time": 0.001645073, "msgr_running_total_time": 0.008584643, "msgr_send_bytes": 134136, "msgr_send_encrypted_bytes": 94160, "msgr_send_messages": 42, "msgr_send_messages_queue_lat": { "avgcount": 40, "avgtime": 0.000947643, "sum": 0.037905735 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 5, "avgtime": 6.67e-07, "sum": 3.337e-06 }, "msgr_recv_bytes": 12063, "msgr_recv_encrypted_bytes": 1872, "msgr_recv_messages": 43, "msgr_running_fast_dispatch_time": 0.000653994, "msgr_running_recv_time": 0.006361633, "msgr_running_send_time": 0.001706789, "msgr_running_total_time": 0.008737806, "msgr_send_bytes": 25766, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 41, "msgr_send_messages_queue_lat": { "avgcount": 40, "avgtime": 0.00449608, "sum": 0.179843227 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 42, "avgtime": 6.2482e-05, "sum": 0.002624257 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 5.239e-06, "sum": 1.0479e-05 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 29, "reply_latency": { "avgcount": 29, "avgtime": 0.000170081, "sum": 0.004932354 }, "request": 29, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 55, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 53, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 8, "evadd": 8, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.00157335, "sum": 0.007866754 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197025 }, "mds_mem": { "cap": 0, "cap+": 2, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 266149888, "ino": 13, "ino+": 13, "ino-": 0, "rss": 44992 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 29, "dispatch_server_request": 0, "handle_client_request": 29, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 26, "avgtime": 0.000162504, "sum": 0.00422511 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 2, "avgtime": 0.000143681, "sum": 0.000287363 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000419881, "sum": 0.000419881 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 14, "avg_session_uptime": 0, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 28 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 222693, "buffer_anon_items": 59, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 52624, "mds_co_items": 205, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5312, "osdmap_items": 75, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 34, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 43, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 43, "avgtime": 0.012767177, "sum": 0.548988648 }, "op_pg": 0, "op_r": 0, "op_reply": 43, "op_resend": 37, "op_rmw": 0, "op_send": 43, "op_send_bytes": 13841, "op_w": 43, "oplen_avg": { "avgcount": 43, "sum": 67 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 140, "get_or_fail_fail": 0, "get_or_fail_success": 140, "get_started": 0, "get_sum": 129469, "max": 104857600, "put": 140, "put_sum": 129469, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 43, "put_sum": 13841, "take": 43, "take_sum": 13841, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 43, "put_sum": 43, "take": 43, "take_sum": 43, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55f30e07c960": { "get": 8, "get_or_fail_fail": 0, "get_or_fail_success": 8, "get_started": 0, "get_sum": 2721, "max": 3758096384, "put": 5, "put_sum": 2721, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 0 } } 2024-09-10T23:15:27.879 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:15:27.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.980+0000 7f1aac1b4640 1 -- 172.21.15.90:0/1913377364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa4159c90 msgr2=0x7f1aa40ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:27.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.980+0000 7f1aac1b4640 1 --2- 172.21.15.90:0/1913377364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa4159c90 0x7f1aa40ca420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0005fd0 tx=0x7f1aa002bbe0 comp rx=0 tx=0).stop 2024-09-10T23:15:27.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.980+0000 7f1aac1b4640 1 -- 172.21.15.90:0/1913377364 shutdown_connections 2024-09-10T23:15:27.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.980+0000 7f1aac1b4640 1 --2- 172.21.15.90:0/1913377364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa4159c90 0x7f1aa40ca420 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:27.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.980+0000 7f1aac1b4640 1 -- 172.21.15.90:0/1913377364 >> 172.21.15.90:0/1913377364 conn(0x7f1aa40cc850 msgr2=0x7f1aa40ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:27.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.980+0000 7f1aac1b4640 1 -- 172.21.15.90:0/1913377364 shutdown_connections 2024-09-10T23:15:27.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.980+0000 7f1aac1b4640 1 -- 172.21.15.90:0/1913377364 wait complete. 2024-09-10T23:15:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.981+0000 7f1aac1b4640 1 Processor -- start 2024-09-10T23:15:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.981+0000 7f1aac1b4640 1 -- start start 2024-09-10T23:15:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.982+0000 7f1aac1b4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1aa40b1f60 0x7f1aa41f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.982+0000 7f1aac1b4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa40cc310 0x7f1aa406e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.982+0000 7f1aac1b4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa4159c90 0x7f1aa4157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.982+0000 7f1aac1b4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa40709a0 con 0x7f1aa40b1f60 2024-09-10T23:15:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.982+0000 7f1aac1b4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa4070820 con 0x7f1aa40cc310 2024-09-10T23:15:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.982+0000 7f1aac1b4640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa4073e50 con 0x7f1aa4159c90 2024-09-10T23:15:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.982+0000 7f1aa9f50640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1aa40b1f60 0x7f1aa41f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.982+0000 7f1aa9f50640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1aa40b1f60 0x7f1aa41f6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37554/0 (socket says 172.21.15.90:37554) 2024-09-10T23:15:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.982+0000 7f1aa9f50640 1 -- 172.21.15.90:0/2875668308 learned_addr learned my addr 172.21.15.90:0/2875668308 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.982+0000 7f1aa974f640 1 --2- 172.21.15.90:0/2875668308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa40cc310 0x7f1aa406e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.982+0000 7f1aaa751640 1 --2- 172.21.15.90:0/2875668308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa4159c90 0x7f1aa4157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.982+0000 7f1aa9f50640 1 -- 172.21.15.90:0/2875668308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa4159c90 msgr2=0x7f1aa4157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.982+0000 7f1aa9f50640 1 --2- 172.21.15.90:0/2875668308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa4159c90 0x7f1aa4157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.982+0000 7f1aa9f50640 1 -- 172.21.15.90:0/2875668308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa40cc310 msgr2=0x7f1aa406e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.982+0000 7f1aa9f50640 1 --2- 172.21.15.90:0/2875668308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa40cc310 0x7f1aa406e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.982+0000 7f1aa9f50640 1 -- 172.21.15.90:0/2875668308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa41f7140 con 0x7f1aa40b1f60 2024-09-10T23:15:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.983+0000 7f1aa9f50640 1 --2- 172.21.15.90:0/2875668308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1aa40b1f60 0x7f1aa41f6c00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0036040 tx=0x7f1aa00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.983+0000 7f1a9a7fc640 1 -- 172.21.15.90:0/2875668308 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0041020 con 0x7f1aa40b1f60 2024-09-10T23:15:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.983+0000 7f1a9a7fc640 1 -- 172.21.15.90:0/2875668308 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1aa003d440 con 0x7f1aa40b1f60 2024-09-10T23:15:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.983+0000 7f1a9a7fc640 1 -- 172.21.15.90:0/2875668308 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa003d870 con 0x7f1aa40b1f60 2024-09-10T23:15:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.983+0000 7f1aac1b4640 1 -- 172.21.15.90:0/2875668308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa40c70f0 con 0x7f1aa40b1f60 2024-09-10T23:15:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.983+0000 7f1aac1b4640 1 -- 172.21.15.90:0/2875668308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa41f6400 con 0x7f1aa40b1f60 2024-09-10T23:15:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.984+0000 7f1aac1b4640 1 -- 172.21.15.90:0/2875668308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa4074300 con 0x7f1aa40b1f60 2024-09-10T23:15:27.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.985+0000 7f1a9a7fc640 1 -- 172.21.15.90:0/2875668308 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1aa000b040 con 0x7f1aa40b1f60 2024-09-10T23:15:27.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.985+0000 7f1a9a7fc640 1 --2- 172.21.15.90:0/2875668308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1a88077f70 0x7f1a8807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:27.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.985+0000 7f1a9a7fc640 1 -- 172.21.15.90:0/2875668308 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1aa00bb3e0 con 0x7f1aa40b1f60 2024-09-10T23:15:27.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.985+0000 7f1aa974f640 1 --2- 172.21.15.90:0/2875668308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1a88077f70 0x7f1a8807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:27.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.986+0000 7f1aa974f640 1 --2- 172.21.15.90:0/2875668308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1a88077f70 0x7f1a8807a430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1aa41f3d70 tx=0x7f1a94009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:27.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:27.989+0000 7f1a9a7fc640 1 -- 172.21.15.90:0/2875668308 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1aa004b030 con 0x7f1aa40b1f60 2024-09-10T23:15:28.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28.197+0000 7f1aac1b4640 1 -- 172.21.15.90:0/2875668308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1aa40ca720 con 0x7f1aa40b1f60 2024-09-10T23:15:28.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28.198+0000 7f1a9a7fc640 1 -- 172.21.15.90:0/2875668308 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f1aa41f7140 con 0x7f1aa40b1f60 2024-09-10T23:15:28.199 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:15:28.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28.199+0000 7f1aac1b4640 1 -- 172.21.15.90:0/2875668308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1a88077f70 msgr2=0x7f1a8807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:28.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28.199+0000 7f1aac1b4640 1 --2- 172.21.15.90:0/2875668308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1a88077f70 0x7f1a8807a430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1aa41f3d70 tx=0x7f1a94009040 comp rx=0 tx=0).stop 2024-09-10T23:15:28.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28.200+0000 7f1aac1b4640 1 -- 172.21.15.90:0/2875668308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1aa40b1f60 msgr2=0x7f1aa41f6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:28.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28.200+0000 7f1aac1b4640 1 --2- 172.21.15.90:0/2875668308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1aa40b1f60 0x7f1aa41f6c00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0036040 tx=0x7f1aa00042f0 comp rx=0 tx=0).stop 2024-09-10T23:15:28.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28.200+0000 7f1aac1b4640 1 -- 172.21.15.90:0/2875668308 shutdown_connections 2024-09-10T23:15:28.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28.200+0000 7f1aac1b4640 1 --2- 172.21.15.90:0/2875668308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1a88077f70 0x7f1a8807a430 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:28.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28.200+0000 7f1aac1b4640 1 --2- 172.21.15.90:0/2875668308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1aa40cc310 0x7f1aa406e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:28.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28.200+0000 7f1aac1b4640 1 --2- 172.21.15.90:0/2875668308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1aa4159c90 0x7f1aa4157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:28.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28.200+0000 7f1aac1b4640 1 --2- 172.21.15.90:0/2875668308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1aa40b1f60 0x7f1aa41f6c00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:28.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28.200+0000 7f1aac1b4640 1 -- 172.21.15.90:0/2875668308 >> 172.21.15.90:0/2875668308 conn(0x7f1aa40cc850 msgr2=0x7f1aa40ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:28.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28.200+0000 7f1aac1b4640 1 -- 172.21.15.90:0/2875668308 shutdown_connections 2024-09-10T23:15:28.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28.200+0000 7f1aac1b4640 1 -- 172.21.15.90:0/2875668308 wait complete. 2024-09-10T23:15:28.211 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:15:28.212 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:15:28.212 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2024-09-10T23:15:28.212 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:15:28.212 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:15:28.212 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:15:28.212 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:15:28.212 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:15:28.212 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:15:28.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:28.212 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2024-09-10T23:15:28.228 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:15:28.228 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:15:28.228 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:15:28.228 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:28.228 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-10T23:15:28.228 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:28.228 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:15:28.229 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:28.229 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2024-09-10T23:15:28.229 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:15:28.229 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:28.229 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2024-09-10T23:15:28.229 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:15:28.229 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:28.229 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:15:28.229 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:28.229 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:15:28.229 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42720sec preferred_lft 42720sec 2024-09-10T23:15:28.229 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link noprefixroute 2024-09-10T23:15:28.229 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:28.229 INFO:teuthology.orchestra.run.smithi090.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:15:28.229 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:28.230 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:15:28.230 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:28.230 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::882a:a9ff:fefc:893f/64 scope link 2024-09-10T23:15:28.230 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:28.230 INFO:teuthology.orchestra.run.smithi090.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:15:28.230 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 76:ad:51:1a:2a:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:15:28.230 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::74ad:51ff:fe1a:2a60/64 scope link 2024-09-10T23:15:28.230 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:28.230 INFO:teuthology.orchestra.run.smithi090.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:15:28.231 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:15:28.231 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::3414:abff:fe49:366c/64 scope link 2024-09-10T23:15:28.231 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:28.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:28.231 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:15:28.292 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-09-10T23:15:28.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:28.294 DEBUG:teuthology.orchestra.run.smithi090:> route 2024-09-10T23:15:28.350 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2024-09-10T23:15:28.350 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:15:28.351 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:15:28.351 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:15:28.351 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:15:28.351 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:15:28.351 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:15:28.351 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:15:28.351 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:15:28.351 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:15:28.351 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:15:28.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:15:28.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:15:28.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:28.476 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-10T23:15:28.491 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:15:28.491 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:15:28.492 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:15:28.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:28.492 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2024-09-10T23:15:28.557 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:15:28.557 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:15:28.613 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:15:28.614 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:15:28.614 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:15:28.669 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:15:28.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:28.669 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:15:28.753 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:15:28.753 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:15:28.753 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:15:28.762 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:15:28.762 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:15:28.762 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:15:28.762 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:15:28.762 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:15:28.767 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:15:28.767 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:15:28.767 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:15:28.767 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:15:28.767 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:15:28.767 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:15:28.767 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:15:28.767 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:15:28.768 INFO:teuthology.orchestra.run.smithi090.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T23:15:28.768 INFO:teuthology.orchestra.run.smithi090.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:15:28.768 INFO:teuthology.orchestra.run.smithi090.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:15:28.768 INFO:teuthology.orchestra.run.smithi090.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:15:28.768 INFO:teuthology.orchestra.run.smithi090.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:15:28.769 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:15:28.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:28.770 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:15:28.834 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:15:28.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:15:28.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:15:28.931 INFO:teuthology.orchestra.run.smithi090.stdout:client5112 2024-09-10T23:15:28.932 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:28.932 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:28.948 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json perf dump 2024-09-10T23:15:29.075 INFO:teuthology.orchestra.run.smithi171.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":64,"msgr_send_messages":59,"msgr_recv_bytes":124959,"msgr_send_bytes":14730,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.007598377,"msgr_running_send_time":0.001899821,"msgr_running_recv_time":0.006475508,"msgr_running_fast_dispatch_time":0.000247388,"msgr_send_messages_queue_lat":{"avgcount":59,"sum":0.033520783,"avgtime":0.000568148},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":123104,"msgr_send_encrypted_bytes":11728},"AsyncMessenger::Worker-1":{"msgr_recv_messages":42,"msgr_send_messages":47,"msgr_recv_bytes":10254,"msgr_send_bytes":136300,"msgr_created_connections":9,"msgr_active_connections":4,"msgr_running_total_time":0.009177869,"msgr_running_send_time":0.001884243,"msgr_running_recv_time":0.007321885,"msgr_running_fast_dispatch_time":0.000217035,"msgr_send_messages_queue_lat":{"avgcount":45,"sum":0.038010392,"avgtime":0.000844675},"msgr_handle_ack_lat":{"avgcount":33,"sum":0.000012787,"avgtime":0.000000387},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":94160},"AsyncMessenger::Worker-2":{"msgr_recv_messages":44,"msgr_send_messages":42,"msgr_recv_bytes":12309,"msgr_send_bytes":26340,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.008852459,"msgr_running_send_time":0.001752931,"msgr_running_recv_time":0.006382923,"msgr_running_fast_dispatch_time":0.000689387,"msgr_send_messages_queue_lat":{"avgcount":41,"sum":0.179871514,"avgtime":0.004387110},"msgr_handle_ack_lat":{"avgcount":5,"sum":0.000003337,"avgtime":0.000000667},"msgr_recv_encrypted_bytes":1872,"msgr_send_encrypted_bytes":448},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":44,"sum":0.002675759,"avgtime":0.000060812}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000010479,"avgtime":0.000005239}},"mds":{"request":33,"reply":33,"reply_latency":{"avgcount":33,"sum":0.005590487,"avgtime":0.000169408},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":62,"traverse_hit":59,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":9,"evex":0,"evtrm":0,"ev":9,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197281,"rdpos":0,"jlat":{"avgcount":6,"sum":0.009442118,"avgtime":0.001573686},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":3,"cap-":2,"rss":45248,"heap":266149888},"mds_server":{"dispatch_client_request":33,"dispatch_server_request":0,"handle_client_request":33,"handle_client_session":7,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":29,"sum":0.004728873,"avgtime":0.000163064},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":3,"sum":0.000441733,"avgtime":0.000147244},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000419881,"avgtime":0.000419881},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":3,"session_remove":2,"sessions_open":1,"sessions_stale":0,"total_load":31,"average_load":31,"avg_session_uptime":0,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":216705,"buffer_anon_items":77,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5312,"osdmap_items":75,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53360,"mds_co_items":216,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":44,"op_send_bytes":14097,"op_resend":37,"op_reply":44,"op_latency":{"avgcount":44,"sum":0.549988628,"avgtime":0.012499741},"op_inflight":0,"oplen_avg":{"avgcount":44,"sum":68},"op":44,"op_r":0,"op_w":44,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":6,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":34,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":146,"get_sum":130492,"get_or_fail_fail":0,"get_or_fail_success":146,"take":0,"take_sum":0,"put":146,"put_sum":130492,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":14097,"put":44,"put_sum":14097,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":44,"put":44,"put_sum":44,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55f30e07c960":{"val":0,"max":3758096384,"get_started":0,"get":9,"get_sum":2977,"get_or_fail_fail":0,"get_or_fail_success":9,"take":0,"take_sum":0,"put":6,"put_sum":2977,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":0}} 2024-09-10T23:15:29.076 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 124959, "msgr_recv_encrypted_bytes": 123104, "msgr_recv_messages": 64, "msgr_running_fast_dispatch_time": 0.000247388, "msgr_running_recv_time": 0.006475508, "msgr_running_send_time": 0.001899821, "msgr_running_total_time": 0.007598377, "msgr_send_bytes": 14730, "msgr_send_encrypted_bytes": 11728, "msgr_send_messages": 59, "msgr_send_messages_queue_lat": { "avgcount": 59, "avgtime": 0.000568148, "sum": 0.033520783 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 9, "msgr_handle_ack_lat": { "avgcount": 33, "avgtime": 3.87e-07, "sum": 1.2787e-05 }, "msgr_recv_bytes": 10254, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 42, "msgr_running_fast_dispatch_time": 0.000217035, "msgr_running_recv_time": 0.007321885, "msgr_running_send_time": 0.001884243, "msgr_running_total_time": 0.009177869, "msgr_send_bytes": 136300, "msgr_send_encrypted_bytes": 94160, "msgr_send_messages": 47, "msgr_send_messages_queue_lat": { "avgcount": 45, "avgtime": 0.000844675, "sum": 0.038010392 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 5, "avgtime": 6.67e-07, "sum": 3.337e-06 }, "msgr_recv_bytes": 12309, "msgr_recv_encrypted_bytes": 1872, "msgr_recv_messages": 44, "msgr_running_fast_dispatch_time": 0.000689387, "msgr_running_recv_time": 0.006382923, "msgr_running_send_time": 0.001752931, "msgr_running_total_time": 0.008852459, "msgr_send_bytes": 26340, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 42, "msgr_send_messages_queue_lat": { "avgcount": 41, "avgtime": 0.00438711, "sum": 0.179871514 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 44, "avgtime": 6.0812e-05, "sum": 0.002675759 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 5.239e-06, "sum": 1.0479e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 33, "reply_latency": { "avgcount": 33, "avgtime": 0.000169408, "sum": 0.005590487 }, "request": 33, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 62, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 59, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 9, "evadd": 9, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 6, "avgtime": 0.001573686, "sum": 0.009442118 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197281 }, "mds_mem": { "cap": 1, "cap+": 3, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 266149888, "ino": 13, "ino+": 13, "ino-": 0, "rss": 45248 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 33, "dispatch_server_request": 0, "handle_client_request": 33, "handle_client_session": 7, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 29, "avgtime": 0.000163064, "sum": 0.004728873 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 3, "avgtime": 0.000147244, "sum": 0.000441733 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000419881, "sum": 0.000419881 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 31, "avg_session_uptime": 0, "mdthresh_evicted": 0, "session_add": 3, "session_count": 1, "session_remove": 2, "sessions_open": 1, "sessions_stale": 0, "total_load": 31 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 216705, "buffer_anon_items": 77, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53360, "mds_co_items": 216, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5312, "osdmap_items": 75, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 34, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 44, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 44, "avgtime": 0.012499741, "sum": 0.549988628 }, "op_pg": 0, "op_r": 0, "op_reply": 44, "op_resend": 37, "op_rmw": 0, "op_send": 44, "op_send_bytes": 14097, "op_w": 44, "oplen_avg": { "avgcount": 44, "sum": 68 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 6, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 146, "get_or_fail_fail": 0, "get_or_fail_success": 146, "get_started": 0, "get_sum": 130492, "max": 104857600, "put": 146, "put_sum": 130492, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 44, "put_sum": 14097, "take": 44, "take_sum": 14097, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 44, "put_sum": 44, "take": 44, "take_sum": 44, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55f30e07c960": { "get": 9, "get_or_fail_fail": 0, "get_or_fail_success": 9, "get_started": 0, "get_sum": 2977, "max": 3758096384, "put": 6, "put_sum": 2977, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 0 } } 2024-09-10T23:15:29.076 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:29.076 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:29.092 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:29.093 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:29.150 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:15:29.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.292+0000 7f34607a3640 1 -- 172.21.15.90:0/4117190340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3458157fc0 msgr2=0x7f345815b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:29.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.292+0000 7f34607a3640 1 --2- 172.21.15.90:0/4117190340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3458157fc0 0x7f345815b290 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3454009830 tx=0x7f345402a470 comp rx=0 tx=0).stop 2024-09-10T23:15:29.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.292+0000 7f34607a3640 1 -- 172.21.15.90:0/4117190340 shutdown_connections 2024-09-10T23:15:29.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.292+0000 7f34607a3640 1 --2- 172.21.15.90:0/4117190340 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34580ca420 0x7f34580ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:29.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.292+0000 7f34607a3640 1 --2- 172.21.15.90:0/4117190340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3458157fc0 0x7f345815b290 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:29.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.292+0000 7f34607a3640 1 -- 172.21.15.90:0/4117190340 >> 172.21.15.90:0/4117190340 conn(0x7f34580cc850 msgr2=0x7f34580ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:29.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.293+0000 7f34607a3640 1 -- 172.21.15.90:0/4117190340 shutdown_connections 2024-09-10T23:15:29.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.293+0000 7f34607a3640 1 -- 172.21.15.90:0/4117190340 wait complete. 2024-09-10T23:15:29.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.294+0000 7f34607a3640 1 Processor -- start 2024-09-10T23:15:29.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.294+0000 7f34607a3640 1 -- start start 2024-09-10T23:15:29.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.294+0000 7f34607a3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34580aef50 0x7f3458156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:29.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.294+0000 7f34607a3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34580ca420 0x7f345809d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:29.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.294+0000 7f34607a3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3458157fc0 0x7f34581f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:29.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.294+0000 7f34607a3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f345806f770 con 0x7f3458157fc0 2024-09-10T23:15:29.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.294+0000 7f34607a3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f345806f5f0 con 0x7f34580aef50 2024-09-10T23:15:29.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.294+0000 7f34607a3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f345806f8f0 con 0x7f34580ca420 2024-09-10T23:15:29.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.294+0000 7f345ed40640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3458157fc0 0x7f34581f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:29.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.295+0000 7f345ed40640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3458157fc0 0x7f34581f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35936/0 (socket says 172.21.15.90:35936) 2024-09-10T23:15:29.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.295+0000 7f345ed40640 1 -- 172.21.15.90:0/797912827 learned_addr learned my addr 172.21.15.90:0/797912827 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:29.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.295+0000 7f345e53f640 1 --2- 172.21.15.90:0/797912827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34580aef50 0x7f3458156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:29.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.295+0000 7f345dd3e640 1 --2- 172.21.15.90:0/797912827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34580ca420 0x7f345809d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:29.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.295+0000 7f345ed40640 1 -- 172.21.15.90:0/797912827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34580ca420 msgr2=0x7f345809d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:29.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.295+0000 7f345ed40640 1 --2- 172.21.15.90:0/797912827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34580ca420 0x7f345809d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:29.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.295+0000 7f345ed40640 1 -- 172.21.15.90:0/797912827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34580aef50 msgr2=0x7f3458156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:29.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.295+0000 7f345ed40640 1 --2- 172.21.15.90:0/797912827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34580aef50 0x7f3458156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:29.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.295+0000 7f345ed40640 1 -- 172.21.15.90:0/797912827 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345809c3c0 con 0x7f3458157fc0 2024-09-10T23:15:29.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.295+0000 7f345e53f640 1 --2- 172.21.15.90:0/797912827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34580aef50 0x7f3458156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:29.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.295+0000 7f345ed40640 1 --2- 172.21.15.90:0/797912827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3458157fc0 0x7f34581f5010 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f345000cb00 tx=0x7f345000a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:29.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.295+0000 7f344effd640 1 -- 172.21.15.90:0/797912827 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3450004b20 con 0x7f3458157fc0 2024-09-10T23:15:29.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.295+0000 7f344effd640 1 -- 172.21.15.90:0/797912827 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3450004db0 con 0x7f3458157fc0 2024-09-10T23:15:29.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.295+0000 7f34607a3640 1 -- 172.21.15.90:0/797912827 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345809c6a0 con 0x7f3458157fc0 2024-09-10T23:15:29.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.295+0000 7f344effd640 1 -- 172.21.15.90:0/797912827 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3450005280 con 0x7f3458157fc0 2024-09-10T23:15:29.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.295+0000 7f34607a3640 1 -- 172.21.15.90:0/797912827 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f345809c070 con 0x7f3458157fc0 2024-09-10T23:15:29.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.296+0000 7f34607a3640 1 -- 172.21.15.90:0/797912827 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f345806fde0 con 0x7f3458157fc0 2024-09-10T23:15:29.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.297+0000 7f344effd640 1 -- 172.21.15.90:0/797912827 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3450005420 con 0x7f3458157fc0 2024-09-10T23:15:29.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.297+0000 7f344effd640 1 --2- 172.21.15.90:0/797912827 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f343c077f70 0x7f343c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:29.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.297+0000 7f344effd640 1 -- 172.21.15.90:0/797912827 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f345009a4f0 con 0x7f3458157fc0 2024-09-10T23:15:29.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.298+0000 7f345e53f640 1 --2- 172.21.15.90:0/797912827 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f343c077f70 0x7f343c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:29.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.298+0000 7f345e53f640 1 --2- 172.21.15.90:0/797912827 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f343c077f70 0x7f343c07a430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3454034000 tx=0x7f3454004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:29.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.302+0000 7f344effd640 1 -- 172.21.15.90:0/797912827 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3450014030 con 0x7f3458157fc0 2024-09-10T23:15:29.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.488+0000 7f34607a3640 1 -- 172.21.15.90:0/797912827 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3458069a40 con 0x7f3458157fc0 2024-09-10T23:15:29.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.488+0000 7f344effd640 1 -- 172.21.15.90:0/797912827 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f3450063080 con 0x7f3458157fc0 2024-09-10T23:15:29.489 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:15:29.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.490+0000 7f34607a3640 1 -- 172.21.15.90:0/797912827 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f343c077f70 msgr2=0x7f343c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:29.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.490+0000 7f34607a3640 1 --2- 172.21.15.90:0/797912827 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f343c077f70 0x7f343c07a430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3454034000 tx=0x7f3454004730 comp rx=0 tx=0).stop 2024-09-10T23:15:29.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.490+0000 7f34607a3640 1 -- 172.21.15.90:0/797912827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3458157fc0 msgr2=0x7f34581f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:29.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.490+0000 7f34607a3640 1 --2- 172.21.15.90:0/797912827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3458157fc0 0x7f34581f5010 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f345000cb00 tx=0x7f345000a250 comp rx=0 tx=0).stop 2024-09-10T23:15:29.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.490+0000 7f34607a3640 1 -- 172.21.15.90:0/797912827 shutdown_connections 2024-09-10T23:15:29.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.490+0000 7f34607a3640 1 --2- 172.21.15.90:0/797912827 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f343c077f70 0x7f343c07a430 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:29.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.490+0000 7f34607a3640 1 --2- 172.21.15.90:0/797912827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3458157fc0 0x7f34581f5010 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:29.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.490+0000 7f34607a3640 1 --2- 172.21.15.90:0/797912827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34580ca420 0x7f345809d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:29.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.490+0000 7f34607a3640 1 --2- 172.21.15.90:0/797912827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34580aef50 0x7f3458156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:29.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.490+0000 7f34607a3640 1 -- 172.21.15.90:0/797912827 >> 172.21.15.90:0/797912827 conn(0x7f34580cc850 msgr2=0x7f34580ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:29.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.490+0000 7f34607a3640 1 -- 172.21.15.90:0/797912827 shutdown_connections 2024-09-10T23:15:29.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.490+0000 7f34607a3640 1 -- 172.21.15.90:0/797912827 wait complete. 2024-09-10T23:15:29.502 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T23:15:29.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:29.502 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T23:15:29.530 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:15:29.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:29.530 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:15:29.586 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json perf dump 2024-09-10T23:15:29.705 INFO:teuthology.orchestra.run.smithi171.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":64,"msgr_send_messages":59,"msgr_recv_bytes":124959,"msgr_send_bytes":14730,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.007615938,"msgr_running_send_time":0.001899821,"msgr_running_recv_time":0.006475508,"msgr_running_fast_dispatch_time":0.000247388,"msgr_send_messages_queue_lat":{"avgcount":59,"sum":0.033520783,"avgtime":0.000568148},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":123104,"msgr_send_encrypted_bytes":11728},"AsyncMessenger::Worker-1":{"msgr_recv_messages":44,"msgr_send_messages":48,"msgr_recv_bytes":10458,"msgr_send_bytes":136403,"msgr_created_connections":9,"msgr_active_connections":3,"msgr_running_total_time":0.009363433,"msgr_running_send_time":0.001923679,"msgr_running_recv_time":0.007585434,"msgr_running_fast_dispatch_time":0.000217035,"msgr_send_messages_queue_lat":{"avgcount":46,"sum":0.038029943,"avgtime":0.000826737},"msgr_handle_ack_lat":{"avgcount":34,"sum":0.000013641,"avgtime":0.000000401},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":94160},"AsyncMessenger::Worker-2":{"msgr_recv_messages":45,"msgr_send_messages":43,"msgr_recv_bytes":12555,"msgr_send_bytes":26799,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.008936574,"msgr_running_send_time":0.001788991,"msgr_running_recv_time":0.006399953,"msgr_running_fast_dispatch_time":0.000711238,"msgr_send_messages_queue_lat":{"avgcount":42,"sum":0.179898547,"avgtime":0.004283298},"msgr_handle_ack_lat":{"avgcount":5,"sum":0.000003337,"avgtime":0.000000667},"msgr_recv_encrypted_bytes":1872,"msgr_send_encrypted_bytes":448},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":46,"sum":0.002739966,"avgtime":0.000059564}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000010479,"avgtime":0.000005239}},"mds":{"request":33,"reply":33,"reply_latency":{"avgcount":33,"sum":0.005590487,"avgtime":0.000169408},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":62,"traverse_hit":59,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":10,"evex":0,"evtrm":0,"ev":10,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197422,"rdpos":0,"jlat":{"avgcount":7,"sum":0.011037456,"avgtime":0.001576779},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":3,"cap-":2,"rss":45248,"heap":266149888},"mds_server":{"dispatch_client_request":33,"dispatch_server_request":0,"handle_client_request":33,"handle_client_session":9,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":29,"sum":0.004728873,"avgtime":0.000163064},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":3,"sum":0.000441733,"avgtime":0.000147244},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000419881,"avgtime":0.000419881},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":3,"session_remove":3,"sessions_open":0,"sessions_stale":0,"total_load":31,"average_load":31,"avg_session_uptime":0,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":216705,"buffer_anon_items":77,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5312,"osdmap_items":75,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53360,"mds_co_items":216,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":45,"op_send_bytes":14238,"op_resend":37,"op_reply":45,"op_latency":{"avgcount":45,"sum":0.551988587,"avgtime":0.012266413},"op_inflight":0,"oplen_avg":{"avgcount":45,"sum":69},"op":45,"op_r":0,"op_w":45,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":7,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":34,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":149,"get_sum":130704,"get_or_fail_fail":0,"get_or_fail_success":149,"take":0,"take_sum":0,"put":149,"put_sum":130704,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":45,"take_sum":14238,"put":45,"put_sum":14238,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":45,"take_sum":45,"put":45,"put_sum":45,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55f30e07c960":{"val":0,"max":3758096384,"get_started":0,"get":10,"get_sum":3118,"get_or_fail_fail":0,"get_or_fail_success":10,"take":0,"take_sum":0,"put":7,"put_sum":3118,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":0}} 2024-09-10T23:15:29.707 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 124959, "msgr_recv_encrypted_bytes": 123104, "msgr_recv_messages": 64, "msgr_running_fast_dispatch_time": 0.000247388, "msgr_running_recv_time": 0.006475508, "msgr_running_send_time": 0.001899821, "msgr_running_total_time": 0.007615938, "msgr_send_bytes": 14730, "msgr_send_encrypted_bytes": 11728, "msgr_send_messages": 59, "msgr_send_messages_queue_lat": { "avgcount": 59, "avgtime": 0.000568148, "sum": 0.033520783 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 9, "msgr_handle_ack_lat": { "avgcount": 34, "avgtime": 4.01e-07, "sum": 1.3641e-05 }, "msgr_recv_bytes": 10458, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 44, "msgr_running_fast_dispatch_time": 0.000217035, "msgr_running_recv_time": 0.007585434, "msgr_running_send_time": 0.001923679, "msgr_running_total_time": 0.009363433, "msgr_send_bytes": 136403, "msgr_send_encrypted_bytes": 94160, "msgr_send_messages": 48, "msgr_send_messages_queue_lat": { "avgcount": 46, "avgtime": 0.000826737, "sum": 0.038029943 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 5, "avgtime": 6.67e-07, "sum": 3.337e-06 }, "msgr_recv_bytes": 12555, "msgr_recv_encrypted_bytes": 1872, "msgr_recv_messages": 45, "msgr_running_fast_dispatch_time": 0.000711238, "msgr_running_recv_time": 0.006399953, "msgr_running_send_time": 0.001788991, "msgr_running_total_time": 0.008936574, "msgr_send_bytes": 26799, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 43, "msgr_send_messages_queue_lat": { "avgcount": 42, "avgtime": 0.004283298, "sum": 0.179898547 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 46, "avgtime": 5.9564e-05, "sum": 0.002739966 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 5.239e-06, "sum": 1.0479e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 33, "reply_latency": { "avgcount": 33, "avgtime": 0.000169408, "sum": 0.005590487 }, "request": 33, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 62, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 59, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 10, "evadd": 10, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 7, "avgtime": 0.001576779, "sum": 0.011037456 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197422 }, "mds_mem": { "cap": 1, "cap+": 3, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 266149888, "ino": 13, "ino+": 13, "ino-": 0, "rss": 45248 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 33, "dispatch_server_request": 0, "handle_client_request": 33, "handle_client_session": 9, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 29, "avgtime": 0.000163064, "sum": 0.004728873 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 3, "avgtime": 0.000147244, "sum": 0.000441733 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000419881, "sum": 0.000419881 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 31, "avg_session_uptime": 0, "mdthresh_evicted": 0, "session_add": 3, "session_count": 0, "session_remove": 3, "sessions_open": 0, "sessions_stale": 0, "total_load": 31 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 216705, "buffer_anon_items": 77, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53360, "mds_co_items": 216, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5312, "osdmap_items": 75, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 34, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 45, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 45, "avgtime": 0.012266413, "sum": 0.551988587 }, "op_pg": 0, "op_r": 0, "op_reply": 45, "op_resend": 37, "op_rmw": 0, "op_send": 45, "op_send_bytes": 14238, "op_w": 45, "oplen_avg": { "avgcount": 45, "sum": 69 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 7, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 149, "get_or_fail_fail": 0, "get_or_fail_success": 149, "get_started": 0, "get_sum": 130704, "max": 104857600, "put": 149, "put_sum": 130704, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 45, "put_sum": 14238, "take": 45, "take_sum": 14238, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 45, "put_sum": 45, "take": 45, "take_sum": 45, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55f30e07c960": { "get": 10, "get_or_fail_fail": 0, "get_or_fail_success": 10, "get_started": 0, "get_sum": 3118, "max": 3758096384, "put": 7, "put_sum": 3118, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 0 } } 2024-09-10T23:15:29.707 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-10T23:15:29.707 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:15:29.707 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:15:29.744 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:15:29.782 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:15:29.782 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:15:29.782 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:29.782 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:29.800 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:15:29.800 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:15:29.800 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:15:29.800 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:29.838 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:15:29.839 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:15:29.839 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:29.839 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:29.856 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:15:29.856 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:15:29.856 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:15:29.856 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:29.894 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:15:29.894 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:29.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.996+0000 7f13f668c640 1 -- 172.21.15.90:0/1929256534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13f0157fc0 msgr2=0x7f13f015b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:29.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.996+0000 7f13f668c640 1 --2- 172.21.15.90:0/1929256534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13f0157fc0 0x7f13f015b290 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f13e0009830 tx=0x7f13e002a470 comp rx=0 tx=0).stop 2024-09-10T23:15:29.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.996+0000 7f13f668c640 1 -- 172.21.15.90:0/1929256534 shutdown_connections 2024-09-10T23:15:29.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.996+0000 7f13f668c640 1 --2- 172.21.15.90:0/1929256534 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13f00ca420 0x7f13f00ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:29.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.996+0000 7f13f668c640 1 --2- 172.21.15.90:0/1929256534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13f0157fc0 0x7f13f015b290 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:29.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.996+0000 7f13f668c640 1 -- 172.21.15.90:0/1929256534 >> 172.21.15.90:0/1929256534 conn(0x7f13f00cc850 msgr2=0x7f13f00ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:29.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.996+0000 7f13f668c640 1 -- 172.21.15.90:0/1929256534 shutdown_connections 2024-09-10T23:15:29.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.996+0000 7f13f668c640 1 -- 172.21.15.90:0/1929256534 wait complete. 2024-09-10T23:15:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.997+0000 7f13f668c640 1 Processor -- start 2024-09-10T23:15:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.998+0000 7f13f668c640 1 -- start start 2024-09-10T23:15:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.998+0000 7f13f668c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13f00aef50 0x7f13f01f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.998+0000 7f13f668c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13f00ca420 0x7f13f00b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.998+0000 7f13f668c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13f0157fc0 0x7f13f009bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.998+0000 7f13f668c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f13f00b1a40 con 0x7f13f0157fc0 2024-09-10T23:15:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.998+0000 7f13f668c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f13f00b18c0 con 0x7f13f00aef50 2024-09-10T23:15:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.998+0000 7f13f668c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f13f00b1bc0 con 0x7f13f00ca420 2024-09-10T23:15:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.998+0000 7f13f4c29640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13f0157fc0 0x7f13f009bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.998+0000 7f13f4c29640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13f0157fc0 0x7f13f009bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35942/0 (socket says 172.21.15.90:35942) 2024-09-10T23:15:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.998+0000 7f13f4c29640 1 -- 172.21.15.90:0/840672356 learned_addr learned my addr 172.21.15.90:0/840672356 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.998+0000 7f13e7fff640 1 --2- 172.21.15.90:0/840672356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13f00ca420 0x7f13f00b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.998+0000 7f13effff640 1 --2- 172.21.15.90:0/840672356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13f00aef50 0x7f13f01f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.999+0000 7f13f4c29640 1 -- 172.21.15.90:0/840672356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13f00ca420 msgr2=0x7f13f00b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.999+0000 7f13f4c29640 1 --2- 172.21.15.90:0/840672356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13f00ca420 0x7f13f00b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.999+0000 7f13f4c29640 1 -- 172.21.15.90:0/840672356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13f00aef50 msgr2=0x7f13f01f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.999+0000 7f13f4c29640 1 --2- 172.21.15.90:0/840672356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13f00aef50 0x7f13f01f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.999+0000 7f13f4c29640 1 -- 172.21.15.90:0/840672356 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f00c62b0 con 0x7f13f0157fc0 2024-09-10T23:15:30.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.999+0000 7f13f4c29640 1 --2- 172.21.15.90:0/840672356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13f0157fc0 0x7f13f009bef0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f13e800eb10 tx=0x7f13e800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:30.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.999+0000 7f13ed7fa640 1 -- 172.21.15.90:0/840672356 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e8004b20 con 0x7f13f0157fc0 2024-09-10T23:15:30.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.999+0000 7f13ed7fa640 1 -- 172.21.15.90:0/840672356 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13e8004ce0 con 0x7f13f0157fc0 2024-09-10T23:15:30.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.999+0000 7f13f668c640 1 -- 172.21.15.90:0/840672356 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f00c6830 con 0x7f13f0157fc0 2024-09-10T23:15:30.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.999+0000 7f13ed7fa640 1 -- 172.21.15.90:0/840672356 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e8005280 con 0x7f13f0157fc0 2024-09-10T23:15:30.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:29.999+0000 7f13f668c640 1 -- 172.21.15.90:0/840672356 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f009b6a0 con 0x7f13f0157fc0 2024-09-10T23:15:30.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.000+0000 7f13f668c640 1 -- 172.21.15.90:0/840672356 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f00cf4e0 con 0x7f13f0157fc0 2024-09-10T23:15:30.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.001+0000 7f13ed7fa640 1 -- 172.21.15.90:0/840672356 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f13e8005420 con 0x7f13f0157fc0 2024-09-10T23:15:30.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.001+0000 7f13ed7fa640 1 --2- 172.21.15.90:0/840672356 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f13d0077f70 0x7f13d007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.001+0000 7f13ed7fa640 1 -- 172.21.15.90:0/840672356 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f13e809a910 con 0x7f13f0157fc0 2024-09-10T23:15:30.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.001+0000 7f13effff640 1 --2- 172.21.15.90:0/840672356 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f13d0077f70 0x7f13d007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.002+0000 7f13effff640 1 --2- 172.21.15.90:0/840672356 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f13d0077f70 0x7f13d007a430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f13e0034000 tx=0x7f13e0004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:30.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.005+0000 7f13ed7fa640 1 -- 172.21.15.90:0/840672356 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f13f00cf4e0 con 0x7f13f0157fc0 2024-09-10T23:15:30.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.212+0000 7f13f668c640 1 -- 172.21.15.90:0/840672356 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13f00ca890 con 0x7f13f0157fc0 2024-09-10T23:15:30.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.212+0000 7f13ed7fa640 1 -- 172.21.15.90:0/840672356 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5220 (secure 0 0 0) 0x7f13e8062dc0 con 0x7f13f0157fc0 2024-09-10T23:15:30.213 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:30.214 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"btime":"2024-09-10T23:15:16:780866+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/464675823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":464675823},{"type":"v1","addr":"172.21.15.90:6835","nonce":464675823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/28851721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":28851721},{"type":"v1","addr":"172.21.15.171:6836","nonce":28851721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/3538341252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3538341252},{"type":"v1","addr":"172.21.15.90:6834","nonce":3538341252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:14.107910+0000","modified":"2024-09-10T23:15:16.120228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4881":{"gid":4881,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/2513837234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2513837234},{"type":"v1","addr":"172.21.15.171:6837","nonce":2513837234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4881,"qdb_cluster":[4881]},"id":2}]} 2024-09-10T23:15:30.214 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2024-09-10T23:15:30.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.214+0000 7f13f668c640 1 -- 172.21.15.90:0/840672356 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f13d0077f70 msgr2=0x7f13d007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.214+0000 7f13f668c640 1 --2- 172.21.15.90:0/840672356 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f13d0077f70 0x7f13d007a430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f13e0034000 tx=0x7f13e0004730 comp rx=0 tx=0).stop 2024-09-10T23:15:30.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.214+0000 7f13f668c640 1 -- 172.21.15.90:0/840672356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13f0157fc0 msgr2=0x7f13f009bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.214+0000 7f13f668c640 1 --2- 172.21.15.90:0/840672356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13f0157fc0 0x7f13f009bef0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f13e800eb10 tx=0x7f13e800c2d0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.214+0000 7f13f668c640 1 -- 172.21.15.90:0/840672356 shutdown_connections 2024-09-10T23:15:30.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.214+0000 7f13f668c640 1 --2- 172.21.15.90:0/840672356 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f13d0077f70 0x7f13d007a430 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.214+0000 7f13f668c640 1 --2- 172.21.15.90:0/840672356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13f0157fc0 0x7f13f009bef0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.214+0000 7f13f668c640 1 --2- 172.21.15.90:0/840672356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13f00ca420 0x7f13f00b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.214+0000 7f13f668c640 1 --2- 172.21.15.90:0/840672356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13f00aef50 0x7f13f01f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.214+0000 7f13f668c640 1 -- 172.21.15.90:0/840672356 >> 172.21.15.90:0/840672356 conn(0x7f13f00cc850 msgr2=0x7f13f00af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:30.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.214+0000 7f13f668c640 1 -- 172.21.15.90:0/840672356 shutdown_connections 2024-09-10T23:15:30.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.214+0000 7f13f668c640 1 -- 172.21.15.90:0/840672356 wait complete. 2024-09-10T23:15:30.227 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:30.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.326+0000 7f7a1d216640 1 -- 172.21.15.90:0/1974731537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a180d2470 msgr2=0x7f7a180b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.326+0000 7f7a1d216640 1 --2- 172.21.15.90:0/1974731537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a180d2470 0x7f7a180b3490 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7a180d3c80 tx=0x7f7a1002aac0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.326+0000 7f7a1d216640 1 -- 172.21.15.90:0/1974731537 shutdown_connections 2024-09-10T23:15:30.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.326+0000 7f7a1d216640 1 --2- 172.21.15.90:0/1974731537 >> v2:172.21.15.171:3300/0 conn(0x7f7a180d1c70 0x7f7a180d2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.326+0000 7f7a1d216640 1 --2- 172.21.15.90:0/1974731537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a180d2470 0x7f7a180b3490 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.326+0000 7f7a1d216640 1 -- 172.21.15.90:0/1974731537 >> 172.21.15.90:0/1974731537 conn(0x7f7a1809d2a0 msgr2=0x7f7a180d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:30.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.326+0000 7f7a1d216640 1 -- 172.21.15.90:0/1974731537 shutdown_connections 2024-09-10T23:15:30.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.326+0000 7f7a1d216640 1 -- 172.21.15.90:0/1974731537 wait complete. 2024-09-10T23:15:30.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.328+0000 7f7a1d216640 1 Processor -- start 2024-09-10T23:15:30.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.328+0000 7f7a1d216640 1 -- start start 2024-09-10T23:15:30.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.328+0000 7f7a1d216640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a180d0ab0 0x7f7a18161420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.328+0000 7f7a1d216640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a180d1c70 0x7f7a18150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.328+0000 7f7a1d216640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a180d2470 0x7f7a180b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.328+0000 7f7a1d216640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1815e4a0 con 0x7f7a180d0ab0 2024-09-10T23:15:30.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.328+0000 7f7a1d216640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1815e320 con 0x7f7a180d2470 2024-09-10T23:15:30.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.328+0000 7f7a1d216640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7a180b4a10 con 0x7f7a180d1c70 2024-09-10T23:15:30.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.328+0000 7f7a16d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a180d0ab0 0x7f7a18161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.328+0000 7f7a16d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a180d0ab0 0x7f7a18161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35960/0 (socket says 172.21.15.90:35960) 2024-09-10T23:15:30.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.329+0000 7f7a16d9d640 1 -- 172.21.15.90:0/2092381205 learned_addr learned my addr 172.21.15.90:0/2092381205 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:30.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.329+0000 7f7a1659c640 1 --2- 172.21.15.90:0/2092381205 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a180d1c70 0x7f7a18150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.329+0000 7f7a1759e640 1 --2- 172.21.15.90:0/2092381205 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a180d2470 0x7f7a180b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.329+0000 7f7a16d9d640 1 -- 172.21.15.90:0/2092381205 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a180d1c70 msgr2=0x7f7a18150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.329+0000 7f7a16d9d640 1 --2- 172.21.15.90:0/2092381205 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a180d1c70 0x7f7a18150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.329+0000 7f7a16d9d640 1 -- 172.21.15.90:0/2092381205 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a180d2470 msgr2=0x7f7a180b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.329+0000 7f7a16d9d640 1 --2- 172.21.15.90:0/2092381205 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a180d2470 0x7f7a180b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.329+0000 7f7a16d9d640 1 -- 172.21.15.90:0/2092381205 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a18151300 con 0x7f7a180d0ab0 2024-09-10T23:15:30.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.329+0000 7f7a16d9d640 1 --2- 172.21.15.90:0/2092381205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a180d0ab0 0x7f7a18161420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7a10000f80 tx=0x7f7a10003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:30.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.329+0000 7f7a0f7fe640 1 -- 172.21.15.90:0/2092381205 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a10044070 con 0x7f7a180d0ab0 2024-09-10T23:15:30.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.329+0000 7f7a0f7fe640 1 -- 172.21.15.90:0/2092381205 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a10004250 con 0x7f7a180d0ab0 2024-09-10T23:15:30.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.329+0000 7f7a0f7fe640 1 -- 172.21.15.90:0/2092381205 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a100046c0 con 0x7f7a180d0ab0 2024-09-10T23:15:30.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.329+0000 7f7a1d216640 1 -- 172.21.15.90:0/2092381205 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1815e920 con 0x7f7a180d0ab0 2024-09-10T23:15:30.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.329+0000 7f7a1d216640 1 -- 172.21.15.90:0/2092381205 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a18160960 con 0x7f7a180d0ab0 2024-09-10T23:15:30.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.330+0000 7f7a1d216640 1 -- 172.21.15.90:0/2092381205 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a180d1790 con 0x7f7a180d0ab0 2024-09-10T23:15:30.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.331+0000 7f7a0f7fe640 1 -- 172.21.15.90:0/2092381205 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7a10036400 con 0x7f7a180d0ab0 2024-09-10T23:15:30.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.331+0000 7f7a0f7fe640 1 --2- 172.21.15.90:0/2092381205 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f79f8077f70 0x7f79f807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.331+0000 7f7a0f7fe640 1 -- 172.21.15.90:0/2092381205 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7a100ba340 con 0x7f7a180d0ab0 2024-09-10T23:15:30.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.331+0000 7f7a1659c640 1 --2- 172.21.15.90:0/2092381205 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f79f8077f70 0x7f79f807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.332+0000 7f7a1659c640 1 --2- 172.21.15.90:0/2092381205 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f79f8077f70 0x7f79f807a430 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7a180cdb10 tx=0x7f7a00005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:30.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.335+0000 7f7a0f7fe640 1 -- 172.21.15.90:0/2092381205 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7a1815e920 con 0x7f7a180d0ab0 2024-09-10T23:15:30.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.545+0000 7f7a1d216640 1 -- 172.21.15.90:0/2092381205 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a180b45b0 con 0x7f7a180d0ab0 2024-09-10T23:15:30.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.546+0000 7f7a0f7fe640 1 -- 172.21.15.90:0/2092381205 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5220 (secure 0 0 0) 0x7f7a18151300 con 0x7f7a180d0ab0 2024-09-10T23:15:30.547 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:30.547 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"btime":"2024-09-10T23:15:16:780866+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/464675823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":464675823},{"type":"v1","addr":"172.21.15.90:6835","nonce":464675823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/28851721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":28851721},{"type":"v1","addr":"172.21.15.171:6836","nonce":28851721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/3538341252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3538341252},{"type":"v1","addr":"172.21.15.90:6834","nonce":3538341252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:14.107910+0000","modified":"2024-09-10T23:15:16.120228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4881":{"gid":4881,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/2513837234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2513837234},{"type":"v1","addr":"172.21.15.171:6837","nonce":2513837234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4881,"qdb_cluster":[4881]},"id":2}]} 2024-09-10T23:15:30.547 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2024-09-10T23:15:30.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.548+0000 7f7a1d216640 1 -- 172.21.15.90:0/2092381205 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f79f8077f70 msgr2=0x7f79f807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.548+0000 7f7a1d216640 1 --2- 172.21.15.90:0/2092381205 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f79f8077f70 0x7f79f807a430 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7a180cdb10 tx=0x7f7a00005f90 comp rx=0 tx=0).stop 2024-09-10T23:15:30.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.548+0000 7f7a1d216640 1 -- 172.21.15.90:0/2092381205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a180d0ab0 msgr2=0x7f7a18161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.548+0000 7f7a1d216640 1 --2- 172.21.15.90:0/2092381205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a180d0ab0 0x7f7a18161420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7a10000f80 tx=0x7f7a10003ce0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.548+0000 7f7a1d216640 1 -- 172.21.15.90:0/2092381205 shutdown_connections 2024-09-10T23:15:30.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.548+0000 7f7a1d216640 1 --2- 172.21.15.90:0/2092381205 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f79f8077f70 0x7f79f807a430 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.548+0000 7f7a1d216640 1 --2- 172.21.15.90:0/2092381205 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a180d2470 0x7f7a180b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.548+0000 7f7a1d216640 1 --2- 172.21.15.90:0/2092381205 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a180d1c70 0x7f7a18150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.548+0000 7f7a1d216640 1 --2- 172.21.15.90:0/2092381205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a180d0ab0 0x7f7a18161420 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.548+0000 7f7a1d216640 1 -- 172.21.15.90:0/2092381205 >> 172.21.15.90:0/2092381205 conn(0x7f7a1809d2a0 msgr2=0x7f7a1806ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:30.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.548+0000 7f7a1d216640 1 -- 172.21.15.90:0/2092381205 shutdown_connections 2024-09-10T23:15:30.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.548+0000 7f7a1d216640 1 -- 172.21.15.90:0/2092381205 wait complete. 2024-09-10T23:15:30.560 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:30.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.660+0000 7f17c50ef640 1 -- 172.21.15.90:0/3301719802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c00ca420 msgr2=0x7f17c00ca850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.660+0000 7f17c50ef640 1 --2- 172.21.15.90:0/3301719802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c00ca420 0x7f17c00ca850 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f17b8005fd0 tx=0x7f17b802aa00 comp rx=0 tx=0).stop 2024-09-10T23:15:30.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.660+0000 7f17c50ef640 1 -- 172.21.15.90:0/3301719802 shutdown_connections 2024-09-10T23:15:30.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.660+0000 7f17c50ef640 1 --2- 172.21.15.90:0/3301719802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c00ca420 0x7f17c00ca850 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.660+0000 7f17c50ef640 1 --2- 172.21.15.90:0/3301719802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17c00cb7e0 0x7f17c006f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.660+0000 7f17c50ef640 1 -- 172.21.15.90:0/3301719802 >> 172.21.15.90:0/3301719802 conn(0x7f17c00cc850 msgr2=0x7f17c00ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:30.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.660+0000 7f17c50ef640 1 -- 172.21.15.90:0/3301719802 shutdown_connections 2024-09-10T23:15:30.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.660+0000 7f17c50ef640 1 -- 172.21.15.90:0/3301719802 wait complete. 2024-09-10T23:15:30.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.662+0000 7f17c50ef640 1 Processor -- start 2024-09-10T23:15:30.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.662+0000 7f17c50ef640 1 -- start start 2024-09-10T23:15:30.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.662+0000 7f17c50ef640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17c00ca420 0x7f17c00c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.662+0000 7f17c50ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c00cb7e0 0x7f17c00c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.662+0000 7f17c50ef640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17c015bcb0 0x7f17c01f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.662+0000 7f17c50ef640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f17c00b1850 con 0x7f17c00cb7e0 2024-09-10T23:15:30.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.662+0000 7f17c50ef640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f17c006f470 con 0x7f17c015bcb0 2024-09-10T23:15:30.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.662+0000 7f17c50ef640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f17c00b19d0 con 0x7f17c00ca420 2024-09-10T23:15:30.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.662+0000 7f17be59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c00cb7e0 0x7f17c00c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.663+0000 7f17be59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c00cb7e0 0x7f17c00c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35972/0 (socket says 172.21.15.90:35972) 2024-09-10T23:15:30.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.663+0000 7f17be59c640 1 -- 172.21.15.90:0/3746673183 learned_addr learned my addr 172.21.15.90:0/3746673183 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:30.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.663+0000 7f17bed9d640 1 --2- 172.21.15.90:0/3746673183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17c00ca420 0x7f17c00c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.663+0000 7f17bf59e640 1 --2- 172.21.15.90:0/3746673183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17c015bcb0 0x7f17c01f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.663+0000 7f17be59c640 1 -- 172.21.15.90:0/3746673183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17c00ca420 msgr2=0x7f17c00c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.663+0000 7f17be59c640 1 --2- 172.21.15.90:0/3746673183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17c00ca420 0x7f17c00c42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.663+0000 7f17be59c640 1 -- 172.21.15.90:0/3746673183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17c015bcb0 msgr2=0x7f17c01f2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.663+0000 7f17be59c640 1 --2- 172.21.15.90:0/3746673183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17c015bcb0 0x7f17c01f2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.663+0000 7f17be59c640 1 -- 172.21.15.90:0/3746673183 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c00c6c00 con 0x7f17c00cb7e0 2024-09-10T23:15:30.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.663+0000 7f17be59c640 1 --2- 172.21.15.90:0/3746673183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c00cb7e0 0x7f17c00c66c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f17a800b4d0 tx=0x7f17a800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:30.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.663+0000 7f17b77fe640 1 -- 172.21.15.90:0/3746673183 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a8014070 con 0x7f17c00cb7e0 2024-09-10T23:15:30.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.663+0000 7f17b77fe640 1 -- 172.21.15.90:0/3746673183 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17a8010960 con 0x7f17c00cb7e0 2024-09-10T23:15:30.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.663+0000 7f17b77fe640 1 -- 172.21.15.90:0/3746673183 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a8010db0 con 0x7f17c00cb7e0 2024-09-10T23:15:30.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.663+0000 7f17c50ef640 1 -- 172.21.15.90:0/3746673183 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c01f3580 con 0x7f17c00cb7e0 2024-09-10T23:15:30.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.663+0000 7f17c50ef640 1 -- 172.21.15.90:0/3746673183 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c00c5ec0 con 0x7f17c00cb7e0 2024-09-10T23:15:30.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.664+0000 7f17c50ef640 1 -- 172.21.15.90:0/3746673183 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c00b1e80 con 0x7f17c00cb7e0 2024-09-10T23:15:30.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.665+0000 7f17b77fe640 1 -- 172.21.15.90:0/3746673183 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f17a800f3c0 con 0x7f17c00cb7e0 2024-09-10T23:15:30.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.665+0000 7f17b77fe640 1 --2- 172.21.15.90:0/3746673183 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f17a0077f70 0x7f17a007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.666+0000 7f17b77fe640 1 -- 172.21.15.90:0/3746673183 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f17a8099da0 con 0x7f17c00cb7e0 2024-09-10T23:15:30.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.666+0000 7f17bed9d640 1 --2- 172.21.15.90:0/3746673183 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f17a0077f70 0x7f17a007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.666+0000 7f17bed9d640 1 --2- 172.21.15.90:0/3746673183 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f17a0077f70 0x7f17a007a430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f17b0006fd0 tx=0x7f17b0009060 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:30.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.670+0000 7f17b77fe640 1 -- 172.21.15.90:0/3746673183 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f17a8062250 con 0x7f17c00cb7e0 2024-09-10T23:15:30.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.850+0000 7f17c50ef640 1 -- 172.21.15.90:0/3746673183 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17c00704e0 con 0x7f17c00cb7e0 2024-09-10T23:15:30.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.851+0000 7f17b77fe640 1 -- 172.21.15.90:0/3746673183 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16729 (secure 0 0 0) 0x7f17a8066c80 con 0x7f17c00cb7e0 2024-09-10T23:15:30.852 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:30.853 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":34,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:15:15.773619+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:11.940848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:13.069613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:30.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.853+0000 7f17c50ef640 1 -- 172.21.15.90:0/3746673183 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f17a0077f70 msgr2=0x7f17a007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.853+0000 7f17c50ef640 1 --2- 172.21.15.90:0/3746673183 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f17a0077f70 0x7f17a007a430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f17b0006fd0 tx=0x7f17b0009060 comp rx=0 tx=0).stop 2024-09-10T23:15:30.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.853+0000 7f17c50ef640 1 -- 172.21.15.90:0/3746673183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c00cb7e0 msgr2=0x7f17c00c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.853+0000 7f17c50ef640 1 --2- 172.21.15.90:0/3746673183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c00cb7e0 0x7f17c00c66c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f17a800b4d0 tx=0x7f17a800b990 comp rx=0 tx=0).stop 2024-09-10T23:15:30.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.853+0000 7f17c50ef640 1 -- 172.21.15.90:0/3746673183 shutdown_connections 2024-09-10T23:15:30.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.853+0000 7f17c50ef640 1 --2- 172.21.15.90:0/3746673183 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f17a0077f70 0x7f17a007a430 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.853+0000 7f17c50ef640 1 --2- 172.21.15.90:0/3746673183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17c015bcb0 0x7f17c01f2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.853+0000 7f17c50ef640 1 --2- 172.21.15.90:0/3746673183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c00cb7e0 0x7f17c00c66c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.853+0000 7f17c50ef640 1 --2- 172.21.15.90:0/3746673183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17c00ca420 0x7f17c00c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.853+0000 7f17c50ef640 1 -- 172.21.15.90:0/3746673183 >> 172.21.15.90:0/3746673183 conn(0x7f17c00cc850 msgr2=0x7f17c00c9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:30.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.854+0000 7f17c50ef640 1 -- 172.21.15.90:0/3746673183 shutdown_connections 2024-09-10T23:15:30.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.854+0000 7f17c50ef640 1 -- 172.21.15.90:0/3746673183 wait complete. 2024-09-10T23:15:30.865 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:15:30.866 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:30.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.965+0000 7f81c4f84640 1 -- 172.21.15.90:0/405509539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81c00ca960 msgr2=0x7f81c00b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.965+0000 7f81c4f84640 1 --2- 172.21.15.90:0/405509539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81c00ca960 0x7f81c00b1850 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f81a8005fd0 tx=0x7f81a802a5d0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.965+0000 7f81c4f84640 1 -- 172.21.15.90:0/405509539 shutdown_connections 2024-09-10T23:15:30.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.965+0000 7f81c4f84640 1 --2- 172.21.15.90:0/405509539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81c00ca960 0x7f81c00b1850 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.965+0000 7f81c4f84640 1 --2- 172.21.15.90:0/405509539 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81c015aa30 0x7f81c00ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.965+0000 7f81c4f84640 1 -- 172.21.15.90:0/405509539 >> 172.21.15.90:0/405509539 conn(0x7f81c00cc850 msgr2=0x7f81c00ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:30.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.966+0000 7f81c4f84640 1 -- 172.21.15.90:0/405509539 shutdown_connections 2024-09-10T23:15:30.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.966+0000 7f81c4f84640 1 -- 172.21.15.90:0/405509539 wait complete. 2024-09-10T23:15:30.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.967+0000 7f81c4f84640 1 Processor -- start 2024-09-10T23:15:30.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.967+0000 7f81c4f84640 1 -- start start 2024-09-10T23:15:30.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81c4f84640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81c015aa30 0x7f81c00c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81c4f84640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81c015ae10 0x7f81c01f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81c4f84640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81c01f4880 0x7f81c01f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81c4f84640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f81c00b2120 con 0x7f81c01f4880 2024-09-10T23:15:30.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81c4f84640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f81c00b1fa0 con 0x7f81c015ae10 2024-09-10T23:15:30.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81c4f84640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f81c006fcd0 con 0x7f81c015aa30 2024-09-10T23:15:30.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81bed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81c01f4880 0x7f81c01f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81bed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81c01f4880 0x7f81c01f4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35984/0 (socket says 172.21.15.90:35984) 2024-09-10T23:15:30.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81bed9d640 1 -- 172.21.15.90:0/2247095115 learned_addr learned my addr 172.21.15.90:0/2247095115 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:30.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81be59c640 1 --2- 172.21.15.90:0/2247095115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81c015aa30 0x7f81c00c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81bdd9b640 1 --2- 172.21.15.90:0/2247095115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81c015ae10 0x7f81c01f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81bed9d640 1 -- 172.21.15.90:0/2247095115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81c015aa30 msgr2=0x7f81c00c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81bed9d640 1 --2- 172.21.15.90:0/2247095115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81c015aa30 0x7f81c00c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81bed9d640 1 -- 172.21.15.90:0/2247095115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81c015ae10 msgr2=0x7f81c01f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81bed9d640 1 --2- 172.21.15.90:0/2247095115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81c015ae10 0x7f81c01f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81bed9d640 1 -- 172.21.15.90:0/2247095115 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c00c4930 con 0x7f81c01f4880 2024-09-10T23:15:30.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81bed9d640 1 --2- 172.21.15.90:0/2247095115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81c01f4880 0x7f81c01f4d10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f81b000e6e0 tx=0x7f81b000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:30.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81b6ffd640 1 -- 172.21.15.90:0/2247095115 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b00052d0 con 0x7f81c01f4880 2024-09-10T23:15:30.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81b6ffd640 1 -- 172.21.15.90:0/2247095115 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81b000c7f0 con 0x7f81c01f4880 2024-09-10T23:15:30.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81b6ffd640 1 -- 172.21.15.90:0/2247095115 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b000cc40 con 0x7f81c01f4880 2024-09-10T23:15:30.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81c4f84640 1 -- 172.21.15.90:0/2247095115 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c00c4c10 con 0x7f81c01f4880 2024-09-10T23:15:30.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.968+0000 7f81c4f84640 1 -- 172.21.15.90:0/2247095115 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c00c51d0 con 0x7f81c01f4880 2024-09-10T23:15:30.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.969+0000 7f81c4f84640 1 -- 172.21.15.90:0/2247095115 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81c00701f0 con 0x7f81c01f4880 2024-09-10T23:15:30.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.970+0000 7f81b6ffd640 1 -- 172.21.15.90:0/2247095115 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f81b000f040 con 0x7f81c01f4880 2024-09-10T23:15:30.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.971+0000 7f81b6ffd640 1 --2- 172.21.15.90:0/2247095115 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f81a0077f70 0x7f81a007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.971+0000 7f81b6ffd640 1 -- 172.21.15.90:0/2247095115 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f81b009bd70 con 0x7f81c01f4880 2024-09-10T23:15:30.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.971+0000 7f81be59c640 1 --2- 172.21.15.90:0/2247095115 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f81a0077f70 0x7f81a007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.971+0000 7f81be59c640 1 --2- 172.21.15.90:0/2247095115 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f81a0077f70 0x7f81a007a430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f81b8005fd0 tx=0x7f81b8009680 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:30.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:30.975+0000 7f81b6ffd640 1 -- 172.21.15.90:0/2247095115 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f81b0016020 con 0x7f81c01f4880 2024-09-10T23:15:31.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.184+0000 7f81c4f84640 1 -- 172.21.15.90:0/2247095115 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81c00d0610 con 0x7f81c01f4880 2024-09-10T23:15:31.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.185+0000 7f81b6ffd640 1 -- 172.21.15.90:0/2247095115 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5220 (secure 0 0 0) 0x7f81b0064220 con 0x7f81c01f4880 2024-09-10T23:15:31.186 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:31.186 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"btime":"2024-09-10T23:15:16:780866+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/464675823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":464675823},{"type":"v1","addr":"172.21.15.90:6835","nonce":464675823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/28851721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":28851721},{"type":"v1","addr":"172.21.15.171:6836","nonce":28851721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/3538341252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3538341252},{"type":"v1","addr":"172.21.15.90:6834","nonce":3538341252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:14.107910+0000","modified":"2024-09-10T23:15:16.120228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4881":{"gid":4881,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/2513837234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2513837234},{"type":"v1","addr":"172.21.15.171:6837","nonce":2513837234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4881,"qdb_cluster":[4881]},"id":2}]} 2024-09-10T23:15:31.186 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2024-09-10T23:15:31.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.187+0000 7f81c4f84640 1 -- 172.21.15.90:0/2247095115 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f81a0077f70 msgr2=0x7f81a007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:31.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.187+0000 7f81c4f84640 1 --2- 172.21.15.90:0/2247095115 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f81a0077f70 0x7f81a007a430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f81b8005fd0 tx=0x7f81b8009680 comp rx=0 tx=0).stop 2024-09-10T23:15:31.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.187+0000 7f81c4f84640 1 -- 172.21.15.90:0/2247095115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81c01f4880 msgr2=0x7f81c01f4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:31.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.187+0000 7f81c4f84640 1 --2- 172.21.15.90:0/2247095115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81c01f4880 0x7f81c01f4d10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f81b000e6e0 tx=0x7f81b000eba0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.187+0000 7f81c4f84640 1 -- 172.21.15.90:0/2247095115 shutdown_connections 2024-09-10T23:15:31.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.187+0000 7f81c4f84640 1 --2- 172.21.15.90:0/2247095115 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f81a0077f70 0x7f81a007a430 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.187+0000 7f81c4f84640 1 --2- 172.21.15.90:0/2247095115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81c015ae10 0x7f81c01f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.187+0000 7f81c4f84640 1 --2- 172.21.15.90:0/2247095115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81c01f4880 0x7f81c01f4d10 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.187+0000 7f81c4f84640 1 --2- 172.21.15.90:0/2247095115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81c015aa30 0x7f81c00c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.187+0000 7f81c4f84640 1 -- 172.21.15.90:0/2247095115 >> 172.21.15.90:0/2247095115 conn(0x7f81c00cc850 msgr2=0x7f81c01593c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:31.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.187+0000 7f81c4f84640 1 -- 172.21.15.90:0/2247095115 shutdown_connections 2024-09-10T23:15:31.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.187+0000 7f81c4f84640 1 -- 172.21.15.90:0/2247095115 wait complete. 2024-09-10T23:15:31.199 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:31.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.299+0000 7fba98f2c640 1 -- 172.21.15.90:0/3126997913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba80003a00 msgr2=0x7fba80003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:31.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.299+0000 7fba98f2c640 1 --2- 172.21.15.90:0/3126997913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba80003a00 0x7fba80003e20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fba8400c2e0 tx=0x7fba80005830 comp rx=0 tx=0).stop 2024-09-10T23:15:31.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.299+0000 7fba92d9d640 1 -- 172.21.15.90:0/3126997913 reap_dead start 2024-09-10T23:15:31.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.299+0000 7fba98f2c640 1 -- 172.21.15.90:0/3126997913 shutdown_connections 2024-09-10T23:15:31.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.299+0000 7fba98f2c640 1 -- 172.21.15.90:0/3126997913 >> 172.21.15.90:0/3126997913 conn(0x7fba940d0490 msgr2=0x7fba940d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:31.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.299+0000 7fba98f2c640 1 -- 172.21.15.90:0/3126997913 shutdown_connections 2024-09-10T23:15:31.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.299+0000 7fba98f2c640 1 -- 172.21.15.90:0/3126997913 wait complete. 2024-09-10T23:15:31.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.300+0000 7fba98f2c640 1 Processor -- start 2024-09-10T23:15:31.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.301+0000 7fba98f2c640 1 -- start start 2024-09-10T23:15:31.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.301+0000 7fba98f2c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba80003a00 0x7fba941f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:31.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.301+0000 7fba98f2c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba9406f940 0x7fba940c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:31.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.301+0000 7fba98f2c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba940b5500 0x7fba940c3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:31.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.301+0000 7fba98f2c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fba9415e7c0 con 0x7fba80003a00 2024-09-10T23:15:31.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.301+0000 7fba98f2c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fba9415e640 con 0x7fba940b5500 2024-09-10T23:15:31.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.301+0000 7fba98f2c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fba940ce5a0 con 0x7fba9406f940 2024-09-10T23:15:31.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.301+0000 7fba9259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba80003a00 0x7fba941f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:31.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.301+0000 7fba9259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba80003a00 0x7fba941f4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36006/0 (socket says 172.21.15.90:36006) 2024-09-10T23:15:31.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.301+0000 7fba9259c640 1 -- 172.21.15.90:0/47093358 learned_addr learned my addr 172.21.15.90:0/47093358 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:31.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.301+0000 7fba89d9b640 1 --2- 172.21.15.90:0/47093358 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba9406f940 0x7fba940c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:31.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.302+0000 7fba92d9d640 1 --2- 172.21.15.90:0/47093358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba940b5500 0x7fba940c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:31.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.302+0000 7fba9259c640 1 -- 172.21.15.90:0/47093358 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba9406f940 msgr2=0x7fba940c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:31.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.302+0000 7fba9259c640 1 --2- 172.21.15.90:0/47093358 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba9406f940 0x7fba940c2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.302+0000 7fba9259c640 1 -- 172.21.15.90:0/47093358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba940b5500 msgr2=0x7fba940c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:31.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.302+0000 7fba9259c640 1 --2- 172.21.15.90:0/47093358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba940b5500 0x7fba940c3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.302+0000 7fba9259c640 1 -- 172.21.15.90:0/47093358 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba941f7fe0 con 0x7fba80003a00 2024-09-10T23:15:31.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.302+0000 7fba92d9d640 1 --2- 172.21.15.90:0/47093358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba940b5500 0x7fba940c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:31.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.302+0000 7fba9259c640 1 --2- 172.21.15.90:0/47093358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba80003a00 0x7fba941f4340 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fba8402b110 tx=0x7fba84001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:31.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.302+0000 7fba8b7fe640 1 -- 172.21.15.90:0/47093358 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84031040 con 0x7fba80003a00 2024-09-10T23:15:31.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.302+0000 7fba8b7fe640 1 -- 172.21.15.90:0/47093358 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba84003610 con 0x7fba80003a00 2024-09-10T23:15:31.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.302+0000 7fba98f2c640 1 -- 172.21.15.90:0/47093358 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba941f82c0 con 0x7fba80003a00 2024-09-10T23:15:31.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.302+0000 7fba8b7fe640 1 -- 172.21.15.90:0/47093358 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84003a40 con 0x7fba80003a00 2024-09-10T23:15:31.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.302+0000 7fba98f2c640 1 -- 172.21.15.90:0/47093358 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba941f8880 con 0x7fba80003a00 2024-09-10T23:15:31.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.303+0000 7fba98f2c640 1 -- 172.21.15.90:0/47093358 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba940ce060 con 0x7fba80003a00 2024-09-10T23:15:31.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.304+0000 7fba8b7fe640 1 -- 172.21.15.90:0/47093358 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fba84003be0 con 0x7fba80003a00 2024-09-10T23:15:31.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.304+0000 7fba8b7fe640 1 --2- 172.21.15.90:0/47093358 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fba74077fa0 0x7fba7407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:31.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.304+0000 7fba8b7fe640 1 -- 172.21.15.90:0/47093358 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fba840ba0c0 con 0x7fba80003a00 2024-09-10T23:15:31.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.304+0000 7fba89d9b640 1 --2- 172.21.15.90:0/47093358 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fba74077fa0 0x7fba7407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:31.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.305+0000 7fba89d9b640 1 --2- 172.21.15.90:0/47093358 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fba74077fa0 0x7fba7407a460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fba940aed90 tx=0x7fba7c005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:31.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.308+0000 7fba8b7fe640 1 -- 172.21.15.90:0/47093358 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fba84082ca0 con 0x7fba80003a00 2024-09-10T23:15:31.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.517+0000 7fba98f2c640 1 -- 172.21.15.90:0/47093358 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba9415cb80 con 0x7fba80003a00 2024-09-10T23:15:31.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.518+0000 7fba8b7fe640 1 -- 172.21.15.90:0/47093358 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5220 (secure 0 0 0) 0x7fba84006630 con 0x7fba80003a00 2024-09-10T23:15:31.519 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:31.519 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":14,"btime":"2024-09-10T23:15:16:780866+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/464675823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":464675823},{"type":"v1","addr":"172.21.15.90:6835","nonce":464675823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/28851721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":28851721},{"type":"v1","addr":"172.21.15.171:6836","nonce":28851721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/3538341252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3538341252},{"type":"v1","addr":"172.21.15.90:6834","nonce":3538341252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:14.107910+0000","modified":"2024-09-10T23:15:16.120228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4881":{"gid":4881,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/2513837234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2513837234},{"type":"v1","addr":"172.21.15.171:6837","nonce":2513837234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4881,"qdb_cluster":[4881]},"id":2}]} 2024-09-10T23:15:31.519 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 14 2024-09-10T23:15:31.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.520+0000 7fba98f2c640 1 -- 172.21.15.90:0/47093358 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fba74077fa0 msgr2=0x7fba7407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:31.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.520+0000 7fba98f2c640 1 --2- 172.21.15.90:0/47093358 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fba74077fa0 0x7fba7407a460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fba940aed90 tx=0x7fba7c005f90 comp rx=0 tx=0).stop 2024-09-10T23:15:31.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.520+0000 7fba98f2c640 1 -- 172.21.15.90:0/47093358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba80003a00 msgr2=0x7fba941f4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:31.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.520+0000 7fba98f2c640 1 --2- 172.21.15.90:0/47093358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba80003a00 0x7fba941f4340 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fba8402b110 tx=0x7fba84001d80 comp rx=0 tx=0).stop 2024-09-10T23:15:31.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.520+0000 7fba98f2c640 1 -- 172.21.15.90:0/47093358 shutdown_connections 2024-09-10T23:15:31.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.520+0000 7fba98f2c640 1 --2- 172.21.15.90:0/47093358 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fba74077fa0 0x7fba7407a460 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.520+0000 7fba98f2c640 1 --2- 172.21.15.90:0/47093358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba940b5500 0x7fba940c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.520+0000 7fba98f2c640 1 --2- 172.21.15.90:0/47093358 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba9406f940 0x7fba940c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.520+0000 7fba98f2c640 1 --2- 172.21.15.90:0/47093358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba80003a00 0x7fba941f4340 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.520+0000 7fba98f2c640 1 -- 172.21.15.90:0/47093358 >> 172.21.15.90:0/47093358 conn(0x7fba940d0490 msgr2=0x7fba94070440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:31.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.520+0000 7fba98f2c640 1 -- 172.21.15.90:0/47093358 shutdown_connections 2024-09-10T23:15:31.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.520+0000 7fba98f2c640 1 -- 172.21.15.90:0/47093358 wait complete. 2024-09-10T23:15:31.532 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:31.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.631+0000 7f28fb67f640 1 -- 172.21.15.90:0/1758123114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28f40d2470 msgr2=0x7f28f40b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:31.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.631+0000 7f28fb67f640 1 --2- 172.21.15.90:0/1758123114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28f40d2470 0x7f28f40b3490 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f28f40d3c80 tx=0x7f28e402a8b0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.631+0000 7f28fb67f640 1 -- 172.21.15.90:0/1758123114 shutdown_connections 2024-09-10T23:15:31.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.631+0000 7f28fb67f640 1 --2- 172.21.15.90:0/1758123114 >> v2:172.21.15.171:3300/0 conn(0x7f28f40d1c70 0x7f28f40d2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.631+0000 7f28fb67f640 1 --2- 172.21.15.90:0/1758123114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28f40d2470 0x7f28f40b3490 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.631+0000 7f28fb67f640 1 -- 172.21.15.90:0/1758123114 >> 172.21.15.90:0/1758123114 conn(0x7f28f409d2a0 msgr2=0x7f28f40d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:31.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.631+0000 7f28fb67f640 1 -- 172.21.15.90:0/1758123114 shutdown_connections 2024-09-10T23:15:31.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.631+0000 7f28fb67f640 1 -- 172.21.15.90:0/1758123114 wait complete. 2024-09-10T23:15:31.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.632+0000 7f28fb67f640 1 Processor -- start 2024-09-10T23:15:31.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.632+0000 7f28fb67f640 1 -- start start 2024-09-10T23:15:31.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.633+0000 7f28fb67f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28f40d0ab0 0x7f28f41f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:31.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.633+0000 7f28fb67f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28f40d1c70 0x7f28f40c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:31.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.633+0000 7f28fb67f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28f40d2470 0x7f28f41503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:31.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.633+0000 7f28fb67f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f28f415e4a0 con 0x7f28f40d0ab0 2024-09-10T23:15:31.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.633+0000 7f28fb67f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f28f415e320 con 0x7f28f40d2470 2024-09-10T23:15:31.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.633+0000 7f28fb67f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f28f40b4a10 con 0x7f28f40d1c70 2024-09-10T23:15:31.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.633+0000 7f28f941b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28f40d0ab0 0x7f28f41f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:31.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.633+0000 7f28f941b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28f40d0ab0 0x7f28f41f41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36016/0 (socket says 172.21.15.90:36016) 2024-09-10T23:15:31.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.633+0000 7f28f941b640 1 -- 172.21.15.90:0/932073676 learned_addr learned my addr 172.21.15.90:0/932073676 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:31.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.634+0000 7f28f8c1a640 1 --2- 172.21.15.90:0/932073676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28f40d1c70 0x7f28f40c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:31.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.634+0000 7f28f9c1c640 1 --2- 172.21.15.90:0/932073676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28f40d2470 0x7f28f41503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:31.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.634+0000 7f28f941b640 1 -- 172.21.15.90:0/932073676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28f40d1c70 msgr2=0x7f28f40c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:31.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.634+0000 7f28f941b640 1 --2- 172.21.15.90:0/932073676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28f40d1c70 0x7f28f40c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.634+0000 7f28f941b640 1 -- 172.21.15.90:0/932073676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28f40d2470 msgr2=0x7f28f41503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:31.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.634+0000 7f28f941b640 1 --2- 172.21.15.90:0/932073676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28f40d2470 0x7f28f41503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.634+0000 7f28f941b640 1 -- 172.21.15.90:0/932073676 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f40ca290 con 0x7f28f40d0ab0 2024-09-10T23:15:31.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.634+0000 7f28f9c1c640 1 --2- 172.21.15.90:0/932073676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28f40d2470 0x7f28f41503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:31.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.634+0000 7f28f941b640 1 --2- 172.21.15.90:0/932073676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28f40d0ab0 0x7f28f41f41a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f28e402aea0 tx=0x7f28e4003a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:31.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.634+0000 7f28f1ffb640 1 -- 172.21.15.90:0/932073676 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e4031b90 con 0x7f28f40d0ab0 2024-09-10T23:15:31.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.634+0000 7f28f1ffb640 1 -- 172.21.15.90:0/932073676 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28e4031e20 con 0x7f28f40d0ab0 2024-09-10T23:15:31.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.634+0000 7f28f1ffb640 1 -- 172.21.15.90:0/932073676 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e40332f0 con 0x7f28f40d0ab0 2024-09-10T23:15:31.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.634+0000 7f28fb67f640 1 -- 172.21.15.90:0/932073676 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f41f46e0 con 0x7f28f40d0ab0 2024-09-10T23:15:31.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.634+0000 7f28fb67f640 1 -- 172.21.15.90:0/932073676 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f40ca810 con 0x7f28f40d0ab0 2024-09-10T23:15:31.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.635+0000 7f28fb67f640 1 -- 172.21.15.90:0/932073676 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28f40d17e0 con 0x7f28f40d0ab0 2024-09-10T23:15:31.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.636+0000 7f28f1ffb640 1 -- 172.21.15.90:0/932073676 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f28e404b030 con 0x7f28f40d0ab0 2024-09-10T23:15:31.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.636+0000 7f28f1ffb640 1 --2- 172.21.15.90:0/932073676 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f28e0077f70 0x7f28e007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:31.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.637+0000 7f28f8c1a640 1 --2- 172.21.15.90:0/932073676 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f28e0077f70 0x7f28e007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:31.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.637+0000 7f28f1ffb640 1 -- 172.21.15.90:0/932073676 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f28e40bafd0 con 0x7f28f40d0ab0 2024-09-10T23:15:31.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.637+0000 7f28f8c1a640 1 --2- 172.21.15.90:0/932073676 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f28e0077f70 0x7f28e007a430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f28e80058c0 tx=0x7f28e8005850 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:31.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.641+0000 7f28f1ffb640 1 -- 172.21.15.90:0/932073676 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f28e403f030 con 0x7f28f40d0ab0 2024-09-10T23:15:31.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.815+0000 7f28fb67f640 1 -- 172.21.15.90:0/932073676 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28f40cbb20 con 0x7f28f40d0ab0 2024-09-10T23:15:31.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.817+0000 7f28f1ffb640 1 -- 172.21.15.90:0/932073676 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16729 (secure 0 0 0) 0x7f28e4083b60 con 0x7f28f40d0ab0 2024-09-10T23:15:31.818 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:31.818 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":34,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:15:15.773619+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:11.940848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:13.069613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:31.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.819+0000 7f28fb67f640 1 -- 172.21.15.90:0/932073676 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f28e0077f70 msgr2=0x7f28e007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:31.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.819+0000 7f28fb67f640 1 --2- 172.21.15.90:0/932073676 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f28e0077f70 0x7f28e007a430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f28e80058c0 tx=0x7f28e8005850 comp rx=0 tx=0).stop 2024-09-10T23:15:31.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.819+0000 7f28fb67f640 1 -- 172.21.15.90:0/932073676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28f40d0ab0 msgr2=0x7f28f41f41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:31.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.819+0000 7f28fb67f640 1 --2- 172.21.15.90:0/932073676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28f40d0ab0 0x7f28f41f41a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f28e402aea0 tx=0x7f28e4003a10 comp rx=0 tx=0).stop 2024-09-10T23:15:31.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.819+0000 7f28fb67f640 1 -- 172.21.15.90:0/932073676 shutdown_connections 2024-09-10T23:15:31.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.819+0000 7f28fb67f640 1 --2- 172.21.15.90:0/932073676 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f28e0077f70 0x7f28e007a430 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.819+0000 7f28fb67f640 1 --2- 172.21.15.90:0/932073676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28f40d2470 0x7f28f41503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.819+0000 7f28fb67f640 1 --2- 172.21.15.90:0/932073676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28f40d1c70 0x7f28f40c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.819+0000 7f28fb67f640 1 --2- 172.21.15.90:0/932073676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28f40d0ab0 0x7f28f41f41a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.819+0000 7f28fb67f640 1 -- 172.21.15.90:0/932073676 >> 172.21.15.90:0/932073676 conn(0x7f28f409d2a0 msgr2=0x7f28f40b4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:31.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.819+0000 7f28fb67f640 1 -- 172.21.15.90:0/932073676 shutdown_connections 2024-09-10T23:15:31.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.819+0000 7f28fb67f640 1 -- 172.21.15.90:0/932073676 wait complete. 2024-09-10T23:15:31.831 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:15:31.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.932+0000 7fd396d89640 1 -- 172.21.15.90:0/3545928850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd39015bcb0 msgr2=0x7fd3900cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:31.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.932+0000 7fd396d89640 1 --2- 172.21.15.90:0/3545928850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd39015bcb0 0x7fd3900cb7e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd390070c10 tx=0x7fd38c02a560 comp rx=0 tx=0).stop 2024-09-10T23:15:31.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.932+0000 7fd396d89640 1 -- 172.21.15.90:0/3545928850 shutdown_connections 2024-09-10T23:15:31.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.932+0000 7fd396d89640 1 --2- 172.21.15.90:0/3545928850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd39006f160 0x7fd3900ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.933+0000 7fd396d89640 1 --2- 172.21.15.90:0/3545928850 >> v2:172.21.15.171:3300/0 conn(0x7fd39006f850 0x7fd39006ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.933+0000 7fd396d89640 1 --2- 172.21.15.90:0/3545928850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd39015bcb0 0x7fd3900cb7e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.933+0000 7fd396d89640 1 -- 172.21.15.90:0/3545928850 >> 172.21.15.90:0/3545928850 conn(0x7fd3900cc850 msgr2=0x7fd3900ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:31.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.933+0000 7fd396d89640 1 -- 172.21.15.90:0/3545928850 shutdown_connections 2024-09-10T23:15:31.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.933+0000 7fd396d89640 1 -- 172.21.15.90:0/3545928850 wait complete. 2024-09-10T23:15:31.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.934+0000 7fd396d89640 1 Processor -- start 2024-09-10T23:15:31.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.934+0000 7fd396d89640 1 -- start start 2024-09-10T23:15:31.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd396d89640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd39006f160 0x7fd3900c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:31.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd396d89640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd39006f850 0x7fd3901f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:31.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd396d89640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd39015bcb0 0x7fd3900c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:31.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd396d89640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd3900cacf0 con 0x7fd39006f850 2024-09-10T23:15:31.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd396d89640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd3900cab70 con 0x7fd39006f160 2024-09-10T23:15:31.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd396d89640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd39015c1e0 con 0x7fd39015bcb0 2024-09-10T23:15:31.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd387fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd39006f850 0x7fd3901f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:31.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd387fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd39006f850 0x7fd3901f1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36034/0 (socket says 172.21.15.90:36034) 2024-09-10T23:15:31.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd387fff640 1 -- 172.21.15.90:0/1923450406 learned_addr learned my addr 172.21.15.90:0/1923450406 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:31.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd394b25640 1 --2- 172.21.15.90:0/1923450406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd39006f160 0x7fd3900c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:31.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd395326640 1 --2- 172.21.15.90:0/1923450406 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd39015bcb0 0x7fd3900c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:31.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd387fff640 1 -- 172.21.15.90:0/1923450406 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd39015bcb0 msgr2=0x7fd3900c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:31.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd387fff640 1 --2- 172.21.15.90:0/1923450406 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd39015bcb0 0x7fd3900c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd387fff640 1 -- 172.21.15.90:0/1923450406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd39006f160 msgr2=0x7fd3900c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:31.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd387fff640 1 --2- 172.21.15.90:0/1923450406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd39006f160 0x7fd3900c67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:31.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd387fff640 1 -- 172.21.15.90:0/1923450406 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39009c4a0 con 0x7fd39006f850 2024-09-10T23:15:31.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd395326640 1 --2- 172.21.15.90:0/1923450406 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd39015bcb0 0x7fd3900c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:31.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd387fff640 1 --2- 172.21.15.90:0/1923450406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd39006f850 0x7fd3901f1e40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd38000d950 tx=0x7fd38000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:31.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd3857fa640 1 -- 172.21.15.90:0/1923450406 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380017070 con 0x7fd39006f850 2024-09-10T23:15:31.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd3857fa640 1 -- 172.21.15.90:0/1923450406 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd380009d20 con 0x7fd39006f850 2024-09-10T23:15:31.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd396d89640 1 -- 172.21.15.90:0/1923450406 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39014fe10 con 0x7fd39006f850 2024-09-10T23:15:31.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd3857fa640 1 -- 172.21.15.90:0/1923450406 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380004280 con 0x7fd39006f850 2024-09-10T23:15:31.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.935+0000 7fd396d89640 1 -- 172.21.15.90:0/1923450406 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd39009acd0 con 0x7fd39006f850 2024-09-10T23:15:31.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.936+0000 7fd396d89640 1 -- 172.21.15.90:0/1923450406 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd39006ec20 con 0x7fd39006f850 2024-09-10T23:15:31.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.937+0000 7fd3857fa640 1 -- 172.21.15.90:0/1923450406 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd3800035f0 con 0x7fd39006f850 2024-09-10T23:15:31.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.937+0000 7fd3857fa640 1 --2- 172.21.15.90:0/1923450406 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd37c077fa0 0x7fd37c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:31.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.937+0000 7fd3857fa640 1 -- 172.21.15.90:0/1923450406 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd380099e10 con 0x7fd39006f850 2024-09-10T23:15:31.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.938+0000 7fd394b25640 1 --2- 172.21.15.90:0/1923450406 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd37c077fa0 0x7fd37c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:31.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.938+0000 7fd394b25640 1 --2- 172.21.15.90:0/1923450406 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd37c077fa0 0x7fd37c07a460 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd38c033000 tx=0x7fd38c004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:31.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:31.941+0000 7fd3857fa640 1 -- 172.21.15.90:0/1923450406 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd3800622c0 con 0x7fd39006f850 2024-09-10T23:15:32.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.149+0000 7fd396d89640 1 -- 172.21.15.90:0/1923450406 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd3900ccfb0 con 0x7fd39006f850 2024-09-10T23:15:32.151 INFO:tasks.ceph.mon.a.smithi090.stderr:2024-09-10T23:15:32.150+0000 7f1a0c84c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:15:32.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.151+0000 7fd3857fa640 1 -- 172.21.15.90:0/1923450406 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) ==== 161+0+0 (secure 0 0 0) 0x7fd380066cf0 con 0x7fd39006f850 2024-09-10T23:15:32.152 INFO:teuthology.orchestra.run.smithi090.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:15:32.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.154+0000 7fd396d89640 1 -- 172.21.15.90:0/1923450406 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd37c077fa0 msgr2=0x7fd37c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:32.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.154+0000 7fd396d89640 1 --2- 172.21.15.90:0/1923450406 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd37c077fa0 0x7fd37c07a460 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd38c033000 tx=0x7fd38c004730 comp rx=0 tx=0).stop 2024-09-10T23:15:32.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.154+0000 7fd396d89640 1 -- 172.21.15.90:0/1923450406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd39006f850 msgr2=0x7fd3901f1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:32.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.154+0000 7fd396d89640 1 --2- 172.21.15.90:0/1923450406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd39006f850 0x7fd3901f1e40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd38000d950 tx=0x7fd38000de10 comp rx=0 tx=0).stop 2024-09-10T23:15:32.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.154+0000 7fd396d89640 1 -- 172.21.15.90:0/1923450406 shutdown_connections 2024-09-10T23:15:32.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.154+0000 7fd396d89640 1 --2- 172.21.15.90:0/1923450406 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd37c077fa0 0x7fd37c07a460 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:32.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.154+0000 7fd396d89640 1 --2- 172.21.15.90:0/1923450406 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd39015bcb0 0x7fd3900c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:32.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.154+0000 7fd396d89640 1 --2- 172.21.15.90:0/1923450406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd39006f850 0x7fd3901f1e40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:32.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.154+0000 7fd396d89640 1 --2- 172.21.15.90:0/1923450406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd39006f160 0x7fd3900c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:32.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.154+0000 7fd396d89640 1 -- 172.21.15.90:0/1923450406 >> 172.21.15.90:0/1923450406 conn(0x7fd3900cc850 msgr2=0x7fd3900ace00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:32.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.154+0000 7fd396d89640 1 -- 172.21.15.90:0/1923450406 shutdown_connections 2024-09-10T23:15:32.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.154+0000 7fd396d89640 1 -- 172.21.15.90:0/1923450406 wait complete. 2024-09-10T23:15:32.156 INFO:tasks.ceph.mds.d.smithi171.stderr: -2437> 2024-09-10T23:15:19.746+0000 7f63c18bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:15:32.166 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:15:32.187 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-09-10T23:15:32.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.268+0000 7f4e6d285640 1 -- 172.21.15.90:0/904541423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e680d2d30 msgr2=0x7f4e680b7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:32.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.268+0000 7f4e6d285640 1 --2- 172.21.15.90:0/904541423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e680d2d30 0x7f4e680b7840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e60005fd0 tx=0x7f4e6002a820 comp rx=0 tx=0).stop 2024-09-10T23:15:32.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.268+0000 7f4e6d285640 1 -- 172.21.15.90:0/904541423 shutdown_connections 2024-09-10T23:15:32.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.268+0000 7f4e6d285640 1 --2- 172.21.15.90:0/904541423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e680d2d30 0x7f4e680b7840 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:32.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.268+0000 7f4e6d285640 1 --2- 172.21.15.90:0/904541423 >> v2:172.21.15.171:3300/0 conn(0x7f4e6815e240 0x7f4e680d4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:32.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.268+0000 7f4e6d285640 1 -- 172.21.15.90:0/904541423 >> 172.21.15.90:0/904541423 conn(0x7f4e680d4150 msgr2=0x7f4e680d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:32.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.268+0000 7f4e6d285640 1 -- 172.21.15.90:0/904541423 shutdown_connections 2024-09-10T23:15:32.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.268+0000 7f4e6d285640 1 -- 172.21.15.90:0/904541423 wait complete. 2024-09-10T23:15:32.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.269+0000 7f4e6d285640 1 Processor -- start 2024-09-10T23:15:32.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.269+0000 7f4e6d285640 1 -- start start 2024-09-10T23:15:32.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e6d285640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e680d21d0 0x7f4e6814cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:32.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e6d285640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e680d2d30 0x7f4e681f8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:32.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e6d285640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e6815e240 0x7f4e680d0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:32.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e6d285640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4e680b8110 con 0x7f4e6815e240 2024-09-10T23:15:32.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e6d285640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4e680b7f90 con 0x7f4e680d21d0 2024-09-10T23:15:32.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e6d285640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4e680b8290 con 0x7f4e680d2d30 2024-09-10T23:15:32.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e677fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e6815e240 0x7f4e680d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:32.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e677fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e6815e240 0x7f4e680d0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36048/0 (socket says 172.21.15.90:36048) 2024-09-10T23:15:32.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e677fe640 1 -- 172.21.15.90:0/3272368123 learned_addr learned my addr 172.21.15.90:0/3272368123 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:32.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e66ffd640 1 --2- 172.21.15.90:0/3272368123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e680d21d0 0x7f4e6814cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:32.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e677fe640 1 -- 172.21.15.90:0/3272368123 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e680d2d30 msgr2=0x7f4e681f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:32.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e5ffff640 1 --2- 172.21.15.90:0/3272368123 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e680d2d30 0x7f4e681f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:32.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e677fe640 1 --2- 172.21.15.90:0/3272368123 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e680d2d30 0x7f4e681f8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:32.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e677fe640 1 -- 172.21.15.90:0/3272368123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e680d21d0 msgr2=0x7f4e6814cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:32.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e677fe640 1 --2- 172.21.15.90:0/3272368123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e680d21d0 0x7f4e6814cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:32.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e677fe640 1 -- 172.21.15.90:0/3272368123 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e681f8e40 con 0x7f4e6815e240 2024-09-10T23:15:32.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e66ffd640 1 --2- 172.21.15.90:0/3272368123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e680d21d0 0x7f4e6814cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:32.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e677fe640 1 --2- 172.21.15.90:0/3272368123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e6815e240 0x7f4e680d0180 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4e60035040 tx=0x7f4e60032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:32.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e5f7fe640 1 -- 172.21.15.90:0/3272368123 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60037040 con 0x7f4e6815e240 2024-09-10T23:15:32.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e5f7fe640 1 -- 172.21.15.90:0/3272368123 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e60042070 con 0x7f4e6815e240 2024-09-10T23:15:32.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e6d285640 1 -- 172.21.15.90:0/3272368123 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6814c150 con 0x7f4e6815e240 2024-09-10T23:15:32.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e5f7fe640 1 -- 172.21.15.90:0/3272368123 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60003e60 con 0x7f4e6815e240 2024-09-10T23:15:32.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.270+0000 7f4e6d285640 1 -- 172.21.15.90:0/3272368123 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e6814c3f0 con 0x7f4e6815e240 2024-09-10T23:15:32.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.271+0000 7f4e6d285640 1 -- 172.21.15.90:0/3272368123 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e680b8820 con 0x7f4e6815e240 2024-09-10T23:15:32.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.272+0000 7f4e5f7fe640 1 -- 172.21.15.90:0/3272368123 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4e6003a030 con 0x7f4e6815e240 2024-09-10T23:15:32.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.273+0000 7f4e5f7fe640 1 --2- 172.21.15.90:0/3272368123 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e48077fa0 0x7f4e4807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:32.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.273+0000 7f4e5f7fe640 1 -- 172.21.15.90:0/3272368123 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f4e600ba7a0 con 0x7f4e6815e240 2024-09-10T23:15:32.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.273+0000 7f4e66ffd640 1 --2- 172.21.15.90:0/3272368123 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e48077fa0 0x7f4e4807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:32.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.273+0000 7f4e66ffd640 1 --2- 172.21.15.90:0/3272368123 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e48077fa0 0x7f4e4807a460 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009ab0 tx=0x7f4e58005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:32.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.277+0000 7f4e5f7fe640 1 -- 172.21.15.90:0/3272368123 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4e681f8e40 con 0x7f4e6815e240 2024-09-10T23:15:32.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:32.488+0000 7f4e6d285640 1 -- 172.21.15.90:0/3272368123 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4e680cf270 con 0x7f4e6815e240 2024-09-10T23:15:33.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.158+0000 7f4e5f7fe640 1 -- 172.21.15.90:0/3272368123 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) ==== 104+0+0 (secure 0 0 0) 0x7f4e60083240 con 0x7f4e6815e240 2024-09-10T23:15:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.161+0000 7f4e6d285640 1 -- 172.21.15.90:0/3272368123 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e48077fa0 msgr2=0x7f4e4807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.161+0000 7f4e6d285640 1 --2- 172.21.15.90:0/3272368123 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e48077fa0 0x7f4e4807a460 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009ab0 tx=0x7f4e58005f90 comp rx=0 tx=0).stop 2024-09-10T23:15:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.161+0000 7f4e6d285640 1 -- 172.21.15.90:0/3272368123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e6815e240 msgr2=0x7f4e680d0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.161+0000 7f4e6d285640 1 --2- 172.21.15.90:0/3272368123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e6815e240 0x7f4e680d0180 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4e60035040 tx=0x7f4e60032c60 comp rx=0 tx=0).stop 2024-09-10T23:15:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.161+0000 7f4e6d285640 1 -- 172.21.15.90:0/3272368123 shutdown_connections 2024-09-10T23:15:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.161+0000 7f4e6d285640 1 --2- 172.21.15.90:0/3272368123 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e48077fa0 0x7f4e4807a460 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.161+0000 7f4e6d285640 1 --2- 172.21.15.90:0/3272368123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e6815e240 0x7f4e680d0180 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.161+0000 7f4e6d285640 1 --2- 172.21.15.90:0/3272368123 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e680d2d30 0x7f4e681f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.161+0000 7f4e6d285640 1 --2- 172.21.15.90:0/3272368123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e680d21d0 0x7f4e6814cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.161+0000 7f4e6d285640 1 -- 172.21.15.90:0/3272368123 >> 172.21.15.90:0/3272368123 conn(0x7f4e680d4150 msgr2=0x7f4e6806eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.161+0000 7f4e6d285640 1 -- 172.21.15.90:0/3272368123 shutdown_connections 2024-09-10T23:15:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.161+0000 7f4e6d285640 1 -- 172.21.15.90:0/3272368123 wait complete. 2024-09-10T23:15:33.176 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:15:33.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.285+0000 7f89fbe8e640 1 -- 172.21.15.90:0/2499932963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f415e120 msgr2=0x7f89f40cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.285+0000 7f89fbe8e640 1 --2- 172.21.15.90:0/2499932963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f415e120 0x7f89f40cfa00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f89f4161af0 tx=0x7f89e802a4d0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.285+0000 7f89fbe8e640 1 -- 172.21.15.90:0/2499932963 shutdown_connections 2024-09-10T23:15:33.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.285+0000 7f89fbe8e640 1 --2- 172.21.15.90:0/2499932963 >> v2:172.21.15.171:3300/0 conn(0x7f89f40d4b50 0x7f89f40d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.285+0000 7f89fbe8e640 1 --2- 172.21.15.90:0/2499932963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f415e120 0x7f89f40cfa00 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.285+0000 7f89fbe8e640 1 -- 172.21.15.90:0/2499932963 >> 172.21.15.90:0/2499932963 conn(0x7f89f40d4030 msgr2=0x7f89f40d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:33.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.285+0000 7f89fbe8e640 1 -- 172.21.15.90:0/2499932963 shutdown_connections 2024-09-10T23:15:33.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.285+0000 7f89fbe8e640 1 -- 172.21.15.90:0/2499932963 wait complete. 2024-09-10T23:15:33.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.287+0000 7f89fbe8e640 1 Processor -- start 2024-09-10T23:15:33.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.287+0000 7f89fbe8e640 1 -- start start 2024-09-10T23:15:33.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.287+0000 7f89fbe8e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f40d0770 0x7f89f415e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:33.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.287+0000 7f89fbe8e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f40d4b50 0x7f89f41620b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:33.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.287+0000 7f89fbe8e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89f415e120 0x7f89f409dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:33.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.287+0000 7f89fbe8e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f89f40d0d40 con 0x7f89f40d0770 2024-09-10T23:15:33.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.287+0000 7f89fbe8e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f89f40d0bc0 con 0x7f89f40d4b50 2024-09-10T23:15:33.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.287+0000 7f89fbe8e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f89f40d0ec0 con 0x7f89f415e120 2024-09-10T23:15:33.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.288+0000 7f89f9c2a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f40d0770 0x7f89f415e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:33.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.288+0000 7f89f9c2a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f40d0770 0x7f89f415e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36062/0 (socket says 172.21.15.90:36062) 2024-09-10T23:15:33.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.288+0000 7f89f9c2a640 1 -- 172.21.15.90:0/4093823708 learned_addr learned my addr 172.21.15.90:0/4093823708 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:33.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.288+0000 7f89f9429640 1 --2- 172.21.15.90:0/4093823708 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f40d4b50 0x7f89f41620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:33.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.288+0000 7f89fa42b640 1 --2- 172.21.15.90:0/4093823708 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89f415e120 0x7f89f409dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:33.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.288+0000 7f89f9c2a640 1 -- 172.21.15.90:0/4093823708 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89f415e120 msgr2=0x7f89f409dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.288+0000 7f89f9c2a640 1 --2- 172.21.15.90:0/4093823708 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89f415e120 0x7f89f409dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.288+0000 7f89f9c2a640 1 -- 172.21.15.90:0/4093823708 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f40d4b50 msgr2=0x7f89f41620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.288+0000 7f89f9c2a640 1 --2- 172.21.15.90:0/4093823708 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f40d4b50 0x7f89f41620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.288+0000 7f89f9c2a640 1 -- 172.21.15.90:0/4093823708 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f41625f0 con 0x7f89f40d0770 2024-09-10T23:15:33.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.288+0000 7f89fa42b640 1 --2- 172.21.15.90:0/4093823708 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89f415e120 0x7f89f409dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:33.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.288+0000 7f89f9c2a640 1 --2- 172.21.15.90:0/4093823708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f40d0770 0x7f89f415e700 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f89e8034040 tx=0x7f89e80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:33.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.288+0000 7f89e67fc640 1 -- 172.21.15.90:0/4093823708 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e803e030 con 0x7f89f40d0770 2024-09-10T23:15:33.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.288+0000 7f89e67fc640 1 -- 172.21.15.90:0/4093823708 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89e80047a0 con 0x7f89f40d0770 2024-09-10T23:15:33.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.288+0000 7f89fbe8e640 1 -- 172.21.15.90:0/4093823708 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f40a02f0 con 0x7f89f40d0770 2024-09-10T23:15:33.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.288+0000 7f89e67fc640 1 -- 172.21.15.90:0/4093823708 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8035040 con 0x7f89f40d0770 2024-09-10T23:15:33.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.288+0000 7f89fbe8e640 1 -- 172.21.15.90:0/4093823708 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f40a0590 con 0x7f89f40d0770 2024-09-10T23:15:33.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.289+0000 7f89fbe8e640 1 -- 172.21.15.90:0/4093823708 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f40d2610 con 0x7f89f40d0770 2024-09-10T23:15:33.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.290+0000 7f89e67fc640 1 -- 172.21.15.90:0/4093823708 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f89e8004b70 con 0x7f89f40d0770 2024-09-10T23:15:33.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.290+0000 7f89e67fc640 1 --2- 172.21.15.90:0/4093823708 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f89d8077f70 0x7f89d807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:33.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.290+0000 7f89e67fc640 1 -- 172.21.15.90:0/4093823708 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f89e80ba770 con 0x7f89f40d0770 2024-09-10T23:15:33.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.291+0000 7f89f9429640 1 --2- 172.21.15.90:0/4093823708 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f89d8077f70 0x7f89d807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:33.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.291+0000 7f89f9429640 1 --2- 172.21.15.90:0/4093823708 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f89d8077f70 0x7f89d807a430 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f89f415ec40 tx=0x7f89f0009110 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:33.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.294+0000 7f89e67fc640 1 -- 172.21.15.90:0/4093823708 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f89f41625f0 con 0x7f89f40d0770 2024-09-10T23:15:33.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:33.470+0000 7f89fbe8e640 1 -- 172.21.15.90:0/4093823708 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f89f409e1f0 con 0x7f89f40d0770 2024-09-10T23:15:34.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.459+0000 7f89e67fc640 1 -- 172.21.15.90:0/4093823708 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7f89e80832a0 con 0x7f89f40d0770 2024-09-10T23:15:34.460 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:15:34.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.462+0000 7f89fbe8e640 1 -- 172.21.15.90:0/4093823708 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f89d8077f70 msgr2=0x7f89d807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:34.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.462+0000 7f89fbe8e640 1 --2- 172.21.15.90:0/4093823708 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f89d8077f70 0x7f89d807a430 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f89f415ec40 tx=0x7f89f0009110 comp rx=0 tx=0).stop 2024-09-10T23:15:34.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.462+0000 7f89fbe8e640 1 -- 172.21.15.90:0/4093823708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f40d0770 msgr2=0x7f89f415e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:34.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.462+0000 7f89fbe8e640 1 --2- 172.21.15.90:0/4093823708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f40d0770 0x7f89f415e700 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f89e8034040 tx=0x7f89e80039e0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.463+0000 7f89fbe8e640 1 -- 172.21.15.90:0/4093823708 shutdown_connections 2024-09-10T23:15:34.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.463+0000 7f89fbe8e640 1 --2- 172.21.15.90:0/4093823708 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f89d8077f70 0x7f89d807a430 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.463+0000 7f89fbe8e640 1 --2- 172.21.15.90:0/4093823708 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f40d4b50 0x7f89f41620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.463+0000 7f89fbe8e640 1 --2- 172.21.15.90:0/4093823708 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89f415e120 0x7f89f409dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.463+0000 7f89fbe8e640 1 --2- 172.21.15.90:0/4093823708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f40d0770 0x7f89f415e700 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.463+0000 7f89fbe8e640 1 -- 172.21.15.90:0/4093823708 >> 172.21.15.90:0/4093823708 conn(0x7f89f40d4030 msgr2=0x7f89f40b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:34.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.463+0000 7f89fbe8e640 1 -- 172.21.15.90:0/4093823708 shutdown_connections 2024-09-10T23:15:34.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.463+0000 7f89fbe8e640 1 -- 172.21.15.90:0/4093823708 wait complete. 2024-09-10T23:15:34.478 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:15:34.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.588+0000 7ff0a3fff640 1 -- 172.21.15.90:0/3448914343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff08c0052e0 msgr2=0x7ff08c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:34.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.588+0000 7ff0a3fff640 1 --2- 172.21.15.90:0/3448914343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff08c0052e0 0x7ff08c00b9c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff09c001690 tx=0x7ff08c005830 comp rx=0 tx=0).stop 2024-09-10T23:15:34.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.588+0000 7ff0a3fff640 1 -- 172.21.15.90:0/3448914343 shutdown_connections 2024-09-10T23:15:34.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.588+0000 7ff0a3fff640 1 --2- 172.21.15.90:0/3448914343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff08c0052e0 0x7ff08c00b9c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.588+0000 7ff0a3fff640 1 -- 172.21.15.90:0/3448914343 >> 172.21.15.90:0/3448914343 conn(0x7ff0a40b1490 msgr2=0x7ff0a40b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:34.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.588+0000 7ff0a3fff640 1 -- 172.21.15.90:0/3448914343 shutdown_connections 2024-09-10T23:15:34.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.588+0000 7ff0a3fff640 1 -- 172.21.15.90:0/3448914343 wait complete. 2024-09-10T23:15:34.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.590+0000 7ff0a3fff640 1 Processor -- start 2024-09-10T23:15:34.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.590+0000 7ff0a3fff640 1 -- start start 2024-09-10T23:15:34.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.590+0000 7ff0a3fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff08c0052e0 0x7ff0a41450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:34.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.590+0000 7ff0a3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a41f5d20 0x7ff0a41f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:34.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.590+0000 7ff0a3fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a4151430 0x7ff0a41518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:34.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.590+0000 7ff0a3fff640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a40cd860 con 0x7ff0a41f5d20 2024-09-10T23:15:34.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.590+0000 7ff0a3fff640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a40cd6e0 con 0x7ff08c0052e0 2024-09-10T23:15:34.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.590+0000 7ff0a3fff640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a4072580 con 0x7ff0a4151430 2024-09-10T23:15:34.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.590+0000 7ff0a27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a41f5d20 0x7ff0a41f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:34.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.590+0000 7ff0a27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a41f5d20 0x7ff0a41f1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36086/0 (socket says 172.21.15.90:36086) 2024-09-10T23:15:34.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.590+0000 7ff0a27fc640 1 -- 172.21.15.90:0/688791992 learned_addr learned my addr 172.21.15.90:0/688791992 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:34.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.591+0000 7ff0a2ffd640 1 --2- 172.21.15.90:0/688791992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff08c0052e0 0x7ff0a41450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:34.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.591+0000 7ff0a37fe640 1 --2- 172.21.15.90:0/688791992 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a4151430 0x7ff0a41518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:34.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.591+0000 7ff0a27fc640 1 -- 172.21.15.90:0/688791992 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a4151430 msgr2=0x7ff0a41518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:34.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.591+0000 7ff0a27fc640 1 --2- 172.21.15.90:0/688791992 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a4151430 0x7ff0a41518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.591+0000 7ff0a27fc640 1 -- 172.21.15.90:0/688791992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff08c0052e0 msgr2=0x7ff0a41450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:34.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.591+0000 7ff0a27fc640 1 --2- 172.21.15.90:0/688791992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff08c0052e0 0x7ff0a41450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.591+0000 7ff0a27fc640 1 -- 172.21.15.90:0/688791992 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a41455f0 con 0x7ff0a41f5d20 2024-09-10T23:15:34.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.591+0000 7ff0a27fc640 1 --2- 172.21.15.90:0/688791992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a41f5d20 0x7ff0a41f1e90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff09800ea70 tx=0x7ff09800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:34.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.591+0000 7ff08b7fe640 1 -- 172.21.15.90:0/688791992 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09800dcf0 con 0x7ff0a41f5d20 2024-09-10T23:15:34.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.591+0000 7ff08b7fe640 1 -- 172.21.15.90:0/688791992 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff098004050 con 0x7ff0a41f5d20 2024-09-10T23:15:34.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.591+0000 7ff08b7fe640 1 -- 172.21.15.90:0/688791992 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0980044a0 con 0x7ff0a41f5d20 2024-09-10T23:15:34.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.591+0000 7ff0a3fff640 1 -- 172.21.15.90:0/688791992 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a4145b00 con 0x7ff0a41f5d20 2024-09-10T23:15:34.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.591+0000 7ff0a3fff640 1 -- 172.21.15.90:0/688791992 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a41f64c0 con 0x7ff0a41f5d20 2024-09-10T23:15:34.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.592+0000 7ff0a3fff640 1 -- 172.21.15.90:0/688791992 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a40cc110 con 0x7ff0a41f5d20 2024-09-10T23:15:34.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.593+0000 7ff08b7fe640 1 -- 172.21.15.90:0/688791992 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff09800b040 con 0x7ff0a41f5d20 2024-09-10T23:15:34.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.593+0000 7ff08b7fe640 1 --2- 172.21.15.90:0/688791992 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff090077f70 0x7ff09007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:34.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.593+0000 7ff08b7fe640 1 -- 172.21.15.90:0/688791992 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5357+0+0 (secure 0 0 0) 0x7ff09809a520 con 0x7ff0a41f5d20 2024-09-10T23:15:34.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.593+0000 7ff0a2ffd640 1 --2- 172.21.15.90:0/688791992 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff090077f70 0x7ff09007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:34.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.594+0000 7ff0a2ffd640 1 --2- 172.21.15.90:0/688791992 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff090077f70 0x7ff09007a430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff094006fd0 tx=0x7ff094006aa0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:34.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.597+0000 7ff08b7fe640 1 -- 172.21.15.90:0/688791992 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff0a41455f0 con 0x7ff0a41f5d20 2024-09-10T23:15:34.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:34.773+0000 7ff0a3fff640 1 -- 172.21.15.90:0/688791992 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff0a41e3f00 con 0x7ff0a41f5d20 2024-09-10T23:15:35.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.461+0000 7ff08b7fe640 1 -- 172.21.15.90:0/688791992 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7ff098063180 con 0x7ff0a41f5d20 2024-09-10T23:15:35.462 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' removed 2024-09-10T23:15:35.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.463+0000 7ff0a3fff640 1 -- 172.21.15.90:0/688791992 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff090077f70 msgr2=0x7ff09007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:35.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.463+0000 7ff0a3fff640 1 --2- 172.21.15.90:0/688791992 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff090077f70 0x7ff09007a430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff094006fd0 tx=0x7ff094006aa0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.463+0000 7ff0a3fff640 1 -- 172.21.15.90:0/688791992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a41f5d20 msgr2=0x7ff0a41f1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:35.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.463+0000 7ff0a3fff640 1 --2- 172.21.15.90:0/688791992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a41f5d20 0x7ff0a41f1e90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff09800ea70 tx=0x7ff09800ef30 comp rx=0 tx=0).stop 2024-09-10T23:15:35.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.463+0000 7ff0a3fff640 1 -- 172.21.15.90:0/688791992 shutdown_connections 2024-09-10T23:15:35.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.463+0000 7ff0a3fff640 1 --2- 172.21.15.90:0/688791992 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff090077f70 0x7ff09007a430 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.463+0000 7ff0a3fff640 1 --2- 172.21.15.90:0/688791992 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a4151430 0x7ff0a41518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.463+0000 7ff0a3fff640 1 --2- 172.21.15.90:0/688791992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a41f5d20 0x7ff0a41f1e90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.463+0000 7ff0a3fff640 1 --2- 172.21.15.90:0/688791992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff08c0052e0 0x7ff0a41450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.463+0000 7ff0a3fff640 1 -- 172.21.15.90:0/688791992 >> 172.21.15.90:0/688791992 conn(0x7ff0a40b1490 msgr2=0x7ff0a40aea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:35.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.464+0000 7ff0a3fff640 1 -- 172.21.15.90:0/688791992 shutdown_connections 2024-09-10T23:15:35.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.464+0000 7ff0a3fff640 1 -- 172.21.15.90:0/688791992 wait complete. 2024-09-10T23:15:35.480 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:15:35.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.585+0000 7f63d1e40640 1 -- 172.21.15.90:0/37231598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63cc0d2470 msgr2=0x7f63cc0b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:35.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.585+0000 7f63d1e40640 1 --2- 172.21.15.90:0/37231598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63cc0d2470 0x7f63cc0b3490 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009830 tx=0x7f63bc02a510 comp rx=0 tx=0).stop 2024-09-10T23:15:35.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.585+0000 7f63d1e40640 1 -- 172.21.15.90:0/37231598 shutdown_connections 2024-09-10T23:15:35.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.585+0000 7f63d1e40640 1 --2- 172.21.15.90:0/37231598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63cc0b3a00 0x7f63cc0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.585+0000 7f63d1e40640 1 --2- 172.21.15.90:0/37231598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63cc0d2470 0x7f63cc0b3490 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.585+0000 7f63d1e40640 1 -- 172.21.15.90:0/37231598 >> 172.21.15.90:0/37231598 conn(0x7f63cc09d2a0 msgr2=0x7f63cc0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:35.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.585+0000 7f63d1e40640 1 -- 172.21.15.90:0/37231598 shutdown_connections 2024-09-10T23:15:35.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.585+0000 7f63d1e40640 1 -- 172.21.15.90:0/37231598 wait complete. 2024-09-10T23:15:35.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.586+0000 7f63d1e40640 1 Processor -- start 2024-09-10T23:15:35.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.586+0000 7f63d1e40640 1 -- start start 2024-09-10T23:15:35.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.587+0000 7f63d1e40640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63cc0b3a00 0x7f63cc154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:35.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.587+0000 7f63d1e40640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63cc0d1c70 0x7f63cc154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:35.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.587+0000 7f63d1e40640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63cc0d2470 0x7f63cc1f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:35.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.587+0000 7f63d1e40640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc0b4570 con 0x7f63cc0d2470 2024-09-10T23:15:35.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.587+0000 7f63d1e40640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc0b43f0 con 0x7f63cc0d1c70 2024-09-10T23:15:35.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.587+0000 7f63d1e40640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f63cc0b46f0 con 0x7f63cc0b3a00 2024-09-10T23:15:35.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.587+0000 7f63cbfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63cc0d2470 0x7f63cc1f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:35.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.587+0000 7f63cbfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63cc0d2470 0x7f63cc1f84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36088/0 (socket says 172.21.15.90:36088) 2024-09-10T23:15:35.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.587+0000 7f63cbfff640 1 -- 172.21.15.90:0/1722664268 learned_addr learned my addr 172.21.15.90:0/1722664268 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:35.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.587+0000 7f63cb7fe640 1 --2- 172.21.15.90:0/1722664268 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63cc0b3a00 0x7f63cc154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:35.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.588+0000 7f63caffd640 1 --2- 172.21.15.90:0/1722664268 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63cc0d1c70 0x7f63cc154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:35.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.588+0000 7f63cbfff640 1 -- 172.21.15.90:0/1722664268 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63cc0b3a00 msgr2=0x7f63cc154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:35.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.588+0000 7f63cbfff640 1 --2- 172.21.15.90:0/1722664268 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63cc0b3a00 0x7f63cc154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.588+0000 7f63cbfff640 1 -- 172.21.15.90:0/1722664268 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63cc0d1c70 msgr2=0x7f63cc154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:35.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.588+0000 7f63cbfff640 1 --2- 172.21.15.90:0/1722664268 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63cc0d1c70 0x7f63cc154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.588+0000 7f63cbfff640 1 -- 172.21.15.90:0/1722664268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63cc0d4eb0 con 0x7f63cc0d2470 2024-09-10T23:15:35.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.588+0000 7f63caffd640 1 --2- 172.21.15.90:0/1722664268 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63cc0d1c70 0x7f63cc154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:35.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.588+0000 7f63cbfff640 1 --2- 172.21.15.90:0/1722664268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63cc0d2470 0x7f63cc1f84e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c370 tx=0x7f63c400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:35.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.588+0000 7f63b3fff640 1 -- 172.21.15.90:0/1722664268 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c4003970 con 0x7f63cc0d2470 2024-09-10T23:15:35.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.588+0000 7f63d1e40640 1 -- 172.21.15.90:0/1722664268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63cc0b7f80 con 0x7f63cc0d2470 2024-09-10T23:15:35.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.588+0000 7f63b3fff640 1 -- 172.21.15.90:0/1722664268 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63c4003c00 con 0x7f63cc0d2470 2024-09-10T23:15:35.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.588+0000 7f63b3fff640 1 -- 172.21.15.90:0/1722664268 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c4004020 con 0x7f63cc0d2470 2024-09-10T23:15:35.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.588+0000 7f63d1e40640 1 -- 172.21.15.90:0/1722664268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63cc0b8540 con 0x7f63cc0d2470 2024-09-10T23:15:35.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.589+0000 7f63d1e40640 1 -- 172.21.15.90:0/1722664268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63cc0b3eb0 con 0x7f63cc0d2470 2024-09-10T23:15:35.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.590+0000 7f63b3fff640 1 -- 172.21.15.90:0/1722664268 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f63c400b040 con 0x7f63cc0d2470 2024-09-10T23:15:35.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.590+0000 7f63b3fff640 1 --2- 172.21.15.90:0/1722664268 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f63b8077f70 0x7f63b807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:35.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.590+0000 7f63b3fff640 1 -- 172.21.15.90:0/1722664268 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f63c409a0c0 con 0x7f63cc0d2470 2024-09-10T23:15:35.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.590+0000 7f63cb7fe640 1 --2- 172.21.15.90:0/1722664268 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f63b8077f70 0x7f63b807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:35.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.591+0000 7f63cb7fe640 1 --2- 172.21.15.90:0/1722664268 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f63b8077f70 0x7f63b807a430 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f63bc034000 tx=0x7f63bc004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:35.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.594+0000 7f63b3fff640 1 -- 172.21.15.90:0/1722664268 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f63c4062e40 con 0x7f63cc0d2470 2024-09-10T23:15:35.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.767+0000 7f63d1e40640 1 -- 172.21.15.90:0/1722664268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f63cc0b34f0 con 0x7f63cc0d2470 2024-09-10T23:15:35.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.770+0000 7f63b3fff640 1 -- 172.21.15.90:0/1722664268 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v30) ==== 71+0+0 (secure 0 0 0) 0x7f63c4062740 con 0x7f63cc0d2470 2024-09-10T23:15:35.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.773+0000 7f63d1e40640 1 -- 172.21.15.90:0/1722664268 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f63b8077f70 msgr2=0x7f63b807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:35.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.773+0000 7f63d1e40640 1 --2- 172.21.15.90:0/1722664268 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f63b8077f70 0x7f63b807a430 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f63bc034000 tx=0x7f63bc004730 comp rx=0 tx=0).stop 2024-09-10T23:15:35.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.773+0000 7f63d1e40640 1 -- 172.21.15.90:0/1722664268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63cc0d2470 msgr2=0x7f63cc1f84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:35.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.773+0000 7f63d1e40640 1 --2- 172.21.15.90:0/1722664268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63cc0d2470 0x7f63cc1f84e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c370 tx=0x7f63c400c830 comp rx=0 tx=0).stop 2024-09-10T23:15:35.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.773+0000 7f63d1e40640 1 -- 172.21.15.90:0/1722664268 shutdown_connections 2024-09-10T23:15:35.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.773+0000 7f63d1e40640 1 --2- 172.21.15.90:0/1722664268 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f63b8077f70 0x7f63b807a430 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.773+0000 7f63d1e40640 1 --2- 172.21.15.90:0/1722664268 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63cc0d1c70 0x7f63cc154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.773+0000 7f63d1e40640 1 --2- 172.21.15.90:0/1722664268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63cc0d2470 0x7f63cc1f84e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.773+0000 7f63d1e40640 1 --2- 172.21.15.90:0/1722664268 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63cc0b3a00 0x7f63cc154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.773+0000 7f63d1e40640 1 -- 172.21.15.90:0/1722664268 >> 172.21.15.90:0/1722664268 conn(0x7f63cc09d2a0 msgr2=0x7f63cc0b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:35.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.773+0000 7f63d1e40640 1 -- 172.21.15.90:0/1722664268 shutdown_connections 2024-09-10T23:15:35.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.773+0000 7f63d1e40640 1 -- 172.21.15.90:0/1722664268 wait complete. 2024-09-10T23:15:35.785 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close' 2024-09-10T23:15:35.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.885+0000 7f3af0d8a640 1 -- 172.21.15.90:0/3142425174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3aec0d0ab0 msgr2=0x7f3aec0d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:35.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.885+0000 7f3af0d8a640 1 --2- 172.21.15.90:0/3142425174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3aec0d0ab0 0x7f3aec0d0f60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3aec08d0d0 tx=0x7f3adc02aa30 comp rx=0 tx=0).stop 2024-09-10T23:15:35.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.885+0000 7f3af0d8a640 1 -- 172.21.15.90:0/3142425174 shutdown_connections 2024-09-10T23:15:35.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.885+0000 7f3af0d8a640 1 --2- 172.21.15.90:0/3142425174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3aec0d0ab0 0x7f3aec0d0f60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.885+0000 7f3af0d8a640 1 --2- 172.21.15.90:0/3142425174 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3aec0d1c70 0x7f3aec0d2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.885+0000 7f3af0d8a640 1 --2- 172.21.15.90:0/3142425174 >> v2:172.21.15.171:3300/0 conn(0x7f3aec0d2470 0x7f3aec0b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.885+0000 7f3af0d8a640 1 -- 172.21.15.90:0/3142425174 >> 172.21.15.90:0/3142425174 conn(0x7f3aec09d2a0 msgr2=0x7f3aec0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:35.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.885+0000 7f3af0d8a640 1 -- 172.21.15.90:0/3142425174 shutdown_connections 2024-09-10T23:15:35.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.885+0000 7f3af0d8a640 1 -- 172.21.15.90:0/3142425174 wait complete. 2024-09-10T23:15:35.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.887+0000 7f3af0d8a640 1 Processor -- start 2024-09-10T23:15:35.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.887+0000 7f3af0d8a640 1 -- start start 2024-09-10T23:15:35.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.887+0000 7f3af0d8a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3aec0d0ab0 0x7f3aec0a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:35.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.887+0000 7f3af0d8a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3aec0d1c70 0x7f3aec09dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:35.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.887+0000 7f3af0d8a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3aec0d2470 0x7f3aec09e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:35.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.887+0000 7f3af0d8a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3aec15e4a0 con 0x7f3aec0d2470 2024-09-10T23:15:35.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.887+0000 7f3af0d8a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3aec15e320 con 0x7f3aec0d1c70 2024-09-10T23:15:35.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.887+0000 7f3af0d8a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3aec0d14a0 con 0x7f3aec0d0ab0 2024-09-10T23:15:35.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.887+0000 7f3aead9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3aec0d2470 0x7f3aec09e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:35.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.888+0000 7f3aead9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3aec0d2470 0x7f3aec09e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36104/0 (socket says 172.21.15.90:36104) 2024-09-10T23:15:35.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.888+0000 7f3aead9d640 1 -- 172.21.15.90:0/14580308 learned_addr learned my addr 172.21.15.90:0/14580308 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:35.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.888+0000 7f3aea59c640 1 --2- 172.21.15.90:0/14580308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3aec0d0ab0 0x7f3aec0a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:35.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.888+0000 7f3ae9d9b640 1 --2- 172.21.15.90:0/14580308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3aec0d1c70 0x7f3aec09dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.888+0000 7f3aead9d640 1 -- 172.21.15.90:0/14580308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3aec0d0ab0 msgr2=0x7f3aec0a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.888+0000 7f3aead9d640 1 --2- 172.21.15.90:0/14580308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3aec0d0ab0 0x7f3aec0a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.888+0000 7f3aead9d640 1 -- 172.21.15.90:0/14580308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3aec0d1c70 msgr2=0x7f3aec09dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.888+0000 7f3aead9d640 1 --2- 172.21.15.90:0/14580308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3aec0d1c70 0x7f3aec09dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.888+0000 7f3aead9d640 1 -- 172.21.15.90:0/14580308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aec1f7a40 con 0x7f3aec0d2470 2024-09-10T23:15:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.888+0000 7f3aead9d640 1 --2- 172.21.15.90:0/14580308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3aec0d2470 0x7f3aec09e2c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3adc005fd0 tx=0x7f3adc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.888+0000 7f3ae2ffd640 1 -- 172.21.15.90:0/14580308 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc046070 con 0x7f3aec0d2470 2024-09-10T23:15:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.888+0000 7f3ae2ffd640 1 -- 172.21.15.90:0/14580308 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3adc0042d0 con 0x7f3aec0d2470 2024-09-10T23:15:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.888+0000 7f3af0d8a640 1 -- 172.21.15.90:0/14580308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aec1f7ce0 con 0x7f3aec0d2470 2024-09-10T23:15:35.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.888+0000 7f3ae2ffd640 1 -- 172.21.15.90:0/14580308 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc033050 con 0x7f3aec0d2470 2024-09-10T23:15:35.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.888+0000 7f3af0d8a640 1 -- 172.21.15.90:0/14580308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aec1f82a0 con 0x7f3aec0d2470 2024-09-10T23:15:35.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.889+0000 7f3af0d8a640 1 -- 172.21.15.90:0/14580308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aec0d0f60 con 0x7f3aec0d2470 2024-09-10T23:15:35.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.890+0000 7f3ae2ffd640 1 -- 172.21.15.90:0/14580308 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3adc038450 con 0x7f3aec0d2470 2024-09-10T23:15:35.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.890+0000 7f3ae2ffd640 1 --2- 172.21.15.90:0/14580308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3acc077f70 0x7f3acc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:35.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.891+0000 7f3ae2ffd640 1 -- 172.21.15.90:0/14580308 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f3adc0bad50 con 0x7f3aec0d2470 2024-09-10T23:15:35.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.891+0000 7f3aea59c640 1 --2- 172.21.15.90:0/14580308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3acc077f70 0x7f3acc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:35.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.891+0000 7f3aea59c640 1 --2- 172.21.15.90:0/14580308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3acc077f70 0x7f3acc07a430 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4005fd0 tx=0x7f3ae400a250 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:35.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:35.895+0000 7f3ae2ffd640 1 -- 172.21.15.90:0/14580308 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3adc0be030 con 0x7f3aec0d2470 2024-09-10T23:15:36.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.135+0000 7f3af0d8a640 1 -- 172.21.15.90:0/14580308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]} v 0) -- 0x7f3aec0760a0 con 0x7f3aec0d2470 2024-09-10T23:15:36.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.470+0000 7f3ae2ffd640 1 -- 172.21.15.90:0/14580308 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]}]=0 v79) ==== 144+0+0 (secure 0 0 0) 0x7f3adc08c300 con 0x7f3aec0d2470 2024-09-10T23:15:36.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.473+0000 7f3af0d8a640 1 -- 172.21.15.90:0/14580308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3acc077f70 msgr2=0x7f3acc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:36.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.473+0000 7f3af0d8a640 1 --2- 172.21.15.90:0/14580308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3acc077f70 0x7f3acc07a430 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4005fd0 tx=0x7f3ae400a250 comp rx=0 tx=0).stop 2024-09-10T23:15:36.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.473+0000 7f3af0d8a640 1 -- 172.21.15.90:0/14580308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3aec0d2470 msgr2=0x7f3aec09e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:36.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.473+0000 7f3af0d8a640 1 --2- 172.21.15.90:0/14580308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3aec0d2470 0x7f3aec09e2c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3adc005fd0 tx=0x7f3adc003f10 comp rx=0 tx=0).stop 2024-09-10T23:15:36.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.473+0000 7f3af0d8a640 1 -- 172.21.15.90:0/14580308 shutdown_connections 2024-09-10T23:15:36.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.473+0000 7f3af0d8a640 1 --2- 172.21.15.90:0/14580308 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3acc077f70 0x7f3acc07a430 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.473+0000 7f3af0d8a640 1 --2- 172.21.15.90:0/14580308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3aec0d1c70 0x7f3aec09dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.473+0000 7f3af0d8a640 1 --2- 172.21.15.90:0/14580308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3aec0d2470 0x7f3aec09e2c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.473+0000 7f3af0d8a640 1 --2- 172.21.15.90:0/14580308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3aec0d0ab0 0x7f3aec0a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.473+0000 7f3af0d8a640 1 -- 172.21.15.90:0/14580308 >> 172.21.15.90:0/14580308 conn(0x7f3aec09d2a0 msgr2=0x7f3aec06d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:36.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.473+0000 7f3af0d8a640 1 -- 172.21.15.90:0/14580308 shutdown_connections 2024-09-10T23:15:36.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.473+0000 7f3af0d8a640 1 -- 172.21.15.90:0/14580308 wait complete. 2024-09-10T23:15:36.485 INFO:tasks.cephfs_test_runner:That when a client unmounts, the thread count on the MDS goes back ... ok 2024-09-10T23:15:36.485 INFO:tasks.cephfs_test_runner:Starting test: test_session_evict_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) Check that mds evicts blocklisted client 2024-09-10T23:15:36.486 INFO:tasks.cephfs_test_runner:test_session_evict_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-10T23:15:36.486 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:36.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.586+0000 7f742df64640 1 -- 172.21.15.90:0/2994886573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f742815bcb0 msgr2=0x7f74280cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:36.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.586+0000 7f742df64640 1 --2- 172.21.15.90:0/2994886573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f742815bcb0 0x7f74280cb7e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f74280b5f10 tx=0x7f741802aac0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.586+0000 7f742df64640 1 -- 172.21.15.90:0/2994886573 shutdown_connections 2024-09-10T23:15:36.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.586+0000 7f742df64640 1 --2- 172.21.15.90:0/2994886573 >> v2:172.21.15.171:3300/0 conn(0x7f74280ca420 0x7f74280ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.586+0000 7f742df64640 1 --2- 172.21.15.90:0/2994886573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f742815bcb0 0x7f74280cb7e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.586+0000 7f742df64640 1 -- 172.21.15.90:0/2994886573 >> 172.21.15.90:0/2994886573 conn(0x7f74280cc850 msgr2=0x7f74280ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:36.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.586+0000 7f742df64640 1 -- 172.21.15.90:0/2994886573 shutdown_connections 2024-09-10T23:15:36.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.586+0000 7f742df64640 1 -- 172.21.15.90:0/2994886573 wait complete. 2024-09-10T23:15:36.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.587+0000 7f742df64640 1 Processor -- start 2024-09-10T23:15:36.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.587+0000 7f742df64640 1 -- start start 2024-09-10T23:15:36.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.588+0000 7f742df64640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f742806f850 0x7f742814c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:36.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.588+0000 7f742df64640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74280ca420 0x7f74281f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:36.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.588+0000 7f742df64640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f742815bcb0 0x7f74281f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:36.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.588+0000 7f742df64640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f742815c210 con 0x7f74280ca420 2024-09-10T23:15:36.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.588+0000 7f742df64640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f742815c090 con 0x7f742815bcb0 2024-09-10T23:15:36.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.588+0000 7f742df64640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f74280b1850 con 0x7f742806f850 2024-09-10T23:15:36.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.588+0000 7f7426ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74280ca420 0x7f74281f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:36.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.588+0000 7f7426ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74280ca420 0x7f74281f5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36132/0 (socket says 172.21.15.90:36132) 2024-09-10T23:15:36.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.588+0000 7f7426ffd640 1 -- 172.21.15.90:0/1326254453 learned_addr learned my addr 172.21.15.90:0/1326254453 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:36.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.588+0000 7f74277fe640 1 --2- 172.21.15.90:0/1326254453 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f742806f850 0x7f742814c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:36.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.588+0000 7f7427fff640 1 --2- 172.21.15.90:0/1326254453 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f742815bcb0 0x7f74281f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:36.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.588+0000 7f7426ffd640 1 -- 172.21.15.90:0/1326254453 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f742806f850 msgr2=0x7f742814c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:36.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.588+0000 7f7426ffd640 1 --2- 172.21.15.90:0/1326254453 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f742806f850 0x7f742814c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.588+0000 7f7426ffd640 1 -- 172.21.15.90:0/1326254453 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f742815bcb0 msgr2=0x7f74281f5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:36.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.588+0000 7f7426ffd640 1 --2- 172.21.15.90:0/1326254453 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f742815bcb0 0x7f74281f5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.588+0000 7f7426ffd640 1 -- 172.21.15.90:0/1326254453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74280c8d70 con 0x7f74280ca420 2024-09-10T23:15:36.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.588+0000 7f7426ffd640 1 --2- 172.21.15.90:0/1326254453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74280ca420 0x7f74281f5840 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f741c00c500 tx=0x7f741c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:36.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.589+0000 7f740ffff640 1 -- 172.21.15.90:0/1326254453 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c0052d0 con 0x7f74280ca420 2024-09-10T23:15:36.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.589+0000 7f740ffff640 1 -- 172.21.15.90:0/1326254453 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f741c005470 con 0x7f74280ca420 2024-09-10T23:15:36.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.589+0000 7f742df64640 1 -- 172.21.15.90:0/1326254453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742809c1f0 con 0x7f74280ca420 2024-09-10T23:15:36.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.589+0000 7f740ffff640 1 -- 172.21.15.90:0/1326254453 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c012870 con 0x7f74280ca420 2024-09-10T23:15:36.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.589+0000 7f742df64640 1 -- 172.21.15.90:0/1326254453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742814c7e0 con 0x7f74280ca420 2024-09-10T23:15:36.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.590+0000 7f742df64640 1 -- 172.21.15.90:0/1326254453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74280ca820 con 0x7f74280ca420 2024-09-10T23:15:36.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.590+0000 7f740ffff640 1 -- 172.21.15.90:0/1326254453 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f741c0035f0 con 0x7f74280ca420 2024-09-10T23:15:36.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.591+0000 7f740ffff640 1 --2- 172.21.15.90:0/1326254453 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7414077f70 0x7f741407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:36.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.591+0000 7f740ffff640 1 -- 172.21.15.90:0/1326254453 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f741c0994d0 con 0x7f74280ca420 2024-09-10T23:15:36.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.591+0000 7f74277fe640 1 --2- 172.21.15.90:0/1326254453 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7414077f70 0x7f741407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:36.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.591+0000 7f74277fe640 1 --2- 172.21.15.90:0/1326254453 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7414077f70 0x7f741407a430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7418035000 tx=0x7f7418038040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:36.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.595+0000 7f740ffff640 1 -- 172.21.15.90:0/1326254453 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f741c061c90 con 0x7f74280ca420 2024-09-10T23:15:36.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.771+0000 7f742df64640 1 -- 172.21.15.90:0/1326254453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f742809c3c0 con 0x7f74280ca420 2024-09-10T23:15:36.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.771+0000 7f740ffff640 1 -- 172.21.15.90:0/1326254453 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13034 (secure 0 0 0) 0x7f741c0666c0 con 0x7f74280ca420 2024-09-10T23:15:36.772 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:36.772 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":37,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:15:35.460365+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.171:6837/2513837234":"2024-09-11T23:15:32.150952+0000","172.21.15.171:6835/2513837234":"2024-09-11T23:15:32.150952+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.773+0000 7f742df64640 1 -- 172.21.15.90:0/1326254453 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7414077f70 msgr2=0x7f741407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.773+0000 7f742df64640 1 --2- 172.21.15.90:0/1326254453 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7414077f70 0x7f741407a430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7418035000 tx=0x7f7418038040 comp rx=0 tx=0).stop 2024-09-10T23:15:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.773+0000 7f742df64640 1 -- 172.21.15.90:0/1326254453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74280ca420 msgr2=0x7f74281f5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.773+0000 7f742df64640 1 --2- 172.21.15.90:0/1326254453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74280ca420 0x7f74281f5840 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f741c00c500 tx=0x7f741c00c9c0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.773+0000 7f742df64640 1 -- 172.21.15.90:0/1326254453 shutdown_connections 2024-09-10T23:15:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.773+0000 7f742df64640 1 --2- 172.21.15.90:0/1326254453 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7414077f70 0x7f741407a430 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.773+0000 7f742df64640 1 --2- 172.21.15.90:0/1326254453 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f742815bcb0 0x7f74281f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.773+0000 7f742df64640 1 --2- 172.21.15.90:0/1326254453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74280ca420 0x7f74281f5840 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.773+0000 7f742df64640 1 --2- 172.21.15.90:0/1326254453 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f742806f850 0x7f742814c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.773+0000 7f742df64640 1 -- 172.21.15.90:0/1326254453 >> 172.21.15.90:0/1326254453 conn(0x7f74280cc850 msgr2=0x7f74280b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.774+0000 7f742df64640 1 -- 172.21.15.90:0/1326254453 shutdown_connections 2024-09-10T23:15:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.774+0000 7f742df64640 1 -- 172.21.15.90:0/1326254453 wait complete. 2024-09-10T23:15:36.785 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:14:26.449950+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:15:36.786 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:15:36.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.893+0000 7f15b1584640 1 -- 172.21.15.90:0/3175911580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15ac15ab10 msgr2=0x7f15ac06e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:36.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.893+0000 7f15b1584640 1 --2- 172.21.15.90:0/3175911580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15ac15ab10 0x7f15ac06e680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f159c005fd0 tx=0x7f159c02a5d0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.893+0000 7f15b1584640 1 -- 172.21.15.90:0/3175911580 shutdown_connections 2024-09-10T23:15:36.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.893+0000 7f15b1584640 1 --2- 172.21.15.90:0/3175911580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15ac0cf840 0x7f15ac15e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.893+0000 7f15b1584640 1 --2- 172.21.15.90:0/3175911580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15ac15ab10 0x7f15ac06e680 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.893+0000 7f15b1584640 1 -- 172.21.15.90:0/3175911580 >> 172.21.15.90:0/3175911580 conn(0x7f15ac0cfc80 msgr2=0x7f15ac0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:36.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.893+0000 7f15b1584640 1 -- 172.21.15.90:0/3175911580 shutdown_connections 2024-09-10T23:15:36.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.893+0000 7f15b1584640 1 -- 172.21.15.90:0/3175911580 wait complete. 2024-09-10T23:15:36.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.894+0000 7f15b1584640 1 Processor -- start 2024-09-10T23:15:36.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.894+0000 7f15b1584640 1 -- start start 2024-09-10T23:15:36.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.895+0000 7f15b1584640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15ac0cf840 0x7f15ac0b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:36.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.895+0000 7f15b1584640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15ac15ab10 0x7f15ac0c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:36.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.895+0000 7f15b1584640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15ac15edb0 0x7f15ac0b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:36.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.895+0000 7f15b1584640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac15b780 con 0x7f15ac15ab10 2024-09-10T23:15:36.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.895+0000 7f15b1584640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac15b600 con 0x7f15ac0cf840 2024-09-10T23:15:36.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.895+0000 7f15b1584640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f15ac15b900 con 0x7f15ac15edb0 2024-09-10T23:15:36.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.895+0000 7f15a3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15ac15ab10 0x7f15ac0c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:36.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.895+0000 7f15aaffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15ac0cf840 0x7f15ac0b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:36.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.895+0000 7f15ab7fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15ac15edb0 0x7f15ac0b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:36.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.895+0000 7f15a3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15ac15ab10 0x7f15ac0c7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36140/0 (socket says 172.21.15.90:36140) 2024-09-10T23:15:36.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.895+0000 7f15aaffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15ac0cf840 0x7f15ac0b4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.90:46992/0 (socket says 172.21.15.90:46992) 2024-09-10T23:15:36.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.895+0000 7f15a3fff640 1 -- 172.21.15.90:0/1243719214 learned_addr learned my addr 172.21.15.90:0/1243719214 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:36.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.895+0000 7f15a3fff640 1 -- 172.21.15.90:0/1243719214 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15ac15edb0 msgr2=0x7f15ac0b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:36.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.895+0000 7f15a3fff640 1 --2- 172.21.15.90:0/1243719214 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15ac15edb0 0x7f15ac0b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.895+0000 7f15a3fff640 1 -- 172.21.15.90:0/1243719214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15ac0cf840 msgr2=0x7f15ac0b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:36.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.895+0000 7f15a3fff640 1 --2- 172.21.15.90:0/1243719214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15ac0cf840 0x7f15ac0b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.895+0000 7f15a3fff640 1 -- 172.21.15.90:0/1243719214 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15ac0b53c0 con 0x7f15ac15ab10 2024-09-10T23:15:36.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.896+0000 7f15a3fff640 1 --2- 172.21.15.90:0/1243719214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15ac15ab10 0x7f15ac0c7680 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f159400e9f0 tx=0x7f159400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:36.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.896+0000 7f15a37fe640 1 -- 172.21.15.90:0/1243719214 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159400cd80 con 0x7f15ac15ab10 2024-09-10T23:15:36.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.896+0000 7f15b1584640 1 -- 172.21.15.90:0/1243719214 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15ac0c87e0 con 0x7f15ac15ab10 2024-09-10T23:15:36.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.896+0000 7f15a37fe640 1 -- 172.21.15.90:0/1243719214 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1594010520 con 0x7f15ac15ab10 2024-09-10T23:15:36.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.896+0000 7f15a37fe640 1 -- 172.21.15.90:0/1243719214 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1594010950 con 0x7f15ac15ab10 2024-09-10T23:15:36.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.896+0000 7f15b1584640 1 -- 172.21.15.90:0/1243719214 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15ac0c6e80 con 0x7f15ac15ab10 2024-09-10T23:15:36.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.897+0000 7f15b1584640 1 -- 172.21.15.90:0/1243719214 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15ac15e870 con 0x7f15ac15ab10 2024-09-10T23:15:36.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.897+0000 7f15a37fe640 1 -- 172.21.15.90:0/1243719214 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1594010af0 con 0x7f15ac15ab10 2024-09-10T23:15:36.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.898+0000 7f15a37fe640 1 --2- 172.21.15.90:0/1243719214 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f158c077f70 0x7f158c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:36.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.898+0000 7f15a37fe640 1 -- 172.21.15.90:0/1243719214 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f159409a480 con 0x7f15ac15ab10 2024-09-10T23:15:36.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.898+0000 7f15aaffd640 1 --2- 172.21.15.90:0/1243719214 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f158c077f70 0x7f158c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:36.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.899+0000 7f15aaffd640 1 --2- 172.21.15.90:0/1243719214 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f158c077f70 0x7f158c07a430 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f159c033000 tx=0x7f159c004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:36.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:36.902+0000 7f15a37fe640 1 -- 172.21.15.90:0/1243719214 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f15ac0b53c0 con 0x7f15ac15ab10 2024-09-10T23:15:37.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.077+0000 7f15b1584640 1 -- 172.21.15.90:0/1243719214 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f15ac0c3550 con 0x7f15ac15ab10 2024-09-10T23:15:37.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.077+0000 7f15a37fe640 1 -- 172.21.15.90:0/1243719214 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7f1594062c40 con 0x7f15ac15ab10 2024-09-10T23:15:37.079 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-09-10T23:15:37.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.079+0000 7f15b1584640 1 -- 172.21.15.90:0/1243719214 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f158c077f70 msgr2=0x7f158c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.079+0000 7f15b1584640 1 --2- 172.21.15.90:0/1243719214 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f158c077f70 0x7f158c07a430 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f159c033000 tx=0x7f159c004730 comp rx=0 tx=0).stop 2024-09-10T23:15:37.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.079+0000 7f15b1584640 1 -- 172.21.15.90:0/1243719214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15ac15ab10 msgr2=0x7f15ac0c7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.079+0000 7f15b1584640 1 --2- 172.21.15.90:0/1243719214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15ac15ab10 0x7f15ac0c7680 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f159400e9f0 tx=0x7f159400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.079+0000 7f15b1584640 1 -- 172.21.15.90:0/1243719214 shutdown_connections 2024-09-10T23:15:37.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.079+0000 7f15b1584640 1 --2- 172.21.15.90:0/1243719214 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f158c077f70 0x7f158c07a430 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.079+0000 7f15b1584640 1 --2- 172.21.15.90:0/1243719214 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15ac15edb0 0x7f15ac0b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.079+0000 7f15b1584640 1 --2- 172.21.15.90:0/1243719214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15ac15ab10 0x7f15ac0c7680 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.079+0000 7f15b1584640 1 --2- 172.21.15.90:0/1243719214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15ac0cf840 0x7f15ac0b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.079+0000 7f15b1584640 1 -- 172.21.15.90:0/1243719214 >> 172.21.15.90:0/1243719214 conn(0x7f15ac0cfc80 msgr2=0x7f15ac0ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:37.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.080+0000 7f15b1584640 1 -- 172.21.15.90:0/1243719214 shutdown_connections 2024-09-10T23:15:37.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.080+0000 7f15b1584640 1 -- 172.21.15.90:0/1243719214 wait complete. 2024-09-10T23:15:37.091 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted' 2024-09-10T23:15:37.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.191+0000 7f3657d2b640 1 -- 172.21.15.90:0/4233749980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3650157fc0 msgr2=0x7f365015b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.191+0000 7f3657d2b640 1 --2- 172.21.15.90:0/4233749980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3650157fc0 0x7f365015b290 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3640005fd0 tx=0x7f364002aa10 comp rx=0 tx=0).stop 2024-09-10T23:15:37.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.191+0000 7f3657d2b640 1 -- 172.21.15.90:0/4233749980 shutdown_connections 2024-09-10T23:15:37.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.191+0000 7f3657d2b640 1 --2- 172.21.15.90:0/4233749980 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36500ca420 0x7f36500ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.191+0000 7f3657d2b640 1 --2- 172.21.15.90:0/4233749980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3650157fc0 0x7f365015b290 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.191+0000 7f3657d2b640 1 -- 172.21.15.90:0/4233749980 >> 172.21.15.90:0/4233749980 conn(0x7f36500cc850 msgr2=0x7f36500ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:37.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.191+0000 7f3657d2b640 1 -- 172.21.15.90:0/4233749980 shutdown_connections 2024-09-10T23:15:37.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.191+0000 7f3657d2b640 1 -- 172.21.15.90:0/4233749980 wait complete. 2024-09-10T23:15:37.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.192+0000 7f3657d2b640 1 Processor -- start 2024-09-10T23:15:37.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.192+0000 7f3657d2b640 1 -- start start 2024-09-10T23:15:37.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f3657d2b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36500aef50 0x7f3650151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:37.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f3657d2b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36500ca420 0x7f36501547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:37.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f3657d2b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3650157fc0 0x7f365015cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:37.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f3657d2b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f36500b1a40 con 0x7f36500aef50 2024-09-10T23:15:37.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f3657d2b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f36500b18c0 con 0x7f3650157fc0 2024-09-10T23:15:37.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f3657d2b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f36500b1bc0 con 0x7f36500ca420 2024-09-10T23:15:37.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f3655ac7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36500aef50 0x7f3650151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:37.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f3655ac7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36500aef50 0x7f3650151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36166/0 (socket says 172.21.15.90:36166) 2024-09-10T23:15:37.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f3655ac7640 1 -- 172.21.15.90:0/997075618 learned_addr learned my addr 172.21.15.90:0/997075618 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:37.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f36562c8640 1 --2- 172.21.15.90:0/997075618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3650157fc0 0x7f365015cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:37.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f36552c6640 1 --2- 172.21.15.90:0/997075618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36500ca420 0x7f36501547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:37.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f3655ac7640 1 -- 172.21.15.90:0/997075618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36500ca420 msgr2=0x7f36501547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f3655ac7640 1 --2- 172.21.15.90:0/997075618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36500ca420 0x7f36501547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f3655ac7640 1 -- 172.21.15.90:0/997075618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3650157fc0 msgr2=0x7f365015cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f3655ac7640 1 --2- 172.21.15.90:0/997075618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3650157fc0 0x7f365015cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f3655ac7640 1 -- 172.21.15.90:0/997075618 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3650154e70 con 0x7f36500aef50 2024-09-10T23:15:37.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f36562c8640 1 --2- 172.21.15.90:0/997075618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3650157fc0 0x7f365015cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:37.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.193+0000 7f36552c6640 1 --2- 172.21.15.90:0/997075618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36500ca420 0x7f36501547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:37.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.194+0000 7f3655ac7640 1 --2- 172.21.15.90:0/997075618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36500aef50 0x7f3650151510 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3640000f80 tx=0x7f3640003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:37.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.194+0000 7f364e7fc640 1 -- 172.21.15.90:0/997075618 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640046070 con 0x7f36500aef50 2024-09-10T23:15:37.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.194+0000 7f364e7fc640 1 -- 172.21.15.90:0/997075618 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3640004540 con 0x7f36500aef50 2024-09-10T23:15:37.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.194+0000 7f364e7fc640 1 -- 172.21.15.90:0/997075618 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640033070 con 0x7f36500aef50 2024-09-10T23:15:37.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.194+0000 7f3657d2b640 1 -- 172.21.15.90:0/997075618 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3650153030 con 0x7f36500aef50 2024-09-10T23:15:37.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.194+0000 7f3657d2b640 1 -- 172.21.15.90:0/997075618 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36501f2600 con 0x7f36500aef50 2024-09-10T23:15:37.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.195+0000 7f3657d2b640 1 -- 172.21.15.90:0/997075618 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36500ca890 con 0x7f36500aef50 2024-09-10T23:15:37.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.196+0000 7f364e7fc640 1 -- 172.21.15.90:0/997075618 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3640040030 con 0x7f36500aef50 2024-09-10T23:15:37.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.196+0000 7f364e7fc640 1 --2- 172.21.15.90:0/997075618 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f363c077f70 0x7f363c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:37.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.196+0000 7f364e7fc640 1 -- 172.21.15.90:0/997075618 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f36400baa10 con 0x7f36500aef50 2024-09-10T23:15:37.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.196+0000 7f36552c6640 1 --2- 172.21.15.90:0/997075618 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f363c077f70 0x7f363c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:37.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.197+0000 7f36552c6640 1 --2- 172.21.15.90:0/997075618 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f363c077f70 0x7f363c07a430 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3650151d10 tx=0x7f3644009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:37.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.200+0000 7f364e7fc640 1 -- 172.21.15.90:0/997075618 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f364003e070 con 0x7f36500aef50 2024-09-10T23:15:37.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.444+0000 7f3657d2b640 1 -- 172.21.15.90:0/997075618 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]} v 0) -- 0x7f36500cee50 con 0x7f36500aef50 2024-09-10T23:15:37.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.471+0000 7f364e7fc640 1 -- 172.21.15.90:0/997075618 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]}]=0 v80) ==== 156+0+0 (secure 0 0 0) 0x7f36400838a0 con 0x7f36500aef50 2024-09-10T23:15:37.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.473+0000 7f3657d2b640 1 -- 172.21.15.90:0/997075618 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f363c077f70 msgr2=0x7f363c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.474+0000 7f3657d2b640 1 --2- 172.21.15.90:0/997075618 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f363c077f70 0x7f363c07a430 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3650151d10 tx=0x7f3644009040 comp rx=0 tx=0).stop 2024-09-10T23:15:37.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.474+0000 7f3657d2b640 1 -- 172.21.15.90:0/997075618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36500aef50 msgr2=0x7f3650151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.474+0000 7f3657d2b640 1 --2- 172.21.15.90:0/997075618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36500aef50 0x7f3650151510 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3640000f80 tx=0x7f3640003f90 comp rx=0 tx=0).stop 2024-09-10T23:15:37.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.474+0000 7f3657d2b640 1 -- 172.21.15.90:0/997075618 shutdown_connections 2024-09-10T23:15:37.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.474+0000 7f3657d2b640 1 --2- 172.21.15.90:0/997075618 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f363c077f70 0x7f363c07a430 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.474+0000 7f3657d2b640 1 --2- 172.21.15.90:0/997075618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3650157fc0 0x7f365015cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.474+0000 7f3657d2b640 1 --2- 172.21.15.90:0/997075618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36500ca420 0x7f36501547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.474+0000 7f3657d2b640 1 --2- 172.21.15.90:0/997075618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36500aef50 0x7f3650151510 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.474+0000 7f3657d2b640 1 -- 172.21.15.90:0/997075618 >> 172.21.15.90:0/997075618 conn(0x7f36500cc850 msgr2=0x7f3650158dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:37.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.474+0000 7f3657d2b640 1 -- 172.21.15.90:0/997075618 shutdown_connections 2024-09-10T23:15:37.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.474+0000 7f3657d2b640 1 -- 172.21.15.90:0/997075618 wait complete. 2024-09-10T23:15:37.485 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:15:37.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.585+0000 7fd0d2a2b640 1 -- 172.21.15.90:0/1974200569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0b4004800 msgr2=0x7fd0b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.585+0000 7fd0d2a2b640 1 --2- 172.21.15.90:0/1974200569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0b4004800 0x7fd0b4004c80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0d20d0 tx=0x7fd0b4005830 comp rx=0 tx=0).stop 2024-09-10T23:15:37.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.585+0000 7fd0d2a2b640 1 -- 172.21.15.90:0/1974200569 shutdown_connections 2024-09-10T23:15:37.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.585+0000 7fd0d2a2b640 1 --2- 172.21.15.90:0/1974200569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0b4004800 0x7fd0b4004c80 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.585+0000 7fd0d2a2b640 1 -- 172.21.15.90:0/1974200569 >> 172.21.15.90:0/1974200569 conn(0x7fd0cc09d2a0 msgr2=0x7fd0cc0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:37.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.585+0000 7fd0d2a2b640 1 -- 172.21.15.90:0/1974200569 shutdown_connections 2024-09-10T23:15:37.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.585+0000 7fd0d2a2b640 1 -- 172.21.15.90:0/1974200569 wait complete. 2024-09-10T23:15:37.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.586+0000 7fd0d2a2b640 1 Processor -- start 2024-09-10T23:15:37.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.586+0000 7fd0d2a2b640 1 -- start start 2024-09-10T23:15:37.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.587+0000 7fd0d2a2b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0b4004800 0x7fd0cc1f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:37.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.587+0000 7fd0d2a2b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0cc1f7c30 0x7fd0cc154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:37.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.587+0000 7fd0d2a2b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0cc0b8540 0x7fd0cc06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:37.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.587+0000 7fd0d2a2b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc0d2850 con 0x7fd0cc0b8540 2024-09-10T23:15:37.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.587+0000 7fd0d2a2b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc0cec80 con 0x7fd0cc1f7c30 2024-09-10T23:15:37.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.587+0000 7fd0d2a2b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd0cc0d29d0 con 0x7fd0b4004800 2024-09-10T23:15:37.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.587+0000 7fd0d0fc8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0cc0b8540 0x7fd0cc06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:37.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.587+0000 7fd0d0fc8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0cc0b8540 0x7fd0cc06e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36184/0 (socket says 172.21.15.90:36184) 2024-09-10T23:15:37.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.587+0000 7fd0d0fc8640 1 -- 172.21.15.90:0/1085880020 learned_addr learned my addr 172.21.15.90:0/1085880020 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:37.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.587+0000 7fd0cbfff640 1 --2- 172.21.15.90:0/1085880020 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0b4004800 0x7fd0cc1f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:37.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.587+0000 7fd0cb7fe640 1 --2- 172.21.15.90:0/1085880020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0cc1f7c30 0x7fd0cc154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:37.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.587+0000 7fd0d0fc8640 1 -- 172.21.15.90:0/1085880020 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0b4004800 msgr2=0x7fd0cc1f45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.587+0000 7fd0d0fc8640 1 --2- 172.21.15.90:0/1085880020 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0b4004800 0x7fd0cc1f45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.587+0000 7fd0d0fc8640 1 -- 172.21.15.90:0/1085880020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0cc1f7c30 msgr2=0x7fd0cc154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.587+0000 7fd0d0fc8640 1 --2- 172.21.15.90:0/1085880020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0cc1f7c30 0x7fd0cc154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.587+0000 7fd0d0fc8640 1 -- 172.21.15.90:0/1085880020 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0cc154950 con 0x7fd0cc0b8540 2024-09-10T23:15:37.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.587+0000 7fd0cb7fe640 1 --2- 172.21.15.90:0/1085880020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0cc1f7c30 0x7fd0cc154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:37.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.588+0000 7fd0d0fc8640 1 --2- 172.21.15.90:0/1085880020 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0cc0b8540 0x7fd0cc06e4a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc08e570 tx=0x7fd0c4010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:37.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.588+0000 7fd0c8ff9640 1 -- 172.21.15.90:0/1085880020 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4003e40 con 0x7fd0cc0b8540 2024-09-10T23:15:37.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.588+0000 7fd0c8ff9640 1 -- 172.21.15.90:0/1085880020 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0c4015070 con 0x7fd0cc0b8540 2024-09-10T23:15:37.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.588+0000 7fd0d2a2b640 1 -- 172.21.15.90:0/1085880020 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0cc1f4c90 con 0x7fd0cc0b8540 2024-09-10T23:15:37.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.588+0000 7fd0c8ff9640 1 -- 172.21.15.90:0/1085880020 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c400ed10 con 0x7fd0cc0b8540 2024-09-10T23:15:37.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.588+0000 7fd0d2a2b640 1 -- 172.21.15.90:0/1085880020 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0cc1f5250 con 0x7fd0cc0b8540 2024-09-10T23:15:37.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.589+0000 7fd0d2a2b640 1 -- 172.21.15.90:0/1085880020 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0cc0b3160 con 0x7fd0cc0b8540 2024-09-10T23:15:37.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.589+0000 7fd0c8ff9640 1 -- 172.21.15.90:0/1085880020 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd0c4004050 con 0x7fd0cc0b8540 2024-09-10T23:15:37.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.590+0000 7fd0c8ff9640 1 --2- 172.21.15.90:0/1085880020 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0b8077f70 0x7fd0b807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:37.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.590+0000 7fd0c8ff9640 1 -- 172.21.15.90:0/1085880020 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fd0c409a550 con 0x7fd0cc0b8540 2024-09-10T23:15:37.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.590+0000 7fd0cbfff640 1 --2- 172.21.15.90:0/1085880020 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0b8077f70 0x7fd0b807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:37.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.591+0000 7fd0cbfff640 1 --2- 172.21.15.90:0/1085880020 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0b8077f70 0x7fd0b807a430 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc006510 tx=0x7fd0bc006aa0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:37.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.594+0000 7fd0c8ff9640 1 -- 172.21.15.90:0/1085880020 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd0c40633e0 con 0x7fd0cc0b8540 2024-09-10T23:15:37.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.770+0000 7fd0d2a2b640 1 -- 172.21.15.90:0/1085880020 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fd0cc0760a0 con 0x7fd0cc0b8540 2024-09-10T23:15:37.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.771+0000 7fd0c8ff9640 1 -- 172.21.15.90:0/1085880020 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v30) ==== 59+0+1998 (secure 0 0 0) 0x7fd0c4062ce0 con 0x7fd0cc0b8540 2024-09-10T23:15:37.772 INFO:teuthology.orchestra.run.smithi090.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:15:37.772 INFO:teuthology.orchestra.run.smithi090.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:15:37.772 INFO:teuthology.orchestra.run.smithi090.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:15:37.772 INFO:teuthology.orchestra.run.smithi090.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:15:37.772 INFO:teuthology.orchestra.run.smithi090.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8283.895139 2024-09-10T23:15:37.772 INFO:teuthology.orchestra.run.smithi090.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5684.288500 2024-09-10T23:15:37.772 INFO:teuthology.orchestra.run.smithi090.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5960.411649 2024-09-10T23:15:37.772 INFO:teuthology.orchestra.run.smithi090.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5499.929251 2024-09-10T23:15:37.772 INFO:teuthology.orchestra.run.smithi090.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5373.806301 2024-09-10T23:15:37.772 INFO:teuthology.orchestra.run.smithi090.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5138.908279 2024-09-10T23:15:37.773 INFO:teuthology.orchestra.run.smithi090.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5181.430205 2024-09-10T23:15:37.773 INFO:teuthology.orchestra.run.smithi090.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4880.265977 2024-09-10T23:15:37.773 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_mds 20/20 2024-09-10T23:15:37.773 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:15:37.773 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_ms 2/2 2024-09-10T23:15:37.773 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_debug_frag true 2024-09-10T23:15:37.773 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:15:37.773 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:15:37.773 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_verify_scatter true 2024-09-10T23:15:37.773 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:15:37.773 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:15:37.773 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:15:37.773 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced client_mount_timeout 600 2024-09-10T23:15:37.774 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced debug_client 20/20 2024-09-10T23:15:37.774 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced debug_ms 1/1 2024-09-10T23:15:37.774 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:15:37.774 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:15:37.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.773+0000 7fd0d2a2b640 1 -- 172.21.15.90:0/1085880020 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0b8077f70 msgr2=0x7fd0b807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.773+0000 7fd0d2a2b640 1 --2- 172.21.15.90:0/1085880020 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0b8077f70 0x7fd0b807a430 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc006510 tx=0x7fd0bc006aa0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.773+0000 7fd0d2a2b640 1 -- 172.21.15.90:0/1085880020 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0cc0b8540 msgr2=0x7fd0cc06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.773+0000 7fd0d2a2b640 1 --2- 172.21.15.90:0/1085880020 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0cc0b8540 0x7fd0cc06e4a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc08e570 tx=0x7fd0c4010f40 comp rx=0 tx=0).stop 2024-09-10T23:15:37.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.773+0000 7fd0d2a2b640 1 -- 172.21.15.90:0/1085880020 shutdown_connections 2024-09-10T23:15:37.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.773+0000 7fd0d2a2b640 1 --2- 172.21.15.90:0/1085880020 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0b8077f70 0x7fd0b807a430 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.773+0000 7fd0d2a2b640 1 --2- 172.21.15.90:0/1085880020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0cc1f7c30 0x7fd0cc154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.773+0000 7fd0d2a2b640 1 --2- 172.21.15.90:0/1085880020 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0cc0b8540 0x7fd0cc06e4a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.773+0000 7fd0d2a2b640 1 --2- 172.21.15.90:0/1085880020 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0b4004800 0x7fd0cc1f45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.773+0000 7fd0d2a2b640 1 -- 172.21.15.90:0/1085880020 >> 172.21.15.90:0/1085880020 conn(0x7fd0cc09d2a0 msgr2=0x7fd0cc15bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:37.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.773+0000 7fd0d2a2b640 1 -- 172.21.15.90:0/1085880020 shutdown_connections 2024-09-10T23:15:37.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.773+0000 7fd0d2a2b640 1 -- 172.21.15.90:0/1085880020 wait complete. 2024-09-10T23:15:37.784 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:15:37.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.887+0000 7f9feea39640 1 -- 172.21.15.90:0/2782717403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fd0004080 msgr2=0x7f9fd0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.887+0000 7f9feea39640 1 --2- 172.21.15.90:0/2782717403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fd0004080 0x7f9fd0004800 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00baf0 tx=0x7f9fd0005830 comp rx=0 tx=0).stop 2024-09-10T23:15:37.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.887+0000 7f9fecfd6640 1 -- 172.21.15.90:0/2782717403 reap_dead start 2024-09-10T23:15:37.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.887+0000 7f9feea39640 1 -- 172.21.15.90:0/2782717403 shutdown_connections 2024-09-10T23:15:37.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.887+0000 7f9feea39640 1 -- 172.21.15.90:0/2782717403 >> 172.21.15.90:0/2782717403 conn(0x7f9fe80cfc80 msgr2=0x7f9fe80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:37.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.887+0000 7f9feea39640 1 -- 172.21.15.90:0/2782717403 shutdown_connections 2024-09-10T23:15:37.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.887+0000 7f9feea39640 1 -- 172.21.15.90:0/2782717403 wait complete. 2024-09-10T23:15:37.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.888+0000 7f9feea39640 1 Processor -- start 2024-09-10T23:15:37.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.889+0000 7f9feea39640 1 -- start start 2024-09-10T23:15:37.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.889+0000 7f9feea39640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fd0004080 0x7f9fe8154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:37.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.889+0000 7f9feea39640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fe80b5310 0x7f9fe8152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:37.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.889+0000 7f9feea39640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fe80b5770 0x7f9fe8152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:37.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.889+0000 7f9feea39640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe806f2a0 con 0x7f9fd0004080 2024-09-10T23:15:37.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.889+0000 7f9feea39640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe806f120 con 0x7f9fe80b5770 2024-09-10T23:15:37.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.889+0000 7f9feea39640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe806f420 con 0x7f9fe80b5310 2024-09-10T23:15:37.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.889+0000 7f9fe7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fd0004080 0x7f9fe8154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:37.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.889+0000 7f9fe7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fd0004080 0x7f9fe8154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36192/0 (socket says 172.21.15.90:36192) 2024-09-10T23:15:37.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.889+0000 7f9fe7fff640 1 -- 172.21.15.90:0/629355764 learned_addr learned my addr 172.21.15.90:0/629355764 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:37.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.890+0000 7f9fecfd6640 1 --2- 172.21.15.90:0/629355764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fe80b5770 0x7f9fe8152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:37.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.890+0000 7f9fe7fff640 1 -- 172.21.15.90:0/629355764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fe80b5310 msgr2=0x7f9fe8152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.890+0000 7f9fe77fe640 1 --2- 172.21.15.90:0/629355764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fe80b5310 0x7f9fe8152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.890+0000 7f9fe7fff640 1 --2- 172.21.15.90:0/629355764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fe80b5310 0x7f9fe8152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.890+0000 7f9fe7fff640 1 -- 172.21.15.90:0/629355764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fe80b5770 msgr2=0x7f9fe8152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.890+0000 7f9fe7fff640 1 --2- 172.21.15.90:0/629355764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fe80b5770 0x7f9fe8152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.890+0000 7f9fe7fff640 1 -- 172.21.15.90:0/629355764 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe81537d0 con 0x7f9fd0004080 2024-09-10T23:15:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.890+0000 7f9fecfd6640 1 --2- 172.21.15.90:0/629355764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fe80b5770 0x7f9fe8152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.890+0000 7f9fe77fe640 1 --2- 172.21.15.90:0/629355764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fe80b5310 0x7f9fe8152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.890+0000 7f9fe7fff640 1 --2- 172.21.15.90:0/629355764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fd0004080 0x7f9fe8154270 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8000fd0 tx=0x7f9fd800eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.890+0000 7f9fe4ff9640 1 -- 172.21.15.90:0/629355764 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8015020 con 0x7f9fd0004080 2024-09-10T23:15:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.890+0000 7f9fe4ff9640 1 -- 172.21.15.90:0/629355764 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fd800c840 con 0x7f9fd0004080 2024-09-10T23:15:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.890+0000 7f9feea39640 1 -- 172.21.15.90:0/629355764 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe81f3310 con 0x7f9fd0004080 2024-09-10T23:15:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.890+0000 7f9fe4ff9640 1 -- 172.21.15.90:0/629355764 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd800cc50 con 0x7f9fd0004080 2024-09-10T23:15:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.890+0000 7f9feea39640 1 -- 172.21.15.90:0/629355764 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe8153d70 con 0x7f9fd0004080 2024-09-10T23:15:37.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.891+0000 7f9feea39640 1 -- 172.21.15.90:0/629355764 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe815e870 con 0x7f9fd0004080 2024-09-10T23:15:37.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.892+0000 7f9fe4ff9640 1 -- 172.21.15.90:0/629355764 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9fd8003610 con 0x7f9fd0004080 2024-09-10T23:15:37.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.892+0000 7f9fe4ff9640 1 --2- 172.21.15.90:0/629355764 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9fd4077f70 0x7f9fd407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:37.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.892+0000 7f9fe4ff9640 1 -- 172.21.15.90:0/629355764 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f9fd809a210 con 0x7f9fd0004080 2024-09-10T23:15:37.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.892+0000 7f9fe77fe640 1 --2- 172.21.15.90:0/629355764 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9fd4077f70 0x7f9fd407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:37.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.893+0000 7f9fe77fe640 1 --2- 172.21.15.90:0/629355764 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9fd4077f70 0x7f9fd407a430 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc036000 tx=0x7f9fdc0046c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:37.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:37.896+0000 7f9fe4ff9640 1 -- 172.21.15.90:0/629355764 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9fd801f030 con 0x7f9fd0004080 2024-09-10T23:15:38.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.072+0000 7f9feea39640 1 -- 172.21.15.90:0/629355764 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f9fe80b5c00 con 0x7f9fd0004080 2024-09-10T23:15:38.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.075+0000 7f9fe4ff9640 1 -- 172.21.15.90:0/629355764 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v31)=0 v31) ==== 122+0+0 (secure 0 0 0) 0x7f9fd8063020 con 0x7f9fd0004080 2024-09-10T23:15:38.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.078+0000 7f9feea39640 1 -- 172.21.15.90:0/629355764 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9fd4077f70 msgr2=0x7f9fd407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:38.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.078+0000 7f9feea39640 1 --2- 172.21.15.90:0/629355764 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9fd4077f70 0x7f9fd407a430 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc036000 tx=0x7f9fdc0046c0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.078+0000 7f9feea39640 1 -- 172.21.15.90:0/629355764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fd0004080 msgr2=0x7f9fe8154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:38.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.078+0000 7f9feea39640 1 --2- 172.21.15.90:0/629355764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fd0004080 0x7f9fe8154270 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8000fd0 tx=0x7f9fd800eb60 comp rx=0 tx=0).stop 2024-09-10T23:15:38.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.078+0000 7f9feea39640 1 -- 172.21.15.90:0/629355764 shutdown_connections 2024-09-10T23:15:38.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.078+0000 7f9feea39640 1 --2- 172.21.15.90:0/629355764 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9fd4077f70 0x7f9fd407a430 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.078+0000 7f9feea39640 1 --2- 172.21.15.90:0/629355764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fe80b5770 0x7f9fe8152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.078+0000 7f9feea39640 1 --2- 172.21.15.90:0/629355764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fe80b5310 0x7f9fe8152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.078+0000 7f9feea39640 1 --2- 172.21.15.90:0/629355764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fd0004080 0x7f9fe8154270 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.078+0000 7f9feea39640 1 -- 172.21.15.90:0/629355764 >> 172.21.15.90:0/629355764 conn(0x7f9fe80cfc80 msgr2=0x7f9fe80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:38.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.078+0000 7f9feea39640 1 -- 172.21.15.90:0/629355764 shutdown_connections 2024-09-10T23:15:38.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.078+0000 7f9feea39640 1 -- 172.21.15.90:0/629355764 wait complete. 2024-09-10T23:15:38.090 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:15:38.090 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:15:38.125 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:15:38.166 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:15:38.167 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:38.167 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:38.182 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:15:38.183 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:15:38.183 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:38.225 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:15:38.226 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:38.226 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:38.241 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:15:38.242 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:15:38.242 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:38.284 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:15:38.284 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:15:38.284 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:38.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.384+0000 7f8537de2640 1 -- 172.21.15.90:0/3155995481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85300ca420 msgr2=0x7f85300ca850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:38.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.384+0000 7f8537de2640 1 --2- 172.21.15.90:0/3155995481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85300ca420 0x7f85300ca850 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8528005fd0 tx=0x7f852802aa90 comp rx=0 tx=0).stop 2024-09-10T23:15:38.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.384+0000 7f8537de2640 1 -- 172.21.15.90:0/3155995481 shutdown_connections 2024-09-10T23:15:38.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.384+0000 7f8537de2640 1 --2- 172.21.15.90:0/3155995481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85300ca420 0x7f85300ca850 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.384+0000 7f8537de2640 1 --2- 172.21.15.90:0/3155995481 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85300cb7e0 0x7f853006f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.384+0000 7f8537de2640 1 -- 172.21.15.90:0/3155995481 >> 172.21.15.90:0/3155995481 conn(0x7f85300cc850 msgr2=0x7f85300ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:38.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.384+0000 7f8537de2640 1 -- 172.21.15.90:0/3155995481 shutdown_connections 2024-09-10T23:15:38.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.384+0000 7f8537de2640 1 -- 172.21.15.90:0/3155995481 wait complete. 2024-09-10T23:15:38.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.385+0000 7f8537de2640 1 Processor -- start 2024-09-10T23:15:38.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.385+0000 7f8537de2640 1 -- start start 2024-09-10T23:15:38.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f8537de2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85300ca420 0x7f853009d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:38.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f8537de2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85300cb7e0 0x7f85301f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:38.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f8537de2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f853015bcb0 0x7f853014be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:38.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f8537de2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85300b1850 con 0x7f853015bcb0 2024-09-10T23:15:38.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f8537de2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f853006f440 con 0x7f85300cb7e0 2024-09-10T23:15:38.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f8537de2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f85300b19d0 con 0x7f85300ca420 2024-09-10T23:15:38.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f853637f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f853015bcb0 0x7f853014be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:38.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f853637f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f853015bcb0 0x7f853014be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46502/0 (socket says 172.21.15.90:46502) 2024-09-10T23:15:38.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f853637f640 1 -- 172.21.15.90:0/553836 learned_addr learned my addr 172.21.15.90:0/553836 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:38.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f853537d640 1 --2- 172.21.15.90:0/553836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85300cb7e0 0x7f85301f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:38.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f8535b7e640 1 --2- 172.21.15.90:0/553836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85300ca420 0x7f853009d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:38.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f853637f640 1 -- 172.21.15.90:0/553836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85300ca420 msgr2=0x7f853009d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:38.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f853637f640 1 --2- 172.21.15.90:0/553836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85300ca420 0x7f853009d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f853637f640 1 -- 172.21.15.90:0/553836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85300cb7e0 msgr2=0x7f85301f1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:38.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f853637f640 1 --2- 172.21.15.90:0/553836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85300cb7e0 0x7f85301f1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f853637f640 1 -- 172.21.15.90:0/553836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8530150180 con 0x7f853015bcb0 2024-09-10T23:15:38.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f853637f640 1 --2- 172.21.15.90:0/553836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f853015bcb0 0x7f853014be00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8528009bf0 tx=0x7f8528003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:38.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f85267fc640 1 -- 172.21.15.90:0/553836 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8528046070 con 0x7f853015bcb0 2024-09-10T23:15:38.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f85267fc640 1 -- 172.21.15.90:0/553836 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8528004040 con 0x7f853015bcb0 2024-09-10T23:15:38.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.386+0000 7f8537de2640 1 -- 172.21.15.90:0/553836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85300c6520 con 0x7f853015bcb0 2024-09-10T23:15:38.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.387+0000 7f85267fc640 1 -- 172.21.15.90:0/553836 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8528004450 con 0x7f853015bcb0 2024-09-10T23:15:38.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.387+0000 7f8537de2640 1 -- 172.21.15.90:0/553836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f853009d000 con 0x7f853015bcb0 2024-09-10T23:15:38.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.388+0000 7f8537de2640 1 -- 172.21.15.90:0/553836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85300ca850 con 0x7f853015bcb0 2024-09-10T23:15:38.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.388+0000 7f85267fc640 1 -- 172.21.15.90:0/553836 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f85280045f0 con 0x7f853015bcb0 2024-09-10T23:15:38.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.389+0000 7f85267fc640 1 --2- 172.21.15.90:0/553836 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8514077fa0 0x7f851407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:38.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.389+0000 7f85267fc640 1 -- 172.21.15.90:0/553836 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f85280ba960 con 0x7f853015bcb0 2024-09-10T23:15:38.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.389+0000 7f8535b7e640 1 --2- 172.21.15.90:0/553836 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8514077fa0 0x7f851407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:38.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.389+0000 7f8535b7e640 1 --2- 172.21.15.90:0/553836 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8514077fa0 0x7f851407a460 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f852c001720 tx=0x7f852c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:38.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.393+0000 7f85267fc640 1 -- 172.21.15.90:0/553836 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8530150180 con 0x7f853015bcb0 2024-09-10T23:15:38.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.608+0000 7f8537de2640 1 -- 172.21.15.90:0/553836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85300c6c60 con 0x7f853015bcb0 2024-09-10T23:15:38.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.608+0000 7f85267fc640 1 -- 172.21.15.90:0/553836 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3908 (secure 0 0 0) 0x7f8528032030 con 0x7f853015bcb0 2024-09-10T23:15:38.609 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:38.610 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":16,"btime":"2024-09-10T23:15:33:152607+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4717,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/464675823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":464675823},{"type":"v1","addr":"172.21.15.90:6835","nonce":464675823}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/28851721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":28851721},{"type":"v1","addr":"172.21.15.171:6836","nonce":28851721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/3538341252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3538341252},{"type":"v1","addr":"172.21.15.90:6834","nonce":3538341252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4933,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3682992021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3682992021},{"type":"v1","addr":"172.21.15.171:6837","nonce":3682992021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[]} 2024-09-10T23:15:38.610 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 16 2024-09-10T23:15:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.610+0000 7f8537de2640 1 -- 172.21.15.90:0/553836 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8514077fa0 msgr2=0x7f851407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.610+0000 7f8537de2640 1 --2- 172.21.15.90:0/553836 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8514077fa0 0x7f851407a460 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f852c001720 tx=0x7f852c009040 comp rx=0 tx=0).stop 2024-09-10T23:15:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.610+0000 7f8537de2640 1 -- 172.21.15.90:0/553836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f853015bcb0 msgr2=0x7f853014be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.610+0000 7f8537de2640 1 --2- 172.21.15.90:0/553836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f853015bcb0 0x7f853014be00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8528009bf0 tx=0x7f8528003ba0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.610+0000 7f8537de2640 1 -- 172.21.15.90:0/553836 shutdown_connections 2024-09-10T23:15:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.610+0000 7f8537de2640 1 --2- 172.21.15.90:0/553836 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8514077fa0 0x7f851407a460 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.611+0000 7f8537de2640 1 --2- 172.21.15.90:0/553836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85300cb7e0 0x7f85301f1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.611+0000 7f8537de2640 1 --2- 172.21.15.90:0/553836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f853015bcb0 0x7f853014be00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.611+0000 7f8537de2640 1 --2- 172.21.15.90:0/553836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85300ca420 0x7f853009d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.611+0000 7f8537de2640 1 -- 172.21.15.90:0/553836 >> 172.21.15.90:0/553836 conn(0x7f85300cc850 msgr2=0x7f85300c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:38.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.611+0000 7f8537de2640 1 -- 172.21.15.90:0/553836 shutdown_connections 2024-09-10T23:15:38.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.611+0000 7f8537de2640 1 -- 172.21.15.90:0/553836 wait complete. 2024-09-10T23:15:38.623 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:15:38.623 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:15:38.623 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:15:38.623 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:15:38.623 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:15:38.623 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:15:38.623 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:15:38.624 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:15:38.624 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:15:38.624 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:15:38.624 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:15:38.624 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:15:38.624 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:15:38.624 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:15:38.625 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:15:38.625 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:15:38.633 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:15:38.633 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:15:38.634 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:15:38.634 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:15:38.638 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:15:38.638 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:15:38.639 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:15:38.639 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:15:38.676 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:15:38.676 DEBUG:teuthology.parallel:result is None 2024-09-10T23:15:38.677 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:15:38.677 DEBUG:teuthology.parallel:result is None 2024-09-10T23:15:38.680 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:15:38.680 DEBUG:teuthology.parallel:result is None 2024-09-10T23:15:38.681 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:15:38.681 DEBUG:teuthology.parallel:result is None 2024-09-10T23:15:38.681 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:15:38.750 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-09-10T23:15:38.750 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-09-10T23:15:38.765 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-09-10T23:15:38.766 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-09-10T23:15:38.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.787+0000 7f42d775d640 1 -- 172.21.15.90:0/1949387829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d00d2470 msgr2=0x7f42d00b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:38.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.787+0000 7f42d775d640 1 --2- 172.21.15.90:0/1949387829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d00d2470 0x7f42d00b3490 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009830 tx=0x7f42cc02a510 comp rx=0 tx=0).stop 2024-09-10T23:15:38.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.787+0000 7f42d775d640 1 -- 172.21.15.90:0/1949387829 shutdown_connections 2024-09-10T23:15:38.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.787+0000 7f42d775d640 1 --2- 172.21.15.90:0/1949387829 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42d00d1c70 0x7f42d00d2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.787+0000 7f42d775d640 1 --2- 172.21.15.90:0/1949387829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d00d2470 0x7f42d00b3490 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.787+0000 7f42d775d640 1 -- 172.21.15.90:0/1949387829 >> 172.21.15.90:0/1949387829 conn(0x7f42d009d2a0 msgr2=0x7f42d00d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:38.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.787+0000 7f42d775d640 1 -- 172.21.15.90:0/1949387829 shutdown_connections 2024-09-10T23:15:38.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.787+0000 7f42d775d640 1 -- 172.21.15.90:0/1949387829 wait complete. 2024-09-10T23:15:38.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.788+0000 7f42d775d640 1 Processor -- start 2024-09-10T23:15:38.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.788+0000 7f42d775d640 1 -- start start 2024-09-10T23:15:38.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d775d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42d00d0ab0 0x7f42d00cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:38.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d775d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42d00d1c70 0x7f42d0159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:38.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d775d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d00d2470 0x7f42d01f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:38.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d775d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f42d015e4a0 con 0x7f42d00d2470 2024-09-10T23:15:38.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d775d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f42d015e320 con 0x7f42d00d1c70 2024-09-10T23:15:38.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d775d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f42d00b4a10 con 0x7f42d00d0ab0 2024-09-10T23:15:38.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d5cfa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d00d2470 0x7f42d01f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:38.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d5cfa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d00d2470 0x7f42d01f4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46548/0 (socket says 172.21.15.90:46548) 2024-09-10T23:15:38.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d5cfa640 1 -- 172.21.15.90:0/2321407071 learned_addr learned my addr 172.21.15.90:0/2321407071 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:38.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d54f9640 1 --2- 172.21.15.90:0/2321407071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42d00d0ab0 0x7f42d00cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:38.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d4cf8640 1 --2- 172.21.15.90:0/2321407071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42d00d1c70 0x7f42d0159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:38.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d5cfa640 1 -- 172.21.15.90:0/2321407071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42d00d0ab0 msgr2=0x7f42d00cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:38.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d5cfa640 1 --2- 172.21.15.90:0/2321407071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42d00d0ab0 0x7f42d00cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d5cfa640 1 -- 172.21.15.90:0/2321407071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42d00d1c70 msgr2=0x7f42d0159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:38.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d5cfa640 1 --2- 172.21.15.90:0/2321407071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42d00d1c70 0x7f42d0159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d5cfa640 1 -- 172.21.15.90:0/2321407071 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d00b3560 con 0x7f42d00d2470 2024-09-10T23:15:38.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d5cfa640 1 --2- 172.21.15.90:0/2321407071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d00d2470 0x7f42d01f4f20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f42c800c7a0 tx=0x7f42c800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:38.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42c5ffb640 1 -- 172.21.15.90:0/2321407071 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8003da0 con 0x7f42d00d2470 2024-09-10T23:15:38.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42c5ffb640 1 -- 172.21.15.90:0/2321407071 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42c8005070 con 0x7f42d00d2470 2024-09-10T23:15:38.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42c5ffb640 1 -- 172.21.15.90:0/2321407071 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c80054c0 con 0x7f42d00d2470 2024-09-10T23:15:38.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.789+0000 7f42d775d640 1 -- 172.21.15.90:0/2321407071 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d00b3840 con 0x7f42d00d2470 2024-09-10T23:15:38.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.790+0000 7f42d775d640 1 -- 172.21.15.90:0/2321407071 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d01f4a00 con 0x7f42d00d2470 2024-09-10T23:15:38.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.791+0000 7f42d775d640 1 -- 172.21.15.90:0/2321407071 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d00d1430 con 0x7f42d00d2470 2024-09-10T23:15:38.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.791+0000 7f42c5ffb640 1 -- 172.21.15.90:0/2321407071 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f42c8005660 con 0x7f42d00d2470 2024-09-10T23:15:38.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.792+0000 7f42c5ffb640 1 --2- 172.21.15.90:0/2321407071 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f42b4077f70 0x7f42b407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:38.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.792+0000 7f42c5ffb640 1 -- 172.21.15.90:0/2321407071 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f42c80997f0 con 0x7f42d00d2470 2024-09-10T23:15:38.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.792+0000 7f42d54f9640 1 --2- 172.21.15.90:0/2321407071 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f42b4077f70 0x7f42b407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:38.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.792+0000 7f42d54f9640 1 --2- 172.21.15.90:0/2321407071 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f42b4077f70 0x7f42b407a430 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f42cc034000 tx=0x7f42cc004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:38.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.796+0000 7f42c5ffb640 1 -- 172.21.15.90:0/2321407071 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f42d00d1430 con 0x7f42d00d2470 2024-09-10T23:15:38.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:38.982+0000 7f42d775d640 1 -- 172.21.15.90:0/2321407071 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f42d00d1790 con 0x7f42d00d2470 2024-09-10T23:15:40.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.090+0000 7f42c5ffb640 1 -- 172.21.15.90:0/2321407071 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) ==== 97+0+0 (secure 0 0 0) 0x7f42d00cff60 con 0x7f42d00d2470 2024-09-10T23:15:40.092 INFO:teuthology.orchestra.run.smithi090.stderr: removed all blocklist entries 2024-09-10T23:15:40.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.094+0000 7f42d775d640 1 -- 172.21.15.90:0/2321407071 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f42b4077f70 msgr2=0x7f42b407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.094+0000 7f42d775d640 1 --2- 172.21.15.90:0/2321407071 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f42b4077f70 0x7f42b407a430 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f42cc034000 tx=0x7f42cc004730 comp rx=0 tx=0).stop 2024-09-10T23:15:40.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.094+0000 7f42d775d640 1 -- 172.21.15.90:0/2321407071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d00d2470 msgr2=0x7f42d01f4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.094+0000 7f42d775d640 1 --2- 172.21.15.90:0/2321407071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d00d2470 0x7f42d01f4f20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f42c800c7a0 tx=0x7f42c800cc60 comp rx=0 tx=0).stop 2024-09-10T23:15:40.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.094+0000 7f42d775d640 1 -- 172.21.15.90:0/2321407071 shutdown_connections 2024-09-10T23:15:40.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.094+0000 7f42d775d640 1 --2- 172.21.15.90:0/2321407071 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f42b4077f70 0x7f42b407a430 secure :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f42cc034000 tx=0x7f42cc004730 comp rx=0 tx=0).stop 2024-09-10T23:15:40.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.094+0000 7f42d775d640 1 --2- 172.21.15.90:0/2321407071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42d00d1c70 0x7f42d0159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.094+0000 7f42d775d640 1 --2- 172.21.15.90:0/2321407071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42d00d2470 0x7f42d01f4f20 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.094+0000 7f42d775d640 1 --2- 172.21.15.90:0/2321407071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42d00d0ab0 0x7f42d00cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.094+0000 7f42d775d640 1 -- 172.21.15.90:0/2321407071 >> 172.21.15.90:0/2321407071 conn(0x7f42d009d2a0 msgr2=0x7f42d006ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:40.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.094+0000 7f42d775d640 1 -- 172.21.15.90:0/2321407071 shutdown_connections 2024-09-10T23:15:40.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.094+0000 7f42d775d640 1 -- 172.21.15.90:0/2321407071 wait complete. 2024-09-10T23:15:40.108 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:15:40.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.215+0000 7ffa65bd3640 1 -- 172.21.15.90:0/911195263 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa600d1c70 msgr2=0x7ffa600d2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.215+0000 7ffa65bd3640 1 --2- 172.21.15.90:0/911195263 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa600d1c70 0x7ffa600d2850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa54005fd0 tx=0x7ffa5402a5d0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.215+0000 7ffa65bd3640 1 -- 172.21.15.90:0/911195263 shutdown_connections 2024-09-10T23:15:40.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.215+0000 7ffa65bd3640 1 --2- 172.21.15.90:0/911195263 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa600d1c70 0x7ffa600d2850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.215+0000 7ffa65bd3640 1 --2- 172.21.15.90:0/911195263 >> v2:172.21.15.171:3300/0 conn(0x7ffa600d2470 0x7ffa600b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.215+0000 7ffa65bd3640 1 -- 172.21.15.90:0/911195263 >> 172.21.15.90:0/911195263 conn(0x7ffa6009d2a0 msgr2=0x7ffa600d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:40.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.215+0000 7ffa65bd3640 1 -- 172.21.15.90:0/911195263 shutdown_connections 2024-09-10T23:15:40.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.215+0000 7ffa65bd3640 1 -- 172.21.15.90:0/911195263 wait complete. 2024-09-10T23:15:40.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.216+0000 7ffa65bd3640 1 Processor -- start 2024-09-10T23:15:40.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.216+0000 7ffa65bd3640 1 -- start start 2024-09-10T23:15:40.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.217+0000 7ffa65bd3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa600d0ab0 0x7ffa6015cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:40.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.217+0000 7ffa65bd3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa600d1c70 0x7ffa600b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:40.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.217+0000 7ffa65bd3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa600d2470 0x7ffa600c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:40.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.217+0000 7ffa65bd3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6015e4a0 con 0x7ffa600d1c70 2024-09-10T23:15:40.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.217+0000 7ffa65bd3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6015e320 con 0x7ffa600d0ab0 2024-09-10T23:15:40.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.217+0000 7ffa65bd3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffa600b4a10 con 0x7ffa600d2470 2024-09-10T23:15:40.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.217+0000 7ffa5effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa600d1c70 0x7ffa600b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:40.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.217+0000 7ffa5effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa600d1c70 0x7ffa600b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46554/0 (socket says 172.21.15.90:46554) 2024-09-10T23:15:40.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.217+0000 7ffa5effd640 1 -- 172.21.15.90:0/3657655422 learned_addr learned my addr 172.21.15.90:0/3657655422 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:40.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.217+0000 7ffa5f7fe640 1 --2- 172.21.15.90:0/3657655422 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa600d0ab0 0x7ffa6015cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:40.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.217+0000 7ffa5ffff640 1 --2- 172.21.15.90:0/3657655422 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa600d2470 0x7ffa600c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:40.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.217+0000 7ffa5effd640 1 -- 172.21.15.90:0/3657655422 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa600d2470 msgr2=0x7ffa600c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.218+0000 7ffa5effd640 1 --2- 172.21.15.90:0/3657655422 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa600d2470 0x7ffa600c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.218+0000 7ffa5effd640 1 -- 172.21.15.90:0/3657655422 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa600d0ab0 msgr2=0x7ffa6015cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.218+0000 7ffa5effd640 1 --2- 172.21.15.90:0/3657655422 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa600d0ab0 0x7ffa6015cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.218+0000 7ffa5effd640 1 -- 172.21.15.90:0/3657655422 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa601611c0 con 0x7ffa600d1c70 2024-09-10T23:15:40.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.218+0000 7ffa5effd640 1 --2- 172.21.15.90:0/3657655422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa600d1c70 0x7ffa600b3630 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ffa54009850 tx=0x7ffa540035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:40.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.218+0000 7ffa47fff640 1 -- 172.21.15.90:0/3657655422 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5403f070 con 0x7ffa600d1c70 2024-09-10T23:15:40.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.218+0000 7ffa47fff640 1 -- 172.21.15.90:0/3657655422 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa54003ce0 con 0x7ffa600d1c70 2024-09-10T23:15:40.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.218+0000 7ffa65bd3640 1 -- 172.21.15.90:0/3657655422 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa600ca000 con 0x7ffa600d1c70 2024-09-10T23:15:40.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.218+0000 7ffa47fff640 1 -- 172.21.15.90:0/3657655422 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54035030 con 0x7ffa600d1c70 2024-09-10T23:15:40.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.218+0000 7ffa65bd3640 1 -- 172.21.15.90:0/3657655422 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa600ca5c0 con 0x7ffa600d1c70 2024-09-10T23:15:40.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.219+0000 7ffa65bd3640 1 -- 172.21.15.90:0/3657655422 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa600d37d0 con 0x7ffa600d1c70 2024-09-10T23:15:40.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.220+0000 7ffa47fff640 1 -- 172.21.15.90:0/3657655422 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ffa54004a00 con 0x7ffa600d1c70 2024-09-10T23:15:40.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.220+0000 7ffa47fff640 1 --2- 172.21.15.90:0/3657655422 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa4c077f70 0x7ffa4c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:40.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.220+0000 7ffa47fff640 1 -- 172.21.15.90:0/3657655422 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7ffa540ba770 con 0x7ffa600d1c70 2024-09-10T23:15:40.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.220+0000 7ffa5f7fe640 1 --2- 172.21.15.90:0/3657655422 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa4c077f70 0x7ffa4c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:40.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.221+0000 7ffa5f7fe640 1 --2- 172.21.15.90:0/3657655422 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa4c077f70 0x7ffa4c07a430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffa500095f0 tx=0x7ffa50005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:40.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.224+0000 7ffa47fff640 1 -- 172.21.15.90:0/3657655422 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ffa600d37d0 con 0x7ffa600d1c70 2024-09-10T23:15:40.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.462+0000 7ffa65bd3640 1 -- 172.21.15.90:0/3657655422 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ffa600d4f50 con 0x7ffa600d1c70 2024-09-10T23:15:40.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.462+0000 7ffa47fff640 1 -- 172.21.15.90:0/3657655422 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) ==== 80+0+5304 (secure 0 0 0) 0x7ffa600d4f50 con 0x7ffa600d1c70 2024-09-10T23:15:40.464 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:40.464 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:15:40.464 INFO:teuthology.orchestra.run.smithi090.stdout: "auth_dump": [ 2024-09-10T23:15:40.464 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.464 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.a", 2024-09-10T23:15:40.464 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBm/QY6KxAAKT1mZg/6ZcszcNrPmouZfw==", 2024-09-10T23:15:40.464 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.464 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:15:40.464 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:15:40.464 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:15:40.464 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:40.464 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.465 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.465 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.465 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.b", 2024-09-10T23:15:40.465 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmSqPhNhAA3flpsOGFszFMeaPUoHAtJg==", 2024-09-10T23:15:40.465 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.465 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:15:40.465 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:15:40.465 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:15:40.465 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:40.465 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.465 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.465 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.465 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.c", 2024-09-10T23:15:40.466 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmDVE4MhAAHal/PtI10hL4nKdTUO5BiQ==", 2024-09-10T23:15:40.466 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.466 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:15:40.466 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:15:40.466 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:15:40.466 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:40.466 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.466 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.466 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.466 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.d", 2024-09-10T23:15:40.466 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmr3lfAhAAFdZ7zvJmGNFHRwCr+mdY7w==", 2024-09-10T23:15:40.466 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.466 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:15:40.466 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:15:40.467 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:15:40.467 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:40.467 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.467 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.467 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.467 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.0", 2024-09-10T23:15:40.467 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCa0uBmZKxTJRAAfEBB/vykopmDbmREyy227g==", 2024-09-10T23:15:40.467 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.467 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:15:40.467 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:15:40.468 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:40.468 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.468 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.1", 2024-09-10T23:15:40.468 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCd0uBmJHG8NRAAS8QD8Zgrxrxddq7kN4P9Ag==", 2024-09-10T23:15:40.468 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.468 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:15:40.468 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:15:40.468 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:40.468 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.468 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.2", 2024-09-10T23:15:40.469 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCh0uBmtUUmDBAAmYRv9P/wjX8HLVkLatoXuQ==", 2024-09-10T23:15:40.469 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.469 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:15:40.469 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:15:40.469 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:40.469 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.469 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.469 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.469 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.3", 2024-09-10T23:15:40.469 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCk0uBm4397HBAAGZK0ktD0ORY/0CPlMprYFg==", 2024-09-10T23:15:40.469 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.469 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:15:40.469 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:15:40.469 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:40.470 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.470 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.470 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.470 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.4", 2024-09-10T23:15:40.470 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCq0uBmBaMINBAAkuhNrc4YFAYQfcxMQenCBQ==", 2024-09-10T23:15:40.470 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.470 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:15:40.470 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:15:40.470 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:40.470 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.471 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.5", 2024-09-10T23:15:40.471 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCu0uBmLOrnCBAAwZTy+62ZN3g5jfH20jB4qw==", 2024-09-10T23:15:40.471 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.471 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:15:40.471 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:15:40.471 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:40.471 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.472 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.472 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.6", 2024-09-10T23:15:40.472 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCx0uBmr4bYChAAdWog9uHnYgiiXniefs25DA==", 2024-09-10T23:15:40.472 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.472 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:15:40.472 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:15:40.472 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:40.472 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.472 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.472 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.472 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.7", 2024-09-10T23:15:40.472 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQC00uBmhU7+DBAAEagAuXuCs1v/vDhIkapi+g==", 2024-09-10T23:15:40.472 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.472 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:15:40.473 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:15:40.473 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:40.473 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.473 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.473 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.473 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.0", 2024-09-10T23:15:40.473 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmiYBwBhAABMV9erpQ+KZlTmf0kDZ0gw==", 2024-09-10T23:15:40.473 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.473 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:15:40.473 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow r", 2024-09-10T23:15:40.474 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:15:40.474 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.474 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.474 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.474 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.1", 2024-09-10T23:15:40.474 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBm+TBDDxAA4o+iZ4PwpBRpY++ATzt+wg==", 2024-09-10T23:15:40.474 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.474 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:15:40.474 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:15:40.474 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:15:40.474 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:15:40.474 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.474 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.475 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.475 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.2", 2024-09-10T23:15:40.475 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmJYcKDBAArXISnuT+R9uzuQnL3V+wSg==", 2024-09-10T23:15:40.475 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.475 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:15:40.475 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:15:40.475 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:15:40.475 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:15:40.475 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.475 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.475 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.475 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.3", 2024-09-10T23:15:40.475 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmPQvkFBAAaCikPByOvk5xUzTWXdcFPA==", 2024-09-10T23:15:40.475 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.476 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:15:40.476 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:15:40.476 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:15:40.476 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:15:40.476 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.476 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.476 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.admin", 2024-09-10T23:15:40.476 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmVVIQEBAAY7yzFxxQCyV1YCM3xYC7Og==", 2024-09-10T23:15:40.476 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.476 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:15:40.476 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:15:40.476 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:15:40.477 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:40.477 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.477 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.477 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.477 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.x", 2024-09-10T23:15:40.477 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBm4r0EKBAAIZ4VjoTsUpdB6KFbi7EQLQ==", 2024-09-10T23:15:40.477 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.477 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:15:40.477 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2024-09-10T23:15:40.477 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:40.477 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.477 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:15:40.477 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.477 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.y", 2024-09-10T23:15:40.478 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmkRSfJBAAWPpV5e4zeX0Es78Xqh9pYw==", 2024-09-10T23:15:40.478 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:15:40.478 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:15:40.478 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2024-09-10T23:15:40.478 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:15:40.478 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.478 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.478 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-10T23:15:40.478 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:15:40.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.465+0000 7ffa65bd3640 1 -- 172.21.15.90:0/3657655422 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa4c077f70 msgr2=0x7ffa4c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.465+0000 7ffa65bd3640 1 --2- 172.21.15.90:0/3657655422 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa4c077f70 0x7ffa4c07a430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffa500095f0 tx=0x7ffa50005f90 comp rx=0 tx=0).stop 2024-09-10T23:15:40.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.465+0000 7ffa65bd3640 1 -- 172.21.15.90:0/3657655422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa600d1c70 msgr2=0x7ffa600b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.465+0000 7ffa65bd3640 1 --2- 172.21.15.90:0/3657655422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa600d1c70 0x7ffa600b3630 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ffa54009850 tx=0x7ffa540035f0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.465+0000 7ffa65bd3640 1 -- 172.21.15.90:0/3657655422 shutdown_connections 2024-09-10T23:15:40.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.465+0000 7ffa65bd3640 1 --2- 172.21.15.90:0/3657655422 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa4c077f70 0x7ffa4c07a430 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.465+0000 7ffa65bd3640 1 --2- 172.21.15.90:0/3657655422 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa600d2470 0x7ffa600c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.465+0000 7ffa65bd3640 1 --2- 172.21.15.90:0/3657655422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa600d1c70 0x7ffa600b3630 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.465+0000 7ffa65bd3640 1 --2- 172.21.15.90:0/3657655422 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa600d0ab0 0x7ffa6015cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.465+0000 7ffa65bd3640 1 -- 172.21.15.90:0/3657655422 >> 172.21.15.90:0/3657655422 conn(0x7ffa6009d2a0 msgr2=0x7ffa600cc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:40.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.465+0000 7ffa65bd3640 1 -- 172.21.15.90:0/3657655422 shutdown_connections 2024-09-10T23:15:40.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.465+0000 7ffa65bd3640 1 -- 172.21.15.90:0/3657655422 wait complete. 2024-09-10T23:15:40.481 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:15:40.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.582+0000 7f693ffff640 1 -- 172.21.15.90:0/407840234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f692c004d90 msgr2=0x7f692c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.582+0000 7f693ffff640 1 --2- 172.21.15.90:0/407840234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f692c004d90 0x7f692c005210 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f693800baf0 tx=0x7f692c005830 comp rx=0 tx=0).stop 2024-09-10T23:15:40.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.582+0000 7f693f7fe640 1 -- 172.21.15.90:0/407840234 reap_dead start 2024-09-10T23:15:40.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.582+0000 7f693ffff640 1 -- 172.21.15.90:0/407840234 shutdown_connections 2024-09-10T23:15:40.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.582+0000 7f693ffff640 1 -- 172.21.15.90:0/407840234 >> 172.21.15.90:0/407840234 conn(0x7f69400d1be0 msgr2=0x7f69400d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:40.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.582+0000 7f693ffff640 1 -- 172.21.15.90:0/407840234 shutdown_connections 2024-09-10T23:15:40.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.582+0000 7f693ffff640 1 -- 172.21.15.90:0/407840234 wait complete. 2024-09-10T23:15:40.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.584+0000 7f693ffff640 1 Processor -- start 2024-09-10T23:15:40.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.584+0000 7f693ffff640 1 -- start start 2024-09-10T23:15:40.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.584+0000 7f693ffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f692c004d90 0x7f694006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:40.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.584+0000 7f693ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f694006dc40 0x7f69401f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.584+0000 7f693ffff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69400cb610 0x7f69400b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.584+0000 7f693ffff640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f69400b3370 con 0x7f694006dc40 2024-09-10T23:15:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.584+0000 7f693ffff640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f69400b31f0 con 0x7f692c004d90 2024-09-10T23:15:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.584+0000 7f693ffff640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f69400b0510 con 0x7f69400cb610 2024-09-10T23:15:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.585+0000 7f693e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f694006dc40 0x7f69401f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.585+0000 7f693e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f694006dc40 0x7f69401f8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46570/0 (socket says 172.21.15.90:46570) 2024-09-10T23:15:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.585+0000 7f693e7fc640 1 -- 172.21.15.90:0/1797858782 learned_addr learned my addr 172.21.15.90:0/1797858782 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.585+0000 7f693effd640 1 --2- 172.21.15.90:0/1797858782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f692c004d90 0x7f694006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.585+0000 7f693f7fe640 1 --2- 172.21.15.90:0/1797858782 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69400cb610 0x7f69400b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.585+0000 7f693e7fc640 1 -- 172.21.15.90:0/1797858782 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69400cb610 msgr2=0x7f69400b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.585+0000 7f693e7fc640 1 --2- 172.21.15.90:0/1797858782 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69400cb610 0x7f69400b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.585+0000 7f693e7fc640 1 -- 172.21.15.90:0/1797858782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f692c004d90 msgr2=0x7f694006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.585+0000 7f693e7fc640 1 --2- 172.21.15.90:0/1797858782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f692c004d90 0x7f694006f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.585+0000 7f693e7fc640 1 -- 172.21.15.90:0/1797858782 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69401f9180 con 0x7f694006dc40 2024-09-10T23:15:40.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.585+0000 7f693e7fc640 1 --2- 172.21.15.90:0/1797858782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f694006dc40 0x7f69401f8c40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f692800e620 tx=0x7f692800eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:40.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.585+0000 7f69377fe640 1 -- 172.21.15.90:0/1797858782 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928015020 con 0x7f694006dc40 2024-09-10T23:15:40.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.585+0000 7f69377fe640 1 -- 172.21.15.90:0/1797858782 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69280035f0 con 0x7f694006dc40 2024-09-10T23:15:40.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.585+0000 7f69377fe640 1 -- 172.21.15.90:0/1797858782 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928003a40 con 0x7f694006dc40 2024-09-10T23:15:40.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.585+0000 7f693ffff640 1 -- 172.21.15.90:0/1797858782 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f694006e120 con 0x7f694006dc40 2024-09-10T23:15:40.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.585+0000 7f693ffff640 1 -- 172.21.15.90:0/1797858782 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f694006e6e0 con 0x7f694006dc40 2024-09-10T23:15:40.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.586+0000 7f693ffff640 1 -- 172.21.15.90:0/1797858782 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69400b09e0 con 0x7f694006dc40 2024-09-10T23:15:40.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.587+0000 7f69377fe640 1 -- 172.21.15.90:0/1797858782 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6928003be0 con 0x7f694006dc40 2024-09-10T23:15:40.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.587+0000 7f69377fe640 1 --2- 172.21.15.90:0/1797858782 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6920077fa0 0x7f692007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:40.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.587+0000 7f69377fe640 1 -- 172.21.15.90:0/1797858782 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f6928099fe0 con 0x7f694006dc40 2024-09-10T23:15:40.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.588+0000 7f693effd640 1 --2- 172.21.15.90:0/1797858782 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6920077fa0 0x7f692007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:40.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.588+0000 7f693effd640 1 --2- 172.21.15.90:0/1797858782 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6920077fa0 0x7f692007a460 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6930000f80 tx=0x7f6930006ef0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:40.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.591+0000 7f69377fe640 1 -- 172.21.15.90:0/1797858782 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f692801f030 con 0x7f694006dc40 2024-09-10T23:15:40.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.768+0000 7f693ffff640 1 -- 172.21.15.90:0/1797858782 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6940069660 con 0x7f694006dc40 2024-09-10T23:15:40.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.768+0000 7f69377fe640 1 -- 172.21.15.90:0/1797858782 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v42) ==== 84+0+65 (secure 0 0 0) 0x7f69280627e0 con 0x7f694006dc40 2024-09-10T23:15:40.769 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:40.769 INFO:teuthology.orchestra.run.smithi090.stdout:[ 2024-09-10T23:15:40.769 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:15:40.769 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 1, 2024-09-10T23:15:40.770 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": ".mgr" 2024-09-10T23:15:40.770 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:15:40.770 INFO:teuthology.orchestra.run.smithi090.stdout:] 2024-09-10T23:15:40.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.770+0000 7f693ffff640 1 -- 172.21.15.90:0/1797858782 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6920077fa0 msgr2=0x7f692007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.770+0000 7f693ffff640 1 --2- 172.21.15.90:0/1797858782 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6920077fa0 0x7f692007a460 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6930000f80 tx=0x7f6930006ef0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.770+0000 7f693ffff640 1 -- 172.21.15.90:0/1797858782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f694006dc40 msgr2=0x7f69401f8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.770+0000 7f693ffff640 1 --2- 172.21.15.90:0/1797858782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f694006dc40 0x7f69401f8c40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f692800e620 tx=0x7f692800eae0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.770+0000 7f693ffff640 1 -- 172.21.15.90:0/1797858782 shutdown_connections 2024-09-10T23:15:40.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.770+0000 7f693ffff640 1 --2- 172.21.15.90:0/1797858782 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6920077fa0 0x7f692007a460 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.770+0000 7f693ffff640 1 --2- 172.21.15.90:0/1797858782 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69400cb610 0x7f69400b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.770+0000 7f693ffff640 1 --2- 172.21.15.90:0/1797858782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f694006dc40 0x7f69401f8c40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.770+0000 7f693ffff640 1 --2- 172.21.15.90:0/1797858782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f692c004d90 0x7f694006f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.770+0000 7f693ffff640 1 -- 172.21.15.90:0/1797858782 >> 172.21.15.90:0/1797858782 conn(0x7f69400d1be0 msgr2=0x7f69400cc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:40.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.770+0000 7f693ffff640 1 -- 172.21.15.90:0/1797858782 shutdown_connections 2024-09-10T23:15:40.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.770+0000 7f693ffff640 1 -- 172.21.15.90:0/1797858782 wait complete. 2024-09-10T23:15:40.782 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:15:40.782 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:15:40.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.886+0000 7fc77d1ec640 1 -- 172.21.15.90:0/294964837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc764004800 msgr2=0x7fc764004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.886+0000 7fc77d1ec640 1 --2- 172.21.15.90:0/294964837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc764004800 0x7fc764004c80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc760009b50 tx=0x7fc764005830 comp rx=0 tx=0).stop 2024-09-10T23:15:40.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.887+0000 7fc77759e640 1 -- 172.21.15.90:0/294964837 reap_dead start 2024-09-10T23:15:40.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.887+0000 7fc77d1ec640 1 -- 172.21.15.90:0/294964837 shutdown_connections 2024-09-10T23:15:40.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.887+0000 7fc77d1ec640 1 -- 172.21.15.90:0/294964837 >> 172.21.15.90:0/294964837 conn(0x7fc7780d1d40 msgr2=0x7fc7780d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:40.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.887+0000 7fc77d1ec640 1 -- 172.21.15.90:0/294964837 shutdown_connections 2024-09-10T23:15:40.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.887+0000 7fc77d1ec640 1 -- 172.21.15.90:0/294964837 wait complete. 2024-09-10T23:15:40.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.888+0000 7fc77d1ec640 1 Processor -- start 2024-09-10T23:15:40.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.888+0000 7fc77d1ec640 1 -- start start 2024-09-10T23:15:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc77d1ec640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc764004800 0x7fc7781591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc77d1ec640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7780b5580 0x7fc7780b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc77d1ec640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7780cab80 0x7fc7780cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc77d1ec640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc7780d08e0 con 0x7fc7780cab80 2024-09-10T23:15:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc77d1ec640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc7780d0760 con 0x7fc7780b5580 2024-09-10T23:15:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc77d1ec640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc7780d0a60 con 0x7fc764004800 2024-09-10T23:15:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc77759e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7780cab80 0x7fc7780cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc77759e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7780cab80 0x7fc7780cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46580/0 (socket says 172.21.15.90:46580) 2024-09-10T23:15:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc77759e640 1 -- 172.21.15.90:0/2403283203 learned_addr learned my addr 172.21.15.90:0/2403283203 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc77659c640 1 --2- 172.21.15.90:0/2403283203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7780b5580 0x7fc7780b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc776d9d640 1 --2- 172.21.15.90:0/2403283203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc764004800 0x7fc7781591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc77759e640 1 -- 172.21.15.90:0/2403283203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc764004800 msgr2=0x7fc7781591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc77759e640 1 --2- 172.21.15.90:0/2403283203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc764004800 0x7fc7781591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc77759e640 1 -- 172.21.15.90:0/2403283203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7780b5580 msgr2=0x7fc7780b74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc77759e640 1 --2- 172.21.15.90:0/2403283203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7780b5580 0x7fc7780b74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc77759e640 1 -- 172.21.15.90:0/2403283203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc778159700 con 0x7fc7780cab80 2024-09-10T23:15:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc77659c640 1 --2- 172.21.15.90:0/2403283203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7780b5580 0x7fc7780b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.889+0000 7fc77759e640 1 --2- 172.21.15.90:0/2403283203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7780cab80 0x7fc7780cb010 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc778073850 tx=0x7fc77000e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.890+0000 7fc76f7fe640 1 -- 172.21.15.90:0/2403283203 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc770011870 con 0x7fc7780cab80 2024-09-10T23:15:40.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.890+0000 7fc76f7fe640 1 -- 172.21.15.90:0/2403283203 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc770017070 con 0x7fc7780cab80 2024-09-10T23:15:40.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.890+0000 7fc77d1ec640 1 -- 172.21.15.90:0/2403283203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7780b5a40 con 0x7fc7780cab80 2024-09-10T23:15:40.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.890+0000 7fc76f7fe640 1 -- 172.21.15.90:0/2403283203 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc770011da0 con 0x7fc7780cab80 2024-09-10T23:15:40.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.890+0000 7fc77d1ec640 1 -- 172.21.15.90:0/2403283203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7780b6000 con 0x7fc7780cab80 2024-09-10T23:15:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.891+0000 7fc77d1ec640 1 -- 172.21.15.90:0/2403283203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7780d2860 con 0x7fc7780cab80 2024-09-10T23:15:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.891+0000 7fc76f7fe640 1 -- 172.21.15.90:0/2403283203 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc77001c460 con 0x7fc7780cab80 2024-09-10T23:15:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.892+0000 7fc76f7fe640 1 --2- 172.21.15.90:0/2403283203 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc758077f70 0x7fc75807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.892+0000 7fc76f7fe640 1 -- 172.21.15.90:0/2403283203 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7fc770099d60 con 0x7fc7780cab80 2024-09-10T23:15:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.892+0000 7fc776d9d640 1 --2- 172.21.15.90:0/2403283203 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc758077f70 0x7fc75807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.893+0000 7fc776d9d640 1 --2- 172.21.15.90:0/2403283203 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc758077f70 0x7fc75807a430 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc768005fd0 tx=0x7fc768009500 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:40.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:40.896+0000 7fc76f7fe640 1 -- 172.21.15.90:0/2403283203 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc770062bb0 con 0x7fc7780cab80 2024-09-10T23:15:41.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.070+0000 7fc77d1ec640 1 -- 172.21.15.90:0/2403283203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc7780ce530 con 0x7fc7780cab80 2024-09-10T23:15:41.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.484+0000 7fc76f7fe640 1 -- 172.21.15.90:0/2403283203 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v43) ==== 138+0+0 (secure 0 0 0) 0x7fc77006b2d0 con 0x7fc7780cab80 2024-09-10T23:15:41.485 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' created 2024-09-10T23:15:41.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.486+0000 7fc77d1ec640 1 -- 172.21.15.90:0/2403283203 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc758077f70 msgr2=0x7fc75807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:41.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.486+0000 7fc77d1ec640 1 --2- 172.21.15.90:0/2403283203 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc758077f70 0x7fc75807a430 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc768005fd0 tx=0x7fc768009500 comp rx=0 tx=0).stop 2024-09-10T23:15:41.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.486+0000 7fc77d1ec640 1 -- 172.21.15.90:0/2403283203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7780cab80 msgr2=0x7fc7780cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:41.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.486+0000 7fc77d1ec640 1 --2- 172.21.15.90:0/2403283203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7780cab80 0x7fc7780cb010 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc778073850 tx=0x7fc77000e9a0 comp rx=0 tx=0).stop 2024-09-10T23:15:41.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.487+0000 7fc77d1ec640 1 -- 172.21.15.90:0/2403283203 shutdown_connections 2024-09-10T23:15:41.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.487+0000 7fc77d1ec640 1 --2- 172.21.15.90:0/2403283203 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc758077f70 0x7fc75807a430 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:41.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.487+0000 7fc77d1ec640 1 --2- 172.21.15.90:0/2403283203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7780b5580 0x7fc7780b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:41.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.487+0000 7fc77d1ec640 1 --2- 172.21.15.90:0/2403283203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7780cab80 0x7fc7780cb010 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:41.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.487+0000 7fc77d1ec640 1 --2- 172.21.15.90:0/2403283203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc764004800 0x7fc7781591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:41.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.487+0000 7fc77d1ec640 1 -- 172.21.15.90:0/2403283203 >> 172.21.15.90:0/2403283203 conn(0x7fc7780d1d40 msgr2=0x7fc7780cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:41.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.487+0000 7fc77d1ec640 1 -- 172.21.15.90:0/2403283203 shutdown_connections 2024-09-10T23:15:41.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.487+0000 7fc77d1ec640 1 -- 172.21.15.90:0/2403283203 wait complete. 2024-09-10T23:15:41.503 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:15:41.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.611+0000 7f217e008640 1 -- 172.21.15.90:0/947402880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2178161480 msgr2=0x7f217806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:41.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.611+0000 7f217e008640 1 --2- 172.21.15.90:0/947402880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2178161480 0x7f217806d6b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2168005fd0 tx=0x7f216802ab20 comp rx=0 tx=0).stop 2024-09-10T23:15:41.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.611+0000 7f217e008640 1 -- 172.21.15.90:0/947402880 shutdown_connections 2024-09-10T23:15:41.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.611+0000 7f217e008640 1 --2- 172.21.15.90:0/947402880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21780b0e40 0x7f21780b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:41.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.611+0000 7f217e008640 1 --2- 172.21.15.90:0/947402880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2178161480 0x7f217806d6b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:41.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.611+0000 7f217e008640 1 -- 172.21.15.90:0/947402880 >> 172.21.15.90:0/947402880 conn(0x7f217809d4e0 msgr2=0x7f21780d41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:41.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.611+0000 7f217e008640 1 -- 172.21.15.90:0/947402880 shutdown_connections 2024-09-10T23:15:41.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.611+0000 7f217e008640 1 -- 172.21.15.90:0/947402880 wait complete. 2024-09-10T23:15:41.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.612+0000 7f217e008640 1 Processor -- start 2024-09-10T23:15:41.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.613+0000 7f217e008640 1 -- start start 2024-09-10T23:15:41.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.613+0000 7f217e008640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21780b0e40 0x7f21780b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:41.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.613+0000 7f217e008640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21780d2b00 0x7f21780cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:41.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.613+0000 7f217e008640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2178161480 0x7f21780cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:41.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.613+0000 7f217e008640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f21781619f0 con 0x7f21780d2b00 2024-09-10T23:15:41.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.613+0000 7f217e008640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f217806e510 con 0x7f2178161480 2024-09-10T23:15:41.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.613+0000 7f217e008640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f21780b1830 con 0x7f21780b0e40 2024-09-10T23:15:41.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.613+0000 7f2176ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21780d2b00 0x7f21780cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:41.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.614+0000 7f2176ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21780d2b00 0x7f21780cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46610/0 (socket says 172.21.15.90:46610) 2024-09-10T23:15:41.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.614+0000 7f2176ffd640 1 -- 172.21.15.90:0/3463624396 learned_addr learned my addr 172.21.15.90:0/3463624396 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:41.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.614+0000 7f21777fe640 1 --2- 172.21.15.90:0/3463624396 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21780b0e40 0x7f21780b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:41.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.614+0000 7f2177fff640 1 --2- 172.21.15.90:0/3463624396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2178161480 0x7f21780cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:41.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.614+0000 7f2176ffd640 1 -- 172.21.15.90:0/3463624396 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21780b0e40 msgr2=0x7f21780b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:41.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.614+0000 7f2176ffd640 1 --2- 172.21.15.90:0/3463624396 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21780b0e40 0x7f21780b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:41.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.614+0000 7f2176ffd640 1 -- 172.21.15.90:0/3463624396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2178161480 msgr2=0x7f21780cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:41.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.614+0000 7f2176ffd640 1 --2- 172.21.15.90:0/3463624396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2178161480 0x7f21780cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:41.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.614+0000 7f2176ffd640 1 -- 172.21.15.90:0/3463624396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21780b6070 con 0x7f21780d2b00 2024-09-10T23:15:41.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.614+0000 7f2176ffd640 1 --2- 172.21.15.90:0/3463624396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21780d2b00 0x7f21780cc7c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c530 tx=0x7f216c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:41.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.614+0000 7f215ffff640 1 -- 172.21.15.90:0/3463624396 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c0052d0 con 0x7f21780d2b00 2024-09-10T23:15:41.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.614+0000 7f215ffff640 1 -- 172.21.15.90:0/3463624396 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f216c005470 con 0x7f21780d2b00 2024-09-10T23:15:41.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.614+0000 7f217e008640 1 -- 172.21.15.90:0/3463624396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21780b4830 con 0x7f21780d2b00 2024-09-10T23:15:41.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.614+0000 7f215ffff640 1 -- 172.21.15.90:0/3463624396 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c012870 con 0x7f21780d2b00 2024-09-10T23:15:41.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.614+0000 7f217e008640 1 -- 172.21.15.90:0/3463624396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21780b5330 con 0x7f21780d2b00 2024-09-10T23:15:41.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.615+0000 7f217e008640 1 -- 172.21.15.90:0/3463624396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21780b12f0 con 0x7f21780d2b00 2024-09-10T23:15:41.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.616+0000 7f215ffff640 1 -- 172.21.15.90:0/3463624396 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f216c0035f0 con 0x7f21780d2b00 2024-09-10T23:15:41.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.616+0000 7f215ffff640 1 --2- 172.21.15.90:0/3463624396 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2164077f70 0x7f216407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:41.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.616+0000 7f215ffff640 1 -- 172.21.15.90:0/3463624396 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5227+0+0 (secure 0 0 0) 0x7f216c0995c0 con 0x7f21780d2b00 2024-09-10T23:15:41.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.617+0000 7f21777fe640 1 --2- 172.21.15.90:0/3463624396 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2164077f70 0x7f216407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:41.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.617+0000 7f21777fe640 1 --2- 172.21.15.90:0/3463624396 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2164077f70 0x7f216407a430 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2168035000 tx=0x7f2168038040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:41.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.621+0000 7f215ffff640 1 -- 172.21.15.90:0/3463624396 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f216c061c50 con 0x7f21780d2b00 2024-09-10T23:15:41.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:41.796+0000 7f217e008640 1 -- 172.21.15.90:0/3463624396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f21780cf360 con 0x7f21780d2b00 2024-09-10T23:15:42.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.487+0000 7f215ffff640 1 -- 172.21.15.90:0/3463624396 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v44) ==== 170+0+0 (secure 0 0 0) 0x7f216c066680 con 0x7f21780d2b00 2024-09-10T23:15:42.488 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' created 2024-09-10T23:15:42.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.490+0000 7f217e008640 1 -- 172.21.15.90:0/3463624396 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2164077f70 msgr2=0x7f216407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.490+0000 7f217e008640 1 --2- 172.21.15.90:0/3463624396 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2164077f70 0x7f216407a430 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2168035000 tx=0x7f2168038040 comp rx=0 tx=0).stop 2024-09-10T23:15:42.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.490+0000 7f217e008640 1 -- 172.21.15.90:0/3463624396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21780d2b00 msgr2=0x7f21780cc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.490+0000 7f217e008640 1 --2- 172.21.15.90:0/3463624396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21780d2b00 0x7f21780cc7c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c530 tx=0x7f216c00c9f0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.490+0000 7f217e008640 1 -- 172.21.15.90:0/3463624396 shutdown_connections 2024-09-10T23:15:42.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.490+0000 7f217e008640 1 --2- 172.21.15.90:0/3463624396 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2164077f70 0x7f216407a430 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.490+0000 7f217e008640 1 --2- 172.21.15.90:0/3463624396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2178161480 0x7f21780cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.490+0000 7f217e008640 1 --2- 172.21.15.90:0/3463624396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21780d2b00 0x7f21780cc7c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.490+0000 7f217e008640 1 --2- 172.21.15.90:0/3463624396 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21780b0e40 0x7f21780b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.490+0000 7f217e008640 1 -- 172.21.15.90:0/3463624396 >> 172.21.15.90:0/3463624396 conn(0x7f217809d4e0 msgr2=0x7f21780d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:42.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.490+0000 7f217e008640 1 -- 172.21.15.90:0/3463624396 shutdown_connections 2024-09-10T23:15:42.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.490+0000 7f217e008640 1 -- 172.21.15.90:0/3463624396 wait complete. 2024-09-10T23:15:42.515 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:15:42.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.620+0000 7f033f6b1640 1 -- 172.21.15.90:0/2362398459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03380702d0 msgr2=0x7f033815f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.620+0000 7f033f6b1640 1 --2- 172.21.15.90:0/2362398459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03380702d0 0x7f033815f2a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0330005fd0 tx=0x7f033002a540 comp rx=0 tx=0).stop 2024-09-10T23:15:42.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.620+0000 7f033f6b1640 1 -- 172.21.15.90:0/2362398459 shutdown_connections 2024-09-10T23:15:42.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.620+0000 7f033f6b1640 1 --2- 172.21.15.90:0/2362398459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03380702d0 0x7f033815f2a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.620+0000 7f033f6b1640 1 -- 172.21.15.90:0/2362398459 >> 172.21.15.90:0/2362398459 conn(0x7f03380ccb40 msgr2=0x7f03380ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:42.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.620+0000 7f033f6b1640 1 -- 172.21.15.90:0/2362398459 shutdown_connections 2024-09-10T23:15:42.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.620+0000 7f033f6b1640 1 -- 172.21.15.90:0/2362398459 wait complete. 2024-09-10T23:15:42.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.621+0000 7f033f6b1640 1 Processor -- start 2024-09-10T23:15:42.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.621+0000 7f033f6b1640 1 -- start start 2024-09-10T23:15:42.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.622+0000 7f033f6b1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03380702d0 0x7f03380c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:42.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.622+0000 7f033f6b1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f033815ad60 0x7f0338156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:42.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.622+0000 7f033f6b1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03380c42f0 0x7f03380ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:42.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.622+0000 7f033f6b1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f03380cef30 con 0x7f033815ad60 2024-09-10T23:15:42.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.622+0000 7f033f6b1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f03380cedb0 con 0x7f03380c42f0 2024-09-10T23:15:42.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.622+0000 7f033f6b1640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f03380cf0b0 con 0x7f03380702d0 2024-09-10T23:15:42.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.622+0000 7f033cc4c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f033815ad60 0x7f0338156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:42.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.622+0000 7f033cc4c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f033815ad60 0x7f0338156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46640/0 (socket says 172.21.15.90:46640) 2024-09-10T23:15:42.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.622+0000 7f033cc4c640 1 -- 172.21.15.90:0/1453174598 learned_addr learned my addr 172.21.15.90:0/1453174598 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:42.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.622+0000 7f033d44d640 1 --2- 172.21.15.90:0/1453174598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03380702d0 0x7f03380c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:42.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.622+0000 7f033dc4e640 1 --2- 172.21.15.90:0/1453174598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03380c42f0 0x7f03380ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:42.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.623+0000 7f033cc4c640 1 -- 172.21.15.90:0/1453174598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03380702d0 msgr2=0x7f03380c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.623+0000 7f033cc4c640 1 --2- 172.21.15.90:0/1453174598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03380702d0 0x7f03380c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.623+0000 7f033cc4c640 1 -- 172.21.15.90:0/1453174598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03380c42f0 msgr2=0x7f03380ae1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.623+0000 7f033cc4c640 1 --2- 172.21.15.90:0/1453174598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03380c42f0 0x7f03380ae1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.623+0000 7f033cc4c640 1 -- 172.21.15.90:0/1453174598 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033809d930 con 0x7f033815ad60 2024-09-10T23:15:42.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.623+0000 7f033cc4c640 1 --2- 172.21.15.90:0/1453174598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f033815ad60 0x7f0338156960 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f032c00c8a0 tx=0x7f032c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:42.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.623+0000 7f0335ffb640 1 -- 172.21.15.90:0/1453174598 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c003b70 con 0x7f033815ad60 2024-09-10T23:15:42.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.623+0000 7f0335ffb640 1 -- 172.21.15.90:0/1453174598 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f032c003d30 con 0x7f033815ad60 2024-09-10T23:15:42.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.623+0000 7f033f6b1640 1 -- 172.21.15.90:0/1453174598 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03380c7330 con 0x7f033815ad60 2024-09-10T23:15:42.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.623+0000 7f0335ffb640 1 -- 172.21.15.90:0/1453174598 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c00aab0 con 0x7f033815ad60 2024-09-10T23:15:42.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.623+0000 7f033f6b1640 1 -- 172.21.15.90:0/1453174598 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03380c78f0 con 0x7f033815ad60 2024-09-10T23:15:42.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.624+0000 7f033f6b1640 1 -- 172.21.15.90:0/1453174598 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03380cf560 con 0x7f033815ad60 2024-09-10T23:15:42.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.625+0000 7f0335ffb640 1 -- 172.21.15.90:0/1453174598 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f032c00ac50 con 0x7f033815ad60 2024-09-10T23:15:42.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.625+0000 7f0335ffb640 1 --2- 172.21.15.90:0/1453174598 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0324077f70 0x7f032407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:42.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.625+0000 7f0335ffb640 1 -- 172.21.15.90:0/1453174598 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5609+0+0 (secure 0 0 0) 0x7f032c099a50 con 0x7f033815ad60 2024-09-10T23:15:42.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.625+0000 7f033d44d640 1 --2- 172.21.15.90:0/1453174598 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0324077f70 0x7f032407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:42.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.626+0000 7f033d44d640 1 --2- 172.21.15.90:0/1453174598 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0324077f70 0x7f032407a430 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0328006fd0 tx=0x7f0328009060 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:42.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.630+0000 7f0335ffb640 1 -- 172.21.15.90:0/1453174598 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f032c061f60 con 0x7f033815ad60 2024-09-10T23:15:42.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:42.841+0000 7f033f6b1640 1 -- 172.21.15.90:0/1453174598 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f03380cde40 con 0x7f033815ad60 2024-09-10T23:15:43.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.510+0000 7f0335ffb640 1 -- 172.21.15.90:0/1453174598 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v18) ==== 172+0+0 (secure 0 0 0) 0x7f032c066990 con 0x7f033815ad60 2024-09-10T23:15:43.511 INFO:teuthology.orchestra.run.smithi090.stderr:new fs with metadata pool 6 and data pool 7 2024-09-10T23:15:43.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.514+0000 7f033f6b1640 1 -- 172.21.15.90:0/1453174598 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0324077f70 msgr2=0x7f032407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.514+0000 7f033f6b1640 1 --2- 172.21.15.90:0/1453174598 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0324077f70 0x7f032407a430 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0328006fd0 tx=0x7f0328009060 comp rx=0 tx=0).stop 2024-09-10T23:15:43.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.515+0000 7f033f6b1640 1 -- 172.21.15.90:0/1453174598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f033815ad60 msgr2=0x7f0338156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.515+0000 7f033f6b1640 1 --2- 172.21.15.90:0/1453174598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f033815ad60 0x7f0338156960 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f032c00c8a0 tx=0x7f032c00cd60 comp rx=0 tx=0).stop 2024-09-10T23:15:43.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.515+0000 7f033f6b1640 1 -- 172.21.15.90:0/1453174598 shutdown_connections 2024-09-10T23:15:43.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.515+0000 7f033f6b1640 1 --2- 172.21.15.90:0/1453174598 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0324077f70 0x7f032407a430 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0328006fd0 tx=0x7f0328009060 comp rx=0 tx=0).stop 2024-09-10T23:15:43.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.515+0000 7f033f6b1640 1 --2- 172.21.15.90:0/1453174598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03380c42f0 0x7f03380ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.515+0000 7f033f6b1640 1 --2- 172.21.15.90:0/1453174598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f033815ad60 0x7f0338156960 secure :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f032c00c8a0 tx=0x7f032c00cd60 comp rx=0 tx=0).stop 2024-09-10T23:15:43.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.515+0000 7f033f6b1640 1 --2- 172.21.15.90:0/1453174598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03380702d0 0x7f03380c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.515+0000 7f033f6b1640 1 -- 172.21.15.90:0/1453174598 >> 172.21.15.90:0/1453174598 conn(0x7f03380ccb40 msgr2=0x7f03380d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:43.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.516+0000 7f033f6b1640 1 -- 172.21.15.90:0/1453174598 shutdown_connections 2024-09-10T23:15:43.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.516+0000 7f033f6b1640 1 -- 172.21.15.90:0/1453174598 wait complete. 2024-09-10T23:15:43.550 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:43.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.653+0000 7f206c1d3640 1 -- 172.21.15.90:0/3244445503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20640d2470 msgr2=0x7f20640b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.653+0000 7f206c1d3640 1 --2- 172.21.15.90:0/3244445503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20640d2470 0x7f20640b3490 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f20640ce940 tx=0x7f205402aa30 comp rx=0 tx=0).stop 2024-09-10T23:15:43.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.653+0000 7f206c1d3640 1 -- 172.21.15.90:0/3244445503 shutdown_connections 2024-09-10T23:15:43.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.653+0000 7f206c1d3640 1 --2- 172.21.15.90:0/3244445503 >> v2:172.21.15.171:3300/0 conn(0x7f20640b3a00 0x7f20640b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.653+0000 7f206c1d3640 1 --2- 172.21.15.90:0/3244445503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20640d2470 0x7f20640b3490 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.653+0000 7f206c1d3640 1 -- 172.21.15.90:0/3244445503 >> 172.21.15.90:0/3244445503 conn(0x7f206409d2a0 msgr2=0x7f20640d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:43.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.653+0000 7f206c1d3640 1 -- 172.21.15.90:0/3244445503 shutdown_connections 2024-09-10T23:15:43.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.653+0000 7f206c1d3640 1 -- 172.21.15.90:0/3244445503 wait complete. 2024-09-10T23:15:43.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.655+0000 7f206c1d3640 1 Processor -- start 2024-09-10T23:15:43.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.655+0000 7f206c1d3640 1 -- start start 2024-09-10T23:15:43.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.655+0000 7f206c1d3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20640b3a00 0x7f206415ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:43.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.655+0000 7f206c1d3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20640d1c70 0x7f20640b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:43.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.655+0000 7f206c1d3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20640d2470 0x7f20641540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:43.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.655+0000 7f206c1d3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f20640b4570 con 0x7f20640b3a00 2024-09-10T23:15:43.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.655+0000 7f206c1d3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f20640b43f0 con 0x7f20640d1c70 2024-09-10T23:15:43.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.655+0000 7f206c1d3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f20640b46f0 con 0x7f20640d2470 2024-09-10T23:15:43.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.655+0000 7f2069f6f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20640b3a00 0x7f206415ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:43.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.655+0000 7f2069f6f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20640b3a00 0x7f206415ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46644/0 (socket says 172.21.15.90:46644) 2024-09-10T23:15:43.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.655+0000 7f2069f6f640 1 -- 172.21.15.90:0/1078275842 learned_addr learned my addr 172.21.15.90:0/1078275842 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:43.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.656+0000 7f206976e640 1 --2- 172.21.15.90:0/1078275842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20640d1c70 0x7f20640b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:43.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.656+0000 7f206a770640 1 --2- 172.21.15.90:0/1078275842 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20640d2470 0x7f20641540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:43.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.656+0000 7f2069f6f640 1 -- 172.21.15.90:0/1078275842 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20640d2470 msgr2=0x7f20641540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.656+0000 7f2069f6f640 1 --2- 172.21.15.90:0/1078275842 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20640d2470 0x7f20641540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.656+0000 7f2069f6f640 1 -- 172.21.15.90:0/1078275842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20640d1c70 msgr2=0x7f20640b8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.656+0000 7f2069f6f640 1 --2- 172.21.15.90:0/1078275842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20640d1c70 0x7f20640b8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.656+0000 7f2069f6f640 1 -- 172.21.15.90:0/1078275842 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2064154630 con 0x7f20640b3a00 2024-09-10T23:15:43.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.656+0000 7f206a770640 1 --2- 172.21.15.90:0/1078275842 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20640d2470 0x7f20641540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:43.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.656+0000 7f2069f6f640 1 --2- 172.21.15.90:0/1078275842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20640b3a00 0x7f206415ef40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2054009bf0 tx=0x7f2054003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:43.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.656+0000 7f20627fc640 1 -- 172.21.15.90:0/1078275842 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2054033050 con 0x7f20640b3a00 2024-09-10T23:15:43.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.656+0000 7f20627fc640 1 -- 172.21.15.90:0/1078275842 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2054004550 con 0x7f20640b3a00 2024-09-10T23:15:43.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.656+0000 7f206c1d3640 1 -- 172.21.15.90:0/1078275842 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f206415f640 con 0x7f20640b3a00 2024-09-10T23:15:43.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.656+0000 7f20627fc640 1 -- 172.21.15.90:0/1078275842 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2054038450 con 0x7f20640b3a00 2024-09-10T23:15:43.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.656+0000 7f206c1d3640 1 -- 172.21.15.90:0/1078275842 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f206415fc00 con 0x7f20640b3a00 2024-09-10T23:15:43.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.657+0000 7f206c1d3640 1 -- 172.21.15.90:0/1078275842 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20641606c0 con 0x7f20640b3a00 2024-09-10T23:15:43.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.658+0000 7f20627fc640 1 -- 172.21.15.90:0/1078275842 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2054040070 con 0x7f20640b3a00 2024-09-10T23:15:43.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.658+0000 7f20627fc640 1 --2- 172.21.15.90:0/1078275842 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2050077f70 0x7f205007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:43.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.658+0000 7f20627fc640 1 -- 172.21.15.90:0/1078275842 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f20540bb220 con 0x7f20640b3a00 2024-09-10T23:15:43.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.658+0000 7f206976e640 1 --2- 172.21.15.90:0/1078275842 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2050077f70 0x7f205007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:43.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.659+0000 7f206976e640 1 --2- 172.21.15.90:0/1078275842 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2050077f70 0x7f205007a430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f20641f8340 tx=0x7f2058007e30 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:43.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.662+0000 7f20627fc640 1 -- 172.21.15.90:0/1078275842 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f20641606c0 con 0x7f20640b3a00 2024-09-10T23:15:43.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.838+0000 7f206c1d3640 1 -- 172.21.15.90:0/1078275842 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20640b3eb0 con 0x7f20640b3a00 2024-09-10T23:15:43.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.839+0000 7f20627fc640 1 -- 172.21.15.90:0/1078275842 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16686 (secure 0 0 0) 0x7f20640cff60 con 0x7f20640b3a00 2024-09-10T23:15:43.840 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:43.841 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":45,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:15:42.843251+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:41.074720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:41.800321+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:43.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.841+0000 7f206c1d3640 1 -- 172.21.15.90:0/1078275842 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2050077f70 msgr2=0x7f205007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.841+0000 7f206c1d3640 1 --2- 172.21.15.90:0/1078275842 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2050077f70 0x7f205007a430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f20641f8340 tx=0x7f2058007e30 comp rx=0 tx=0).stop 2024-09-10T23:15:43.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.841+0000 7f206c1d3640 1 -- 172.21.15.90:0/1078275842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20640b3a00 msgr2=0x7f206415ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.841+0000 7f206c1d3640 1 --2- 172.21.15.90:0/1078275842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20640b3a00 0x7f206415ef40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2054009bf0 tx=0x7f2054003f10 comp rx=0 tx=0).stop 2024-09-10T23:15:43.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.841+0000 7f206c1d3640 1 -- 172.21.15.90:0/1078275842 shutdown_connections 2024-09-10T23:15:43.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.841+0000 7f206c1d3640 1 --2- 172.21.15.90:0/1078275842 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2050077f70 0x7f205007a430 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.841+0000 7f206c1d3640 1 --2- 172.21.15.90:0/1078275842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20640d1c70 0x7f20640b8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.841+0000 7f206c1d3640 1 --2- 172.21.15.90:0/1078275842 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20640d2470 0x7f20641540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.841+0000 7f206c1d3640 1 --2- 172.21.15.90:0/1078275842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20640b3a00 0x7f206415ef40 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.841+0000 7f206c1d3640 1 -- 172.21.15.90:0/1078275842 >> 172.21.15.90:0/1078275842 conn(0x7f206409d2a0 msgr2=0x7f20640d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:43.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.842+0000 7f206c1d3640 1 -- 172.21.15.90:0/1078275842 shutdown_connections 2024-09-10T23:15:43.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.842+0000 7f206c1d3640 1 -- 172.21.15.90:0/1078275842 wait complete. 2024-09-10T23:15:43.854 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:43.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.953+0000 7fe26f532640 1 -- 172.21.15.90:0/2643103075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe254004d40 msgr2=0x7fe2540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.953+0000 7fe26f532640 1 --2- 172.21.15.90:0/2643103075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe254004d40 0x7fe2540051c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe260001f60 tx=0x7fe254005830 comp rx=0 tx=0).stop 2024-09-10T23:15:43.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.953+0000 7fe26dacf640 1 -- 172.21.15.90:0/2643103075 reap_dead start 2024-09-10T23:15:43.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.954+0000 7fe26f532640 1 -- 172.21.15.90:0/2643103075 shutdown_connections 2024-09-10T23:15:43.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.954+0000 7fe26f532640 1 -- 172.21.15.90:0/2643103075 >> 172.21.15.90:0/2643103075 conn(0x7fe2680cc850 msgr2=0x7fe2680ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:43.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.954+0000 7fe26f532640 1 -- 172.21.15.90:0/2643103075 shutdown_connections 2024-09-10T23:15:43.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.954+0000 7fe26f532640 1 -- 172.21.15.90:0/2643103075 wait complete. 2024-09-10T23:15:43.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.955+0000 7fe26f532640 1 Processor -- start 2024-09-10T23:15:43.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.955+0000 7fe26f532640 1 -- start start 2024-09-10T23:15:43.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.955+0000 7fe26f532640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe254004d40 0x7fe2680c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:43.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.955+0000 7fe26f532640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe26814d920 0x7fe26814cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:43.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe26f532640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2680c6820 0x7fe26814d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:43.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe26f532640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe2680b20e0 con 0x7fe2680c6820 2024-09-10T23:15:43.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe26f532640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe2680b1f60 con 0x7fe254004d40 2024-09-10T23:15:43.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe26f532640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe2680cb7e0 con 0x7fe26814d920 2024-09-10T23:15:43.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe26dacf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2680c6820 0x7fe26814d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:43.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe26dacf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2680c6820 0x7fe26814d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46668/0 (socket says 172.21.15.90:46668) 2024-09-10T23:15:43.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe26dacf640 1 -- 172.21.15.90:0/2675717905 learned_addr learned my addr 172.21.15.90:0/2675717905 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:43.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe26cacd640 1 --2- 172.21.15.90:0/2675717905 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe26814d920 0x7fe26814cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:43.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe26d2ce640 1 --2- 172.21.15.90:0/2675717905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe254004d40 0x7fe2680c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:43.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe26dacf640 1 -- 172.21.15.90:0/2675717905 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe26814d920 msgr2=0x7fe26814cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe26dacf640 1 --2- 172.21.15.90:0/2675717905 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe26814d920 0x7fe26814cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe26dacf640 1 -- 172.21.15.90:0/2675717905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe254004d40 msgr2=0x7fe2680c3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe26dacf640 1 --2- 172.21.15.90:0/2675717905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe254004d40 0x7fe2680c3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe26dacf640 1 -- 172.21.15.90:0/2675717905 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2680c5780 con 0x7fe2680c6820 2024-09-10T23:15:43.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe26dacf640 1 --2- 172.21.15.90:0/2675717905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2680c6820 0x7fe26814d2a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe26002ae00 tx=0x7fe260006810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:43.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe25dffb640 1 -- 172.21.15.90:0/2675717905 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe260001b50 con 0x7fe2680c6820 2024-09-10T23:15:43.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe25dffb640 1 -- 172.21.15.90:0/2675717905 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe260003d40 con 0x7fe2680c6820 2024-09-10T23:15:43.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe26f532640 1 -- 172.21.15.90:0/2675717905 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2680c5a60 con 0x7fe2680c6820 2024-09-10T23:15:43.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.956+0000 7fe25dffb640 1 -- 172.21.15.90:0/2675717905 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe260006c40 con 0x7fe2680c6820 2024-09-10T23:15:43.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.957+0000 7fe26f532640 1 -- 172.21.15.90:0/2675717905 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2680c6020 con 0x7fe2680c6820 2024-09-10T23:15:43.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.958+0000 7fe26f532640 1 -- 172.21.15.90:0/2675717905 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2680ca850 con 0x7fe2680c6820 2024-09-10T23:15:43.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.958+0000 7fe25dffb640 1 -- 172.21.15.90:0/2675717905 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe260032020 con 0x7fe2680c6820 2024-09-10T23:15:43.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.959+0000 7fe25dffb640 1 --2- 172.21.15.90:0/2675717905 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe24c077f70 0x7fe24c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:43.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.959+0000 7fe25dffb640 1 -- 172.21.15.90:0/2675717905 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fe2600b9980 con 0x7fe2680c6820 2024-09-10T23:15:43.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.959+0000 7fe26d2ce640 1 --2- 172.21.15.90:0/2675717905 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe24c077f70 0x7fe24c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:43.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.960+0000 7fe26d2ce640 1 --2- 172.21.15.90:0/2675717905 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe24c077f70 0x7fe24c07a430 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe264009c50 tx=0x7fe264005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:43.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:43.963+0000 7fe25dffb640 1 -- 172.21.15.90:0/2675717905 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe260038030 con 0x7fe2680c6820 2024-09-10T23:15:44.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.140+0000 7fe26f532640 1 -- 172.21.15.90:0/2675717905 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2680ca850 con 0x7fe2680c6820 2024-09-10T23:15:44.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.141+0000 7fe25dffb640 1 -- 172.21.15.90:0/2675717905 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16686 (secure 0 0 0) 0x7fe260081ec0 con 0x7fe2680c6820 2024-09-10T23:15:44.142 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:44.142 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":45,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:15:42.843251+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:41.074720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:41.800321+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:44.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.143+0000 7fe26f532640 1 -- 172.21.15.90:0/2675717905 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe24c077f70 msgr2=0x7fe24c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.143+0000 7fe26f532640 1 --2- 172.21.15.90:0/2675717905 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe24c077f70 0x7fe24c07a430 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe264009c50 tx=0x7fe264005f90 comp rx=0 tx=0).stop 2024-09-10T23:15:44.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.143+0000 7fe26f532640 1 -- 172.21.15.90:0/2675717905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2680c6820 msgr2=0x7fe26814d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.143+0000 7fe26f532640 1 --2- 172.21.15.90:0/2675717905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2680c6820 0x7fe26814d2a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe26002ae00 tx=0x7fe260006810 comp rx=0 tx=0).stop 2024-09-10T23:15:44.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.143+0000 7fe26f532640 1 -- 172.21.15.90:0/2675717905 shutdown_connections 2024-09-10T23:15:44.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.143+0000 7fe26f532640 1 --2- 172.21.15.90:0/2675717905 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe24c077f70 0x7fe24c07a430 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.143+0000 7fe26f532640 1 --2- 172.21.15.90:0/2675717905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2680c6820 0x7fe26814d2a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.143+0000 7fe26f532640 1 --2- 172.21.15.90:0/2675717905 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe26814d920 0x7fe26814cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.143+0000 7fe26f532640 1 --2- 172.21.15.90:0/2675717905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe254004d40 0x7fe2680c3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.143+0000 7fe26f532640 1 -- 172.21.15.90:0/2675717905 >> 172.21.15.90:0/2675717905 conn(0x7fe2680cc850 msgr2=0x7fe2680c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:44.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.143+0000 7fe26f532640 1 -- 172.21.15.90:0/2675717905 shutdown_connections 2024-09-10T23:15:44.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.143+0000 7fe26f532640 1 -- 172.21.15.90:0/2675717905 wait complete. 2024-09-10T23:15:44.156 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:15:44.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.259+0000 7f5fd03a3640 1 -- 172.21.15.90:0/1648043122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fb0003a50 msgr2=0x7f5fb0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.259+0000 7f5fd03a3640 1 --2- 172.21.15.90:0/1648043122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fb0003a50 0x7f5fb0003e70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8001dc0 tx=0x7f5fb0005830 comp rx=0 tx=0).stop 2024-09-10T23:15:44.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.259+0000 7f5fd03a3640 1 -- 172.21.15.90:0/1648043122 shutdown_connections 2024-09-10T23:15:44.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.259+0000 7f5fd03a3640 1 --2- 172.21.15.90:0/1648043122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fb0003a50 0x7f5fb0003e70 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.259+0000 7f5fd03a3640 1 -- 172.21.15.90:0/1648043122 >> 172.21.15.90:0/1648043122 conn(0x7f5fc80b2120 msgr2=0x7f5fc80b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:44.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.259+0000 7f5fd03a3640 1 -- 172.21.15.90:0/1648043122 shutdown_connections 2024-09-10T23:15:44.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.259+0000 7f5fd03a3640 1 -- 172.21.15.90:0/1648043122 wait complete. 2024-09-10T23:15:44.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.260+0000 7f5fd03a3640 1 Processor -- start 2024-09-10T23:15:44.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.260+0000 7f5fd03a3640 1 -- start start 2024-09-10T23:15:44.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fd03a3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5fb0003a50 0x7f5fc8156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fd03a3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fc80c9500 0x7f5fc80c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fd03a3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc80c9980 0x7f5fc80c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fd03a3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc815fc00 con 0x7f5fc80c9980 2024-09-10T23:15:44.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fd03a3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc8070e00 con 0x7f5fc80c9500 2024-09-10T23:15:44.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fd03a3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc815fd80 con 0x7f5fb0003a50 2024-09-10T23:15:44.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fce940640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc80c9980 0x7f5fc80c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fce940640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc80c9980 0x7f5fc80c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46692/0 (socket says 172.21.15.90:46692) 2024-09-10T23:15:44.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fce940640 1 -- 172.21.15.90:0/1886478302 learned_addr learned my addr 172.21.15.90:0/1886478302 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:44.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fce13f640 1 --2- 172.21.15.90:0/1886478302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5fb0003a50 0x7f5fc8156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fcd93e640 1 --2- 172.21.15.90:0/1886478302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fc80c9500 0x7f5fc80c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fce940640 1 -- 172.21.15.90:0/1886478302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5fb0003a50 msgr2=0x7f5fc8156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fce940640 1 --2- 172.21.15.90:0/1886478302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5fb0003a50 0x7f5fc8156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fce940640 1 -- 172.21.15.90:0/1886478302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fc80c9500 msgr2=0x7f5fc80c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fce940640 1 --2- 172.21.15.90:0/1886478302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fc80c9500 0x7f5fc80c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fce940640 1 -- 172.21.15.90:0/1886478302 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc81f3a50 con 0x7f5fc80c9980 2024-09-10T23:15:44.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fce940640 1 --2- 172.21.15.90:0/1886478302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc80c9980 0x7f5fc80c67a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0001eb0 tx=0x7f5fc000e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:44.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fc6ffd640 1 -- 172.21.15.90:0/1886478302 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0011870 con 0x7f5fc80c9980 2024-09-10T23:15:44.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fc6ffd640 1 -- 172.21.15.90:0/1886478302 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fc0017070 con 0x7f5fc80c9980 2024-09-10T23:15:44.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fd03a3640 1 -- 172.21.15.90:0/1886478302 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc81f3770 con 0x7f5fc80c9980 2024-09-10T23:15:44.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.261+0000 7f5fc6ffd640 1 -- 172.21.15.90:0/1886478302 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0011da0 con 0x7f5fc80c9980 2024-09-10T23:15:44.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.262+0000 7f5fd03a3640 1 -- 172.21.15.90:0/1886478302 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc80c8d00 con 0x7f5fc80c9980 2024-09-10T23:15:44.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.262+0000 7f5fd03a3640 1 -- 172.21.15.90:0/1886478302 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc81602e0 con 0x7f5fc80c9980 2024-09-10T23:15:44.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.263+0000 7f5fc6ffd640 1 -- 172.21.15.90:0/1886478302 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5fc001c460 con 0x7f5fc80c9980 2024-09-10T23:15:44.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.264+0000 7f5fc6ffd640 1 --2- 172.21.15.90:0/1886478302 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5fb4077f70 0x7f5fb407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.264+0000 7f5fc6ffd640 1 -- 172.21.15.90:0/1886478302 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f5fc0099f10 con 0x7f5fc80c9980 2024-09-10T23:15:44.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.264+0000 7f5fce13f640 1 --2- 172.21.15.90:0/1886478302 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5fb4077f70 0x7f5fb407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.264+0000 7f5fce13f640 1 --2- 172.21.15.90:0/1886478302 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5fb4077f70 0x7f5fb407a430 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8032000 tx=0x7f5fb8001510 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:44.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.268+0000 7f5fc6ffd640 1 -- 172.21.15.90:0/1886478302 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5fc00623c0 con 0x7f5fc80c9980 2024-09-10T23:15:44.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.477+0000 7f5fd03a3640 1 -- 172.21.15.90:0/1886478302 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5fc815ee00 con 0x7f5fc80c9980 2024-09-10T23:15:44.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.528+0000 7f5fc6ffd640 1 -- 172.21.15.90:0/1886478302 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v19) ==== 118+0+0 (secure 0 0 0) 0x7f5fc006b130 con 0x7f5fc80c9980 2024-09-10T23:15:44.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.530+0000 7f5fd03a3640 1 -- 172.21.15.90:0/1886478302 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5fb4077f70 msgr2=0x7f5fb407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.530+0000 7f5fd03a3640 1 --2- 172.21.15.90:0/1886478302 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5fb4077f70 0x7f5fb407a430 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8032000 tx=0x7f5fb8001510 comp rx=0 tx=0).stop 2024-09-10T23:15:44.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.530+0000 7f5fd03a3640 1 -- 172.21.15.90:0/1886478302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc80c9980 msgr2=0x7f5fc80c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.530+0000 7f5fd03a3640 1 --2- 172.21.15.90:0/1886478302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc80c9980 0x7f5fc80c67a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0001eb0 tx=0x7f5fc000e9a0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.530+0000 7f5fd03a3640 1 -- 172.21.15.90:0/1886478302 shutdown_connections 2024-09-10T23:15:44.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.530+0000 7f5fd03a3640 1 --2- 172.21.15.90:0/1886478302 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5fb4077f70 0x7f5fb407a430 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.530+0000 7f5fd03a3640 1 --2- 172.21.15.90:0/1886478302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fc80c9500 0x7f5fc80c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.530+0000 7f5fd03a3640 1 --2- 172.21.15.90:0/1886478302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5fc80c9980 0x7f5fc80c67a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.530+0000 7f5fd03a3640 1 --2- 172.21.15.90:0/1886478302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5fb0003a50 0x7f5fc8156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.530+0000 7f5fd03a3640 1 -- 172.21.15.90:0/1886478302 >> 172.21.15.90:0/1886478302 conn(0x7f5fc80b2120 msgr2=0x7f5fc8072eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:44.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.530+0000 7f5fd03a3640 1 -- 172.21.15.90:0/1886478302 shutdown_connections 2024-09-10T23:15:44.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.530+0000 7f5fd03a3640 1 -- 172.21.15.90:0/1886478302 wait complete. 2024-09-10T23:15:44.542 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:15:44.542 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:15:44.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.646+0000 7fb5be175640 1 -- 172.21.15.90:0/3916176250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00052e0 msgr2=0x7fb5a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.646+0000 7fb5be175640 1 --2- 172.21.15.90:0/3916176250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00052e0 0x7fb5a000b9c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0006f90 tx=0x7fb5a0005830 comp rx=0 tx=0).stop 2024-09-10T23:15:44.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.646+0000 7fb5b7fff640 1 -- 172.21.15.90:0/3916176250 reap_dead start 2024-09-10T23:15:44.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.646+0000 7fb5be175640 1 -- 172.21.15.90:0/3916176250 shutdown_connections 2024-09-10T23:15:44.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.646+0000 7fb5be175640 1 -- 172.21.15.90:0/3916176250 >> 172.21.15.90:0/3916176250 conn(0x7fb5b80cfc80 msgr2=0x7fb5b80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:44.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.646+0000 7fb5be175640 1 -- 172.21.15.90:0/3916176250 shutdown_connections 2024-09-10T23:15:44.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.646+0000 7fb5be175640 1 -- 172.21.15.90:0/3916176250 wait complete. 2024-09-10T23:15:44.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.647+0000 7fb5be175640 1 Processor -- start 2024-09-10T23:15:44.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.648+0000 7fb5be175640 1 -- start start 2024-09-10T23:15:44.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.648+0000 7fb5be175640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00052e0 0x7fb5b80c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.648+0000 7fb5be175640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5b81f50c0 0x7fb5b81f2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.648+0000 7fb5be175640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5b81f2890 0x7fb5b8152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.648+0000 7fb5be175640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b806ec50 con 0x7fb5a00052e0 2024-09-10T23:15:44.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.648+0000 7fb5be175640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b806ead0 con 0x7fb5b81f2890 2024-09-10T23:15:44.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.648+0000 7fb5be175640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b80c7730 con 0x7fb5b81f50c0 2024-09-10T23:15:44.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.649+0000 7fb5b77fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00052e0 0x7fb5b80c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.649+0000 7fb5b77fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00052e0 0x7fb5b80c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46702/0 (socket says 172.21.15.90:46702) 2024-09-10T23:15:44.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.649+0000 7fb5b77fe640 1 -- 172.21.15.90:0/4052239427 learned_addr learned my addr 172.21.15.90:0/4052239427 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:44.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.649+0000 7fb5b6ffd640 1 --2- 172.21.15.90:0/4052239427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5b81f50c0 0x7fb5b81f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.649+0000 7fb5b7fff640 1 --2- 172.21.15.90:0/4052239427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5b81f2890 0x7fb5b8152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.649+0000 7fb5b77fe640 1 -- 172.21.15.90:0/4052239427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5b81f50c0 msgr2=0x7fb5b81f2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.649+0000 7fb5b77fe640 1 --2- 172.21.15.90:0/4052239427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5b81f50c0 0x7fb5b81f2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.649+0000 7fb5b77fe640 1 -- 172.21.15.90:0/4052239427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5b81f2890 msgr2=0x7fb5b8152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.649+0000 7fb5b77fe640 1 --2- 172.21.15.90:0/4052239427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5b81f2890 0x7fb5b8152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.649+0000 7fb5b77fe640 1 -- 172.21.15.90:0/4052239427 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b81f2d20 con 0x7fb5a00052e0 2024-09-10T23:15:44.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.649+0000 7fb5b77fe640 1 --2- 172.21.15.90:0/4052239427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00052e0 0x7fb5b80c9760 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb5a80018c0 tx=0x7fb5a8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:44.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.649+0000 7fb59ffff640 1 -- 172.21.15.90:0/4052239427 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8015070 con 0x7fb5a00052e0 2024-09-10T23:15:44.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.649+0000 7fb59ffff640 1 -- 172.21.15.90:0/4052239427 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5a800ebd0 con 0x7fb5a00052e0 2024-09-10T23:15:44.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.649+0000 7fb5be175640 1 -- 172.21.15.90:0/4052239427 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b80c79b0 con 0x7fb5a00052e0 2024-09-10T23:15:44.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.649+0000 7fb59ffff640 1 -- 172.21.15.90:0/4052239427 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80020c0 con 0x7fb5a00052e0 2024-09-10T23:15:44.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.649+0000 7fb5be175640 1 -- 172.21.15.90:0/4052239427 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b80c7f70 con 0x7fb5a00052e0 2024-09-10T23:15:44.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.650+0000 7fb5be175640 1 -- 172.21.15.90:0/4052239427 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5b80caa90 con 0x7fb5a00052e0 2024-09-10T23:15:44.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.651+0000 7fb59ffff640 1 -- 172.21.15.90:0/4052239427 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb5a8011460 con 0x7fb5a00052e0 2024-09-10T23:15:44.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.651+0000 7fb59ffff640 1 --2- 172.21.15.90:0/4052239427 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5a4077f70 0x7fb5a407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.651+0000 7fb59ffff640 1 -- 172.21.15.90:0/4052239427 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fb5a809a760 con 0x7fb5a00052e0 2024-09-10T23:15:44.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.651+0000 7fb5b6ffd640 1 --2- 172.21.15.90:0/4052239427 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5a4077f70 0x7fb5a407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.652+0000 7fb5b6ffd640 1 --2- 172.21.15.90:0/4052239427 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5a4077f70 0x7fb5a407a430 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0058c0 tx=0x7fb5ac00d360 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:44.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.656+0000 7fb59ffff640 1 -- 172.21.15.90:0/4052239427 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb5a8062ca0 con 0x7fb5a00052e0 2024-09-10T23:15:44.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:44.864+0000 7fb5be175640 1 -- 172.21.15.90:0/4052239427 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb5b80c9ca0 con 0x7fb5a00052e0 2024-09-10T23:15:45.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.537+0000 7fb59ffff640 1 -- 172.21.15.90:0/4052239427 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7fb5a80676d0 con 0x7fb5a00052e0 2024-09-10T23:15:45.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.540+0000 7fb5be175640 1 -- 172.21.15.90:0/4052239427 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5a4077f70 msgr2=0x7fb5a407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:45.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.540+0000 7fb5be175640 1 --2- 172.21.15.90:0/4052239427 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5a4077f70 0x7fb5a407a430 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0058c0 tx=0x7fb5ac00d360 comp rx=0 tx=0).stop 2024-09-10T23:15:45.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.540+0000 7fb5be175640 1 -- 172.21.15.90:0/4052239427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00052e0 msgr2=0x7fb5b80c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:45.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.540+0000 7fb5be175640 1 --2- 172.21.15.90:0/4052239427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00052e0 0x7fb5b80c9760 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb5a80018c0 tx=0x7fb5a8001d80 comp rx=0 tx=0).stop 2024-09-10T23:15:45.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.540+0000 7fb5be175640 1 -- 172.21.15.90:0/4052239427 shutdown_connections 2024-09-10T23:15:45.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.540+0000 7fb5be175640 1 --2- 172.21.15.90:0/4052239427 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5a4077f70 0x7fb5a407a430 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.540+0000 7fb5be175640 1 --2- 172.21.15.90:0/4052239427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5b81f2890 0x7fb5b8152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.540+0000 7fb5be175640 1 --2- 172.21.15.90:0/4052239427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5b81f50c0 0x7fb5b81f2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.540+0000 7fb5be175640 1 --2- 172.21.15.90:0/4052239427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00052e0 0x7fb5b80c9760 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.540+0000 7fb5be175640 1 -- 172.21.15.90:0/4052239427 >> 172.21.15.90:0/4052239427 conn(0x7fb5b80cfc80 msgr2=0x7fb5b815a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:45.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.540+0000 7fb5be175640 1 -- 172.21.15.90:0/4052239427 shutdown_connections 2024-09-10T23:15:45.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.540+0000 7fb5be175640 1 -- 172.21.15.90:0/4052239427 wait complete. 2024-09-10T23:15:45.554 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:15:45.555 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:45.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.660+0000 7f6526152640 1 -- 172.21.15.90:0/1262299744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65200ca960 msgr2=0x7f65200b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:45.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.660+0000 7f6526152640 1 --2- 172.21.15.90:0/1262299744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65200ca960 0x7f65200b1850 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f65200707c0 tx=0x7f651402a560 comp rx=0 tx=0).stop 2024-09-10T23:15:45.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.660+0000 7f6526152640 1 -- 172.21.15.90:0/1262299744 shutdown_connections 2024-09-10T23:15:45.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.660+0000 7f6526152640 1 --2- 172.21.15.90:0/1262299744 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652015ae10 0x7f65200b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.660+0000 7f6526152640 1 --2- 172.21.15.90:0/1262299744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65200ca960 0x7f65200b1850 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.660+0000 7f6526152640 1 --2- 172.21.15.90:0/1262299744 >> v2:172.21.15.171:3300/0 conn(0x7f652015aa30 0x7f65200ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.660+0000 7f6526152640 1 -- 172.21.15.90:0/1262299744 >> 172.21.15.90:0/1262299744 conn(0x7f65200cc850 msgr2=0x7f65200ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:45.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.660+0000 7f6526152640 1 -- 172.21.15.90:0/1262299744 shutdown_connections 2024-09-10T23:15:45.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.660+0000 7f6526152640 1 -- 172.21.15.90:0/1262299744 wait complete. 2024-09-10T23:15:45.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.662+0000 7f6526152640 1 Processor -- start 2024-09-10T23:15:45.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.662+0000 7f6526152640 1 -- start start 2024-09-10T23:15:45.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f6526152640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652015aa30 0x7f65201f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:45.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f6526152640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f652015ae10 0x7f652009d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:45.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f6526152640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65200b4e10 0x7f65200b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:45.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f6526152640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f652006faf0 con 0x7f65200b4e10 2024-09-10T23:15:45.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f6526152640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f652006f970 con 0x7f652015ae10 2024-09-10T23:15:45.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f6526152640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f652006fc70 con 0x7f652015aa30 2024-09-10T23:15:45.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f651ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65200b4e10 0x7f65200b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:45.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f651ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65200b4e10 0x7f65200b52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46718/0 (socket says 172.21.15.90:46718) 2024-09-10T23:15:45.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f651ffff640 1 -- 172.21.15.90:0/2610856377 learned_addr learned my addr 172.21.15.90:0/2610856377 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:45.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f651f7fe640 1 --2- 172.21.15.90:0/2610856377 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652015aa30 0x7f65201f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f651effd640 1 --2- 172.21.15.90:0/2610856377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f652015ae10 0x7f652009d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f651ffff640 1 -- 172.21.15.90:0/2610856377 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652015aa30 msgr2=0x7f65201f6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f651ffff640 1 --2- 172.21.15.90:0/2610856377 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652015aa30 0x7f65201f6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f651ffff640 1 -- 172.21.15.90:0/2610856377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f652015ae10 msgr2=0x7f652009d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f651ffff640 1 --2- 172.21.15.90:0/2610856377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f652015ae10 0x7f652009d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f651ffff640 1 -- 172.21.15.90:0/2610856377 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65201f6ab0 con 0x7f65200b4e10 2024-09-10T23:15:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f651f7fe640 1 --2- 172.21.15.90:0/2610856377 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652015aa30 0x7f65201f6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f651ffff640 1 --2- 172.21.15.90:0/2610856377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65200b4e10 0x7f65200b52a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f651800ba10 tx=0x7f651800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f6507fff640 1 -- 172.21.15.90:0/2610856377 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518019070 con 0x7f65200b4e10 2024-09-10T23:15:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f6507fff640 1 -- 172.21.15.90:0/2610856377 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f651800cc30 con 0x7f65200b4e10 2024-09-10T23:15:45.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f6526152640 1 -- 172.21.15.90:0/2610856377 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65201f2880 con 0x7f65200b4e10 2024-09-10T23:15:45.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f6507fff640 1 -- 172.21.15.90:0/2610856377 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65180146a0 con 0x7f65200b4e10 2024-09-10T23:15:45.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.663+0000 7f6526152640 1 -- 172.21.15.90:0/2610856377 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65201f2e40 con 0x7f65200b4e10 2024-09-10T23:15:45.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.664+0000 7f6526152640 1 -- 172.21.15.90:0/2610856377 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6520070160 con 0x7f65200b4e10 2024-09-10T23:15:45.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.665+0000 7f6507fff640 1 -- 172.21.15.90:0/2610856377 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f651801d3b0 con 0x7f65200b4e10 2024-09-10T23:15:45.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.665+0000 7f6507fff640 1 --2- 172.21.15.90:0/2610856377 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f650c077f70 0x7f650c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:45.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.665+0000 7f6507fff640 1 -- 172.21.15.90:0/2610856377 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f6518099c80 con 0x7f65200b4e10 2024-09-10T23:15:45.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.666+0000 7f651f7fe640 1 --2- 172.21.15.90:0/2610856377 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f650c077f70 0x7f650c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:45.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.666+0000 7f651f7fe640 1 --2- 172.21.15.90:0/2610856377 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f650c077f70 0x7f650c07a430 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f65100058c0 tx=0x7f6510005ec0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:45.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.669+0000 7f6507fff640 1 -- 172.21.15.90:0/2610856377 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f65201f6ab0 con 0x7f65200b4e10 2024-09-10T23:15:45.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.877+0000 7f6526152640 1 -- 172.21.15.90:0/2610856377 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65200b1c00 con 0x7f65200b4e10 2024-09-10T23:15:45.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.878+0000 7f6507fff640 1 -- 172.21.15.90:0/2610856377 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5229 (secure 0 0 0) 0x7f651800ce20 con 0x7f65200b4e10 2024-09-10T23:15:45.879 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:45.879 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"btime":"2024-09-10T23:15:45:529350+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3694036833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3694036833},{"type":"v1","addr":"172.21.15.171:6836","nonce":3694036833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4148214232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":4148214232},{"type":"v1","addr":"172.21.15.90:6835","nonce":4148214232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/2531112116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2531112116},{"type":"v1","addr":"172.21.15.90:6834","nonce":2531112116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:42.843210+0000","modified":"2024-09-10T23:15:44.866224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/4106111677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":4106111677},{"type":"v1","addr":"172.21.15.171:6837","nonce":4106111677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-10T23:15:45.879 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 20 2024-09-10T23:15:45.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.880+0000 7f6526152640 1 -- 172.21.15.90:0/2610856377 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f650c077f70 msgr2=0x7f650c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:45.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.880+0000 7f6526152640 1 --2- 172.21.15.90:0/2610856377 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f650c077f70 0x7f650c07a430 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f65100058c0 tx=0x7f6510005ec0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.880+0000 7f6526152640 1 -- 172.21.15.90:0/2610856377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65200b4e10 msgr2=0x7f65200b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:45.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.880+0000 7f6526152640 1 --2- 172.21.15.90:0/2610856377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65200b4e10 0x7f65200b52a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f651800ba10 tx=0x7f651800bed0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.880+0000 7f6526152640 1 -- 172.21.15.90:0/2610856377 shutdown_connections 2024-09-10T23:15:45.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.880+0000 7f6526152640 1 --2- 172.21.15.90:0/2610856377 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f650c077f70 0x7f650c07a430 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.880+0000 7f6526152640 1 --2- 172.21.15.90:0/2610856377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f652015ae10 0x7f652009d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.880+0000 7f6526152640 1 --2- 172.21.15.90:0/2610856377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65200b4e10 0x7f65200b52a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.880+0000 7f6526152640 1 --2- 172.21.15.90:0/2610856377 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652015aa30 0x7f65201f6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.880+0000 7f6526152640 1 -- 172.21.15.90:0/2610856377 >> 172.21.15.90:0/2610856377 conn(0x7f65200cc850 msgr2=0x7f65200ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:45.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.880+0000 7f6526152640 1 -- 172.21.15.90:0/2610856377 shutdown_connections 2024-09-10T23:15:45.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.880+0000 7f6526152640 1 -- 172.21.15.90:0/2610856377 wait complete. 2024-09-10T23:15:45.892 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:45.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.992+0000 7f3ac8c33640 1 -- 172.21.15.90:0/1616668420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac40ca420 msgr2=0x7f3ac40ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:45.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.992+0000 7f3ac8c33640 1 --2- 172.21.15.90:0/1616668420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac40ca420 0x7f3ac40ca8b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3abc005fd0 tx=0x7f3abc02aa10 comp rx=0 tx=0).stop 2024-09-10T23:15:45.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.992+0000 7f3ac8c33640 1 -- 172.21.15.90:0/1616668420 shutdown_connections 2024-09-10T23:15:45.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.992+0000 7f3ac8c33640 1 --2- 172.21.15.90:0/1616668420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac40ca420 0x7f3ac40ca8b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.992+0000 7f3ac8c33640 1 --2- 172.21.15.90:0/1616668420 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ac4157fc0 0x7f3ac415b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.992+0000 7f3ac8c33640 1 -- 172.21.15.90:0/1616668420 >> 172.21.15.90:0/1616668420 conn(0x7f3ac40cc850 msgr2=0x7f3ac40ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:45.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.992+0000 7f3ac8c33640 1 -- 172.21.15.90:0/1616668420 shutdown_connections 2024-09-10T23:15:45.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.992+0000 7f3ac8c33640 1 -- 172.21.15.90:0/1616668420 wait complete. 2024-09-10T23:15:45.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.994+0000 7f3ac8c33640 1 Processor -- start 2024-09-10T23:15:45.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.994+0000 7f3ac8c33640 1 -- start start 2024-09-10T23:15:45.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.994+0000 7f3ac8c33640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ac40aef50 0x7f3ac41f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:45.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.994+0000 7f3ac8c33640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ac40ca420 0x7f3ac40b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:45.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.994+0000 7f3ac8c33640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac4157fc0 0x7f3ac40c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:45.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.994+0000 7f3ac8c33640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac406f770 con 0x7f3ac4157fc0 2024-09-10T23:15:45.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.994+0000 7f3ac8c33640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac406f5f0 con 0x7f3ac40ca420 2024-09-10T23:15:45.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.994+0000 7f3ac8c33640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3ac406f8f0 con 0x7f3ac40aef50 2024-09-10T23:15:45.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3ac2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac4157fc0 0x7f3ac40c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:45.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3ac2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac4157fc0 0x7f3ac40c5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46750/0 (socket says 172.21.15.90:46750) 2024-09-10T23:15:45.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3ac2d9d640 1 -- 172.21.15.90:0/1333651731 learned_addr learned my addr 172.21.15.90:0/1333651731 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:45.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3ac259c640 1 --2- 172.21.15.90:0/1333651731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ac40aef50 0x7f3ac41f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:45.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3abbfff640 1 --2- 172.21.15.90:0/1333651731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ac40ca420 0x7f3ac40b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:45.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3ac2d9d640 1 -- 172.21.15.90:0/1333651731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ac40aef50 msgr2=0x7f3ac41f6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:45.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3ac2d9d640 1 --2- 172.21.15.90:0/1333651731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ac40aef50 0x7f3ac41f6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3ac2d9d640 1 -- 172.21.15.90:0/1333651731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ac40ca420 msgr2=0x7f3ac40b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:45.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3ac2d9d640 1 --2- 172.21.15.90:0/1333651731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ac40ca420 0x7f3ac40b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:45.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3ac2d9d640 1 -- 172.21.15.90:0/1333651731 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac40ae2e0 con 0x7f3ac4157fc0 2024-09-10T23:15:45.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3abbfff640 1 --2- 172.21.15.90:0/1333651731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ac40ca420 0x7f3ac40b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:45.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3ac259c640 1 --2- 172.21.15.90:0/1333651731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ac40aef50 0x7f3ac41f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:45.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3ac2d9d640 1 --2- 172.21.15.90:0/1333651731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac4157fc0 0x7f3ac40c5b10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3abc006010 tx=0x7f3abc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:45.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3abaffd640 1 -- 172.21.15.90:0/1333651731 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc046070 con 0x7f3ac4157fc0 2024-09-10T23:15:45.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3abaffd640 1 -- 172.21.15.90:0/1333651731 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3abc004250 con 0x7f3ac4157fc0 2024-09-10T23:15:45.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3abaffd640 1 -- 172.21.15.90:0/1333651731 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc033070 con 0x7f3ac4157fc0 2024-09-10T23:15:45.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3ac8c33640 1 -- 172.21.15.90:0/1333651731 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac40ae5c0 con 0x7f3ac4157fc0 2024-09-10T23:15:45.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.995+0000 7f3ac8c33640 1 -- 172.21.15.90:0/1333651731 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac41f5d20 con 0x7f3ac4157fc0 2024-09-10T23:15:45.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.996+0000 7f3ac8c33640 1 -- 172.21.15.90:0/1333651731 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac406fd70 con 0x7f3ac4157fc0 2024-09-10T23:15:45.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.997+0000 7f3abaffd640 1 -- 172.21.15.90:0/1333651731 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3abc02f7e0 con 0x7f3ac4157fc0 2024-09-10T23:15:45.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.997+0000 7f3abaffd640 1 --2- 172.21.15.90:0/1333651731 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3aa4077f70 0x7f3aa407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:45.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.998+0000 7f3abaffd640 1 -- 172.21.15.90:0/1333651731 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f3abc0baea0 con 0x7f3ac4157fc0 2024-09-10T23:15:45.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.998+0000 7f3ac259c640 1 --2- 172.21.15.90:0/1333651731 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3aa4077f70 0x7f3aa407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:45.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:45.998+0000 7f3ac259c640 1 --2- 172.21.15.90:0/1333651731 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3aa4077f70 0x7f3aa407a430 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009890 tx=0x7f3ab4008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:46.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.002+0000 7f3abaffd640 1 -- 172.21.15.90:0/1333651731 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3abc083a30 con 0x7f3ac4157fc0 2024-09-10T23:15:46.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.176+0000 7f3ac8c33640 1 -- 172.21.15.90:0/1333651731 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ac409e090 con 0x7f3ac4157fc0 2024-09-10T23:15:46.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.177+0000 7f3abaffd640 1 -- 172.21.15.90:0/1333651731 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16673 (secure 0 0 0) 0x7f3abc083330 con 0x7f3ac4157fc0 2024-09-10T23:15:46.178 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:46.178 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":46,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:15:44.511355+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:41.074720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:41.800321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:46.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.179+0000 7f3ac8c33640 1 -- 172.21.15.90:0/1333651731 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3aa4077f70 msgr2=0x7f3aa407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:46.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.179+0000 7f3ac8c33640 1 --2- 172.21.15.90:0/1333651731 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3aa4077f70 0x7f3aa407a430 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009890 tx=0x7f3ab4008040 comp rx=0 tx=0).stop 2024-09-10T23:15:46.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.179+0000 7f3ac8c33640 1 -- 172.21.15.90:0/1333651731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac4157fc0 msgr2=0x7f3ac40c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:46.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.179+0000 7f3ac8c33640 1 --2- 172.21.15.90:0/1333651731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac4157fc0 0x7f3ac40c5b10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3abc006010 tx=0x7f3abc003f10 comp rx=0 tx=0).stop 2024-09-10T23:15:46.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.179+0000 7f3ac8c33640 1 -- 172.21.15.90:0/1333651731 shutdown_connections 2024-09-10T23:15:46.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.179+0000 7f3ac8c33640 1 --2- 172.21.15.90:0/1333651731 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3aa4077f70 0x7f3aa407a430 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.179+0000 7f3ac8c33640 1 --2- 172.21.15.90:0/1333651731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ac40ca420 0x7f3ac40b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.179+0000 7f3ac8c33640 1 --2- 172.21.15.90:0/1333651731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac4157fc0 0x7f3ac40c5b10 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.179+0000 7f3ac8c33640 1 --2- 172.21.15.90:0/1333651731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ac40aef50 0x7f3ac41f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.179+0000 7f3ac8c33640 1 -- 172.21.15.90:0/1333651731 >> 172.21.15.90:0/1333651731 conn(0x7f3ac40cc850 msgr2=0x7f3ac40d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:46.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.179+0000 7f3ac8c33640 1 -- 172.21.15.90:0/1333651731 shutdown_connections 2024-09-10T23:15:46.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.179+0000 7f3ac8c33640 1 -- 172.21.15.90:0/1333651731 wait complete. 2024-09-10T23:15:46.191 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:15:46.191 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:15:46.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.291+0000 7f920a3ca640 1 -- 172.21.15.90:0/2202932638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92040d1190 msgr2=0x7f92040ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:46.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.291+0000 7f920a3ca640 1 --2- 172.21.15.90:0/2202932638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92040d1190 0x7f92040ce060 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f91f8005fd0 tx=0x7f91f802a4b0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.291+0000 7f920a3ca640 1 -- 172.21.15.90:0/2202932638 shutdown_connections 2024-09-10T23:15:46.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.291+0000 7f920a3ca640 1 --2- 172.21.15.90:0/2202932638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92040d1190 0x7f92040ce060 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.291+0000 7f920a3ca640 1 -- 172.21.15.90:0/2202932638 >> 172.21.15.90:0/2202932638 conn(0x7f92040d0490 msgr2=0x7f92040d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:46.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.291+0000 7f920a3ca640 1 -- 172.21.15.90:0/2202932638 shutdown_connections 2024-09-10T23:15:46.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.291+0000 7f920a3ca640 1 -- 172.21.15.90:0/2202932638 wait complete. 2024-09-10T23:15:46.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.292+0000 7f920a3ca640 1 Processor -- start 2024-09-10T23:15:46.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.292+0000 7f920a3ca640 1 -- start start 2024-09-10T23:15:46.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.293+0000 7f920a3ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92040af4a0 0x7f92041595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:46.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.293+0000 7f920a3ca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92040d1190 0x7f92041f0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.293+0000 7f920a3ca640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f920415e260 0x7f92040b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.293+0000 7f920a3ca640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f920415e7c0 con 0x7f920415e260 2024-09-10T23:15:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.293+0000 7f920a3ca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f920415e640 con 0x7f92040d1190 2024-09-10T23:15:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.293+0000 7f920a3ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f92040cecb0 con 0x7f92040af4a0 2024-09-10T23:15:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.293+0000 7f9208967640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f920415e260 0x7f92040b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.293+0000 7f9208967640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f920415e260 0x7f92040b52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46756/0 (socket says 172.21.15.90:46756) 2024-09-10T23:15:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.293+0000 7f9208967640 1 -- 172.21.15.90:0/378628359 learned_addr learned my addr 172.21.15.90:0/378628359 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.293+0000 7f92037fe640 1 --2- 172.21.15.90:0/378628359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92040d1190 0x7f92041f0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.293+0000 7f9203fff640 1 --2- 172.21.15.90:0/378628359 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92040af4a0 0x7f92041595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.293+0000 7f9208967640 1 -- 172.21.15.90:0/378628359 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92040af4a0 msgr2=0x7f92041595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.293+0000 7f9208967640 1 --2- 172.21.15.90:0/378628359 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92040af4a0 0x7f92041595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.293+0000 7f9208967640 1 -- 172.21.15.90:0/378628359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92040d1190 msgr2=0x7f92041f0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:46.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.294+0000 7f9208967640 1 --2- 172.21.15.90:0/378628359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92040d1190 0x7f92041f0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.294+0000 7f9208967640 1 -- 172.21.15.90:0/378628359 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9204156100 con 0x7f920415e260 2024-09-10T23:15:46.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.294+0000 7f9208967640 1 --2- 172.21.15.90:0/378628359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f920415e260 0x7f92040b52d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00c6d0 tx=0x7f91fc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:46.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.294+0000 7f9200ff9640 1 -- 172.21.15.90:0/378628359 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc00a840 con 0x7f920415e260 2024-09-10T23:15:46.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.294+0000 7f9200ff9640 1 -- 172.21.15.90:0/378628359 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91fc00aad0 con 0x7f920415e260 2024-09-10T23:15:46.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.294+0000 7f920a3ca640 1 -- 172.21.15.90:0/378628359 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92041563e0 con 0x7f920415e260 2024-09-10T23:15:46.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.294+0000 7f9200ff9640 1 -- 172.21.15.90:0/378628359 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc011470 con 0x7f920415e260 2024-09-10T23:15:46.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.294+0000 7f920a3ca640 1 -- 172.21.15.90:0/378628359 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92041f13b0 con 0x7f920415e260 2024-09-10T23:15:46.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.295+0000 7f920a3ca640 1 -- 172.21.15.90:0/378628359 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92040cf1f0 con 0x7f920415e260 2024-09-10T23:15:46.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.295+0000 7f9200ff9640 1 -- 172.21.15.90:0/378628359 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f91fc022030 con 0x7f920415e260 2024-09-10T23:15:46.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.296+0000 7f9200ff9640 1 --2- 172.21.15.90:0/378628359 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f91f0077f70 0x7f91f007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:46.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.296+0000 7f9200ff9640 1 -- 172.21.15.90:0/378628359 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f91fc09be70 con 0x7f920415e260 2024-09-10T23:15:46.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.296+0000 7f9203fff640 1 --2- 172.21.15.90:0/378628359 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f91f0077f70 0x7f91f007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:46.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.297+0000 7f9203fff640 1 --2- 172.21.15.90:0/378628359 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f91f0077f70 0x7f91f007a430 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f91f4000f60 tx=0x7f91f4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:46.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.300+0000 7f9200ff9640 1 -- 172.21.15.90:0/378628359 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f91fc016030 con 0x7f920415e260 2024-09-10T23:15:46.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.471+0000 7f920a3ca640 1 -- 172.21.15.90:0/378628359 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f92041f15e0 con 0x7f91f0077f70 2024-09-10T23:15:46.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.476+0000 7f9200ff9640 1 -- 172.21.15.90:0/378628359 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250802 (secure 0 0 0) 0x7f92041f15e0 con 0x7f91f0077f70 2024-09-10T23:15:46.479 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:46.480 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:15:46.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.479+0000 7f920a3ca640 1 -- 172.21.15.90:0/378628359 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f91f0077f70 msgr2=0x7f91f007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:46.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.479+0000 7f920a3ca640 1 --2- 172.21.15.90:0/378628359 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f91f0077f70 0x7f91f007a430 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f91f4000f60 tx=0x7f91f4009040 comp rx=0 tx=0).stop 2024-09-10T23:15:46.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.479+0000 7f920a3ca640 1 -- 172.21.15.90:0/378628359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f920415e260 msgr2=0x7f92040b52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:46.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.479+0000 7f920a3ca640 1 --2- 172.21.15.90:0/378628359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f920415e260 0x7f92040b52d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00c6d0 tx=0x7f91fc00cb90 comp rx=0 tx=0).stop 2024-09-10T23:15:46.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.479+0000 7f920a3ca640 1 -- 172.21.15.90:0/378628359 shutdown_connections 2024-09-10T23:15:46.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.479+0000 7f920a3ca640 1 --2- 172.21.15.90:0/378628359 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f91f0077f70 0x7f91f007a430 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.479+0000 7f920a3ca640 1 --2- 172.21.15.90:0/378628359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92040d1190 0x7f92041f0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.479+0000 7f920a3ca640 1 --2- 172.21.15.90:0/378628359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f920415e260 0x7f92040b52d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.479+0000 7f920a3ca640 1 --2- 172.21.15.90:0/378628359 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92040af4a0 0x7f92041595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.479+0000 7f920a3ca640 1 -- 172.21.15.90:0/378628359 >> 172.21.15.90:0/378628359 conn(0x7f92040d0490 msgr2=0x7f9204070740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:46.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.479+0000 7f920a3ca640 1 -- 172.21.15.90:0/378628359 shutdown_connections 2024-09-10T23:15:46.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.479+0000 7f920a3ca640 1 -- 172.21.15.90:0/378628359 wait complete. 2024-09-10T23:15:46.491 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-09-10T23:15:46.448813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":133,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225748,"kb_used_data":5332,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748972,"statfs":{"total":773094113280,"available":772862947328,"internally_reserved":0,"allocated":5459968,"data_stored":2863319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.960789"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516290+0000","last_change":"2024-09-10T23:15:43.531769+0000","last_active":"2024-09-10T23:15:44.516290+0000","last_peered":"2024-09-10T23:15:44.516290+0000","last_clean":"2024-09-10T23:15:44.516290+0000","last_became_active":"2024-09-10T23:15:43.531487+0000","last_became_peered":"2024-09-10T23:15:43.531487+0000","last_unstale":"2024-09-10T23:15:44.516290+0000","last_undegraded":"2024-09-10T23:15:44.516290+0000","last_fullsized":"2024-09-10T23:15:44.516290+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:59.369815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516729+0000","last_change":"2024-09-10T23:15:43.529475+0000","last_active":"2024-09-10T23:15:44.516729+0000","last_peered":"2024-09-10T23:15:44.516729+0000","last_clean":"2024-09-10T23:15:44.516729+0000","last_became_active":"2024-09-10T23:15:43.529175+0000","last_became_peered":"2024-09-10T23:15:43.529175+0000","last_unstale":"2024-09-10T23:15:44.516729+0000","last_undegraded":"2024-09-10T23:15:44.516729+0000","last_fullsized":"2024-09-10T23:15:44.516729+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:42.574340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932949+0000","last_change":"2024-09-10T23:15:43.527735+0000","last_active":"2024-09-10T23:15:44.932949+0000","last_peered":"2024-09-10T23:15:44.932949+0000","last_clean":"2024-09-10T23:15:44.932949+0000","last_became_active":"2024-09-10T23:15:43.527276+0000","last_became_peered":"2024-09-10T23:15:43.527276+0000","last_unstale":"2024-09-10T23:15:44.932949+0000","last_undegraded":"2024-09-10T23:15:44.932949+0000","last_fullsized":"2024-09-10T23:15:44.932949+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:39.709891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.501516+0000","last_change":"2024-09-10T23:15:42.501516+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.501516+0000","last_undegraded":"2024-09-10T23:15:42.501516+0000","last_fullsized":"2024-09-10T23:15:42.501516+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516486+0000","last_change":"2024-09-10T23:15:43.529380+0000","last_active":"2024-09-10T23:15:44.516486+0000","last_peered":"2024-09-10T23:15:44.516486+0000","last_clean":"2024-09-10T23:15:44.516486+0000","last_became_active":"2024-09-10T23:15:43.529090+0000","last_became_peered":"2024-09-10T23:15:43.529090+0000","last_unstale":"2024-09-10T23:15:44.516486+0000","last_undegraded":"2024-09-10T23:15:44.516486+0000","last_fullsized":"2024-09-10T23:15:44.516486+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:52.446596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931825+0000","last_change":"2024-09-10T23:15:43.533375+0000","last_active":"2024-09-10T23:15:44.931825+0000","last_peered":"2024-09-10T23:15:44.931825+0000","last_clean":"2024-09-10T23:15:44.931825+0000","last_became_active":"2024-09-10T23:15:43.533088+0000","last_became_peered":"2024-09-10T23:15:43.533088+0000","last_unstale":"2024-09-10T23:15:44.931825+0000","last_undegraded":"2024-09-10T23:15:44.931825+0000","last_fullsized":"2024-09-10T23:15:44.931825+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:28.504092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516163+0000","last_change":"2024-09-10T23:15:43.543935+0000","last_active":"2024-09-10T23:15:44.516163+0000","last_peered":"2024-09-10T23:15:44.516163+0000","last_clean":"2024-09-10T23:15:44.516163+0000","last_became_active":"2024-09-10T23:15:43.543641+0000","last_became_peered":"2024-09-10T23:15:43.543641+0000","last_unstale":"2024-09-10T23:15:44.516163+0000","last_undegraded":"2024-09-10T23:15:44.516163+0000","last_fullsized":"2024-09-10T23:15:44.516163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:23.451112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.501129+0000","last_change":"2024-09-10T23:15:42.501129+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.501129+0000","last_undegraded":"2024-09-10T23:15:42.501129+0000","last_fullsized":"2024-09-10T23:15:42.501129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.501467+0000","last_change":"2024-09-10T23:15:42.501467+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.501467+0000","last_undegraded":"2024-09-10T23:15:42.501467+0000","last_fullsized":"2024-09-10T23:15:42.501467+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.499597+0000","last_change":"2024-09-10T23:15:42.499597+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.499597+0000","last_undegraded":"2024-09-10T23:15:42.499597+0000","last_fullsized":"2024-09-10T23:15:42.499597+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.498776+0000","last_change":"2024-09-10T23:15:42.498776+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.498776+0000","last_undegraded":"2024-09-10T23:15:42.498776+0000","last_fullsized":"2024-09-10T23:15:42.498776+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517339+0000","last_change":"2024-09-10T23:15:43.529156+0000","last_active":"2024-09-10T23:15:44.517339+0000","last_peered":"2024-09-10T23:15:44.517339+0000","last_clean":"2024-09-10T23:15:44.517339+0000","last_became_active":"2024-09-10T23:15:43.528877+0000","last_became_peered":"2024-09-10T23:15:43.528877+0000","last_unstale":"2024-09-10T23:15:44.517339+0000","last_undegraded":"2024-09-10T23:15:44.517339+0000","last_fullsized":"2024-09-10T23:15:44.517339+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:58.070612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931161+0000","last_change":"2024-09-10T23:15:43.527284+0000","last_active":"2024-09-10T23:15:44.931161+0000","last_peered":"2024-09-10T23:15:44.931161+0000","last_clean":"2024-09-10T23:15:44.931161+0000","last_became_active":"2024-09-10T23:15:43.527019+0000","last_became_peered":"2024-09-10T23:15:43.527019+0000","last_unstale":"2024-09-10T23:15:44.931161+0000","last_undegraded":"2024-09-10T23:15:44.931161+0000","last_fullsized":"2024-09-10T23:15:44.931161+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:20.558073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.498260+0000","last_change":"2024-09-10T23:15:42.498260+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.498260+0000","last_undegraded":"2024-09-10T23:15:42.498260+0000","last_fullsized":"2024-09-10T23:15:42.498260+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931121+0000","last_change":"2024-09-10T23:15:43.530842+0000","last_active":"2024-09-10T23:15:44.931121+0000","last_peered":"2024-09-10T23:15:44.931121+0000","last_clean":"2024-09-10T23:15:44.931121+0000","last_became_active":"2024-09-10T23:15:43.530559+0000","last_became_peered":"2024-09-10T23:15:43.530559+0000","last_unstale":"2024-09-10T23:15:44.931121+0000","last_undegraded":"2024-09-10T23:15:44.931121+0000","last_fullsized":"2024-09-10T23:15:44.931121+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:41.393470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931624+0000","last_change":"2024-09-10T23:15:43.533130+0000","last_active":"2024-09-10T23:15:44.931624+0000","last_peered":"2024-09-10T23:15:44.931624+0000","last_clean":"2024-09-10T23:15:44.931624+0000","last_became_active":"2024-09-10T23:15:43.532800+0000","last_became_peered":"2024-09-10T23:15:43.532800+0000","last_unstale":"2024-09-10T23:15:44.931624+0000","last_undegraded":"2024-09-10T23:15:44.931624+0000","last_fullsized":"2024-09-10T23:15:44.931624+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:22.539205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933198+0000","last_change":"2024-09-10T23:15:43.524871+0000","last_active":"2024-09-10T23:15:44.933198+0000","last_peered":"2024-09-10T23:15:44.933198+0000","last_clean":"2024-09-10T23:15:44.933198+0000","last_became_active":"2024-09-10T23:15:43.524580+0000","last_became_peered":"2024-09-10T23:15:43.524580+0000","last_unstale":"2024-09-10T23:15:44.933198+0000","last_undegraded":"2024-09-10T23:15:44.933198+0000","last_fullsized":"2024-09-10T23:15:44.933198+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:46.276138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933038+0000","last_change":"2024-09-10T23:15:43.530280+0000","last_active":"2024-09-10T23:15:44.933038+0000","last_peered":"2024-09-10T23:15:44.933038+0000","last_clean":"2024-09-10T23:15:44.933038+0000","last_became_active":"2024-09-10T23:15:43.529987+0000","last_became_peered":"2024-09-10T23:15:43.529987+0000","last_unstale":"2024-09-10T23:15:44.933038+0000","last_undegraded":"2024-09-10T23:15:44.933038+0000","last_fullsized":"2024-09-10T23:15:44.933038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:56.385670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932219+0000","last_change":"2024-09-10T23:15:43.532316+0000","last_active":"2024-09-10T23:15:44.932219+0000","last_peered":"2024-09-10T23:15:44.932219+0000","last_clean":"2024-09-10T23:15:44.932219+0000","last_became_active":"2024-09-10T23:15:43.532064+0000","last_became_peered":"2024-09-10T23:15:43.532064+0000","last_unstale":"2024-09-10T23:15:44.932219+0000","last_undegraded":"2024-09-10T23:15:44.932219+0000","last_fullsized":"2024-09-10T23:15:44.932219+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:43.137866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931596+0000","last_change":"2024-09-10T23:15:43.531896+0000","last_active":"2024-09-10T23:15:44.931596+0000","last_peered":"2024-09-10T23:15:44.931596+0000","last_clean":"2024-09-10T23:15:44.931596+0000","last_became_active":"2024-09-10T23:15:43.531650+0000","last_became_peered":"2024-09-10T23:15:43.531650+0000","last_unstale":"2024-09-10T23:15:44.931596+0000","last_undegraded":"2024-09-10T23:15:44.931596+0000","last_fullsized":"2024-09-10T23:15:44.931596+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:49.987654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932163+0000","last_change":"2024-09-10T23:15:43.538991+0000","last_active":"2024-09-10T23:15:44.932163+0000","last_peered":"2024-09-10T23:15:44.932163+0000","last_clean":"2024-09-10T23:15:44.932163+0000","last_became_active":"2024-09-10T23:15:43.538544+0000","last_became_peered":"2024-09-10T23:15:43.538544+0000","last_unstale":"2024-09-10T23:15:44.932163+0000","last_undegraded":"2024-09-10T23:15:44.932163+0000","last_fullsized":"2024-09-10T23:15:44.932163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:00.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.493997+0000","last_change":"2024-09-10T23:15:42.493997+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.493997+0000","last_undegraded":"2024-09-10T23:15:42.493997+0000","last_fullsized":"2024-09-10T23:15:42.493997+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931912+0000","last_change":"2024-09-10T23:15:43.535424+0000","last_active":"2024-09-10T23:15:44.931912+0000","last_peered":"2024-09-10T23:15:44.931912+0000","last_clean":"2024-09-10T23:15:44.931912+0000","last_became_active":"2024-09-10T23:15:43.535182+0000","last_became_peered":"2024-09-10T23:15:43.535182+0000","last_unstale":"2024-09-10T23:15:44.931912+0000","last_undegraded":"2024-09-10T23:15:44.931912+0000","last_fullsized":"2024-09-10T23:15:44.931912+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:30.995258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931643+0000","last_change":"2024-09-10T23:15:43.534813+0000","last_active":"2024-09-10T23:15:44.931643+0000","last_peered":"2024-09-10T23:15:44.931643+0000","last_clean":"2024-09-10T23:15:44.931643+0000","last_became_active":"2024-09-10T23:15:43.534529+0000","last_became_peered":"2024-09-10T23:15:43.534529+0000","last_unstale":"2024-09-10T23:15:44.931643+0000","last_undegraded":"2024-09-10T23:15:44.931643+0000","last_fullsized":"2024-09-10T23:15:44.931643+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:52.674972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932061+0000","last_change":"2024-09-10T23:15:43.536434+0000","last_active":"2024-09-10T23:15:44.932061+0000","last_peered":"2024-09-10T23:15:44.932061+0000","last_clean":"2024-09-10T23:15:44.932061+0000","last_became_active":"2024-09-10T23:15:43.536045+0000","last_became_peered":"2024-09-10T23:15:43.536045+0000","last_unstale":"2024-09-10T23:15:44.932061+0000","last_undegraded":"2024-09-10T23:15:44.932061+0000","last_fullsized":"2024-09-10T23:15:44.932061+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:41.288775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931088+0000","last_change":"2024-09-10T23:15:43.525079+0000","last_active":"2024-09-10T23:15:44.931088+0000","last_peered":"2024-09-10T23:15:44.931088+0000","last_clean":"2024-09-10T23:15:44.931088+0000","last_became_active":"2024-09-10T23:15:43.524767+0000","last_became_peered":"2024-09-10T23:15:43.524767+0000","last_unstale":"2024-09-10T23:15:44.931088+0000","last_undegraded":"2024-09-10T23:15:44.931088+0000","last_fullsized":"2024-09-10T23:15:44.931088+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:43.164571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933052+0000","last_change":"2024-09-10T23:15:43.527365+0000","last_active":"2024-09-10T23:15:44.933052+0000","last_peered":"2024-09-10T23:15:44.933052+0000","last_clean":"2024-09-10T23:15:44.933052+0000","last_became_active":"2024-09-10T23:15:43.527076+0000","last_became_peered":"2024-09-10T23:15:43.527076+0000","last_unstale":"2024-09-10T23:15:44.933052+0000","last_undegraded":"2024-09-10T23:15:44.933052+0000","last_fullsized":"2024-09-10T23:15:44.933052+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:03.936831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517372+0000","last_change":"2024-09-10T23:15:43.528612+0000","last_active":"2024-09-10T23:15:44.517372+0000","last_peered":"2024-09-10T23:15:44.517372+0000","last_clean":"2024-09-10T23:15:44.517372+0000","last_became_active":"2024-09-10T23:15:43.528315+0000","last_became_peered":"2024-09-10T23:15:43.528315+0000","last_unstale":"2024-09-10T23:15:44.517372+0000","last_undegraded":"2024-09-10T23:15:44.517372+0000","last_fullsized":"2024-09-10T23:15:44.517372+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:28.073391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931746+0000","last_change":"2024-09-10T23:15:43.535273+0000","last_active":"2024-09-10T23:15:44.931746+0000","last_peered":"2024-09-10T23:15:44.931746+0000","last_clean":"2024-09-10T23:15:44.931746+0000","last_became_active":"2024-09-10T23:15:43.535024+0000","last_became_peered":"2024-09-10T23:15:43.535024+0000","last_unstale":"2024-09-10T23:15:44.931746+0000","last_undegraded":"2024-09-10T23:15:44.931746+0000","last_fullsized":"2024-09-10T23:15:44.931746+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:04.093540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932900+0000","last_change":"2024-09-10T23:15:43.527299+0000","last_active":"2024-09-10T23:15:44.932900+0000","last_peered":"2024-09-10T23:15:44.932900+0000","last_clean":"2024-09-10T23:15:44.932900+0000","last_became_active":"2024-09-10T23:15:43.526863+0000","last_became_peered":"2024-09-10T23:15:43.526863+0000","last_unstale":"2024-09-10T23:15:44.932900+0000","last_undegraded":"2024-09-10T23:15:44.932900+0000","last_fullsized":"2024-09-10T23:15:44.932900+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:11.752339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931322+0000","last_change":"2024-09-10T23:15:43.530364+0000","last_active":"2024-09-10T23:15:44.931322+0000","last_peered":"2024-09-10T23:15:44.931322+0000","last_clean":"2024-09-10T23:15:44.931322+0000","last_became_active":"2024-09-10T23:15:43.530090+0000","last_became_peered":"2024-09-10T23:15:43.530090+0000","last_unstale":"2024-09-10T23:15:44.931322+0000","last_undegraded":"2024-09-10T23:15:44.931322+0000","last_fullsized":"2024-09-10T23:15:44.931322+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:54.877057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.930861+0000","last_change":"2024-09-10T23:15:43.521138+0000","last_active":"2024-09-10T23:15:44.930861+0000","last_peered":"2024-09-10T23:15:44.930861+0000","last_clean":"2024-09-10T23:15:44.930861+0000","last_became_active":"2024-09-10T23:15:43.520871+0000","last_became_peered":"2024-09-10T23:15:43.520871+0000","last_unstale":"2024-09-10T23:15:44.930861+0000","last_undegraded":"2024-09-10T23:15:44.930861+0000","last_fullsized":"2024-09-10T23:15:44.930861+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:48.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.515005+0000","last_change":"2024-09-10T23:15:43.528339+0000","last_active":"2024-09-10T23:15:44.515005+0000","last_peered":"2024-09-10T23:15:44.515005+0000","last_clean":"2024-09-10T23:15:44.515005+0000","last_became_active":"2024-09-10T23:15:43.528000+0000","last_became_peered":"2024-09-10T23:15:43.528000+0000","last_unstale":"2024-09-10T23:15:44.515005+0000","last_undegraded":"2024-09-10T23:15:44.515005+0000","last_fullsized":"2024-09-10T23:15:44.515005+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:41.252238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932530+0000","last_change":"2024-09-10T23:15:42.511719+0000","last_active":"2024-09-10T23:15:44.932530+0000","last_peered":"2024-09-10T23:15:44.932530+0000","last_clean":"2024-09-10T23:15:44.932530+0000","last_became_active":"2024-09-10T23:15:42.511478+0000","last_became_peered":"2024-09-10T23:15:42.511478+0000","last_unstale":"2024-09-10T23:15:44.932530+0000","last_undegraded":"2024-09-10T23:15:44.932530+0000","last_fullsized":"2024-09-10T23:15:44.932530+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:33.981158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932123+0000","last_change":"2024-09-10T23:15:43.523565+0000","last_active":"2024-09-10T23:15:44.932123+0000","last_peered":"2024-09-10T23:15:44.932123+0000","last_clean":"2024-09-10T23:15:44.932123+0000","last_became_active":"2024-09-10T23:15:43.523272+0000","last_became_peered":"2024-09-10T23:15:43.523272+0000","last_unstale":"2024-09-10T23:15:44.932123+0000","last_undegraded":"2024-09-10T23:15:44.932123+0000","last_fullsized":"2024-09-10T23:15:44.932123+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:41.252238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933175+0000","last_change":"2024-09-10T23:15:42.511614+0000","last_active":"2024-09-10T23:15:44.933175+0000","last_peered":"2024-09-10T23:15:44.933175+0000","last_clean":"2024-09-10T23:15:44.933175+0000","last_became_active":"2024-09-10T23:15:42.511315+0000","last_became_peered":"2024-09-10T23:15:42.511315+0000","last_unstale":"2024-09-10T23:15:44.933175+0000","last_undegraded":"2024-09-10T23:15:44.933175+0000","last_fullsized":"2024-09-10T23:15:44.933175+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:51.671803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517486+0000","last_change":"2024-09-10T23:15:43.529829+0000","last_active":"2024-09-10T23:15:44.517486+0000","last_peered":"2024-09-10T23:15:44.517486+0000","last_clean":"2024-09-10T23:15:44.517486+0000","last_became_active":"2024-09-10T23:15:43.529545+0000","last_became_peered":"2024-09-10T23:15:43.529545+0000","last_unstale":"2024-09-10T23:15:44.517486+0000","last_undegraded":"2024-09-10T23:15:44.517486+0000","last_fullsized":"2024-09-10T23:15:44.517486+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:37.792217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514966+0000","last_change":"2024-09-10T23:15:42.507388+0000","last_active":"2024-09-10T23:15:44.514966+0000","last_peered":"2024-09-10T23:15:44.514966+0000","last_clean":"2024-09-10T23:15:44.514966+0000","last_became_active":"2024-09-10T23:15:42.507140+0000","last_became_peered":"2024-09-10T23:15:42.507140+0000","last_unstale":"2024-09-10T23:15:44.514966+0000","last_undegraded":"2024-09-10T23:15:44.514966+0000","last_fullsized":"2024-09-10T23:15:44.514966+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:00.620682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514992+0000","last_change":"2024-09-10T23:15:43.535494+0000","last_active":"2024-09-10T23:15:44.514992+0000","last_peered":"2024-09-10T23:15:44.514992+0000","last_clean":"2024-09-10T23:15:44.514992+0000","last_became_active":"2024-09-10T23:15:43.535197+0000","last_became_peered":"2024-09-10T23:15:43.535197+0000","last_unstale":"2024-09-10T23:15:44.514992+0000","last_undegraded":"2024-09-10T23:15:44.514992+0000","last_fullsized":"2024-09-10T23:15:44.514992+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:51.184507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.515748+0000","last_change":"2024-09-10T23:15:42.507889+0000","last_active":"2024-09-10T23:15:44.515748+0000","last_peered":"2024-09-10T23:15:44.515748+0000","last_clean":"2024-09-10T23:15:44.515748+0000","last_became_active":"2024-09-10T23:15:42.507525+0000","last_became_peered":"2024-09-10T23:15:42.507525+0000","last_unstale":"2024-09-10T23:15:44.515748+0000","last_undegraded":"2024-09-10T23:15:44.515748+0000","last_fullsized":"2024-09-10T23:15:44.515748+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:31.136115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932861+0000","last_change":"2024-09-10T23:15:43.528047+0000","last_active":"2024-09-10T23:15:44.932861+0000","last_peered":"2024-09-10T23:15:44.932861+0000","last_clean":"2024-09-10T23:15:44.932861+0000","last_became_active":"2024-09-10T23:15:43.527788+0000","last_became_peered":"2024-09-10T23:15:43.527788+0000","last_unstale":"2024-09-10T23:15:44.932861+0000","last_undegraded":"2024-09-10T23:15:44.932861+0000","last_fullsized":"2024-09-10T23:15:44.932861+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:52.085571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932226+0000","last_change":"2024-09-10T23:15:42.504164+0000","last_active":"2024-09-10T23:15:44.932226+0000","last_peered":"2024-09-10T23:15:44.932226+0000","last_clean":"2024-09-10T23:15:44.932226+0000","last_became_active":"2024-09-10T23:15:42.503841+0000","last_became_peered":"2024-09-10T23:15:42.503841+0000","last_unstale":"2024-09-10T23:15:44.932226+0000","last_undegraded":"2024-09-10T23:15:44.932226+0000","last_fullsized":"2024-09-10T23:15:44.932226+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:51.973570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.497880+0000","last_change":"2024-09-10T23:15:42.497880+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.497880+0000","last_undegraded":"2024-09-10T23:15:42.497880+0000","last_fullsized":"2024-09-10T23:15:42.497880+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933092+0000","last_change":"2024-09-10T23:15:42.507501+0000","last_active":"2024-09-10T23:15:44.933092+0000","last_peered":"2024-09-10T23:15:44.933092+0000","last_clean":"2024-09-10T23:15:44.933092+0000","last_became_active":"2024-09-10T23:15:42.507224+0000","last_became_peered":"2024-09-10T23:15:42.507224+0000","last_unstale":"2024-09-10T23:15:44.933092+0000","last_undegraded":"2024-09-10T23:15:44.933092+0000","last_fullsized":"2024-09-10T23:15:44.933092+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:41.069742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.498212+0000","last_change":"2024-09-10T23:15:42.498212+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.498212+0000","last_undegraded":"2024-09-10T23:15:42.498212+0000","last_fullsized":"2024-09-10T23:15:42.498212+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516014+0000","last_change":"2024-09-10T23:15:42.500537+0000","last_active":"2024-09-10T23:15:44.516014+0000","last_peered":"2024-09-10T23:15:44.516014+0000","last_clean":"2024-09-10T23:15:44.516014+0000","last_became_active":"2024-09-10T23:15:42.500174+0000","last_became_peered":"2024-09-10T23:15:42.500174+0000","last_unstale":"2024-09-10T23:15:44.516014+0000","last_undegraded":"2024-09-10T23:15:44.516014+0000","last_fullsized":"2024-09-10T23:15:44.516014+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:42.134697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931662+0000","last_change":"2024-09-10T23:15:43.534456+0000","last_active":"2024-09-10T23:15:44.931662+0000","last_peered":"2024-09-10T23:15:44.931662+0000","last_clean":"2024-09-10T23:15:44.931662+0000","last_became_active":"2024-09-10T23:15:43.534189+0000","last_became_peered":"2024-09-10T23:15:43.534189+0000","last_unstale":"2024-09-10T23:15:44.931662+0000","last_undegraded":"2024-09-10T23:15:44.931662+0000","last_fullsized":"2024-09-10T23:15:44.931662+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:10.389011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.508230+0000","last_change":"2024-09-10T23:15:42.504650+0000","last_active":"2024-09-10T23:15:42.508230+0000","last_peered":"2024-09-10T23:15:42.508230+0000","last_clean":"2024-09-10T23:15:42.508230+0000","last_became_active":"2024-09-10T23:15:42.504410+0000","last_became_peered":"2024-09-10T23:15:42.504410+0000","last_unstale":"2024-09-10T23:15:42.508230+0000","last_undegraded":"2024-09-10T23:15:42.508230+0000","last_fullsized":"2024-09-10T23:15:42.508230+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:45.052771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933152+0000","last_change":"2024-09-10T23:15:43.531044+0000","last_active":"2024-09-10T23:15:44.933152+0000","last_peered":"2024-09-10T23:15:44.933152+0000","last_clean":"2024-09-10T23:15:44.933152+0000","last_became_active":"2024-09-10T23:15:43.530763+0000","last_became_peered":"2024-09-10T23:15:43.530763+0000","last_unstale":"2024-09-10T23:15:44.933152+0000","last_undegraded":"2024-09-10T23:15:44.933152+0000","last_fullsized":"2024-09-10T23:15:44.933152+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:52.976739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933174+0000","last_change":"2024-09-10T23:15:42.497687+0000","last_active":"2024-09-10T23:15:44.933174+0000","last_peered":"2024-09-10T23:15:44.933174+0000","last_clean":"2024-09-10T23:15:44.933174+0000","last_became_active":"2024-09-10T23:15:42.497411+0000","last_became_peered":"2024-09-10T23:15:42.497411+0000","last_unstale":"2024-09-10T23:15:44.933174+0000","last_undegraded":"2024-09-10T23:15:44.933174+0000","last_fullsized":"2024-09-10T23:15:44.933174+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:07.647238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516410+0000","last_change":"2024-09-10T23:15:43.537527+0000","last_active":"2024-09-10T23:15:44.516410+0000","last_peered":"2024-09-10T23:15:44.516410+0000","last_clean":"2024-09-10T23:15:44.516410+0000","last_became_active":"2024-09-10T23:15:43.537079+0000","last_became_peered":"2024-09-10T23:15:43.537079+0000","last_unstale":"2024-09-10T23:15:44.516410+0000","last_undegraded":"2024-09-10T23:15:44.516410+0000","last_fullsized":"2024-09-10T23:15:44.516410+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:07.594488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.507897+0000","last_change":"2024-09-10T23:15:42.504742+0000","last_active":"2024-09-10T23:15:42.507897+0000","last_peered":"2024-09-10T23:15:42.507897+0000","last_clean":"2024-09-10T23:15:42.507897+0000","last_became_active":"2024-09-10T23:15:42.504469+0000","last_became_peered":"2024-09-10T23:15:42.504469+0000","last_unstale":"2024-09-10T23:15:42.507897+0000","last_undegraded":"2024-09-10T23:15:42.507897+0000","last_fullsized":"2024-09-10T23:15:42.507897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:26.061097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932516+0000","last_change":"2024-09-10T23:15:43.536547+0000","last_active":"2024-09-10T23:15:44.932516+0000","last_peered":"2024-09-10T23:15:44.932516+0000","last_clean":"2024-09-10T23:15:44.932516+0000","last_became_active":"2024-09-10T23:15:43.535697+0000","last_became_peered":"2024-09-10T23:15:43.535697+0000","last_unstale":"2024-09-10T23:15:44.932516+0000","last_undegraded":"2024-09-10T23:15:44.932516+0000","last_fullsized":"2024-09-10T23:15:44.932516+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:02.345671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516552+0000","last_change":"2024-09-10T23:15:42.512649+0000","last_active":"2024-09-10T23:15:44.516552+0000","last_peered":"2024-09-10T23:15:44.516552+0000","last_clean":"2024-09-10T23:15:44.516552+0000","last_became_active":"2024-09-10T23:15:42.512284+0000","last_became_peered":"2024-09-10T23:15:42.512284+0000","last_unstale":"2024-09-10T23:15:44.516552+0000","last_undegraded":"2024-09-10T23:15:44.516552+0000","last_fullsized":"2024-09-10T23:15:44.516552+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:02.933662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516269+0000","last_change":"2024-09-10T23:15:43.543825+0000","last_active":"2024-09-10T23:15:44.516269+0000","last_peered":"2024-09-10T23:15:44.516269+0000","last_clean":"2024-09-10T23:15:44.516269+0000","last_became_active":"2024-09-10T23:15:43.543546+0000","last_became_peered":"2024-09-10T23:15:43.543546+0000","last_unstale":"2024-09-10T23:15:44.516269+0000","last_undegraded":"2024-09-10T23:15:44.516269+0000","last_fullsized":"2024-09-10T23:15:44.516269+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:29.218569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931707+0000","last_change":"2024-09-10T23:15:42.499400+0000","last_active":"2024-09-10T23:15:44.931707+0000","last_peered":"2024-09-10T23:15:44.931707+0000","last_clean":"2024-09-10T23:15:44.931707+0000","last_became_active":"2024-09-10T23:15:42.499123+0000","last_became_peered":"2024-09-10T23:15:42.499123+0000","last_unstale":"2024-09-10T23:15:44.931707+0000","last_undegraded":"2024-09-10T23:15:44.931707+0000","last_fullsized":"2024-09-10T23:15:44.931707+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:27.654745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932077+0000","last_change":"2024-09-10T23:15:43.532558+0000","last_active":"2024-09-10T23:15:44.932077+0000","last_peered":"2024-09-10T23:15:44.932077+0000","last_clean":"2024-09-10T23:15:44.932077+0000","last_became_active":"2024-09-10T23:15:43.532269+0000","last_became_peered":"2024-09-10T23:15:43.532269+0000","last_unstale":"2024-09-10T23:15:44.932077+0000","last_undegraded":"2024-09-10T23:15:44.932077+0000","last_fullsized":"2024-09-10T23:15:44.932077+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:49.306185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932280+0000","last_change":"2024-09-10T23:15:42.508928+0000","last_active":"2024-09-10T23:15:44.932280+0000","last_peered":"2024-09-10T23:15:44.932280+0000","last_clean":"2024-09-10T23:15:44.932280+0000","last_became_active":"2024-09-10T23:15:42.508568+0000","last_became_peered":"2024-09-10T23:15:42.508568+0000","last_unstale":"2024-09-10T23:15:44.932280+0000","last_undegraded":"2024-09-10T23:15:44.932280+0000","last_fullsized":"2024-09-10T23:15:44.932280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:55.382501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.496416+0000","last_change":"2024-09-10T23:15:42.496416+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.496416+0000","last_undegraded":"2024-09-10T23:15:42.496416+0000","last_fullsized":"2024-09-10T23:15:42.496416+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516010+0000","last_change":"2024-09-10T23:15:42.502106+0000","last_active":"2024-09-10T23:15:44.516010+0000","last_peered":"2024-09-10T23:15:44.516010+0000","last_clean":"2024-09-10T23:15:44.516010+0000","last_became_active":"2024-09-10T23:15:42.501620+0000","last_became_peered":"2024-09-10T23:15:42.501620+0000","last_unstale":"2024-09-10T23:15:44.516010+0000","last_undegraded":"2024-09-10T23:15:44.516010+0000","last_fullsized":"2024-09-10T23:15:44.516010+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:42.459571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.930865+0000","last_change":"2024-09-10T23:15:43.534217+0000","last_active":"2024-09-10T23:15:44.930865+0000","last_peered":"2024-09-10T23:15:44.930865+0000","last_clean":"2024-09-10T23:15:44.930865+0000","last_became_active":"2024-09-10T23:15:43.533952+0000","last_became_peered":"2024-09-10T23:15:43.533952+0000","last_unstale":"2024-09-10T23:15:44.930865+0000","last_undegraded":"2024-09-10T23:15:44.930865+0000","last_fullsized":"2024-09-10T23:15:44.930865+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:46:57.091610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931425+0000","last_change":"2024-09-10T23:15:42.508283+0000","last_active":"2024-09-10T23:15:44.931425+0000","last_peered":"2024-09-10T23:15:44.931425+0000","last_clean":"2024-09-10T23:15:44.931425+0000","last_became_active":"2024-09-10T23:15:42.508016+0000","last_became_peered":"2024-09-10T23:15:42.508016+0000","last_unstale":"2024-09-10T23:15:44.931425+0000","last_undegraded":"2024-09-10T23:15:44.931425+0000","last_fullsized":"2024-09-10T23:15:44.931425+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:38.706722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516424+0000","last_change":"2024-09-10T23:15:43.540626+0000","last_active":"2024-09-10T23:15:44.516424+0000","last_peered":"2024-09-10T23:15:44.516424+0000","last_clean":"2024-09-10T23:15:44.516424+0000","last_became_active":"2024-09-10T23:15:43.540323+0000","last_became_peered":"2024-09-10T23:15:43.540323+0000","last_unstale":"2024-09-10T23:15:44.516424+0000","last_undegraded":"2024-09-10T23:15:44.516424+0000","last_fullsized":"2024-09-10T23:15:44.516424+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:27.806294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.509136+0000","last_change":"2024-09-10T23:15:42.507669+0000","last_active":"2024-09-10T23:15:42.509136+0000","last_peered":"2024-09-10T23:15:42.509136+0000","last_clean":"2024-09-10T23:15:42.509136+0000","last_became_active":"2024-09-10T23:15:42.507393+0000","last_became_peered":"2024-09-10T23:15:42.507393+0000","last_unstale":"2024-09-10T23:15:42.509136+0000","last_undegraded":"2024-09-10T23:15:42.509136+0000","last_fullsized":"2024-09-10T23:15:42.509136+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:53.985338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931271+0000","last_change":"2024-09-10T23:15:43.518692+0000","last_active":"2024-09-10T23:15:44.931271+0000","last_peered":"2024-09-10T23:15:44.931271+0000","last_clean":"2024-09-10T23:15:44.931271+0000","last_became_active":"2024-09-10T23:15:43.518325+0000","last_became_peered":"2024-09-10T23:15:43.518325+0000","last_unstale":"2024-09-10T23:15:44.931271+0000","last_undegraded":"2024-09-10T23:15:44.931271+0000","last_fullsized":"2024-09-10T23:15:44.931271+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:26.438912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931431+0000","last_change":"2024-09-10T23:15:42.501325+0000","last_active":"2024-09-10T23:15:44.931431+0000","last_peered":"2024-09-10T23:15:44.931431+0000","last_clean":"2024-09-10T23:15:44.931431+0000","last_became_active":"2024-09-10T23:15:42.501051+0000","last_became_peered":"2024-09-10T23:15:42.501051+0000","last_unstale":"2024-09-10T23:15:44.931431+0000","last_undegraded":"2024-09-10T23:15:44.931431+0000","last_fullsized":"2024-09-10T23:15:44.931431+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:01.930458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.496590+0000","last_change":"2024-09-10T23:15:42.496590+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.496590+0000","last_undegraded":"2024-09-10T23:15:42.496590+0000","last_fullsized":"2024-09-10T23:15:42.496590+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933250+0000","last_change":"2024-09-10T23:15:42.499477+0000","last_active":"2024-09-10T23:15:44.933250+0000","last_peered":"2024-09-10T23:15:44.933250+0000","last_clean":"2024-09-10T23:15:44.933250+0000","last_became_active":"2024-09-10T23:15:42.499161+0000","last_became_peered":"2024-09-10T23:15:42.499161+0000","last_unstale":"2024-09-10T23:15:44.933250+0000","last_undegraded":"2024-09-10T23:15:44.933250+0000","last_fullsized":"2024-09-10T23:15:44.933250+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:00.620682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931894+0000","last_change":"2024-09-10T23:15:43.530654+0000","last_active":"2024-09-10T23:15:44.931894+0000","last_peered":"2024-09-10T23:15:44.931894+0000","last_clean":"2024-09-10T23:15:44.931894+0000","last_became_active":"2024-09-10T23:15:43.530378+0000","last_became_peered":"2024-09-10T23:15:43.530378+0000","last_unstale":"2024-09-10T23:15:44.931894+0000","last_undegraded":"2024-09-10T23:15:44.931894+0000","last_fullsized":"2024-09-10T23:15:44.931894+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:36.613962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516809+0000","last_change":"2024-09-10T23:15:42.501879+0000","last_active":"2024-09-10T23:15:44.516809+0000","last_peered":"2024-09-10T23:15:44.516809+0000","last_clean":"2024-09-10T23:15:44.516809+0000","last_became_active":"2024-09-10T23:15:42.501613+0000","last_became_peered":"2024-09-10T23:15:42.501613+0000","last_unstale":"2024-09-10T23:15:44.516809+0000","last_undegraded":"2024-09-10T23:15:44.516809+0000","last_fullsized":"2024-09-10T23:15:44.516809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:31.143311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931997+0000","last_change":"2024-09-10T23:15:43.534829+0000","last_active":"2024-09-10T23:15:44.931997+0000","last_peered":"2024-09-10T23:15:44.931997+0000","last_clean":"2024-09-10T23:15:44.931997+0000","last_became_active":"2024-09-10T23:15:43.533503+0000","last_became_peered":"2024-09-10T23:15:43.533503+0000","last_unstale":"2024-09-10T23:15:44.931997+0000","last_undegraded":"2024-09-10T23:15:44.931997+0000","last_fullsized":"2024-09-10T23:15:44.931997+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:38.530901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932497+0000","last_change":"2024-09-10T23:15:42.511492+0000","last_active":"2024-09-10T23:15:44.932497+0000","last_peered":"2024-09-10T23:15:44.932497+0000","last_clean":"2024-09-10T23:15:44.932497+0000","last_became_active":"2024-09-10T23:15:42.511245+0000","last_became_peered":"2024-09-10T23:15:42.511245+0000","last_unstale":"2024-09-10T23:15:44.932497+0000","last_undegraded":"2024-09-10T23:15:44.932497+0000","last_fullsized":"2024-09-10T23:15:44.932497+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:45.272969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932054+0000","last_change":"2024-09-10T23:15:43.527612+0000","last_active":"2024-09-10T23:15:44.932054+0000","last_peered":"2024-09-10T23:15:44.932054+0000","last_clean":"2024-09-10T23:15:44.932054+0000","last_became_active":"2024-09-10T23:15:43.527357+0000","last_became_peered":"2024-09-10T23:15:43.527357+0000","last_unstale":"2024-09-10T23:15:44.932054+0000","last_undegraded":"2024-09-10T23:15:44.932054+0000","last_fullsized":"2024-09-10T23:15:44.932054+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:51.973604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932333+0000","last_change":"2024-09-10T23:15:42.501512+0000","last_active":"2024-09-10T23:15:44.932333+0000","last_peered":"2024-09-10T23:15:44.932333+0000","last_clean":"2024-09-10T23:15:44.932333+0000","last_became_active":"2024-09-10T23:15:42.501257+0000","last_became_peered":"2024-09-10T23:15:42.501257+0000","last_unstale":"2024-09-10T23:15:44.932333+0000","last_undegraded":"2024-09-10T23:15:44.932333+0000","last_fullsized":"2024-09-10T23:15:44.932333+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:02.933662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514830+0000","last_change":"2024-09-10T23:15:43.527690+0000","last_active":"2024-09-10T23:15:44.514830+0000","last_peered":"2024-09-10T23:15:44.514830+0000","last_clean":"2024-09-10T23:15:44.514830+0000","last_became_active":"2024-09-10T23:15:43.527237+0000","last_became_peered":"2024-09-10T23:15:43.527237+0000","last_unstale":"2024-09-10T23:15:44.514830+0000","last_undegraded":"2024-09-10T23:15:44.514830+0000","last_fullsized":"2024-09-10T23:15:44.514830+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:34.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516195+0000","last_change":"2024-09-10T23:15:42.509258+0000","last_active":"2024-09-10T23:15:44.516195+0000","last_peered":"2024-09-10T23:15:44.516195+0000","last_clean":"2024-09-10T23:15:44.516195+0000","last_became_active":"2024-09-10T23:15:42.508931+0000","last_became_peered":"2024-09-10T23:15:42.508931+0000","last_unstale":"2024-09-10T23:15:44.516195+0000","last_undegraded":"2024-09-10T23:15:44.516195+0000","last_fullsized":"2024-09-10T23:15:44.516195+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:03.971821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.930894+0000","last_change":"2024-09-10T23:15:43.533806+0000","last_active":"2024-09-10T23:15:44.930894+0000","last_peered":"2024-09-10T23:15:44.930894+0000","last_clean":"2024-09-10T23:15:44.930894+0000","last_became_active":"2024-09-10T23:15:43.533555+0000","last_became_peered":"2024-09-10T23:15:43.533555+0000","last_unstale":"2024-09-10T23:15:44.930894+0000","last_undegraded":"2024-09-10T23:15:44.930894+0000","last_fullsized":"2024-09-10T23:15:44.930894+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:34.468042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.508118+0000","last_change":"2024-09-10T23:15:42.506805+0000","last_active":"2024-09-10T23:15:42.508118+0000","last_peered":"2024-09-10T23:15:42.508118+0000","last_clean":"2024-09-10T23:15:42.508118+0000","last_became_active":"2024-09-10T23:15:42.506467+0000","last_became_peered":"2024-09-10T23:15:42.506467+0000","last_unstale":"2024-09-10T23:15:42.508118+0000","last_undegraded":"2024-09-10T23:15:42.508118+0000","last_fullsized":"2024-09-10T23:15:42.508118+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:48.798844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.495789+0000","last_change":"2024-09-10T23:15:42.495789+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.495789+0000","last_undegraded":"2024-09-10T23:15:42.495789+0000","last_fullsized":"2024-09-10T23:15:42.495789+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516188+0000","last_change":"2024-09-10T23:15:42.504548+0000","last_active":"2024-09-10T23:15:44.516188+0000","last_peered":"2024-09-10T23:15:44.516188+0000","last_clean":"2024-09-10T23:15:44.516188+0000","last_became_active":"2024-09-10T23:15:42.504243+0000","last_became_peered":"2024-09-10T23:15:42.504243+0000","last_unstale":"2024-09-10T23:15:44.516188+0000","last_undegraded":"2024-09-10T23:15:44.516188+0000","last_fullsized":"2024-09-10T23:15:44.516188+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:38.706722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932271+0000","last_change":"2024-09-10T23:15:43.532480+0000","last_active":"2024-09-10T23:15:44.932271+0000","last_peered":"2024-09-10T23:15:44.932271+0000","last_clean":"2024-09-10T23:15:44.932271+0000","last_became_active":"2024-09-10T23:15:43.532213+0000","last_became_peered":"2024-09-10T23:15:43.532213+0000","last_unstale":"2024-09-10T23:15:44.932271+0000","last_undegraded":"2024-09-10T23:15:44.932271+0000","last_fullsized":"2024-09-10T23:15:44.932271+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:28.144367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932439+0000","last_change":"2024-09-10T23:15:42.507050+0000","last_active":"2024-09-10T23:15:44.932439+0000","last_peered":"2024-09-10T23:15:44.932439+0000","last_clean":"2024-09-10T23:15:44.932439+0000","last_became_active":"2024-09-10T23:15:42.506736+0000","last_became_peered":"2024-09-10T23:15:42.506736+0000","last_unstale":"2024-09-10T23:15:44.932439+0000","last_undegraded":"2024-09-10T23:15:44.932439+0000","last_fullsized":"2024-09-10T23:15:44.932439+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:58.264160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.495292+0000","last_change":"2024-09-10T23:15:42.495292+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.495292+0000","last_undegraded":"2024-09-10T23:15:42.495292+0000","last_fullsized":"2024-09-10T23:15:42.495292+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516565+0000","last_change":"2024-09-10T23:15:42.512550+0000","last_active":"2024-09-10T23:15:44.516565+0000","last_peered":"2024-09-10T23:15:44.516565+0000","last_clean":"2024-09-10T23:15:44.516565+0000","last_became_active":"2024-09-10T23:15:42.512264+0000","last_became_peered":"2024-09-10T23:15:42.512264+0000","last_unstale":"2024-09-10T23:15:44.516565+0000","last_undegraded":"2024-09-10T23:15:44.516565+0000","last_fullsized":"2024-09-10T23:15:44.516565+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:51.973570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516494+0000","last_change":"2024-09-10T23:15:43.542762+0000","last_active":"2024-09-10T23:15:44.516494+0000","last_peered":"2024-09-10T23:15:44.516494+0000","last_clean":"2024-09-10T23:15:44.516494+0000","last_became_active":"2024-09-10T23:15:43.542496+0000","last_became_peered":"2024-09-10T23:15:43.542496+0000","last_unstale":"2024-09-10T23:15:44.516494+0000","last_undegraded":"2024-09-10T23:15:44.516494+0000","last_fullsized":"2024-09-10T23:15:44.516494+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:27.489244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514684+0000","last_change":"2024-09-10T23:15:42.508047+0000","last_active":"2024-09-10T23:15:44.514684+0000","last_peered":"2024-09-10T23:15:44.514684+0000","last_clean":"2024-09-10T23:15:44.514684+0000","last_became_active":"2024-09-10T23:15:42.506608+0000","last_became_peered":"2024-09-10T23:15:42.506608+0000","last_unstale":"2024-09-10T23:15:44.514684+0000","last_undegraded":"2024-09-10T23:15:44.514684+0000","last_fullsized":"2024-09-10T23:15:44.514684+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:07.647238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932154+0000","last_change":"2024-09-10T23:15:43.537555+0000","last_active":"2024-09-10T23:15:44.932154+0000","last_peered":"2024-09-10T23:15:44.932154+0000","last_clean":"2024-09-10T23:15:44.932154+0000","last_became_active":"2024-09-10T23:15:43.537267+0000","last_became_peered":"2024-09-10T23:15:43.537267+0000","last_unstale":"2024-09-10T23:15:44.932154+0000","last_undegraded":"2024-09-10T23:15:44.932154+0000","last_fullsized":"2024-09-10T23:15:44.932154+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:58.503796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516015+0000","last_change":"2024-09-10T23:15:42.511730+0000","last_active":"2024-09-10T23:15:44.516015+0000","last_peered":"2024-09-10T23:15:44.516015+0000","last_clean":"2024-09-10T23:15:44.516015+0000","last_became_active":"2024-09-10T23:15:42.511450+0000","last_became_peered":"2024-09-10T23:15:42.511450+0000","last_unstale":"2024-09-10T23:15:44.516015+0000","last_undegraded":"2024-09-10T23:15:44.516015+0000","last_fullsized":"2024-09-10T23:15:44.516015+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:55.382501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932247+0000","last_change":"2024-09-10T23:15:43.542960+0000","last_active":"2024-09-10T23:15:44.932247+0000","last_peered":"2024-09-10T23:15:44.932247+0000","last_clean":"2024-09-10T23:15:44.932247+0000","last_became_active":"2024-09-10T23:15:43.542616+0000","last_became_peered":"2024-09-10T23:15:43.542616+0000","last_unstale":"2024-09-10T23:15:44.932247+0000","last_undegraded":"2024-09-10T23:15:44.932247+0000","last_fullsized":"2024-09-10T23:15:44.932247+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:30.060356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933198+0000","last_change":"2024-09-10T23:15:42.502459+0000","last_active":"2024-09-10T23:15:44.933198+0000","last_peered":"2024-09-10T23:15:44.933198+0000","last_clean":"2024-09-10T23:15:44.933198+0000","last_became_active":"2024-09-10T23:15:42.502179+0000","last_became_peered":"2024-09-10T23:15:42.502179+0000","last_unstale":"2024-09-10T23:15:44.933198+0000","last_undegraded":"2024-09-10T23:15:44.933198+0000","last_fullsized":"2024-09-10T23:15:44.933198+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:35.610793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517231+0000","last_change":"2024-09-10T23:15:43.522932+0000","last_active":"2024-09-10T23:15:44.517231+0000","last_peered":"2024-09-10T23:15:44.517231+0000","last_clean":"2024-09-10T23:15:44.517231+0000","last_became_active":"2024-09-10T23:15:43.522601+0000","last_became_peered":"2024-09-10T23:15:43.522601+0000","last_unstale":"2024-09-10T23:15:44.517231+0000","last_undegraded":"2024-09-10T23:15:44.517231+0000","last_fullsized":"2024-09-10T23:15:44.517231+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:42.321567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514697+0000","last_change":"2024-09-10T23:15:42.508818+0000","last_active":"2024-09-10T23:15:44.514697+0000","last_peered":"2024-09-10T23:15:44.514697+0000","last_clean":"2024-09-10T23:15:44.514697+0000","last_became_active":"2024-09-10T23:15:42.508541+0000","last_became_peered":"2024-09-10T23:15:42.508541+0000","last_unstale":"2024-09-10T23:15:44.514697+0000","last_undegraded":"2024-09-10T23:15:44.514697+0000","last_fullsized":"2024-09-10T23:15:44.514697+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:51.671803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932924+0000","last_change":"2024-09-10T23:15:43.530853+0000","last_active":"2024-09-10T23:15:44.932924+0000","last_peered":"2024-09-10T23:15:44.932924+0000","last_clean":"2024-09-10T23:15:44.932924+0000","last_became_active":"2024-09-10T23:15:43.530574+0000","last_became_peered":"2024-09-10T23:15:43.530574+0000","last_unstale":"2024-09-10T23:15:44.932924+0000","last_undegraded":"2024-09-10T23:15:44.932924+0000","last_fullsized":"2024-09-10T23:15:44.932924+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:32.139284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.508254+0000","last_change":"2024-09-10T23:15:42.505319+0000","last_active":"2024-09-10T23:15:42.508254+0000","last_peered":"2024-09-10T23:15:42.508254+0000","last_clean":"2024-09-10T23:15:42.508254+0000","last_became_active":"2024-09-10T23:15:42.504868+0000","last_became_peered":"2024-09-10T23:15:42.504868+0000","last_unstale":"2024-09-10T23:15:42.508254+0000","last_undegraded":"2024-09-10T23:15:42.508254+0000","last_fullsized":"2024-09-10T23:15:42.508254+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:19.381787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.496168+0000","last_change":"2024-09-10T23:15:42.496168+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.496168+0000","last_undegraded":"2024-09-10T23:15:42.496168+0000","last_fullsized":"2024-09-10T23:15:42.496168+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517097+0000","last_change":"2024-09-10T23:15:42.506691+0000","last_active":"2024-09-10T23:15:44.517097+0000","last_peered":"2024-09-10T23:15:44.517097+0000","last_clean":"2024-09-10T23:15:44.517097+0000","last_became_active":"2024-09-10T23:15:42.506074+0000","last_became_peered":"2024-09-10T23:15:42.506074+0000","last_unstale":"2024-09-10T23:15:44.517097+0000","last_undegraded":"2024-09-10T23:15:44.517097+0000","last_fullsized":"2024-09-10T23:15:44.517097+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:27.141199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":152,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516368+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:15:44.516368+0000","last_peered":"2024-09-10T23:15:44.516368+0000","last_clean":"2024-09-10T23:15:44.516368+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:15:44.516368+0000","last_undegraded":"2024-09-10T23:15:44.516368+0000","last_fullsized":"2024-09-10T23:15:44.516368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1130496,"data_stored":803392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":540672,"data_stored":213606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":213004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":532480,"data_stored":208246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":532480,"data_stored":207272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":214568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":536576,"data_stored":213004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1101824,"data_stored":790227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:15:46.496 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:15:46.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.630+0000 7f797b8dd640 1 -- 172.21.15.90:0/2911682495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f797406f850 msgr2=0x7f797406ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:46.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.630+0000 7f797b8dd640 1 --2- 172.21.15.90:0/2911682495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f797406f850 0x7f797406ec20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f79740701c0 tx=0x7f796402a560 comp rx=0 tx=0).stop 2024-09-10T23:15:46.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.631+0000 7f797b8dd640 1 -- 172.21.15.90:0/2911682495 shutdown_connections 2024-09-10T23:15:46.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.631+0000 7f797b8dd640 1 --2- 172.21.15.90:0/2911682495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f797406f160 0x7f79740ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.631+0000 7f797b8dd640 1 --2- 172.21.15.90:0/2911682495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f797406f850 0x7f797406ec20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.631+0000 7f797b8dd640 1 --2- 172.21.15.90:0/2911682495 >> v2:172.21.15.171:3300/0 conn(0x7f797415bcb0 0x7f79740cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.631+0000 7f797b8dd640 1 -- 172.21.15.90:0/2911682495 >> 172.21.15.90:0/2911682495 conn(0x7f79740cc850 msgr2=0x7f79740ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:46.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.631+0000 7f797b8dd640 1 -- 172.21.15.90:0/2911682495 shutdown_connections 2024-09-10T23:15:46.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.631+0000 7f797b8dd640 1 -- 172.21.15.90:0/2911682495 wait complete. 2024-09-10T23:15:46.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.632+0000 7f797b8dd640 1 Processor -- start 2024-09-10T23:15:46.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.632+0000 7f797b8dd640 1 -- start start 2024-09-10T23:15:46.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.632+0000 7f797b8dd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f797406f160 0x7f79740b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:46.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f797b8dd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f797406f850 0x7f79740c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:46.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f797b8dd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f797415bcb0 0x7f79741f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:46.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f797b8dd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f79740cacf0 con 0x7f797415bcb0 2024-09-10T23:15:46.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f797b8dd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f79740cab70 con 0x7f797406f850 2024-09-10T23:15:46.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f797b8dd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f797415c1e0 con 0x7f797406f160 2024-09-10T23:15:46.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f7979e7a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f797415bcb0 0x7f79741f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:46.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f7979e7a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f797415bcb0 0x7f79741f5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46768/0 (socket says 172.21.15.90:46768) 2024-09-10T23:15:46.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f7979e7a640 1 -- 172.21.15.90:0/3643956253 learned_addr learned my addr 172.21.15.90:0/3643956253 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:46.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f7978e78640 1 --2- 172.21.15.90:0/3643956253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f797406f850 0x7f79740c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:46.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f7979679640 1 --2- 172.21.15.90:0/3643956253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f797406f160 0x7f79740b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:46.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f7979e7a640 1 -- 172.21.15.90:0/3643956253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f797406f160 msgr2=0x7f79740b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:46.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f7979e7a640 1 --2- 172.21.15.90:0/3643956253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f797406f160 0x7f79740b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f7979e7a640 1 -- 172.21.15.90:0/3643956253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f797406f850 msgr2=0x7f79740c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:46.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f7979e7a640 1 --2- 172.21.15.90:0/3643956253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f797406f850 0x7f79740c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f7979e7a640 1 -- 172.21.15.90:0/3643956253 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79740c5250 con 0x7f797415bcb0 2024-09-10T23:15:46.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f7978e78640 1 --2- 172.21.15.90:0/3643956253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f797406f850 0x7f79740c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:46.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f7979e7a640 1 --2- 172.21.15.90:0/3643956253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f797415bcb0 0x7f79741f5950 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f796c00e980 tx=0x7f796c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:46.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f7969ffb640 1 -- 172.21.15.90:0/3643956253 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c004d20 con 0x7f797415bcb0 2024-09-10T23:15:46.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f7969ffb640 1 -- 172.21.15.90:0/3643956253 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f796c00cb20 con 0x7f797415bcb0 2024-09-10T23:15:46.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f797b8dd640 1 -- 172.21.15.90:0/3643956253 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79740c5530 con 0x7f797415bcb0 2024-09-10T23:15:46.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f7969ffb640 1 -- 172.21.15.90:0/3643956253 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c005020 con 0x7f797415bcb0 2024-09-10T23:15:46.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.633+0000 7f797b8dd640 1 -- 172.21.15.90:0/3643956253 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79740c5af0 con 0x7f797415bcb0 2024-09-10T23:15:46.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.634+0000 7f797b8dd640 1 -- 172.21.15.90:0/3643956253 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f797406ec20 con 0x7f797415bcb0 2024-09-10T23:15:46.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.635+0000 7f7969ffb640 1 -- 172.21.15.90:0/3643956253 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f796c00f040 con 0x7f797415bcb0 2024-09-10T23:15:46.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.635+0000 7f7969ffb640 1 --2- 172.21.15.90:0/3643956253 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7958077f70 0x7f795807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:46.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.636+0000 7f7969ffb640 1 -- 172.21.15.90:0/3643956253 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f796c09a320 con 0x7f797415bcb0 2024-09-10T23:15:46.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.636+0000 7f7979679640 1 --2- 172.21.15.90:0/3643956253 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7958077f70 0x7f795807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:46.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.636+0000 7f7979679640 1 --2- 172.21.15.90:0/3643956253 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7958077f70 0x7f795807a430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7970005fd0 tx=0x7f7970005850 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:46.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.639+0000 7f7969ffb640 1 -- 172.21.15.90:0/3643956253 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f796c016030 con 0x7f797415bcb0 2024-09-10T23:15:46.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.812+0000 7f797b8dd640 1 -- 172.21.15.90:0/3643956253 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f797409e090 con 0x7f7958077f70 2024-09-10T23:15:46.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.817+0000 7f7969ffb640 1 -- 172.21.15.90:0/3643956253 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250802 (secure 0 0 0) 0x7f797409e090 con 0x7f7958077f70 2024-09-10T23:15:46.820 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:46.822 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:15:46.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.820+0000 7f797b8dd640 1 -- 172.21.15.90:0/3643956253 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7958077f70 msgr2=0x7f795807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:46.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.820+0000 7f797b8dd640 1 --2- 172.21.15.90:0/3643956253 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7958077f70 0x7f795807a430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7970005fd0 tx=0x7f7970005850 comp rx=0 tx=0).stop 2024-09-10T23:15:46.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.820+0000 7f797b8dd640 1 -- 172.21.15.90:0/3643956253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f797415bcb0 msgr2=0x7f79741f5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.820+0000 7f797b8dd640 1 --2- 172.21.15.90:0/3643956253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f797415bcb0 0x7f79741f5950 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f796c00e980 tx=0x7f796c00ee40 comp rx=0 tx=0).stop 2024-09-10T23:15:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.820+0000 7f797b8dd640 1 -- 172.21.15.90:0/3643956253 shutdown_connections 2024-09-10T23:15:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.820+0000 7f797b8dd640 1 --2- 172.21.15.90:0/3643956253 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7958077f70 0x7f795807a430 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.820+0000 7f797b8dd640 1 --2- 172.21.15.90:0/3643956253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f797406f850 0x7f79740c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.820+0000 7f797b8dd640 1 --2- 172.21.15.90:0/3643956253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f797415bcb0 0x7f79741f5950 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.820+0000 7f797b8dd640 1 --2- 172.21.15.90:0/3643956253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f797406f160 0x7f79740b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.820+0000 7f797b8dd640 1 -- 172.21.15.90:0/3643956253 >> 172.21.15.90:0/3643956253 conn(0x7f79740cc850 msgr2=0x7f79740ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.820+0000 7f797b8dd640 1 -- 172.21.15.90:0/3643956253 shutdown_connections 2024-09-10T23:15:46.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.820+0000 7f797b8dd640 1 -- 172.21.15.90:0/3643956253 wait complete. 2024-09-10T23:15:46.832 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-09-10T23:15:46.448813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":133,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225748,"kb_used_data":5332,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748972,"statfs":{"total":773094113280,"available":772862947328,"internally_reserved":0,"allocated":5459968,"data_stored":2863319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.960789"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516290+0000","last_change":"2024-09-10T23:15:43.531769+0000","last_active":"2024-09-10T23:15:44.516290+0000","last_peered":"2024-09-10T23:15:44.516290+0000","last_clean":"2024-09-10T23:15:44.516290+0000","last_became_active":"2024-09-10T23:15:43.531487+0000","last_became_peered":"2024-09-10T23:15:43.531487+0000","last_unstale":"2024-09-10T23:15:44.516290+0000","last_undegraded":"2024-09-10T23:15:44.516290+0000","last_fullsized":"2024-09-10T23:15:44.516290+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:59.369815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516729+0000","last_change":"2024-09-10T23:15:43.529475+0000","last_active":"2024-09-10T23:15:44.516729+0000","last_peered":"2024-09-10T23:15:44.516729+0000","last_clean":"2024-09-10T23:15:44.516729+0000","last_became_active":"2024-09-10T23:15:43.529175+0000","last_became_peered":"2024-09-10T23:15:43.529175+0000","last_unstale":"2024-09-10T23:15:44.516729+0000","last_undegraded":"2024-09-10T23:15:44.516729+0000","last_fullsized":"2024-09-10T23:15:44.516729+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:42.574340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932949+0000","last_change":"2024-09-10T23:15:43.527735+0000","last_active":"2024-09-10T23:15:44.932949+0000","last_peered":"2024-09-10T23:15:44.932949+0000","last_clean":"2024-09-10T23:15:44.932949+0000","last_became_active":"2024-09-10T23:15:43.527276+0000","last_became_peered":"2024-09-10T23:15:43.527276+0000","last_unstale":"2024-09-10T23:15:44.932949+0000","last_undegraded":"2024-09-10T23:15:44.932949+0000","last_fullsized":"2024-09-10T23:15:44.932949+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:39.709891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.501516+0000","last_change":"2024-09-10T23:15:42.501516+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.501516+0000","last_undegraded":"2024-09-10T23:15:42.501516+0000","last_fullsized":"2024-09-10T23:15:42.501516+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516486+0000","last_change":"2024-09-10T23:15:43.529380+0000","last_active":"2024-09-10T23:15:44.516486+0000","last_peered":"2024-09-10T23:15:44.516486+0000","last_clean":"2024-09-10T23:15:44.516486+0000","last_became_active":"2024-09-10T23:15:43.529090+0000","last_became_peered":"2024-09-10T23:15:43.529090+0000","last_unstale":"2024-09-10T23:15:44.516486+0000","last_undegraded":"2024-09-10T23:15:44.516486+0000","last_fullsized":"2024-09-10T23:15:44.516486+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:52.446596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931825+0000","last_change":"2024-09-10T23:15:43.533375+0000","last_active":"2024-09-10T23:15:44.931825+0000","last_peered":"2024-09-10T23:15:44.931825+0000","last_clean":"2024-09-10T23:15:44.931825+0000","last_became_active":"2024-09-10T23:15:43.533088+0000","last_became_peered":"2024-09-10T23:15:43.533088+0000","last_unstale":"2024-09-10T23:15:44.931825+0000","last_undegraded":"2024-09-10T23:15:44.931825+0000","last_fullsized":"2024-09-10T23:15:44.931825+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:28.504092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516163+0000","last_change":"2024-09-10T23:15:43.543935+0000","last_active":"2024-09-10T23:15:44.516163+0000","last_peered":"2024-09-10T23:15:44.516163+0000","last_clean":"2024-09-10T23:15:44.516163+0000","last_became_active":"2024-09-10T23:15:43.543641+0000","last_became_peered":"2024-09-10T23:15:43.543641+0000","last_unstale":"2024-09-10T23:15:44.516163+0000","last_undegraded":"2024-09-10T23:15:44.516163+0000","last_fullsized":"2024-09-10T23:15:44.516163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:23.451112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.501129+0000","last_change":"2024-09-10T23:15:42.501129+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.501129+0000","last_undegraded":"2024-09-10T23:15:42.501129+0000","last_fullsized":"2024-09-10T23:15:42.501129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.501467+0000","last_change":"2024-09-10T23:15:42.501467+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.501467+0000","last_undegraded":"2024-09-10T23:15:42.501467+0000","last_fullsized":"2024-09-10T23:15:42.501467+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.499597+0000","last_change":"2024-09-10T23:15:42.499597+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.499597+0000","last_undegraded":"2024-09-10T23:15:42.499597+0000","last_fullsized":"2024-09-10T23:15:42.499597+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.498776+0000","last_change":"2024-09-10T23:15:42.498776+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.498776+0000","last_undegraded":"2024-09-10T23:15:42.498776+0000","last_fullsized":"2024-09-10T23:15:42.498776+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517339+0000","last_change":"2024-09-10T23:15:43.529156+0000","last_active":"2024-09-10T23:15:44.517339+0000","last_peered":"2024-09-10T23:15:44.517339+0000","last_clean":"2024-09-10T23:15:44.517339+0000","last_became_active":"2024-09-10T23:15:43.528877+0000","last_became_peered":"2024-09-10T23:15:43.528877+0000","last_unstale":"2024-09-10T23:15:44.517339+0000","last_undegraded":"2024-09-10T23:15:44.517339+0000","last_fullsized":"2024-09-10T23:15:44.517339+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:58.070612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931161+0000","last_change":"2024-09-10T23:15:43.527284+0000","last_active":"2024-09-10T23:15:44.931161+0000","last_peered":"2024-09-10T23:15:44.931161+0000","last_clean":"2024-09-10T23:15:44.931161+0000","last_became_active":"2024-09-10T23:15:43.527019+0000","last_became_peered":"2024-09-10T23:15:43.527019+0000","last_unstale":"2024-09-10T23:15:44.931161+0000","last_undegraded":"2024-09-10T23:15:44.931161+0000","last_fullsized":"2024-09-10T23:15:44.931161+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:20.558073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.498260+0000","last_change":"2024-09-10T23:15:42.498260+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.498260+0000","last_undegraded":"2024-09-10T23:15:42.498260+0000","last_fullsized":"2024-09-10T23:15:42.498260+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931121+0000","last_change":"2024-09-10T23:15:43.530842+0000","last_active":"2024-09-10T23:15:44.931121+0000","last_peered":"2024-09-10T23:15:44.931121+0000","last_clean":"2024-09-10T23:15:44.931121+0000","last_became_active":"2024-09-10T23:15:43.530559+0000","last_became_peered":"2024-09-10T23:15:43.530559+0000","last_unstale":"2024-09-10T23:15:44.931121+0000","last_undegraded":"2024-09-10T23:15:44.931121+0000","last_fullsized":"2024-09-10T23:15:44.931121+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:41.393470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931624+0000","last_change":"2024-09-10T23:15:43.533130+0000","last_active":"2024-09-10T23:15:44.931624+0000","last_peered":"2024-09-10T23:15:44.931624+0000","last_clean":"2024-09-10T23:15:44.931624+0000","last_became_active":"2024-09-10T23:15:43.532800+0000","last_became_peered":"2024-09-10T23:15:43.532800+0000","last_unstale":"2024-09-10T23:15:44.931624+0000","last_undegraded":"2024-09-10T23:15:44.931624+0000","last_fullsized":"2024-09-10T23:15:44.931624+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:22.539205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933198+0000","last_change":"2024-09-10T23:15:43.524871+0000","last_active":"2024-09-10T23:15:44.933198+0000","last_peered":"2024-09-10T23:15:44.933198+0000","last_clean":"2024-09-10T23:15:44.933198+0000","last_became_active":"2024-09-10T23:15:43.524580+0000","last_became_peered":"2024-09-10T23:15:43.524580+0000","last_unstale":"2024-09-10T23:15:44.933198+0000","last_undegraded":"2024-09-10T23:15:44.933198+0000","last_fullsized":"2024-09-10T23:15:44.933198+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:46.276138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933038+0000","last_change":"2024-09-10T23:15:43.530280+0000","last_active":"2024-09-10T23:15:44.933038+0000","last_peered":"2024-09-10T23:15:44.933038+0000","last_clean":"2024-09-10T23:15:44.933038+0000","last_became_active":"2024-09-10T23:15:43.529987+0000","last_became_peered":"2024-09-10T23:15:43.529987+0000","last_unstale":"2024-09-10T23:15:44.933038+0000","last_undegraded":"2024-09-10T23:15:44.933038+0000","last_fullsized":"2024-09-10T23:15:44.933038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:56.385670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932219+0000","last_change":"2024-09-10T23:15:43.532316+0000","last_active":"2024-09-10T23:15:44.932219+0000","last_peered":"2024-09-10T23:15:44.932219+0000","last_clean":"2024-09-10T23:15:44.932219+0000","last_became_active":"2024-09-10T23:15:43.532064+0000","last_became_peered":"2024-09-10T23:15:43.532064+0000","last_unstale":"2024-09-10T23:15:44.932219+0000","last_undegraded":"2024-09-10T23:15:44.932219+0000","last_fullsized":"2024-09-10T23:15:44.932219+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:43.137866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931596+0000","last_change":"2024-09-10T23:15:43.531896+0000","last_active":"2024-09-10T23:15:44.931596+0000","last_peered":"2024-09-10T23:15:44.931596+0000","last_clean":"2024-09-10T23:15:44.931596+0000","last_became_active":"2024-09-10T23:15:43.531650+0000","last_became_peered":"2024-09-10T23:15:43.531650+0000","last_unstale":"2024-09-10T23:15:44.931596+0000","last_undegraded":"2024-09-10T23:15:44.931596+0000","last_fullsized":"2024-09-10T23:15:44.931596+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:49.987654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932163+0000","last_change":"2024-09-10T23:15:43.538991+0000","last_active":"2024-09-10T23:15:44.932163+0000","last_peered":"2024-09-10T23:15:44.932163+0000","last_clean":"2024-09-10T23:15:44.932163+0000","last_became_active":"2024-09-10T23:15:43.538544+0000","last_became_peered":"2024-09-10T23:15:43.538544+0000","last_unstale":"2024-09-10T23:15:44.932163+0000","last_undegraded":"2024-09-10T23:15:44.932163+0000","last_fullsized":"2024-09-10T23:15:44.932163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:00.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.493997+0000","last_change":"2024-09-10T23:15:42.493997+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.493997+0000","last_undegraded":"2024-09-10T23:15:42.493997+0000","last_fullsized":"2024-09-10T23:15:42.493997+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931912+0000","last_change":"2024-09-10T23:15:43.535424+0000","last_active":"2024-09-10T23:15:44.931912+0000","last_peered":"2024-09-10T23:15:44.931912+0000","last_clean":"2024-09-10T23:15:44.931912+0000","last_became_active":"2024-09-10T23:15:43.535182+0000","last_became_peered":"2024-09-10T23:15:43.535182+0000","last_unstale":"2024-09-10T23:15:44.931912+0000","last_undegraded":"2024-09-10T23:15:44.931912+0000","last_fullsized":"2024-09-10T23:15:44.931912+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:30.995258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931643+0000","last_change":"2024-09-10T23:15:43.534813+0000","last_active":"2024-09-10T23:15:44.931643+0000","last_peered":"2024-09-10T23:15:44.931643+0000","last_clean":"2024-09-10T23:15:44.931643+0000","last_became_active":"2024-09-10T23:15:43.534529+0000","last_became_peered":"2024-09-10T23:15:43.534529+0000","last_unstale":"2024-09-10T23:15:44.931643+0000","last_undegraded":"2024-09-10T23:15:44.931643+0000","last_fullsized":"2024-09-10T23:15:44.931643+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:52.674972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932061+0000","last_change":"2024-09-10T23:15:43.536434+0000","last_active":"2024-09-10T23:15:44.932061+0000","last_peered":"2024-09-10T23:15:44.932061+0000","last_clean":"2024-09-10T23:15:44.932061+0000","last_became_active":"2024-09-10T23:15:43.536045+0000","last_became_peered":"2024-09-10T23:15:43.536045+0000","last_unstale":"2024-09-10T23:15:44.932061+0000","last_undegraded":"2024-09-10T23:15:44.932061+0000","last_fullsized":"2024-09-10T23:15:44.932061+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:41.288775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931088+0000","last_change":"2024-09-10T23:15:43.525079+0000","last_active":"2024-09-10T23:15:44.931088+0000","last_peered":"2024-09-10T23:15:44.931088+0000","last_clean":"2024-09-10T23:15:44.931088+0000","last_became_active":"2024-09-10T23:15:43.524767+0000","last_became_peered":"2024-09-10T23:15:43.524767+0000","last_unstale":"2024-09-10T23:15:44.931088+0000","last_undegraded":"2024-09-10T23:15:44.931088+0000","last_fullsized":"2024-09-10T23:15:44.931088+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:43.164571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933052+0000","last_change":"2024-09-10T23:15:43.527365+0000","last_active":"2024-09-10T23:15:44.933052+0000","last_peered":"2024-09-10T23:15:44.933052+0000","last_clean":"2024-09-10T23:15:44.933052+0000","last_became_active":"2024-09-10T23:15:43.527076+0000","last_became_peered":"2024-09-10T23:15:43.527076+0000","last_unstale":"2024-09-10T23:15:44.933052+0000","last_undegraded":"2024-09-10T23:15:44.933052+0000","last_fullsized":"2024-09-10T23:15:44.933052+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:03.936831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517372+0000","last_change":"2024-09-10T23:15:43.528612+0000","last_active":"2024-09-10T23:15:44.517372+0000","last_peered":"2024-09-10T23:15:44.517372+0000","last_clean":"2024-09-10T23:15:44.517372+0000","last_became_active":"2024-09-10T23:15:43.528315+0000","last_became_peered":"2024-09-10T23:15:43.528315+0000","last_unstale":"2024-09-10T23:15:44.517372+0000","last_undegraded":"2024-09-10T23:15:44.517372+0000","last_fullsized":"2024-09-10T23:15:44.517372+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:28.073391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931746+0000","last_change":"2024-09-10T23:15:43.535273+0000","last_active":"2024-09-10T23:15:44.931746+0000","last_peered":"2024-09-10T23:15:44.931746+0000","last_clean":"2024-09-10T23:15:44.931746+0000","last_became_active":"2024-09-10T23:15:43.535024+0000","last_became_peered":"2024-09-10T23:15:43.535024+0000","last_unstale":"2024-09-10T23:15:44.931746+0000","last_undegraded":"2024-09-10T23:15:44.931746+0000","last_fullsized":"2024-09-10T23:15:44.931746+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:04.093540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932900+0000","last_change":"2024-09-10T23:15:43.527299+0000","last_active":"2024-09-10T23:15:44.932900+0000","last_peered":"2024-09-10T23:15:44.932900+0000","last_clean":"2024-09-10T23:15:44.932900+0000","last_became_active":"2024-09-10T23:15:43.526863+0000","last_became_peered":"2024-09-10T23:15:43.526863+0000","last_unstale":"2024-09-10T23:15:44.932900+0000","last_undegraded":"2024-09-10T23:15:44.932900+0000","last_fullsized":"2024-09-10T23:15:44.932900+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:11.752339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931322+0000","last_change":"2024-09-10T23:15:43.530364+0000","last_active":"2024-09-10T23:15:44.931322+0000","last_peered":"2024-09-10T23:15:44.931322+0000","last_clean":"2024-09-10T23:15:44.931322+0000","last_became_active":"2024-09-10T23:15:43.530090+0000","last_became_peered":"2024-09-10T23:15:43.530090+0000","last_unstale":"2024-09-10T23:15:44.931322+0000","last_undegraded":"2024-09-10T23:15:44.931322+0000","last_fullsized":"2024-09-10T23:15:44.931322+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:54.877057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.930861+0000","last_change":"2024-09-10T23:15:43.521138+0000","last_active":"2024-09-10T23:15:44.930861+0000","last_peered":"2024-09-10T23:15:44.930861+0000","last_clean":"2024-09-10T23:15:44.930861+0000","last_became_active":"2024-09-10T23:15:43.520871+0000","last_became_peered":"2024-09-10T23:15:43.520871+0000","last_unstale":"2024-09-10T23:15:44.930861+0000","last_undegraded":"2024-09-10T23:15:44.930861+0000","last_fullsized":"2024-09-10T23:15:44.930861+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:48.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.515005+0000","last_change":"2024-09-10T23:15:43.528339+0000","last_active":"2024-09-10T23:15:44.515005+0000","last_peered":"2024-09-10T23:15:44.515005+0000","last_clean":"2024-09-10T23:15:44.515005+0000","last_became_active":"2024-09-10T23:15:43.528000+0000","last_became_peered":"2024-09-10T23:15:43.528000+0000","last_unstale":"2024-09-10T23:15:44.515005+0000","last_undegraded":"2024-09-10T23:15:44.515005+0000","last_fullsized":"2024-09-10T23:15:44.515005+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:41.252238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932530+0000","last_change":"2024-09-10T23:15:42.511719+0000","last_active":"2024-09-10T23:15:44.932530+0000","last_peered":"2024-09-10T23:15:44.932530+0000","last_clean":"2024-09-10T23:15:44.932530+0000","last_became_active":"2024-09-10T23:15:42.511478+0000","last_became_peered":"2024-09-10T23:15:42.511478+0000","last_unstale":"2024-09-10T23:15:44.932530+0000","last_undegraded":"2024-09-10T23:15:44.932530+0000","last_fullsized":"2024-09-10T23:15:44.932530+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:33.981158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932123+0000","last_change":"2024-09-10T23:15:43.523565+0000","last_active":"2024-09-10T23:15:44.932123+0000","last_peered":"2024-09-10T23:15:44.932123+0000","last_clean":"2024-09-10T23:15:44.932123+0000","last_became_active":"2024-09-10T23:15:43.523272+0000","last_became_peered":"2024-09-10T23:15:43.523272+0000","last_unstale":"2024-09-10T23:15:44.932123+0000","last_undegraded":"2024-09-10T23:15:44.932123+0000","last_fullsized":"2024-09-10T23:15:44.932123+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:41.252238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933175+0000","last_change":"2024-09-10T23:15:42.511614+0000","last_active":"2024-09-10T23:15:44.933175+0000","last_peered":"2024-09-10T23:15:44.933175+0000","last_clean":"2024-09-10T23:15:44.933175+0000","last_became_active":"2024-09-10T23:15:42.511315+0000","last_became_peered":"2024-09-10T23:15:42.511315+0000","last_unstale":"2024-09-10T23:15:44.933175+0000","last_undegraded":"2024-09-10T23:15:44.933175+0000","last_fullsized":"2024-09-10T23:15:44.933175+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:51.671803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517486+0000","last_change":"2024-09-10T23:15:43.529829+0000","last_active":"2024-09-10T23:15:44.517486+0000","last_peered":"2024-09-10T23:15:44.517486+0000","last_clean":"2024-09-10T23:15:44.517486+0000","last_became_active":"2024-09-10T23:15:43.529545+0000","last_became_peered":"2024-09-10T23:15:43.529545+0000","last_unstale":"2024-09-10T23:15:44.517486+0000","last_undegraded":"2024-09-10T23:15:44.517486+0000","last_fullsized":"2024-09-10T23:15:44.517486+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:37.792217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514966+0000","last_change":"2024-09-10T23:15:42.507388+0000","last_active":"2024-09-10T23:15:44.514966+0000","last_peered":"2024-09-10T23:15:44.514966+0000","last_clean":"2024-09-10T23:15:44.514966+0000","last_became_active":"2024-09-10T23:15:42.507140+0000","last_became_peered":"2024-09-10T23:15:42.507140+0000","last_unstale":"2024-09-10T23:15:44.514966+0000","last_undegraded":"2024-09-10T23:15:44.514966+0000","last_fullsized":"2024-09-10T23:15:44.514966+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:00.620682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514992+0000","last_change":"2024-09-10T23:15:43.535494+0000","last_active":"2024-09-10T23:15:44.514992+0000","last_peered":"2024-09-10T23:15:44.514992+0000","last_clean":"2024-09-10T23:15:44.514992+0000","last_became_active":"2024-09-10T23:15:43.535197+0000","last_became_peered":"2024-09-10T23:15:43.535197+0000","last_unstale":"2024-09-10T23:15:44.514992+0000","last_undegraded":"2024-09-10T23:15:44.514992+0000","last_fullsized":"2024-09-10T23:15:44.514992+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:51.184507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.515748+0000","last_change":"2024-09-10T23:15:42.507889+0000","last_active":"2024-09-10T23:15:44.515748+0000","last_peered":"2024-09-10T23:15:44.515748+0000","last_clean":"2024-09-10T23:15:44.515748+0000","last_became_active":"2024-09-10T23:15:42.507525+0000","last_became_peered":"2024-09-10T23:15:42.507525+0000","last_unstale":"2024-09-10T23:15:44.515748+0000","last_undegraded":"2024-09-10T23:15:44.515748+0000","last_fullsized":"2024-09-10T23:15:44.515748+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:31.136115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932861+0000","last_change":"2024-09-10T23:15:43.528047+0000","last_active":"2024-09-10T23:15:44.932861+0000","last_peered":"2024-09-10T23:15:44.932861+0000","last_clean":"2024-09-10T23:15:44.932861+0000","last_became_active":"2024-09-10T23:15:43.527788+0000","last_became_peered":"2024-09-10T23:15:43.527788+0000","last_unstale":"2024-09-10T23:15:44.932861+0000","last_undegraded":"2024-09-10T23:15:44.932861+0000","last_fullsized":"2024-09-10T23:15:44.932861+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:52.085571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932226+0000","last_change":"2024-09-10T23:15:42.504164+0000","last_active":"2024-09-10T23:15:44.932226+0000","last_peered":"2024-09-10T23:15:44.932226+0000","last_clean":"2024-09-10T23:15:44.932226+0000","last_became_active":"2024-09-10T23:15:42.503841+0000","last_became_peered":"2024-09-10T23:15:42.503841+0000","last_unstale":"2024-09-10T23:15:44.932226+0000","last_undegraded":"2024-09-10T23:15:44.932226+0000","last_fullsized":"2024-09-10T23:15:44.932226+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:51.973570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.497880+0000","last_change":"2024-09-10T23:15:42.497880+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.497880+0000","last_undegraded":"2024-09-10T23:15:42.497880+0000","last_fullsized":"2024-09-10T23:15:42.497880+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933092+0000","last_change":"2024-09-10T23:15:42.507501+0000","last_active":"2024-09-10T23:15:44.933092+0000","last_peered":"2024-09-10T23:15:44.933092+0000","last_clean":"2024-09-10T23:15:44.933092+0000","last_became_active":"2024-09-10T23:15:42.507224+0000","last_became_peered":"2024-09-10T23:15:42.507224+0000","last_unstale":"2024-09-10T23:15:44.933092+0000","last_undegraded":"2024-09-10T23:15:44.933092+0000","last_fullsized":"2024-09-10T23:15:44.933092+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:41.069742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.498212+0000","last_change":"2024-09-10T23:15:42.498212+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.498212+0000","last_undegraded":"2024-09-10T23:15:42.498212+0000","last_fullsized":"2024-09-10T23:15:42.498212+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516014+0000","last_change":"2024-09-10T23:15:42.500537+0000","last_active":"2024-09-10T23:15:44.516014+0000","last_peered":"2024-09-10T23:15:44.516014+0000","last_clean":"2024-09-10T23:15:44.516014+0000","last_became_active":"2024-09-10T23:15:42.500174+0000","last_became_peered":"2024-09-10T23:15:42.500174+0000","last_unstale":"2024-09-10T23:15:44.516014+0000","last_undegraded":"2024-09-10T23:15:44.516014+0000","last_fullsized":"2024-09-10T23:15:44.516014+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:42.134697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931662+0000","last_change":"2024-09-10T23:15:43.534456+0000","last_active":"2024-09-10T23:15:44.931662+0000","last_peered":"2024-09-10T23:15:44.931662+0000","last_clean":"2024-09-10T23:15:44.931662+0000","last_became_active":"2024-09-10T23:15:43.534189+0000","last_became_peered":"2024-09-10T23:15:43.534189+0000","last_unstale":"2024-09-10T23:15:44.931662+0000","last_undegraded":"2024-09-10T23:15:44.931662+0000","last_fullsized":"2024-09-10T23:15:44.931662+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:10.389011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.508230+0000","last_change":"2024-09-10T23:15:42.504650+0000","last_active":"2024-09-10T23:15:42.508230+0000","last_peered":"2024-09-10T23:15:42.508230+0000","last_clean":"2024-09-10T23:15:42.508230+0000","last_became_active":"2024-09-10T23:15:42.504410+0000","last_became_peered":"2024-09-10T23:15:42.504410+0000","last_unstale":"2024-09-10T23:15:42.508230+0000","last_undegraded":"2024-09-10T23:15:42.508230+0000","last_fullsized":"2024-09-10T23:15:42.508230+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:45.052771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933152+0000","last_change":"2024-09-10T23:15:43.531044+0000","last_active":"2024-09-10T23:15:44.933152+0000","last_peered":"2024-09-10T23:15:44.933152+0000","last_clean":"2024-09-10T23:15:44.933152+0000","last_became_active":"2024-09-10T23:15:43.530763+0000","last_became_peered":"2024-09-10T23:15:43.530763+0000","last_unstale":"2024-09-10T23:15:44.933152+0000","last_undegraded":"2024-09-10T23:15:44.933152+0000","last_fullsized":"2024-09-10T23:15:44.933152+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:52.976739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933174+0000","last_change":"2024-09-10T23:15:42.497687+0000","last_active":"2024-09-10T23:15:44.933174+0000","last_peered":"2024-09-10T23:15:44.933174+0000","last_clean":"2024-09-10T23:15:44.933174+0000","last_became_active":"2024-09-10T23:15:42.497411+0000","last_became_peered":"2024-09-10T23:15:42.497411+0000","last_unstale":"2024-09-10T23:15:44.933174+0000","last_undegraded":"2024-09-10T23:15:44.933174+0000","last_fullsized":"2024-09-10T23:15:44.933174+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:07.647238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516410+0000","last_change":"2024-09-10T23:15:43.537527+0000","last_active":"2024-09-10T23:15:44.516410+0000","last_peered":"2024-09-10T23:15:44.516410+0000","last_clean":"2024-09-10T23:15:44.516410+0000","last_became_active":"2024-09-10T23:15:43.537079+0000","last_became_peered":"2024-09-10T23:15:43.537079+0000","last_unstale":"2024-09-10T23:15:44.516410+0000","last_undegraded":"2024-09-10T23:15:44.516410+0000","last_fullsized":"2024-09-10T23:15:44.516410+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:07.594488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.507897+0000","last_change":"2024-09-10T23:15:42.504742+0000","last_active":"2024-09-10T23:15:42.507897+0000","last_peered":"2024-09-10T23:15:42.507897+0000","last_clean":"2024-09-10T23:15:42.507897+0000","last_became_active":"2024-09-10T23:15:42.504469+0000","last_became_peered":"2024-09-10T23:15:42.504469+0000","last_unstale":"2024-09-10T23:15:42.507897+0000","last_undegraded":"2024-09-10T23:15:42.507897+0000","last_fullsized":"2024-09-10T23:15:42.507897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:26.061097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932516+0000","last_change":"2024-09-10T23:15:43.536547+0000","last_active":"2024-09-10T23:15:44.932516+0000","last_peered":"2024-09-10T23:15:44.932516+0000","last_clean":"2024-09-10T23:15:44.932516+0000","last_became_active":"2024-09-10T23:15:43.535697+0000","last_became_peered":"2024-09-10T23:15:43.535697+0000","last_unstale":"2024-09-10T23:15:44.932516+0000","last_undegraded":"2024-09-10T23:15:44.932516+0000","last_fullsized":"2024-09-10T23:15:44.932516+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:02.345671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516552+0000","last_change":"2024-09-10T23:15:42.512649+0000","last_active":"2024-09-10T23:15:44.516552+0000","last_peered":"2024-09-10T23:15:44.516552+0000","last_clean":"2024-09-10T23:15:44.516552+0000","last_became_active":"2024-09-10T23:15:42.512284+0000","last_became_peered":"2024-09-10T23:15:42.512284+0000","last_unstale":"2024-09-10T23:15:44.516552+0000","last_undegraded":"2024-09-10T23:15:44.516552+0000","last_fullsized":"2024-09-10T23:15:44.516552+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:02.933662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516269+0000","last_change":"2024-09-10T23:15:43.543825+0000","last_active":"2024-09-10T23:15:44.516269+0000","last_peered":"2024-09-10T23:15:44.516269+0000","last_clean":"2024-09-10T23:15:44.516269+0000","last_became_active":"2024-09-10T23:15:43.543546+0000","last_became_peered":"2024-09-10T23:15:43.543546+0000","last_unstale":"2024-09-10T23:15:44.516269+0000","last_undegraded":"2024-09-10T23:15:44.516269+0000","last_fullsized":"2024-09-10T23:15:44.516269+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:29.218569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931707+0000","last_change":"2024-09-10T23:15:42.499400+0000","last_active":"2024-09-10T23:15:44.931707+0000","last_peered":"2024-09-10T23:15:44.931707+0000","last_clean":"2024-09-10T23:15:44.931707+0000","last_became_active":"2024-09-10T23:15:42.499123+0000","last_became_peered":"2024-09-10T23:15:42.499123+0000","last_unstale":"2024-09-10T23:15:44.931707+0000","last_undegraded":"2024-09-10T23:15:44.931707+0000","last_fullsized":"2024-09-10T23:15:44.931707+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:27.654745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932077+0000","last_change":"2024-09-10T23:15:43.532558+0000","last_active":"2024-09-10T23:15:44.932077+0000","last_peered":"2024-09-10T23:15:44.932077+0000","last_clean":"2024-09-10T23:15:44.932077+0000","last_became_active":"2024-09-10T23:15:43.532269+0000","last_became_peered":"2024-09-10T23:15:43.532269+0000","last_unstale":"2024-09-10T23:15:44.932077+0000","last_undegraded":"2024-09-10T23:15:44.932077+0000","last_fullsized":"2024-09-10T23:15:44.932077+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:49.306185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932280+0000","last_change":"2024-09-10T23:15:42.508928+0000","last_active":"2024-09-10T23:15:44.932280+0000","last_peered":"2024-09-10T23:15:44.932280+0000","last_clean":"2024-09-10T23:15:44.932280+0000","last_became_active":"2024-09-10T23:15:42.508568+0000","last_became_peered":"2024-09-10T23:15:42.508568+0000","last_unstale":"2024-09-10T23:15:44.932280+0000","last_undegraded":"2024-09-10T23:15:44.932280+0000","last_fullsized":"2024-09-10T23:15:44.932280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:55.382501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.496416+0000","last_change":"2024-09-10T23:15:42.496416+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.496416+0000","last_undegraded":"2024-09-10T23:15:42.496416+0000","last_fullsized":"2024-09-10T23:15:42.496416+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516010+0000","last_change":"2024-09-10T23:15:42.502106+0000","last_active":"2024-09-10T23:15:44.516010+0000","last_peered":"2024-09-10T23:15:44.516010+0000","last_clean":"2024-09-10T23:15:44.516010+0000","last_became_active":"2024-09-10T23:15:42.501620+0000","last_became_peered":"2024-09-10T23:15:42.501620+0000","last_unstale":"2024-09-10T23:15:44.516010+0000","last_undegraded":"2024-09-10T23:15:44.516010+0000","last_fullsized":"2024-09-10T23:15:44.516010+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:42.459571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.930865+0000","last_change":"2024-09-10T23:15:43.534217+0000","last_active":"2024-09-10T23:15:44.930865+0000","last_peered":"2024-09-10T23:15:44.930865+0000","last_clean":"2024-09-10T23:15:44.930865+0000","last_became_active":"2024-09-10T23:15:43.533952+0000","last_became_peered":"2024-09-10T23:15:43.533952+0000","last_unstale":"2024-09-10T23:15:44.930865+0000","last_undegraded":"2024-09-10T23:15:44.930865+0000","last_fullsized":"2024-09-10T23:15:44.930865+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:46:57.091610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931425+0000","last_change":"2024-09-10T23:15:42.508283+0000","last_active":"2024-09-10T23:15:44.931425+0000","last_peered":"2024-09-10T23:15:44.931425+0000","last_clean":"2024-09-10T23:15:44.931425+0000","last_became_active":"2024-09-10T23:15:42.508016+0000","last_became_peered":"2024-09-10T23:15:42.508016+0000","last_unstale":"2024-09-10T23:15:44.931425+0000","last_undegraded":"2024-09-10T23:15:44.931425+0000","last_fullsized":"2024-09-10T23:15:44.931425+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:38.706722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516424+0000","last_change":"2024-09-10T23:15:43.540626+0000","last_active":"2024-09-10T23:15:44.516424+0000","last_peered":"2024-09-10T23:15:44.516424+0000","last_clean":"2024-09-10T23:15:44.516424+0000","last_became_active":"2024-09-10T23:15:43.540323+0000","last_became_peered":"2024-09-10T23:15:43.540323+0000","last_unstale":"2024-09-10T23:15:44.516424+0000","last_undegraded":"2024-09-10T23:15:44.516424+0000","last_fullsized":"2024-09-10T23:15:44.516424+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:27.806294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.509136+0000","last_change":"2024-09-10T23:15:42.507669+0000","last_active":"2024-09-10T23:15:42.509136+0000","last_peered":"2024-09-10T23:15:42.509136+0000","last_clean":"2024-09-10T23:15:42.509136+0000","last_became_active":"2024-09-10T23:15:42.507393+0000","last_became_peered":"2024-09-10T23:15:42.507393+0000","last_unstale":"2024-09-10T23:15:42.509136+0000","last_undegraded":"2024-09-10T23:15:42.509136+0000","last_fullsized":"2024-09-10T23:15:42.509136+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:53.985338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931271+0000","last_change":"2024-09-10T23:15:43.518692+0000","last_active":"2024-09-10T23:15:44.931271+0000","last_peered":"2024-09-10T23:15:44.931271+0000","last_clean":"2024-09-10T23:15:44.931271+0000","last_became_active":"2024-09-10T23:15:43.518325+0000","last_became_peered":"2024-09-10T23:15:43.518325+0000","last_unstale":"2024-09-10T23:15:44.931271+0000","last_undegraded":"2024-09-10T23:15:44.931271+0000","last_fullsized":"2024-09-10T23:15:44.931271+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:26.438912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931431+0000","last_change":"2024-09-10T23:15:42.501325+0000","last_active":"2024-09-10T23:15:44.931431+0000","last_peered":"2024-09-10T23:15:44.931431+0000","last_clean":"2024-09-10T23:15:44.931431+0000","last_became_active":"2024-09-10T23:15:42.501051+0000","last_became_peered":"2024-09-10T23:15:42.501051+0000","last_unstale":"2024-09-10T23:15:44.931431+0000","last_undegraded":"2024-09-10T23:15:44.931431+0000","last_fullsized":"2024-09-10T23:15:44.931431+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:01.930458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.496590+0000","last_change":"2024-09-10T23:15:42.496590+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.496590+0000","last_undegraded":"2024-09-10T23:15:42.496590+0000","last_fullsized":"2024-09-10T23:15:42.496590+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933250+0000","last_change":"2024-09-10T23:15:42.499477+0000","last_active":"2024-09-10T23:15:44.933250+0000","last_peered":"2024-09-10T23:15:44.933250+0000","last_clean":"2024-09-10T23:15:44.933250+0000","last_became_active":"2024-09-10T23:15:42.499161+0000","last_became_peered":"2024-09-10T23:15:42.499161+0000","last_unstale":"2024-09-10T23:15:44.933250+0000","last_undegraded":"2024-09-10T23:15:44.933250+0000","last_fullsized":"2024-09-10T23:15:44.933250+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:00.620682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931894+0000","last_change":"2024-09-10T23:15:43.530654+0000","last_active":"2024-09-10T23:15:44.931894+0000","last_peered":"2024-09-10T23:15:44.931894+0000","last_clean":"2024-09-10T23:15:44.931894+0000","last_became_active":"2024-09-10T23:15:43.530378+0000","last_became_peered":"2024-09-10T23:15:43.530378+0000","last_unstale":"2024-09-10T23:15:44.931894+0000","last_undegraded":"2024-09-10T23:15:44.931894+0000","last_fullsized":"2024-09-10T23:15:44.931894+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:36.613962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516809+0000","last_change":"2024-09-10T23:15:42.501879+0000","last_active":"2024-09-10T23:15:44.516809+0000","last_peered":"2024-09-10T23:15:44.516809+0000","last_clean":"2024-09-10T23:15:44.516809+0000","last_became_active":"2024-09-10T23:15:42.501613+0000","last_became_peered":"2024-09-10T23:15:42.501613+0000","last_unstale":"2024-09-10T23:15:44.516809+0000","last_undegraded":"2024-09-10T23:15:44.516809+0000","last_fullsized":"2024-09-10T23:15:44.516809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:31.143311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931997+0000","last_change":"2024-09-10T23:15:43.534829+0000","last_active":"2024-09-10T23:15:44.931997+0000","last_peered":"2024-09-10T23:15:44.931997+0000","last_clean":"2024-09-10T23:15:44.931997+0000","last_became_active":"2024-09-10T23:15:43.533503+0000","last_became_peered":"2024-09-10T23:15:43.533503+0000","last_unstale":"2024-09-10T23:15:44.931997+0000","last_undegraded":"2024-09-10T23:15:44.931997+0000","last_fullsized":"2024-09-10T23:15:44.931997+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:38.530901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932497+0000","last_change":"2024-09-10T23:15:42.511492+0000","last_active":"2024-09-10T23:15:44.932497+0000","last_peered":"2024-09-10T23:15:44.932497+0000","last_clean":"2024-09-10T23:15:44.932497+0000","last_became_active":"2024-09-10T23:15:42.511245+0000","last_became_peered":"2024-09-10T23:15:42.511245+0000","last_unstale":"2024-09-10T23:15:44.932497+0000","last_undegraded":"2024-09-10T23:15:44.932497+0000","last_fullsized":"2024-09-10T23:15:44.932497+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:45.272969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932054+0000","last_change":"2024-09-10T23:15:43.527612+0000","last_active":"2024-09-10T23:15:44.932054+0000","last_peered":"2024-09-10T23:15:44.932054+0000","last_clean":"2024-09-10T23:15:44.932054+0000","last_became_active":"2024-09-10T23:15:43.527357+0000","last_became_peered":"2024-09-10T23:15:43.527357+0000","last_unstale":"2024-09-10T23:15:44.932054+0000","last_undegraded":"2024-09-10T23:15:44.932054+0000","last_fullsized":"2024-09-10T23:15:44.932054+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:51.973604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932333+0000","last_change":"2024-09-10T23:15:42.501512+0000","last_active":"2024-09-10T23:15:44.932333+0000","last_peered":"2024-09-10T23:15:44.932333+0000","last_clean":"2024-09-10T23:15:44.932333+0000","last_became_active":"2024-09-10T23:15:42.501257+0000","last_became_peered":"2024-09-10T23:15:42.501257+0000","last_unstale":"2024-09-10T23:15:44.932333+0000","last_undegraded":"2024-09-10T23:15:44.932333+0000","last_fullsized":"2024-09-10T23:15:44.932333+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:02.933662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514830+0000","last_change":"2024-09-10T23:15:43.527690+0000","last_active":"2024-09-10T23:15:44.514830+0000","last_peered":"2024-09-10T23:15:44.514830+0000","last_clean":"2024-09-10T23:15:44.514830+0000","last_became_active":"2024-09-10T23:15:43.527237+0000","last_became_peered":"2024-09-10T23:15:43.527237+0000","last_unstale":"2024-09-10T23:15:44.514830+0000","last_undegraded":"2024-09-10T23:15:44.514830+0000","last_fullsized":"2024-09-10T23:15:44.514830+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:34.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516195+0000","last_change":"2024-09-10T23:15:42.509258+0000","last_active":"2024-09-10T23:15:44.516195+0000","last_peered":"2024-09-10T23:15:44.516195+0000","last_clean":"2024-09-10T23:15:44.516195+0000","last_became_active":"2024-09-10T23:15:42.508931+0000","last_became_peered":"2024-09-10T23:15:42.508931+0000","last_unstale":"2024-09-10T23:15:44.516195+0000","last_undegraded":"2024-09-10T23:15:44.516195+0000","last_fullsized":"2024-09-10T23:15:44.516195+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:03.971821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.930894+0000","last_change":"2024-09-10T23:15:43.533806+0000","last_active":"2024-09-10T23:15:44.930894+0000","last_peered":"2024-09-10T23:15:44.930894+0000","last_clean":"2024-09-10T23:15:44.930894+0000","last_became_active":"2024-09-10T23:15:43.533555+0000","last_became_peered":"2024-09-10T23:15:43.533555+0000","last_unstale":"2024-09-10T23:15:44.930894+0000","last_undegraded":"2024-09-10T23:15:44.930894+0000","last_fullsized":"2024-09-10T23:15:44.930894+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:34.468042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.508118+0000","last_change":"2024-09-10T23:15:42.506805+0000","last_active":"2024-09-10T23:15:42.508118+0000","last_peered":"2024-09-10T23:15:42.508118+0000","last_clean":"2024-09-10T23:15:42.508118+0000","last_became_active":"2024-09-10T23:15:42.506467+0000","last_became_peered":"2024-09-10T23:15:42.506467+0000","last_unstale":"2024-09-10T23:15:42.508118+0000","last_undegraded":"2024-09-10T23:15:42.508118+0000","last_fullsized":"2024-09-10T23:15:42.508118+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:48.798844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.495789+0000","last_change":"2024-09-10T23:15:42.495789+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.495789+0000","last_undegraded":"2024-09-10T23:15:42.495789+0000","last_fullsized":"2024-09-10T23:15:42.495789+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516188+0000","last_change":"2024-09-10T23:15:42.504548+0000","last_active":"2024-09-10T23:15:44.516188+0000","last_peered":"2024-09-10T23:15:44.516188+0000","last_clean":"2024-09-10T23:15:44.516188+0000","last_became_active":"2024-09-10T23:15:42.504243+0000","last_became_peered":"2024-09-10T23:15:42.504243+0000","last_unstale":"2024-09-10T23:15:44.516188+0000","last_undegraded":"2024-09-10T23:15:44.516188+0000","last_fullsized":"2024-09-10T23:15:44.516188+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:38.706722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932271+0000","last_change":"2024-09-10T23:15:43.532480+0000","last_active":"2024-09-10T23:15:44.932271+0000","last_peered":"2024-09-10T23:15:44.932271+0000","last_clean":"2024-09-10T23:15:44.932271+0000","last_became_active":"2024-09-10T23:15:43.532213+0000","last_became_peered":"2024-09-10T23:15:43.532213+0000","last_unstale":"2024-09-10T23:15:44.932271+0000","last_undegraded":"2024-09-10T23:15:44.932271+0000","last_fullsized":"2024-09-10T23:15:44.932271+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:28.144367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932439+0000","last_change":"2024-09-10T23:15:42.507050+0000","last_active":"2024-09-10T23:15:44.932439+0000","last_peered":"2024-09-10T23:15:44.932439+0000","last_clean":"2024-09-10T23:15:44.932439+0000","last_became_active":"2024-09-10T23:15:42.506736+0000","last_became_peered":"2024-09-10T23:15:42.506736+0000","last_unstale":"2024-09-10T23:15:44.932439+0000","last_undegraded":"2024-09-10T23:15:44.932439+0000","last_fullsized":"2024-09-10T23:15:44.932439+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:58.264160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.495292+0000","last_change":"2024-09-10T23:15:42.495292+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.495292+0000","last_undegraded":"2024-09-10T23:15:42.495292+0000","last_fullsized":"2024-09-10T23:15:42.495292+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516565+0000","last_change":"2024-09-10T23:15:42.512550+0000","last_active":"2024-09-10T23:15:44.516565+0000","last_peered":"2024-09-10T23:15:44.516565+0000","last_clean":"2024-09-10T23:15:44.516565+0000","last_became_active":"2024-09-10T23:15:42.512264+0000","last_became_peered":"2024-09-10T23:15:42.512264+0000","last_unstale":"2024-09-10T23:15:44.516565+0000","last_undegraded":"2024-09-10T23:15:44.516565+0000","last_fullsized":"2024-09-10T23:15:44.516565+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:51.973570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516494+0000","last_change":"2024-09-10T23:15:43.542762+0000","last_active":"2024-09-10T23:15:44.516494+0000","last_peered":"2024-09-10T23:15:44.516494+0000","last_clean":"2024-09-10T23:15:44.516494+0000","last_became_active":"2024-09-10T23:15:43.542496+0000","last_became_peered":"2024-09-10T23:15:43.542496+0000","last_unstale":"2024-09-10T23:15:44.516494+0000","last_undegraded":"2024-09-10T23:15:44.516494+0000","last_fullsized":"2024-09-10T23:15:44.516494+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:27.489244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514684+0000","last_change":"2024-09-10T23:15:42.508047+0000","last_active":"2024-09-10T23:15:44.514684+0000","last_peered":"2024-09-10T23:15:44.514684+0000","last_clean":"2024-09-10T23:15:44.514684+0000","last_became_active":"2024-09-10T23:15:42.506608+0000","last_became_peered":"2024-09-10T23:15:42.506608+0000","last_unstale":"2024-09-10T23:15:44.514684+0000","last_undegraded":"2024-09-10T23:15:44.514684+0000","last_fullsized":"2024-09-10T23:15:44.514684+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:07.647238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932154+0000","last_change":"2024-09-10T23:15:43.537555+0000","last_active":"2024-09-10T23:15:44.932154+0000","last_peered":"2024-09-10T23:15:44.932154+0000","last_clean":"2024-09-10T23:15:44.932154+0000","last_became_active":"2024-09-10T23:15:43.537267+0000","last_became_peered":"2024-09-10T23:15:43.537267+0000","last_unstale":"2024-09-10T23:15:44.932154+0000","last_undegraded":"2024-09-10T23:15:44.932154+0000","last_fullsized":"2024-09-10T23:15:44.932154+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:58.503796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516015+0000","last_change":"2024-09-10T23:15:42.511730+0000","last_active":"2024-09-10T23:15:44.516015+0000","last_peered":"2024-09-10T23:15:44.516015+0000","last_clean":"2024-09-10T23:15:44.516015+0000","last_became_active":"2024-09-10T23:15:42.511450+0000","last_became_peered":"2024-09-10T23:15:42.511450+0000","last_unstale":"2024-09-10T23:15:44.516015+0000","last_undegraded":"2024-09-10T23:15:44.516015+0000","last_fullsized":"2024-09-10T23:15:44.516015+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:55.382501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932247+0000","last_change":"2024-09-10T23:15:43.542960+0000","last_active":"2024-09-10T23:15:44.932247+0000","last_peered":"2024-09-10T23:15:44.932247+0000","last_clean":"2024-09-10T23:15:44.932247+0000","last_became_active":"2024-09-10T23:15:43.542616+0000","last_became_peered":"2024-09-10T23:15:43.542616+0000","last_unstale":"2024-09-10T23:15:44.932247+0000","last_undegraded":"2024-09-10T23:15:44.932247+0000","last_fullsized":"2024-09-10T23:15:44.932247+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:30.060356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933198+0000","last_change":"2024-09-10T23:15:42.502459+0000","last_active":"2024-09-10T23:15:44.933198+0000","last_peered":"2024-09-10T23:15:44.933198+0000","last_clean":"2024-09-10T23:15:44.933198+0000","last_became_active":"2024-09-10T23:15:42.502179+0000","last_became_peered":"2024-09-10T23:15:42.502179+0000","last_unstale":"2024-09-10T23:15:44.933198+0000","last_undegraded":"2024-09-10T23:15:44.933198+0000","last_fullsized":"2024-09-10T23:15:44.933198+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:35.610793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517231+0000","last_change":"2024-09-10T23:15:43.522932+0000","last_active":"2024-09-10T23:15:44.517231+0000","last_peered":"2024-09-10T23:15:44.517231+0000","last_clean":"2024-09-10T23:15:44.517231+0000","last_became_active":"2024-09-10T23:15:43.522601+0000","last_became_peered":"2024-09-10T23:15:43.522601+0000","last_unstale":"2024-09-10T23:15:44.517231+0000","last_undegraded":"2024-09-10T23:15:44.517231+0000","last_fullsized":"2024-09-10T23:15:44.517231+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:42.321567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514697+0000","last_change":"2024-09-10T23:15:42.508818+0000","last_active":"2024-09-10T23:15:44.514697+0000","last_peered":"2024-09-10T23:15:44.514697+0000","last_clean":"2024-09-10T23:15:44.514697+0000","last_became_active":"2024-09-10T23:15:42.508541+0000","last_became_peered":"2024-09-10T23:15:42.508541+0000","last_unstale":"2024-09-10T23:15:44.514697+0000","last_undegraded":"2024-09-10T23:15:44.514697+0000","last_fullsized":"2024-09-10T23:15:44.514697+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:51.671803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932924+0000","last_change":"2024-09-10T23:15:43.530853+0000","last_active":"2024-09-10T23:15:44.932924+0000","last_peered":"2024-09-10T23:15:44.932924+0000","last_clean":"2024-09-10T23:15:44.932924+0000","last_became_active":"2024-09-10T23:15:43.530574+0000","last_became_peered":"2024-09-10T23:15:43.530574+0000","last_unstale":"2024-09-10T23:15:44.932924+0000","last_undegraded":"2024-09-10T23:15:44.932924+0000","last_fullsized":"2024-09-10T23:15:44.932924+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:32.139284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.508254+0000","last_change":"2024-09-10T23:15:42.505319+0000","last_active":"2024-09-10T23:15:42.508254+0000","last_peered":"2024-09-10T23:15:42.508254+0000","last_clean":"2024-09-10T23:15:42.508254+0000","last_became_active":"2024-09-10T23:15:42.504868+0000","last_became_peered":"2024-09-10T23:15:42.504868+0000","last_unstale":"2024-09-10T23:15:42.508254+0000","last_undegraded":"2024-09-10T23:15:42.508254+0000","last_fullsized":"2024-09-10T23:15:42.508254+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:19.381787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.496168+0000","last_change":"2024-09-10T23:15:42.496168+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.496168+0000","last_undegraded":"2024-09-10T23:15:42.496168+0000","last_fullsized":"2024-09-10T23:15:42.496168+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517097+0000","last_change":"2024-09-10T23:15:42.506691+0000","last_active":"2024-09-10T23:15:44.517097+0000","last_peered":"2024-09-10T23:15:44.517097+0000","last_clean":"2024-09-10T23:15:44.517097+0000","last_became_active":"2024-09-10T23:15:42.506074+0000","last_became_peered":"2024-09-10T23:15:42.506074+0000","last_unstale":"2024-09-10T23:15:44.517097+0000","last_undegraded":"2024-09-10T23:15:44.517097+0000","last_fullsized":"2024-09-10T23:15:44.517097+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:27.141199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":152,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516368+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:15:44.516368+0000","last_peered":"2024-09-10T23:15:44.516368+0000","last_clean":"2024-09-10T23:15:44.516368+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:15:44.516368+0000","last_undegraded":"2024-09-10T23:15:44.516368+0000","last_fullsized":"2024-09-10T23:15:44.516368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1130496,"data_stored":803392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":540672,"data_stored":213606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":213004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":532480,"data_stored":208246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":532480,"data_stored":207272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":214568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":536576,"data_stored":213004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1101824,"data_stored":790227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:15:46.887 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:15:46.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.987+0000 7fd4807a0640 1 -- 172.21.15.90:0/1977733291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4780d2470 msgr2=0x7fd4780b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:46.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.987+0000 7fd4807a0640 1 --2- 172.21.15.90:0/1977733291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4780d2470 0x7fd4780b3490 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd474005fd0 tx=0x7fd47402a5d0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.987+0000 7fd4807a0640 1 -- 172.21.15.90:0/1977733291 shutdown_connections 2024-09-10T23:15:46.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.987+0000 7fd4807a0640 1 --2- 172.21.15.90:0/1977733291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4780b3a00 0x7fd4780b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.987+0000 7fd4807a0640 1 --2- 172.21.15.90:0/1977733291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4780d2470 0x7fd4780b3490 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.987+0000 7fd4807a0640 1 -- 172.21.15.90:0/1977733291 >> 172.21.15.90:0/1977733291 conn(0x7fd47809d2a0 msgr2=0x7fd4780d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:46.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.987+0000 7fd4807a0640 1 -- 172.21.15.90:0/1977733291 shutdown_connections 2024-09-10T23:15:46.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.987+0000 7fd4807a0640 1 -- 172.21.15.90:0/1977733291 wait complete. 2024-09-10T23:15:46.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.989+0000 7fd4807a0640 1 Processor -- start 2024-09-10T23:15:46.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.989+0000 7fd4807a0640 1 -- start start 2024-09-10T23:15:46.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.989+0000 7fd4807a0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4780b3a00 0x7fd4780cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:46.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.989+0000 7fd4807a0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4780d1c70 0x7fd4780b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:46.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.989+0000 7fd4807a0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4780d2470 0x7fd4780b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:46.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.989+0000 7fd4807a0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4780b4570 con 0x7fd4780d1c70 2024-09-10T23:15:46.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.989+0000 7fd4807a0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd4780b43f0 con 0x7fd4780b3a00 2024-09-10T23:15:46.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.989+0000 7fd4807a0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd4780b46f0 con 0x7fd4780d2470 2024-09-10T23:15:46.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.989+0000 7fd47dd3b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4780d1c70 0x7fd4780b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:46.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.989+0000 7fd47dd3b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4780d1c70 0x7fd4780b8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46778/0 (socket says 172.21.15.90:46778) 2024-09-10T23:15:46.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.989+0000 7fd47dd3b640 1 -- 172.21.15.90:0/2781168376 learned_addr learned my addr 172.21.15.90:0/2781168376 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:46.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.990+0000 7fd47ed3d640 1 --2- 172.21.15.90:0/2781168376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4780d2470 0x7fd4780b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:46.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.990+0000 7fd47e53c640 1 --2- 172.21.15.90:0/2781168376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4780b3a00 0x7fd4780cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:46.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.990+0000 7fd47dd3b640 1 -- 172.21.15.90:0/2781168376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4780d2470 msgr2=0x7fd4780b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:46.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.990+0000 7fd47dd3b640 1 --2- 172.21.15.90:0/2781168376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4780d2470 0x7fd4780b8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.990+0000 7fd47dd3b640 1 -- 172.21.15.90:0/2781168376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4780b3a00 msgr2=0x7fd4780cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:46.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.990+0000 7fd47dd3b640 1 --2- 172.21.15.90:0/2781168376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4780b3a00 0x7fd4780cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:46.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.990+0000 7fd47dd3b640 1 -- 172.21.15.90:0/2781168376 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4781f8e40 con 0x7fd4780d1c70 2024-09-10T23:15:46.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.990+0000 7fd47e53c640 1 --2- 172.21.15.90:0/2781168376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4780b3a00 0x7fd4780cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:46.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.990+0000 7fd47dd3b640 1 --2- 172.21.15.90:0/2781168376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4780d1c70 0x7fd4780b8510 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00c730 tx=0x7fd46c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:46.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.990+0000 7fd46affd640 1 -- 172.21.15.90:0/2781168376 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c005070 con 0x7fd4780d1c70 2024-09-10T23:15:46.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.990+0000 7fd46affd640 1 -- 172.21.15.90:0/2781168376 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd46c005230 con 0x7fd4780d1c70 2024-09-10T23:15:46.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.990+0000 7fd46affd640 1 -- 172.21.15.90:0/2781168376 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c00a640 con 0x7fd4780d1c70 2024-09-10T23:15:46.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.990+0000 7fd4807a0640 1 -- 172.21.15.90:0/2781168376 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4781f8080 con 0x7fd4780d1c70 2024-09-10T23:15:46.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.990+0000 7fd4807a0640 1 -- 172.21.15.90:0/2781168376 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4781f8640 con 0x7fd4780d1c70 2024-09-10T23:15:46.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.991+0000 7fd4807a0640 1 -- 172.21.15.90:0/2781168376 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4780b3eb0 con 0x7fd4780d1c70 2024-09-10T23:15:46.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.992+0000 7fd46affd640 1 -- 172.21.15.90:0/2781168376 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd46c00a9f0 con 0x7fd4780d1c70 2024-09-10T23:15:46.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.992+0000 7fd46affd640 1 --2- 172.21.15.90:0/2781168376 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd45c077f70 0x7fd45c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:46.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.992+0000 7fd46affd640 1 -- 172.21.15.90:0/2781168376 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fd46c099aa0 con 0x7fd4780d1c70 2024-09-10T23:15:46.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.992+0000 7fd47e53c640 1 --2- 172.21.15.90:0/2781168376 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd45c077f70 0x7fd45c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:46.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.993+0000 7fd47e53c640 1 --2- 172.21.15.90:0/2781168376 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd45c077f70 0x7fd45c07a430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd474033000 tx=0x7fd474004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:46.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:46.996+0000 7fd46affd640 1 -- 172.21.15.90:0/2781168376 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd4780cff60 con 0x7fd4780d1c70 2024-09-10T23:15:47.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.169+0000 7fd4807a0640 1 -- 172.21.15.90:0/2781168376 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4780d0420 con 0x7fd45c077f70 2024-09-10T23:15:47.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.174+0000 7fd46affd640 1 -- 172.21.15.90:0/2781168376 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250802 (secure 0 0 0) 0x7fd4780d0420 con 0x7fd45c077f70 2024-09-10T23:15:47.177 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:47.179 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:15:47.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.177+0000 7fd4807a0640 1 -- 172.21.15.90:0/2781168376 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd45c077f70 msgr2=0x7fd45c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:47.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.177+0000 7fd4807a0640 1 --2- 172.21.15.90:0/2781168376 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd45c077f70 0x7fd45c07a430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd474033000 tx=0x7fd474004730 comp rx=0 tx=0).stop 2024-09-10T23:15:47.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.177+0000 7fd4807a0640 1 -- 172.21.15.90:0/2781168376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4780d1c70 msgr2=0x7fd4780b8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:47.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.177+0000 7fd4807a0640 1 --2- 172.21.15.90:0/2781168376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4780d1c70 0x7fd4780b8510 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00c730 tx=0x7fd46c00cbf0 comp rx=0 tx=0).stop 2024-09-10T23:15:47.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.177+0000 7fd4807a0640 1 -- 172.21.15.90:0/2781168376 shutdown_connections 2024-09-10T23:15:47.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.177+0000 7fd4807a0640 1 --2- 172.21.15.90:0/2781168376 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd45c077f70 0x7fd45c07a430 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:47.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.177+0000 7fd4807a0640 1 --2- 172.21.15.90:0/2781168376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4780d2470 0x7fd4780b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:47.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.177+0000 7fd4807a0640 1 --2- 172.21.15.90:0/2781168376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4780d1c70 0x7fd4780b8510 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:47.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.177+0000 7fd4807a0640 1 --2- 172.21.15.90:0/2781168376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4780b3a00 0x7fd4780cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:47.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.177+0000 7fd4807a0640 1 -- 172.21.15.90:0/2781168376 >> 172.21.15.90:0/2781168376 conn(0x7fd47809d2a0 msgr2=0x7fd4780b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:47.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.177+0000 7fd4807a0640 1 -- 172.21.15.90:0/2781168376 shutdown_connections 2024-09-10T23:15:47.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.177+0000 7fd4807a0640 1 -- 172.21.15.90:0/2781168376 wait complete. 2024-09-10T23:15:47.189 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-09-10T23:15:46.448813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":133,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225748,"kb_used_data":5332,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748972,"statfs":{"total":773094113280,"available":772862947328,"internally_reserved":0,"allocated":5459968,"data_stored":2863319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.960789"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516290+0000","last_change":"2024-09-10T23:15:43.531769+0000","last_active":"2024-09-10T23:15:44.516290+0000","last_peered":"2024-09-10T23:15:44.516290+0000","last_clean":"2024-09-10T23:15:44.516290+0000","last_became_active":"2024-09-10T23:15:43.531487+0000","last_became_peered":"2024-09-10T23:15:43.531487+0000","last_unstale":"2024-09-10T23:15:44.516290+0000","last_undegraded":"2024-09-10T23:15:44.516290+0000","last_fullsized":"2024-09-10T23:15:44.516290+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:59.369815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516729+0000","last_change":"2024-09-10T23:15:43.529475+0000","last_active":"2024-09-10T23:15:44.516729+0000","last_peered":"2024-09-10T23:15:44.516729+0000","last_clean":"2024-09-10T23:15:44.516729+0000","last_became_active":"2024-09-10T23:15:43.529175+0000","last_became_peered":"2024-09-10T23:15:43.529175+0000","last_unstale":"2024-09-10T23:15:44.516729+0000","last_undegraded":"2024-09-10T23:15:44.516729+0000","last_fullsized":"2024-09-10T23:15:44.516729+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:42.574340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932949+0000","last_change":"2024-09-10T23:15:43.527735+0000","last_active":"2024-09-10T23:15:44.932949+0000","last_peered":"2024-09-10T23:15:44.932949+0000","last_clean":"2024-09-10T23:15:44.932949+0000","last_became_active":"2024-09-10T23:15:43.527276+0000","last_became_peered":"2024-09-10T23:15:43.527276+0000","last_unstale":"2024-09-10T23:15:44.932949+0000","last_undegraded":"2024-09-10T23:15:44.932949+0000","last_fullsized":"2024-09-10T23:15:44.932949+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:39.709891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.501516+0000","last_change":"2024-09-10T23:15:42.501516+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.501516+0000","last_undegraded":"2024-09-10T23:15:42.501516+0000","last_fullsized":"2024-09-10T23:15:42.501516+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516486+0000","last_change":"2024-09-10T23:15:43.529380+0000","last_active":"2024-09-10T23:15:44.516486+0000","last_peered":"2024-09-10T23:15:44.516486+0000","last_clean":"2024-09-10T23:15:44.516486+0000","last_became_active":"2024-09-10T23:15:43.529090+0000","last_became_peered":"2024-09-10T23:15:43.529090+0000","last_unstale":"2024-09-10T23:15:44.516486+0000","last_undegraded":"2024-09-10T23:15:44.516486+0000","last_fullsized":"2024-09-10T23:15:44.516486+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:52.446596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931825+0000","last_change":"2024-09-10T23:15:43.533375+0000","last_active":"2024-09-10T23:15:44.931825+0000","last_peered":"2024-09-10T23:15:44.931825+0000","last_clean":"2024-09-10T23:15:44.931825+0000","last_became_active":"2024-09-10T23:15:43.533088+0000","last_became_peered":"2024-09-10T23:15:43.533088+0000","last_unstale":"2024-09-10T23:15:44.931825+0000","last_undegraded":"2024-09-10T23:15:44.931825+0000","last_fullsized":"2024-09-10T23:15:44.931825+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:28.504092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516163+0000","last_change":"2024-09-10T23:15:43.543935+0000","last_active":"2024-09-10T23:15:44.516163+0000","last_peered":"2024-09-10T23:15:44.516163+0000","last_clean":"2024-09-10T23:15:44.516163+0000","last_became_active":"2024-09-10T23:15:43.543641+0000","last_became_peered":"2024-09-10T23:15:43.543641+0000","last_unstale":"2024-09-10T23:15:44.516163+0000","last_undegraded":"2024-09-10T23:15:44.516163+0000","last_fullsized":"2024-09-10T23:15:44.516163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:23.451112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.501129+0000","last_change":"2024-09-10T23:15:42.501129+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.501129+0000","last_undegraded":"2024-09-10T23:15:42.501129+0000","last_fullsized":"2024-09-10T23:15:42.501129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.501467+0000","last_change":"2024-09-10T23:15:42.501467+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.501467+0000","last_undegraded":"2024-09-10T23:15:42.501467+0000","last_fullsized":"2024-09-10T23:15:42.501467+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.499597+0000","last_change":"2024-09-10T23:15:42.499597+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.499597+0000","last_undegraded":"2024-09-10T23:15:42.499597+0000","last_fullsized":"2024-09-10T23:15:42.499597+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.498776+0000","last_change":"2024-09-10T23:15:42.498776+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.498776+0000","last_undegraded":"2024-09-10T23:15:42.498776+0000","last_fullsized":"2024-09-10T23:15:42.498776+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517339+0000","last_change":"2024-09-10T23:15:43.529156+0000","last_active":"2024-09-10T23:15:44.517339+0000","last_peered":"2024-09-10T23:15:44.517339+0000","last_clean":"2024-09-10T23:15:44.517339+0000","last_became_active":"2024-09-10T23:15:43.528877+0000","last_became_peered":"2024-09-10T23:15:43.528877+0000","last_unstale":"2024-09-10T23:15:44.517339+0000","last_undegraded":"2024-09-10T23:15:44.517339+0000","last_fullsized":"2024-09-10T23:15:44.517339+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:58.070612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931161+0000","last_change":"2024-09-10T23:15:43.527284+0000","last_active":"2024-09-10T23:15:44.931161+0000","last_peered":"2024-09-10T23:15:44.931161+0000","last_clean":"2024-09-10T23:15:44.931161+0000","last_became_active":"2024-09-10T23:15:43.527019+0000","last_became_peered":"2024-09-10T23:15:43.527019+0000","last_unstale":"2024-09-10T23:15:44.931161+0000","last_undegraded":"2024-09-10T23:15:44.931161+0000","last_fullsized":"2024-09-10T23:15:44.931161+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:20.558073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.498260+0000","last_change":"2024-09-10T23:15:42.498260+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.498260+0000","last_undegraded":"2024-09-10T23:15:42.498260+0000","last_fullsized":"2024-09-10T23:15:42.498260+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931121+0000","last_change":"2024-09-10T23:15:43.530842+0000","last_active":"2024-09-10T23:15:44.931121+0000","last_peered":"2024-09-10T23:15:44.931121+0000","last_clean":"2024-09-10T23:15:44.931121+0000","last_became_active":"2024-09-10T23:15:43.530559+0000","last_became_peered":"2024-09-10T23:15:43.530559+0000","last_unstale":"2024-09-10T23:15:44.931121+0000","last_undegraded":"2024-09-10T23:15:44.931121+0000","last_fullsized":"2024-09-10T23:15:44.931121+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:41.393470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931624+0000","last_change":"2024-09-10T23:15:43.533130+0000","last_active":"2024-09-10T23:15:44.931624+0000","last_peered":"2024-09-10T23:15:44.931624+0000","last_clean":"2024-09-10T23:15:44.931624+0000","last_became_active":"2024-09-10T23:15:43.532800+0000","last_became_peered":"2024-09-10T23:15:43.532800+0000","last_unstale":"2024-09-10T23:15:44.931624+0000","last_undegraded":"2024-09-10T23:15:44.931624+0000","last_fullsized":"2024-09-10T23:15:44.931624+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:22.539205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933198+0000","last_change":"2024-09-10T23:15:43.524871+0000","last_active":"2024-09-10T23:15:44.933198+0000","last_peered":"2024-09-10T23:15:44.933198+0000","last_clean":"2024-09-10T23:15:44.933198+0000","last_became_active":"2024-09-10T23:15:43.524580+0000","last_became_peered":"2024-09-10T23:15:43.524580+0000","last_unstale":"2024-09-10T23:15:44.933198+0000","last_undegraded":"2024-09-10T23:15:44.933198+0000","last_fullsized":"2024-09-10T23:15:44.933198+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:46.276138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933038+0000","last_change":"2024-09-10T23:15:43.530280+0000","last_active":"2024-09-10T23:15:44.933038+0000","last_peered":"2024-09-10T23:15:44.933038+0000","last_clean":"2024-09-10T23:15:44.933038+0000","last_became_active":"2024-09-10T23:15:43.529987+0000","last_became_peered":"2024-09-10T23:15:43.529987+0000","last_unstale":"2024-09-10T23:15:44.933038+0000","last_undegraded":"2024-09-10T23:15:44.933038+0000","last_fullsized":"2024-09-10T23:15:44.933038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:56.385670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932219+0000","last_change":"2024-09-10T23:15:43.532316+0000","last_active":"2024-09-10T23:15:44.932219+0000","last_peered":"2024-09-10T23:15:44.932219+0000","last_clean":"2024-09-10T23:15:44.932219+0000","last_became_active":"2024-09-10T23:15:43.532064+0000","last_became_peered":"2024-09-10T23:15:43.532064+0000","last_unstale":"2024-09-10T23:15:44.932219+0000","last_undegraded":"2024-09-10T23:15:44.932219+0000","last_fullsized":"2024-09-10T23:15:44.932219+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:43.137866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931596+0000","last_change":"2024-09-10T23:15:43.531896+0000","last_active":"2024-09-10T23:15:44.931596+0000","last_peered":"2024-09-10T23:15:44.931596+0000","last_clean":"2024-09-10T23:15:44.931596+0000","last_became_active":"2024-09-10T23:15:43.531650+0000","last_became_peered":"2024-09-10T23:15:43.531650+0000","last_unstale":"2024-09-10T23:15:44.931596+0000","last_undegraded":"2024-09-10T23:15:44.931596+0000","last_fullsized":"2024-09-10T23:15:44.931596+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:49.987654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932163+0000","last_change":"2024-09-10T23:15:43.538991+0000","last_active":"2024-09-10T23:15:44.932163+0000","last_peered":"2024-09-10T23:15:44.932163+0000","last_clean":"2024-09-10T23:15:44.932163+0000","last_became_active":"2024-09-10T23:15:43.538544+0000","last_became_peered":"2024-09-10T23:15:43.538544+0000","last_unstale":"2024-09-10T23:15:44.932163+0000","last_undegraded":"2024-09-10T23:15:44.932163+0000","last_fullsized":"2024-09-10T23:15:44.932163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:00.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.493997+0000","last_change":"2024-09-10T23:15:42.493997+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.493997+0000","last_undegraded":"2024-09-10T23:15:42.493997+0000","last_fullsized":"2024-09-10T23:15:42.493997+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931912+0000","last_change":"2024-09-10T23:15:43.535424+0000","last_active":"2024-09-10T23:15:44.931912+0000","last_peered":"2024-09-10T23:15:44.931912+0000","last_clean":"2024-09-10T23:15:44.931912+0000","last_became_active":"2024-09-10T23:15:43.535182+0000","last_became_peered":"2024-09-10T23:15:43.535182+0000","last_unstale":"2024-09-10T23:15:44.931912+0000","last_undegraded":"2024-09-10T23:15:44.931912+0000","last_fullsized":"2024-09-10T23:15:44.931912+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:30.995258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931643+0000","last_change":"2024-09-10T23:15:43.534813+0000","last_active":"2024-09-10T23:15:44.931643+0000","last_peered":"2024-09-10T23:15:44.931643+0000","last_clean":"2024-09-10T23:15:44.931643+0000","last_became_active":"2024-09-10T23:15:43.534529+0000","last_became_peered":"2024-09-10T23:15:43.534529+0000","last_unstale":"2024-09-10T23:15:44.931643+0000","last_undegraded":"2024-09-10T23:15:44.931643+0000","last_fullsized":"2024-09-10T23:15:44.931643+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:52.674972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932061+0000","last_change":"2024-09-10T23:15:43.536434+0000","last_active":"2024-09-10T23:15:44.932061+0000","last_peered":"2024-09-10T23:15:44.932061+0000","last_clean":"2024-09-10T23:15:44.932061+0000","last_became_active":"2024-09-10T23:15:43.536045+0000","last_became_peered":"2024-09-10T23:15:43.536045+0000","last_unstale":"2024-09-10T23:15:44.932061+0000","last_undegraded":"2024-09-10T23:15:44.932061+0000","last_fullsized":"2024-09-10T23:15:44.932061+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:41.288775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931088+0000","last_change":"2024-09-10T23:15:43.525079+0000","last_active":"2024-09-10T23:15:44.931088+0000","last_peered":"2024-09-10T23:15:44.931088+0000","last_clean":"2024-09-10T23:15:44.931088+0000","last_became_active":"2024-09-10T23:15:43.524767+0000","last_became_peered":"2024-09-10T23:15:43.524767+0000","last_unstale":"2024-09-10T23:15:44.931088+0000","last_undegraded":"2024-09-10T23:15:44.931088+0000","last_fullsized":"2024-09-10T23:15:44.931088+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:43.164571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933052+0000","last_change":"2024-09-10T23:15:43.527365+0000","last_active":"2024-09-10T23:15:44.933052+0000","last_peered":"2024-09-10T23:15:44.933052+0000","last_clean":"2024-09-10T23:15:44.933052+0000","last_became_active":"2024-09-10T23:15:43.527076+0000","last_became_peered":"2024-09-10T23:15:43.527076+0000","last_unstale":"2024-09-10T23:15:44.933052+0000","last_undegraded":"2024-09-10T23:15:44.933052+0000","last_fullsized":"2024-09-10T23:15:44.933052+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:03.936831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517372+0000","last_change":"2024-09-10T23:15:43.528612+0000","last_active":"2024-09-10T23:15:44.517372+0000","last_peered":"2024-09-10T23:15:44.517372+0000","last_clean":"2024-09-10T23:15:44.517372+0000","last_became_active":"2024-09-10T23:15:43.528315+0000","last_became_peered":"2024-09-10T23:15:43.528315+0000","last_unstale":"2024-09-10T23:15:44.517372+0000","last_undegraded":"2024-09-10T23:15:44.517372+0000","last_fullsized":"2024-09-10T23:15:44.517372+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:28.073391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931746+0000","last_change":"2024-09-10T23:15:43.535273+0000","last_active":"2024-09-10T23:15:44.931746+0000","last_peered":"2024-09-10T23:15:44.931746+0000","last_clean":"2024-09-10T23:15:44.931746+0000","last_became_active":"2024-09-10T23:15:43.535024+0000","last_became_peered":"2024-09-10T23:15:43.535024+0000","last_unstale":"2024-09-10T23:15:44.931746+0000","last_undegraded":"2024-09-10T23:15:44.931746+0000","last_fullsized":"2024-09-10T23:15:44.931746+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:04.093540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932900+0000","last_change":"2024-09-10T23:15:43.527299+0000","last_active":"2024-09-10T23:15:44.932900+0000","last_peered":"2024-09-10T23:15:44.932900+0000","last_clean":"2024-09-10T23:15:44.932900+0000","last_became_active":"2024-09-10T23:15:43.526863+0000","last_became_peered":"2024-09-10T23:15:43.526863+0000","last_unstale":"2024-09-10T23:15:44.932900+0000","last_undegraded":"2024-09-10T23:15:44.932900+0000","last_fullsized":"2024-09-10T23:15:44.932900+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:11.752339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931322+0000","last_change":"2024-09-10T23:15:43.530364+0000","last_active":"2024-09-10T23:15:44.931322+0000","last_peered":"2024-09-10T23:15:44.931322+0000","last_clean":"2024-09-10T23:15:44.931322+0000","last_became_active":"2024-09-10T23:15:43.530090+0000","last_became_peered":"2024-09-10T23:15:43.530090+0000","last_unstale":"2024-09-10T23:15:44.931322+0000","last_undegraded":"2024-09-10T23:15:44.931322+0000","last_fullsized":"2024-09-10T23:15:44.931322+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:54.877057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.930861+0000","last_change":"2024-09-10T23:15:43.521138+0000","last_active":"2024-09-10T23:15:44.930861+0000","last_peered":"2024-09-10T23:15:44.930861+0000","last_clean":"2024-09-10T23:15:44.930861+0000","last_became_active":"2024-09-10T23:15:43.520871+0000","last_became_peered":"2024-09-10T23:15:43.520871+0000","last_unstale":"2024-09-10T23:15:44.930861+0000","last_undegraded":"2024-09-10T23:15:44.930861+0000","last_fullsized":"2024-09-10T23:15:44.930861+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:48.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.515005+0000","last_change":"2024-09-10T23:15:43.528339+0000","last_active":"2024-09-10T23:15:44.515005+0000","last_peered":"2024-09-10T23:15:44.515005+0000","last_clean":"2024-09-10T23:15:44.515005+0000","last_became_active":"2024-09-10T23:15:43.528000+0000","last_became_peered":"2024-09-10T23:15:43.528000+0000","last_unstale":"2024-09-10T23:15:44.515005+0000","last_undegraded":"2024-09-10T23:15:44.515005+0000","last_fullsized":"2024-09-10T23:15:44.515005+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:41.252238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932530+0000","last_change":"2024-09-10T23:15:42.511719+0000","last_active":"2024-09-10T23:15:44.932530+0000","last_peered":"2024-09-10T23:15:44.932530+0000","last_clean":"2024-09-10T23:15:44.932530+0000","last_became_active":"2024-09-10T23:15:42.511478+0000","last_became_peered":"2024-09-10T23:15:42.511478+0000","last_unstale":"2024-09-10T23:15:44.932530+0000","last_undegraded":"2024-09-10T23:15:44.932530+0000","last_fullsized":"2024-09-10T23:15:44.932530+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:33.981158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932123+0000","last_change":"2024-09-10T23:15:43.523565+0000","last_active":"2024-09-10T23:15:44.932123+0000","last_peered":"2024-09-10T23:15:44.932123+0000","last_clean":"2024-09-10T23:15:44.932123+0000","last_became_active":"2024-09-10T23:15:43.523272+0000","last_became_peered":"2024-09-10T23:15:43.523272+0000","last_unstale":"2024-09-10T23:15:44.932123+0000","last_undegraded":"2024-09-10T23:15:44.932123+0000","last_fullsized":"2024-09-10T23:15:44.932123+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:41.252238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933175+0000","last_change":"2024-09-10T23:15:42.511614+0000","last_active":"2024-09-10T23:15:44.933175+0000","last_peered":"2024-09-10T23:15:44.933175+0000","last_clean":"2024-09-10T23:15:44.933175+0000","last_became_active":"2024-09-10T23:15:42.511315+0000","last_became_peered":"2024-09-10T23:15:42.511315+0000","last_unstale":"2024-09-10T23:15:44.933175+0000","last_undegraded":"2024-09-10T23:15:44.933175+0000","last_fullsized":"2024-09-10T23:15:44.933175+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:51.671803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517486+0000","last_change":"2024-09-10T23:15:43.529829+0000","last_active":"2024-09-10T23:15:44.517486+0000","last_peered":"2024-09-10T23:15:44.517486+0000","last_clean":"2024-09-10T23:15:44.517486+0000","last_became_active":"2024-09-10T23:15:43.529545+0000","last_became_peered":"2024-09-10T23:15:43.529545+0000","last_unstale":"2024-09-10T23:15:44.517486+0000","last_undegraded":"2024-09-10T23:15:44.517486+0000","last_fullsized":"2024-09-10T23:15:44.517486+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:37.792217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514966+0000","last_change":"2024-09-10T23:15:42.507388+0000","last_active":"2024-09-10T23:15:44.514966+0000","last_peered":"2024-09-10T23:15:44.514966+0000","last_clean":"2024-09-10T23:15:44.514966+0000","last_became_active":"2024-09-10T23:15:42.507140+0000","last_became_peered":"2024-09-10T23:15:42.507140+0000","last_unstale":"2024-09-10T23:15:44.514966+0000","last_undegraded":"2024-09-10T23:15:44.514966+0000","last_fullsized":"2024-09-10T23:15:44.514966+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:00.620682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514992+0000","last_change":"2024-09-10T23:15:43.535494+0000","last_active":"2024-09-10T23:15:44.514992+0000","last_peered":"2024-09-10T23:15:44.514992+0000","last_clean":"2024-09-10T23:15:44.514992+0000","last_became_active":"2024-09-10T23:15:43.535197+0000","last_became_peered":"2024-09-10T23:15:43.535197+0000","last_unstale":"2024-09-10T23:15:44.514992+0000","last_undegraded":"2024-09-10T23:15:44.514992+0000","last_fullsized":"2024-09-10T23:15:44.514992+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:51.184507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.515748+0000","last_change":"2024-09-10T23:15:42.507889+0000","last_active":"2024-09-10T23:15:44.515748+0000","last_peered":"2024-09-10T23:15:44.515748+0000","last_clean":"2024-09-10T23:15:44.515748+0000","last_became_active":"2024-09-10T23:15:42.507525+0000","last_became_peered":"2024-09-10T23:15:42.507525+0000","last_unstale":"2024-09-10T23:15:44.515748+0000","last_undegraded":"2024-09-10T23:15:44.515748+0000","last_fullsized":"2024-09-10T23:15:44.515748+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:31.136115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932861+0000","last_change":"2024-09-10T23:15:43.528047+0000","last_active":"2024-09-10T23:15:44.932861+0000","last_peered":"2024-09-10T23:15:44.932861+0000","last_clean":"2024-09-10T23:15:44.932861+0000","last_became_active":"2024-09-10T23:15:43.527788+0000","last_became_peered":"2024-09-10T23:15:43.527788+0000","last_unstale":"2024-09-10T23:15:44.932861+0000","last_undegraded":"2024-09-10T23:15:44.932861+0000","last_fullsized":"2024-09-10T23:15:44.932861+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:52.085571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932226+0000","last_change":"2024-09-10T23:15:42.504164+0000","last_active":"2024-09-10T23:15:44.932226+0000","last_peered":"2024-09-10T23:15:44.932226+0000","last_clean":"2024-09-10T23:15:44.932226+0000","last_became_active":"2024-09-10T23:15:42.503841+0000","last_became_peered":"2024-09-10T23:15:42.503841+0000","last_unstale":"2024-09-10T23:15:44.932226+0000","last_undegraded":"2024-09-10T23:15:44.932226+0000","last_fullsized":"2024-09-10T23:15:44.932226+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:51.973570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.497880+0000","last_change":"2024-09-10T23:15:42.497880+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.497880+0000","last_undegraded":"2024-09-10T23:15:42.497880+0000","last_fullsized":"2024-09-10T23:15:42.497880+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933092+0000","last_change":"2024-09-10T23:15:42.507501+0000","last_active":"2024-09-10T23:15:44.933092+0000","last_peered":"2024-09-10T23:15:44.933092+0000","last_clean":"2024-09-10T23:15:44.933092+0000","last_became_active":"2024-09-10T23:15:42.507224+0000","last_became_peered":"2024-09-10T23:15:42.507224+0000","last_unstale":"2024-09-10T23:15:44.933092+0000","last_undegraded":"2024-09-10T23:15:44.933092+0000","last_fullsized":"2024-09-10T23:15:44.933092+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:41.069742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.498212+0000","last_change":"2024-09-10T23:15:42.498212+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.498212+0000","last_undegraded":"2024-09-10T23:15:42.498212+0000","last_fullsized":"2024-09-10T23:15:42.498212+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516014+0000","last_change":"2024-09-10T23:15:42.500537+0000","last_active":"2024-09-10T23:15:44.516014+0000","last_peered":"2024-09-10T23:15:44.516014+0000","last_clean":"2024-09-10T23:15:44.516014+0000","last_became_active":"2024-09-10T23:15:42.500174+0000","last_became_peered":"2024-09-10T23:15:42.500174+0000","last_unstale":"2024-09-10T23:15:44.516014+0000","last_undegraded":"2024-09-10T23:15:44.516014+0000","last_fullsized":"2024-09-10T23:15:44.516014+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:42.134697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931662+0000","last_change":"2024-09-10T23:15:43.534456+0000","last_active":"2024-09-10T23:15:44.931662+0000","last_peered":"2024-09-10T23:15:44.931662+0000","last_clean":"2024-09-10T23:15:44.931662+0000","last_became_active":"2024-09-10T23:15:43.534189+0000","last_became_peered":"2024-09-10T23:15:43.534189+0000","last_unstale":"2024-09-10T23:15:44.931662+0000","last_undegraded":"2024-09-10T23:15:44.931662+0000","last_fullsized":"2024-09-10T23:15:44.931662+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:10.389011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.508230+0000","last_change":"2024-09-10T23:15:42.504650+0000","last_active":"2024-09-10T23:15:42.508230+0000","last_peered":"2024-09-10T23:15:42.508230+0000","last_clean":"2024-09-10T23:15:42.508230+0000","last_became_active":"2024-09-10T23:15:42.504410+0000","last_became_peered":"2024-09-10T23:15:42.504410+0000","last_unstale":"2024-09-10T23:15:42.508230+0000","last_undegraded":"2024-09-10T23:15:42.508230+0000","last_fullsized":"2024-09-10T23:15:42.508230+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:45.052771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933152+0000","last_change":"2024-09-10T23:15:43.531044+0000","last_active":"2024-09-10T23:15:44.933152+0000","last_peered":"2024-09-10T23:15:44.933152+0000","last_clean":"2024-09-10T23:15:44.933152+0000","last_became_active":"2024-09-10T23:15:43.530763+0000","last_became_peered":"2024-09-10T23:15:43.530763+0000","last_unstale":"2024-09-10T23:15:44.933152+0000","last_undegraded":"2024-09-10T23:15:44.933152+0000","last_fullsized":"2024-09-10T23:15:44.933152+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:52.976739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933174+0000","last_change":"2024-09-10T23:15:42.497687+0000","last_active":"2024-09-10T23:15:44.933174+0000","last_peered":"2024-09-10T23:15:44.933174+0000","last_clean":"2024-09-10T23:15:44.933174+0000","last_became_active":"2024-09-10T23:15:42.497411+0000","last_became_peered":"2024-09-10T23:15:42.497411+0000","last_unstale":"2024-09-10T23:15:44.933174+0000","last_undegraded":"2024-09-10T23:15:44.933174+0000","last_fullsized":"2024-09-10T23:15:44.933174+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:07.647238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516410+0000","last_change":"2024-09-10T23:15:43.537527+0000","last_active":"2024-09-10T23:15:44.516410+0000","last_peered":"2024-09-10T23:15:44.516410+0000","last_clean":"2024-09-10T23:15:44.516410+0000","last_became_active":"2024-09-10T23:15:43.537079+0000","last_became_peered":"2024-09-10T23:15:43.537079+0000","last_unstale":"2024-09-10T23:15:44.516410+0000","last_undegraded":"2024-09-10T23:15:44.516410+0000","last_fullsized":"2024-09-10T23:15:44.516410+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:07.594488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.507897+0000","last_change":"2024-09-10T23:15:42.504742+0000","last_active":"2024-09-10T23:15:42.507897+0000","last_peered":"2024-09-10T23:15:42.507897+0000","last_clean":"2024-09-10T23:15:42.507897+0000","last_became_active":"2024-09-10T23:15:42.504469+0000","last_became_peered":"2024-09-10T23:15:42.504469+0000","last_unstale":"2024-09-10T23:15:42.507897+0000","last_undegraded":"2024-09-10T23:15:42.507897+0000","last_fullsized":"2024-09-10T23:15:42.507897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:26.061097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932516+0000","last_change":"2024-09-10T23:15:43.536547+0000","last_active":"2024-09-10T23:15:44.932516+0000","last_peered":"2024-09-10T23:15:44.932516+0000","last_clean":"2024-09-10T23:15:44.932516+0000","last_became_active":"2024-09-10T23:15:43.535697+0000","last_became_peered":"2024-09-10T23:15:43.535697+0000","last_unstale":"2024-09-10T23:15:44.932516+0000","last_undegraded":"2024-09-10T23:15:44.932516+0000","last_fullsized":"2024-09-10T23:15:44.932516+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:02.345671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516552+0000","last_change":"2024-09-10T23:15:42.512649+0000","last_active":"2024-09-10T23:15:44.516552+0000","last_peered":"2024-09-10T23:15:44.516552+0000","last_clean":"2024-09-10T23:15:44.516552+0000","last_became_active":"2024-09-10T23:15:42.512284+0000","last_became_peered":"2024-09-10T23:15:42.512284+0000","last_unstale":"2024-09-10T23:15:44.516552+0000","last_undegraded":"2024-09-10T23:15:44.516552+0000","last_fullsized":"2024-09-10T23:15:44.516552+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:02.933662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516269+0000","last_change":"2024-09-10T23:15:43.543825+0000","last_active":"2024-09-10T23:15:44.516269+0000","last_peered":"2024-09-10T23:15:44.516269+0000","last_clean":"2024-09-10T23:15:44.516269+0000","last_became_active":"2024-09-10T23:15:43.543546+0000","last_became_peered":"2024-09-10T23:15:43.543546+0000","last_unstale":"2024-09-10T23:15:44.516269+0000","last_undegraded":"2024-09-10T23:15:44.516269+0000","last_fullsized":"2024-09-10T23:15:44.516269+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:29.218569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931707+0000","last_change":"2024-09-10T23:15:42.499400+0000","last_active":"2024-09-10T23:15:44.931707+0000","last_peered":"2024-09-10T23:15:44.931707+0000","last_clean":"2024-09-10T23:15:44.931707+0000","last_became_active":"2024-09-10T23:15:42.499123+0000","last_became_peered":"2024-09-10T23:15:42.499123+0000","last_unstale":"2024-09-10T23:15:44.931707+0000","last_undegraded":"2024-09-10T23:15:44.931707+0000","last_fullsized":"2024-09-10T23:15:44.931707+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:27.654745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932077+0000","last_change":"2024-09-10T23:15:43.532558+0000","last_active":"2024-09-10T23:15:44.932077+0000","last_peered":"2024-09-10T23:15:44.932077+0000","last_clean":"2024-09-10T23:15:44.932077+0000","last_became_active":"2024-09-10T23:15:43.532269+0000","last_became_peered":"2024-09-10T23:15:43.532269+0000","last_unstale":"2024-09-10T23:15:44.932077+0000","last_undegraded":"2024-09-10T23:15:44.932077+0000","last_fullsized":"2024-09-10T23:15:44.932077+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:49.306185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932280+0000","last_change":"2024-09-10T23:15:42.508928+0000","last_active":"2024-09-10T23:15:44.932280+0000","last_peered":"2024-09-10T23:15:44.932280+0000","last_clean":"2024-09-10T23:15:44.932280+0000","last_became_active":"2024-09-10T23:15:42.508568+0000","last_became_peered":"2024-09-10T23:15:42.508568+0000","last_unstale":"2024-09-10T23:15:44.932280+0000","last_undegraded":"2024-09-10T23:15:44.932280+0000","last_fullsized":"2024-09-10T23:15:44.932280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:55.382501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.496416+0000","last_change":"2024-09-10T23:15:42.496416+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.496416+0000","last_undegraded":"2024-09-10T23:15:42.496416+0000","last_fullsized":"2024-09-10T23:15:42.496416+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516010+0000","last_change":"2024-09-10T23:15:42.502106+0000","last_active":"2024-09-10T23:15:44.516010+0000","last_peered":"2024-09-10T23:15:44.516010+0000","last_clean":"2024-09-10T23:15:44.516010+0000","last_became_active":"2024-09-10T23:15:42.501620+0000","last_became_peered":"2024-09-10T23:15:42.501620+0000","last_unstale":"2024-09-10T23:15:44.516010+0000","last_undegraded":"2024-09-10T23:15:44.516010+0000","last_fullsized":"2024-09-10T23:15:44.516010+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:42.459571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.930865+0000","last_change":"2024-09-10T23:15:43.534217+0000","last_active":"2024-09-10T23:15:44.930865+0000","last_peered":"2024-09-10T23:15:44.930865+0000","last_clean":"2024-09-10T23:15:44.930865+0000","last_became_active":"2024-09-10T23:15:43.533952+0000","last_became_peered":"2024-09-10T23:15:43.533952+0000","last_unstale":"2024-09-10T23:15:44.930865+0000","last_undegraded":"2024-09-10T23:15:44.930865+0000","last_fullsized":"2024-09-10T23:15:44.930865+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:46:57.091610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931425+0000","last_change":"2024-09-10T23:15:42.508283+0000","last_active":"2024-09-10T23:15:44.931425+0000","last_peered":"2024-09-10T23:15:44.931425+0000","last_clean":"2024-09-10T23:15:44.931425+0000","last_became_active":"2024-09-10T23:15:42.508016+0000","last_became_peered":"2024-09-10T23:15:42.508016+0000","last_unstale":"2024-09-10T23:15:44.931425+0000","last_undegraded":"2024-09-10T23:15:44.931425+0000","last_fullsized":"2024-09-10T23:15:44.931425+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:38.706722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516424+0000","last_change":"2024-09-10T23:15:43.540626+0000","last_active":"2024-09-10T23:15:44.516424+0000","last_peered":"2024-09-10T23:15:44.516424+0000","last_clean":"2024-09-10T23:15:44.516424+0000","last_became_active":"2024-09-10T23:15:43.540323+0000","last_became_peered":"2024-09-10T23:15:43.540323+0000","last_unstale":"2024-09-10T23:15:44.516424+0000","last_undegraded":"2024-09-10T23:15:44.516424+0000","last_fullsized":"2024-09-10T23:15:44.516424+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:27.806294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.509136+0000","last_change":"2024-09-10T23:15:42.507669+0000","last_active":"2024-09-10T23:15:42.509136+0000","last_peered":"2024-09-10T23:15:42.509136+0000","last_clean":"2024-09-10T23:15:42.509136+0000","last_became_active":"2024-09-10T23:15:42.507393+0000","last_became_peered":"2024-09-10T23:15:42.507393+0000","last_unstale":"2024-09-10T23:15:42.509136+0000","last_undegraded":"2024-09-10T23:15:42.509136+0000","last_fullsized":"2024-09-10T23:15:42.509136+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:53.985338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931271+0000","last_change":"2024-09-10T23:15:43.518692+0000","last_active":"2024-09-10T23:15:44.931271+0000","last_peered":"2024-09-10T23:15:44.931271+0000","last_clean":"2024-09-10T23:15:44.931271+0000","last_became_active":"2024-09-10T23:15:43.518325+0000","last_became_peered":"2024-09-10T23:15:43.518325+0000","last_unstale":"2024-09-10T23:15:44.931271+0000","last_undegraded":"2024-09-10T23:15:44.931271+0000","last_fullsized":"2024-09-10T23:15:44.931271+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:26.438912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931431+0000","last_change":"2024-09-10T23:15:42.501325+0000","last_active":"2024-09-10T23:15:44.931431+0000","last_peered":"2024-09-10T23:15:44.931431+0000","last_clean":"2024-09-10T23:15:44.931431+0000","last_became_active":"2024-09-10T23:15:42.501051+0000","last_became_peered":"2024-09-10T23:15:42.501051+0000","last_unstale":"2024-09-10T23:15:44.931431+0000","last_undegraded":"2024-09-10T23:15:44.931431+0000","last_fullsized":"2024-09-10T23:15:44.931431+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:01.930458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.496590+0000","last_change":"2024-09-10T23:15:42.496590+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.496590+0000","last_undegraded":"2024-09-10T23:15:42.496590+0000","last_fullsized":"2024-09-10T23:15:42.496590+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933250+0000","last_change":"2024-09-10T23:15:42.499477+0000","last_active":"2024-09-10T23:15:44.933250+0000","last_peered":"2024-09-10T23:15:44.933250+0000","last_clean":"2024-09-10T23:15:44.933250+0000","last_became_active":"2024-09-10T23:15:42.499161+0000","last_became_peered":"2024-09-10T23:15:42.499161+0000","last_unstale":"2024-09-10T23:15:44.933250+0000","last_undegraded":"2024-09-10T23:15:44.933250+0000","last_fullsized":"2024-09-10T23:15:44.933250+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:00.620682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931894+0000","last_change":"2024-09-10T23:15:43.530654+0000","last_active":"2024-09-10T23:15:44.931894+0000","last_peered":"2024-09-10T23:15:44.931894+0000","last_clean":"2024-09-10T23:15:44.931894+0000","last_became_active":"2024-09-10T23:15:43.530378+0000","last_became_peered":"2024-09-10T23:15:43.530378+0000","last_unstale":"2024-09-10T23:15:44.931894+0000","last_undegraded":"2024-09-10T23:15:44.931894+0000","last_fullsized":"2024-09-10T23:15:44.931894+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:36.613962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516809+0000","last_change":"2024-09-10T23:15:42.501879+0000","last_active":"2024-09-10T23:15:44.516809+0000","last_peered":"2024-09-10T23:15:44.516809+0000","last_clean":"2024-09-10T23:15:44.516809+0000","last_became_active":"2024-09-10T23:15:42.501613+0000","last_became_peered":"2024-09-10T23:15:42.501613+0000","last_unstale":"2024-09-10T23:15:44.516809+0000","last_undegraded":"2024-09-10T23:15:44.516809+0000","last_fullsized":"2024-09-10T23:15:44.516809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:31.143311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931997+0000","last_change":"2024-09-10T23:15:43.534829+0000","last_active":"2024-09-10T23:15:44.931997+0000","last_peered":"2024-09-10T23:15:44.931997+0000","last_clean":"2024-09-10T23:15:44.931997+0000","last_became_active":"2024-09-10T23:15:43.533503+0000","last_became_peered":"2024-09-10T23:15:43.533503+0000","last_unstale":"2024-09-10T23:15:44.931997+0000","last_undegraded":"2024-09-10T23:15:44.931997+0000","last_fullsized":"2024-09-10T23:15:44.931997+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:38.530901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932497+0000","last_change":"2024-09-10T23:15:42.511492+0000","last_active":"2024-09-10T23:15:44.932497+0000","last_peered":"2024-09-10T23:15:44.932497+0000","last_clean":"2024-09-10T23:15:44.932497+0000","last_became_active":"2024-09-10T23:15:42.511245+0000","last_became_peered":"2024-09-10T23:15:42.511245+0000","last_unstale":"2024-09-10T23:15:44.932497+0000","last_undegraded":"2024-09-10T23:15:44.932497+0000","last_fullsized":"2024-09-10T23:15:44.932497+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:45.272969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932054+0000","last_change":"2024-09-10T23:15:43.527612+0000","last_active":"2024-09-10T23:15:44.932054+0000","last_peered":"2024-09-10T23:15:44.932054+0000","last_clean":"2024-09-10T23:15:44.932054+0000","last_became_active":"2024-09-10T23:15:43.527357+0000","last_became_peered":"2024-09-10T23:15:43.527357+0000","last_unstale":"2024-09-10T23:15:44.932054+0000","last_undegraded":"2024-09-10T23:15:44.932054+0000","last_fullsized":"2024-09-10T23:15:44.932054+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:51.973604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932333+0000","last_change":"2024-09-10T23:15:42.501512+0000","last_active":"2024-09-10T23:15:44.932333+0000","last_peered":"2024-09-10T23:15:44.932333+0000","last_clean":"2024-09-10T23:15:44.932333+0000","last_became_active":"2024-09-10T23:15:42.501257+0000","last_became_peered":"2024-09-10T23:15:42.501257+0000","last_unstale":"2024-09-10T23:15:44.932333+0000","last_undegraded":"2024-09-10T23:15:44.932333+0000","last_fullsized":"2024-09-10T23:15:44.932333+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:02.933662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514830+0000","last_change":"2024-09-10T23:15:43.527690+0000","last_active":"2024-09-10T23:15:44.514830+0000","last_peered":"2024-09-10T23:15:44.514830+0000","last_clean":"2024-09-10T23:15:44.514830+0000","last_became_active":"2024-09-10T23:15:43.527237+0000","last_became_peered":"2024-09-10T23:15:43.527237+0000","last_unstale":"2024-09-10T23:15:44.514830+0000","last_undegraded":"2024-09-10T23:15:44.514830+0000","last_fullsized":"2024-09-10T23:15:44.514830+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:34.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516195+0000","last_change":"2024-09-10T23:15:42.509258+0000","last_active":"2024-09-10T23:15:44.516195+0000","last_peered":"2024-09-10T23:15:44.516195+0000","last_clean":"2024-09-10T23:15:44.516195+0000","last_became_active":"2024-09-10T23:15:42.508931+0000","last_became_peered":"2024-09-10T23:15:42.508931+0000","last_unstale":"2024-09-10T23:15:44.516195+0000","last_undegraded":"2024-09-10T23:15:44.516195+0000","last_fullsized":"2024-09-10T23:15:44.516195+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:03.971821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.930894+0000","last_change":"2024-09-10T23:15:43.533806+0000","last_active":"2024-09-10T23:15:44.930894+0000","last_peered":"2024-09-10T23:15:44.930894+0000","last_clean":"2024-09-10T23:15:44.930894+0000","last_became_active":"2024-09-10T23:15:43.533555+0000","last_became_peered":"2024-09-10T23:15:43.533555+0000","last_unstale":"2024-09-10T23:15:44.930894+0000","last_undegraded":"2024-09-10T23:15:44.930894+0000","last_fullsized":"2024-09-10T23:15:44.930894+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:34.468042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.508118+0000","last_change":"2024-09-10T23:15:42.506805+0000","last_active":"2024-09-10T23:15:42.508118+0000","last_peered":"2024-09-10T23:15:42.508118+0000","last_clean":"2024-09-10T23:15:42.508118+0000","last_became_active":"2024-09-10T23:15:42.506467+0000","last_became_peered":"2024-09-10T23:15:42.506467+0000","last_unstale":"2024-09-10T23:15:42.508118+0000","last_undegraded":"2024-09-10T23:15:42.508118+0000","last_fullsized":"2024-09-10T23:15:42.508118+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:48.798844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.495789+0000","last_change":"2024-09-10T23:15:42.495789+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.495789+0000","last_undegraded":"2024-09-10T23:15:42.495789+0000","last_fullsized":"2024-09-10T23:15:42.495789+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516188+0000","last_change":"2024-09-10T23:15:42.504548+0000","last_active":"2024-09-10T23:15:44.516188+0000","last_peered":"2024-09-10T23:15:44.516188+0000","last_clean":"2024-09-10T23:15:44.516188+0000","last_became_active":"2024-09-10T23:15:42.504243+0000","last_became_peered":"2024-09-10T23:15:42.504243+0000","last_unstale":"2024-09-10T23:15:44.516188+0000","last_undegraded":"2024-09-10T23:15:44.516188+0000","last_fullsized":"2024-09-10T23:15:44.516188+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:38.706722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932271+0000","last_change":"2024-09-10T23:15:43.532480+0000","last_active":"2024-09-10T23:15:44.932271+0000","last_peered":"2024-09-10T23:15:44.932271+0000","last_clean":"2024-09-10T23:15:44.932271+0000","last_became_active":"2024-09-10T23:15:43.532213+0000","last_became_peered":"2024-09-10T23:15:43.532213+0000","last_unstale":"2024-09-10T23:15:44.932271+0000","last_undegraded":"2024-09-10T23:15:44.932271+0000","last_fullsized":"2024-09-10T23:15:44.932271+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:28.144367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932439+0000","last_change":"2024-09-10T23:15:42.507050+0000","last_active":"2024-09-10T23:15:44.932439+0000","last_peered":"2024-09-10T23:15:44.932439+0000","last_clean":"2024-09-10T23:15:44.932439+0000","last_became_active":"2024-09-10T23:15:42.506736+0000","last_became_peered":"2024-09-10T23:15:42.506736+0000","last_unstale":"2024-09-10T23:15:44.932439+0000","last_undegraded":"2024-09-10T23:15:44.932439+0000","last_fullsized":"2024-09-10T23:15:44.932439+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:58.264160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.495292+0000","last_change":"2024-09-10T23:15:42.495292+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.495292+0000","last_undegraded":"2024-09-10T23:15:42.495292+0000","last_fullsized":"2024-09-10T23:15:42.495292+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516565+0000","last_change":"2024-09-10T23:15:42.512550+0000","last_active":"2024-09-10T23:15:44.516565+0000","last_peered":"2024-09-10T23:15:44.516565+0000","last_clean":"2024-09-10T23:15:44.516565+0000","last_became_active":"2024-09-10T23:15:42.512264+0000","last_became_peered":"2024-09-10T23:15:42.512264+0000","last_unstale":"2024-09-10T23:15:44.516565+0000","last_undegraded":"2024-09-10T23:15:44.516565+0000","last_fullsized":"2024-09-10T23:15:44.516565+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:51.973570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516494+0000","last_change":"2024-09-10T23:15:43.542762+0000","last_active":"2024-09-10T23:15:44.516494+0000","last_peered":"2024-09-10T23:15:44.516494+0000","last_clean":"2024-09-10T23:15:44.516494+0000","last_became_active":"2024-09-10T23:15:43.542496+0000","last_became_peered":"2024-09-10T23:15:43.542496+0000","last_unstale":"2024-09-10T23:15:44.516494+0000","last_undegraded":"2024-09-10T23:15:44.516494+0000","last_fullsized":"2024-09-10T23:15:44.516494+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:27.489244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514684+0000","last_change":"2024-09-10T23:15:42.508047+0000","last_active":"2024-09-10T23:15:44.514684+0000","last_peered":"2024-09-10T23:15:44.514684+0000","last_clean":"2024-09-10T23:15:44.514684+0000","last_became_active":"2024-09-10T23:15:42.506608+0000","last_became_peered":"2024-09-10T23:15:42.506608+0000","last_unstale":"2024-09-10T23:15:44.514684+0000","last_undegraded":"2024-09-10T23:15:44.514684+0000","last_fullsized":"2024-09-10T23:15:44.514684+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:07.647238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932154+0000","last_change":"2024-09-10T23:15:43.537555+0000","last_active":"2024-09-10T23:15:44.932154+0000","last_peered":"2024-09-10T23:15:44.932154+0000","last_clean":"2024-09-10T23:15:44.932154+0000","last_became_active":"2024-09-10T23:15:43.537267+0000","last_became_peered":"2024-09-10T23:15:43.537267+0000","last_unstale":"2024-09-10T23:15:44.932154+0000","last_undegraded":"2024-09-10T23:15:44.932154+0000","last_fullsized":"2024-09-10T23:15:44.932154+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:58.503796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516015+0000","last_change":"2024-09-10T23:15:42.511730+0000","last_active":"2024-09-10T23:15:44.516015+0000","last_peered":"2024-09-10T23:15:44.516015+0000","last_clean":"2024-09-10T23:15:44.516015+0000","last_became_active":"2024-09-10T23:15:42.511450+0000","last_became_peered":"2024-09-10T23:15:42.511450+0000","last_unstale":"2024-09-10T23:15:44.516015+0000","last_undegraded":"2024-09-10T23:15:44.516015+0000","last_fullsized":"2024-09-10T23:15:44.516015+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:55.382501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932247+0000","last_change":"2024-09-10T23:15:43.542960+0000","last_active":"2024-09-10T23:15:44.932247+0000","last_peered":"2024-09-10T23:15:44.932247+0000","last_clean":"2024-09-10T23:15:44.932247+0000","last_became_active":"2024-09-10T23:15:43.542616+0000","last_became_peered":"2024-09-10T23:15:43.542616+0000","last_unstale":"2024-09-10T23:15:44.932247+0000","last_undegraded":"2024-09-10T23:15:44.932247+0000","last_fullsized":"2024-09-10T23:15:44.932247+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:30.060356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933198+0000","last_change":"2024-09-10T23:15:42.502459+0000","last_active":"2024-09-10T23:15:44.933198+0000","last_peered":"2024-09-10T23:15:44.933198+0000","last_clean":"2024-09-10T23:15:44.933198+0000","last_became_active":"2024-09-10T23:15:42.502179+0000","last_became_peered":"2024-09-10T23:15:42.502179+0000","last_unstale":"2024-09-10T23:15:44.933198+0000","last_undegraded":"2024-09-10T23:15:44.933198+0000","last_fullsized":"2024-09-10T23:15:44.933198+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:35.610793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517231+0000","last_change":"2024-09-10T23:15:43.522932+0000","last_active":"2024-09-10T23:15:44.517231+0000","last_peered":"2024-09-10T23:15:44.517231+0000","last_clean":"2024-09-10T23:15:44.517231+0000","last_became_active":"2024-09-10T23:15:43.522601+0000","last_became_peered":"2024-09-10T23:15:43.522601+0000","last_unstale":"2024-09-10T23:15:44.517231+0000","last_undegraded":"2024-09-10T23:15:44.517231+0000","last_fullsized":"2024-09-10T23:15:44.517231+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:42.321567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514697+0000","last_change":"2024-09-10T23:15:42.508818+0000","last_active":"2024-09-10T23:15:44.514697+0000","last_peered":"2024-09-10T23:15:44.514697+0000","last_clean":"2024-09-10T23:15:44.514697+0000","last_became_active":"2024-09-10T23:15:42.508541+0000","last_became_peered":"2024-09-10T23:15:42.508541+0000","last_unstale":"2024-09-10T23:15:44.514697+0000","last_undegraded":"2024-09-10T23:15:44.514697+0000","last_fullsized":"2024-09-10T23:15:44.514697+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:51.671803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932924+0000","last_change":"2024-09-10T23:15:43.530853+0000","last_active":"2024-09-10T23:15:44.932924+0000","last_peered":"2024-09-10T23:15:44.932924+0000","last_clean":"2024-09-10T23:15:44.932924+0000","last_became_active":"2024-09-10T23:15:43.530574+0000","last_became_peered":"2024-09-10T23:15:43.530574+0000","last_unstale":"2024-09-10T23:15:44.932924+0000","last_undegraded":"2024-09-10T23:15:44.932924+0000","last_fullsized":"2024-09-10T23:15:44.932924+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:32.139284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.508254+0000","last_change":"2024-09-10T23:15:42.505319+0000","last_active":"2024-09-10T23:15:42.508254+0000","last_peered":"2024-09-10T23:15:42.508254+0000","last_clean":"2024-09-10T23:15:42.508254+0000","last_became_active":"2024-09-10T23:15:42.504868+0000","last_became_peered":"2024-09-10T23:15:42.504868+0000","last_unstale":"2024-09-10T23:15:42.508254+0000","last_undegraded":"2024-09-10T23:15:42.508254+0000","last_fullsized":"2024-09-10T23:15:42.508254+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:19.381787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.496168+0000","last_change":"2024-09-10T23:15:42.496168+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.496168+0000","last_undegraded":"2024-09-10T23:15:42.496168+0000","last_fullsized":"2024-09-10T23:15:42.496168+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517097+0000","last_change":"2024-09-10T23:15:42.506691+0000","last_active":"2024-09-10T23:15:44.517097+0000","last_peered":"2024-09-10T23:15:44.517097+0000","last_clean":"2024-09-10T23:15:44.517097+0000","last_became_active":"2024-09-10T23:15:42.506074+0000","last_became_peered":"2024-09-10T23:15:42.506074+0000","last_unstale":"2024-09-10T23:15:44.517097+0000","last_undegraded":"2024-09-10T23:15:44.517097+0000","last_fullsized":"2024-09-10T23:15:44.517097+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:27.141199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":152,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516368+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:15:44.516368+0000","last_peered":"2024-09-10T23:15:44.516368+0000","last_clean":"2024-09-10T23:15:44.516368+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:15:44.516368+0000","last_undegraded":"2024-09-10T23:15:44.516368+0000","last_fullsized":"2024-09-10T23:15:44.516368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1130496,"data_stored":803392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":540672,"data_stored":213606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":213004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":532480,"data_stored":208246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":532480,"data_stored":207272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":214568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":536576,"data_stored":213004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1101824,"data_stored":790227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:15:47.193 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3c is not active+clean 2024-09-10T23:15:47.193 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:42.501516+0000', 'last_change': '2024-09-10T23:15:42.501516+0000', 'last_active': '2024-09-10T23:15:42.485472+0000', 'last_peered': '2024-09-10T23:15:42.485472+0000', 'last_clean': '2024-09-10T23:15:42.485472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:42.501516+0000', 'last_undegraded': '2024-09-10T23:15:42.501516+0000', 'last_fullsized': '2024-09-10T23:15:42.501516+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:47.193 INFO:tasks.ceph.ceph_manager.ceph:PG 7.38 is not active+clean 2024-09-10T23:15:47.193 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:42.501129+0000', 'last_change': '2024-09-10T23:15:42.501129+0000', 'last_active': '2024-09-10T23:15:42.485472+0000', 'last_peered': '2024-09-10T23:15:42.485472+0000', 'last_clean': '2024-09-10T23:15:42.485472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:42.501129+0000', 'last_undegraded': '2024-09-10T23:15:42.501129+0000', 'last_fullsized': '2024-09-10T23:15:42.501129+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:47.193 INFO:tasks.ceph.ceph_manager.ceph:PG 7.37 is not active+clean 2024-09-10T23:15:47.193 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:42.501467+0000', 'last_change': '2024-09-10T23:15:42.501467+0000', 'last_active': '2024-09-10T23:15:42.485472+0000', 'last_peered': '2024-09-10T23:15:42.485472+0000', 'last_clean': '2024-09-10T23:15:42.485472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:42.501467+0000', 'last_undegraded': '2024-09-10T23:15:42.501467+0000', 'last_fullsized': '2024-09-10T23:15:42.501467+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:47.194 INFO:tasks.ceph.ceph_manager.ceph:PG 7.36 is not active+clean 2024-09-10T23:15:47.194 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:42.499597+0000', 'last_change': '2024-09-10T23:15:42.499597+0000', 'last_active': '2024-09-10T23:15:42.485472+0000', 'last_peered': '2024-09-10T23:15:42.485472+0000', 'last_clean': '2024-09-10T23:15:42.485472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:42.499597+0000', 'last_undegraded': '2024-09-10T23:15:42.499597+0000', 'last_fullsized': '2024-09-10T23:15:42.499597+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:47.194 INFO:tasks.ceph.ceph_manager.ceph:PG 7.35 is not active+clean 2024-09-10T23:15:47.194 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:42.498776+0000', 'last_change': '2024-09-10T23:15:42.498776+0000', 'last_active': '2024-09-10T23:15:42.485472+0000', 'last_peered': '2024-09-10T23:15:42.485472+0000', 'last_clean': '2024-09-10T23:15:42.485472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:42.498776+0000', 'last_undegraded': '2024-09-10T23:15:42.498776+0000', 'last_fullsized': '2024-09-10T23:15:42.498776+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:47.194 INFO:tasks.ceph.ceph_manager.ceph:PG 7.32 is not active+clean 2024-09-10T23:15:47.194 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:42.498260+0000', 'last_change': '2024-09-10T23:15:42.498260+0000', 'last_active': '2024-09-10T23:15:42.485472+0000', 'last_peered': '2024-09-10T23:15:42.485472+0000', 'last_clean': '2024-09-10T23:15:42.485472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:42.498260+0000', 'last_undegraded': '2024-09-10T23:15:42.498260+0000', 'last_fullsized': '2024-09-10T23:15:42.498260+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:47.194 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2a is not active+clean 2024-09-10T23:15:47.194 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:42.493997+0000', 'last_change': '2024-09-10T23:15:42.493997+0000', 'last_active': '2024-09-10T23:15:42.485472+0000', 'last_peered': '2024-09-10T23:15:42.485472+0000', 'last_clean': '2024-09-10T23:15:42.485472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:42.493997+0000', 'last_undegraded': '2024-09-10T23:15:42.493997+0000', 'last_fullsized': '2024-09-10T23:15:42.493997+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:47.194 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-09-10T23:15:47.194 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:42.497880+0000', 'last_change': '2024-09-10T23:15:42.497880+0000', 'last_active': '2024-09-10T23:15:42.485472+0000', 'last_peered': '2024-09-10T23:15:42.485472+0000', 'last_clean': '2024-09-10T23:15:42.485472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:42.497880+0000', 'last_undegraded': '2024-09-10T23:15:42.497880+0000', 'last_fullsized': '2024-09-10T23:15:42.497880+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:47.194 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-09-10T23:15:47.195 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:42.498212+0000', 'last_change': '2024-09-10T23:15:42.498212+0000', 'last_active': '2024-09-10T23:15:42.485472+0000', 'last_peered': '2024-09-10T23:15:42.485472+0000', 'last_clean': '2024-09-10T23:15:42.485472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:42.498212+0000', 'last_undegraded': '2024-09-10T23:15:42.498212+0000', 'last_fullsized': '2024-09-10T23:15:42.498212+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:47.195 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-09-10T23:15:47.195 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:42.496416+0000', 'last_change': '2024-09-10T23:15:42.496416+0000', 'last_active': '2024-09-10T23:15:42.485472+0000', 'last_peered': '2024-09-10T23:15:42.485472+0000', 'last_clean': '2024-09-10T23:15:42.485472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:42.496416+0000', 'last_undegraded': '2024-09-10T23:15:42.496416+0000', 'last_fullsized': '2024-09-10T23:15:42.496416+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:47.195 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-09-10T23:15:47.195 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:42.496590+0000', 'last_change': '2024-09-10T23:15:42.496590+0000', 'last_active': '2024-09-10T23:15:42.485472+0000', 'last_peered': '2024-09-10T23:15:42.485472+0000', 'last_clean': '2024-09-10T23:15:42.485472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:42.496590+0000', 'last_undegraded': '2024-09-10T23:15:42.496590+0000', 'last_fullsized': '2024-09-10T23:15:42.496590+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:47.195 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-09-10T23:15:47.195 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:42.495789+0000', 'last_change': '2024-09-10T23:15:42.495789+0000', 'last_active': '2024-09-10T23:15:42.485472+0000', 'last_peered': '2024-09-10T23:15:42.485472+0000', 'last_clean': '2024-09-10T23:15:42.485472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:42.495789+0000', 'last_undegraded': '2024-09-10T23:15:42.495789+0000', 'last_fullsized': '2024-09-10T23:15:42.495789+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:47.195 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-09-10T23:15:47.195 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:42.495292+0000', 'last_change': '2024-09-10T23:15:42.495292+0000', 'last_active': '2024-09-10T23:15:42.485472+0000', 'last_peered': '2024-09-10T23:15:42.485472+0000', 'last_clean': '2024-09-10T23:15:42.485472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:42.495292+0000', 'last_undegraded': '2024-09-10T23:15:42.495292+0000', 'last_fullsized': '2024-09-10T23:15:42.495292+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:47.195 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-09-10T23:15:47.195 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:15:42.496168+0000', 'last_change': '2024-09-10T23:15:42.496168+0000', 'last_active': '2024-09-10T23:15:42.485472+0000', 'last_peered': '2024-09-10T23:15:42.485472+0000', 'last_clean': '2024-09-10T23:15:42.485472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:15:42.496168+0000', 'last_undegraded': '2024-09-10T23:15:42.496168+0000', 'last_fullsized': '2024-09-10T23:15:42.496168+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'last_clean_scrub_stamp': '2024-09-10T23:15:42.485472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:15:47.196 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:15:47.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.329+0000 7f9a0352b640 1 -- 172.21.15.90:0/1682156417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99e8003a00 msgr2=0x7f99e8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:47.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.329+0000 7f9a0352b640 1 --2- 172.21.15.90:0/1682156417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99e8003a00 0x7f99e8003e20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009b50 tx=0x7f99e8005830 comp rx=0 tx=0).stop 2024-09-10T23:15:47.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.329+0000 7f9a01ac8640 1 -- 172.21.15.90:0/1682156417 reap_dead start 2024-09-10T23:15:47.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.329+0000 7f9a0352b640 1 -- 172.21.15.90:0/1682156417 shutdown_connections 2024-09-10T23:15:47.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.329+0000 7f9a0352b640 1 -- 172.21.15.90:0/1682156417 >> 172.21.15.90:0/1682156417 conn(0x7f99fc09d2a0 msgr2=0x7f99fc0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:47.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.329+0000 7f9a0352b640 1 -- 172.21.15.90:0/1682156417 shutdown_connections 2024-09-10T23:15:47.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.329+0000 7f9a0352b640 1 -- 172.21.15.90:0/1682156417 wait complete. 2024-09-10T23:15:47.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.330+0000 7f9a0352b640 1 Processor -- start 2024-09-10T23:15:47.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.330+0000 7f9a0352b640 1 -- start start 2024-09-10T23:15:47.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.331+0000 7f9a0352b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99e8003a00 0x7f99fc1f88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:47.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.331+0000 7f9a0352b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99fc160ef0 0x7f99fc0cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:47.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.331+0000 7f9a0352b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99fc161370 0x7f99fc0cd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:47.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.331+0000 7f9a0352b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc0b3610 con 0x7f99fc161370 2024-09-10T23:15:47.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.331+0000 7f9a0352b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc0b3490 con 0x7f99e8003a00 2024-09-10T23:15:47.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.331+0000 7f9a0352b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f99fc0b3790 con 0x7f99fc160ef0 2024-09-10T23:15:47.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.331+0000 7f9a01ac8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99fc161370 0x7f99fc0cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:47.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.331+0000 7f9a01ac8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99fc161370 0x7f99fc0cd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46790/0 (socket says 172.21.15.90:46790) 2024-09-10T23:15:47.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.331+0000 7f9a01ac8640 1 -- 172.21.15.90:0/4018485568 learned_addr learned my addr 172.21.15.90:0/4018485568 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:47.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.331+0000 7f9a012c7640 1 --2- 172.21.15.90:0/4018485568 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99e8003a00 0x7f99fc1f88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:47.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.331+0000 7f9a00ac6640 1 --2- 172.21.15.90:0/4018485568 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99fc160ef0 0x7f99fc0cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:47.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.331+0000 7f9a01ac8640 1 -- 172.21.15.90:0/4018485568 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99fc160ef0 msgr2=0x7f99fc0cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:47.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.331+0000 7f9a01ac8640 1 --2- 172.21.15.90:0/4018485568 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99fc160ef0 0x7f99fc0cd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:47.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.331+0000 7f9a01ac8640 1 -- 172.21.15.90:0/4018485568 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99e8003a00 msgr2=0x7f99fc1f88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:47.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.331+0000 7f9a01ac8640 1 --2- 172.21.15.90:0/4018485568 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99e8003a00 0x7f99fc1f88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:47.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.331+0000 7f9a01ac8640 1 -- 172.21.15.90:0/4018485568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99fc1f8e20 con 0x7f99fc161370 2024-09-10T23:15:47.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.331+0000 7f9a01ac8640 1 --2- 172.21.15.90:0/4018485568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99fc161370 0x7f99fc0cd880 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0d20d0 tx=0x7f99f4010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:47.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.332+0000 7f99edffb640 1 -- 172.21.15.90:0/4018485568 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f4003970 con 0x7f99fc161370 2024-09-10T23:15:47.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.332+0000 7f99edffb640 1 -- 172.21.15.90:0/4018485568 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99f4015070 con 0x7f99fc161370 2024-09-10T23:15:47.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.332+0000 7f99edffb640 1 -- 172.21.15.90:0/4018485568 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f4004030 con 0x7f99fc161370 2024-09-10T23:15:47.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.332+0000 7f9a0352b640 1 -- 172.21.15.90:0/4018485568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99fc1f58a0 con 0x7f99fc161370 2024-09-10T23:15:47.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.332+0000 7f9a0352b640 1 -- 172.21.15.90:0/4018485568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99fc160410 con 0x7f99fc161370 2024-09-10T23:15:47.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.333+0000 7f9a0352b640 1 -- 172.21.15.90:0/4018485568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99fc0b3eb0 con 0x7f99fc161370 2024-09-10T23:15:47.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.333+0000 7f99edffb640 1 -- 172.21.15.90:0/4018485568 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f99f4024060 con 0x7f99fc161370 2024-09-10T23:15:47.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.334+0000 7f99edffb640 1 --2- 172.21.15.90:0/4018485568 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f99e0077f70 0x7f99e007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:47.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.334+0000 7f99edffb640 1 -- 172.21.15.90:0/4018485568 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f99f409a0a0 con 0x7f99fc161370 2024-09-10T23:15:47.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.334+0000 7f9a012c7640 1 --2- 172.21.15.90:0/4018485568 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f99e0077f70 0x7f99e007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:47.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.335+0000 7f9a012c7640 1 --2- 172.21.15.90:0/4018485568 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f99e0077f70 0x7f99e007a430 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f99f0035000 tx=0x7f99f002d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:47.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.338+0000 7f99edffb640 1 -- 172.21.15.90:0/4018485568 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f99f4062c30 con 0x7f99fc161370 2024-09-10T23:15:47.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.583+0000 7f9a0352b640 1 -- 172.21.15.90:0/4018485568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f99fc0b1cd0 con 0x7f99fc161370 2024-09-10T23:15:47.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.584+0000 7f99edffb640 1 -- 172.21.15.90:0/4018485568 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1560 (secure 0 0 0) 0x7f99f406b350 con 0x7f99fc161370 2024-09-10T23:15:47.585 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:47.585 INFO:teuthology.orchestra.run.smithi090.stdout:{"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":95,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":46,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010065,"num_in_osds":8,"osd_in_since":1726010055,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":83},{"state_name":"creating+peering","count":14}],"num_pgs":97,"num_pools":3,"num_objects":19,"data_bytes":592778,"bytes_used":231165952,"bytes_avail":772862947328,"bytes_total":773094113280,"inactive_pgs_ratio":0.14432989060878754,"write_bytes_sec":2889,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":20,"btime":"2024-09-10T23:15:45:529350+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":5250}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-10T23:15:32.445881+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:15:47.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.586+0000 7f9a0352b640 1 -- 172.21.15.90:0/4018485568 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f99e0077f70 msgr2=0x7f99e007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:47.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.586+0000 7f9a0352b640 1 --2- 172.21.15.90:0/4018485568 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f99e0077f70 0x7f99e007a430 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f99f0035000 tx=0x7f99f002d040 comp rx=0 tx=0).stop 2024-09-10T23:15:47.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.586+0000 7f9a0352b640 1 -- 172.21.15.90:0/4018485568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99fc161370 msgr2=0x7f99fc0cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:47.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.586+0000 7f9a0352b640 1 --2- 172.21.15.90:0/4018485568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99fc161370 0x7f99fc0cd880 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0d20d0 tx=0x7f99f4010f40 comp rx=0 tx=0).stop 2024-09-10T23:15:47.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.586+0000 7f9a0352b640 1 -- 172.21.15.90:0/4018485568 shutdown_connections 2024-09-10T23:15:47.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.586+0000 7f9a0352b640 1 --2- 172.21.15.90:0/4018485568 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f99e0077f70 0x7f99e007a430 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:47.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.586+0000 7f9a0352b640 1 --2- 172.21.15.90:0/4018485568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99fc161370 0x7f99fc0cd880 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:47.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.586+0000 7f9a0352b640 1 --2- 172.21.15.90:0/4018485568 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99fc160ef0 0x7f99fc0cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:47.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.586+0000 7f9a0352b640 1 --2- 172.21.15.90:0/4018485568 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99e8003a00 0x7f99fc1f88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:47.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.586+0000 7f9a0352b640 1 -- 172.21.15.90:0/4018485568 >> 172.21.15.90:0/4018485568 conn(0x7f99fc09d2a0 msgr2=0x7f99fc0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:47.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.586+0000 7f9a0352b640 1 -- 172.21.15.90:0/4018485568 shutdown_connections 2024-09-10T23:15:47.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.586+0000 7f9a0352b640 1 -- 172.21.15.90:0/4018485568 wait complete. 2024-09-10T23:15:47.598 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T23:15:47.598 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:15:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.699+0000 7f5ef210e640 1 -- 172.21.15.90:0/4196000381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed4004800 msgr2=0x7f5ed4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.699+0000 7f5ef210e640 1 --2- 172.21.15.90:0/4196000381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed4004800 0x7f5ed4004c80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0006fd0 tx=0x7f5ed4005830 comp rx=0 tx=0).stop 2024-09-10T23:15:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.699+0000 7f5eebfff640 1 -- 172.21.15.90:0/4196000381 reap_dead start 2024-09-10T23:15:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.700+0000 7f5ef210e640 1 -- 172.21.15.90:0/4196000381 shutdown_connections 2024-09-10T23:15:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.700+0000 7f5ef210e640 1 -- 172.21.15.90:0/4196000381 >> 172.21.15.90:0/4196000381 conn(0x7f5eec0cc850 msgr2=0x7f5eec0ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.700+0000 7f5ef210e640 1 -- 172.21.15.90:0/4196000381 shutdown_connections 2024-09-10T23:15:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.700+0000 7f5ef210e640 1 -- 172.21.15.90:0/4196000381 wait complete. 2024-09-10T23:15:47.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.701+0000 7f5ef210e640 1 Processor -- start 2024-09-10T23:15:47.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.701+0000 7f5ef210e640 1 -- start start 2024-09-10T23:15:47.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5ef210e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed4004800 0x7f5eec0c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:47.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5ef210e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eec1591d0 0x7f5eec0afb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:47.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5ef210e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5eec159630 0x7f5eec0b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:47.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5ef210e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec06e630 con 0x7f5ed4004800 2024-09-10T23:15:47.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5ef210e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec06e4b0 con 0x7f5eec1591d0 2024-09-10T23:15:47.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5ef210e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5eec06e7b0 con 0x7f5eec159630 2024-09-10T23:15:47.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5eeb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed4004800 0x7f5eec0c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:47.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5eeb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed4004800 0x7f5eec0c8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46800/0 (socket says 172.21.15.90:46800) 2024-09-10T23:15:47.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5eeb7fe640 1 -- 172.21.15.90:0/1179336206 learned_addr learned my addr 172.21.15.90:0/1179336206 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:47.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5eeaffd640 1 --2- 172.21.15.90:0/1179336206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eec1591d0 0x7f5eec0afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:47.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5eebfff640 1 --2- 172.21.15.90:0/1179336206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5eec159630 0x7f5eec0b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:47.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5eeb7fe640 1 -- 172.21.15.90:0/1179336206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5eec159630 msgr2=0x7f5eec0b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:47.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5eeb7fe640 1 --2- 172.21.15.90:0/1179336206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5eec159630 0x7f5eec0b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:47.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5eeb7fe640 1 -- 172.21.15.90:0/1179336206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eec1591d0 msgr2=0x7f5eec0afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:47.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5eeb7fe640 1 --2- 172.21.15.90:0/1179336206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eec1591d0 0x7f5eec0afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:47.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5eeb7fe640 1 -- 172.21.15.90:0/1179336206 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eec1f7c90 con 0x7f5ed4004800 2024-09-10T23:15:47.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5eeaffd640 1 --2- 172.21.15.90:0/1179336206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eec1591d0 0x7f5eec0afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:47.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5eeb7fe640 1 --2- 172.21.15.90:0/1179336206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed4004800 0x7f5eec0c8780 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5edc006110 tx=0x7f5edc003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:47.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5ed3fff640 1 -- 172.21.15.90:0/1179336206 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc00f890 con 0x7f5ed4004800 2024-09-10T23:15:47.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5ed3fff640 1 -- 172.21.15.90:0/1179336206 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5edc016020 con 0x7f5ed4004800 2024-09-10T23:15:47.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5ef210e640 1 -- 172.21.15.90:0/1179336206 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eec1f7f70 con 0x7f5ed4004800 2024-09-10T23:15:47.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5ed3fff640 1 -- 172.21.15.90:0/1179336206 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc00fcb0 con 0x7f5ed4004800 2024-09-10T23:15:47.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.702+0000 7f5ef210e640 1 -- 172.21.15.90:0/1179336206 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eec1f8530 con 0x7f5ed4004800 2024-09-10T23:15:47.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.703+0000 7f5ef210e640 1 -- 172.21.15.90:0/1179336206 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eec0ca420 con 0x7f5ed4004800 2024-09-10T23:15:47.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.704+0000 7f5ed3fff640 1 -- 172.21.15.90:0/1179336206 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5edc011430 con 0x7f5ed4004800 2024-09-10T23:15:47.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.704+0000 7f5ed3fff640 1 --2- 172.21.15.90:0/1179336206 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ed8077f70 0x7f5ed807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:47.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.704+0000 7f5ed3fff640 1 -- 172.21.15.90:0/1179336206 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f5edc09aa90 con 0x7f5ed4004800 2024-09-10T23:15:47.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.705+0000 7f5eeaffd640 1 --2- 172.21.15.90:0/1179336206 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ed8077f70 0x7f5ed807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:47.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.705+0000 7f5eeaffd640 1 --2- 172.21.15.90:0/1179336206 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ed8077f70 0x7f5ed807a430 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0033000 tx=0x7f5ee0001a10 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:47.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.708+0000 7f5ed3fff640 1 -- 172.21.15.90:0/1179336206 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5edc020020 con 0x7f5ed4004800 2024-09-10T23:15:47.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.877+0000 7f5ef210e640 1 -- 172.21.15.90:0/1179336206 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5eec15a5d0 con 0x7f5ed8077f70 2024-09-10T23:15:47.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.881+0000 7f5ed3fff640 1 -- 172.21.15.90:0/1179336206 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250802 (secure 0 0 0) 0x7f5eec15a5d0 con 0x7f5ed8077f70 2024-09-10T23:15:47.885 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:47.886 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:15:47.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.885+0000 7f5ef210e640 1 -- 172.21.15.90:0/1179336206 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ed8077f70 msgr2=0x7f5ed807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:47.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.885+0000 7f5ef210e640 1 --2- 172.21.15.90:0/1179336206 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ed8077f70 0x7f5ed807a430 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0033000 tx=0x7f5ee0001a10 comp rx=0 tx=0).stop 2024-09-10T23:15:47.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.885+0000 7f5ef210e640 1 -- 172.21.15.90:0/1179336206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed4004800 msgr2=0x7f5eec0c8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:47.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.885+0000 7f5ef210e640 1 --2- 172.21.15.90:0/1179336206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed4004800 0x7f5eec0c8780 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5edc006110 tx=0x7f5edc003f90 comp rx=0 tx=0).stop 2024-09-10T23:15:47.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.885+0000 7f5ef210e640 1 -- 172.21.15.90:0/1179336206 shutdown_connections 2024-09-10T23:15:47.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.885+0000 7f5ef210e640 1 --2- 172.21.15.90:0/1179336206 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ed8077f70 0x7f5ed807a430 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:47.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.885+0000 7f5ef210e640 1 --2- 172.21.15.90:0/1179336206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eec1591d0 0x7f5eec0afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:47.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.885+0000 7f5ef210e640 1 --2- 172.21.15.90:0/1179336206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5eec159630 0x7f5eec0b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:47.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.885+0000 7f5ef210e640 1 --2- 172.21.15.90:0/1179336206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed4004800 0x7f5eec0c8780 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:47.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.885+0000 7f5ef210e640 1 -- 172.21.15.90:0/1179336206 >> 172.21.15.90:0/1179336206 conn(0x7f5eec0cc850 msgr2=0x7f5eec0ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:47.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.885+0000 7f5ef210e640 1 -- 172.21.15.90:0/1179336206 shutdown_connections 2024-09-10T23:15:47.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:47.885+0000 7f5ef210e640 1 -- 172.21.15.90:0/1179336206 wait complete. 2024-09-10T23:15:47.896 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-09-10T23:15:46.448813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":133,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225748,"kb_used_data":5332,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748972,"statfs":{"total":773094113280,"available":772862947328,"internally_reserved":0,"allocated":5459968,"data_stored":2863319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.960789"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516290+0000","last_change":"2024-09-10T23:15:43.531769+0000","last_active":"2024-09-10T23:15:44.516290+0000","last_peered":"2024-09-10T23:15:44.516290+0000","last_clean":"2024-09-10T23:15:44.516290+0000","last_became_active":"2024-09-10T23:15:43.531487+0000","last_became_peered":"2024-09-10T23:15:43.531487+0000","last_unstale":"2024-09-10T23:15:44.516290+0000","last_undegraded":"2024-09-10T23:15:44.516290+0000","last_fullsized":"2024-09-10T23:15:44.516290+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:59.369815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516729+0000","last_change":"2024-09-10T23:15:43.529475+0000","last_active":"2024-09-10T23:15:44.516729+0000","last_peered":"2024-09-10T23:15:44.516729+0000","last_clean":"2024-09-10T23:15:44.516729+0000","last_became_active":"2024-09-10T23:15:43.529175+0000","last_became_peered":"2024-09-10T23:15:43.529175+0000","last_unstale":"2024-09-10T23:15:44.516729+0000","last_undegraded":"2024-09-10T23:15:44.516729+0000","last_fullsized":"2024-09-10T23:15:44.516729+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:42.574340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932949+0000","last_change":"2024-09-10T23:15:43.527735+0000","last_active":"2024-09-10T23:15:44.932949+0000","last_peered":"2024-09-10T23:15:44.932949+0000","last_clean":"2024-09-10T23:15:44.932949+0000","last_became_active":"2024-09-10T23:15:43.527276+0000","last_became_peered":"2024-09-10T23:15:43.527276+0000","last_unstale":"2024-09-10T23:15:44.932949+0000","last_undegraded":"2024-09-10T23:15:44.932949+0000","last_fullsized":"2024-09-10T23:15:44.932949+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:39.709891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.501516+0000","last_change":"2024-09-10T23:15:42.501516+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.501516+0000","last_undegraded":"2024-09-10T23:15:42.501516+0000","last_fullsized":"2024-09-10T23:15:42.501516+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516486+0000","last_change":"2024-09-10T23:15:43.529380+0000","last_active":"2024-09-10T23:15:44.516486+0000","last_peered":"2024-09-10T23:15:44.516486+0000","last_clean":"2024-09-10T23:15:44.516486+0000","last_became_active":"2024-09-10T23:15:43.529090+0000","last_became_peered":"2024-09-10T23:15:43.529090+0000","last_unstale":"2024-09-10T23:15:44.516486+0000","last_undegraded":"2024-09-10T23:15:44.516486+0000","last_fullsized":"2024-09-10T23:15:44.516486+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:52.446596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931825+0000","last_change":"2024-09-10T23:15:43.533375+0000","last_active":"2024-09-10T23:15:44.931825+0000","last_peered":"2024-09-10T23:15:44.931825+0000","last_clean":"2024-09-10T23:15:44.931825+0000","last_became_active":"2024-09-10T23:15:43.533088+0000","last_became_peered":"2024-09-10T23:15:43.533088+0000","last_unstale":"2024-09-10T23:15:44.931825+0000","last_undegraded":"2024-09-10T23:15:44.931825+0000","last_fullsized":"2024-09-10T23:15:44.931825+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:28.504092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516163+0000","last_change":"2024-09-10T23:15:43.543935+0000","last_active":"2024-09-10T23:15:44.516163+0000","last_peered":"2024-09-10T23:15:44.516163+0000","last_clean":"2024-09-10T23:15:44.516163+0000","last_became_active":"2024-09-10T23:15:43.543641+0000","last_became_peered":"2024-09-10T23:15:43.543641+0000","last_unstale":"2024-09-10T23:15:44.516163+0000","last_undegraded":"2024-09-10T23:15:44.516163+0000","last_fullsized":"2024-09-10T23:15:44.516163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:23.451112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.501129+0000","last_change":"2024-09-10T23:15:42.501129+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.501129+0000","last_undegraded":"2024-09-10T23:15:42.501129+0000","last_fullsized":"2024-09-10T23:15:42.501129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.501467+0000","last_change":"2024-09-10T23:15:42.501467+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.501467+0000","last_undegraded":"2024-09-10T23:15:42.501467+0000","last_fullsized":"2024-09-10T23:15:42.501467+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.499597+0000","last_change":"2024-09-10T23:15:42.499597+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.499597+0000","last_undegraded":"2024-09-10T23:15:42.499597+0000","last_fullsized":"2024-09-10T23:15:42.499597+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.498776+0000","last_change":"2024-09-10T23:15:42.498776+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.498776+0000","last_undegraded":"2024-09-10T23:15:42.498776+0000","last_fullsized":"2024-09-10T23:15:42.498776+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517339+0000","last_change":"2024-09-10T23:15:43.529156+0000","last_active":"2024-09-10T23:15:44.517339+0000","last_peered":"2024-09-10T23:15:44.517339+0000","last_clean":"2024-09-10T23:15:44.517339+0000","last_became_active":"2024-09-10T23:15:43.528877+0000","last_became_peered":"2024-09-10T23:15:43.528877+0000","last_unstale":"2024-09-10T23:15:44.517339+0000","last_undegraded":"2024-09-10T23:15:44.517339+0000","last_fullsized":"2024-09-10T23:15:44.517339+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:58.070612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931161+0000","last_change":"2024-09-10T23:15:43.527284+0000","last_active":"2024-09-10T23:15:44.931161+0000","last_peered":"2024-09-10T23:15:44.931161+0000","last_clean":"2024-09-10T23:15:44.931161+0000","last_became_active":"2024-09-10T23:15:43.527019+0000","last_became_peered":"2024-09-10T23:15:43.527019+0000","last_unstale":"2024-09-10T23:15:44.931161+0000","last_undegraded":"2024-09-10T23:15:44.931161+0000","last_fullsized":"2024-09-10T23:15:44.931161+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:20.558073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.498260+0000","last_change":"2024-09-10T23:15:42.498260+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.498260+0000","last_undegraded":"2024-09-10T23:15:42.498260+0000","last_fullsized":"2024-09-10T23:15:42.498260+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931121+0000","last_change":"2024-09-10T23:15:43.530842+0000","last_active":"2024-09-10T23:15:44.931121+0000","last_peered":"2024-09-10T23:15:44.931121+0000","last_clean":"2024-09-10T23:15:44.931121+0000","last_became_active":"2024-09-10T23:15:43.530559+0000","last_became_peered":"2024-09-10T23:15:43.530559+0000","last_unstale":"2024-09-10T23:15:44.931121+0000","last_undegraded":"2024-09-10T23:15:44.931121+0000","last_fullsized":"2024-09-10T23:15:44.931121+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:41.393470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931624+0000","last_change":"2024-09-10T23:15:43.533130+0000","last_active":"2024-09-10T23:15:44.931624+0000","last_peered":"2024-09-10T23:15:44.931624+0000","last_clean":"2024-09-10T23:15:44.931624+0000","last_became_active":"2024-09-10T23:15:43.532800+0000","last_became_peered":"2024-09-10T23:15:43.532800+0000","last_unstale":"2024-09-10T23:15:44.931624+0000","last_undegraded":"2024-09-10T23:15:44.931624+0000","last_fullsized":"2024-09-10T23:15:44.931624+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:22.539205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933198+0000","last_change":"2024-09-10T23:15:43.524871+0000","last_active":"2024-09-10T23:15:44.933198+0000","last_peered":"2024-09-10T23:15:44.933198+0000","last_clean":"2024-09-10T23:15:44.933198+0000","last_became_active":"2024-09-10T23:15:43.524580+0000","last_became_peered":"2024-09-10T23:15:43.524580+0000","last_unstale":"2024-09-10T23:15:44.933198+0000","last_undegraded":"2024-09-10T23:15:44.933198+0000","last_fullsized":"2024-09-10T23:15:44.933198+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:46.276138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933038+0000","last_change":"2024-09-10T23:15:43.530280+0000","last_active":"2024-09-10T23:15:44.933038+0000","last_peered":"2024-09-10T23:15:44.933038+0000","last_clean":"2024-09-10T23:15:44.933038+0000","last_became_active":"2024-09-10T23:15:43.529987+0000","last_became_peered":"2024-09-10T23:15:43.529987+0000","last_unstale":"2024-09-10T23:15:44.933038+0000","last_undegraded":"2024-09-10T23:15:44.933038+0000","last_fullsized":"2024-09-10T23:15:44.933038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:56.385670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932219+0000","last_change":"2024-09-10T23:15:43.532316+0000","last_active":"2024-09-10T23:15:44.932219+0000","last_peered":"2024-09-10T23:15:44.932219+0000","last_clean":"2024-09-10T23:15:44.932219+0000","last_became_active":"2024-09-10T23:15:43.532064+0000","last_became_peered":"2024-09-10T23:15:43.532064+0000","last_unstale":"2024-09-10T23:15:44.932219+0000","last_undegraded":"2024-09-10T23:15:44.932219+0000","last_fullsized":"2024-09-10T23:15:44.932219+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:43.137866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931596+0000","last_change":"2024-09-10T23:15:43.531896+0000","last_active":"2024-09-10T23:15:44.931596+0000","last_peered":"2024-09-10T23:15:44.931596+0000","last_clean":"2024-09-10T23:15:44.931596+0000","last_became_active":"2024-09-10T23:15:43.531650+0000","last_became_peered":"2024-09-10T23:15:43.531650+0000","last_unstale":"2024-09-10T23:15:44.931596+0000","last_undegraded":"2024-09-10T23:15:44.931596+0000","last_fullsized":"2024-09-10T23:15:44.931596+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:49.987654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932163+0000","last_change":"2024-09-10T23:15:43.538991+0000","last_active":"2024-09-10T23:15:44.932163+0000","last_peered":"2024-09-10T23:15:44.932163+0000","last_clean":"2024-09-10T23:15:44.932163+0000","last_became_active":"2024-09-10T23:15:43.538544+0000","last_became_peered":"2024-09-10T23:15:43.538544+0000","last_unstale":"2024-09-10T23:15:44.932163+0000","last_undegraded":"2024-09-10T23:15:44.932163+0000","last_fullsized":"2024-09-10T23:15:44.932163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:00.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.493997+0000","last_change":"2024-09-10T23:15:42.493997+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.493997+0000","last_undegraded":"2024-09-10T23:15:42.493997+0000","last_fullsized":"2024-09-10T23:15:42.493997+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931912+0000","last_change":"2024-09-10T23:15:43.535424+0000","last_active":"2024-09-10T23:15:44.931912+0000","last_peered":"2024-09-10T23:15:44.931912+0000","last_clean":"2024-09-10T23:15:44.931912+0000","last_became_active":"2024-09-10T23:15:43.535182+0000","last_became_peered":"2024-09-10T23:15:43.535182+0000","last_unstale":"2024-09-10T23:15:44.931912+0000","last_undegraded":"2024-09-10T23:15:44.931912+0000","last_fullsized":"2024-09-10T23:15:44.931912+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:30.995258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931643+0000","last_change":"2024-09-10T23:15:43.534813+0000","last_active":"2024-09-10T23:15:44.931643+0000","last_peered":"2024-09-10T23:15:44.931643+0000","last_clean":"2024-09-10T23:15:44.931643+0000","last_became_active":"2024-09-10T23:15:43.534529+0000","last_became_peered":"2024-09-10T23:15:43.534529+0000","last_unstale":"2024-09-10T23:15:44.931643+0000","last_undegraded":"2024-09-10T23:15:44.931643+0000","last_fullsized":"2024-09-10T23:15:44.931643+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:52.674972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932061+0000","last_change":"2024-09-10T23:15:43.536434+0000","last_active":"2024-09-10T23:15:44.932061+0000","last_peered":"2024-09-10T23:15:44.932061+0000","last_clean":"2024-09-10T23:15:44.932061+0000","last_became_active":"2024-09-10T23:15:43.536045+0000","last_became_peered":"2024-09-10T23:15:43.536045+0000","last_unstale":"2024-09-10T23:15:44.932061+0000","last_undegraded":"2024-09-10T23:15:44.932061+0000","last_fullsized":"2024-09-10T23:15:44.932061+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:41.288775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931088+0000","last_change":"2024-09-10T23:15:43.525079+0000","last_active":"2024-09-10T23:15:44.931088+0000","last_peered":"2024-09-10T23:15:44.931088+0000","last_clean":"2024-09-10T23:15:44.931088+0000","last_became_active":"2024-09-10T23:15:43.524767+0000","last_became_peered":"2024-09-10T23:15:43.524767+0000","last_unstale":"2024-09-10T23:15:44.931088+0000","last_undegraded":"2024-09-10T23:15:44.931088+0000","last_fullsized":"2024-09-10T23:15:44.931088+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:43.164571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933052+0000","last_change":"2024-09-10T23:15:43.527365+0000","last_active":"2024-09-10T23:15:44.933052+0000","last_peered":"2024-09-10T23:15:44.933052+0000","last_clean":"2024-09-10T23:15:44.933052+0000","last_became_active":"2024-09-10T23:15:43.527076+0000","last_became_peered":"2024-09-10T23:15:43.527076+0000","last_unstale":"2024-09-10T23:15:44.933052+0000","last_undegraded":"2024-09-10T23:15:44.933052+0000","last_fullsized":"2024-09-10T23:15:44.933052+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:03.936831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517372+0000","last_change":"2024-09-10T23:15:43.528612+0000","last_active":"2024-09-10T23:15:44.517372+0000","last_peered":"2024-09-10T23:15:44.517372+0000","last_clean":"2024-09-10T23:15:44.517372+0000","last_became_active":"2024-09-10T23:15:43.528315+0000","last_became_peered":"2024-09-10T23:15:43.528315+0000","last_unstale":"2024-09-10T23:15:44.517372+0000","last_undegraded":"2024-09-10T23:15:44.517372+0000","last_fullsized":"2024-09-10T23:15:44.517372+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:28.073391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931746+0000","last_change":"2024-09-10T23:15:43.535273+0000","last_active":"2024-09-10T23:15:44.931746+0000","last_peered":"2024-09-10T23:15:44.931746+0000","last_clean":"2024-09-10T23:15:44.931746+0000","last_became_active":"2024-09-10T23:15:43.535024+0000","last_became_peered":"2024-09-10T23:15:43.535024+0000","last_unstale":"2024-09-10T23:15:44.931746+0000","last_undegraded":"2024-09-10T23:15:44.931746+0000","last_fullsized":"2024-09-10T23:15:44.931746+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:04.093540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932900+0000","last_change":"2024-09-10T23:15:43.527299+0000","last_active":"2024-09-10T23:15:44.932900+0000","last_peered":"2024-09-10T23:15:44.932900+0000","last_clean":"2024-09-10T23:15:44.932900+0000","last_became_active":"2024-09-10T23:15:43.526863+0000","last_became_peered":"2024-09-10T23:15:43.526863+0000","last_unstale":"2024-09-10T23:15:44.932900+0000","last_undegraded":"2024-09-10T23:15:44.932900+0000","last_fullsized":"2024-09-10T23:15:44.932900+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:11.752339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931322+0000","last_change":"2024-09-10T23:15:43.530364+0000","last_active":"2024-09-10T23:15:44.931322+0000","last_peered":"2024-09-10T23:15:44.931322+0000","last_clean":"2024-09-10T23:15:44.931322+0000","last_became_active":"2024-09-10T23:15:43.530090+0000","last_became_peered":"2024-09-10T23:15:43.530090+0000","last_unstale":"2024-09-10T23:15:44.931322+0000","last_undegraded":"2024-09-10T23:15:44.931322+0000","last_fullsized":"2024-09-10T23:15:44.931322+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:54.877057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.930861+0000","last_change":"2024-09-10T23:15:43.521138+0000","last_active":"2024-09-10T23:15:44.930861+0000","last_peered":"2024-09-10T23:15:44.930861+0000","last_clean":"2024-09-10T23:15:44.930861+0000","last_became_active":"2024-09-10T23:15:43.520871+0000","last_became_peered":"2024-09-10T23:15:43.520871+0000","last_unstale":"2024-09-10T23:15:44.930861+0000","last_undegraded":"2024-09-10T23:15:44.930861+0000","last_fullsized":"2024-09-10T23:15:44.930861+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:48.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.515005+0000","last_change":"2024-09-10T23:15:43.528339+0000","last_active":"2024-09-10T23:15:44.515005+0000","last_peered":"2024-09-10T23:15:44.515005+0000","last_clean":"2024-09-10T23:15:44.515005+0000","last_became_active":"2024-09-10T23:15:43.528000+0000","last_became_peered":"2024-09-10T23:15:43.528000+0000","last_unstale":"2024-09-10T23:15:44.515005+0000","last_undegraded":"2024-09-10T23:15:44.515005+0000","last_fullsized":"2024-09-10T23:15:44.515005+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:41.252238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932530+0000","last_change":"2024-09-10T23:15:42.511719+0000","last_active":"2024-09-10T23:15:44.932530+0000","last_peered":"2024-09-10T23:15:44.932530+0000","last_clean":"2024-09-10T23:15:44.932530+0000","last_became_active":"2024-09-10T23:15:42.511478+0000","last_became_peered":"2024-09-10T23:15:42.511478+0000","last_unstale":"2024-09-10T23:15:44.932530+0000","last_undegraded":"2024-09-10T23:15:44.932530+0000","last_fullsized":"2024-09-10T23:15:44.932530+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:33.981158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932123+0000","last_change":"2024-09-10T23:15:43.523565+0000","last_active":"2024-09-10T23:15:44.932123+0000","last_peered":"2024-09-10T23:15:44.932123+0000","last_clean":"2024-09-10T23:15:44.932123+0000","last_became_active":"2024-09-10T23:15:43.523272+0000","last_became_peered":"2024-09-10T23:15:43.523272+0000","last_unstale":"2024-09-10T23:15:44.932123+0000","last_undegraded":"2024-09-10T23:15:44.932123+0000","last_fullsized":"2024-09-10T23:15:44.932123+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:41.252238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933175+0000","last_change":"2024-09-10T23:15:42.511614+0000","last_active":"2024-09-10T23:15:44.933175+0000","last_peered":"2024-09-10T23:15:44.933175+0000","last_clean":"2024-09-10T23:15:44.933175+0000","last_became_active":"2024-09-10T23:15:42.511315+0000","last_became_peered":"2024-09-10T23:15:42.511315+0000","last_unstale":"2024-09-10T23:15:44.933175+0000","last_undegraded":"2024-09-10T23:15:44.933175+0000","last_fullsized":"2024-09-10T23:15:44.933175+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:51.671803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517486+0000","last_change":"2024-09-10T23:15:43.529829+0000","last_active":"2024-09-10T23:15:44.517486+0000","last_peered":"2024-09-10T23:15:44.517486+0000","last_clean":"2024-09-10T23:15:44.517486+0000","last_became_active":"2024-09-10T23:15:43.529545+0000","last_became_peered":"2024-09-10T23:15:43.529545+0000","last_unstale":"2024-09-10T23:15:44.517486+0000","last_undegraded":"2024-09-10T23:15:44.517486+0000","last_fullsized":"2024-09-10T23:15:44.517486+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:37.792217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514966+0000","last_change":"2024-09-10T23:15:42.507388+0000","last_active":"2024-09-10T23:15:44.514966+0000","last_peered":"2024-09-10T23:15:44.514966+0000","last_clean":"2024-09-10T23:15:44.514966+0000","last_became_active":"2024-09-10T23:15:42.507140+0000","last_became_peered":"2024-09-10T23:15:42.507140+0000","last_unstale":"2024-09-10T23:15:44.514966+0000","last_undegraded":"2024-09-10T23:15:44.514966+0000","last_fullsized":"2024-09-10T23:15:44.514966+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:00.620682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514992+0000","last_change":"2024-09-10T23:15:43.535494+0000","last_active":"2024-09-10T23:15:44.514992+0000","last_peered":"2024-09-10T23:15:44.514992+0000","last_clean":"2024-09-10T23:15:44.514992+0000","last_became_active":"2024-09-10T23:15:43.535197+0000","last_became_peered":"2024-09-10T23:15:43.535197+0000","last_unstale":"2024-09-10T23:15:44.514992+0000","last_undegraded":"2024-09-10T23:15:44.514992+0000","last_fullsized":"2024-09-10T23:15:44.514992+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:51.184507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.515748+0000","last_change":"2024-09-10T23:15:42.507889+0000","last_active":"2024-09-10T23:15:44.515748+0000","last_peered":"2024-09-10T23:15:44.515748+0000","last_clean":"2024-09-10T23:15:44.515748+0000","last_became_active":"2024-09-10T23:15:42.507525+0000","last_became_peered":"2024-09-10T23:15:42.507525+0000","last_unstale":"2024-09-10T23:15:44.515748+0000","last_undegraded":"2024-09-10T23:15:44.515748+0000","last_fullsized":"2024-09-10T23:15:44.515748+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:31.136115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932861+0000","last_change":"2024-09-10T23:15:43.528047+0000","last_active":"2024-09-10T23:15:44.932861+0000","last_peered":"2024-09-10T23:15:44.932861+0000","last_clean":"2024-09-10T23:15:44.932861+0000","last_became_active":"2024-09-10T23:15:43.527788+0000","last_became_peered":"2024-09-10T23:15:43.527788+0000","last_unstale":"2024-09-10T23:15:44.932861+0000","last_undegraded":"2024-09-10T23:15:44.932861+0000","last_fullsized":"2024-09-10T23:15:44.932861+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:52.085571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932226+0000","last_change":"2024-09-10T23:15:42.504164+0000","last_active":"2024-09-10T23:15:44.932226+0000","last_peered":"2024-09-10T23:15:44.932226+0000","last_clean":"2024-09-10T23:15:44.932226+0000","last_became_active":"2024-09-10T23:15:42.503841+0000","last_became_peered":"2024-09-10T23:15:42.503841+0000","last_unstale":"2024-09-10T23:15:44.932226+0000","last_undegraded":"2024-09-10T23:15:44.932226+0000","last_fullsized":"2024-09-10T23:15:44.932226+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:51.973570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.497880+0000","last_change":"2024-09-10T23:15:42.497880+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.497880+0000","last_undegraded":"2024-09-10T23:15:42.497880+0000","last_fullsized":"2024-09-10T23:15:42.497880+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933092+0000","last_change":"2024-09-10T23:15:42.507501+0000","last_active":"2024-09-10T23:15:44.933092+0000","last_peered":"2024-09-10T23:15:44.933092+0000","last_clean":"2024-09-10T23:15:44.933092+0000","last_became_active":"2024-09-10T23:15:42.507224+0000","last_became_peered":"2024-09-10T23:15:42.507224+0000","last_unstale":"2024-09-10T23:15:44.933092+0000","last_undegraded":"2024-09-10T23:15:44.933092+0000","last_fullsized":"2024-09-10T23:15:44.933092+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:41.069742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.498212+0000","last_change":"2024-09-10T23:15:42.498212+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.498212+0000","last_undegraded":"2024-09-10T23:15:42.498212+0000","last_fullsized":"2024-09-10T23:15:42.498212+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516014+0000","last_change":"2024-09-10T23:15:42.500537+0000","last_active":"2024-09-10T23:15:44.516014+0000","last_peered":"2024-09-10T23:15:44.516014+0000","last_clean":"2024-09-10T23:15:44.516014+0000","last_became_active":"2024-09-10T23:15:42.500174+0000","last_became_peered":"2024-09-10T23:15:42.500174+0000","last_unstale":"2024-09-10T23:15:44.516014+0000","last_undegraded":"2024-09-10T23:15:44.516014+0000","last_fullsized":"2024-09-10T23:15:44.516014+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:42.134697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931662+0000","last_change":"2024-09-10T23:15:43.534456+0000","last_active":"2024-09-10T23:15:44.931662+0000","last_peered":"2024-09-10T23:15:44.931662+0000","last_clean":"2024-09-10T23:15:44.931662+0000","last_became_active":"2024-09-10T23:15:43.534189+0000","last_became_peered":"2024-09-10T23:15:43.534189+0000","last_unstale":"2024-09-10T23:15:44.931662+0000","last_undegraded":"2024-09-10T23:15:44.931662+0000","last_fullsized":"2024-09-10T23:15:44.931662+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:10.389011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.508230+0000","last_change":"2024-09-10T23:15:42.504650+0000","last_active":"2024-09-10T23:15:42.508230+0000","last_peered":"2024-09-10T23:15:42.508230+0000","last_clean":"2024-09-10T23:15:42.508230+0000","last_became_active":"2024-09-10T23:15:42.504410+0000","last_became_peered":"2024-09-10T23:15:42.504410+0000","last_unstale":"2024-09-10T23:15:42.508230+0000","last_undegraded":"2024-09-10T23:15:42.508230+0000","last_fullsized":"2024-09-10T23:15:42.508230+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:45.052771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933152+0000","last_change":"2024-09-10T23:15:43.531044+0000","last_active":"2024-09-10T23:15:44.933152+0000","last_peered":"2024-09-10T23:15:44.933152+0000","last_clean":"2024-09-10T23:15:44.933152+0000","last_became_active":"2024-09-10T23:15:43.530763+0000","last_became_peered":"2024-09-10T23:15:43.530763+0000","last_unstale":"2024-09-10T23:15:44.933152+0000","last_undegraded":"2024-09-10T23:15:44.933152+0000","last_fullsized":"2024-09-10T23:15:44.933152+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:52.976739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933174+0000","last_change":"2024-09-10T23:15:42.497687+0000","last_active":"2024-09-10T23:15:44.933174+0000","last_peered":"2024-09-10T23:15:44.933174+0000","last_clean":"2024-09-10T23:15:44.933174+0000","last_became_active":"2024-09-10T23:15:42.497411+0000","last_became_peered":"2024-09-10T23:15:42.497411+0000","last_unstale":"2024-09-10T23:15:44.933174+0000","last_undegraded":"2024-09-10T23:15:44.933174+0000","last_fullsized":"2024-09-10T23:15:44.933174+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:07.647238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516410+0000","last_change":"2024-09-10T23:15:43.537527+0000","last_active":"2024-09-10T23:15:44.516410+0000","last_peered":"2024-09-10T23:15:44.516410+0000","last_clean":"2024-09-10T23:15:44.516410+0000","last_became_active":"2024-09-10T23:15:43.537079+0000","last_became_peered":"2024-09-10T23:15:43.537079+0000","last_unstale":"2024-09-10T23:15:44.516410+0000","last_undegraded":"2024-09-10T23:15:44.516410+0000","last_fullsized":"2024-09-10T23:15:44.516410+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:07.594488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.507897+0000","last_change":"2024-09-10T23:15:42.504742+0000","last_active":"2024-09-10T23:15:42.507897+0000","last_peered":"2024-09-10T23:15:42.507897+0000","last_clean":"2024-09-10T23:15:42.507897+0000","last_became_active":"2024-09-10T23:15:42.504469+0000","last_became_peered":"2024-09-10T23:15:42.504469+0000","last_unstale":"2024-09-10T23:15:42.507897+0000","last_undegraded":"2024-09-10T23:15:42.507897+0000","last_fullsized":"2024-09-10T23:15:42.507897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:26.061097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932516+0000","last_change":"2024-09-10T23:15:43.536547+0000","last_active":"2024-09-10T23:15:44.932516+0000","last_peered":"2024-09-10T23:15:44.932516+0000","last_clean":"2024-09-10T23:15:44.932516+0000","last_became_active":"2024-09-10T23:15:43.535697+0000","last_became_peered":"2024-09-10T23:15:43.535697+0000","last_unstale":"2024-09-10T23:15:44.932516+0000","last_undegraded":"2024-09-10T23:15:44.932516+0000","last_fullsized":"2024-09-10T23:15:44.932516+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:02.345671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516552+0000","last_change":"2024-09-10T23:15:42.512649+0000","last_active":"2024-09-10T23:15:44.516552+0000","last_peered":"2024-09-10T23:15:44.516552+0000","last_clean":"2024-09-10T23:15:44.516552+0000","last_became_active":"2024-09-10T23:15:42.512284+0000","last_became_peered":"2024-09-10T23:15:42.512284+0000","last_unstale":"2024-09-10T23:15:44.516552+0000","last_undegraded":"2024-09-10T23:15:44.516552+0000","last_fullsized":"2024-09-10T23:15:44.516552+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:02.933662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516269+0000","last_change":"2024-09-10T23:15:43.543825+0000","last_active":"2024-09-10T23:15:44.516269+0000","last_peered":"2024-09-10T23:15:44.516269+0000","last_clean":"2024-09-10T23:15:44.516269+0000","last_became_active":"2024-09-10T23:15:43.543546+0000","last_became_peered":"2024-09-10T23:15:43.543546+0000","last_unstale":"2024-09-10T23:15:44.516269+0000","last_undegraded":"2024-09-10T23:15:44.516269+0000","last_fullsized":"2024-09-10T23:15:44.516269+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:29.218569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931707+0000","last_change":"2024-09-10T23:15:42.499400+0000","last_active":"2024-09-10T23:15:44.931707+0000","last_peered":"2024-09-10T23:15:44.931707+0000","last_clean":"2024-09-10T23:15:44.931707+0000","last_became_active":"2024-09-10T23:15:42.499123+0000","last_became_peered":"2024-09-10T23:15:42.499123+0000","last_unstale":"2024-09-10T23:15:44.931707+0000","last_undegraded":"2024-09-10T23:15:44.931707+0000","last_fullsized":"2024-09-10T23:15:44.931707+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:27.654745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932077+0000","last_change":"2024-09-10T23:15:43.532558+0000","last_active":"2024-09-10T23:15:44.932077+0000","last_peered":"2024-09-10T23:15:44.932077+0000","last_clean":"2024-09-10T23:15:44.932077+0000","last_became_active":"2024-09-10T23:15:43.532269+0000","last_became_peered":"2024-09-10T23:15:43.532269+0000","last_unstale":"2024-09-10T23:15:44.932077+0000","last_undegraded":"2024-09-10T23:15:44.932077+0000","last_fullsized":"2024-09-10T23:15:44.932077+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:49.306185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932280+0000","last_change":"2024-09-10T23:15:42.508928+0000","last_active":"2024-09-10T23:15:44.932280+0000","last_peered":"2024-09-10T23:15:44.932280+0000","last_clean":"2024-09-10T23:15:44.932280+0000","last_became_active":"2024-09-10T23:15:42.508568+0000","last_became_peered":"2024-09-10T23:15:42.508568+0000","last_unstale":"2024-09-10T23:15:44.932280+0000","last_undegraded":"2024-09-10T23:15:44.932280+0000","last_fullsized":"2024-09-10T23:15:44.932280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:55.382501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.496416+0000","last_change":"2024-09-10T23:15:42.496416+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.496416+0000","last_undegraded":"2024-09-10T23:15:42.496416+0000","last_fullsized":"2024-09-10T23:15:42.496416+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516010+0000","last_change":"2024-09-10T23:15:42.502106+0000","last_active":"2024-09-10T23:15:44.516010+0000","last_peered":"2024-09-10T23:15:44.516010+0000","last_clean":"2024-09-10T23:15:44.516010+0000","last_became_active":"2024-09-10T23:15:42.501620+0000","last_became_peered":"2024-09-10T23:15:42.501620+0000","last_unstale":"2024-09-10T23:15:44.516010+0000","last_undegraded":"2024-09-10T23:15:44.516010+0000","last_fullsized":"2024-09-10T23:15:44.516010+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:42.459571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.930865+0000","last_change":"2024-09-10T23:15:43.534217+0000","last_active":"2024-09-10T23:15:44.930865+0000","last_peered":"2024-09-10T23:15:44.930865+0000","last_clean":"2024-09-10T23:15:44.930865+0000","last_became_active":"2024-09-10T23:15:43.533952+0000","last_became_peered":"2024-09-10T23:15:43.533952+0000","last_unstale":"2024-09-10T23:15:44.930865+0000","last_undegraded":"2024-09-10T23:15:44.930865+0000","last_fullsized":"2024-09-10T23:15:44.930865+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:46:57.091610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931425+0000","last_change":"2024-09-10T23:15:42.508283+0000","last_active":"2024-09-10T23:15:44.931425+0000","last_peered":"2024-09-10T23:15:44.931425+0000","last_clean":"2024-09-10T23:15:44.931425+0000","last_became_active":"2024-09-10T23:15:42.508016+0000","last_became_peered":"2024-09-10T23:15:42.508016+0000","last_unstale":"2024-09-10T23:15:44.931425+0000","last_undegraded":"2024-09-10T23:15:44.931425+0000","last_fullsized":"2024-09-10T23:15:44.931425+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:38.706722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516424+0000","last_change":"2024-09-10T23:15:43.540626+0000","last_active":"2024-09-10T23:15:44.516424+0000","last_peered":"2024-09-10T23:15:44.516424+0000","last_clean":"2024-09-10T23:15:44.516424+0000","last_became_active":"2024-09-10T23:15:43.540323+0000","last_became_peered":"2024-09-10T23:15:43.540323+0000","last_unstale":"2024-09-10T23:15:44.516424+0000","last_undegraded":"2024-09-10T23:15:44.516424+0000","last_fullsized":"2024-09-10T23:15:44.516424+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:27.806294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.509136+0000","last_change":"2024-09-10T23:15:42.507669+0000","last_active":"2024-09-10T23:15:42.509136+0000","last_peered":"2024-09-10T23:15:42.509136+0000","last_clean":"2024-09-10T23:15:42.509136+0000","last_became_active":"2024-09-10T23:15:42.507393+0000","last_became_peered":"2024-09-10T23:15:42.507393+0000","last_unstale":"2024-09-10T23:15:42.509136+0000","last_undegraded":"2024-09-10T23:15:42.509136+0000","last_fullsized":"2024-09-10T23:15:42.509136+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:53.985338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931271+0000","last_change":"2024-09-10T23:15:43.518692+0000","last_active":"2024-09-10T23:15:44.931271+0000","last_peered":"2024-09-10T23:15:44.931271+0000","last_clean":"2024-09-10T23:15:44.931271+0000","last_became_active":"2024-09-10T23:15:43.518325+0000","last_became_peered":"2024-09-10T23:15:43.518325+0000","last_unstale":"2024-09-10T23:15:44.931271+0000","last_undegraded":"2024-09-10T23:15:44.931271+0000","last_fullsized":"2024-09-10T23:15:44.931271+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:26.438912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931431+0000","last_change":"2024-09-10T23:15:42.501325+0000","last_active":"2024-09-10T23:15:44.931431+0000","last_peered":"2024-09-10T23:15:44.931431+0000","last_clean":"2024-09-10T23:15:44.931431+0000","last_became_active":"2024-09-10T23:15:42.501051+0000","last_became_peered":"2024-09-10T23:15:42.501051+0000","last_unstale":"2024-09-10T23:15:44.931431+0000","last_undegraded":"2024-09-10T23:15:44.931431+0000","last_fullsized":"2024-09-10T23:15:44.931431+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:01.930458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.496590+0000","last_change":"2024-09-10T23:15:42.496590+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.496590+0000","last_undegraded":"2024-09-10T23:15:42.496590+0000","last_fullsized":"2024-09-10T23:15:42.496590+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933250+0000","last_change":"2024-09-10T23:15:42.499477+0000","last_active":"2024-09-10T23:15:44.933250+0000","last_peered":"2024-09-10T23:15:44.933250+0000","last_clean":"2024-09-10T23:15:44.933250+0000","last_became_active":"2024-09-10T23:15:42.499161+0000","last_became_peered":"2024-09-10T23:15:42.499161+0000","last_unstale":"2024-09-10T23:15:44.933250+0000","last_undegraded":"2024-09-10T23:15:44.933250+0000","last_fullsized":"2024-09-10T23:15:44.933250+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:00.620682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931894+0000","last_change":"2024-09-10T23:15:43.530654+0000","last_active":"2024-09-10T23:15:44.931894+0000","last_peered":"2024-09-10T23:15:44.931894+0000","last_clean":"2024-09-10T23:15:44.931894+0000","last_became_active":"2024-09-10T23:15:43.530378+0000","last_became_peered":"2024-09-10T23:15:43.530378+0000","last_unstale":"2024-09-10T23:15:44.931894+0000","last_undegraded":"2024-09-10T23:15:44.931894+0000","last_fullsized":"2024-09-10T23:15:44.931894+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:36.613962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516809+0000","last_change":"2024-09-10T23:15:42.501879+0000","last_active":"2024-09-10T23:15:44.516809+0000","last_peered":"2024-09-10T23:15:44.516809+0000","last_clean":"2024-09-10T23:15:44.516809+0000","last_became_active":"2024-09-10T23:15:42.501613+0000","last_became_peered":"2024-09-10T23:15:42.501613+0000","last_unstale":"2024-09-10T23:15:44.516809+0000","last_undegraded":"2024-09-10T23:15:44.516809+0000","last_fullsized":"2024-09-10T23:15:44.516809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:31.143311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931997+0000","last_change":"2024-09-10T23:15:43.534829+0000","last_active":"2024-09-10T23:15:44.931997+0000","last_peered":"2024-09-10T23:15:44.931997+0000","last_clean":"2024-09-10T23:15:44.931997+0000","last_became_active":"2024-09-10T23:15:43.533503+0000","last_became_peered":"2024-09-10T23:15:43.533503+0000","last_unstale":"2024-09-10T23:15:44.931997+0000","last_undegraded":"2024-09-10T23:15:44.931997+0000","last_fullsized":"2024-09-10T23:15:44.931997+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:38.530901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932497+0000","last_change":"2024-09-10T23:15:42.511492+0000","last_active":"2024-09-10T23:15:44.932497+0000","last_peered":"2024-09-10T23:15:44.932497+0000","last_clean":"2024-09-10T23:15:44.932497+0000","last_became_active":"2024-09-10T23:15:42.511245+0000","last_became_peered":"2024-09-10T23:15:42.511245+0000","last_unstale":"2024-09-10T23:15:44.932497+0000","last_undegraded":"2024-09-10T23:15:44.932497+0000","last_fullsized":"2024-09-10T23:15:44.932497+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:45.272969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932054+0000","last_change":"2024-09-10T23:15:43.527612+0000","last_active":"2024-09-10T23:15:44.932054+0000","last_peered":"2024-09-10T23:15:44.932054+0000","last_clean":"2024-09-10T23:15:44.932054+0000","last_became_active":"2024-09-10T23:15:43.527357+0000","last_became_peered":"2024-09-10T23:15:43.527357+0000","last_unstale":"2024-09-10T23:15:44.932054+0000","last_undegraded":"2024-09-10T23:15:44.932054+0000","last_fullsized":"2024-09-10T23:15:44.932054+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:51.973604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932333+0000","last_change":"2024-09-10T23:15:42.501512+0000","last_active":"2024-09-10T23:15:44.932333+0000","last_peered":"2024-09-10T23:15:44.932333+0000","last_clean":"2024-09-10T23:15:44.932333+0000","last_became_active":"2024-09-10T23:15:42.501257+0000","last_became_peered":"2024-09-10T23:15:42.501257+0000","last_unstale":"2024-09-10T23:15:44.932333+0000","last_undegraded":"2024-09-10T23:15:44.932333+0000","last_fullsized":"2024-09-10T23:15:44.932333+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:02.933662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514830+0000","last_change":"2024-09-10T23:15:43.527690+0000","last_active":"2024-09-10T23:15:44.514830+0000","last_peered":"2024-09-10T23:15:44.514830+0000","last_clean":"2024-09-10T23:15:44.514830+0000","last_became_active":"2024-09-10T23:15:43.527237+0000","last_became_peered":"2024-09-10T23:15:43.527237+0000","last_unstale":"2024-09-10T23:15:44.514830+0000","last_undegraded":"2024-09-10T23:15:44.514830+0000","last_fullsized":"2024-09-10T23:15:44.514830+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:34.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516195+0000","last_change":"2024-09-10T23:15:42.509258+0000","last_active":"2024-09-10T23:15:44.516195+0000","last_peered":"2024-09-10T23:15:44.516195+0000","last_clean":"2024-09-10T23:15:44.516195+0000","last_became_active":"2024-09-10T23:15:42.508931+0000","last_became_peered":"2024-09-10T23:15:42.508931+0000","last_unstale":"2024-09-10T23:15:44.516195+0000","last_undegraded":"2024-09-10T23:15:44.516195+0000","last_fullsized":"2024-09-10T23:15:44.516195+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:03.971821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.930894+0000","last_change":"2024-09-10T23:15:43.533806+0000","last_active":"2024-09-10T23:15:44.930894+0000","last_peered":"2024-09-10T23:15:44.930894+0000","last_clean":"2024-09-10T23:15:44.930894+0000","last_became_active":"2024-09-10T23:15:43.533555+0000","last_became_peered":"2024-09-10T23:15:43.533555+0000","last_unstale":"2024-09-10T23:15:44.930894+0000","last_undegraded":"2024-09-10T23:15:44.930894+0000","last_fullsized":"2024-09-10T23:15:44.930894+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:34.468042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.508118+0000","last_change":"2024-09-10T23:15:42.506805+0000","last_active":"2024-09-10T23:15:42.508118+0000","last_peered":"2024-09-10T23:15:42.508118+0000","last_clean":"2024-09-10T23:15:42.508118+0000","last_became_active":"2024-09-10T23:15:42.506467+0000","last_became_peered":"2024-09-10T23:15:42.506467+0000","last_unstale":"2024-09-10T23:15:42.508118+0000","last_undegraded":"2024-09-10T23:15:42.508118+0000","last_fullsized":"2024-09-10T23:15:42.508118+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:48.798844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.495789+0000","last_change":"2024-09-10T23:15:42.495789+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.495789+0000","last_undegraded":"2024-09-10T23:15:42.495789+0000","last_fullsized":"2024-09-10T23:15:42.495789+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516188+0000","last_change":"2024-09-10T23:15:42.504548+0000","last_active":"2024-09-10T23:15:44.516188+0000","last_peered":"2024-09-10T23:15:44.516188+0000","last_clean":"2024-09-10T23:15:44.516188+0000","last_became_active":"2024-09-10T23:15:42.504243+0000","last_became_peered":"2024-09-10T23:15:42.504243+0000","last_unstale":"2024-09-10T23:15:44.516188+0000","last_undegraded":"2024-09-10T23:15:44.516188+0000","last_fullsized":"2024-09-10T23:15:44.516188+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:38.706722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932271+0000","last_change":"2024-09-10T23:15:43.532480+0000","last_active":"2024-09-10T23:15:44.932271+0000","last_peered":"2024-09-10T23:15:44.932271+0000","last_clean":"2024-09-10T23:15:44.932271+0000","last_became_active":"2024-09-10T23:15:43.532213+0000","last_became_peered":"2024-09-10T23:15:43.532213+0000","last_unstale":"2024-09-10T23:15:44.932271+0000","last_undegraded":"2024-09-10T23:15:44.932271+0000","last_fullsized":"2024-09-10T23:15:44.932271+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:28.144367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932439+0000","last_change":"2024-09-10T23:15:42.507050+0000","last_active":"2024-09-10T23:15:44.932439+0000","last_peered":"2024-09-10T23:15:44.932439+0000","last_clean":"2024-09-10T23:15:44.932439+0000","last_became_active":"2024-09-10T23:15:42.506736+0000","last_became_peered":"2024-09-10T23:15:42.506736+0000","last_unstale":"2024-09-10T23:15:44.932439+0000","last_undegraded":"2024-09-10T23:15:44.932439+0000","last_fullsized":"2024-09-10T23:15:44.932439+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:58.264160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.495292+0000","last_change":"2024-09-10T23:15:42.495292+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.495292+0000","last_undegraded":"2024-09-10T23:15:42.495292+0000","last_fullsized":"2024-09-10T23:15:42.495292+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516565+0000","last_change":"2024-09-10T23:15:42.512550+0000","last_active":"2024-09-10T23:15:44.516565+0000","last_peered":"2024-09-10T23:15:44.516565+0000","last_clean":"2024-09-10T23:15:44.516565+0000","last_became_active":"2024-09-10T23:15:42.512264+0000","last_became_peered":"2024-09-10T23:15:42.512264+0000","last_unstale":"2024-09-10T23:15:44.516565+0000","last_undegraded":"2024-09-10T23:15:44.516565+0000","last_fullsized":"2024-09-10T23:15:44.516565+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:51.973570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516494+0000","last_change":"2024-09-10T23:15:43.542762+0000","last_active":"2024-09-10T23:15:44.516494+0000","last_peered":"2024-09-10T23:15:44.516494+0000","last_clean":"2024-09-10T23:15:44.516494+0000","last_became_active":"2024-09-10T23:15:43.542496+0000","last_became_peered":"2024-09-10T23:15:43.542496+0000","last_unstale":"2024-09-10T23:15:44.516494+0000","last_undegraded":"2024-09-10T23:15:44.516494+0000","last_fullsized":"2024-09-10T23:15:44.516494+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:27.489244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514684+0000","last_change":"2024-09-10T23:15:42.508047+0000","last_active":"2024-09-10T23:15:44.514684+0000","last_peered":"2024-09-10T23:15:44.514684+0000","last_clean":"2024-09-10T23:15:44.514684+0000","last_became_active":"2024-09-10T23:15:42.506608+0000","last_became_peered":"2024-09-10T23:15:42.506608+0000","last_unstale":"2024-09-10T23:15:44.514684+0000","last_undegraded":"2024-09-10T23:15:44.514684+0000","last_fullsized":"2024-09-10T23:15:44.514684+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:07.647238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932154+0000","last_change":"2024-09-10T23:15:43.537555+0000","last_active":"2024-09-10T23:15:44.932154+0000","last_peered":"2024-09-10T23:15:44.932154+0000","last_clean":"2024-09-10T23:15:44.932154+0000","last_became_active":"2024-09-10T23:15:43.537267+0000","last_became_peered":"2024-09-10T23:15:43.537267+0000","last_unstale":"2024-09-10T23:15:44.932154+0000","last_undegraded":"2024-09-10T23:15:44.932154+0000","last_fullsized":"2024-09-10T23:15:44.932154+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:58.503796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516015+0000","last_change":"2024-09-10T23:15:42.511730+0000","last_active":"2024-09-10T23:15:44.516015+0000","last_peered":"2024-09-10T23:15:44.516015+0000","last_clean":"2024-09-10T23:15:44.516015+0000","last_became_active":"2024-09-10T23:15:42.511450+0000","last_became_peered":"2024-09-10T23:15:42.511450+0000","last_unstale":"2024-09-10T23:15:44.516015+0000","last_undegraded":"2024-09-10T23:15:44.516015+0000","last_fullsized":"2024-09-10T23:15:44.516015+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:55.382501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932247+0000","last_change":"2024-09-10T23:15:43.542960+0000","last_active":"2024-09-10T23:15:44.932247+0000","last_peered":"2024-09-10T23:15:44.932247+0000","last_clean":"2024-09-10T23:15:44.932247+0000","last_became_active":"2024-09-10T23:15:43.542616+0000","last_became_peered":"2024-09-10T23:15:43.542616+0000","last_unstale":"2024-09-10T23:15:44.932247+0000","last_undegraded":"2024-09-10T23:15:44.932247+0000","last_fullsized":"2024-09-10T23:15:44.932247+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:30.060356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933198+0000","last_change":"2024-09-10T23:15:42.502459+0000","last_active":"2024-09-10T23:15:44.933198+0000","last_peered":"2024-09-10T23:15:44.933198+0000","last_clean":"2024-09-10T23:15:44.933198+0000","last_became_active":"2024-09-10T23:15:42.502179+0000","last_became_peered":"2024-09-10T23:15:42.502179+0000","last_unstale":"2024-09-10T23:15:44.933198+0000","last_undegraded":"2024-09-10T23:15:44.933198+0000","last_fullsized":"2024-09-10T23:15:44.933198+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:35.610793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517231+0000","last_change":"2024-09-10T23:15:43.522932+0000","last_active":"2024-09-10T23:15:44.517231+0000","last_peered":"2024-09-10T23:15:44.517231+0000","last_clean":"2024-09-10T23:15:44.517231+0000","last_became_active":"2024-09-10T23:15:43.522601+0000","last_became_peered":"2024-09-10T23:15:43.522601+0000","last_unstale":"2024-09-10T23:15:44.517231+0000","last_undegraded":"2024-09-10T23:15:44.517231+0000","last_fullsized":"2024-09-10T23:15:44.517231+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:42.321567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514697+0000","last_change":"2024-09-10T23:15:42.508818+0000","last_active":"2024-09-10T23:15:44.514697+0000","last_peered":"2024-09-10T23:15:44.514697+0000","last_clean":"2024-09-10T23:15:44.514697+0000","last_became_active":"2024-09-10T23:15:42.508541+0000","last_became_peered":"2024-09-10T23:15:42.508541+0000","last_unstale":"2024-09-10T23:15:44.514697+0000","last_undegraded":"2024-09-10T23:15:44.514697+0000","last_fullsized":"2024-09-10T23:15:44.514697+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:51.671803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932924+0000","last_change":"2024-09-10T23:15:43.530853+0000","last_active":"2024-09-10T23:15:44.932924+0000","last_peered":"2024-09-10T23:15:44.932924+0000","last_clean":"2024-09-10T23:15:44.932924+0000","last_became_active":"2024-09-10T23:15:43.530574+0000","last_became_peered":"2024-09-10T23:15:43.530574+0000","last_unstale":"2024-09-10T23:15:44.932924+0000","last_undegraded":"2024-09-10T23:15:44.932924+0000","last_fullsized":"2024-09-10T23:15:44.932924+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:32.139284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.508254+0000","last_change":"2024-09-10T23:15:42.505319+0000","last_active":"2024-09-10T23:15:42.508254+0000","last_peered":"2024-09-10T23:15:42.508254+0000","last_clean":"2024-09-10T23:15:42.508254+0000","last_became_active":"2024-09-10T23:15:42.504868+0000","last_became_peered":"2024-09-10T23:15:42.504868+0000","last_unstale":"2024-09-10T23:15:42.508254+0000","last_undegraded":"2024-09-10T23:15:42.508254+0000","last_fullsized":"2024-09-10T23:15:42.508254+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:19.381787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-10T23:15:42.496168+0000","last_change":"2024-09-10T23:15:42.496168+0000","last_active":"2024-09-10T23:15:42.485472+0000","last_peered":"2024-09-10T23:15:42.485472+0000","last_clean":"2024-09-10T23:15:42.485472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:15:42.496168+0000","last_undegraded":"2024-09-10T23:15:42.496168+0000","last_fullsized":"2024-09-10T23:15:42.496168+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517097+0000","last_change":"2024-09-10T23:15:42.506691+0000","last_active":"2024-09-10T23:15:44.517097+0000","last_peered":"2024-09-10T23:15:44.517097+0000","last_clean":"2024-09-10T23:15:44.517097+0000","last_became_active":"2024-09-10T23:15:42.506074+0000","last_became_peered":"2024-09-10T23:15:42.506074+0000","last_unstale":"2024-09-10T23:15:44.517097+0000","last_undegraded":"2024-09-10T23:15:44.517097+0000","last_fullsized":"2024-09-10T23:15:44.517097+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:27.141199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":152,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516368+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:15:44.516368+0000","last_peered":"2024-09-10T23:15:44.516368+0000","last_clean":"2024-09-10T23:15:44.516368+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:15:44.516368+0000","last_undegraded":"2024-09-10T23:15:44.516368+0000","last_fullsized":"2024-09-10T23:15:44.516368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1130496,"data_stored":803392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":540672,"data_stored":213606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":213004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":532480,"data_stored":208246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":532480,"data_stored":207272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":214568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":536576,"data_stored":213004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1101824,"data_stored":790227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:15:49.483 INFO:tasks.ceph.mds.d.smithi171.stderr:2024-09-10T23:15:49.483+0000 7f082e24f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:15:50.901 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:15:51.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.012+0000 7fc671c39640 1 -- 172.21.15.90:0/2550481782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc66c0d1c70 msgr2=0x7fc66c0b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:51.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.012+0000 7fc671c39640 1 --2- 172.21.15.90:0/2550481782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc66c0d1c70 0x7fc66c0b3490 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc66c0ce940 tx=0x7fc66002a560 comp rx=0 tx=0).stop 2024-09-10T23:15:51.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.012+0000 7fc671c39640 1 -- 172.21.15.90:0/2550481782 shutdown_connections 2024-09-10T23:15:51.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.012+0000 7fc671c39640 1 --2- 172.21.15.90:0/2550481782 >> v2:172.21.15.171:3300/0 conn(0x7fc66c0b3a00 0x7fc66c0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.012+0000 7fc671c39640 1 --2- 172.21.15.90:0/2550481782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc66c0d1c70 0x7fc66c0b3490 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.012+0000 7fc671c39640 1 -- 172.21.15.90:0/2550481782 >> 172.21.15.90:0/2550481782 conn(0x7fc66c09d2a0 msgr2=0x7fc66c0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:51.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.012+0000 7fc671c39640 1 -- 172.21.15.90:0/2550481782 shutdown_connections 2024-09-10T23:15:51.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.012+0000 7fc671c39640 1 -- 172.21.15.90:0/2550481782 wait complete. 2024-09-10T23:15:51.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.013+0000 7fc671c39640 1 Processor -- start 2024-09-10T23:15:51.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.014+0000 7fc671c39640 1 -- start start 2024-09-10T23:15:51.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.014+0000 7fc671c39640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc66c0b3a00 0x7fc66c0ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:51.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.014+0000 7fc671c39640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc66c0d1c70 0x7fc66c0b7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:51.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.014+0000 7fc671c39640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc66c0d2470 0x7fc66c0b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:51.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.014+0000 7fc671c39640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c0b4570 con 0x7fc66c0d1c70 2024-09-10T23:15:51.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.014+0000 7fc671c39640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c0b43f0 con 0x7fc66c0b3a00 2024-09-10T23:15:51.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.014+0000 7fc671c39640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc66c0b46f0 con 0x7fc66c0d2470 2024-09-10T23:15:51.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.015+0000 7fc66affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc66c0d1c70 0x7fc66c0b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:51.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.015+0000 7fc66affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc66c0d1c70 0x7fc66c0b7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41366/0 (socket says 172.21.15.90:41366) 2024-09-10T23:15:51.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.015+0000 7fc66affd640 1 -- 172.21.15.90:0/2425500860 learned_addr learned my addr 172.21.15.90:0/2425500860 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:51.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.015+0000 7fc66bfff640 1 --2- 172.21.15.90:0/2425500860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc66c0d2470 0x7fc66c0b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:51.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.015+0000 7fc66b7fe640 1 --2- 172.21.15.90:0/2425500860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc66c0b3a00 0x7fc66c0ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:51.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.015+0000 7fc66affd640 1 -- 172.21.15.90:0/2425500860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc66c0d2470 msgr2=0x7fc66c0b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:51.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.015+0000 7fc66affd640 1 --2- 172.21.15.90:0/2425500860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc66c0d2470 0x7fc66c0b7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.015+0000 7fc66affd640 1 -- 172.21.15.90:0/2425500860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc66c0b3a00 msgr2=0x7fc66c0ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:51.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.015+0000 7fc66affd640 1 --2- 172.21.15.90:0/2425500860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc66c0b3a00 0x7fc66c0ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.015+0000 7fc66affd640 1 -- 172.21.15.90:0/2425500860 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66c153d80 con 0x7fc66c0d1c70 2024-09-10T23:15:51.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.015+0000 7fc66affd640 1 --2- 172.21.15.90:0/2425500860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc66c0d1c70 0x7fc66c0b7660 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc660009850 tx=0x7fc660003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:51.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.015+0000 7fc653fff640 1 -- 172.21.15.90:0/2425500860 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66003f070 con 0x7fc66c0d1c70 2024-09-10T23:15:51.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.015+0000 7fc653fff640 1 -- 172.21.15.90:0/2425500860 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6600047a0 con 0x7fc66c0d1c70 2024-09-10T23:15:51.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.015+0000 7fc653fff640 1 -- 172.21.15.90:0/2425500860 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660035030 con 0x7fc66c0d1c70 2024-09-10T23:15:51.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.015+0000 7fc671c39640 1 -- 172.21.15.90:0/2425500860 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66c1614a0 con 0x7fc66c0d1c70 2024-09-10T23:15:51.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.015+0000 7fc671c39640 1 -- 172.21.15.90:0/2425500860 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc66c0c9f90 con 0x7fc66c0d1c70 2024-09-10T23:15:51.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.016+0000 7fc671c39640 1 -- 172.21.15.90:0/2425500860 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc66c0b3eb0 con 0x7fc66c0d1c70 2024-09-10T23:15:51.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.017+0000 7fc653fff640 1 -- 172.21.15.90:0/2425500860 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc660004bb0 con 0x7fc66c0d1c70 2024-09-10T23:15:51.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.017+0000 7fc653fff640 1 --2- 172.21.15.90:0/2425500860 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc658077f70 0x7fc65807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:51.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.017+0000 7fc653fff640 1 -- 172.21.15.90:0/2425500860 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fc6600bae00 con 0x7fc66c0d1c70 2024-09-10T23:15:51.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.018+0000 7fc66b7fe640 1 --2- 172.21.15.90:0/2425500860 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc658077f70 0x7fc65807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:51.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.018+0000 7fc66b7fe640 1 --2- 172.21.15.90:0/2425500860 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc658077f70 0x7fc65807a430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00b450 tx=0x7fc65c00d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:51.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.021+0000 7fc653fff640 1 -- 172.21.15.90:0/2425500860 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc66c0cff60 con 0x7fc66c0d1c70 2024-09-10T23:15:51.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.193+0000 7fc671c39640 1 -- 172.21.15.90:0/2425500860 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc66c0b3290 con 0x7fc658077f70 2024-09-10T23:15:51.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.198+0000 7fc653fff640 1 -- 172.21.15.90:0/2425500860 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251945 (secure 0 0 0) 0x7fc66c0b3290 con 0x7fc658077f70 2024-09-10T23:15:51.201 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:51.202 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:15:51.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.201+0000 7fc671c39640 1 -- 172.21.15.90:0/2425500860 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc658077f70 msgr2=0x7fc65807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:51.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.201+0000 7fc671c39640 1 --2- 172.21.15.90:0/2425500860 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc658077f70 0x7fc65807a430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00b450 tx=0x7fc65c00d040 comp rx=0 tx=0).stop 2024-09-10T23:15:51.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.201+0000 7fc671c39640 1 -- 172.21.15.90:0/2425500860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc66c0d1c70 msgr2=0x7fc66c0b7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:51.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.201+0000 7fc671c39640 1 --2- 172.21.15.90:0/2425500860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc66c0d1c70 0x7fc66c0b7660 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc660009850 tx=0x7fc660003910 comp rx=0 tx=0).stop 2024-09-10T23:15:51.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.201+0000 7fc671c39640 1 -- 172.21.15.90:0/2425500860 shutdown_connections 2024-09-10T23:15:51.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.201+0000 7fc671c39640 1 --2- 172.21.15.90:0/2425500860 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc658077f70 0x7fc65807a430 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.201+0000 7fc671c39640 1 --2- 172.21.15.90:0/2425500860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc66c0d2470 0x7fc66c0b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.201+0000 7fc671c39640 1 --2- 172.21.15.90:0/2425500860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc66c0d1c70 0x7fc66c0b7660 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.201+0000 7fc671c39640 1 --2- 172.21.15.90:0/2425500860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc66c0b3a00 0x7fc66c0ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.201+0000 7fc671c39640 1 -- 172.21.15.90:0/2425500860 >> 172.21.15.90:0/2425500860 conn(0x7fc66c09d2a0 msgr2=0x7fc66c0b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:51.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.201+0000 7fc671c39640 1 -- 172.21.15.90:0/2425500860 shutdown_connections 2024-09-10T23:15:51.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.201+0000 7fc671c39640 1 -- 172.21.15.90:0/2425500860 wait complete. 2024-09-10T23:15:51.213 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-09-10T23:15:50.449800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225772,"kb_used_data":5360,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748948,"statfs":{"total":773094113280,"available":772862922752,"internally_reserved":0,"allocated":5488640,"data_stored":2876428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.958332"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516290+0000","last_change":"2024-09-10T23:15:43.531769+0000","last_active":"2024-09-10T23:15:44.516290+0000","last_peered":"2024-09-10T23:15:44.516290+0000","last_clean":"2024-09-10T23:15:44.516290+0000","last_became_active":"2024-09-10T23:15:43.531487+0000","last_became_peered":"2024-09-10T23:15:43.531487+0000","last_unstale":"2024-09-10T23:15:44.516290+0000","last_undegraded":"2024-09-10T23:15:44.516290+0000","last_fullsized":"2024-09-10T23:15:44.516290+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:59.369815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516729+0000","last_change":"2024-09-10T23:15:43.529475+0000","last_active":"2024-09-10T23:15:44.516729+0000","last_peered":"2024-09-10T23:15:44.516729+0000","last_clean":"2024-09-10T23:15:44.516729+0000","last_became_active":"2024-09-10T23:15:43.529175+0000","last_became_peered":"2024-09-10T23:15:43.529175+0000","last_unstale":"2024-09-10T23:15:44.516729+0000","last_undegraded":"2024-09-10T23:15:44.516729+0000","last_fullsized":"2024-09-10T23:15:44.516729+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:42.574340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932949+0000","last_change":"2024-09-10T23:15:43.527735+0000","last_active":"2024-09-10T23:15:44.932949+0000","last_peered":"2024-09-10T23:15:44.932949+0000","last_clean":"2024-09-10T23:15:44.932949+0000","last_became_active":"2024-09-10T23:15:43.527276+0000","last_became_peered":"2024-09-10T23:15:43.527276+0000","last_unstale":"2024-09-10T23:15:44.932949+0000","last_undegraded":"2024-09-10T23:15:44.932949+0000","last_fullsized":"2024-09-10T23:15:44.932949+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:39.709891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931039+0000","last_change":"2024-09-10T23:15:43.537889+0000","last_active":"2024-09-10T23:15:44.931039+0000","last_peered":"2024-09-10T23:15:44.931039+0000","last_clean":"2024-09-10T23:15:44.931039+0000","last_became_active":"2024-09-10T23:15:43.537592+0000","last_became_peered":"2024-09-10T23:15:43.537592+0000","last_unstale":"2024-09-10T23:15:44.931039+0000","last_undegraded":"2024-09-10T23:15:44.931039+0000","last_fullsized":"2024-09-10T23:15:44.931039+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:50.888216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516486+0000","last_change":"2024-09-10T23:15:43.529380+0000","last_active":"2024-09-10T23:15:44.516486+0000","last_peered":"2024-09-10T23:15:44.516486+0000","last_clean":"2024-09-10T23:15:44.516486+0000","last_became_active":"2024-09-10T23:15:43.529090+0000","last_became_peered":"2024-09-10T23:15:43.529090+0000","last_unstale":"2024-09-10T23:15:44.516486+0000","last_undegraded":"2024-09-10T23:15:44.516486+0000","last_fullsized":"2024-09-10T23:15:44.516486+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:52.446596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931825+0000","last_change":"2024-09-10T23:15:43.533375+0000","last_active":"2024-09-10T23:15:44.931825+0000","last_peered":"2024-09-10T23:15:44.931825+0000","last_clean":"2024-09-10T23:15:44.931825+0000","last_became_active":"2024-09-10T23:15:43.533088+0000","last_became_peered":"2024-09-10T23:15:43.533088+0000","last_unstale":"2024-09-10T23:15:44.931825+0000","last_undegraded":"2024-09-10T23:15:44.931825+0000","last_fullsized":"2024-09-10T23:15:44.931825+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:28.504092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516163+0000","last_change":"2024-09-10T23:15:43.543935+0000","last_active":"2024-09-10T23:15:44.516163+0000","last_peered":"2024-09-10T23:15:44.516163+0000","last_clean":"2024-09-10T23:15:44.516163+0000","last_became_active":"2024-09-10T23:15:43.543641+0000","last_became_peered":"2024-09-10T23:15:43.543641+0000","last_unstale":"2024-09-10T23:15:44.516163+0000","last_undegraded":"2024-09-10T23:15:44.516163+0000","last_fullsized":"2024-09-10T23:15:44.516163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:23.451112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.930978+0000","last_change":"2024-09-10T23:15:43.534237+0000","last_active":"2024-09-10T23:15:44.930978+0000","last_peered":"2024-09-10T23:15:44.930978+0000","last_clean":"2024-09-10T23:15:44.930978+0000","last_became_active":"2024-09-10T23:15:43.533969+0000","last_became_peered":"2024-09-10T23:15:43.533969+0000","last_unstale":"2024-09-10T23:15:44.930978+0000","last_undegraded":"2024-09-10T23:15:44.930978+0000","last_fullsized":"2024-09-10T23:15:44.930978+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:43.059991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931507+0000","last_change":"2024-09-10T23:15:43.538866+0000","last_active":"2024-09-10T23:15:44.931507+0000","last_peered":"2024-09-10T23:15:44.931507+0000","last_clean":"2024-09-10T23:15:44.931507+0000","last_became_active":"2024-09-10T23:15:43.538593+0000","last_became_peered":"2024-09-10T23:15:43.538593+0000","last_unstale":"2024-09-10T23:15:44.931507+0000","last_undegraded":"2024-09-10T23:15:44.931507+0000","last_fullsized":"2024-09-10T23:15:44.931507+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:24.382623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931906+0000","last_change":"2024-09-10T23:15:43.538170+0000","last_active":"2024-09-10T23:15:44.931906+0000","last_peered":"2024-09-10T23:15:44.931906+0000","last_clean":"2024-09-10T23:15:44.931906+0000","last_became_active":"2024-09-10T23:15:43.537865+0000","last_became_peered":"2024-09-10T23:15:43.537865+0000","last_unstale":"2024-09-10T23:15:44.931906+0000","last_undegraded":"2024-09-10T23:15:44.931906+0000","last_fullsized":"2024-09-10T23:15:44.931906+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:12.351780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931321+0000","last_change":"2024-09-10T23:15:43.531853+0000","last_active":"2024-09-10T23:15:44.931321+0000","last_peered":"2024-09-10T23:15:44.931321+0000","last_clean":"2024-09-10T23:15:44.931321+0000","last_became_active":"2024-09-10T23:15:43.531569+0000","last_became_peered":"2024-09-10T23:15:43.531569+0000","last_unstale":"2024-09-10T23:15:44.931321+0000","last_undegraded":"2024-09-10T23:15:44.931321+0000","last_fullsized":"2024-09-10T23:15:44.931321+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:25.420827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517339+0000","last_change":"2024-09-10T23:15:43.529156+0000","last_active":"2024-09-10T23:15:44.517339+0000","last_peered":"2024-09-10T23:15:44.517339+0000","last_clean":"2024-09-10T23:15:44.517339+0000","last_became_active":"2024-09-10T23:15:43.528877+0000","last_became_peered":"2024-09-10T23:15:43.528877+0000","last_unstale":"2024-09-10T23:15:44.517339+0000","last_undegraded":"2024-09-10T23:15:44.517339+0000","last_fullsized":"2024-09-10T23:15:44.517339+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:58.070612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931161+0000","last_change":"2024-09-10T23:15:43.527284+0000","last_active":"2024-09-10T23:15:44.931161+0000","last_peered":"2024-09-10T23:15:44.931161+0000","last_clean":"2024-09-10T23:15:44.931161+0000","last_became_active":"2024-09-10T23:15:43.527019+0000","last_became_peered":"2024-09-10T23:15:43.527019+0000","last_unstale":"2024-09-10T23:15:44.931161+0000","last_undegraded":"2024-09-10T23:15:44.931161+0000","last_fullsized":"2024-09-10T23:15:44.931161+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:20.558073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931374+0000","last_change":"2024-09-10T23:15:43.531856+0000","last_active":"2024-09-10T23:15:44.931374+0000","last_peered":"2024-09-10T23:15:44.931374+0000","last_clean":"2024-09-10T23:15:44.931374+0000","last_became_active":"2024-09-10T23:15:43.531554+0000","last_became_peered":"2024-09-10T23:15:43.531554+0000","last_unstale":"2024-09-10T23:15:44.931374+0000","last_undegraded":"2024-09-10T23:15:44.931374+0000","last_fullsized":"2024-09-10T23:15:44.931374+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:51.133844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931121+0000","last_change":"2024-09-10T23:15:43.530842+0000","last_active":"2024-09-10T23:15:44.931121+0000","last_peered":"2024-09-10T23:15:44.931121+0000","last_clean":"2024-09-10T23:15:44.931121+0000","last_became_active":"2024-09-10T23:15:43.530559+0000","last_became_peered":"2024-09-10T23:15:43.530559+0000","last_unstale":"2024-09-10T23:15:44.931121+0000","last_undegraded":"2024-09-10T23:15:44.931121+0000","last_fullsized":"2024-09-10T23:15:44.931121+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:41.393470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931624+0000","last_change":"2024-09-10T23:15:43.533130+0000","last_active":"2024-09-10T23:15:44.931624+0000","last_peered":"2024-09-10T23:15:44.931624+0000","last_clean":"2024-09-10T23:15:44.931624+0000","last_became_active":"2024-09-10T23:15:43.532800+0000","last_became_peered":"2024-09-10T23:15:43.532800+0000","last_unstale":"2024-09-10T23:15:44.931624+0000","last_undegraded":"2024-09-10T23:15:44.931624+0000","last_fullsized":"2024-09-10T23:15:44.931624+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:22.539205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933198+0000","last_change":"2024-09-10T23:15:43.524871+0000","last_active":"2024-09-10T23:15:44.933198+0000","last_peered":"2024-09-10T23:15:44.933198+0000","last_clean":"2024-09-10T23:15:44.933198+0000","last_became_active":"2024-09-10T23:15:43.524580+0000","last_became_peered":"2024-09-10T23:15:43.524580+0000","last_unstale":"2024-09-10T23:15:44.933198+0000","last_undegraded":"2024-09-10T23:15:44.933198+0000","last_fullsized":"2024-09-10T23:15:44.933198+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:46.276138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933038+0000","last_change":"2024-09-10T23:15:43.530280+0000","last_active":"2024-09-10T23:15:44.933038+0000","last_peered":"2024-09-10T23:15:44.933038+0000","last_clean":"2024-09-10T23:15:44.933038+0000","last_became_active":"2024-09-10T23:15:43.529987+0000","last_became_peered":"2024-09-10T23:15:43.529987+0000","last_unstale":"2024-09-10T23:15:44.933038+0000","last_undegraded":"2024-09-10T23:15:44.933038+0000","last_fullsized":"2024-09-10T23:15:44.933038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:56.385670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932219+0000","last_change":"2024-09-10T23:15:43.532316+0000","last_active":"2024-09-10T23:15:44.932219+0000","last_peered":"2024-09-10T23:15:44.932219+0000","last_clean":"2024-09-10T23:15:44.932219+0000","last_became_active":"2024-09-10T23:15:43.532064+0000","last_became_peered":"2024-09-10T23:15:43.532064+0000","last_unstale":"2024-09-10T23:15:44.932219+0000","last_undegraded":"2024-09-10T23:15:44.932219+0000","last_fullsized":"2024-09-10T23:15:44.932219+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:43.137866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931596+0000","last_change":"2024-09-10T23:15:43.531896+0000","last_active":"2024-09-10T23:15:44.931596+0000","last_peered":"2024-09-10T23:15:44.931596+0000","last_clean":"2024-09-10T23:15:44.931596+0000","last_became_active":"2024-09-10T23:15:43.531650+0000","last_became_peered":"2024-09-10T23:15:43.531650+0000","last_unstale":"2024-09-10T23:15:44.931596+0000","last_undegraded":"2024-09-10T23:15:44.931596+0000","last_fullsized":"2024-09-10T23:15:44.931596+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:49.987654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932163+0000","last_change":"2024-09-10T23:15:43.538991+0000","last_active":"2024-09-10T23:15:44.932163+0000","last_peered":"2024-09-10T23:15:44.932163+0000","last_clean":"2024-09-10T23:15:44.932163+0000","last_became_active":"2024-09-10T23:15:43.538544+0000","last_became_peered":"2024-09-10T23:15:43.538544+0000","last_unstale":"2024-09-10T23:15:44.932163+0000","last_undegraded":"2024-09-10T23:15:44.932163+0000","last_fullsized":"2024-09-10T23:15:44.932163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:00.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931431+0000","last_change":"2024-09-10T23:15:43.535339+0000","last_active":"2024-09-10T23:15:44.931431+0000","last_peered":"2024-09-10T23:15:44.931431+0000","last_clean":"2024-09-10T23:15:44.931431+0000","last_became_active":"2024-09-10T23:15:43.534791+0000","last_became_peered":"2024-09-10T23:15:43.534791+0000","last_unstale":"2024-09-10T23:15:44.931431+0000","last_undegraded":"2024-09-10T23:15:44.931431+0000","last_fullsized":"2024-09-10T23:15:44.931431+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:14.051963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931912+0000","last_change":"2024-09-10T23:15:43.535424+0000","last_active":"2024-09-10T23:15:44.931912+0000","last_peered":"2024-09-10T23:15:44.931912+0000","last_clean":"2024-09-10T23:15:44.931912+0000","last_became_active":"2024-09-10T23:15:43.535182+0000","last_became_peered":"2024-09-10T23:15:43.535182+0000","last_unstale":"2024-09-10T23:15:44.931912+0000","last_undegraded":"2024-09-10T23:15:44.931912+0000","last_fullsized":"2024-09-10T23:15:44.931912+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:30.995258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931643+0000","last_change":"2024-09-10T23:15:43.534813+0000","last_active":"2024-09-10T23:15:44.931643+0000","last_peered":"2024-09-10T23:15:44.931643+0000","last_clean":"2024-09-10T23:15:44.931643+0000","last_became_active":"2024-09-10T23:15:43.534529+0000","last_became_peered":"2024-09-10T23:15:43.534529+0000","last_unstale":"2024-09-10T23:15:44.931643+0000","last_undegraded":"2024-09-10T23:15:44.931643+0000","last_fullsized":"2024-09-10T23:15:44.931643+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:52.674972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932061+0000","last_change":"2024-09-10T23:15:43.536434+0000","last_active":"2024-09-10T23:15:44.932061+0000","last_peered":"2024-09-10T23:15:44.932061+0000","last_clean":"2024-09-10T23:15:44.932061+0000","last_became_active":"2024-09-10T23:15:43.536045+0000","last_became_peered":"2024-09-10T23:15:43.536045+0000","last_unstale":"2024-09-10T23:15:44.932061+0000","last_undegraded":"2024-09-10T23:15:44.932061+0000","last_fullsized":"2024-09-10T23:15:44.932061+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:41.288775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931088+0000","last_change":"2024-09-10T23:15:43.525079+0000","last_active":"2024-09-10T23:15:44.931088+0000","last_peered":"2024-09-10T23:15:44.931088+0000","last_clean":"2024-09-10T23:15:44.931088+0000","last_became_active":"2024-09-10T23:15:43.524767+0000","last_became_peered":"2024-09-10T23:15:43.524767+0000","last_unstale":"2024-09-10T23:15:44.931088+0000","last_undegraded":"2024-09-10T23:15:44.931088+0000","last_fullsized":"2024-09-10T23:15:44.931088+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:43.164571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933052+0000","last_change":"2024-09-10T23:15:43.527365+0000","last_active":"2024-09-10T23:15:44.933052+0000","last_peered":"2024-09-10T23:15:44.933052+0000","last_clean":"2024-09-10T23:15:44.933052+0000","last_became_active":"2024-09-10T23:15:43.527076+0000","last_became_peered":"2024-09-10T23:15:43.527076+0000","last_unstale":"2024-09-10T23:15:44.933052+0000","last_undegraded":"2024-09-10T23:15:44.933052+0000","last_fullsized":"2024-09-10T23:15:44.933052+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:03.936831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517372+0000","last_change":"2024-09-10T23:15:43.528612+0000","last_active":"2024-09-10T23:15:44.517372+0000","last_peered":"2024-09-10T23:15:44.517372+0000","last_clean":"2024-09-10T23:15:44.517372+0000","last_became_active":"2024-09-10T23:15:43.528315+0000","last_became_peered":"2024-09-10T23:15:43.528315+0000","last_unstale":"2024-09-10T23:15:44.517372+0000","last_undegraded":"2024-09-10T23:15:44.517372+0000","last_fullsized":"2024-09-10T23:15:44.517372+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:28.073391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931746+0000","last_change":"2024-09-10T23:15:43.535273+0000","last_active":"2024-09-10T23:15:44.931746+0000","last_peered":"2024-09-10T23:15:44.931746+0000","last_clean":"2024-09-10T23:15:44.931746+0000","last_became_active":"2024-09-10T23:15:43.535024+0000","last_became_peered":"2024-09-10T23:15:43.535024+0000","last_unstale":"2024-09-10T23:15:44.931746+0000","last_undegraded":"2024-09-10T23:15:44.931746+0000","last_fullsized":"2024-09-10T23:15:44.931746+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:04.093540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932900+0000","last_change":"2024-09-10T23:15:43.527299+0000","last_active":"2024-09-10T23:15:44.932900+0000","last_peered":"2024-09-10T23:15:44.932900+0000","last_clean":"2024-09-10T23:15:44.932900+0000","last_became_active":"2024-09-10T23:15:43.526863+0000","last_became_peered":"2024-09-10T23:15:43.526863+0000","last_unstale":"2024-09-10T23:15:44.932900+0000","last_undegraded":"2024-09-10T23:15:44.932900+0000","last_fullsized":"2024-09-10T23:15:44.932900+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:11.752339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931322+0000","last_change":"2024-09-10T23:15:43.530364+0000","last_active":"2024-09-10T23:15:44.931322+0000","last_peered":"2024-09-10T23:15:44.931322+0000","last_clean":"2024-09-10T23:15:44.931322+0000","last_became_active":"2024-09-10T23:15:43.530090+0000","last_became_peered":"2024-09-10T23:15:43.530090+0000","last_unstale":"2024-09-10T23:15:44.931322+0000","last_undegraded":"2024-09-10T23:15:44.931322+0000","last_fullsized":"2024-09-10T23:15:44.931322+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:54.877057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.930861+0000","last_change":"2024-09-10T23:15:43.521138+0000","last_active":"2024-09-10T23:15:44.930861+0000","last_peered":"2024-09-10T23:15:44.930861+0000","last_clean":"2024-09-10T23:15:44.930861+0000","last_became_active":"2024-09-10T23:15:43.520871+0000","last_became_peered":"2024-09-10T23:15:43.520871+0000","last_unstale":"2024-09-10T23:15:44.930861+0000","last_undegraded":"2024-09-10T23:15:44.930861+0000","last_fullsized":"2024-09-10T23:15:44.930861+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:48.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.515005+0000","last_change":"2024-09-10T23:15:43.528339+0000","last_active":"2024-09-10T23:15:44.515005+0000","last_peered":"2024-09-10T23:15:44.515005+0000","last_clean":"2024-09-10T23:15:44.515005+0000","last_became_active":"2024-09-10T23:15:43.528000+0000","last_became_peered":"2024-09-10T23:15:43.528000+0000","last_unstale":"2024-09-10T23:15:44.515005+0000","last_undegraded":"2024-09-10T23:15:44.515005+0000","last_fullsized":"2024-09-10T23:15:44.515005+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:41.252238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932530+0000","last_change":"2024-09-10T23:15:42.511719+0000","last_active":"2024-09-10T23:15:44.932530+0000","last_peered":"2024-09-10T23:15:44.932530+0000","last_clean":"2024-09-10T23:15:44.932530+0000","last_became_active":"2024-09-10T23:15:42.511478+0000","last_became_peered":"2024-09-10T23:15:42.511478+0000","last_unstale":"2024-09-10T23:15:44.932530+0000","last_undegraded":"2024-09-10T23:15:44.932530+0000","last_fullsized":"2024-09-10T23:15:44.932530+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:33.981158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932123+0000","last_change":"2024-09-10T23:15:43.523565+0000","last_active":"2024-09-10T23:15:44.932123+0000","last_peered":"2024-09-10T23:15:44.932123+0000","last_clean":"2024-09-10T23:15:44.932123+0000","last_became_active":"2024-09-10T23:15:43.523272+0000","last_became_peered":"2024-09-10T23:15:43.523272+0000","last_unstale":"2024-09-10T23:15:44.932123+0000","last_undegraded":"2024-09-10T23:15:44.932123+0000","last_fullsized":"2024-09-10T23:15:44.932123+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:41.252238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933175+0000","last_change":"2024-09-10T23:15:42.511614+0000","last_active":"2024-09-10T23:15:44.933175+0000","last_peered":"2024-09-10T23:15:44.933175+0000","last_clean":"2024-09-10T23:15:44.933175+0000","last_became_active":"2024-09-10T23:15:42.511315+0000","last_became_peered":"2024-09-10T23:15:42.511315+0000","last_unstale":"2024-09-10T23:15:44.933175+0000","last_undegraded":"2024-09-10T23:15:44.933175+0000","last_fullsized":"2024-09-10T23:15:44.933175+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:51.671803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517486+0000","last_change":"2024-09-10T23:15:43.529829+0000","last_active":"2024-09-10T23:15:44.517486+0000","last_peered":"2024-09-10T23:15:44.517486+0000","last_clean":"2024-09-10T23:15:44.517486+0000","last_became_active":"2024-09-10T23:15:43.529545+0000","last_became_peered":"2024-09-10T23:15:43.529545+0000","last_unstale":"2024-09-10T23:15:44.517486+0000","last_undegraded":"2024-09-10T23:15:44.517486+0000","last_fullsized":"2024-09-10T23:15:44.517486+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:37.792217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514966+0000","last_change":"2024-09-10T23:15:42.507388+0000","last_active":"2024-09-10T23:15:44.514966+0000","last_peered":"2024-09-10T23:15:44.514966+0000","last_clean":"2024-09-10T23:15:44.514966+0000","last_became_active":"2024-09-10T23:15:42.507140+0000","last_became_peered":"2024-09-10T23:15:42.507140+0000","last_unstale":"2024-09-10T23:15:44.514966+0000","last_undegraded":"2024-09-10T23:15:44.514966+0000","last_fullsized":"2024-09-10T23:15:44.514966+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:00.620682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514992+0000","last_change":"2024-09-10T23:15:43.535494+0000","last_active":"2024-09-10T23:15:44.514992+0000","last_peered":"2024-09-10T23:15:44.514992+0000","last_clean":"2024-09-10T23:15:44.514992+0000","last_became_active":"2024-09-10T23:15:43.535197+0000","last_became_peered":"2024-09-10T23:15:43.535197+0000","last_unstale":"2024-09-10T23:15:44.514992+0000","last_undegraded":"2024-09-10T23:15:44.514992+0000","last_fullsized":"2024-09-10T23:15:44.514992+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:51.184507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.515748+0000","last_change":"2024-09-10T23:15:42.507889+0000","last_active":"2024-09-10T23:15:44.515748+0000","last_peered":"2024-09-10T23:15:44.515748+0000","last_clean":"2024-09-10T23:15:44.515748+0000","last_became_active":"2024-09-10T23:15:42.507525+0000","last_became_peered":"2024-09-10T23:15:42.507525+0000","last_unstale":"2024-09-10T23:15:44.515748+0000","last_undegraded":"2024-09-10T23:15:44.515748+0000","last_fullsized":"2024-09-10T23:15:44.515748+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:31.136115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932861+0000","last_change":"2024-09-10T23:15:43.528047+0000","last_active":"2024-09-10T23:15:44.932861+0000","last_peered":"2024-09-10T23:15:44.932861+0000","last_clean":"2024-09-10T23:15:44.932861+0000","last_became_active":"2024-09-10T23:15:43.527788+0000","last_became_peered":"2024-09-10T23:15:43.527788+0000","last_unstale":"2024-09-10T23:15:44.932861+0000","last_undegraded":"2024-09-10T23:15:44.932861+0000","last_fullsized":"2024-09-10T23:15:44.932861+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:52.085571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932226+0000","last_change":"2024-09-10T23:15:42.504164+0000","last_active":"2024-09-10T23:15:44.932226+0000","last_peered":"2024-09-10T23:15:44.932226+0000","last_clean":"2024-09-10T23:15:44.932226+0000","last_became_active":"2024-09-10T23:15:42.503841+0000","last_became_peered":"2024-09-10T23:15:42.503841+0000","last_unstale":"2024-09-10T23:15:44.932226+0000","last_undegraded":"2024-09-10T23:15:44.932226+0000","last_fullsized":"2024-09-10T23:15:44.932226+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:51.973570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931822+0000","last_change":"2024-09-10T23:15:43.529147+0000","last_active":"2024-09-10T23:15:44.931822+0000","last_peered":"2024-09-10T23:15:44.931822+0000","last_clean":"2024-09-10T23:15:44.931822+0000","last_became_active":"2024-09-10T23:15:43.528791+0000","last_became_peered":"2024-09-10T23:15:43.528791+0000","last_unstale":"2024-09-10T23:15:44.931822+0000","last_undegraded":"2024-09-10T23:15:44.931822+0000","last_fullsized":"2024-09-10T23:15:44.931822+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:23.845116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933092+0000","last_change":"2024-09-10T23:15:42.507501+0000","last_active":"2024-09-10T23:15:44.933092+0000","last_peered":"2024-09-10T23:15:44.933092+0000","last_clean":"2024-09-10T23:15:44.933092+0000","last_became_active":"2024-09-10T23:15:42.507224+0000","last_became_peered":"2024-09-10T23:15:42.507224+0000","last_unstale":"2024-09-10T23:15:44.933092+0000","last_undegraded":"2024-09-10T23:15:44.933092+0000","last_fullsized":"2024-09-10T23:15:44.933092+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:41.069742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931009+0000","last_change":"2024-09-10T23:15:43.533476+0000","last_active":"2024-09-10T23:15:44.931009+0000","last_peered":"2024-09-10T23:15:44.931009+0000","last_clean":"2024-09-10T23:15:44.931009+0000","last_became_active":"2024-09-10T23:15:43.533220+0000","last_became_peered":"2024-09-10T23:15:43.533220+0000","last_unstale":"2024-09-10T23:15:44.931009+0000","last_undegraded":"2024-09-10T23:15:44.931009+0000","last_fullsized":"2024-09-10T23:15:44.931009+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:10.057709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516014+0000","last_change":"2024-09-10T23:15:42.500537+0000","last_active":"2024-09-10T23:15:44.516014+0000","last_peered":"2024-09-10T23:15:44.516014+0000","last_clean":"2024-09-10T23:15:44.516014+0000","last_became_active":"2024-09-10T23:15:42.500174+0000","last_became_peered":"2024-09-10T23:15:42.500174+0000","last_unstale":"2024-09-10T23:15:44.516014+0000","last_undegraded":"2024-09-10T23:15:44.516014+0000","last_fullsized":"2024-09-10T23:15:44.516014+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:42.134697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931662+0000","last_change":"2024-09-10T23:15:43.534456+0000","last_active":"2024-09-10T23:15:44.931662+0000","last_peered":"2024-09-10T23:15:44.931662+0000","last_clean":"2024-09-10T23:15:44.931662+0000","last_became_active":"2024-09-10T23:15:43.534189+0000","last_became_peered":"2024-09-10T23:15:43.534189+0000","last_unstale":"2024-09-10T23:15:44.931662+0000","last_undegraded":"2024-09-10T23:15:44.931662+0000","last_fullsized":"2024-09-10T23:15:44.931662+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:10.389011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931173+0000","last_change":"2024-09-10T23:15:42.504650+0000","last_active":"2024-09-10T23:15:44.931173+0000","last_peered":"2024-09-10T23:15:44.931173+0000","last_clean":"2024-09-10T23:15:44.931173+0000","last_became_active":"2024-09-10T23:15:42.504410+0000","last_became_peered":"2024-09-10T23:15:42.504410+0000","last_unstale":"2024-09-10T23:15:44.931173+0000","last_undegraded":"2024-09-10T23:15:44.931173+0000","last_fullsized":"2024-09-10T23:15:44.931173+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:54.097050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933152+0000","last_change":"2024-09-10T23:15:43.531044+0000","last_active":"2024-09-10T23:15:44.933152+0000","last_peered":"2024-09-10T23:15:44.933152+0000","last_clean":"2024-09-10T23:15:44.933152+0000","last_became_active":"2024-09-10T23:15:43.530763+0000","last_became_peered":"2024-09-10T23:15:43.530763+0000","last_unstale":"2024-09-10T23:15:44.933152+0000","last_undegraded":"2024-09-10T23:15:44.933152+0000","last_fullsized":"2024-09-10T23:15:44.933152+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:52.976739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933174+0000","last_change":"2024-09-10T23:15:42.497687+0000","last_active":"2024-09-10T23:15:44.933174+0000","last_peered":"2024-09-10T23:15:44.933174+0000","last_clean":"2024-09-10T23:15:44.933174+0000","last_became_active":"2024-09-10T23:15:42.497411+0000","last_became_peered":"2024-09-10T23:15:42.497411+0000","last_unstale":"2024-09-10T23:15:44.933174+0000","last_undegraded":"2024-09-10T23:15:44.933174+0000","last_fullsized":"2024-09-10T23:15:44.933174+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:07.647238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516410+0000","last_change":"2024-09-10T23:15:43.537527+0000","last_active":"2024-09-10T23:15:44.516410+0000","last_peered":"2024-09-10T23:15:44.516410+0000","last_clean":"2024-09-10T23:15:44.516410+0000","last_became_active":"2024-09-10T23:15:43.537079+0000","last_became_peered":"2024-09-10T23:15:43.537079+0000","last_unstale":"2024-09-10T23:15:44.516410+0000","last_undegraded":"2024-09-10T23:15:44.516410+0000","last_fullsized":"2024-09-10T23:15:44.516410+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:07.594488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932035+0000","last_change":"2024-09-10T23:15:42.504742+0000","last_active":"2024-09-10T23:15:44.932035+0000","last_peered":"2024-09-10T23:15:44.932035+0000","last_clean":"2024-09-10T23:15:44.932035+0000","last_became_active":"2024-09-10T23:15:42.504469+0000","last_became_peered":"2024-09-10T23:15:42.504469+0000","last_unstale":"2024-09-10T23:15:44.932035+0000","last_undegraded":"2024-09-10T23:15:44.932035+0000","last_fullsized":"2024-09-10T23:15:44.932035+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:16.974691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932516+0000","last_change":"2024-09-10T23:15:43.536547+0000","last_active":"2024-09-10T23:15:44.932516+0000","last_peered":"2024-09-10T23:15:44.932516+0000","last_clean":"2024-09-10T23:15:44.932516+0000","last_became_active":"2024-09-10T23:15:43.535697+0000","last_became_peered":"2024-09-10T23:15:43.535697+0000","last_unstale":"2024-09-10T23:15:44.932516+0000","last_undegraded":"2024-09-10T23:15:44.932516+0000","last_fullsized":"2024-09-10T23:15:44.932516+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:02.345671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516552+0000","last_change":"2024-09-10T23:15:42.512649+0000","last_active":"2024-09-10T23:15:44.516552+0000","last_peered":"2024-09-10T23:15:44.516552+0000","last_clean":"2024-09-10T23:15:44.516552+0000","last_became_active":"2024-09-10T23:15:42.512284+0000","last_became_peered":"2024-09-10T23:15:42.512284+0000","last_unstale":"2024-09-10T23:15:44.516552+0000","last_undegraded":"2024-09-10T23:15:44.516552+0000","last_fullsized":"2024-09-10T23:15:44.516552+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:02.933662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516269+0000","last_change":"2024-09-10T23:15:43.543825+0000","last_active":"2024-09-10T23:15:44.516269+0000","last_peered":"2024-09-10T23:15:44.516269+0000","last_clean":"2024-09-10T23:15:44.516269+0000","last_became_active":"2024-09-10T23:15:43.543546+0000","last_became_peered":"2024-09-10T23:15:43.543546+0000","last_unstale":"2024-09-10T23:15:44.516269+0000","last_undegraded":"2024-09-10T23:15:44.516269+0000","last_fullsized":"2024-09-10T23:15:44.516269+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:29.218569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931707+0000","last_change":"2024-09-10T23:15:42.499400+0000","last_active":"2024-09-10T23:15:44.931707+0000","last_peered":"2024-09-10T23:15:44.931707+0000","last_clean":"2024-09-10T23:15:44.931707+0000","last_became_active":"2024-09-10T23:15:42.499123+0000","last_became_peered":"2024-09-10T23:15:42.499123+0000","last_unstale":"2024-09-10T23:15:44.931707+0000","last_undegraded":"2024-09-10T23:15:44.931707+0000","last_fullsized":"2024-09-10T23:15:44.931707+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:27.654745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932077+0000","last_change":"2024-09-10T23:15:43.532558+0000","last_active":"2024-09-10T23:15:44.932077+0000","last_peered":"2024-09-10T23:15:44.932077+0000","last_clean":"2024-09-10T23:15:44.932077+0000","last_became_active":"2024-09-10T23:15:43.532269+0000","last_became_peered":"2024-09-10T23:15:43.532269+0000","last_unstale":"2024-09-10T23:15:44.932077+0000","last_undegraded":"2024-09-10T23:15:44.932077+0000","last_fullsized":"2024-09-10T23:15:44.932077+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:49.306185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932280+0000","last_change":"2024-09-10T23:15:42.508928+0000","last_active":"2024-09-10T23:15:44.932280+0000","last_peered":"2024-09-10T23:15:44.932280+0000","last_clean":"2024-09-10T23:15:44.932280+0000","last_became_active":"2024-09-10T23:15:42.508568+0000","last_became_peered":"2024-09-10T23:15:42.508568+0000","last_unstale":"2024-09-10T23:15:44.932280+0000","last_undegraded":"2024-09-10T23:15:44.932280+0000","last_fullsized":"2024-09-10T23:15:44.932280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:55.382501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931984+0000","last_change":"2024-09-10T23:15:43.531700+0000","last_active":"2024-09-10T23:15:44.931984+0000","last_peered":"2024-09-10T23:15:44.931984+0000","last_clean":"2024-09-10T23:15:44.931984+0000","last_became_active":"2024-09-10T23:15:43.531412+0000","last_became_peered":"2024-09-10T23:15:43.531412+0000","last_unstale":"2024-09-10T23:15:44.931984+0000","last_undegraded":"2024-09-10T23:15:44.931984+0000","last_fullsized":"2024-09-10T23:15:44.931984+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:24.844169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516010+0000","last_change":"2024-09-10T23:15:42.502106+0000","last_active":"2024-09-10T23:15:44.516010+0000","last_peered":"2024-09-10T23:15:44.516010+0000","last_clean":"2024-09-10T23:15:44.516010+0000","last_became_active":"2024-09-10T23:15:42.501620+0000","last_became_peered":"2024-09-10T23:15:42.501620+0000","last_unstale":"2024-09-10T23:15:44.516010+0000","last_undegraded":"2024-09-10T23:15:44.516010+0000","last_fullsized":"2024-09-10T23:15:44.516010+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:42.459571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.930865+0000","last_change":"2024-09-10T23:15:43.534217+0000","last_active":"2024-09-10T23:15:44.930865+0000","last_peered":"2024-09-10T23:15:44.930865+0000","last_clean":"2024-09-10T23:15:44.930865+0000","last_became_active":"2024-09-10T23:15:43.533952+0000","last_became_peered":"2024-09-10T23:15:43.533952+0000","last_unstale":"2024-09-10T23:15:44.930865+0000","last_undegraded":"2024-09-10T23:15:44.930865+0000","last_fullsized":"2024-09-10T23:15:44.930865+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:46:57.091610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931425+0000","last_change":"2024-09-10T23:15:42.508283+0000","last_active":"2024-09-10T23:15:44.931425+0000","last_peered":"2024-09-10T23:15:44.931425+0000","last_clean":"2024-09-10T23:15:44.931425+0000","last_became_active":"2024-09-10T23:15:42.508016+0000","last_became_peered":"2024-09-10T23:15:42.508016+0000","last_unstale":"2024-09-10T23:15:44.931425+0000","last_undegraded":"2024-09-10T23:15:44.931425+0000","last_fullsized":"2024-09-10T23:15:44.931425+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:38.706722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516424+0000","last_change":"2024-09-10T23:15:43.540626+0000","last_active":"2024-09-10T23:15:44.516424+0000","last_peered":"2024-09-10T23:15:44.516424+0000","last_clean":"2024-09-10T23:15:44.516424+0000","last_became_active":"2024-09-10T23:15:43.540323+0000","last_became_peered":"2024-09-10T23:15:43.540323+0000","last_unstale":"2024-09-10T23:15:44.516424+0000","last_undegraded":"2024-09-10T23:15:44.516424+0000","last_fullsized":"2024-09-10T23:15:44.516424+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:27.806294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931283+0000","last_change":"2024-09-10T23:15:42.507669+0000","last_active":"2024-09-10T23:15:44.931283+0000","last_peered":"2024-09-10T23:15:44.931283+0000","last_clean":"2024-09-10T23:15:44.931283+0000","last_became_active":"2024-09-10T23:15:42.507393+0000","last_became_peered":"2024-09-10T23:15:42.507393+0000","last_unstale":"2024-09-10T23:15:44.931283+0000","last_undegraded":"2024-09-10T23:15:44.931283+0000","last_fullsized":"2024-09-10T23:15:44.931283+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:09.602849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931271+0000","last_change":"2024-09-10T23:15:43.518692+0000","last_active":"2024-09-10T23:15:44.931271+0000","last_peered":"2024-09-10T23:15:44.931271+0000","last_clean":"2024-09-10T23:15:44.931271+0000","last_became_active":"2024-09-10T23:15:43.518325+0000","last_became_peered":"2024-09-10T23:15:43.518325+0000","last_unstale":"2024-09-10T23:15:44.931271+0000","last_undegraded":"2024-09-10T23:15:44.931271+0000","last_fullsized":"2024-09-10T23:15:44.931271+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:26.438912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931431+0000","last_change":"2024-09-10T23:15:42.501325+0000","last_active":"2024-09-10T23:15:44.931431+0000","last_peered":"2024-09-10T23:15:44.931431+0000","last_clean":"2024-09-10T23:15:44.931431+0000","last_became_active":"2024-09-10T23:15:42.501051+0000","last_became_peered":"2024-09-10T23:15:42.501051+0000","last_unstale":"2024-09-10T23:15:44.931431+0000","last_undegraded":"2024-09-10T23:15:44.931431+0000","last_fullsized":"2024-09-10T23:15:44.931431+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:01.930458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931692+0000","last_change":"2024-09-10T23:15:43.530797+0000","last_active":"2024-09-10T23:15:44.931692+0000","last_peered":"2024-09-10T23:15:44.931692+0000","last_clean":"2024-09-10T23:15:44.931692+0000","last_became_active":"2024-09-10T23:15:43.530523+0000","last_became_peered":"2024-09-10T23:15:43.530523+0000","last_unstale":"2024-09-10T23:15:44.931692+0000","last_undegraded":"2024-09-10T23:15:44.931692+0000","last_fullsized":"2024-09-10T23:15:44.931692+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:01.585993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933250+0000","last_change":"2024-09-10T23:15:42.499477+0000","last_active":"2024-09-10T23:15:44.933250+0000","last_peered":"2024-09-10T23:15:44.933250+0000","last_clean":"2024-09-10T23:15:44.933250+0000","last_became_active":"2024-09-10T23:15:42.499161+0000","last_became_peered":"2024-09-10T23:15:42.499161+0000","last_unstale":"2024-09-10T23:15:44.933250+0000","last_undegraded":"2024-09-10T23:15:44.933250+0000","last_fullsized":"2024-09-10T23:15:44.933250+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:00.620682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931894+0000","last_change":"2024-09-10T23:15:43.530654+0000","last_active":"2024-09-10T23:15:44.931894+0000","last_peered":"2024-09-10T23:15:44.931894+0000","last_clean":"2024-09-10T23:15:44.931894+0000","last_became_active":"2024-09-10T23:15:43.530378+0000","last_became_peered":"2024-09-10T23:15:43.530378+0000","last_unstale":"2024-09-10T23:15:44.931894+0000","last_undegraded":"2024-09-10T23:15:44.931894+0000","last_fullsized":"2024-09-10T23:15:44.931894+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:36.613962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516809+0000","last_change":"2024-09-10T23:15:42.501879+0000","last_active":"2024-09-10T23:15:44.516809+0000","last_peered":"2024-09-10T23:15:44.516809+0000","last_clean":"2024-09-10T23:15:44.516809+0000","last_became_active":"2024-09-10T23:15:42.501613+0000","last_became_peered":"2024-09-10T23:15:42.501613+0000","last_unstale":"2024-09-10T23:15:44.516809+0000","last_undegraded":"2024-09-10T23:15:44.516809+0000","last_fullsized":"2024-09-10T23:15:44.516809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:31.143311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931997+0000","last_change":"2024-09-10T23:15:43.534829+0000","last_active":"2024-09-10T23:15:44.931997+0000","last_peered":"2024-09-10T23:15:44.931997+0000","last_clean":"2024-09-10T23:15:44.931997+0000","last_became_active":"2024-09-10T23:15:43.533503+0000","last_became_peered":"2024-09-10T23:15:43.533503+0000","last_unstale":"2024-09-10T23:15:44.931997+0000","last_undegraded":"2024-09-10T23:15:44.931997+0000","last_fullsized":"2024-09-10T23:15:44.931997+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:38.530901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932497+0000","last_change":"2024-09-10T23:15:42.511492+0000","last_active":"2024-09-10T23:15:44.932497+0000","last_peered":"2024-09-10T23:15:44.932497+0000","last_clean":"2024-09-10T23:15:44.932497+0000","last_became_active":"2024-09-10T23:15:42.511245+0000","last_became_peered":"2024-09-10T23:15:42.511245+0000","last_unstale":"2024-09-10T23:15:44.932497+0000","last_undegraded":"2024-09-10T23:15:44.932497+0000","last_fullsized":"2024-09-10T23:15:44.932497+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:45.272969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932054+0000","last_change":"2024-09-10T23:15:43.527612+0000","last_active":"2024-09-10T23:15:44.932054+0000","last_peered":"2024-09-10T23:15:44.932054+0000","last_clean":"2024-09-10T23:15:44.932054+0000","last_became_active":"2024-09-10T23:15:43.527357+0000","last_became_peered":"2024-09-10T23:15:43.527357+0000","last_unstale":"2024-09-10T23:15:44.932054+0000","last_undegraded":"2024-09-10T23:15:44.932054+0000","last_fullsized":"2024-09-10T23:15:44.932054+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:51.973604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932333+0000","last_change":"2024-09-10T23:15:42.501512+0000","last_active":"2024-09-10T23:15:44.932333+0000","last_peered":"2024-09-10T23:15:44.932333+0000","last_clean":"2024-09-10T23:15:44.932333+0000","last_became_active":"2024-09-10T23:15:42.501257+0000","last_became_peered":"2024-09-10T23:15:42.501257+0000","last_unstale":"2024-09-10T23:15:44.932333+0000","last_undegraded":"2024-09-10T23:15:44.932333+0000","last_fullsized":"2024-09-10T23:15:44.932333+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:02.933662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514830+0000","last_change":"2024-09-10T23:15:43.527690+0000","last_active":"2024-09-10T23:15:44.514830+0000","last_peered":"2024-09-10T23:15:44.514830+0000","last_clean":"2024-09-10T23:15:44.514830+0000","last_became_active":"2024-09-10T23:15:43.527237+0000","last_became_peered":"2024-09-10T23:15:43.527237+0000","last_unstale":"2024-09-10T23:15:44.514830+0000","last_undegraded":"2024-09-10T23:15:44.514830+0000","last_fullsized":"2024-09-10T23:15:44.514830+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:34.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516195+0000","last_change":"2024-09-10T23:15:42.509258+0000","last_active":"2024-09-10T23:15:44.516195+0000","last_peered":"2024-09-10T23:15:44.516195+0000","last_clean":"2024-09-10T23:15:44.516195+0000","last_became_active":"2024-09-10T23:15:42.508931+0000","last_became_peered":"2024-09-10T23:15:42.508931+0000","last_unstale":"2024-09-10T23:15:44.516195+0000","last_undegraded":"2024-09-10T23:15:44.516195+0000","last_fullsized":"2024-09-10T23:15:44.516195+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:03.971821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.930894+0000","last_change":"2024-09-10T23:15:43.533806+0000","last_active":"2024-09-10T23:15:44.930894+0000","last_peered":"2024-09-10T23:15:44.930894+0000","last_clean":"2024-09-10T23:15:44.930894+0000","last_became_active":"2024-09-10T23:15:43.533555+0000","last_became_peered":"2024-09-10T23:15:43.533555+0000","last_unstale":"2024-09-10T23:15:44.930894+0000","last_undegraded":"2024-09-10T23:15:44.930894+0000","last_fullsized":"2024-09-10T23:15:44.930894+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:34.468042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931752+0000","last_change":"2024-09-10T23:15:42.506805+0000","last_active":"2024-09-10T23:15:44.931752+0000","last_peered":"2024-09-10T23:15:44.931752+0000","last_clean":"2024-09-10T23:15:44.931752+0000","last_became_active":"2024-09-10T23:15:42.506467+0000","last_became_peered":"2024-09-10T23:15:42.506467+0000","last_unstale":"2024-09-10T23:15:44.931752+0000","last_undegraded":"2024-09-10T23:15:44.931752+0000","last_fullsized":"2024-09-10T23:15:44.931752+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:47.392905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931611+0000","last_change":"2024-09-10T23:15:43.538380+0000","last_active":"2024-09-10T23:15:44.931611+0000","last_peered":"2024-09-10T23:15:44.931611+0000","last_clean":"2024-09-10T23:15:44.931611+0000","last_became_active":"2024-09-10T23:15:43.538104+0000","last_became_peered":"2024-09-10T23:15:43.538104+0000","last_unstale":"2024-09-10T23:15:44.931611+0000","last_undegraded":"2024-09-10T23:15:44.931611+0000","last_fullsized":"2024-09-10T23:15:44.931611+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:29.097732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516188+0000","last_change":"2024-09-10T23:15:42.504548+0000","last_active":"2024-09-10T23:15:44.516188+0000","last_peered":"2024-09-10T23:15:44.516188+0000","last_clean":"2024-09-10T23:15:44.516188+0000","last_became_active":"2024-09-10T23:15:42.504243+0000","last_became_peered":"2024-09-10T23:15:42.504243+0000","last_unstale":"2024-09-10T23:15:44.516188+0000","last_undegraded":"2024-09-10T23:15:44.516188+0000","last_fullsized":"2024-09-10T23:15:44.516188+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:38.706722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932271+0000","last_change":"2024-09-10T23:15:43.532480+0000","last_active":"2024-09-10T23:15:44.932271+0000","last_peered":"2024-09-10T23:15:44.932271+0000","last_clean":"2024-09-10T23:15:44.932271+0000","last_became_active":"2024-09-10T23:15:43.532213+0000","last_became_peered":"2024-09-10T23:15:43.532213+0000","last_unstale":"2024-09-10T23:15:44.932271+0000","last_undegraded":"2024-09-10T23:15:44.932271+0000","last_fullsized":"2024-09-10T23:15:44.932271+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:28.144367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932439+0000","last_change":"2024-09-10T23:15:42.507050+0000","last_active":"2024-09-10T23:15:44.932439+0000","last_peered":"2024-09-10T23:15:44.932439+0000","last_clean":"2024-09-10T23:15:44.932439+0000","last_became_active":"2024-09-10T23:15:42.506736+0000","last_became_peered":"2024-09-10T23:15:42.506736+0000","last_unstale":"2024-09-10T23:15:44.932439+0000","last_undegraded":"2024-09-10T23:15:44.932439+0000","last_fullsized":"2024-09-10T23:15:44.932439+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:58.264160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931192+0000","last_change":"2024-09-10T23:15:43.527436+0000","last_active":"2024-09-10T23:15:44.931192+0000","last_peered":"2024-09-10T23:15:44.931192+0000","last_clean":"2024-09-10T23:15:44.931192+0000","last_became_active":"2024-09-10T23:15:43.527161+0000","last_became_peered":"2024-09-10T23:15:43.527161+0000","last_unstale":"2024-09-10T23:15:44.931192+0000","last_undegraded":"2024-09-10T23:15:44.931192+0000","last_fullsized":"2024-09-10T23:15:44.931192+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:35.716419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516565+0000","last_change":"2024-09-10T23:15:42.512550+0000","last_active":"2024-09-10T23:15:44.516565+0000","last_peered":"2024-09-10T23:15:44.516565+0000","last_clean":"2024-09-10T23:15:44.516565+0000","last_became_active":"2024-09-10T23:15:42.512264+0000","last_became_peered":"2024-09-10T23:15:42.512264+0000","last_unstale":"2024-09-10T23:15:44.516565+0000","last_undegraded":"2024-09-10T23:15:44.516565+0000","last_fullsized":"2024-09-10T23:15:44.516565+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:51.973570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516494+0000","last_change":"2024-09-10T23:15:43.542762+0000","last_active":"2024-09-10T23:15:44.516494+0000","last_peered":"2024-09-10T23:15:44.516494+0000","last_clean":"2024-09-10T23:15:44.516494+0000","last_became_active":"2024-09-10T23:15:43.542496+0000","last_became_peered":"2024-09-10T23:15:43.542496+0000","last_unstale":"2024-09-10T23:15:44.516494+0000","last_undegraded":"2024-09-10T23:15:44.516494+0000","last_fullsized":"2024-09-10T23:15:44.516494+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:27.489244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514684+0000","last_change":"2024-09-10T23:15:42.508047+0000","last_active":"2024-09-10T23:15:44.514684+0000","last_peered":"2024-09-10T23:15:44.514684+0000","last_clean":"2024-09-10T23:15:44.514684+0000","last_became_active":"2024-09-10T23:15:42.506608+0000","last_became_peered":"2024-09-10T23:15:42.506608+0000","last_unstale":"2024-09-10T23:15:44.514684+0000","last_undegraded":"2024-09-10T23:15:44.514684+0000","last_fullsized":"2024-09-10T23:15:44.514684+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:07.647238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932154+0000","last_change":"2024-09-10T23:15:43.537555+0000","last_active":"2024-09-10T23:15:44.932154+0000","last_peered":"2024-09-10T23:15:44.932154+0000","last_clean":"2024-09-10T23:15:44.932154+0000","last_became_active":"2024-09-10T23:15:43.537267+0000","last_became_peered":"2024-09-10T23:15:43.537267+0000","last_unstale":"2024-09-10T23:15:44.932154+0000","last_undegraded":"2024-09-10T23:15:44.932154+0000","last_fullsized":"2024-09-10T23:15:44.932154+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:58.503796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516015+0000","last_change":"2024-09-10T23:15:42.511730+0000","last_active":"2024-09-10T23:15:44.516015+0000","last_peered":"2024-09-10T23:15:44.516015+0000","last_clean":"2024-09-10T23:15:44.516015+0000","last_became_active":"2024-09-10T23:15:42.511450+0000","last_became_peered":"2024-09-10T23:15:42.511450+0000","last_unstale":"2024-09-10T23:15:44.516015+0000","last_undegraded":"2024-09-10T23:15:44.516015+0000","last_fullsized":"2024-09-10T23:15:44.516015+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:55.382501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932247+0000","last_change":"2024-09-10T23:15:43.542960+0000","last_active":"2024-09-10T23:15:44.932247+0000","last_peered":"2024-09-10T23:15:44.932247+0000","last_clean":"2024-09-10T23:15:44.932247+0000","last_became_active":"2024-09-10T23:15:43.542616+0000","last_became_peered":"2024-09-10T23:15:43.542616+0000","last_unstale":"2024-09-10T23:15:44.932247+0000","last_undegraded":"2024-09-10T23:15:44.932247+0000","last_fullsized":"2024-09-10T23:15:44.932247+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:30.060356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.933198+0000","last_change":"2024-09-10T23:15:42.502459+0000","last_active":"2024-09-10T23:15:44.933198+0000","last_peered":"2024-09-10T23:15:44.933198+0000","last_clean":"2024-09-10T23:15:44.933198+0000","last_became_active":"2024-09-10T23:15:42.502179+0000","last_became_peered":"2024-09-10T23:15:42.502179+0000","last_unstale":"2024-09-10T23:15:44.933198+0000","last_undegraded":"2024-09-10T23:15:44.933198+0000","last_fullsized":"2024-09-10T23:15:44.933198+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:35.610793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517231+0000","last_change":"2024-09-10T23:15:43.522932+0000","last_active":"2024-09-10T23:15:44.517231+0000","last_peered":"2024-09-10T23:15:44.517231+0000","last_clean":"2024-09-10T23:15:44.517231+0000","last_became_active":"2024-09-10T23:15:43.522601+0000","last_became_peered":"2024-09-10T23:15:43.522601+0000","last_unstale":"2024-09-10T23:15:44.517231+0000","last_undegraded":"2024-09-10T23:15:44.517231+0000","last_fullsized":"2024-09-10T23:15:44.517231+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:42.321567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.514697+0000","last_change":"2024-09-10T23:15:42.508818+0000","last_active":"2024-09-10T23:15:44.514697+0000","last_peered":"2024-09-10T23:15:44.514697+0000","last_clean":"2024-09-10T23:15:44.514697+0000","last_became_active":"2024-09-10T23:15:42.508541+0000","last_became_peered":"2024-09-10T23:15:42.508541+0000","last_unstale":"2024-09-10T23:15:44.514697+0000","last_undegraded":"2024-09-10T23:15:44.514697+0000","last_fullsized":"2024-09-10T23:15:44.514697+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:51.671803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932924+0000","last_change":"2024-09-10T23:15:43.530853+0000","last_active":"2024-09-10T23:15:44.932924+0000","last_peered":"2024-09-10T23:15:44.932924+0000","last_clean":"2024-09-10T23:15:44.932924+0000","last_became_active":"2024-09-10T23:15:43.530574+0000","last_became_peered":"2024-09-10T23:15:43.530574+0000","last_unstale":"2024-09-10T23:15:44.932924+0000","last_undegraded":"2024-09-10T23:15:44.932924+0000","last_fullsized":"2024-09-10T23:15:44.932924+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:32.139284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.931398+0000","last_change":"2024-09-10T23:15:42.505319+0000","last_active":"2024-09-10T23:15:44.931398+0000","last_peered":"2024-09-10T23:15:44.931398+0000","last_clean":"2024-09-10T23:15:44.931398+0000","last_became_active":"2024-09-10T23:15:42.504868+0000","last_became_peered":"2024-09-10T23:15:42.504868+0000","last_unstale":"2024-09-10T23:15:44.931398+0000","last_undegraded":"2024-09-10T23:15:44.931398+0000","last_fullsized":"2024-09-10T23:15:44.931398+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:28.985349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.932040+0000","last_change":"2024-09-10T23:15:43.540045+0000","last_active":"2024-09-10T23:15:44.932040+0000","last_peered":"2024-09-10T23:15:44.932040+0000","last_clean":"2024-09-10T23:15:44.932040+0000","last_became_active":"2024-09-10T23:15:43.539776+0000","last_became_peered":"2024-09-10T23:15:43.539776+0000","last_unstale":"2024-09-10T23:15:44.932040+0000","last_undegraded":"2024-09-10T23:15:44.932040+0000","last_fullsized":"2024-09-10T23:15:44.932040+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:42.485472+0000","last_clean_scrub_stamp":"2024-09-10T23:15:42.485472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:20.911242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.517097+0000","last_change":"2024-09-10T23:15:42.506691+0000","last_active":"2024-09-10T23:15:44.517097+0000","last_peered":"2024-09-10T23:15:44.517097+0000","last_clean":"2024-09-10T23:15:44.517097+0000","last_became_active":"2024-09-10T23:15:42.506074+0000","last_became_peered":"2024-09-10T23:15:42.506074+0000","last_unstale":"2024-09-10T23:15:44.517097+0000","last_undegraded":"2024-09-10T23:15:44.517097+0000","last_fullsized":"2024-09-10T23:15:44.517097+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:41.482304+0000","last_clean_scrub_stamp":"2024-09-10T23:15:41.482304+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:27.141199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":152,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T23:15:44.516368+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:15:44.516368+0000","last_peered":"2024-09-10T23:15:44.516368+0000","last_clean":"2024-09-10T23:15:44.516368+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:15:44.516368+0000","last_undegraded":"2024-09-10T23:15:44.516368+0000","last_fullsized":"2024-09-10T23:15:44.516368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1130496,"data_stored":803392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":540672,"data_stored":213606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":213004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":532480,"data_stored":208246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":532480,"data_stored":207272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":214568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":536576,"data_stored":213004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1130496,"data_stored":803336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:15:51.217 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:15:51.217 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:15:51.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.361+0000 7f2065ad4640 1 -- 172.21.15.90:0/4227131873 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20600caa70 msgr2=0x7f206006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:51.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.361+0000 7f2065ad4640 1 --2- 172.21.15.90:0/4227131873 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20600caa70 0x7f206006f190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2058009830 tx=0x7f205802a510 comp rx=0 tx=0).stop 2024-09-10T23:15:51.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.361+0000 7f2065ad4640 1 -- 172.21.15.90:0/4227131873 shutdown_connections 2024-09-10T23:15:51.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.361+0000 7f2065ad4640 1 --2- 172.21.15.90:0/4227131873 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20600caa70 0x7f206006f190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.361+0000 7f2065ad4640 1 --2- 172.21.15.90:0/4227131873 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20601547c0 0x7f206015a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.361+0000 7f2065ad4640 1 -- 172.21.15.90:0/4227131873 >> 172.21.15.90:0/4227131873 conn(0x7f20600cfbc0 msgr2=0x7f20600cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:51.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.361+0000 7f2065ad4640 1 -- 172.21.15.90:0/4227131873 shutdown_connections 2024-09-10T23:15:51.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.361+0000 7f2065ad4640 1 -- 172.21.15.90:0/4227131873 wait complete. 2024-09-10T23:15:51.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.363+0000 7f2065ad4640 1 Processor -- start 2024-09-10T23:15:51.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.363+0000 7f2065ad4640 1 -- start start 2024-09-10T23:15:51.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.363+0000 7f2065ad4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20600caa70 0x7f20600c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:51.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.363+0000 7f2065ad4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20600cdca0 0x7f20601f2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:51.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f2065ad4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20601547c0 0x7f20600c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:51.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f2065ad4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f206006fae0 con 0x7f20600caa70 2024-09-10T23:15:51.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f2065ad4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f206006f960 con 0x7f20601547c0 2024-09-10T23:15:51.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f2065ad4640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f206006fc60 con 0x7f20600cdca0 2024-09-10T23:15:51.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f205f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20600caa70 0x7f20600c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:51.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f205f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20600caa70 0x7f20600c5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41376/0 (socket says 172.21.15.90:41376) 2024-09-10T23:15:51.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f205f7fe640 1 -- 172.21.15.90:0/3419316475 learned_addr learned my addr 172.21.15.90:0/3419316475 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:51.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f205ffff640 1 --2- 172.21.15.90:0/3419316475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20601547c0 0x7f20600c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:51.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f205effd640 1 --2- 172.21.15.90:0/3419316475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20600cdca0 0x7f20601f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:51.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f205f7fe640 1 -- 172.21.15.90:0/3419316475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20600cdca0 msgr2=0x7f20601f2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:51.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f205f7fe640 1 --2- 172.21.15.90:0/3419316475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20600cdca0 0x7f20601f2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f205f7fe640 1 -- 172.21.15.90:0/3419316475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20601547c0 msgr2=0x7f20600c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:51.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f205f7fe640 1 --2- 172.21.15.90:0/3419316475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20601547c0 0x7f20600c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f205f7fe640 1 -- 172.21.15.90:0/3419316475 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20600c46d0 con 0x7f20600caa70 2024-09-10T23:15:51.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f205effd640 1 --2- 172.21.15.90:0/3419316475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20600cdca0 0x7f20601f2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:51.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f205f7fe640 1 --2- 172.21.15.90:0/3419316475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20600caa70 0x7f20600c5710 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f205000eb30 tx=0x7f205000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:51.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f2047fff640 1 -- 172.21.15.90:0/3419316475 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2050010430 con 0x7f20600caa70 2024-09-10T23:15:51.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f2047fff640 1 -- 172.21.15.90:0/3419316475 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20500105d0 con 0x7f20600caa70 2024-09-10T23:15:51.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f2065ad4640 1 -- 172.21.15.90:0/3419316475 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20600c4950 con 0x7f20600caa70 2024-09-10T23:15:51.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f2047fff640 1 -- 172.21.15.90:0/3419316475 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2050010a20 con 0x7f20600caa70 2024-09-10T23:15:51.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.364+0000 7f2065ad4640 1 -- 172.21.15.90:0/3419316475 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20600c4f10 con 0x7f20600caa70 2024-09-10T23:15:51.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.365+0000 7f2065ad4640 1 -- 172.21.15.90:0/3419316475 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2060070180 con 0x7f20600caa70 2024-09-10T23:15:51.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.366+0000 7f2047fff640 1 -- 172.21.15.90:0/3419316475 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2050010bc0 con 0x7f20600caa70 2024-09-10T23:15:51.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.366+0000 7f2047fff640 1 --2- 172.21.15.90:0/3419316475 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f204c077f70 0x7f204c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:51.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.366+0000 7f2047fff640 1 -- 172.21.15.90:0/3419316475 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f205009aae0 con 0x7f20600caa70 2024-09-10T23:15:51.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.366+0000 7f205effd640 1 --2- 172.21.15.90:0/3419316475 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f204c077f70 0x7f204c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:51.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.367+0000 7f205effd640 1 --2- 172.21.15.90:0/3419316475 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f204c077f70 0x7f204c07a430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2054007fd0 tx=0x7f2054009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:51.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.370+0000 7f2047fff640 1 -- 172.21.15.90:0/3419316475 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f20600c46d0 con 0x7f20600caa70 2024-09-10T23:15:51.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.617+0000 7f2065ad4640 1 -- 172.21.15.90:0/3419316475 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f206006ea50 con 0x7f20600caa70 2024-09-10T23:15:51.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.619+0000 7f2047fff640 1 -- 172.21.15.90:0/3419316475 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) ==== 190+0+147 (secure 0 0 0) 0x7f20500635e0 con 0x7f20600caa70 2024-09-10T23:15:51.619 INFO:teuthology.orchestra.run.smithi090.stdout:[client.0] 2024-09-10T23:15:51.620 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCX0uBmiYBwBhAABMV9erpQ+KZlTmf0kDZ0gw== 2024-09-10T23:15:51.620 INFO:teuthology.orchestra.run.smithi090.stdout: caps mds = "allow" 2024-09-10T23:15:51.620 INFO:teuthology.orchestra.run.smithi090.stdout: caps mon = "allow r" 2024-09-10T23:15:51.620 INFO:teuthology.orchestra.run.smithi090.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:15:51.620 INFO:teuthology.orchestra.run.smithi090.stderr:updated caps for client.0 2024-09-10T23:15:51.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.621+0000 7f2065ad4640 1 -- 172.21.15.90:0/3419316475 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f204c077f70 msgr2=0x7f204c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:51.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.621+0000 7f2065ad4640 1 --2- 172.21.15.90:0/3419316475 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f204c077f70 0x7f204c07a430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2054007fd0 tx=0x7f2054009040 comp rx=0 tx=0).stop 2024-09-10T23:15:51.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.621+0000 7f2065ad4640 1 -- 172.21.15.90:0/3419316475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20600caa70 msgr2=0x7f20600c5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:51.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.621+0000 7f2065ad4640 1 --2- 172.21.15.90:0/3419316475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20600caa70 0x7f20600c5710 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f205000eb30 tx=0x7f205000c2d0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.621+0000 7f2065ad4640 1 -- 172.21.15.90:0/3419316475 shutdown_connections 2024-09-10T23:15:51.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.621+0000 7f2065ad4640 1 --2- 172.21.15.90:0/3419316475 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f204c077f70 0x7f204c07a430 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.621+0000 7f2065ad4640 1 --2- 172.21.15.90:0/3419316475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20601547c0 0x7f20600c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.621+0000 7f2065ad4640 1 --2- 172.21.15.90:0/3419316475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20600cdca0 0x7f20601f2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.621+0000 7f2065ad4640 1 --2- 172.21.15.90:0/3419316475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20600caa70 0x7f20600c5710 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.621+0000 7f2065ad4640 1 -- 172.21.15.90:0/3419316475 >> 172.21.15.90:0/3419316475 conn(0x7f20600cfbc0 msgr2=0x7f20601586a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:51.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.621+0000 7f2065ad4640 1 -- 172.21.15.90:0/3419316475 shutdown_connections 2024-09-10T23:15:51.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.621+0000 7f2065ad4640 1 -- 172.21.15.90:0/3419316475 wait complete. 2024-09-10T23:15:51.633 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:51.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.733+0000 7fa6a8823640 1 -- 172.21.15.90:0/1759889729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa690003a50 msgr2=0x7fa690003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:51.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.733+0000 7fa6a8823640 1 --2- 172.21.15.90:0/1759889729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa690003a50 0x7fa690003e70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa69400c260 tx=0x7fa690005830 comp rx=0 tx=0).stop 2024-09-10T23:15:51.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.733+0000 7fa6a8823640 1 -- 172.21.15.90:0/1759889729 shutdown_connections 2024-09-10T23:15:51.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.733+0000 7fa6a8823640 1 --2- 172.21.15.90:0/1759889729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa690003a50 0x7fa690003e70 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.733+0000 7fa6a8823640 1 -- 172.21.15.90:0/1759889729 >> 172.21.15.90:0/1759889729 conn(0x7fa6a40cc850 msgr2=0x7fa6a40ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:51.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.733+0000 7fa6a8823640 1 -- 172.21.15.90:0/1759889729 shutdown_connections 2024-09-10T23:15:51.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.733+0000 7fa6a8823640 1 -- 172.21.15.90:0/1759889729 wait complete. 2024-09-10T23:15:51.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.734+0000 7fa6a8823640 1 Processor -- start 2024-09-10T23:15:51.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.734+0000 7fa6a8823640 1 -- start start 2024-09-10T23:15:51.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.735+0000 7fa6a8823640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa690003a50 0x7fa6a4072630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:51.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.735+0000 7fa6a8823640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6a4073f60 0x7fa6a415bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:51.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.735+0000 7fa6a8823640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6a40743c0 0x7fa6a415c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:51.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.735+0000 7fa6a8823640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a40cada0 con 0x7fa690003a50 2024-09-10T23:15:51.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.735+0000 7fa6a8823640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a40cac20 con 0x7fa6a4073f60 2024-09-10T23:15:51.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.735+0000 7fa6a8823640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a415b290 con 0x7fa6a40743c0 2024-09-10T23:15:51.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.735+0000 7fa6a259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa690003a50 0x7fa6a4072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:51.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.735+0000 7fa6a259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa690003a50 0x7fa6a4072630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41394/0 (socket says 172.21.15.90:41394) 2024-09-10T23:15:51.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.735+0000 7fa6a259c640 1 -- 172.21.15.90:0/1998766331 learned_addr learned my addr 172.21.15.90:0/1998766331 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:51.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.735+0000 7fa6a2d9d640 1 --2- 172.21.15.90:0/1998766331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6a40743c0 0x7fa6a415c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:51.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.735+0000 7fa699d9b640 1 --2- 172.21.15.90:0/1998766331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6a4073f60 0x7fa6a415bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:51.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.736+0000 7fa6a259c640 1 -- 172.21.15.90:0/1998766331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6a40743c0 msgr2=0x7fa6a415c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:51.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.736+0000 7fa6a259c640 1 --2- 172.21.15.90:0/1998766331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6a40743c0 0x7fa6a415c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.736+0000 7fa6a259c640 1 -- 172.21.15.90:0/1998766331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6a4073f60 msgr2=0x7fa6a415bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:51.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.736+0000 7fa6a259c640 1 --2- 172.21.15.90:0/1998766331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6a4073f60 0x7fa6a415bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.736+0000 7fa6a259c640 1 -- 172.21.15.90:0/1998766331 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a41f4b00 con 0x7fa690003a50 2024-09-10T23:15:51.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.736+0000 7fa6a2d9d640 1 --2- 172.21.15.90:0/1998766331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6a40743c0 0x7fa6a415c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:51.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.736+0000 7fa699d9b640 1 --2- 172.21.15.90:0/1998766331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6a4073f60 0x7fa6a415bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:51.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.736+0000 7fa6a259c640 1 --2- 172.21.15.90:0/1998766331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa690003a50 0x7fa6a4072630 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa69402b0f0 tx=0x7fa694004dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:51.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.736+0000 7fa69b7fe640 1 -- 172.21.15.90:0/1998766331 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694031040 con 0x7fa690003a50 2024-09-10T23:15:51.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.736+0000 7fa69b7fe640 1 -- 172.21.15.90:0/1998766331 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa694006440 con 0x7fa690003a50 2024-09-10T23:15:51.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.736+0000 7fa69b7fe640 1 -- 172.21.15.90:0/1998766331 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694006c30 con 0x7fa690003a50 2024-09-10T23:15:51.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.736+0000 7fa6a8823640 1 -- 172.21.15.90:0/1998766331 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a41f4de0 con 0x7fa690003a50 2024-09-10T23:15:51.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.736+0000 7fa6a8823640 1 -- 172.21.15.90:0/1998766331 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a41f53a0 con 0x7fa690003a50 2024-09-10T23:15:51.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.737+0000 7fa6a8823640 1 -- 172.21.15.90:0/1998766331 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a40b18c0 con 0x7fa690003a50 2024-09-10T23:15:51.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.737+0000 7fa69b7fe640 1 -- 172.21.15.90:0/1998766331 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa694048030 con 0x7fa690003a50 2024-09-10T23:15:51.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.738+0000 7fa69b7fe640 1 --2- 172.21.15.90:0/1998766331 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa684077fa0 0x7fa68407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:51.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.738+0000 7fa69b7fe640 1 -- 172.21.15.90:0/1998766331 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fa6940b9be0 con 0x7fa690003a50 2024-09-10T23:15:51.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.738+0000 7fa699d9b640 1 --2- 172.21.15.90:0/1998766331 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa684077fa0 0x7fa68407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:51.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.739+0000 7fa699d9b640 1 --2- 172.21.15.90:0/1998766331 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa684077fa0 0x7fa68407a460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa6a41570b0 tx=0x7fa68c005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:51.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.742+0000 7fa69b7fe640 1 -- 172.21.15.90:0/1998766331 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa6940826e0 con 0x7fa690003a50 2024-09-10T23:15:51.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.952+0000 7fa6a8823640 1 -- 172.21.15.90:0/1998766331 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6a40cf520 con 0x7fa690003a50 2024-09-10T23:15:51.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.952+0000 7fa69b7fe640 1 -- 172.21.15.90:0/1998766331 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5229 (secure 0 0 0) 0x7fa694001710 con 0x7fa690003a50 2024-09-10T23:15:51.954 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:51.954 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"btime":"2024-09-10T23:15:45:529350+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3694036833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3694036833},{"type":"v1","addr":"172.21.15.171:6836","nonce":3694036833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4148214232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":4148214232},{"type":"v1","addr":"172.21.15.90:6835","nonce":4148214232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/2531112116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2531112116},{"type":"v1","addr":"172.21.15.90:6834","nonce":2531112116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:42.843210+0000","modified":"2024-09-10T23:15:44.866224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/4106111677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":4106111677},{"type":"v1","addr":"172.21.15.171:6837","nonce":4106111677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-10T23:15:51.954 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 20 2024-09-10T23:15:51.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.955+0000 7fa6a8823640 1 -- 172.21.15.90:0/1998766331 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa684077fa0 msgr2=0x7fa68407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:51.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.955+0000 7fa6a8823640 1 --2- 172.21.15.90:0/1998766331 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa684077fa0 0x7fa68407a460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa6a41570b0 tx=0x7fa68c005f90 comp rx=0 tx=0).stop 2024-09-10T23:15:51.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.955+0000 7fa6a8823640 1 -- 172.21.15.90:0/1998766331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa690003a50 msgr2=0x7fa6a4072630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:51.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.955+0000 7fa6a8823640 1 --2- 172.21.15.90:0/1998766331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa690003a50 0x7fa6a4072630 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa69402b0f0 tx=0x7fa694004dd0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.955+0000 7fa6a8823640 1 -- 172.21.15.90:0/1998766331 shutdown_connections 2024-09-10T23:15:51.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.955+0000 7fa6a8823640 1 --2- 172.21.15.90:0/1998766331 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa684077fa0 0x7fa68407a460 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.955+0000 7fa6a8823640 1 --2- 172.21.15.90:0/1998766331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6a4073f60 0x7fa6a415bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.955+0000 7fa6a8823640 1 --2- 172.21.15.90:0/1998766331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6a40743c0 0x7fa6a415c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.955+0000 7fa6a8823640 1 --2- 172.21.15.90:0/1998766331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa690003a50 0x7fa6a4072630 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:51.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.955+0000 7fa6a8823640 1 -- 172.21.15.90:0/1998766331 >> 172.21.15.90:0/1998766331 conn(0x7fa6a40cc850 msgr2=0x7fa6a40b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:51.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.955+0000 7fa6a8823640 1 -- 172.21.15.90:0/1998766331 shutdown_connections 2024-09-10T23:15:51.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:51.955+0000 7fa6a8823640 1 -- 172.21.15.90:0/1998766331 wait complete. 2024-09-10T23:15:52.370 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:15:42.843210+0000', 'modified': '2024-09-10T23:15:44.866224+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5250}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5250': {'gid': 5250, 'name': 'd', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.171:6837/4106111677', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6835', 'nonce': 4106111677}, {'type': 'v1', 'addr': '172.21.15.171:6837', 'nonce': 4106111677}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5250, 'qdb_cluster': [5250]} 2024-09-10T23:15:52.370 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:15:52.371 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T23:15:52.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.474+0000 7f5f326b8640 1 -- 172.21.15.90:0/3290693648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f2c0d1c70 msgr2=0x7f5f2c0b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:52.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.474+0000 7f5f326b8640 1 --2- 172.21.15.90:0/3290693648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f2c0d1c70 0x7f5f2c0b3490 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0ce940 tx=0x7f5f2002a530 comp rx=0 tx=0).stop 2024-09-10T23:15:52.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.475+0000 7f5f326b8640 1 -- 172.21.15.90:0/3290693648 shutdown_connections 2024-09-10T23:15:52.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.475+0000 7f5f326b8640 1 --2- 172.21.15.90:0/3290693648 >> v2:172.21.15.171:3300/0 conn(0x7f5f2c0b3a00 0x7f5f2c0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.475+0000 7f5f326b8640 1 --2- 172.21.15.90:0/3290693648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f2c0d1c70 0x7f5f2c0b3490 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.475+0000 7f5f326b8640 1 -- 172.21.15.90:0/3290693648 >> 172.21.15.90:0/3290693648 conn(0x7f5f2c09d2a0 msgr2=0x7f5f2c0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:52.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.475+0000 7f5f326b8640 1 -- 172.21.15.90:0/3290693648 shutdown_connections 2024-09-10T23:15:52.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.475+0000 7f5f326b8640 1 -- 172.21.15.90:0/3290693648 wait complete. 2024-09-10T23:15:52.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.476+0000 7f5f326b8640 1 Processor -- start 2024-09-10T23:15:52.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.476+0000 7f5f326b8640 1 -- start start 2024-09-10T23:15:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f326b8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f2c0b3a00 0x7f5f2c1f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f326b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f2c0d1c70 0x7f5f2c0b9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f326b8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f2c0d2470 0x7f5f2c0cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f326b8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c0b4570 con 0x7f5f2c0b3a00 2024-09-10T23:15:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f326b8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c0b43f0 con 0x7f5f2c0d2470 2024-09-10T23:15:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f326b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5f2c0b46f0 con 0x7f5f2c0d1c70 2024-09-10T23:15:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f2bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f2c0b3a00 0x7f5f2c1f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f2bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f2c0b3a00 0x7f5f2c1f1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41406/0 (socket says 172.21.15.90:41406) 2024-09-10T23:15:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f2bfff640 1 -- 172.21.15.90:0/3482201356 learned_addr learned my addr 172.21.15.90:0/3482201356 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f30c55640 1 --2- 172.21.15.90:0/3482201356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f2c0d2470 0x7f5f2c0cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f2b7fe640 1 --2- 172.21.15.90:0/3482201356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f2c0d1c70 0x7f5f2c0b9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f2bfff640 1 -- 172.21.15.90:0/3482201356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f2c0d1c70 msgr2=0x7f5f2c0b9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:52.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f2bfff640 1 --2- 172.21.15.90:0/3482201356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f2c0d1c70 0x7f5f2c0b9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f2bfff640 1 -- 172.21.15.90:0/3482201356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f2c0d2470 msgr2=0x7f5f2c0cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:52.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f2bfff640 1 --2- 172.21.15.90:0/3482201356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f2c0d2470 0x7f5f2c0cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f2bfff640 1 -- 172.21.15.90:0/3482201356 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2c1f2470 con 0x7f5f2c0b3a00 2024-09-10T23:15:52.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f2bfff640 1 --2- 172.21.15.90:0/3482201356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f2c0b3a00 0x7f5f2c1f1f30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00c730 tx=0x7f5f1c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:52.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f28ff9640 1 -- 172.21.15.90:0/3482201356 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c016020 con 0x7f5f2c0b3a00 2024-09-10T23:15:52.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f28ff9640 1 -- 172.21.15.90:0/3482201356 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f1c00a950 con 0x7f5f2c0b3a00 2024-09-10T23:15:52.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f28ff9640 1 -- 172.21.15.90:0/3482201356 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c00ada0 con 0x7f5f2c0b3a00 2024-09-10T23:15:52.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.477+0000 7f5f326b8640 1 -- 172.21.15.90:0/3482201356 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f2c0b7f80 con 0x7f5f2c0b3a00 2024-09-10T23:15:52.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.478+0000 7f5f326b8640 1 -- 172.21.15.90:0/3482201356 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f2c0b8f20 con 0x7f5f2c0b3a00 2024-09-10T23:15:52.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.479+0000 7f5f28ff9640 1 -- 172.21.15.90:0/3482201356 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5f1c01b400 con 0x7f5f2c0b3a00 2024-09-10T23:15:52.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.480+0000 7f5f28ff9640 1 --2- 172.21.15.90:0/3482201356 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5f18077f70 0x7f5f1807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.480+0000 7f5f28ff9640 1 -- 172.21.15.90:0/3482201356 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f5f1c099ed0 con 0x7f5f2c0b3a00 2024-09-10T23:15:52.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.480+0000 7f5f2b7fe640 1 --2- 172.21.15.90:0/3482201356 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5f18077f70 0x7f5f1807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.480+0000 7f5f35481740 1 Processor -- start 2024-09-10T23:15:52.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.480+0000 7f5f35481740 1 -- start start 2024-09-10T23:15:52.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.480+0000 7f5f2b7fe640 1 --2- 172.21.15.90:0/3482201356 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5f18077f70 0x7f5f1807a430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5f20034000 tx=0x7f5f20004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:52.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.481+0000 7f5f35481740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126bf31b0 0x55f126bcab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.481+0000 7f5f35481740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126c12df0 0x55f126c131f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.481+0000 7f5f35481740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bc85f0 0x55f126bc8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.481+0000 7f5f35481740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f126b3f820 con 0x55f126bf31b0 2024-09-10T23:15:52.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.481+0000 7f5f35481740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f126b2ec50 con 0x55f126bc85f0 2024-09-10T23:15:52.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.481+0000 7f5f35481740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55f126b32a60 con 0x55f126c12df0 2024-09-10T23:15:52.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.481+0000 7f5f2bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126bf31b0 0x55f126bcab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.481+0000 7f5f2bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126bf31b0 0x55f126bcab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41420/0 (socket says 172.21.15.90:41420) 2024-09-10T23:15:52.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.481+0000 7f5f2bfff640 1 -- 172.21.15.90:0/3921169169 learned_addr learned my addr 172.21.15.90:0/3921169169 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:52.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.481+0000 7f5f2b7fe640 1 --2- 172.21.15.90:0/3921169169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126c12df0 0x55f126c131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.481+0000 7f5f30c55640 1 --2- 172.21.15.90:0/3921169169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bc85f0 0x55f126bc8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.482+0000 7f5f2bfff640 1 -- 172.21.15.90:0/3921169169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126c12df0 msgr2=0x55f126c131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:52.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.482+0000 7f5f2bfff640 1 --2- 172.21.15.90:0/3921169169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126c12df0 0x55f126c131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.482+0000 7f5f2bfff640 1 -- 172.21.15.90:0/3921169169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bc85f0 msgr2=0x55f126bc8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:52.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.482+0000 7f5f2bfff640 1 --2- 172.21.15.90:0/3921169169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bc85f0 0x55f126bc8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.482+0000 7f5f2bfff640 1 -- 172.21.15.90:0/3921169169 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f126890850 con 0x55f126bf31b0 2024-09-10T23:15:52.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.482+0000 7f5f30c55640 1 --2- 172.21.15.90:0/3921169169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bc85f0 0x55f126bc8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:52.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.482+0000 7f5f2bfff640 1 --2- 172.21.15.90:0/3921169169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126bf31b0 0x55f126bcab20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c098420 tx=0x7f5f1c007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d410d1d5e8559c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:52.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.482+0000 7f5f11ffb640 1 -- 172.21.15.90:0/3921169169 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c06b120 con 0x55f126bf31b0 2024-09-10T23:15:52.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.482+0000 7f5f11ffb640 1 -- 172.21.15.90:0/3921169169 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f1c0629d0 con 0x55f126bf31b0 2024-09-10T23:15:52.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.482+0000 7f5f11ffb640 1 -- 172.21.15.90:0/3921169169 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0622d0 con 0x55f126bf31b0 2024-09-10T23:15:52.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.482+0000 7f5f35481740 1 -- 172.21.15.90:0/3921169169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126bf31b0 msgr2=0x55f126bcab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:52.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.482+0000 7f5f35481740 1 --2- 172.21.15.90:0/3921169169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126bf31b0 0x55f126bcab20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c098420 tx=0x7f5f1c007e50 comp rx=0 tx=0).stop 2024-09-10T23:15:52.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.482+0000 7f5f35481740 1 -- 172.21.15.90:0/3921169169 shutdown_connections 2024-09-10T23:15:52.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.482+0000 7f5f35481740 1 --2- 172.21.15.90:0/3921169169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bc85f0 0x55f126bc8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.482+0000 7f5f35481740 1 --2- 172.21.15.90:0/3921169169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126c12df0 0x55f126c131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.482+0000 7f5f35481740 1 --2- 172.21.15.90:0/3921169169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126bf31b0 0x55f126bcab20 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.482+0000 7f5f35481740 1 -- 172.21.15.90:0/3921169169 >> 172.21.15.90:0/3921169169 conn(0x55f126bc96a0 msgr2=0x55f126bcd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:52.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.483+0000 7f5f35481740 1 -- 172.21.15.90:0/3921169169 shutdown_connections 2024-09-10T23:15:52.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.483+0000 7f5f35481740 1 -- 172.21.15.90:0/3921169169 wait complete. 2024-09-10T23:15:52.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.483+0000 7f5f35481740 1 -- start start 2024-09-10T23:15:52.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.483+0000 7f5f35481740 1 Processor -- start 2024-09-10T23:15:52.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f35481740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126bf31b0 0x55f126c21d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f35481740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126c12df0 0x55f126c0aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f35481740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bf2490 0x55f126beec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f35481740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f12689f620 con 0x55f126c12df0 2024-09-10T23:15:52.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f35481740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f126ad45f0 con 0x55f126bf2490 2024-09-10T23:15:52.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f35481740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55f126bc7b30 con 0x55f126bf31b0 2024-09-10T23:15:52.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f35481740 10 client.0 _ll_register_callbacks cb 0x55f126ad80a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:15:52.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f2b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126c12df0 0x55f126c0aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f2b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126c12df0 0x55f126c0aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41436/0 (socket says 172.21.15.90:41436) 2024-09-10T23:15:52.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f2b7fe640 1 -- 172.21.15.90:0/646509425 learned_addr learned my addr 172.21.15.90:0/646509425 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:52.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f2bfff640 1 --2- 172.21.15.90:0/646509425 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126bf31b0 0x55f126c21d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f30c55640 1 --2- 172.21.15.90:0/646509425 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bf2490 0x55f126beec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f2b7fe640 1 -- 172.21.15.90:0/646509425 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126bf31b0 msgr2=0x55f126c21d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:52.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f2b7fe640 1 --2- 172.21.15.90:0/646509425 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126bf31b0 0x55f126c21d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f2b7fe640 1 -- 172.21.15.90:0/646509425 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bf2490 msgr2=0x55f126beec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:52.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f2b7fe640 1 --2- 172.21.15.90:0/646509425 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bf2490 0x55f126beec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f2b7fe640 1 -- 172.21.15.90:0/646509425 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1269076b0 con 0x55f126c12df0 2024-09-10T23:15:52.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f30c55640 1 --2- 172.21.15.90:0/646509425 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bf2490 0x55f126beec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:52.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.484+0000 7f5f2bfff640 1 --2- 172.21.15.90:0/646509425 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126bf31b0 0x55f126c21d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:52.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.485+0000 7f5f2b7fe640 1 --2- 172.21.15.90:0/646509425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126c12df0 0x55f126c0aaf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5f20003c30 tx=0x7f5f20005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88456c18ea64618d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:52.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.485+0000 7f5f0affd640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:15:52.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.485+0000 7f5f0affd640 1 -- 172.21.15.90:0/646509425 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2003cba0 con 0x55f126c12df0 2024-09-10T23:15:52.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.485+0000 7f5f0affd640 1 -- 172.21.15.90:0/646509425 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f5f2003cd40 con 0x55f126c12df0 2024-09-10T23:15:52.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.485+0000 7f5f35481740 1 -- 172.21.15.90:0/646509425 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f1c0629d0 con 0x55f126c12df0 2024-09-10T23:15:52.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.485+0000 7f5f0affd640 1 -- 172.21.15.90:0/646509425 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5f20049420 con 0x55f126c12df0 2024-09-10T23:15:52.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.485+0000 7f5f35481740 10 client.5394 fetch_fsmap learned FSMap version 20 2024-09-10T23:15:52.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.485+0000 7f5f35481740 1 -- 172.21.15.90:0/646509425 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55f126c0a2f0 con 0x55f126c12df0 2024-09-10T23:15:52.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.485+0000 7f5f0affd640 1 -- 172.21.15.90:0/646509425 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f1c0629d0 con 0x55f126c12df0 2024-09-10T23:15:52.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.485+0000 7f5f0affd640 1 -- 172.21.15.90:0/646509425 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7f5f200495c0 con 0x55f126c12df0 2024-09-10T23:15:52.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.485+0000 7f5f35481740 10 client.5394 fetch_fsmap finished waiting for FSMap version 20 2024-09-10T23:15:52.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.485+0000 7f5f35481740 10 client.5394 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:15:52.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.485+0000 7f5f35481740 20 client.5394 populate_metadata read hostname 'smithi090' 2024-09-10T23:15:52.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.485+0000 7f5f35481740 1 --2- 172.21.15.90:0/646509425 >> [v2:172.21.15.171:6835/4106111677,v1:172.21.15.171:6837/4106111677] conn(0x55f126c25770 0x55f126c25b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.485+0000 7f5f35481740 4 client.5394 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:15:52.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.485+0000 7f5f35481740 1 -- 172.21.15.90:0/646509425 --> [v2:172.21.15.171:6835/4106111677,v1:172.21.15.171:6837/4106111677] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f126b41770 con 0x55f126c25770 2024-09-10T23:15:52.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.485+0000 7f5f2bfff640 1 --2- 172.21.15.90:0/646509425 >> [v2:172.21.15.171:6835/4106111677,v1:172.21.15.171:6837/4106111677] conn(0x55f126c25770 0x55f126c25b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.486+0000 7f5f0affd640 10 client.5394 ms_handle_connect on v2:172.21.15.171:6835/4106111677 2024-09-10T23:15:52.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.486+0000 7f5f2bfff640 1 --2- 172.21.15.90:0/646509425 >> [v2:172.21.15.171:6835/4106111677,v1:172.21.15.171:6837/4106111677] conn(0x55f126c25770 0x55f126c25b50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a950759c1d738df5 server_cookie=746acdbcce28ef4b in_seq=0 out_seq=0 2024-09-10T23:15:52.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.487+0000 7f5f0affd640 1 -- 172.21.15.90:0/646509425 <== mds.0 v2:172.21.15.171:6835/4106111677 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f126b41770 con 0x55f126c25770 2024-09-10T23:15:52.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.487+0000 7f5f0affd640 10 client.5394 handle_command_reply: tid=0 2024-09-10T23:15:52.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.487+0000 7f5f35481740 1 client.5394 shutdown 2024-09-10T23:15:52.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.487+0000 7f5f35481740 1 -- 172.21.15.90:0/646509425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126c12df0 msgr2=0x55f126c0aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:52.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.487+0000 7f5f35481740 1 --2- 172.21.15.90:0/646509425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126c12df0 0x55f126c0aaf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5f20003c30 tx=0x7f5f20005f90 comp rx=0 tx=0).stop 2024-09-10T23:15:52.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.487+0000 7f5f35481740 1 -- 172.21.15.90:0/646509425 shutdown_connections 2024-09-10T23:15:52.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.487+0000 7f5f35481740 1 --2- 172.21.15.90:0/646509425 >> [v2:172.21.15.171:6835/4106111677,v1:172.21.15.171:6837/4106111677] conn(0x55f126c25770 0x55f126c25b50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.487+0000 7f5f35481740 1 --2- 172.21.15.90:0/646509425 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bf2490 0x55f126beec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.487+0000 7f5f35481740 1 --2- 172.21.15.90:0/646509425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126c12df0 0x55f126c0aaf0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.487+0000 7f5f35481740 1 --2- 172.21.15.90:0/646509425 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126bf31b0 0x55f126c21d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.487+0000 7f5f0affd640 0 client.5394 ms_handle_reset on v2:172.21.15.171:6835/4106111677 2024-09-10T23:15:52.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.487+0000 7f5f35481740 1 -- 172.21.15.90:0/646509425 >> 172.21.15.90:0/646509425 conn(0x55f126bc85f0 msgr2=0x55f126bccee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:52.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.487+0000 7f5f35481740 1 -- 172.21.15.90:0/646509425 shutdown_connections 2024-09-10T23:15:52.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.487+0000 7f5f35481740 1 -- 172.21.15.90:0/646509425 wait complete. 2024-09-10T23:15:52.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.487+0000 7f5f35481740 20 client.5394 trim_cache size 0 max 16384 2024-09-10T23:15:52.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.505+0000 7f5f35481740 1 Processor -- start 2024-09-10T23:15:52.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.505+0000 7f5f35481740 1 -- start start 2024-09-10T23:15:52.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f35481740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126bf2490 0x55f126bef750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f35481740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bf31b0 0x55f126befc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f35481740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126c12df0 0x55f126c35840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f35481740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c1f8ed0 con 0x55f126bf2490 2024-09-10T23:15:52.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f35481740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c1f8230 con 0x55f126bf31b0 2024-09-10T23:15:52.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f35481740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5f2c1f8880 con 0x55f126c12df0 2024-09-10T23:15:52.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f2bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126bf2490 0x55f126bef750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f2bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126bf2490 0x55f126bef750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41446/0 (socket says 172.21.15.90:41446) 2024-09-10T23:15:52.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f2bfff640 1 -- 172.21.15.90:0/1767803064 learned_addr learned my addr 172.21.15.90:0/1767803064 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:52.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f2b7fe640 1 --2- 172.21.15.90:0/1767803064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bf31b0 0x55f126befc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f30c55640 1 --2- 172.21.15.90:0/1767803064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126c12df0 0x55f126c35840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f2bfff640 1 -- 172.21.15.90:0/1767803064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126c12df0 msgr2=0x55f126c35840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:52.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f2bfff640 1 --2- 172.21.15.90:0/1767803064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126c12df0 0x55f126c35840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f2bfff640 1 -- 172.21.15.90:0/1767803064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bf31b0 msgr2=0x55f126befc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:52.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f2bfff640 1 --2- 172.21.15.90:0/1767803064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bf31b0 0x55f126befc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f2bfff640 1 -- 172.21.15.90:0/1767803064 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f126c24670 con 0x55f126bf2490 2024-09-10T23:15:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f2b7fe640 1 --2- 172.21.15.90:0/1767803064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bf31b0 0x55f126befc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f30c55640 1 --2- 172.21.15.90:0/1767803064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126c12df0 0x55f126c35840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f2bfff640 1 --2- 172.21.15.90:0/1767803064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126bf2490 0x55f126bef750 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c061f80 tx=0x7f5f1c0982d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d8cfe0db0efda8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f117fa640 1 -- 172.21.15.90:0/1767803064 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c05e170 con 0x55f126bf2490 2024-09-10T23:15:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f117fa640 1 -- 172.21.15.90:0/1767803064 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f1c0629d0 con 0x55f126bf2490 2024-09-10T23:15:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.506+0000 7f5f117fa640 1 -- 172.21.15.90:0/1767803064 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0692d0 con 0x55f126bf2490 2024-09-10T23:15:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.507+0000 7f5f35481740 1 -- 172.21.15.90:0/1767803064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126bf2490 msgr2=0x55f126bef750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.507+0000 7f5f35481740 1 --2- 172.21.15.90:0/1767803064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126bf2490 0x55f126bef750 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c061f80 tx=0x7f5f1c0982d0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.507+0000 7f5f35481740 1 -- 172.21.15.90:0/1767803064 shutdown_connections 2024-09-10T23:15:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.507+0000 7f5f35481740 1 --2- 172.21.15.90:0/1767803064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bf31b0 0x55f126befc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.507+0000 7f5f35481740 1 --2- 172.21.15.90:0/1767803064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126c12df0 0x55f126c35840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.507+0000 7f5f35481740 1 --2- 172.21.15.90:0/1767803064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126bf2490 0x55f126bef750 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.507+0000 7f5f35481740 1 -- 172.21.15.90:0/1767803064 >> 172.21.15.90:0/1767803064 conn(0x55f126bc85f0 msgr2=0x55f126bf1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:52.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.507+0000 7f5f35481740 1 -- 172.21.15.90:0/1767803064 shutdown_connections 2024-09-10T23:15:52.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.507+0000 7f5f35481740 1 -- 172.21.15.90:0/1767803064 wait complete. 2024-09-10T23:15:52.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.507+0000 7f5f35481740 1 -- start start 2024-09-10T23:15:52.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.508+0000 7f5f35481740 1 Processor -- start 2024-09-10T23:15:52.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.508+0000 7f5f35481740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bf2490 0x55f126bf7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.508+0000 7f5f35481740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126bf31b0 0x55f126c8de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.508+0000 7f5f35481740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126c12df0 0x55f126bef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.508+0000 7f5f35481740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f126c09470 con 0x55f126c12df0 2024-09-10T23:15:52.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.508+0000 7f5f35481740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f126bf18f0 con 0x55f126bf2490 2024-09-10T23:15:52.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.508+0000 7f5f35481740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55f126bf1050 con 0x55f126bf31b0 2024-09-10T23:15:52.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.508+0000 7f5f35481740 10 client.0 _ll_register_callbacks cb 0x7f5f20040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:15:52.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.508+0000 7f5f30c55640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126c12df0 0x55f126bef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.508+0000 7f5f30c55640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126c12df0 0x55f126bef6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41452/0 (socket says 172.21.15.90:41452) 2024-09-10T23:15:52.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.508+0000 7f5f30c55640 1 -- 172.21.15.90:0/2075924166 learned_addr learned my addr 172.21.15.90:0/2075924166 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:52.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f2b7fe640 1 --2- 172.21.15.90:0/2075924166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126bf31b0 0x55f126c8de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f2bfff640 1 --2- 172.21.15.90:0/2075924166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bf2490 0x55f126bf7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f30c55640 1 -- 172.21.15.90:0/2075924166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126bf31b0 msgr2=0x55f126c8de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:52.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f30c55640 1 --2- 172.21.15.90:0/2075924166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126bf31b0 0x55f126c8de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f30c55640 1 -- 172.21.15.90:0/2075924166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bf2490 msgr2=0x55f126bf7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:52.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f30c55640 1 --2- 172.21.15.90:0/2075924166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bf2490 0x55f126bf7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f30c55640 1 -- 172.21.15.90:0/2075924166 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f126bf22c0 con 0x55f126c12df0 2024-09-10T23:15:52.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f30c55640 1 --2- 172.21.15.90:0/2075924166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126c12df0 0x55f126bef6f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009f60 tx=0x7f5f24009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31dc9f0c4f2a158f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:52.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f0affd640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:15:52.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f0affd640 1 -- 172.21.15.90:0/2075924166 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f24004b20 con 0x55f126c12df0 2024-09-10T23:15:52.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f0affd640 1 -- 172.21.15.90:0/2075924166 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f5f24004cc0 con 0x55f126c12df0 2024-09-10T23:15:52.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f35481740 1 -- 172.21.15.90:0/2075924166 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f1c0629d0 con 0x55f126c12df0 2024-09-10T23:15:52.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f0affd640 1 -- 172.21.15.90:0/2075924166 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5f24025050 con 0x55f126c12df0 2024-09-10T23:15:52.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f35481740 10 client.5400 fetch_fsmap learned FSMap version 20 2024-09-10T23:15:52.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f35481740 1 -- 172.21.15.90:0/2075924166 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55f126c2b7c0 con 0x55f126c12df0 2024-09-10T23:15:52.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f0affd640 1 -- 172.21.15.90:0/2075924166 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f1c0629d0 con 0x55f126c12df0 2024-09-10T23:15:52.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f0affd640 1 -- 172.21.15.90:0/2075924166 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7f5f24028020 con 0x55f126c12df0 2024-09-10T23:15:52.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.509+0000 7f5f35481740 10 client.5400 fetch_fsmap finished waiting for FSMap version 20 2024-09-10T23:15:52.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.510+0000 7f5f35481740 10 client.5400 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:15:52.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.510+0000 7f5f35481740 20 client.5400 populate_metadata read hostname 'smithi090' 2024-09-10T23:15:52.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.510+0000 7f5f35481740 1 --2- 172.21.15.90:0/2075924166 >> [v2:172.21.15.171:6835/4106111677,v1:172.21.15.171:6837/4106111677] conn(0x55f126c35df0 0x55f126c973e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.510+0000 7f5f35481740 4 client.5400 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:15:52.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.510+0000 7f5f35481740 1 -- 172.21.15.90:0/2075924166 --> [v2:172.21.15.171:6835/4106111677,v1:172.21.15.171:6837/4106111677] -- command(tid 0: {"prefix": "status"}) -- 0x55f126b3d220 con 0x55f126c35df0 2024-09-10T23:15:52.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.510+0000 7f5f2bfff640 1 --2- 172.21.15.90:0/2075924166 >> [v2:172.21.15.171:6835/4106111677,v1:172.21.15.171:6837/4106111677] conn(0x55f126c35df0 0x55f126c973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.510+0000 7f5f2bfff640 1 --2- 172.21.15.90:0/2075924166 >> [v2:172.21.15.171:6835/4106111677,v1:172.21.15.171:6837/4106111677] conn(0x55f126c35df0 0x55f126c973e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=330239a962271f1e server_cookie=6ca0b987a567af56 in_seq=0 out_seq=0 2024-09-10T23:15:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.510+0000 7f5f0affd640 10 client.5400 ms_handle_connect on v2:172.21.15.171:6835/4106111677 2024-09-10T23:15:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.510+0000 7f5f0affd640 1 -- 172.21.15.90:0/2075924166 <== mds.0 v2:172.21.15.171:6835/4106111677 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55f126b3d220 con 0x55f126c35df0 2024-09-10T23:15:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.510+0000 7f5f0affd640 10 client.5400 handle_command_reply: tid=0 2024-09-10T23:15:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.510+0000 7f5f35481740 1 client.5400 shutdown 2024-09-10T23:15:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f35481740 1 -- 172.21.15.90:0/2075924166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126c12df0 msgr2=0x55f126bef6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f35481740 1 --2- 172.21.15.90:0/2075924166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126c12df0 0x55f126bef6f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009f60 tx=0x7f5f24009f90 comp rx=0 tx=0).stop 2024-09-10T23:15:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f35481740 1 -- 172.21.15.90:0/2075924166 shutdown_connections 2024-09-10T23:15:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f35481740 1 --2- 172.21.15.90:0/2075924166 >> [v2:172.21.15.171:6835/4106111677,v1:172.21.15.171:6837/4106111677] conn(0x55f126c35df0 0x55f126c973e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f35481740 1 --2- 172.21.15.90:0/2075924166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f126c12df0 0x55f126bef6f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f35481740 1 --2- 172.21.15.90:0/2075924166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f126bf31b0 0x55f126c8de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f35481740 1 --2- 172.21.15.90:0/2075924166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f126bf2490 0x55f126bf7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f0affd640 0 client.5400 ms_handle_reset on v2:172.21.15.171:6835/4106111677 2024-09-10T23:15:52.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f35481740 1 -- 172.21.15.90:0/2075924166 >> 172.21.15.90:0/2075924166 conn(0x55f126bc85f0 msgr2=0x55f126c08850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:52.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f35481740 1 -- 172.21.15.90:0/2075924166 shutdown_connections 2024-09-10T23:15:52.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f35481740 1 -- 172.21.15.90:0/2075924166 wait complete. 2024-09-10T23:15:52.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f35481740 20 client.5400 trim_cache size 0 max 16384 2024-09-10T23:15:52.518 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:15:52.518 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd", 2024-09-10T23:15:52.518 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2024-09-10T23:15:52.518 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 5250, 2024-09-10T23:15:52.518 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-09-10T23:15:52.518 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-09-10T23:15:52.518 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2024-09-10T23:15:52.519 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 8.9996120089999998, 2024-09-10T23:15:52.519 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 20, 2024-09-10T23:15:52.519 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 46, 2024-09-10T23:15:52.519 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 46, 2024-09-10T23:15:52.519 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 13.744584351 2024-09-10T23:15:52.519 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:15:52.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f326b8640 1 -- 172.21.15.90:0/3482201356 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5f18077f70 msgr2=0x7f5f1807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:52.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f326b8640 1 --2- 172.21.15.90:0/3482201356 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5f18077f70 0x7f5f1807a430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5f20034000 tx=0x7f5f20004730 comp rx=0 tx=0).stop 2024-09-10T23:15:52.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f326b8640 1 -- 172.21.15.90:0/3482201356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f2c0b3a00 msgr2=0x7f5f2c1f1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:52.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f326b8640 1 --2- 172.21.15.90:0/3482201356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f2c0b3a00 0x7f5f2c1f1f30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00c730 tx=0x7f5f1c00cbf0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f326b8640 1 -- 172.21.15.90:0/3482201356 shutdown_connections 2024-09-10T23:15:52.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f326b8640 1 --2- 172.21.15.90:0/3482201356 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5f18077f70 0x7f5f1807a430 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f326b8640 1 --2- 172.21.15.90:0/3482201356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f2c0d2470 0x7f5f2c0cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f326b8640 1 --2- 172.21.15.90:0/3482201356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f2c0d1c70 0x7f5f2c0b9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f326b8640 1 --2- 172.21.15.90:0/3482201356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f2c0b3a00 0x7f5f2c1f1f30 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f326b8640 1 -- 172.21.15.90:0/3482201356 >> 172.21.15.90:0/3482201356 conn(0x7f5f2c09d2a0 msgr2=0x7f5f2c0d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:52.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f326b8640 1 -- 172.21.15.90:0/3482201356 shutdown_connections 2024-09-10T23:15:52.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.511+0000 7f5f326b8640 1 -- 172.21.15.90:0/3482201356 wait complete. 2024-09-10T23:15:52.523 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:15:52.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.624+0000 7f2a9fd9c640 1 -- 172.21.15.90:0/1403226648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a980d2470 msgr2=0x7f2a980b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:52.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.624+0000 7f2a9fd9c640 1 --2- 172.21.15.90:0/1403226648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a980d2470 0x7f2a980b3490 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2a94005fd0 tx=0x7f2a9402a5d0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.624+0000 7f2a9fd9c640 1 -- 172.21.15.90:0/1403226648 shutdown_connections 2024-09-10T23:15:52.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.624+0000 7f2a9fd9c640 1 --2- 172.21.15.90:0/1403226648 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a980b3a00 0x7f2a980b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.624+0000 7f2a9fd9c640 1 --2- 172.21.15.90:0/1403226648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a980d2470 0x7f2a980b3490 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.624+0000 7f2a9fd9c640 1 -- 172.21.15.90:0/1403226648 >> 172.21.15.90:0/1403226648 conn(0x7f2a9809d2a0 msgr2=0x7f2a980d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:52.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.624+0000 7f2a9fd9c640 1 -- 172.21.15.90:0/1403226648 shutdown_connections 2024-09-10T23:15:52.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.624+0000 7f2a9fd9c640 1 -- 172.21.15.90:0/1403226648 wait complete. 2024-09-10T23:15:52.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.625+0000 7f2a9fd9c640 1 Processor -- start 2024-09-10T23:15:52.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.625+0000 7f2a9fd9c640 1 -- start start 2024-09-10T23:15:52.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9fd9c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a980b3a00 0x7f2a980b99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9fd9c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a980d1c70 0x7f2a981f5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9fd9c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a980d2470 0x7f2a980cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9fd9c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2a980b4570 con 0x7f2a980b3a00 2024-09-10T23:15:52.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9fd9c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2a980b43f0 con 0x7f2a980d1c70 2024-09-10T23:15:52.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9fd9c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2a980b46f0 con 0x7f2a980d2470 2024-09-10T23:15:52.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9db38640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a980b3a00 0x7f2a980b99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9db38640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a980b3a00 0x7f2a980b99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41456/0 (socket says 172.21.15.90:41456) 2024-09-10T23:15:52.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9db38640 1 -- 172.21.15.90:0/398270657 learned_addr learned my addr 172.21.15.90:0/398270657 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:52.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9d337640 1 --2- 172.21.15.90:0/398270657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a980d1c70 0x7f2a981f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9e339640 1 --2- 172.21.15.90:0/398270657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a980d2470 0x7f2a980cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9db38640 1 -- 172.21.15.90:0/398270657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a980d2470 msgr2=0x7f2a980cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:52.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9db38640 1 --2- 172.21.15.90:0/398270657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a980d2470 0x7f2a980cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9db38640 1 -- 172.21.15.90:0/398270657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a980d1c70 msgr2=0x7f2a981f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:52.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9db38640 1 --2- 172.21.15.90:0/398270657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a980d1c70 0x7f2a981f5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9db38640 1 -- 172.21.15.90:0/398270657 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a981f5a50 con 0x7f2a980b3a00 2024-09-10T23:15:52.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9e339640 1 --2- 172.21.15.90:0/398270657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a980d2470 0x7f2a980cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:52.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.626+0000 7f2a9db38640 1 --2- 172.21.15.90:0/398270657 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a980b3a00 0x7f2a980b99f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2a94006010 tx=0x7f2a940038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:52.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.627+0000 7f2a8e7fc640 1 -- 172.21.15.90:0/398270657 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9403e030 con 0x7f2a980b3a00 2024-09-10T23:15:52.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.627+0000 7f2a8e7fc640 1 -- 172.21.15.90:0/398270657 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a94003ca0 con 0x7f2a980b3a00 2024-09-10T23:15:52.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.627+0000 7f2a9fd9c640 1 -- 172.21.15.90:0/398270657 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a980b8c30 con 0x7f2a980b3a00 2024-09-10T23:15:52.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.627+0000 7f2a8e7fc640 1 -- 172.21.15.90:0/398270657 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a94035040 con 0x7f2a980b3a00 2024-09-10T23:15:52.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.627+0000 7f2a9fd9c640 1 -- 172.21.15.90:0/398270657 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a980b91f0 con 0x7f2a980b3a00 2024-09-10T23:15:52.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.628+0000 7f2a9fd9c640 1 -- 172.21.15.90:0/398270657 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a980b41c0 con 0x7f2a980b3a00 2024-09-10T23:15:52.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.628+0000 7f2a8e7fc640 1 -- 172.21.15.90:0/398270657 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2a940049e0 con 0x7f2a980b3a00 2024-09-10T23:15:52.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.629+0000 7f2a8e7fc640 1 --2- 172.21.15.90:0/398270657 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a7c077f70 0x7f2a7c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:52.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.629+0000 7f2a8e7fc640 1 -- 172.21.15.90:0/398270657 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f2a940ba3a0 con 0x7f2a980b3a00 2024-09-10T23:15:52.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.629+0000 7f2a9d337640 1 --2- 172.21.15.90:0/398270657 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a7c077f70 0x7f2a7c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:52.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.630+0000 7f2a9d337640 1 --2- 172.21.15.90:0/398270657 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a7c077f70 0x7f2a7c07a430 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2a980c76d0 tx=0x7f2a88009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:52.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.633+0000 7f2a8e7fc640 1 -- 172.21.15.90:0/398270657 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2a980b41c0 con 0x7f2a980b3a00 2024-09-10T23:15:52.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.841+0000 7f2a9fd9c640 1 -- 172.21.15.90:0/398270657 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2a980b3eb0 con 0x7f2a980b3a00 2024-09-10T23:15:52.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.842+0000 7f2a8e7fc640 1 -- 172.21.15.90:0/398270657 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+73 (secure 0 0 0) 0x7f2a940828c0 con 0x7f2a980b3a00 2024-09-10T23:15:52.843 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:15:52.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.844+0000 7f2a9fd9c640 1 -- 172.21.15.90:0/398270657 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a7c077f70 msgr2=0x7f2a7c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:52.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.844+0000 7f2a9fd9c640 1 --2- 172.21.15.90:0/398270657 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a7c077f70 0x7f2a7c07a430 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2a980c76d0 tx=0x7f2a88009040 comp rx=0 tx=0).stop 2024-09-10T23:15:52.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.844+0000 7f2a9fd9c640 1 -- 172.21.15.90:0/398270657 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a980b3a00 msgr2=0x7f2a980b99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:52.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.844+0000 7f2a9fd9c640 1 --2- 172.21.15.90:0/398270657 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a980b3a00 0x7f2a980b99f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2a94006010 tx=0x7f2a940038a0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.844+0000 7f2a9fd9c640 1 -- 172.21.15.90:0/398270657 shutdown_connections 2024-09-10T23:15:52.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.844+0000 7f2a9fd9c640 1 --2- 172.21.15.90:0/398270657 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a7c077f70 0x7f2a7c07a430 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.844+0000 7f2a9fd9c640 1 --2- 172.21.15.90:0/398270657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a980d1c70 0x7f2a981f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.844+0000 7f2a9fd9c640 1 --2- 172.21.15.90:0/398270657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a980d2470 0x7f2a980cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.844+0000 7f2a9fd9c640 1 --2- 172.21.15.90:0/398270657 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a980b3a00 0x7f2a980b99f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:52.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.844+0000 7f2a9fd9c640 1 -- 172.21.15.90:0/398270657 >> 172.21.15.90:0/398270657 conn(0x7f2a9809d2a0 msgr2=0x7f2a980b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:52.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.844+0000 7f2a9fd9c640 1 -- 172.21.15.90:0/398270657 shutdown_connections 2024-09-10T23:15:52.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:52.844+0000 7f2a9fd9c640 1 -- 172.21.15.90:0/398270657 wait complete. 2024-09-10T23:15:52.856 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:15:52.856 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:15:52.856 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2024-09-10T23:15:52.856 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:15:52.856 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:15:52.857 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:15:52.857 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:15:52.857 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:15:52.857 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:15:52.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:52.857 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2024-09-10T23:15:52.873 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:15:52.873 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:15:52.873 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:15:52.873 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:52.873 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-10T23:15:52.873 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:52.874 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:15:52.874 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:52.874 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2024-09-10T23:15:52.874 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:15:52.874 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:52.874 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2024-09-10T23:15:52.874 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:15:52.874 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:52.874 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:15:52.874 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:52.875 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:15:52.875 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42695sec preferred_lft 42695sec 2024-09-10T23:15:52.875 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link noprefixroute 2024-09-10T23:15:52.875 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:52.875 INFO:teuthology.orchestra.run.smithi090.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:15:52.875 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:52.875 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:15:52.875 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:52.875 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::882a:a9ff:fefc:893f/64 scope link 2024-09-10T23:15:52.875 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:52.875 INFO:teuthology.orchestra.run.smithi090.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:15:52.875 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 76:ad:51:1a:2a:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:15:52.876 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::74ad:51ff:fe1a:2a60/64 scope link 2024-09-10T23:15:52.876 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:52.876 INFO:teuthology.orchestra.run.smithi090.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:15:52.876 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:15:52.876 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::3414:abff:fe49:366c/64 scope link 2024-09-10T23:15:52.876 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:52.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:52.876 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:15:52.937 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-09-10T23:15:52.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:52.939 DEBUG:teuthology.orchestra.run.smithi090:> route 2024-09-10T23:15:52.995 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2024-09-10T23:15:52.995 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:15:52.995 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:15:52.995 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:15:52.995 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:15:52.996 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:15:52.996 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:15:52.996 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:15:52.996 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:15:52.996 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:15:52.996 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:15:53.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:15:53.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:15:53.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:53.122 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-10T23:15:53.137 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:15:53.137 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:15:53.137 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:15:53.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:53.138 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2024-09-10T23:15:53.203 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:15:53.203 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:15:53.258 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:15:53.258 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:15:53.258 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:15:53.314 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:15:53.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:53.314 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:15:53.397 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:15:53.397 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:15:53.397 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:15:53.405 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:15:53.406 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:15:53.406 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:15:53.406 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:15:53.406 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:15:53.412 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:15:53.412 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:15:53.412 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:15:53.412 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:15:53.412 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:15:53.412 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:15:53.412 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:15:53.412 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:15:53.413 INFO:teuthology.orchestra.run.smithi090.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T23:15:53.413 INFO:teuthology.orchestra.run.smithi090.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:15:53.413 INFO:teuthology.orchestra.run.smithi090.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:15:53.413 INFO:teuthology.orchestra.run.smithi090.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:15:53.413 INFO:teuthology.orchestra.run.smithi090.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:15:53.414 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:15:53.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:53.415 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:15:53.480 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:15:53.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:15:53.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:15:53.587 INFO:teuthology.orchestra.run.smithi090.stdout:client5143 2024-09-10T23:15:53.588 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:53.588 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:53.604 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:15:53.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.743+0000 7fe48412c640 1 -- 172.21.15.90:0/2749696470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe47c15ae10 msgr2=0x7fe47c0b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:53.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.743+0000 7fe48412c640 1 --2- 172.21.15.90:0/2749696470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe47c15ae10 0x7fe47c0b1d90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe47c070620 tx=0x7fe47402a560 comp rx=0 tx=0).stop 2024-09-10T23:15:53.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.743+0000 7fe48412c640 1 -- 172.21.15.90:0/2749696470 shutdown_connections 2024-09-10T23:15:53.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.743+0000 7fe48412c640 1 --2- 172.21.15.90:0/2749696470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe47c15ae10 0x7fe47c0b1d90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:53.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.743+0000 7fe48412c640 1 --2- 172.21.15.90:0/2749696470 >> v2:172.21.15.171:3300/0 conn(0x7fe47c0ca960 0x7fe47c0b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:53.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.743+0000 7fe48412c640 1 --2- 172.21.15.90:0/2749696470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe47c15aa30 0x7fe47c0ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:53.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.743+0000 7fe48412c640 1 -- 172.21.15.90:0/2749696470 >> 172.21.15.90:0/2749696470 conn(0x7fe47c0cc850 msgr2=0x7fe47c0ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:53.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.743+0000 7fe48412c640 1 -- 172.21.15.90:0/2749696470 shutdown_connections 2024-09-10T23:15:53.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.743+0000 7fe48412c640 1 -- 172.21.15.90:0/2749696470 wait complete. 2024-09-10T23:15:53.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.744+0000 7fe48412c640 1 Processor -- start 2024-09-10T23:15:53.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.744+0000 7fe48412c640 1 -- start start 2024-09-10T23:15:53.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.745+0000 7fe48412c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe47c15aa30 0x7fe47c14b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:53.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.745+0000 7fe48412c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe47c15ae10 0x7fe47c0c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:53.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.745+0000 7fe48412c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe47c15dde0 0x7fe47c0c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:53.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.745+0000 7fe48412c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe47c0ce170 con 0x7fe47c15aa30 2024-09-10T23:15:53.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.745+0000 7fe48412c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe47c0cdff0 con 0x7fe47c15ae10 2024-09-10T23:15:53.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.745+0000 7fe48412c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe47c0ce2f0 con 0x7fe47c15dde0 2024-09-10T23:15:53.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.745+0000 7fe481ec8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe47c15aa30 0x7fe47c14b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:53.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.745+0000 7fe481ec8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe47c15aa30 0x7fe47c14b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41476/0 (socket says 172.21.15.90:41476) 2024-09-10T23:15:53.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.745+0000 7fe481ec8640 1 -- 172.21.15.90:0/1854691998 learned_addr learned my addr 172.21.15.90:0/1854691998 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:53.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.745+0000 7fe4816c7640 1 --2- 172.21.15.90:0/1854691998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe47c15ae10 0x7fe47c0c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:53.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.745+0000 7fe4826c9640 1 --2- 172.21.15.90:0/1854691998 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe47c15dde0 0x7fe47c0c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:53.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.745+0000 7fe481ec8640 1 -- 172.21.15.90:0/1854691998 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe47c15dde0 msgr2=0x7fe47c0c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:53.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.745+0000 7fe481ec8640 1 --2- 172.21.15.90:0/1854691998 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe47c15dde0 0x7fe47c0c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:53.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.745+0000 7fe481ec8640 1 -- 172.21.15.90:0/1854691998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe47c15ae10 msgr2=0x7fe47c0c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:53.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.745+0000 7fe481ec8640 1 --2- 172.21.15.90:0/1854691998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe47c15ae10 0x7fe47c0c3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:53.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.745+0000 7fe481ec8640 1 -- 172.21.15.90:0/1854691998 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47c0c4690 con 0x7fe47c15aa30 2024-09-10T23:15:53.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.746+0000 7fe481ec8640 1 --2- 172.21.15.90:0/1854691998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe47c15aa30 0x7fe47c14b440 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00eab0 tx=0x7fe46c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:53.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.746+0000 7fe47a7fc640 1 -- 172.21.15.90:0/1854691998 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c00ce40 con 0x7fe47c15aa30 2024-09-10T23:15:53.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.746+0000 7fe47a7fc640 1 -- 172.21.15.90:0/1854691998 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe46c011560 con 0x7fe47c15aa30 2024-09-10T23:15:53.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.746+0000 7fe48412c640 1 -- 172.21.15.90:0/1854691998 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe47c0c4970 con 0x7fe47c15aa30 2024-09-10T23:15:53.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.746+0000 7fe47a7fc640 1 -- 172.21.15.90:0/1854691998 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c011930 con 0x7fe47c15aa30 2024-09-10T23:15:53.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.746+0000 7fe48412c640 1 -- 172.21.15.90:0/1854691998 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe47c14c100 con 0x7fe47c15aa30 2024-09-10T23:15:53.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.747+0000 7fe48412c640 1 -- 172.21.15.90:0/1854691998 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe47c0ca420 con 0x7fe47c15aa30 2024-09-10T23:15:53.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.747+0000 7fe47a7fc640 1 -- 172.21.15.90:0/1854691998 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe46c022030 con 0x7fe47c15aa30 2024-09-10T23:15:53.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.748+0000 7fe47a7fc640 1 --2- 172.21.15.90:0/1854691998 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe468077f70 0x7fe46807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:53.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.748+0000 7fe47a7fc640 1 -- 172.21.15.90:0/1854691998 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fe46c09a670 con 0x7fe47c15aa30 2024-09-10T23:15:53.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.748+0000 7fe4816c7640 1 --2- 172.21.15.90:0/1854691998 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe468077f70 0x7fe46807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:53.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.749+0000 7fe4816c7640 1 --2- 172.21.15.90:0/1854691998 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe468077f70 0x7fe46807a430 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe470005fd0 tx=0x7fe470005850 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:53.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.752+0000 7fe47a7fc640 1 -- 172.21.15.90:0/1854691998 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe46c016030 con 0x7fe47c15aa30 2024-09-10T23:15:53.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.963+0000 7fe48412c640 1 -- 172.21.15.90:0/1854691998 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe47c1508a0 con 0x7fe47c15aa30 2024-09-10T23:15:53.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.963+0000 7fe47a7fc640 1 -- 172.21.15.90:0/1854691998 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+73 (secure 0 0 0) 0x7fe46c063200 con 0x7fe47c15aa30 2024-09-10T23:15:53.964 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:15:53.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.965+0000 7fe48412c640 1 -- 172.21.15.90:0/1854691998 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe468077f70 msgr2=0x7fe46807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:53.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.965+0000 7fe48412c640 1 --2- 172.21.15.90:0/1854691998 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe468077f70 0x7fe46807a430 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe470005fd0 tx=0x7fe470005850 comp rx=0 tx=0).stop 2024-09-10T23:15:53.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.965+0000 7fe48412c640 1 -- 172.21.15.90:0/1854691998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe47c15aa30 msgr2=0x7fe47c14b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:53.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.965+0000 7fe48412c640 1 --2- 172.21.15.90:0/1854691998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe47c15aa30 0x7fe47c14b440 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00eab0 tx=0x7fe46c00ef70 comp rx=0 tx=0).stop 2024-09-10T23:15:53.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.965+0000 7fe48412c640 1 -- 172.21.15.90:0/1854691998 shutdown_connections 2024-09-10T23:15:53.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.965+0000 7fe48412c640 1 --2- 172.21.15.90:0/1854691998 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe468077f70 0x7fe46807a430 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:53.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.965+0000 7fe48412c640 1 --2- 172.21.15.90:0/1854691998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe47c15ae10 0x7fe47c0c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:53.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.965+0000 7fe48412c640 1 --2- 172.21.15.90:0/1854691998 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe47c15dde0 0x7fe47c0c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:53.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.965+0000 7fe48412c640 1 --2- 172.21.15.90:0/1854691998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe47c15aa30 0x7fe47c14b440 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:53.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.965+0000 7fe48412c640 1 -- 172.21.15.90:0/1854691998 >> 172.21.15.90:0/1854691998 conn(0x7fe47c0cc850 msgr2=0x7fe47c14f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:53.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.965+0000 7fe48412c640 1 -- 172.21.15.90:0/1854691998 shutdown_connections 2024-09-10T23:15:53.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:53.965+0000 7fe48412c640 1 -- 172.21.15.90:0/1854691998 wait complete. 2024-09-10T23:15:53.978 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:15:53.978 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:15:53.978 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-09-10T23:15:53.978 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T23:15:53.978 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T23:15:53.978 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:15:53.978 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:15:53.978 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:15:53.978 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:15:53.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:53.979 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-09-10T23:15:54.003 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:15:54.003 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:15:54.004 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:15:54.004 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:54.004 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-09-10T23:15:54.004 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:54.004 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:15:54.004 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:54.005 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-09-10T23:15:54.005 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:15:54.005 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:54.005 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-09-10T23:15:54.005 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:15:54.006 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:54.006 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:15:54.006 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:54.006 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:15:54.006 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42677sec preferred_lft 42677sec 2024-09-10T23:15:54.006 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link noprefixroute 2024-09-10T23:15:54.007 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:54.007 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:15:54.007 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:54.007 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:15:54.007 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:54.007 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::c18:12ff:fe41:788b/64 scope link 2024-09-10T23:15:54.007 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:54.008 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:15:54.008 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:15:54.008 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a0e4:c6ff:fe48:8d44/64 scope link 2024-09-10T23:15:54.008 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:54.008 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:15:54.009 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a6:c9:8b:0f:78:86 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:15:54.009 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a4c9:8bff:fe0f:7886/64 scope link 2024-09-10T23:15:54.009 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:54.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:54.010 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:15:54.076 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-09-10T23:15:54.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:54.078 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-09-10T23:15:54.139 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-09-10T23:15:54.139 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:15:54.139 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:15:54.139 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:15:54.139 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:15:54.140 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:15:54.140 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:15:54.140 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:15:54.140 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:15:54.140 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:15:54.140 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:15:54.233 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:15:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:15:54.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:15:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:15:54.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:54.273 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-09-10T23:15:54.289 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T23:15:54.289 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T23:15:54.289 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:15:54.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:54.289 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-09-10T23:15:54.356 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:15:54.356 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T23:15:54.412 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:15:54.412 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:15:54.412 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:15:54.470 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:15:54.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:54.470 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:15:54.554 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:15:54.554 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:15:54.555 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:15:54.563 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:15:54.563 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:15:54.563 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:15:54.563 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:15:54.564 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:15:54.572 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:15:54.572 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:15:54.572 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:15:54.572 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:15:54.572 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:15:54.572 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:15:54.572 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:15:54.572 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:15:54.573 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T23:15:54.573 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:15:54.573 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:15:54.573 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:15:54.573 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:15:54.574 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:15:54.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:54.575 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:15:54.599 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:15:54.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:15:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:15:54.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:15:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:15:54.696 INFO:teuthology.orchestra.run.smithi171.stdout:client4955 2024-09-10T23:15:54.696 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:15:54.696 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:54.712 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:15:54.713 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:15:54.735 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:15:54.760 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:15:54.772 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:15:54.837 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:15:54.837 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:15:54.837 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:54.837 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:54.868 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:54.868 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:54.925 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:15:55.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.069+0000 7f14e9440640 1 -- 172.21.15.90:0/161352979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14e415c0c0 msgr2=0x7f14e40d2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.069+0000 7f14e9440640 1 --2- 172.21.15.90:0/161352979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14e415c0c0 0x7f14e40d2960 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f14e4069850 tx=0x7f14dc02a560 comp rx=0 tx=0).stop 2024-09-10T23:15:55.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.069+0000 7f14e9440640 1 -- 172.21.15.90:0/161352979 shutdown_connections 2024-09-10T23:15:55.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.069+0000 7f14e9440640 1 --2- 172.21.15.90:0/161352979 >> v2:172.21.15.171:3300/0 conn(0x7f14e40d0560 0x7f14e40b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.069+0000 7f14e9440640 1 --2- 172.21.15.90:0/161352979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14e415c0c0 0x7f14e40d2960 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.069+0000 7f14e9440640 1 -- 172.21.15.90:0/161352979 >> 172.21.15.90:0/161352979 conn(0x7f14e40d1dd0 msgr2=0x7f14e40d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:55.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.069+0000 7f14e9440640 1 -- 172.21.15.90:0/161352979 shutdown_connections 2024-09-10T23:15:55.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.069+0000 7f14e9440640 1 -- 172.21.15.90:0/161352979 wait complete. 2024-09-10T23:15:55.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.070+0000 7f14e9440640 1 Processor -- start 2024-09-10T23:15:55.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.070+0000 7f14e9440640 1 -- start start 2024-09-10T23:15:55.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.071+0000 7f14e9440640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14e40cf1f0 0x7f14e415ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.071+0000 7f14e9440640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14e40d0560 0x7f14e414a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.071+0000 7f14e9440640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14e415c0c0 0x7f14e41f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.071+0000 7f14e9440640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f14e40b54f0 con 0x7f14e40cf1f0 2024-09-10T23:15:55.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.071+0000 7f14e9440640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f14e40b5370 con 0x7f14e415c0c0 2024-09-10T23:15:55.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.071+0000 7f14e9440640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f14e40b5670 con 0x7f14e40d0560 2024-09-10T23:15:55.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.071+0000 7f14e2ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14e40cf1f0 0x7f14e415ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.071+0000 7f14e2ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14e40cf1f0 0x7f14e415ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41490/0 (socket says 172.21.15.90:41490) 2024-09-10T23:15:55.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.071+0000 7f14e2ffd640 1 -- 172.21.15.90:0/2471305936 learned_addr learned my addr 172.21.15.90:0/2471305936 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:55.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.071+0000 7f14e37fe640 1 --2- 172.21.15.90:0/2471305936 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14e415c0c0 0x7f14e41f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.071+0000 7f14e27fc640 1 --2- 172.21.15.90:0/2471305936 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14e40d0560 0x7f14e414a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.071+0000 7f14e2ffd640 1 -- 172.21.15.90:0/2471305936 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14e40d0560 msgr2=0x7f14e414a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.071+0000 7f14e2ffd640 1 --2- 172.21.15.90:0/2471305936 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14e40d0560 0x7f14e414a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.071+0000 7f14e2ffd640 1 -- 172.21.15.90:0/2471305936 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14e415c0c0 msgr2=0x7f14e41f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.071+0000 7f14e2ffd640 1 --2- 172.21.15.90:0/2471305936 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14e415c0c0 0x7f14e41f60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.071+0000 7f14e2ffd640 1 -- 172.21.15.90:0/2471305936 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e414a710 con 0x7f14e40cf1f0 2024-09-10T23:15:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.071+0000 7f14e2ffd640 1 --2- 172.21.15.90:0/2471305936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14e40cf1f0 0x7f14e415ef30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0099d0 tx=0x7f14dc005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.072+0000 7f14db7fe640 1 -- 172.21.15.90:0/2471305936 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc03f070 con 0x7f14e40cf1f0 2024-09-10T23:15:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.072+0000 7f14db7fe640 1 -- 172.21.15.90:0/2471305936 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14dc004340 con 0x7f14e40cf1f0 2024-09-10T23:15:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.072+0000 7f14e9440640 1 -- 172.21.15.90:0/2471305936 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e40c5900 con 0x7f14e40cf1f0 2024-09-10T23:15:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.072+0000 7f14db7fe640 1 -- 172.21.15.90:0/2471305936 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc031bb0 con 0x7f14e40cf1f0 2024-09-10T23:15:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.072+0000 7f14e9440640 1 -- 172.21.15.90:0/2471305936 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e40c5ea0 con 0x7f14e40cf1f0 2024-09-10T23:15:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.073+0000 7f14e9440640 1 -- 172.21.15.90:0/2471305936 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e40b5ba0 con 0x7f14e40cf1f0 2024-09-10T23:15:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.073+0000 7f14db7fe640 1 -- 172.21.15.90:0/2471305936 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f14dc0047a0 con 0x7f14e40cf1f0 2024-09-10T23:15:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.074+0000 7f14db7fe640 1 --2- 172.21.15.90:0/2471305936 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14c4077f70 0x7f14c407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.074+0000 7f14db7fe640 1 -- 172.21.15.90:0/2471305936 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f14dc0baed0 con 0x7f14e40cf1f0 2024-09-10T23:15:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.074+0000 7f14e27fc640 1 --2- 172.21.15.90:0/2471305936 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14c4077f70 0x7f14c407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.074+0000 7f14e27fc640 1 --2- 172.21.15.90:0/2471305936 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14c4077f70 0x7f14c407a430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f14e40c8b10 tx=0x7f14cc009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:55.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.078+0000 7f14db7fe640 1 -- 172.21.15.90:0/2471305936 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f14dc031770 con 0x7f14e40cf1f0 2024-09-10T23:15:55.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.262+0000 7f14e9440640 1 -- 172.21.15.90:0/2471305936 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f14e40ce5c0 con 0x7f14e40cf1f0 2024-09-10T23:15:55.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.262+0000 7f14db7fe640 1 -- 172.21.15.90:0/2471305936 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) ==== 80+0+0 (secure 0 0 0) 0x7f14dc083390 con 0x7f14e40cf1f0 2024-09-10T23:15:55.263 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:15:55.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.264+0000 7f14e9440640 1 -- 172.21.15.90:0/2471305936 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14c4077f70 msgr2=0x7f14c407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.264+0000 7f14e9440640 1 --2- 172.21.15.90:0/2471305936 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14c4077f70 0x7f14c407a430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f14e40c8b10 tx=0x7f14cc009040 comp rx=0 tx=0).stop 2024-09-10T23:15:55.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.264+0000 7f14e9440640 1 -- 172.21.15.90:0/2471305936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14e40cf1f0 msgr2=0x7f14e415ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.264+0000 7f14e9440640 1 --2- 172.21.15.90:0/2471305936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14e40cf1f0 0x7f14e415ef30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0099d0 tx=0x7f14dc005270 comp rx=0 tx=0).stop 2024-09-10T23:15:55.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.264+0000 7f14e9440640 1 -- 172.21.15.90:0/2471305936 shutdown_connections 2024-09-10T23:15:55.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.264+0000 7f14e9440640 1 --2- 172.21.15.90:0/2471305936 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14c4077f70 0x7f14c407a430 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.264+0000 7f14e9440640 1 --2- 172.21.15.90:0/2471305936 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14e415c0c0 0x7f14e41f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.264+0000 7f14e9440640 1 --2- 172.21.15.90:0/2471305936 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14e40d0560 0x7f14e414a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.264+0000 7f14e9440640 1 --2- 172.21.15.90:0/2471305936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14e40cf1f0 0x7f14e415ef30 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.264+0000 7f14e9440640 1 -- 172.21.15.90:0/2471305936 >> 172.21.15.90:0/2471305936 conn(0x7f14e40d1dd0 msgr2=0x7f14e40b6120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:55.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.264+0000 7f14e9440640 1 -- 172.21.15.90:0/2471305936 shutdown_connections 2024-09-10T23:15:55.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.264+0000 7f14e9440640 1 -- 172.21.15.90:0/2471305936 wait complete. 2024-09-10T23:15:55.276 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T23:15:55.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:55.276 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T23:15:55.304 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:15:55.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:55.304 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:15:55.360 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:15:55.360 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:15:55.360 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:55.378 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:15:55.378 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:55.435 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:15:55.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.537+0000 7f02c569b640 1 -- 172.21.15.90:0/3811813885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02a8003a30 msgr2=0x7f02a8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.537+0000 7f02c569b640 1 --2- 172.21.15.90:0/3811813885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02a8003a30 0x7f02a8003e50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f02b0009b50 tx=0x7f02a8005830 comp rx=0 tx=0).stop 2024-09-10T23:15:55.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.537+0000 7f02bf7fe640 1 -- 172.21.15.90:0/3811813885 reap_dead start 2024-09-10T23:15:55.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.537+0000 7f02c569b640 1 -- 172.21.15.90:0/3811813885 shutdown_connections 2024-09-10T23:15:55.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.537+0000 7f02c569b640 1 -- 172.21.15.90:0/3811813885 >> 172.21.15.90:0/3811813885 conn(0x7f02c009d2a0 msgr2=0x7f02c00d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:55.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.537+0000 7f02c569b640 1 -- 172.21.15.90:0/3811813885 shutdown_connections 2024-09-10T23:15:55.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.537+0000 7f02c569b640 1 -- 172.21.15.90:0/3811813885 wait complete. 2024-09-10T23:15:55.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.538+0000 7f02c569b640 1 Processor -- start 2024-09-10T23:15:55.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.538+0000 7f02c569b640 1 -- start start 2024-09-10T23:15:55.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.539+0000 7f02c569b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02a8003a30 0x7f02c0154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.539+0000 7f02c569b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02c00c9090 0x7f02c00c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.539+0000 7f02c569b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02c00b8ee0 0x7f02c00b9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.539+0000 7f02c569b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f02c00b3610 con 0x7f02c00b8ee0 2024-09-10T23:15:55.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.539+0000 7f02c569b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f02c00b3490 con 0x7f02a8003a30 2024-09-10T23:15:55.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.539+0000 7f02c569b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f02c00b3790 con 0x7f02c00c9090 2024-09-10T23:15:55.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.539+0000 7f02bf7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02c00b8ee0 0x7f02c00b9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.539+0000 7f02bf7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02c00b8ee0 0x7f02c00b9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41516/0 (socket says 172.21.15.90:41516) 2024-09-10T23:15:55.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.539+0000 7f02bf7fe640 1 -- 172.21.15.90:0/3030674501 learned_addr learned my addr 172.21.15.90:0/3030674501 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:55.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.539+0000 7f02be7fc640 1 --2- 172.21.15.90:0/3030674501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02c00c9090 0x7f02c00c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.539+0000 7f02beffd640 1 --2- 172.21.15.90:0/3030674501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02a8003a30 0x7f02c0154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.539+0000 7f02bf7fe640 1 -- 172.21.15.90:0/3030674501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02c00c9090 msgr2=0x7f02c00c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.539+0000 7f02bf7fe640 1 --2- 172.21.15.90:0/3030674501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02c00c9090 0x7f02c00c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.539+0000 7f02bf7fe640 1 -- 172.21.15.90:0/3030674501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02a8003a30 msgr2=0x7f02c0154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.539+0000 7f02bf7fe640 1 --2- 172.21.15.90:0/3030674501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02a8003a30 0x7f02c0154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.540+0000 7f02bf7fe640 1 -- 172.21.15.90:0/3030674501 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c00c9b50 con 0x7f02c00b8ee0 2024-09-10T23:15:55.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.540+0000 7f02bf7fe640 1 --2- 172.21.15.90:0/3030674501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02c00b8ee0 0x7f02c00b9360 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f02c00b6c90 tx=0x7f02b80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:55.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.540+0000 7f02a77fe640 1 -- 172.21.15.90:0/3030674501 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b8011870 con 0x7f02c00b8ee0 2024-09-10T23:15:55.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.540+0000 7f02a77fe640 1 -- 172.21.15.90:0/3030674501 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02b8017070 con 0x7f02c00b8ee0 2024-09-10T23:15:55.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.540+0000 7f02a77fe640 1 -- 172.21.15.90:0/3030674501 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b8011da0 con 0x7f02c00b8ee0 2024-09-10T23:15:55.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.540+0000 7f02c569b640 1 -- 172.21.15.90:0/3030674501 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c01f4ab0 con 0x7f02c00b8ee0 2024-09-10T23:15:55.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.540+0000 7f02c569b640 1 -- 172.21.15.90:0/3030674501 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c01f5070 con 0x7f02c00b8ee0 2024-09-10T23:15:55.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.541+0000 7f02c569b640 1 -- 172.21.15.90:0/3030674501 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c00b98a0 con 0x7f02c00b8ee0 2024-09-10T23:15:55.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.541+0000 7f02a77fe640 1 -- 172.21.15.90:0/3030674501 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f02b801c460 con 0x7f02c00b8ee0 2024-09-10T23:15:55.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.542+0000 7f02a77fe640 1 --2- 172.21.15.90:0/3030674501 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f02ac077fa0 0x7f02ac07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.542+0000 7f02a77fe640 1 -- 172.21.15.90:0/3030674501 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f02b809a420 con 0x7f02c00b8ee0 2024-09-10T23:15:55.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.542+0000 7f02beffd640 1 --2- 172.21.15.90:0/3030674501 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f02ac077fa0 0x7f02ac07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.542+0000 7f02beffd640 1 --2- 172.21.15.90:0/3030674501 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f02ac077fa0 0x7f02ac07a460 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f02b0035000 tx=0x7f02b002d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:55.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.546+0000 7f02a77fe640 1 -- 172.21.15.90:0/3030674501 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f02b80628d0 con 0x7f02c00b8ee0 2024-09-10T23:15:55.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.734+0000 7f02c569b640 1 -- 172.21.15.90:0/3030674501 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f02c006ac40 con 0x7f02c00b8ee0 2024-09-10T23:15:55.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.734+0000 7f02a77fe640 1 -- 172.21.15.90:0/3030674501 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) ==== 80+0+0 (secure 0 0 0) 0x7f02c006ac40 con 0x7f02c00b8ee0 2024-09-10T23:15:55.735 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:15:55.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.736+0000 7f02c569b640 1 -- 172.21.15.90:0/3030674501 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f02ac077fa0 msgr2=0x7f02ac07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.736+0000 7f02c569b640 1 --2- 172.21.15.90:0/3030674501 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f02ac077fa0 0x7f02ac07a460 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f02b0035000 tx=0x7f02b002d040 comp rx=0 tx=0).stop 2024-09-10T23:15:55.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.736+0000 7f02c569b640 1 -- 172.21.15.90:0/3030674501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02c00b8ee0 msgr2=0x7f02c00b9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.736+0000 7f02c569b640 1 --2- 172.21.15.90:0/3030674501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02c00b8ee0 0x7f02c00b9360 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f02c00b6c90 tx=0x7f02b80019b0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.736+0000 7f02c569b640 1 -- 172.21.15.90:0/3030674501 shutdown_connections 2024-09-10T23:15:55.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.736+0000 7f02c569b640 1 --2- 172.21.15.90:0/3030674501 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f02ac077fa0 0x7f02ac07a460 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.736+0000 7f02c569b640 1 --2- 172.21.15.90:0/3030674501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02c00b8ee0 0x7f02c00b9360 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.736+0000 7f02c569b640 1 --2- 172.21.15.90:0/3030674501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02c00c9090 0x7f02c00c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.736+0000 7f02c569b640 1 --2- 172.21.15.90:0/3030674501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02a8003a30 0x7f02c0154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.736+0000 7f02c569b640 1 -- 172.21.15.90:0/3030674501 >> 172.21.15.90:0/3030674501 conn(0x7f02c009d2a0 msgr2=0x7f02c00b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:55.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.736+0000 7f02c569b640 1 -- 172.21.15.90:0/3030674501 shutdown_connections 2024-09-10T23:15:55.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.736+0000 7f02c569b640 1 -- 172.21.15.90:0/3030674501 wait complete. 2024-09-10T23:15:55.748 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T23:15:55.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:55.749 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T23:15:55.782 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:15:55.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:55.782 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T23:15:55.841 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:15:55.841 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:15:55.841 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:55.857 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:15:55.857 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:15:55.857 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:15:55.857 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:55.899 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:15:55.899 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:56.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.998+0000 7f392aab1640 1 -- 172.21.15.90:0/3442893968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39240d1c70 msgr2=0x7f39240b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.998+0000 7f392aab1640 1 --2- 172.21.15.90:0/3442893968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39240d1c70 0x7f39240b3490 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3910005fd0 tx=0x7f391002a5d0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.998+0000 7f392aab1640 1 -- 172.21.15.90:0/3442893968 shutdown_connections 2024-09-10T23:15:56.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.998+0000 7f392aab1640 1 --2- 172.21.15.90:0/3442893968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39240d1c70 0x7f39240b3490 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.998+0000 7f392aab1640 1 -- 172.21.15.90:0/3442893968 >> 172.21.15.90:0/3442893968 conn(0x7f392409d2a0 msgr2=0x7f39240d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:56.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.998+0000 7f392aab1640 1 -- 172.21.15.90:0/3442893968 shutdown_connections 2024-09-10T23:15:56.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.998+0000 7f392aab1640 1 -- 172.21.15.90:0/3442893968 wait complete. 2024-09-10T23:15:56.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.999+0000 7f392aab1640 1 Processor -- start 2024-09-10T23:15:56.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:55.999+0000 7f392aab1640 1 -- start start 2024-09-10T23:15:56.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.000+0000 7f392aab1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39240b3a00 0x7f39240cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.000+0000 7f392aab1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39240d1c70 0x7f392415e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.000+0000 7f392aab1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39240d2470 0x7f39240b9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.000+0000 7f392aab1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39240b4740 con 0x7f39240b3a00 2024-09-10T23:15:56.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.000+0000 7f392aab1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f39240b45c0 con 0x7f39240d2470 2024-09-10T23:15:56.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.000+0000 7f392aab1640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f39240b48c0 con 0x7f39240d1c70 2024-09-10T23:15:56.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.001+0000 7f392884d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39240b3a00 0x7f39240cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.001+0000 7f392884d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39240b3a00 0x7f39240cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41544/0 (socket says 172.21.15.90:41544) 2024-09-10T23:15:56.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.001+0000 7f392884d640 1 -- 172.21.15.90:0/2239552243 learned_addr learned my addr 172.21.15.90:0/2239552243 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:56.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.001+0000 7f392884d640 1 -- 172.21.15.90:0/2239552243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39240d1c70 msgr2=0x7f392415e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.001+0000 7f392884d640 1 --2- 172.21.15.90:0/2239552243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39240d1c70 0x7f392415e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.001+0000 7f392884d640 1 -- 172.21.15.90:0/2239552243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39240d2470 msgr2=0x7f39240b9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.001+0000 7f392884d640 1 --2- 172.21.15.90:0/2239552243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39240d2470 0x7f39240b9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.001+0000 7f392884d640 1 -- 172.21.15.90:0/2239552243 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39240b7e00 con 0x7f39240b3a00 2024-09-10T23:15:56.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.001+0000 7f392884d640 1 --2- 172.21.15.90:0/2239552243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39240b3a00 0x7f39240cd3f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f391800c3a0 tx=0x7f391800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:56.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.001+0000 7f39217fa640 1 -- 172.21.15.90:0/2239552243 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918017070 con 0x7f39240b3a00 2024-09-10T23:15:56.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.001+0000 7f39217fa640 1 -- 172.21.15.90:0/2239552243 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39180053c0 con 0x7f39240b3a00 2024-09-10T23:15:56.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.001+0000 7f392aab1640 1 -- 172.21.15.90:0/2239552243 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39240b8690 con 0x7f39240b3a00 2024-09-10T23:15:56.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.001+0000 7f39217fa640 1 -- 172.21.15.90:0/2239552243 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918003850 con 0x7f39240b3a00 2024-09-10T23:15:56.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.001+0000 7f392aab1640 1 -- 172.21.15.90:0/2239552243 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39240b8f30 con 0x7f39240b3a00 2024-09-10T23:15:56.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.002+0000 7f392aab1640 1 -- 172.21.15.90:0/2239552243 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39240b3490 con 0x7f39240b3a00 2024-09-10T23:15:56.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.003+0000 7f39217fa640 1 -- 172.21.15.90:0/2239552243 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f39180039f0 con 0x7f39240b3a00 2024-09-10T23:15:56.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.003+0000 7f39217fa640 1 --2- 172.21.15.90:0/2239552243 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3908077f70 0x7f390807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.004+0000 7f39217fa640 1 -- 172.21.15.90:0/2239552243 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f39180993a0 con 0x7f39240b3a00 2024-09-10T23:15:56.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.004+0000 7f3923fff640 1 --2- 172.21.15.90:0/2239552243 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3908077f70 0x7f390807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.004+0000 7f3923fff640 1 --2- 172.21.15.90:0/2239552243 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3908077f70 0x7f390807a430 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3910033000 tx=0x7f39100046c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:56.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.008+0000 7f39217fa640 1 -- 172.21.15.90:0/2239552243 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f39240cff60 con 0x7f39240b3a00 2024-09-10T23:15:56.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.216+0000 7f392aab1640 1 -- 172.21.15.90:0/2239552243 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39240b8a20 con 0x7f39240b3a00 2024-09-10T23:15:56.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.216+0000 7f39217fa640 1 -- 172.21.15.90:0/2239552243 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5229 (secure 0 0 0) 0x7f3918061ea0 con 0x7f39240b3a00 2024-09-10T23:15:56.218 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:56.218 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"btime":"2024-09-10T23:15:45:529350+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3694036833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3694036833},{"type":"v1","addr":"172.21.15.171:6836","nonce":3694036833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4148214232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":4148214232},{"type":"v1","addr":"172.21.15.90:6835","nonce":4148214232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/2531112116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2531112116},{"type":"v1","addr":"172.21.15.90:6834","nonce":2531112116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:42.843210+0000","modified":"2024-09-10T23:15:44.866224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/4106111677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":4106111677},{"type":"v1","addr":"172.21.15.171:6837","nonce":4106111677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-10T23:15:56.218 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 20 2024-09-10T23:15:56.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.219+0000 7f392aab1640 1 -- 172.21.15.90:0/2239552243 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3908077f70 msgr2=0x7f390807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.219+0000 7f392aab1640 1 --2- 172.21.15.90:0/2239552243 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3908077f70 0x7f390807a430 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3910033000 tx=0x7f39100046c0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.219+0000 7f392aab1640 1 -- 172.21.15.90:0/2239552243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39240b3a00 msgr2=0x7f39240cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.219+0000 7f392aab1640 1 --2- 172.21.15.90:0/2239552243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39240b3a00 0x7f39240cd3f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f391800c3a0 tx=0x7f391800c860 comp rx=0 tx=0).stop 2024-09-10T23:15:56.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.219+0000 7f392aab1640 1 -- 172.21.15.90:0/2239552243 shutdown_connections 2024-09-10T23:15:56.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.219+0000 7f392aab1640 1 --2- 172.21.15.90:0/2239552243 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3908077f70 0x7f390807a430 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.219+0000 7f392aab1640 1 --2- 172.21.15.90:0/2239552243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39240d2470 0x7f39240b9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.219+0000 7f392aab1640 1 --2- 172.21.15.90:0/2239552243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39240d1c70 0x7f392415e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.219+0000 7f392aab1640 1 --2- 172.21.15.90:0/2239552243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39240b3a00 0x7f39240cd3f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.219+0000 7f392aab1640 1 -- 172.21.15.90:0/2239552243 >> 172.21.15.90:0/2239552243 conn(0x7f392409d2a0 msgr2=0x7f39240b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:56.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.219+0000 7f392aab1640 1 -- 172.21.15.90:0/2239552243 shutdown_connections 2024-09-10T23:15:56.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.219+0000 7f392aab1640 1 -- 172.21.15.90:0/2239552243 wait complete. 2024-09-10T23:15:56.231 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:56.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.331+0000 7f209e117640 1 -- 172.21.15.90:0/2521517724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2080003a00 msgr2=0x7f2080003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.331+0000 7f209e117640 1 --2- 172.21.15.90:0/2521517724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2080003a00 0x7f2080003e20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2088009b50 tx=0x7f2080005830 comp rx=0 tx=0).stop 2024-09-10T23:15:56.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.331+0000 7f2097fff640 1 -- 172.21.15.90:0/2521517724 reap_dead start 2024-09-10T23:15:56.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.331+0000 7f209e117640 1 -- 172.21.15.90:0/2521517724 shutdown_connections 2024-09-10T23:15:56.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.331+0000 7f209e117640 1 -- 172.21.15.90:0/2521517724 >> 172.21.15.90:0/2521517724 conn(0x7f20980cc850 msgr2=0x7f20980ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:56.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.331+0000 7f209e117640 1 -- 172.21.15.90:0/2521517724 shutdown_connections 2024-09-10T23:15:56.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.331+0000 7f209e117640 1 -- 172.21.15.90:0/2521517724 wait complete. 2024-09-10T23:15:56.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.332+0000 7f209e117640 1 Processor -- start 2024-09-10T23:15:56.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.333+0000 7f209e117640 1 -- start start 2024-09-10T23:15:56.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.333+0000 7f209e117640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2080003a00 0x7f2098159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.333+0000 7f209e117640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20980c79e0 0x7f20980b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.333+0000 7f209e117640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f209809cde0 0x7f209809d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.333+0000 7f209e117640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f20980ca7b0 con 0x7f209809cde0 2024-09-10T23:15:56.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.333+0000 7f209e117640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f20980ca630 con 0x7f20980c79e0 2024-09-10T23:15:56.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.333+0000 7f209e117640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f20980b1d90 con 0x7f2080003a00 2024-09-10T23:15:56.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.333+0000 7f2097fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f209809cde0 0x7f209809d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.334+0000 7f2097fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f209809cde0 0x7f209809d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41568/0 (socket says 172.21.15.90:41568) 2024-09-10T23:15:56.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.334+0000 7f2097fff640 1 -- 172.21.15.90:0/2092228061 learned_addr learned my addr 172.21.15.90:0/2092228061 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:56.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.334+0000 7f2096ffd640 1 --2- 172.21.15.90:0/2092228061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20980c79e0 0x7f20980b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.334+0000 7f20977fe640 1 --2- 172.21.15.90:0/2092228061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2080003a00 0x7f2098159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.334+0000 7f2097fff640 1 -- 172.21.15.90:0/2092228061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2080003a00 msgr2=0x7f2098159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.334+0000 7f2097fff640 1 --2- 172.21.15.90:0/2092228061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2080003a00 0x7f2098159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.334+0000 7f2097fff640 1 -- 172.21.15.90:0/2092228061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20980c79e0 msgr2=0x7f20980b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.334+0000 7f2097fff640 1 --2- 172.21.15.90:0/2092228061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20980c79e0 0x7f20980b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.334+0000 7f2097fff640 1 -- 172.21.15.90:0/2092228061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20980c8b00 con 0x7f209809cde0 2024-09-10T23:15:56.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.334+0000 7f20977fe640 1 --2- 172.21.15.90:0/2092228061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2080003a00 0x7f2098159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:56.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.334+0000 7f2097fff640 1 --2- 172.21.15.90:0/2092228061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f209809cde0 0x7f209809d260 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2090006fd0 tx=0x7f2090006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:56.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.334+0000 7f207ffff640 1 -- 172.21.15.90:0/2092228061 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209000fa80 con 0x7f209809cde0 2024-09-10T23:15:56.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.334+0000 7f207ffff640 1 -- 172.21.15.90:0/2092228061 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2090018070 con 0x7f209809cde0 2024-09-10T23:15:56.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.334+0000 7f209e117640 1 -- 172.21.15.90:0/2092228061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20980c7f80 con 0x7f209809cde0 2024-09-10T23:15:56.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.334+0000 7f207ffff640 1 -- 172.21.15.90:0/2092228061 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090011430 con 0x7f209809cde0 2024-09-10T23:15:56.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.334+0000 7f209e117640 1 -- 172.21.15.90:0/2092228061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20980c8540 con 0x7f209809cde0 2024-09-10T23:15:56.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.335+0000 7f209e117640 1 -- 172.21.15.90:0/2092228061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20980b1850 con 0x7f209809cde0 2024-09-10T23:15:56.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.336+0000 7f207ffff640 1 -- 172.21.15.90:0/2092228061 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f20900115d0 con 0x7f209809cde0 2024-09-10T23:15:56.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.336+0000 7f207ffff640 1 --2- 172.21.15.90:0/2092228061 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2084077fa0 0x7f208407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.336+0000 7f207ffff640 1 -- 172.21.15.90:0/2092228061 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f209009a540 con 0x7f209809cde0 2024-09-10T23:15:56.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.336+0000 7f20977fe640 1 --2- 172.21.15.90:0/2092228061 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2084077fa0 0x7f208407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.337+0000 7f20977fe640 1 --2- 172.21.15.90:0/2092228061 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2084077fa0 0x7f208407a460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2088035000 tx=0x7f208802d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:56.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.340+0000 7f207ffff640 1 -- 172.21.15.90:0/2092228061 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2090063040 con 0x7f209809cde0 2024-09-10T23:15:56.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.549+0000 7f209e117640 1 -- 172.21.15.90:0/2092228061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20980c6260 con 0x7f209809cde0 2024-09-10T23:15:56.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.549+0000 7f207ffff640 1 -- 172.21.15.90:0/2092228061 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5229 (secure 0 0 0) 0x7f2090062940 con 0x7f209809cde0 2024-09-10T23:15:56.551 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:56.551 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"btime":"2024-09-10T23:15:45:529350+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3694036833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3694036833},{"type":"v1","addr":"172.21.15.171:6836","nonce":3694036833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4148214232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":4148214232},{"type":"v1","addr":"172.21.15.90:6835","nonce":4148214232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/2531112116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2531112116},{"type":"v1","addr":"172.21.15.90:6834","nonce":2531112116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:42.843210+0000","modified":"2024-09-10T23:15:44.866224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/4106111677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":4106111677},{"type":"v1","addr":"172.21.15.171:6837","nonce":4106111677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-10T23:15:56.551 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 20 2024-09-10T23:15:56.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.552+0000 7f209e117640 1 -- 172.21.15.90:0/2092228061 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2084077fa0 msgr2=0x7f208407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.552+0000 7f209e117640 1 --2- 172.21.15.90:0/2092228061 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2084077fa0 0x7f208407a460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2088035000 tx=0x7f208802d040 comp rx=0 tx=0).stop 2024-09-10T23:15:56.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.552+0000 7f209e117640 1 -- 172.21.15.90:0/2092228061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f209809cde0 msgr2=0x7f209809d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.552+0000 7f209e117640 1 --2- 172.21.15.90:0/2092228061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f209809cde0 0x7f209809d260 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2090006fd0 tx=0x7f2090006720 comp rx=0 tx=0).stop 2024-09-10T23:15:56.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.552+0000 7f209e117640 1 -- 172.21.15.90:0/2092228061 shutdown_connections 2024-09-10T23:15:56.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.552+0000 7f209e117640 1 --2- 172.21.15.90:0/2092228061 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2084077fa0 0x7f208407a460 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.552+0000 7f209e117640 1 --2- 172.21.15.90:0/2092228061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20980c79e0 0x7f20980b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.552+0000 7f209e117640 1 --2- 172.21.15.90:0/2092228061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f209809cde0 0x7f209809d260 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.552+0000 7f209e117640 1 --2- 172.21.15.90:0/2092228061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2080003a00 0x7f2098159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.552+0000 7f209e117640 1 -- 172.21.15.90:0/2092228061 >> 172.21.15.90:0/2092228061 conn(0x7f20980cc850 msgr2=0x7f20980ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:56.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.552+0000 7f209e117640 1 -- 172.21.15.90:0/2092228061 shutdown_connections 2024-09-10T23:15:56.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.552+0000 7f209e117640 1 -- 172.21.15.90:0/2092228061 wait complete. 2024-09-10T23:15:56.564 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:56.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.666+0000 7fb25d3c6640 1 -- 172.21.15.90:0/722759270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb244004800 msgr2=0x7fb244004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.666+0000 7fb25d3c6640 1 --2- 172.21.15.90:0/722759270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb244004800 0x7fb244004c80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb2580d20d0 tx=0x7fb244005830 comp rx=0 tx=0).stop 2024-09-10T23:15:56.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.666+0000 7fb2577fe640 1 -- 172.21.15.90:0/722759270 reap_dead start 2024-09-10T23:15:56.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.666+0000 7fb25d3c6640 1 -- 172.21.15.90:0/722759270 shutdown_connections 2024-09-10T23:15:56.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.666+0000 7fb25d3c6640 1 -- 172.21.15.90:0/722759270 >> 172.21.15.90:0/722759270 conn(0x7fb25809d2a0 msgr2=0x7fb2580d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:56.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.666+0000 7fb25d3c6640 1 -- 172.21.15.90:0/722759270 shutdown_connections 2024-09-10T23:15:56.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.666+0000 7fb25d3c6640 1 -- 172.21.15.90:0/722759270 wait complete. 2024-09-10T23:15:56.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.667+0000 7fb25d3c6640 1 Processor -- start 2024-09-10T23:15:56.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.667+0000 7fb25d3c6640 1 -- start start 2024-09-10T23:15:56.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb25d3c6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb244004800 0x7fb2581f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb25d3c6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb25815fb30 0x7fb2580cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb25d3c6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25815ffb0 0x7fb25815e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb25d3c6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb2580b4290 con 0x7fb25815ffb0 2024-09-10T23:15:56.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb25d3c6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb2580b4110 con 0x7fb244004800 2024-09-10T23:15:56.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb25d3c6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb2580b4410 con 0x7fb25815fb30 2024-09-10T23:15:56.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb2577fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25815ffb0 0x7fb25815e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb2577fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25815ffb0 0x7fb25815e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41588/0 (socket says 172.21.15.90:41588) 2024-09-10T23:15:56.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb2577fe640 1 -- 172.21.15.90:0/595602688 learned_addr learned my addr 172.21.15.90:0/595602688 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:56.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb2567fc640 1 --2- 172.21.15.90:0/595602688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb25815fb30 0x7fb2580cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb256ffd640 1 --2- 172.21.15.90:0/595602688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb244004800 0x7fb2581f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb2577fe640 1 -- 172.21.15.90:0/595602688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb25815fb30 msgr2=0x7fb2580cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb2577fe640 1 --2- 172.21.15.90:0/595602688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb25815fb30 0x7fb2580cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb2577fe640 1 -- 172.21.15.90:0/595602688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb244004800 msgr2=0x7fb2581f89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb2577fe640 1 --2- 172.21.15.90:0/595602688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb244004800 0x7fb2581f89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb2577fe640 1 -- 172.21.15.90:0/595602688 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2581f4ec0 con 0x7fb25815ffb0 2024-09-10T23:15:56.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb2567fc640 1 --2- 172.21.15.90:0/595602688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb25815fb30 0x7fb2580cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:56.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb256ffd640 1 --2- 172.21.15.90:0/595602688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb244004800 0x7fb2581f89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:56.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.668+0000 7fb2577fe640 1 --2- 172.21.15.90:0/595602688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25815ffb0 0x7fb25815e980 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb25808cfc0 tx=0x7fb248011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:56.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.669+0000 7fb24f7fe640 1 -- 172.21.15.90:0/595602688 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb248004230 con 0x7fb25815ffb0 2024-09-10T23:15:56.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.669+0000 7fb24f7fe640 1 -- 172.21.15.90:0/595602688 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb248016070 con 0x7fb25815ffb0 2024-09-10T23:15:56.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.669+0000 7fb25d3c6640 1 -- 172.21.15.90:0/595602688 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2581f51a0 con 0x7fb25815ffb0 2024-09-10T23:15:56.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.669+0000 7fb24f7fe640 1 -- 172.21.15.90:0/595602688 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24800fa90 con 0x7fb25815ffb0 2024-09-10T23:15:56.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.669+0000 7fb25d3c6640 1 -- 172.21.15.90:0/595602688 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2581f5760 con 0x7fb25815ffb0 2024-09-10T23:15:56.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.669+0000 7fb25d3c6640 1 -- 172.21.15.90:0/595602688 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2580b49a0 con 0x7fb25815ffb0 2024-09-10T23:15:56.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.670+0000 7fb24f7fe640 1 -- 172.21.15.90:0/595602688 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb248023030 con 0x7fb25815ffb0 2024-09-10T23:15:56.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.671+0000 7fb24f7fe640 1 --2- 172.21.15.90:0/595602688 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb238077f70 0x7fb23807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.671+0000 7fb24f7fe640 1 -- 172.21.15.90:0/595602688 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fb24809a480 con 0x7fb25815ffb0 2024-09-10T23:15:56.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.671+0000 7fb256ffd640 1 --2- 172.21.15.90:0/595602688 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb238077f70 0x7fb23807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.672+0000 7fb256ffd640 1 --2- 172.21.15.90:0/595602688 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb238077f70 0x7fb23807a430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb250006fd0 tx=0x7fb250006f20 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:56.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.675+0000 7fb24f7fe640 1 -- 172.21.15.90:0/595602688 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb248062f80 con 0x7fb25815ffb0 2024-09-10T23:15:56.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.849+0000 7fb25d3c6640 1 -- 172.21.15.90:0/595602688 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb258161790 con 0x7fb25815ffb0 2024-09-10T23:15:56.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.850+0000 7fb24f7fe640 1 -- 172.21.15.90:0/595602688 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16673 (secure 0 0 0) 0x7fb248062880 con 0x7fb25815ffb0 2024-09-10T23:15:56.852 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:56.852 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":46,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:15:44.511355+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:41.074720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:41.800321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:56.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.852+0000 7fb25d3c6640 1 -- 172.21.15.90:0/595602688 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb238077f70 msgr2=0x7fb23807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.852+0000 7fb25d3c6640 1 --2- 172.21.15.90:0/595602688 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb238077f70 0x7fb23807a430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb250006fd0 tx=0x7fb250006f20 comp rx=0 tx=0).stop 2024-09-10T23:15:56.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.852+0000 7fb25d3c6640 1 -- 172.21.15.90:0/595602688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25815ffb0 msgr2=0x7fb25815e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.852+0000 7fb25d3c6640 1 --2- 172.21.15.90:0/595602688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25815ffb0 0x7fb25815e980 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb25808cfc0 tx=0x7fb248011b10 comp rx=0 tx=0).stop 2024-09-10T23:15:56.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.853+0000 7fb25d3c6640 1 -- 172.21.15.90:0/595602688 shutdown_connections 2024-09-10T23:15:56.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.853+0000 7fb25d3c6640 1 --2- 172.21.15.90:0/595602688 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb238077f70 0x7fb23807a430 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.853+0000 7fb25d3c6640 1 --2- 172.21.15.90:0/595602688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb25815ffb0 0x7fb25815e980 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.853+0000 7fb25d3c6640 1 --2- 172.21.15.90:0/595602688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb25815fb30 0x7fb2580cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.853+0000 7fb25d3c6640 1 --2- 172.21.15.90:0/595602688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb244004800 0x7fb2581f89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.853+0000 7fb25d3c6640 1 -- 172.21.15.90:0/595602688 >> 172.21.15.90:0/595602688 conn(0x7fb25809d2a0 msgr2=0x7fb2580b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:56.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.853+0000 7fb25d3c6640 1 -- 172.21.15.90:0/595602688 shutdown_connections 2024-09-10T23:15:56.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.853+0000 7fb25d3c6640 1 -- 172.21.15.90:0/595602688 wait complete. 2024-09-10T23:15:56.865 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:15:56.865 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:56.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.965+0000 7f3b52c9b640 1 -- 172.21.15.90:0/3068458924 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b380039e0 msgr2=0x7f3b38003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.965+0000 7f3b52c9b640 1 --2- 172.21.15.90:0/3068458924 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b380039e0 0x7f3b38003dc0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00c730 tx=0x7f3b38005830 comp rx=0 tx=0).stop 2024-09-10T23:15:56.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.965+0000 7f3b51238640 1 -- 172.21.15.90:0/3068458924 reap_dead start 2024-09-10T23:15:56.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.965+0000 7f3b52c9b640 1 -- 172.21.15.90:0/3068458924 shutdown_connections 2024-09-10T23:15:56.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.965+0000 7f3b52c9b640 1 -- 172.21.15.90:0/3068458924 >> 172.21.15.90:0/3068458924 conn(0x7f3b4c09d2a0 msgr2=0x7f3b4c0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:56.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.965+0000 7f3b52c9b640 1 -- 172.21.15.90:0/3068458924 shutdown_connections 2024-09-10T23:15:56.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.965+0000 7f3b52c9b640 1 -- 172.21.15.90:0/3068458924 wait complete. 2024-09-10T23:15:56.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.966+0000 7f3b52c9b640 1 Processor -- start 2024-09-10T23:15:56.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.966+0000 7f3b52c9b640 1 -- start start 2024-09-10T23:15:56.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.967+0000 7f3b52c9b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b380039e0 0x7f3b4c15e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.967+0000 7f3b52c9b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b4c0b97d0 0x7f3b4c1f85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.967+0000 7f3b52c9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b4c15f350 0x7f3b4c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.967+0000 7f3b52c9b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c0b3610 con 0x7f3b4c15f350 2024-09-10T23:15:56.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.967+0000 7f3b52c9b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c0b3490 con 0x7f3b4c0b97d0 2024-09-10T23:15:56.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.967+0000 7f3b52c9b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3b4c0b3790 con 0x7f3b380039e0 2024-09-10T23:15:56.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.967+0000 7f3b51238640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b4c15f350 0x7f3b4c0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.967+0000 7f3b51238640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b4c15f350 0x7f3b4c0cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41598/0 (socket says 172.21.15.90:41598) 2024-09-10T23:15:56.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.967+0000 7f3b51238640 1 -- 172.21.15.90:0/130328111 learned_addr learned my addr 172.21.15.90:0/130328111 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:56.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.967+0000 7f3b50a37640 1 --2- 172.21.15.90:0/130328111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b380039e0 0x7f3b4c15e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.967+0000 7f3b4bfff640 1 --2- 172.21.15.90:0/130328111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b4c0b97d0 0x7f3b4c1f85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.967+0000 7f3b51238640 1 -- 172.21.15.90:0/130328111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b380039e0 msgr2=0x7f3b4c15e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.967+0000 7f3b51238640 1 --2- 172.21.15.90:0/130328111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b380039e0 0x7f3b4c15e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.967+0000 7f3b51238640 1 -- 172.21.15.90:0/130328111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b4c0b97d0 msgr2=0x7f3b4c1f85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.967+0000 7f3b51238640 1 --2- 172.21.15.90:0/130328111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b4c0b97d0 0x7f3b4c1f85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.967+0000 7f3b51238640 1 -- 172.21.15.90:0/130328111 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4c1f5580 con 0x7f3b4c15f350 2024-09-10T23:15:56.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.968+0000 7f3b51238640 1 --2- 172.21.15.90:0/130328111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b4c15f350 0x7f3b4c0cd180 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c09da10 tx=0x7f3b44001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:56.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.968+0000 7f3b497fa640 1 -- 172.21.15.90:0/130328111 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44015020 con 0x7f3b4c15f350 2024-09-10T23:15:56.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.968+0000 7f3b497fa640 1 -- 172.21.15.90:0/130328111 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b44011770 con 0x7f3b4c15f350 2024-09-10T23:15:56.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.968+0000 7f3b52c9b640 1 -- 172.21.15.90:0/130328111 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b4c1f4690 con 0x7f3b4c15f350 2024-09-10T23:15:56.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.968+0000 7f3b497fa640 1 -- 172.21.15.90:0/130328111 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44011bc0 con 0x7f3b4c15f350 2024-09-10T23:15:56.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.968+0000 7f3b52c9b640 1 -- 172.21.15.90:0/130328111 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b4c1f4c50 con 0x7f3b4c15f350 2024-09-10T23:15:56.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.969+0000 7f3b52c9b640 1 -- 172.21.15.90:0/130328111 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b4c0b47d0 con 0x7f3b4c15f350 2024-09-10T23:15:56.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.969+0000 7f3b497fa640 1 -- 172.21.15.90:0/130328111 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3b4401a400 con 0x7f3b4c15f350 2024-09-10T23:15:56.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.970+0000 7f3b497fa640 1 --2- 172.21.15.90:0/130328111 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3b2c077f70 0x7f3b2c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.970+0000 7f3b497fa640 1 -- 172.21.15.90:0/130328111 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f3b4409a600 con 0x7f3b4c15f350 2024-09-10T23:15:56.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.970+0000 7f3b50a37640 1 --2- 172.21.15.90:0/130328111 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3b2c077f70 0x7f3b2c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.971+0000 7f3b50a37640 1 --2- 172.21.15.90:0/130328111 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3b2c077f70 0x7f3b2c07a430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00c730 tx=0x7f3b3c02d070 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:56.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:56.974+0000 7f3b497fa640 1 -- 172.21.15.90:0/130328111 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3b4401f020 con 0x7f3b4c15f350 2024-09-10T23:15:57.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.185+0000 7f3b52c9b640 1 -- 172.21.15.90:0/130328111 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b4c0b5cc0 con 0x7f3b4c15f350 2024-09-10T23:15:57.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.185+0000 7f3b497fa640 1 -- 172.21.15.90:0/130328111 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5229 (secure 0 0 0) 0x7f3b44062b40 con 0x7f3b4c15f350 2024-09-10T23:15:57.187 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:57.187 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"btime":"2024-09-10T23:15:45:529350+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3694036833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3694036833},{"type":"v1","addr":"172.21.15.171:6836","nonce":3694036833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4148214232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":4148214232},{"type":"v1","addr":"172.21.15.90:6835","nonce":4148214232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/2531112116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2531112116},{"type":"v1","addr":"172.21.15.90:6834","nonce":2531112116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:42.843210+0000","modified":"2024-09-10T23:15:44.866224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/4106111677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":4106111677},{"type":"v1","addr":"172.21.15.171:6837","nonce":4106111677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-10T23:15:57.187 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 20 2024-09-10T23:15:57.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.187+0000 7f3b52c9b640 1 -- 172.21.15.90:0/130328111 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3b2c077f70 msgr2=0x7f3b2c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.187+0000 7f3b52c9b640 1 --2- 172.21.15.90:0/130328111 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3b2c077f70 0x7f3b2c07a430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00c730 tx=0x7f3b3c02d070 comp rx=0 tx=0).stop 2024-09-10T23:15:57.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.187+0000 7f3b52c9b640 1 -- 172.21.15.90:0/130328111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b4c15f350 msgr2=0x7f3b4c0cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.187+0000 7f3b52c9b640 1 --2- 172.21.15.90:0/130328111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b4c15f350 0x7f3b4c0cd180 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c09da10 tx=0x7f3b44001710 comp rx=0 tx=0).stop 2024-09-10T23:15:57.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.188+0000 7f3b52c9b640 1 -- 172.21.15.90:0/130328111 shutdown_connections 2024-09-10T23:15:57.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.188+0000 7f3b52c9b640 1 --2- 172.21.15.90:0/130328111 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3b2c077f70 0x7f3b2c07a430 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.188+0000 7f3b52c9b640 1 --2- 172.21.15.90:0/130328111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b4c0b97d0 0x7f3b4c1f85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.188+0000 7f3b52c9b640 1 --2- 172.21.15.90:0/130328111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b4c15f350 0x7f3b4c0cd180 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.188+0000 7f3b52c9b640 1 --2- 172.21.15.90:0/130328111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b380039e0 0x7f3b4c15e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.188+0000 7f3b52c9b640 1 -- 172.21.15.90:0/130328111 >> 172.21.15.90:0/130328111 conn(0x7f3b4c09d2a0 msgr2=0x7f3b4c06d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:57.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.188+0000 7f3b52c9b640 1 -- 172.21.15.90:0/130328111 shutdown_connections 2024-09-10T23:15:57.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.188+0000 7f3b52c9b640 1 -- 172.21.15.90:0/130328111 wait complete. 2024-09-10T23:15:57.200 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:57.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.298+0000 7ff16d55d640 1 -- 172.21.15.90:0/3912511827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1680d2470 msgr2=0x7ff1680b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.298+0000 7ff16d55d640 1 --2- 172.21.15.90:0/3912511827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1680d2470 0x7ff1680b3490 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff158009830 tx=0x7ff15802a510 comp rx=0 tx=0).stop 2024-09-10T23:15:57.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.298+0000 7ff16d55d640 1 -- 172.21.15.90:0/3912511827 shutdown_connections 2024-09-10T23:15:57.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.298+0000 7ff16d55d640 1 --2- 172.21.15.90:0/3912511827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1680d2470 0x7ff1680b3490 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.298+0000 7ff16d55d640 1 -- 172.21.15.90:0/3912511827 >> 172.21.15.90:0/3912511827 conn(0x7ff16809d2a0 msgr2=0x7ff1680d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:57.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.298+0000 7ff16d55d640 1 -- 172.21.15.90:0/3912511827 shutdown_connections 2024-09-10T23:15:57.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.298+0000 7ff16d55d640 1 -- 172.21.15.90:0/3912511827 wait complete. 2024-09-10T23:15:57.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.299+0000 7ff16d55d640 1 Processor -- start 2024-09-10T23:15:57.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.300+0000 7ff16d55d640 1 -- start start 2024-09-10T23:15:57.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.300+0000 7ff16d55d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1680b3a00 0x7ff16814f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.300+0000 7ff16d55d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1680d1c70 0x7ff1680cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.300+0000 7ff16d55d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1680d2470 0x7ff1680cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.300+0000 7ff16d55d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff1680b4740 con 0x7ff1680d2470 2024-09-10T23:15:57.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.300+0000 7ff16d55d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff1680b45c0 con 0x7ff1680d1c70 2024-09-10T23:15:57.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.300+0000 7ff16d55d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff1680b48c0 con 0x7ff1680b3a00 2024-09-10T23:15:57.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.301+0000 7ff1677fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1680d2470 0x7ff1680cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.301+0000 7ff1677fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1680d2470 0x7ff1680cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41626/0 (socket says 172.21.15.90:41626) 2024-09-10T23:15:57.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.301+0000 7ff1677fe640 1 -- 172.21.15.90:0/2787719973 learned_addr learned my addr 172.21.15.90:0/2787719973 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:57.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.301+0000 7ff15e7fc640 1 --2- 172.21.15.90:0/2787719973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1680d1c70 0x7ff1680cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.301+0000 7ff166ffd640 1 --2- 172.21.15.90:0/2787719973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1680b3a00 0x7ff16814f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.301+0000 7ff1677fe640 1 -- 172.21.15.90:0/2787719973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1680b3a00 msgr2=0x7ff16814f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.301+0000 7ff1677fe640 1 --2- 172.21.15.90:0/2787719973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1680b3a00 0x7ff16814f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.301+0000 7ff1677fe640 1 -- 172.21.15.90:0/2787719973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1680d1c70 msgr2=0x7ff1680cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.301+0000 7ff1677fe640 1 --2- 172.21.15.90:0/2787719973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1680d1c70 0x7ff1680cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.301+0000 7ff1677fe640 1 -- 172.21.15.90:0/2787719973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1680c7d00 con 0x7ff1680d2470 2024-09-10T23:15:57.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.301+0000 7ff166ffd640 1 --2- 172.21.15.90:0/2787719973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1680b3a00 0x7ff16814f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:57.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.301+0000 7ff1677fe640 1 --2- 172.21.15.90:0/2787719973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1680d2470 0x7ff1680cd6c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff16000c780 tx=0x7ff16000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:57.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.301+0000 7ff15ffff640 1 -- 172.21.15.90:0/2787719973 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff160017070 con 0x7ff1680d2470 2024-09-10T23:15:57.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.301+0000 7ff15ffff640 1 -- 172.21.15.90:0/2787719973 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff160005070 con 0x7ff1680d2470 2024-09-10T23:15:57.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.301+0000 7ff16d55d640 1 -- 172.21.15.90:0/2787719973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1680c7fe0 con 0x7ff1680d2470 2024-09-10T23:15:57.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.301+0000 7ff15ffff640 1 -- 172.21.15.90:0/2787719973 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff160005500 con 0x7ff1680d2470 2024-09-10T23:15:57.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.301+0000 7ff16d55d640 1 -- 172.21.15.90:0/2787719973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1680c85a0 con 0x7ff1680d2470 2024-09-10T23:15:57.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.302+0000 7ff16d55d640 1 -- 172.21.15.90:0/2787719973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1680b3490 con 0x7ff1680d2470 2024-09-10T23:15:57.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.303+0000 7ff15ffff640 1 -- 172.21.15.90:0/2787719973 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff16000a5e0 con 0x7ff1680d2470 2024-09-10T23:15:57.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.303+0000 7ff15ffff640 1 --2- 172.21.15.90:0/2787719973 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff148077f70 0x7ff14807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.303+0000 7ff15ffff640 1 -- 172.21.15.90:0/2787719973 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7ff160099620 con 0x7ff1680d2470 2024-09-10T23:15:57.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.304+0000 7ff166ffd640 1 --2- 172.21.15.90:0/2787719973 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff148077f70 0x7ff14807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.304+0000 7ff166ffd640 1 --2- 172.21.15.90:0/2787719973 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff148077f70 0x7ff14807a430 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff158034000 tx=0x7ff158004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:57.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.308+0000 7ff15ffff640 1 -- 172.21.15.90:0/2787719973 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff1600621b0 con 0x7ff1680d2470 2024-09-10T23:15:57.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.515+0000 7ff16d55d640 1 -- 172.21.15.90:0/2787719973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff16815db20 con 0x7ff1680d2470 2024-09-10T23:15:57.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.515+0000 7ff15ffff640 1 -- 172.21.15.90:0/2787719973 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5229 (secure 0 0 0) 0x7ff160061ab0 con 0x7ff1680d2470 2024-09-10T23:15:57.516 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:57.516 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"btime":"2024-09-10T23:15:45:529350+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3694036833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3694036833},{"type":"v1","addr":"172.21.15.171:6836","nonce":3694036833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4148214232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":4148214232},{"type":"v1","addr":"172.21.15.90:6835","nonce":4148214232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/2531112116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2531112116},{"type":"v1","addr":"172.21.15.90:6834","nonce":2531112116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:42.843210+0000","modified":"2024-09-10T23:15:44.866224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/4106111677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":4106111677},{"type":"v1","addr":"172.21.15.171:6837","nonce":4106111677}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-10T23:15:57.517 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 20 2024-09-10T23:15:57.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.517+0000 7ff16d55d640 1 -- 172.21.15.90:0/2787719973 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff148077f70 msgr2=0x7ff14807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.517+0000 7ff16d55d640 1 --2- 172.21.15.90:0/2787719973 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff148077f70 0x7ff14807a430 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff158034000 tx=0x7ff158004730 comp rx=0 tx=0).stop 2024-09-10T23:15:57.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.517+0000 7ff16d55d640 1 -- 172.21.15.90:0/2787719973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1680d2470 msgr2=0x7ff1680cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.517+0000 7ff16d55d640 1 --2- 172.21.15.90:0/2787719973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1680d2470 0x7ff1680cd6c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff16000c780 tx=0x7ff16000cc40 comp rx=0 tx=0).stop 2024-09-10T23:15:57.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.517+0000 7ff16d55d640 1 -- 172.21.15.90:0/2787719973 shutdown_connections 2024-09-10T23:15:57.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.517+0000 7ff16d55d640 1 --2- 172.21.15.90:0/2787719973 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff148077f70 0x7ff14807a430 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.517+0000 7ff16d55d640 1 --2- 172.21.15.90:0/2787719973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1680d1c70 0x7ff1680cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.517+0000 7ff16d55d640 1 --2- 172.21.15.90:0/2787719973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1680d2470 0x7ff1680cd6c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.517+0000 7ff16d55d640 1 --2- 172.21.15.90:0/2787719973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1680b3a00 0x7ff16814f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.517+0000 7ff16d55d640 1 -- 172.21.15.90:0/2787719973 >> 172.21.15.90:0/2787719973 conn(0x7ff16809d2a0 msgr2=0x7ff16806d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:57.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.518+0000 7ff16d55d640 1 -- 172.21.15.90:0/2787719973 shutdown_connections 2024-09-10T23:15:57.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.518+0000 7ff16d55d640 1 -- 172.21.15.90:0/2787719973 wait complete. 2024-09-10T23:15:57.530 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:57.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.630+0000 7f08b3d82640 1 -- 172.21.15.90:0/3778803356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0894004800 msgr2=0x7f0894004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.630+0000 7f08b3d82640 1 --2- 172.21.15.90:0/3778803356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0894004800 0x7f0894004c80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f08a0001690 tx=0x7f0894005830 comp rx=0 tx=0).stop 2024-09-10T23:15:57.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.630+0000 7f08b3d82640 1 -- 172.21.15.90:0/3778803356 shutdown_connections 2024-09-10T23:15:57.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.630+0000 7f08b3d82640 1 --2- 172.21.15.90:0/3778803356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0894004800 0x7f0894004c80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.630+0000 7f08b3d82640 1 -- 172.21.15.90:0/3778803356 >> 172.21.15.90:0/3778803356 conn(0x7f08ac0d1dd0 msgr2=0x7f08ac0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:57.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.630+0000 7f08b3d82640 1 -- 172.21.15.90:0/3778803356 shutdown_connections 2024-09-10T23:15:57.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.630+0000 7f08b3d82640 1 -- 172.21.15.90:0/3778803356 wait complete. 2024-09-10T23:15:57.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.631+0000 7f08b3d82640 1 Processor -- start 2024-09-10T23:15:57.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.631+0000 7f08b3d82640 1 -- start start 2024-09-10T23:15:57.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b3d82640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0894004800 0x7f08ac06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b3d82640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08ac1f4a90 0x7f08ac0b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b3d82640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08ac15e770 0x7f08ac15ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b3d82640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f08ac0d01e0 con 0x7f08ac1f4a90 2024-09-10T23:15:57.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b3d82640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f08ac0d0060 con 0x7f0894004800 2024-09-10T23:15:57.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b3d82640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f08ac0d0360 con 0x7f08ac15e770 2024-09-10T23:15:57.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b131d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08ac1f4a90 0x7f08ac0b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b131d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08ac1f4a90 0x7f08ac0b2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41640/0 (socket says 172.21.15.90:41640) 2024-09-10T23:15:57.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b131d640 1 -- 172.21.15.90:0/70470950 learned_addr learned my addr 172.21.15.90:0/70470950 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:57.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b1b1e640 1 --2- 172.21.15.90:0/70470950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0894004800 0x7f08ac06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b231f640 1 --2- 172.21.15.90:0/70470950 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08ac15e770 0x7f08ac15ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b131d640 1 -- 172.21.15.90:0/70470950 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08ac15e770 msgr2=0x7f08ac15ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b131d640 1 --2- 172.21.15.90:0/70470950 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08ac15e770 0x7f08ac15ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b131d640 1 -- 172.21.15.90:0/70470950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0894004800 msgr2=0x7f08ac06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b131d640 1 --2- 172.21.15.90:0/70470950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0894004800 0x7f08ac06dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b131d640 1 -- 172.21.15.90:0/70470950 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08ac0b26c0 con 0x7f08ac1f4a90 2024-09-10T23:15:57.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b231f640 1 --2- 172.21.15.90:0/70470950 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08ac15e770 0x7f08ac15ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:57.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.632+0000 7f08b131d640 1 --2- 172.21.15.90:0/70470950 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08ac1f4a90 0x7f08ac0b2180 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f08a002a8e0 tx=0x7f08a00063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:57.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.634+0000 7f08aa7fc640 1 -- 172.21.15.90:0/70470950 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a0003a00 con 0x7f08ac1f4a90 2024-09-10T23:15:57.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.634+0000 7f08aa7fc640 1 -- 172.21.15.90:0/70470950 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08a0039070 con 0x7f08ac1f4a90 2024-09-10T23:15:57.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.634+0000 7f08b3d82640 1 -- 172.21.15.90:0/70470950 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08ac06e3b0 con 0x7f08ac1f4a90 2024-09-10T23:15:57.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.634+0000 7f08aa7fc640 1 -- 172.21.15.90:0/70470950 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a0033420 con 0x7f08ac1f4a90 2024-09-10T23:15:57.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.634+0000 7f08b3d82640 1 -- 172.21.15.90:0/70470950 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08ac06e970 con 0x7f08ac1f4a90 2024-09-10T23:15:57.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.635+0000 7f08b3d82640 1 -- 172.21.15.90:0/70470950 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08ac0cf3b0 con 0x7f08ac1f4a90 2024-09-10T23:15:57.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.636+0000 7f08aa7fc640 1 -- 172.21.15.90:0/70470950 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f08a00335c0 con 0x7f08ac1f4a90 2024-09-10T23:15:57.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.636+0000 7f08aa7fc640 1 --2- 172.21.15.90:0/70470950 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0898077fa0 0x7f089807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.636+0000 7f08aa7fc640 1 -- 172.21.15.90:0/70470950 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f08a00b96b0 con 0x7f08ac1f4a90 2024-09-10T23:15:57.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.636+0000 7f08b1b1e640 1 --2- 172.21.15.90:0/70470950 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0898077fa0 0x7f089807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.637+0000 7f08b1b1e640 1 --2- 172.21.15.90:0/70470950 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0898077fa0 0x7f089807a460 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f089c002190 tx=0x7f089c006040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:57.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.640+0000 7f08aa7fc640 1 -- 172.21.15.90:0/70470950 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f08a00821b0 con 0x7f08ac1f4a90 2024-09-10T23:15:57.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.814+0000 7f08b3d82640 1 -- 172.21.15.90:0/70470950 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08ac070fd0 con 0x7f08ac1f4a90 2024-09-10T23:15:57.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.815+0000 7f08aa7fc640 1 -- 172.21.15.90:0/70470950 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16673 (secure 0 0 0) 0x7f08a0081ab0 con 0x7f08ac1f4a90 2024-09-10T23:15:57.817 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:15:57.817 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":46,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:15:44.511355+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:41.074720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:41.800321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:57.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.818+0000 7f08b3d82640 1 -- 172.21.15.90:0/70470950 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0898077fa0 msgr2=0x7f089807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.818+0000 7f08b3d82640 1 --2- 172.21.15.90:0/70470950 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0898077fa0 0x7f089807a460 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f089c002190 tx=0x7f089c006040 comp rx=0 tx=0).stop 2024-09-10T23:15:57.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.818+0000 7f08b3d82640 1 -- 172.21.15.90:0/70470950 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08ac1f4a90 msgr2=0x7f08ac0b2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.818+0000 7f08b3d82640 1 --2- 172.21.15.90:0/70470950 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08ac1f4a90 0x7f08ac0b2180 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f08a002a8e0 tx=0x7f08a00063a0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.818+0000 7f08b3d82640 1 -- 172.21.15.90:0/70470950 shutdown_connections 2024-09-10T23:15:57.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.818+0000 7f08b3d82640 1 --2- 172.21.15.90:0/70470950 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0898077fa0 0x7f089807a460 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.818+0000 7f08b3d82640 1 --2- 172.21.15.90:0/70470950 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08ac15e770 0x7f08ac15ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.818+0000 7f08b3d82640 1 --2- 172.21.15.90:0/70470950 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08ac1f4a90 0x7f08ac0b2180 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.818+0000 7f08b3d82640 1 --2- 172.21.15.90:0/70470950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0894004800 0x7f08ac06dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.818+0000 7f08b3d82640 1 -- 172.21.15.90:0/70470950 >> 172.21.15.90:0/70470950 conn(0x7f08ac0d1dd0 msgr2=0x7f08ac071af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:57.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.818+0000 7f08b3d82640 1 -- 172.21.15.90:0/70470950 shutdown_connections 2024-09-10T23:15:57.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.818+0000 7f08b3d82640 1 -- 172.21.15.90:0/70470950 wait complete. 2024-09-10T23:15:57.830 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:15:57.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.931+0000 7f5a954b8640 1 -- 172.21.15.90:0/394880884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a90160400 msgr2=0x7f5a90160840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.931+0000 7f5a954b8640 1 --2- 172.21.15.90:0/394880884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a90160400 0x7f5a90160840 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5a900740d0 tx=0x7f5a8402a560 comp rx=0 tx=0).stop 2024-09-10T23:15:57.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.931+0000 7f5a954b8640 1 -- 172.21.15.90:0/394880884 shutdown_connections 2024-09-10T23:15:57.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.931+0000 7f5a954b8640 1 --2- 172.21.15.90:0/394880884 >> v2:172.21.15.171:3300/0 conn(0x7f5a900c8e60 0x7f5a900c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.931+0000 7f5a954b8640 1 --2- 172.21.15.90:0/394880884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a90160400 0x7f5a90160840 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.931+0000 7f5a954b8640 1 --2- 172.21.15.90:0/394880884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a90160020 0x7f5a900688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.931+0000 7f5a954b8640 1 -- 172.21.15.90:0/394880884 >> 172.21.15.90:0/394880884 conn(0x7f5a900d0490 msgr2=0x7f5a900d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.931+0000 7f5a954b8640 1 -- 172.21.15.90:0/394880884 shutdown_connections 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.931+0000 7f5a954b8640 1 -- 172.21.15.90:0/394880884 wait complete. 2024-09-10T23:15:57.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.932+0000 7f5a954b8640 1 Processor -- start 2024-09-10T23:15:57.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.932+0000 7f5a954b8640 1 -- start start 2024-09-10T23:15:57.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a954b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a900c8e60 0x7f5a900997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a954b8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a90160020 0x7f5a901f84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a954b8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a90160400 0x7f5a9015a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a954b8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5a900c9f00 con 0x7f5a90160400 2024-09-10T23:15:57.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a954b8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5a900c9d80 con 0x7f5a90160020 2024-09-10T23:15:57.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a954b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5a900ca080 con 0x7f5a900c8e60 2024-09-10T23:15:57.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a8f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a90160400 0x7f5a9015a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a8f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a90160400 0x7f5a9015a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41654/0 (socket says 172.21.15.90:41654) 2024-09-10T23:15:57.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a8f7fe640 1 -- 172.21.15.90:0/2302679927 learned_addr learned my addr 172.21.15.90:0/2302679927 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:57.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a8effd640 1 --2- 172.21.15.90:0/2302679927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a900c8e60 0x7f5a900997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a8e7fc640 1 --2- 172.21.15.90:0/2302679927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a90160020 0x7f5a901f84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a8f7fe640 1 -- 172.21.15.90:0/2302679927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a900c8e60 msgr2=0x7f5a900997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a8f7fe640 1 --2- 172.21.15.90:0/2302679927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a900c8e60 0x7f5a900997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a8f7fe640 1 -- 172.21.15.90:0/2302679927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a90160020 msgr2=0x7f5a901f84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a8f7fe640 1 --2- 172.21.15.90:0/2302679927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a90160020 0x7f5a901f84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a8f7fe640 1 -- 172.21.15.90:0/2302679927 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a900cee40 con 0x7f5a90160400 2024-09-10T23:15:57.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a8e7fc640 1 --2- 172.21.15.90:0/2302679927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a90160020 0x7f5a901f84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:57.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.933+0000 7f5a8f7fe640 1 --2- 172.21.15.90:0/2302679927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a90160400 0x7f5a9015a920 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800e8e0 tx=0x7f5a8800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:57.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.934+0000 7f5a777fe640 1 -- 172.21.15.90:0/2302679927 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a88004d20 con 0x7f5a90160400 2024-09-10T23:15:57.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.934+0000 7f5a777fe640 1 -- 172.21.15.90:0/2302679927 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a8800ca60 con 0x7f5a90160400 2024-09-10T23:15:57.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.934+0000 7f5a777fe640 1 -- 172.21.15.90:0/2302679927 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a88005020 con 0x7f5a90160400 2024-09-10T23:15:57.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.934+0000 7f5a954b8640 1 -- 172.21.15.90:0/2302679927 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a900cf120 con 0x7f5a90160400 2024-09-10T23:15:57.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.934+0000 7f5a954b8640 1 -- 172.21.15.90:0/2302679927 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a9015a120 con 0x7f5a90160400 2024-09-10T23:15:57.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.935+0000 7f5a954b8640 1 -- 172.21.15.90:0/2302679927 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a900688e0 con 0x7f5a90160400 2024-09-10T23:15:57.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.935+0000 7f5a777fe640 1 -- 172.21.15.90:0/2302679927 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5a8800f040 con 0x7f5a90160400 2024-09-10T23:15:57.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.936+0000 7f5a777fe640 1 --2- 172.21.15.90:0/2302679927 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5a7c077f70 0x7f5a7c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.936+0000 7f5a777fe640 1 -- 172.21.15.90:0/2302679927 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f5a8809a330 con 0x7f5a90160400 2024-09-10T23:15:57.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.936+0000 7f5a8effd640 1 --2- 172.21.15.90:0/2302679927 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5a7c077f70 0x7f5a7c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.937+0000 7f5a8effd640 1 --2- 172.21.15.90:0/2302679927 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5a7c077f70 0x7f5a7c07a430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5a80005fd0 tx=0x7f5a8000b390 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:57.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:57.940+0000 7f5a777fe640 1 -- 172.21.15.90:0/2302679927 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5a88016030 con 0x7f5a90160400 2024-09-10T23:15:58.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.150+0000 7f5a954b8640 1 -- 172.21.15.90:0/2302679927 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5a9015f7a0 con 0x7f5a90160400 2024-09-10T23:15:58.151 INFO:tasks.ceph.mon.a.smithi090.stderr:2024-09-10T23:15:58.150+0000 7f1a0c84c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:15:58.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.151+0000 7f5a777fe640 1 -- 172.21.15.90:0/2302679927 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) ==== 161+0+0 (secure 0 0 0) 0x7f5a880627f0 con 0x7f5a90160400 2024-09-10T23:15:58.152 INFO:teuthology.orchestra.run.smithi090.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:15:58.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.154+0000 7f5a954b8640 1 -- 172.21.15.90:0/2302679927 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5a7c077f70 msgr2=0x7f5a7c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.154+0000 7f5a954b8640 1 --2- 172.21.15.90:0/2302679927 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5a7c077f70 0x7f5a7c07a430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5a80005fd0 tx=0x7f5a8000b390 comp rx=0 tx=0).stop 2024-09-10T23:15:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.154+0000 7f5a954b8640 1 -- 172.21.15.90:0/2302679927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a90160400 msgr2=0x7f5a9015a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.154+0000 7f5a954b8640 1 --2- 172.21.15.90:0/2302679927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a90160400 0x7f5a9015a920 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800e8e0 tx=0x7f5a8800eda0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.154+0000 7f5a954b8640 1 -- 172.21.15.90:0/2302679927 shutdown_connections 2024-09-10T23:15:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.154+0000 7f5a954b8640 1 --2- 172.21.15.90:0/2302679927 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5a7c077f70 0x7f5a7c07a430 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.154+0000 7f5a954b8640 1 --2- 172.21.15.90:0/2302679927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a90160020 0x7f5a901f84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.154+0000 7f5a954b8640 1 --2- 172.21.15.90:0/2302679927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a90160400 0x7f5a9015a920 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.154+0000 7f5a954b8640 1 --2- 172.21.15.90:0/2302679927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a900c8e60 0x7f5a900997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.154+0000 7f5a954b8640 1 -- 172.21.15.90:0/2302679927 >> 172.21.15.90:0/2302679927 conn(0x7f5a900d0490 msgr2=0x7f5a900c6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.154+0000 7f5a954b8640 1 -- 172.21.15.90:0/2302679927 shutdown_connections 2024-09-10T23:15:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.154+0000 7f5a954b8640 1 -- 172.21.15.90:0/2302679927 wait complete. 2024-09-10T23:15:58.158 INFO:tasks.ceph.mds.d.smithi171.stderr: -2038> 2024-09-10T23:15:49.483+0000 7f082e24f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:15:58.166 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:15:58.188 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-09-10T23:15:58.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.267+0000 7f1d0d07f640 1 -- 172.21.15.90:0/630485783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d080d21d0 msgr2=0x7f1d080d25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.267+0000 7f1d0d07f640 1 --2- 172.21.15.90:0/630485783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d080d21d0 0x7f1d080d25f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009830 tx=0x7f1cfc02a480 comp rx=0 tx=0).stop 2024-09-10T23:15:58.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.267+0000 7f1d0d07f640 1 -- 172.21.15.90:0/630485783 shutdown_connections 2024-09-10T23:15:58.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.267+0000 7f1d0d07f640 1 --2- 172.21.15.90:0/630485783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d080d21d0 0x7f1d080d25f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.267+0000 7f1d0d07f640 1 --2- 172.21.15.90:0/630485783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d0815e240 0x7f1d080d4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.267+0000 7f1d0d07f640 1 -- 172.21.15.90:0/630485783 >> 172.21.15.90:0/630485783 conn(0x7f1d080d4150 msgr2=0x7f1d080d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:58.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.267+0000 7f1d0d07f640 1 -- 172.21.15.90:0/630485783 shutdown_connections 2024-09-10T23:15:58.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.267+0000 7f1d0d07f640 1 -- 172.21.15.90:0/630485783 wait complete. 2024-09-10T23:15:58.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.269+0000 7f1d0d07f640 1 Processor -- start 2024-09-10T23:15:58.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.269+0000 7f1d0d07f640 1 -- start start 2024-09-10T23:15:58.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d0d07f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d080d21d0 0x7f1d0809f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:58.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d0d07f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d080d2b30 0x7f1d0809dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:58.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d0d07f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d0815e240 0x7f1d0814cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:58.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d0d07f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1d080b89d0 con 0x7f1d0815e240 2024-09-10T23:15:58.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d0d07f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1d080b8850 con 0x7f1d080d2b30 2024-09-10T23:15:58.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d0d07f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1d080b8b50 con 0x7f1d080d21d0 2024-09-10T23:15:58.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d0759e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d0815e240 0x7f1d0814cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:58.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d06d9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d080d21d0 0x7f1d0809f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:58.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d06d9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d080d21d0 0x7f1d0809f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.90:32934/0 (socket says 172.21.15.90:32934) 2024-09-10T23:15:58.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d06d9d640 1 -- 172.21.15.90:0/3585161408 learned_addr learned my addr 172.21.15.90:0/3585161408 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:58.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d0659c640 1 --2- 172.21.15.90:0/3585161408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d080d2b30 0x7f1d0809dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:58.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d06d9d640 1 -- 172.21.15.90:0/3585161408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d080d2b30 msgr2=0x7f1d0809dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d06d9d640 1 --2- 172.21.15.90:0/3585161408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d080d2b30 0x7f1d0809dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d06d9d640 1 -- 172.21.15.90:0/3585161408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d0815e240 msgr2=0x7f1d0814cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d06d9d640 1 --2- 172.21.15.90:0/3585161408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d0815e240 0x7f1d0814cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d06d9d640 1 -- 172.21.15.90:0/3585161408 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0814d6b0 con 0x7f1d080d21d0 2024-09-10T23:15:58.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d06d9d640 1 --2- 172.21.15.90:0/3585161408 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d080d21d0 0x7f1d0809f7a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800eb30 tx=0x7f1cf800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:58.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1cef7fe640 1 -- 172.21.15.90:0/3585161408 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8010430 con 0x7f1d080d21d0 2024-09-10T23:15:58.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1cef7fe640 1 -- 172.21.15.90:0/3585161408 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cf80105d0 con 0x7f1d080d21d0 2024-09-10T23:15:58.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d0d07f640 1 -- 172.21.15.90:0/3585161408 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d0814d990 con 0x7f1d080d21d0 2024-09-10T23:15:58.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1cef7fe640 1 -- 172.21.15.90:0/3585161408 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8010a20 con 0x7f1d080d21d0 2024-09-10T23:15:58.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.270+0000 7f1d0d07f640 1 -- 172.21.15.90:0/3585161408 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d0814df50 con 0x7f1d080d21d0 2024-09-10T23:15:58.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.271+0000 7f1d0d07f640 1 -- 172.21.15.90:0/3585161408 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d080d25f0 con 0x7f1d080d21d0 2024-09-10T23:15:58.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.272+0000 7f1cef7fe640 1 -- 172.21.15.90:0/3585161408 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1cf8010bc0 con 0x7f1d080d21d0 2024-09-10T23:15:58.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.273+0000 7f1cef7fe640 1 --2- 172.21.15.90:0/3585161408 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1cf4077f70 0x7f1cf407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:58.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.273+0000 7f1cef7fe640 1 -- 172.21.15.90:0/3585161408 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(47..47 src has 1..47) ==== 5795+0+0 (secure 0 0 0) 0x7f1cf809ad20 con 0x7f1d080d21d0 2024-09-10T23:15:58.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.273+0000 7f1d0659c640 1 --2- 172.21.15.90:0/3585161408 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1cf4077f70 0x7f1cf407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:58.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.273+0000 7f1d0659c640 1 --2- 172.21.15.90:0/3585161408 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1cf4077f70 0x7f1cf407a430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc034000 tx=0x7f1cfc004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:58.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.277+0000 7f1cef7fe640 1 -- 172.21.15.90:0/3585161408 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1cf8063150 con 0x7f1d080d21d0 2024-09-10T23:15:58.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:58.485+0000 7f1d0d07f640 1 -- 172.21.15.90:0/3585161408 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1d080b9770 con 0x7f1d080d21d0 2024-09-10T23:15:59.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.164+0000 7f1cef7fe640 1 -- 172.21.15.90:0/3585161408 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) ==== 104+0+0 (secure 0 0 0) 0x7f1cf8067b80 con 0x7f1d080d21d0 2024-09-10T23:15:59.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.166+0000 7f1d0d07f640 1 -- 172.21.15.90:0/3585161408 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1cf4077f70 msgr2=0x7f1cf407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.166+0000 7f1d0d07f640 1 --2- 172.21.15.90:0/3585161408 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1cf4077f70 0x7f1cf407a430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc034000 tx=0x7f1cfc004730 comp rx=0 tx=0).stop 2024-09-10T23:15:59.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.166+0000 7f1d0d07f640 1 -- 172.21.15.90:0/3585161408 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d080d21d0 msgr2=0x7f1d0809f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.166+0000 7f1d0d07f640 1 --2- 172.21.15.90:0/3585161408 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d080d21d0 0x7f1d0809f7a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800eb30 tx=0x7f1cf800c2d0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.166+0000 7f1d0d07f640 1 -- 172.21.15.90:0/3585161408 shutdown_connections 2024-09-10T23:15:59.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.166+0000 7f1d0d07f640 1 --2- 172.21.15.90:0/3585161408 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1cf4077f70 0x7f1cf407a430 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.166+0000 7f1d0d07f640 1 --2- 172.21.15.90:0/3585161408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d080d2b30 0x7f1d0809dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.166+0000 7f1d0d07f640 1 --2- 172.21.15.90:0/3585161408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d0815e240 0x7f1d0814cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.166+0000 7f1d0d07f640 1 --2- 172.21.15.90:0/3585161408 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d080d21d0 0x7f1d0809f7a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.166+0000 7f1d0d07f640 1 -- 172.21.15.90:0/3585161408 >> 172.21.15.90:0/3585161408 conn(0x7f1d080d4150 msgr2=0x7f1d080d4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:59.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.166+0000 7f1d0d07f640 1 -- 172.21.15.90:0/3585161408 shutdown_connections 2024-09-10T23:15:59.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.166+0000 7f1d0d07f640 1 -- 172.21.15.90:0/3585161408 wait complete. 2024-09-10T23:15:59.179 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:15:59.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.284+0000 7f3b0b233640 1 -- 172.21.15.90:0/3838921668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b040d4b50 msgr2=0x7f3b040cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.284+0000 7f3b0b233640 1 --2- 172.21.15.90:0/3838921668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b040d4b50 0x7f3b040cfa00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009830 tx=0x7f3af802a480 comp rx=0 tx=0).stop 2024-09-10T23:15:59.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.284+0000 7f3b0b233640 1 -- 172.21.15.90:0/3838921668 shutdown_connections 2024-09-10T23:15:59.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.284+0000 7f3b0b233640 1 --2- 172.21.15.90:0/3838921668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b040d0770 0x7f3b040d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.284+0000 7f3b0b233640 1 --2- 172.21.15.90:0/3838921668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b040d4b50 0x7f3b040cfa00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.284+0000 7f3b0b233640 1 -- 172.21.15.90:0/3838921668 >> 172.21.15.90:0/3838921668 conn(0x7f3b040d4030 msgr2=0x7f3b040d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:59.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.284+0000 7f3b0b233640 1 -- 172.21.15.90:0/3838921668 shutdown_connections 2024-09-10T23:15:59.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.284+0000 7f3b0b233640 1 -- 172.21.15.90:0/3838921668 wait complete. 2024-09-10T23:15:59.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.285+0000 7f3b0b233640 1 Processor -- start 2024-09-10T23:15:59.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.285+0000 7f3b0b233640 1 -- start start 2024-09-10T23:15:59.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.286+0000 7f3b0b233640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b040d0770 0x7f3b0414cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.286+0000 7f3b0b233640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b040d4b50 0x7f3b041f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.286+0000 7f3b0b233640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b0415e120 0x7f3b040c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.286+0000 7f3b0b233640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3b040b7210 con 0x7f3b0415e120 2024-09-10T23:15:59.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.286+0000 7f3b0b233640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3b040b7090 con 0x7f3b040d0770 2024-09-10T23:15:59.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.286+0000 7f3b0b233640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3b040b7390 con 0x7f3b040d4b50 2024-09-10T23:15:59.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.286+0000 7f3b097d0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b0415e120 0x7f3b040c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.286+0000 7f3b097d0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b0415e120 0x7f3b040c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37550/0 (socket says 172.21.15.90:37550) 2024-09-10T23:15:59.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.286+0000 7f3b097d0640 1 -- 172.21.15.90:0/3213826427 learned_addr learned my addr 172.21.15.90:0/3213826427 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:15:59.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.286+0000 7f3b03fff640 1 --2- 172.21.15.90:0/3213826427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b040d4b50 0x7f3b041f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.286+0000 7f3b08fcf640 1 --2- 172.21.15.90:0/3213826427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b040d0770 0x7f3b0414cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.286+0000 7f3b097d0640 1 -- 172.21.15.90:0/3213826427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b040d4b50 msgr2=0x7f3b041f88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.286+0000 7f3b097d0640 1 --2- 172.21.15.90:0/3213826427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b040d4b50 0x7f3b041f88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.286+0000 7f3b097d0640 1 -- 172.21.15.90:0/3213826427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b040d0770 msgr2=0x7f3b0414cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.286+0000 7f3b097d0640 1 --2- 172.21.15.90:0/3213826427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b040d0770 0x7f3b0414cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.286+0000 7f3b097d0640 1 -- 172.21.15.90:0/3213826427 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0414d6f0 con 0x7f3b0415e120 2024-09-10T23:15:59.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.286+0000 7f3b097d0640 1 --2- 172.21.15.90:0/3213826427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b0415e120 0x7f3b040c9b80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00c370 tx=0x7f3afc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:59.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.287+0000 7f3b017fa640 1 -- 172.21.15.90:0/3213826427 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc003970 con 0x7f3b0415e120 2024-09-10T23:15:59.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.287+0000 7f3b0b233640 1 -- 172.21.15.90:0/3213826427 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b0414d9d0 con 0x7f3b0415e120 2024-09-10T23:15:59.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.287+0000 7f3b017fa640 1 -- 172.21.15.90:0/3213826427 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3afc003c00 con 0x7f3b0415e120 2024-09-10T23:15:59.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.287+0000 7f3b017fa640 1 -- 172.21.15.90:0/3213826427 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc004020 con 0x7f3b0415e120 2024-09-10T23:15:59.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.287+0000 7f3b0b233640 1 -- 172.21.15.90:0/3213826427 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b04153800 con 0x7f3b0415e120 2024-09-10T23:15:59.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.288+0000 7f3b0b233640 1 -- 172.21.15.90:0/3213826427 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b040b7840 con 0x7f3b0415e120 2024-09-10T23:15:59.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.288+0000 7f3b017fa640 1 -- 172.21.15.90:0/3213826427 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3afc00b040 con 0x7f3b0415e120 2024-09-10T23:15:59.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.289+0000 7f3b017fa640 1 --2- 172.21.15.90:0/3213826427 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3af0077f70 0x7f3af007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.289+0000 7f3b017fa640 1 -- 172.21.15.90:0/3213826427 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5795+0+0 (secure 0 0 0) 0x7f3afc09a2f0 con 0x7f3b0415e120 2024-09-10T23:15:59.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.289+0000 7f3b08fcf640 1 --2- 172.21.15.90:0/3213826427 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3af0077f70 0x7f3af007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.289+0000 7f3b08fcf640 1 --2- 172.21.15.90:0/3213826427 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3af0077f70 0x7f3af007a430 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3af4001720 tx=0x7f3af4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:59.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.293+0000 7f3b017fa640 1 -- 172.21.15.90:0/3213826427 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3afc062750 con 0x7f3b0415e120 2024-09-10T23:15:59.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:15:59.467+0000 7f3b0b233640 1 -- 172.21.15.90:0/3213826427 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3b040d15e0 con 0x7f3b0415e120 2024-09-10T23:16:00.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.163+0000 7f3b017fa640 1 -- 172.21.15.90:0/3213826427 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v48) ==== 181+0+0 (secure 0 0 0) 0x7f3afc067180 con 0x7f3b0415e120 2024-09-10T23:16:00.164 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:16:00.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.166+0000 7f3b0b233640 1 -- 172.21.15.90:0/3213826427 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3af0077f70 msgr2=0x7f3af007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.166+0000 7f3b0b233640 1 --2- 172.21.15.90:0/3213826427 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3af0077f70 0x7f3af007a430 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3af4001720 tx=0x7f3af4009040 comp rx=0 tx=0).stop 2024-09-10T23:16:00.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.166+0000 7f3b0b233640 1 -- 172.21.15.90:0/3213826427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b0415e120 msgr2=0x7f3b040c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.166+0000 7f3b0b233640 1 --2- 172.21.15.90:0/3213826427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b0415e120 0x7f3b040c9b80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00c370 tx=0x7f3afc00c830 comp rx=0 tx=0).stop 2024-09-10T23:16:00.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.166+0000 7f3b0b233640 1 -- 172.21.15.90:0/3213826427 shutdown_connections 2024-09-10T23:16:00.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.166+0000 7f3b0b233640 1 --2- 172.21.15.90:0/3213826427 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3af0077f70 0x7f3af007a430 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.166+0000 7f3b0b233640 1 --2- 172.21.15.90:0/3213826427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b0415e120 0x7f3b040c9b80 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.166+0000 7f3b0b233640 1 --2- 172.21.15.90:0/3213826427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b040d4b50 0x7f3b041f88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.166+0000 7f3b0b233640 1 --2- 172.21.15.90:0/3213826427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b040d0770 0x7f3b0414cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.166+0000 7f3b0b233640 1 -- 172.21.15.90:0/3213826427 >> 172.21.15.90:0/3213826427 conn(0x7f3b040d4030 msgr2=0x7f3b040b94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.167+0000 7f3b0b233640 1 -- 172.21.15.90:0/3213826427 shutdown_connections 2024-09-10T23:16:00.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.167+0000 7f3b0b233640 1 -- 172.21.15.90:0/3213826427 wait complete. 2024-09-10T23:16:00.181 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:16:00.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.287+0000 7fcf3cab6640 1 -- 172.21.15.90:0/2683996597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3815f460 msgr2=0x7fcf381602e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.287+0000 7fcf3cab6640 1 --2- 172.21.15.90:0/2683996597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3815f460 0x7fcf381602e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fcf28005fd0 tx=0x7fcf2802a8e0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.287+0000 7fcf3cab6640 1 -- 172.21.15.90:0/2683996597 shutdown_connections 2024-09-10T23:16:00.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.287+0000 7fcf3cab6640 1 --2- 172.21.15.90:0/2683996597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf3815d4a0 0x7fcf380cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.287+0000 7fcf3cab6640 1 --2- 172.21.15.90:0/2683996597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3815f460 0x7fcf381602e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.287+0000 7fcf3cab6640 1 -- 172.21.15.90:0/2683996597 >> 172.21.15.90:0/2683996597 conn(0x7fcf380d0400 msgr2=0x7fcf380d0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.287+0000 7fcf3cab6640 1 -- 172.21.15.90:0/2683996597 shutdown_connections 2024-09-10T23:16:00.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.287+0000 7fcf3cab6640 1 -- 172.21.15.90:0/2683996597 wait complete. 2024-09-10T23:16:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.288+0000 7fcf3cab6640 1 Processor -- start 2024-09-10T23:16:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.288+0000 7fcf3cab6640 1 -- start start 2024-09-10T23:16:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf3cab6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf380688e0 0x7fcf380b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf3cab6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf3815d4a0 0x7fcf381e9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf3cab6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3815f460 0x7fcf381581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf3cab6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcf380cc840 con 0x7fcf3815f460 2024-09-10T23:16:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf3cab6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcf380cc6c0 con 0x7fcf380688e0 2024-09-10T23:16:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf3cab6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcf38074930 con 0x7fcf3815d4a0 2024-09-10T23:16:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf36d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3815f460 0x7fcf381581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf36d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3815f460 0x7fcf381581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37574/0 (socket says 172.21.15.90:37574) 2024-09-10T23:16:00.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf36d9d640 1 -- 172.21.15.90:0/289693845 learned_addr learned my addr 172.21.15.90:0/289693845 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:00.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf35d9b640 1 --2- 172.21.15.90:0/289693845 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf3815d4a0 0x7fcf381e9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf3659c640 1 --2- 172.21.15.90:0/289693845 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf380688e0 0x7fcf380b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf36d9d640 1 -- 172.21.15.90:0/289693845 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf3815d4a0 msgr2=0x7fcf381e9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf36d9d640 1 --2- 172.21.15.90:0/289693845 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf3815d4a0 0x7fcf381e9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf36d9d640 1 -- 172.21.15.90:0/289693845 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf380688e0 msgr2=0x7fcf380b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf36d9d640 1 --2- 172.21.15.90:0/289693845 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf380688e0 0x7fcf380b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf36d9d640 1 -- 172.21.15.90:0/289693845 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf381f7f10 con 0x7fcf3815f460 2024-09-10T23:16:00.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf36d9d640 1 --2- 172.21.15.90:0/289693845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3815f460 0x7fcf381581c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000c410 tx=0x7fcf3000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf26ffd640 1 -- 172.21.15.90:0/289693845 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf30017070 con 0x7fcf3815f460 2024-09-10T23:16:00.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.289+0000 7fcf26ffd640 1 -- 172.21.15.90:0/289693845 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf30007320 con 0x7fcf3815f460 2024-09-10T23:16:00.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.290+0000 7fcf3cab6640 1 -- 172.21.15.90:0/289693845 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf381f81f0 con 0x7fcf3815f460 2024-09-10T23:16:00.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.290+0000 7fcf26ffd640 1 -- 172.21.15.90:0/289693845 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf300067d0 con 0x7fcf3815f460 2024-09-10T23:16:00.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.290+0000 7fcf3cab6640 1 -- 172.21.15.90:0/289693845 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf381f87b0 con 0x7fcf3815f460 2024-09-10T23:16:00.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.291+0000 7fcf3cab6640 1 -- 172.21.15.90:0/289693845 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf38074e40 con 0x7fcf3815f460 2024-09-10T23:16:00.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.291+0000 7fcf26ffd640 1 -- 172.21.15.90:0/289693845 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcf30006970 con 0x7fcf3815f460 2024-09-10T23:16:00.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.291+0000 7fcf26ffd640 1 --2- 172.21.15.90:0/289693845 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcf18077f70 0x7fcf1807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.292+0000 7fcf26ffd640 1 -- 172.21.15.90:0/289693845 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5357+0+0 (secure 0 0 0) 0x7fcf300991c0 con 0x7fcf3815f460 2024-09-10T23:16:00.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.292+0000 7fcf3659c640 1 --2- 172.21.15.90:0/289693845 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcf18077f70 0x7fcf1807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.292+0000 7fcf3659c640 1 --2- 172.21.15.90:0/289693845 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcf18077f70 0x7fcf1807a430 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcf28035000 tx=0x7fcf28004ab0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.296+0000 7fcf26ffd640 1 -- 172.21.15.90:0/289693845 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcf300617d0 con 0x7fcf3815f460 2024-09-10T23:16:00.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:00.468+0000 7fcf3cab6640 1 -- 172.21.15.90:0/289693845 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcf381f8980 con 0x7fcf3815f460 2024-09-10T23:16:01.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.169+0000 7fcf26ffd640 1 -- 172.21.15.90:0/289693845 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v49) ==== 169+0+0 (secure 0 0 0) 0x7fcf30066200 con 0x7fcf3815f460 2024-09-10T23:16:01.171 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' removed 2024-09-10T23:16:01.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.172+0000 7fcf3cab6640 1 -- 172.21.15.90:0/289693845 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcf18077f70 msgr2=0x7fcf1807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.172+0000 7fcf3cab6640 1 --2- 172.21.15.90:0/289693845 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcf18077f70 0x7fcf1807a430 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcf28035000 tx=0x7fcf28004ab0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.172+0000 7fcf3cab6640 1 -- 172.21.15.90:0/289693845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3815f460 msgr2=0x7fcf381581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.172+0000 7fcf3cab6640 1 --2- 172.21.15.90:0/289693845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3815f460 0x7fcf381581c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000c410 tx=0x7fcf3000c8d0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.172+0000 7fcf3cab6640 1 -- 172.21.15.90:0/289693845 shutdown_connections 2024-09-10T23:16:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.172+0000 7fcf3cab6640 1 --2- 172.21.15.90:0/289693845 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcf18077f70 0x7fcf1807a430 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.172+0000 7fcf3cab6640 1 --2- 172.21.15.90:0/289693845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3815f460 0x7fcf381581c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.172+0000 7fcf3cab6640 1 --2- 172.21.15.90:0/289693845 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf3815d4a0 0x7fcf381e9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.172+0000 7fcf3cab6640 1 --2- 172.21.15.90:0/289693845 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf380688e0 0x7fcf380b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.172+0000 7fcf3cab6640 1 -- 172.21.15.90:0/289693845 >> 172.21.15.90:0/289693845 conn(0x7fcf380d0400 msgr2=0x7fcf3815ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.172+0000 7fcf3cab6640 1 -- 172.21.15.90:0/289693845 shutdown_connections 2024-09-10T23:16:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.172+0000 7fcf3cab6640 1 -- 172.21.15.90:0/289693845 wait complete. 2024-09-10T23:16:01.189 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:16:01.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.292+0000 7f4e33b2c640 1 -- 172.21.15.90:0/4117901114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e18004b10 msgr2=0x7f4e18004f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.292+0000 7f4e33b2c640 1 --2- 172.21.15.90:0/4117901114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e18004b10 0x7f4e18004f10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800c710 tx=0x7f4e18006940 comp rx=0 tx=0).stop 2024-09-10T23:16:01.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.292+0000 7f4e33b2c640 1 -- 172.21.15.90:0/4117901114 shutdown_connections 2024-09-10T23:16:01.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.292+0000 7f4e33b2c640 1 --2- 172.21.15.90:0/4117901114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e18004b10 0x7f4e18004f10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.292+0000 7f4e33b2c640 1 -- 172.21.15.90:0/4117901114 >> 172.21.15.90:0/4117901114 conn(0x7f4e2c0cc850 msgr2=0x7f4e2c0ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.292+0000 7f4e33b2c640 1 -- 172.21.15.90:0/4117901114 shutdown_connections 2024-09-10T23:16:01.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.292+0000 7f4e33b2c640 1 -- 172.21.15.90:0/4117901114 wait complete. 2024-09-10T23:16:01.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.294+0000 7f4e33b2c640 1 Processor -- start 2024-09-10T23:16:01.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.294+0000 7f4e33b2c640 1 -- start start 2024-09-10T23:16:01.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.294+0000 7f4e33b2c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e18004b10 0x7f4e2c1f0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.294+0000 7f4e33b2c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e2c073ef0 0x7f4e2c09c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.294+0000 7f4e33b2c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e2c09ca30 0x7f4e2c0ce630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.294+0000 7f4e33b2c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c0ca5a0 con 0x7f4e2c073ef0 2024-09-10T23:16:01.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.294+0000 7f4e33b2c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c0ca420 con 0x7f4e18004b10 2024-09-10T23:16:01.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.294+0000 7f4e33b2c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4e2c0ca720 con 0x7f4e2c09ca30 2024-09-10T23:16:01.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.294+0000 7f4e310c7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e2c073ef0 0x7f4e2c09c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.294+0000 7f4e310c7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e2c073ef0 0x7f4e2c09c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37588/0 (socket says 172.21.15.90:37588) 2024-09-10T23:16:01.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.294+0000 7f4e310c7640 1 -- 172.21.15.90:0/4126542521 learned_addr learned my addr 172.21.15.90:0/4126542521 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:01.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.295+0000 7f4e318c8640 1 --2- 172.21.15.90:0/4126542521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e18004b10 0x7f4e2c1f0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.295+0000 7f4e320c9640 1 --2- 172.21.15.90:0/4126542521 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e2c09ca30 0x7f4e2c0ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.295+0000 7f4e310c7640 1 -- 172.21.15.90:0/4126542521 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e2c09ca30 msgr2=0x7f4e2c0ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.295+0000 7f4e310c7640 1 --2- 172.21.15.90:0/4126542521 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e2c09ca30 0x7f4e2c0ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.295+0000 7f4e310c7640 1 -- 172.21.15.90:0/4126542521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e18004b10 msgr2=0x7f4e2c1f0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.295+0000 7f4e310c7640 1 --2- 172.21.15.90:0/4126542521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e18004b10 0x7f4e2c1f0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.295+0000 7f4e310c7640 1 -- 172.21.15.90:0/4126542521 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2c072960 con 0x7f4e2c073ef0 2024-09-10T23:16:01.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.295+0000 7f4e310c7640 1 --2- 172.21.15.90:0/4126542521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e2c073ef0 0x7f4e2c09c4f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c00e570 tx=0x7f4e1c00ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.295+0000 7f4e227fc640 1 -- 172.21.15.90:0/4126542521 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c015070 con 0x7f4e2c073ef0 2024-09-10T23:16:01.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.295+0000 7f4e227fc640 1 -- 172.21.15.90:0/4126542521 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e1c010980 con 0x7f4e2c073ef0 2024-09-10T23:16:01.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.295+0000 7f4e33b2c640 1 -- 172.21.15.90:0/4126542521 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2c072c40 con 0x7f4e2c073ef0 2024-09-10T23:16:01.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.295+0000 7f4e227fc640 1 -- 172.21.15.90:0/4126542521 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c010d70 con 0x7f4e2c073ef0 2024-09-10T23:16:01.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.295+0000 7f4e33b2c640 1 -- 172.21.15.90:0/4126542521 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2c073200 con 0x7f4e2c073ef0 2024-09-10T23:16:01.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.296+0000 7f4e33b2c640 1 -- 172.21.15.90:0/4126542521 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e2c0b1930 con 0x7f4e2c073ef0 2024-09-10T23:16:01.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.296+0000 7f4e227fc640 1 -- 172.21.15.90:0/4126542521 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4e1c011460 con 0x7f4e2c073ef0 2024-09-10T23:16:01.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.297+0000 7f4e227fc640 1 --2- 172.21.15.90:0/4126542521 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e10077f70 0x7f4e1007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.297+0000 7f4e227fc640 1 -- 172.21.15.90:0/4126542521 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f4e1c09a100 con 0x7f4e2c073ef0 2024-09-10T23:16:01.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.297+0000 7f4e318c8640 1 --2- 172.21.15.90:0/4126542521 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e10077f70 0x7f4e1007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.298+0000 7f4e318c8640 1 --2- 172.21.15.90:0/4126542521 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e10077f70 0x7f4e1007a430 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4e28032000 tx=0x7f4e28003760 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.301+0000 7f4e227fc640 1 -- 172.21.15.90:0/4126542521 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4e1c062f00 con 0x7f4e2c073ef0 2024-09-10T23:16:01.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.486+0000 7f4e33b2c640 1 -- 172.21.15.90:0/4126542521 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f4e2c0b5d50 con 0x7f4e2c073ef0 2024-09-10T23:16:01.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.489+0000 7f4e227fc640 1 -- 172.21.15.90:0/4126542521 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v32) ==== 71+0+0 (secure 0 0 0) 0x7f4e1c062800 con 0x7f4e2c073ef0 2024-09-10T23:16:01.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.491+0000 7f4e33b2c640 1 -- 172.21.15.90:0/4126542521 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e10077f70 msgr2=0x7f4e1007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.491+0000 7f4e33b2c640 1 --2- 172.21.15.90:0/4126542521 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e10077f70 0x7f4e1007a430 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4e28032000 tx=0x7f4e28003760 comp rx=0 tx=0).stop 2024-09-10T23:16:01.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.491+0000 7f4e33b2c640 1 -- 172.21.15.90:0/4126542521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e2c073ef0 msgr2=0x7f4e2c09c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.491+0000 7f4e33b2c640 1 --2- 172.21.15.90:0/4126542521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e2c073ef0 0x7f4e2c09c4f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c00e570 tx=0x7f4e1c00ea30 comp rx=0 tx=0).stop 2024-09-10T23:16:01.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.491+0000 7f4e33b2c640 1 -- 172.21.15.90:0/4126542521 shutdown_connections 2024-09-10T23:16:01.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.491+0000 7f4e33b2c640 1 --2- 172.21.15.90:0/4126542521 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4e10077f70 0x7f4e1007a430 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.491+0000 7f4e33b2c640 1 --2- 172.21.15.90:0/4126542521 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e2c09ca30 0x7f4e2c0ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.491+0000 7f4e33b2c640 1 --2- 172.21.15.90:0/4126542521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e2c073ef0 0x7f4e2c09c4f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.491+0000 7f4e33b2c640 1 --2- 172.21.15.90:0/4126542521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e18004b10 0x7f4e2c1f0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.491+0000 7f4e33b2c640 1 -- 172.21.15.90:0/4126542521 >> 172.21.15.90:0/4126542521 conn(0x7f4e2c0cc850 msgr2=0x7f4e2c15c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.491+0000 7f4e33b2c640 1 -- 172.21.15.90:0/4126542521 shutdown_connections 2024-09-10T23:16:01.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.491+0000 7f4e33b2c640 1 -- 172.21.15.90:0/4126542521 wait complete. 2024-09-10T23:16:01.503 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted' 2024-09-10T23:16:01.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.603+0000 7fc570eed640 1 -- 172.21.15.90:0/4078430360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc56c0aef50 msgr2=0x7fc56c0cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.603+0000 7fc570eed640 1 --2- 172.21.15.90:0/4078430360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc56c0aef50 0x7fc56c0cd9a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc554009830 tx=0x7fc55402a470 comp rx=0 tx=0).stop 2024-09-10T23:16:01.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.603+0000 7fc570eed640 1 -- 172.21.15.90:0/4078430360 shutdown_connections 2024-09-10T23:16:01.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.603+0000 7fc570eed640 1 --2- 172.21.15.90:0/4078430360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc56c0ca420 0x7fc56c0ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.603+0000 7fc570eed640 1 --2- 172.21.15.90:0/4078430360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc56c0aef50 0x7fc56c0cd9a0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.603+0000 7fc570eed640 1 -- 172.21.15.90:0/4078430360 >> 172.21.15.90:0/4078430360 conn(0x7fc56c0cc850 msgr2=0x7fc56c0ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.603+0000 7fc570eed640 1 -- 172.21.15.90:0/4078430360 shutdown_connections 2024-09-10T23:16:01.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.603+0000 7fc570eed640 1 -- 172.21.15.90:0/4078430360 wait complete. 2024-09-10T23:16:01.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.604+0000 7fc570eed640 1 Processor -- start 2024-09-10T23:16:01.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.604+0000 7fc570eed640 1 -- start start 2024-09-10T23:16:01.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.605+0000 7fc570eed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc56c0aef50 0x7fc56c074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.605+0000 7fc570eed640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc56c0ca420 0x7fc56c151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.605+0000 7fc570eed640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc56c157fc0 0x7fc56c14e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.605+0000 7fc570eed640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c0b18c0 con 0x7fc56c0aef50 2024-09-10T23:16:01.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.605+0000 7fc570eed640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c0ce0f0 con 0x7fc56c157fc0 2024-09-10T23:16:01.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.605+0000 7fc570eed640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc56c0b1a40 con 0x7fc56c0ca420 2024-09-10T23:16:01.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.605+0000 7fc56a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc56c0aef50 0x7fc56c074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.605+0000 7fc56a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc56c0aef50 0x7fc56c074600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37618/0 (socket says 172.21.15.90:37618) 2024-09-10T23:16:01.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.605+0000 7fc56a59c640 1 -- 172.21.15.90:0/2422619696 learned_addr learned my addr 172.21.15.90:0/2422619696 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:01.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.605+0000 7fc569d9b640 1 --2- 172.21.15.90:0/2422619696 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc56c0ca420 0x7fc56c151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.606+0000 7fc56ad9d640 1 --2- 172.21.15.90:0/2422619696 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc56c157fc0 0x7fc56c14e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.606+0000 7fc56a59c640 1 -- 172.21.15.90:0/2422619696 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc56c0ca420 msgr2=0x7fc56c151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.606+0000 7fc56a59c640 1 --2- 172.21.15.90:0/2422619696 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc56c0ca420 0x7fc56c151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.606+0000 7fc56a59c640 1 -- 172.21.15.90:0/2422619696 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc56c157fc0 msgr2=0x7fc56c14e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.606+0000 7fc56a59c640 1 --2- 172.21.15.90:0/2422619696 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc56c157fc0 0x7fc56c14e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.606+0000 7fc56a59c640 1 -- 172.21.15.90:0/2422619696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56c152190 con 0x7fc56c0aef50 2024-09-10T23:16:01.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.606+0000 7fc569d9b640 1 --2- 172.21.15.90:0/2422619696 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc56c0ca420 0x7fc56c151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:01.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.606+0000 7fc56ad9d640 1 --2- 172.21.15.90:0/2422619696 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc56c157fc0 0x7fc56c14e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:01.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.606+0000 7fc56a59c640 1 --2- 172.21.15.90:0/2422619696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc56c0aef50 0x7fc56c074600 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00cbf0 tx=0x7fc55c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.606+0000 7fc562ffd640 1 -- 172.21.15.90:0/2422619696 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c016020 con 0x7fc56c0aef50 2024-09-10T23:16:01.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.606+0000 7fc562ffd640 1 -- 172.21.15.90:0/2422619696 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc55c00ad90 con 0x7fc56c0aef50 2024-09-10T23:16:01.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.606+0000 7fc570eed640 1 -- 172.21.15.90:0/2422619696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56c152430 con 0x7fc56c0aef50 2024-09-10T23:16:01.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.606+0000 7fc562ffd640 1 -- 172.21.15.90:0/2422619696 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c012680 con 0x7fc56c0aef50 2024-09-10T23:16:01.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.606+0000 7fc570eed640 1 -- 172.21.15.90:0/2422619696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc56c152cd0 con 0x7fc56c0aef50 2024-09-10T23:16:01.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.607+0000 7fc570eed640 1 -- 172.21.15.90:0/2422619696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc56c0cd9a0 con 0x7fc56c0aef50 2024-09-10T23:16:01.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.608+0000 7fc562ffd640 1 -- 172.21.15.90:0/2422619696 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc55c01b400 con 0x7fc56c0aef50 2024-09-10T23:16:01.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.608+0000 7fc562ffd640 1 --2- 172.21.15.90:0/2422619696 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc54c077f70 0x7fc54c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.608+0000 7fc562ffd640 1 -- 172.21.15.90:0/2422619696 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7fc55c09a340 con 0x7fc56c0aef50 2024-09-10T23:16:01.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.608+0000 7fc569d9b640 1 --2- 172.21.15.90:0/2422619696 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc54c077f70 0x7fc54c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.609+0000 7fc569d9b640 1 --2- 172.21.15.90:0/2422619696 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc54c077f70 0x7fc54c07a430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc554034000 tx=0x7fc554004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.612+0000 7fc562ffd640 1 -- 172.21.15.90:0/2422619696 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc55c020020 con 0x7fc56c0aef50 2024-09-10T23:16:01.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:01.853+0000 7fc570eed640 1 -- 172.21.15.90:0/2422619696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]} v 0) -- 0x7fc56c0b2030 con 0x7fc56c0aef50 2024-09-10T23:16:02.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.173+0000 7fc562ffd640 1 -- 172.21.15.90:0/2422619696 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]}]=0 v103) ==== 153+0+0 (secure 0 0 0) 0x7fc55c063130 con 0x7fc56c0aef50 2024-09-10T23:16:02.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.176+0000 7fc570eed640 1 -- 172.21.15.90:0/2422619696 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc54c077f70 msgr2=0x7fc54c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.176+0000 7fc570eed640 1 --2- 172.21.15.90:0/2422619696 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc54c077f70 0x7fc54c07a430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc554034000 tx=0x7fc554004730 comp rx=0 tx=0).stop 2024-09-10T23:16:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.176+0000 7fc570eed640 1 -- 172.21.15.90:0/2422619696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc56c0aef50 msgr2=0x7fc56c074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.176+0000 7fc570eed640 1 --2- 172.21.15.90:0/2422619696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc56c0aef50 0x7fc56c074600 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00cbf0 tx=0x7fc55c00a060 comp rx=0 tx=0).stop 2024-09-10T23:16:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.176+0000 7fc570eed640 1 -- 172.21.15.90:0/2422619696 shutdown_connections 2024-09-10T23:16:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.176+0000 7fc570eed640 1 --2- 172.21.15.90:0/2422619696 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc54c077f70 0x7fc54c07a430 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.176+0000 7fc570eed640 1 --2- 172.21.15.90:0/2422619696 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc56c157fc0 0x7fc56c14e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.176+0000 7fc570eed640 1 --2- 172.21.15.90:0/2422619696 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc56c0ca420 0x7fc56c151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.176+0000 7fc570eed640 1 --2- 172.21.15.90:0/2422619696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc56c0aef50 0x7fc56c074600 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.176+0000 7fc570eed640 1 -- 172.21.15.90:0/2422619696 >> 172.21.15.90:0/2422619696 conn(0x7fc56c0cc850 msgr2=0x7fc56c0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.176+0000 7fc570eed640 1 -- 172.21.15.90:0/2422619696 shutdown_connections 2024-09-10T23:16:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.176+0000 7fc570eed640 1 -- 172.21.15.90:0/2422619696 wait complete. 2024-09-10T23:16:02.189 INFO:tasks.cephfs_test_runner:Check that mds evicts blocklisted client ... skipped 'Requires FUSE client to use mds_cluster.is_addr_blocklisted()' 2024-09-10T23:16:02.189 INFO:tasks.cephfs_test_runner:Starting test: test_session_evict_non_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) Check that mds evicts without blocklisting client 2024-09-10T23:16:02.190 INFO:tasks.cephfs_test_runner:test_session_evict_non_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-10T23:16:02.190 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:16:02.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.291+0000 7f514f55a640 1 -- 172.21.15.90:0/366024954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f514815c0c0 msgr2=0x7f51480d2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.291+0000 7f514f55a640 1 --2- 172.21.15.90:0/366024954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f514815c0c0 0x7f51480d2960 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f51400098e0 tx=0x7f514002a5d0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.291+0000 7f514f55a640 1 -- 172.21.15.90:0/366024954 shutdown_connections 2024-09-10T23:16:02.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.291+0000 7f514f55a640 1 --2- 172.21.15.90:0/366024954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51480cf1f0 0x7f51480cfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.291+0000 7f514f55a640 1 --2- 172.21.15.90:0/366024954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f514815c0c0 0x7f51480d2960 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.291+0000 7f514f55a640 1 -- 172.21.15.90:0/366024954 >> 172.21.15.90:0/366024954 conn(0x7f51480d1dd0 msgr2=0x7f51480d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:02.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.291+0000 7f514f55a640 1 -- 172.21.15.90:0/366024954 shutdown_connections 2024-09-10T23:16:02.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.291+0000 7f514f55a640 1 -- 172.21.15.90:0/366024954 wait complete. 2024-09-10T23:16:02.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.292+0000 7f514f55a640 1 Processor -- start 2024-09-10T23:16:02.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.292+0000 7f514f55a640 1 -- start start 2024-09-10T23:16:02.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f514f55a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51480cf1f0 0x7f51481579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f514f55a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51480d0390 0x7f51480c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f514f55a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f514815c0c0 0x7f51480c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f514f55a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51480cdd30 con 0x7f51480cf1f0 2024-09-10T23:16:02.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f514f55a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f51480cdbb0 con 0x7f51480d0390 2024-09-10T23:16:02.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f514f55a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f51481601b0 con 0x7f514815c0c0 2024-09-10T23:16:02.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f514d2f6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51480cf1f0 0x7f51481579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f514d2f6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51480cf1f0 0x7f51481579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37636/0 (socket says 172.21.15.90:37636) 2024-09-10T23:16:02.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f514d2f6640 1 -- 172.21.15.90:0/3265389778 learned_addr learned my addr 172.21.15.90:0/3265389778 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:02.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f514caf5640 1 --2- 172.21.15.90:0/3265389778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51480d0390 0x7f51480c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f514daf7640 1 --2- 172.21.15.90:0/3265389778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f514815c0c0 0x7f51480c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f514d2f6640 1 -- 172.21.15.90:0/3265389778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f514815c0c0 msgr2=0x7f51480c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f514d2f6640 1 --2- 172.21.15.90:0/3265389778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f514815c0c0 0x7f51480c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f514d2f6640 1 -- 172.21.15.90:0/3265389778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51480d0390 msgr2=0x7f51480c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f514d2f6640 1 --2- 172.21.15.90:0/3265389778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51480d0390 0x7f51480c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f514d2f6640 1 -- 172.21.15.90:0/3265389778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51480cc0c0 con 0x7f51480cf1f0 2024-09-10T23:16:02.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f514d2f6640 1 --2- 172.21.15.90:0/3265389778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51480cf1f0 0x7f51481579a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f514002abc0 tx=0x7f51400316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f5145ffb640 1 -- 172.21.15.90:0/3265389778 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514003f070 con 0x7f51480cf1f0 2024-09-10T23:16:02.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.293+0000 7f5145ffb640 1 -- 172.21.15.90:0/3265389778 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5140031950 con 0x7f51480cf1f0 2024-09-10T23:16:02.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.294+0000 7f514f55a640 1 -- 172.21.15.90:0/3265389778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51481f6480 con 0x7f51480cf1f0 2024-09-10T23:16:02.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.294+0000 7f5145ffb640 1 -- 172.21.15.90:0/3265389778 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140031da0 con 0x7f51480cf1f0 2024-09-10T23:16:02.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.294+0000 7f514f55a640 1 -- 172.21.15.90:0/3265389778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51481f6a40 con 0x7f51480cf1f0 2024-09-10T23:16:02.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.295+0000 7f514f55a640 1 -- 172.21.15.90:0/3265389778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5148160740 con 0x7f51480cf1f0 2024-09-10T23:16:02.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.295+0000 7f5145ffb640 1 -- 172.21.15.90:0/3265389778 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5140005140 con 0x7f51480cf1f0 2024-09-10T23:16:02.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.296+0000 7f5145ffb640 1 --2- 172.21.15.90:0/3265389778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5134077f70 0x7f513407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.296+0000 7f5145ffb640 1 -- 172.21.15.90:0/3265389778 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f51400ba940 con 0x7f51480cf1f0 2024-09-10T23:16:02.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.296+0000 7f514caf5640 1 --2- 172.21.15.90:0/3265389778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5134077f70 0x7f513407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.297+0000 7f514caf5640 1 --2- 172.21.15.90:0/3265389778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5134077f70 0x7f513407a430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f513c005fd0 tx=0x7f513c005850 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.300+0000 7f5145ffb640 1 -- 172.21.15.90:0/3265389778 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5140083750 con 0x7f51480cf1f0 2024-09-10T23:16:02.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.475+0000 7f514f55a640 1 -- 172.21.15.90:0/3265389778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f514815aed0 con 0x7f51480cf1f0 2024-09-10T23:16:02.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.476+0000 7f5145ffb640 1 -- 172.21.15.90:0/3265389778 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+13034 (secure 0 0 0) 0x7f514008ae20 con 0x7f51480cf1f0 2024-09-10T23:16:02.477 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:02.477 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":49,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:16:01.164680+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.171:6837/4106111677":"2024-09-11T23:15:58.151200+0000","172.21.15.171:6835/4106111677":"2024-09-11T23:15:58.151200+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:16:02.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.478+0000 7f514f55a640 1 -- 172.21.15.90:0/3265389778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5134077f70 msgr2=0x7f513407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.478+0000 7f514f55a640 1 --2- 172.21.15.90:0/3265389778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5134077f70 0x7f513407a430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f513c005fd0 tx=0x7f513c005850 comp rx=0 tx=0).stop 2024-09-10T23:16:02.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.478+0000 7f514f55a640 1 -- 172.21.15.90:0/3265389778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51480cf1f0 msgr2=0x7f51481579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.478+0000 7f514f55a640 1 --2- 172.21.15.90:0/3265389778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51480cf1f0 0x7f51481579a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f514002abc0 tx=0x7f51400316b0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.478+0000 7f514f55a640 1 -- 172.21.15.90:0/3265389778 shutdown_connections 2024-09-10T23:16:02.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.478+0000 7f514f55a640 1 --2- 172.21.15.90:0/3265389778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5134077f70 0x7f513407a430 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.478+0000 7f514f55a640 1 --2- 172.21.15.90:0/3265389778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51480d0390 0x7f51480c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.478+0000 7f514f55a640 1 --2- 172.21.15.90:0/3265389778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f514815c0c0 0x7f51480c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.478+0000 7f514f55a640 1 --2- 172.21.15.90:0/3265389778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51480cf1f0 0x7f51481579a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.478+0000 7f514f55a640 1 -- 172.21.15.90:0/3265389778 >> 172.21.15.90:0/3265389778 conn(0x7f51480d1dd0 msgr2=0x7f51480720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:02.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.479+0000 7f514f55a640 1 -- 172.21.15.90:0/3265389778 shutdown_connections 2024-09-10T23:16:02.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.479+0000 7f514f55a640 1 -- 172.21.15.90:0/3265389778 wait complete. 2024-09-10T23:16:02.491 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:14:26.449950+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:16:02.491 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.594+0000 7f2eb7cfe640 1 -- 172.21.15.90:0/1881750361 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e9c004d40 msgr2=0x7f2e9c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.594+0000 7f2eb7cfe640 1 --2- 172.21.15.90:0/1881750361 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e9c004d40 0x7f2e9c0051c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8005fd0 tx=0x7f2e9c005830 comp rx=0 tx=0).stop 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.594+0000 7f2eb629b640 1 -- 172.21.15.90:0/1881750361 reap_dead start 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.594+0000 7f2eb7cfe640 1 -- 172.21.15.90:0/1881750361 shutdown_connections 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.594+0000 7f2eb7cfe640 1 -- 172.21.15.90:0/1881750361 >> 172.21.15.90:0/1881750361 conn(0x7f2eb00d4190 msgr2=0x7f2eb00d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.594+0000 7f2eb7cfe640 1 -- 172.21.15.90:0/1881750361 shutdown_connections 2024-09-10T23:16:02.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.594+0000 7f2eb7cfe640 1 -- 172.21.15.90:0/1881750361 wait complete. 2024-09-10T23:16:02.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.595+0000 7f2eb7cfe640 1 Processor -- start 2024-09-10T23:16:02.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.595+0000 7f2eb7cfe640 1 -- start start 2024-09-10T23:16:02.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb7cfe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e9c004d40 0x7f2eb01f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb7cfe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2eb00cdbd0 0x7f2eb00cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb7cfe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2eb00cbd40 0x7f2eb01572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb7cfe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb00b8d90 con 0x7f2eb00cbd40 2024-09-10T23:16:02.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb7cfe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb00b8c10 con 0x7f2e9c004d40 2024-09-10T23:16:02.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb7cfe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb00b8f10 con 0x7f2eb00cdbd0 2024-09-10T23:16:02.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb629b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2eb00cbd40 0x7f2eb01572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb629b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2eb00cbd40 0x7f2eb01572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37648/0 (socket says 172.21.15.90:37648) 2024-09-10T23:16:02.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb629b640 1 -- 172.21.15.90:0/2797772726 learned_addr learned my addr 172.21.15.90:0/2797772726 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:02.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb5299640 1 --2- 172.21.15.90:0/2797772726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2eb00cdbd0 0x7f2eb00cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb5a9a640 1 --2- 172.21.15.90:0/2797772726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e9c004d40 0x7f2eb01f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb629b640 1 -- 172.21.15.90:0/2797772726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2eb00cdbd0 msgr2=0x7f2eb00cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb629b640 1 --2- 172.21.15.90:0/2797772726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2eb00cdbd0 0x7f2eb00cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb629b640 1 -- 172.21.15.90:0/2797772726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e9c004d40 msgr2=0x7f2eb01f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb629b640 1 --2- 172.21.15.90:0/2797772726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e9c004d40 0x7f2eb01f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb629b640 1 -- 172.21.15.90:0/2797772726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb01f9010 con 0x7f2eb00cbd40 2024-09-10T23:16:02.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb5299640 1 --2- 172.21.15.90:0/2797772726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2eb00cdbd0 0x7f2eb00cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:02.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.596+0000 7f2eb629b640 1 --2- 172.21.15.90:0/2797772726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2eb00cbd40 0x7f2eb01572c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8002230 tx=0x7f2ea8034bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.597+0000 7f2ea27fc640 1 -- 172.21.15.90:0/2797772726 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8043070 con 0x7f2eb00cbd40 2024-09-10T23:16:02.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.597+0000 7f2ea27fc640 1 -- 172.21.15.90:0/2797772726 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ea8034ca0 con 0x7f2eb00cbd40 2024-09-10T23:16:02.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.597+0000 7f2eb7cfe640 1 -- 172.21.15.90:0/2797772726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb01f8490 con 0x7f2eb00cbd40 2024-09-10T23:16:02.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.597+0000 7f2ea27fc640 1 -- 172.21.15.90:0/2797772726 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8038040 con 0x7f2eb00cbd40 2024-09-10T23:16:02.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.597+0000 7f2eb7cfe640 1 -- 172.21.15.90:0/2797772726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb01f8a50 con 0x7f2eb00cbd40 2024-09-10T23:16:02.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.598+0000 7f2eb7cfe640 1 -- 172.21.15.90:0/2797772726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb00d2ea0 con 0x7f2eb00cbd40 2024-09-10T23:16:02.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.598+0000 7f2ea27fc640 1 -- 172.21.15.90:0/2797772726 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2ea803b050 con 0x7f2eb00cbd40 2024-09-10T23:16:02.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.599+0000 7f2ea27fc640 1 --2- 172.21.15.90:0/2797772726 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2e94077fd0 0x7f2e9407a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.599+0000 7f2ea27fc640 1 -- 172.21.15.90:0/2797772726 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f2ea80b9760 con 0x7f2eb00cbd40 2024-09-10T23:16:02.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.599+0000 7f2eb5a9a640 1 --2- 172.21.15.90:0/2797772726 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2e94077fd0 0x7f2e9407a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.600+0000 7f2eb5a9a640 1 --2- 172.21.15.90:0/2797772726 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2e94077fd0 0x7f2e9407a490 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009b50 tx=0x7f2ea4005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.603+0000 7f2ea27fc640 1 -- 172.21.15.90:0/2797772726 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2ea8081e80 con 0x7f2eb00cbd40 2024-09-10T23:16:02.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.779+0000 7f2eb7cfe640 1 -- 172.21.15.90:0/2797772726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2eb01e7520 con 0x7f2eb00cbd40 2024-09-10T23:16:02.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.780+0000 7f2ea27fc640 1 -- 172.21.15.90:0/2797772726 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) ==== 93+0+10 (secure 0 0 0) 0x7f2ea80868b0 con 0x7f2eb00cbd40 2024-09-10T23:16:02.781 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-09-10T23:16:02.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.782+0000 7f2eb7cfe640 1 -- 172.21.15.90:0/2797772726 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2e94077fd0 msgr2=0x7f2e9407a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.782+0000 7f2eb7cfe640 1 --2- 172.21.15.90:0/2797772726 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2e94077fd0 0x7f2e9407a490 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009b50 tx=0x7f2ea4005f90 comp rx=0 tx=0).stop 2024-09-10T23:16:02.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.782+0000 7f2eb7cfe640 1 -- 172.21.15.90:0/2797772726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2eb00cbd40 msgr2=0x7f2eb01572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.782+0000 7f2eb7cfe640 1 --2- 172.21.15.90:0/2797772726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2eb00cbd40 0x7f2eb01572c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8002230 tx=0x7f2ea8034bb0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.782+0000 7f2eb7cfe640 1 -- 172.21.15.90:0/2797772726 shutdown_connections 2024-09-10T23:16:02.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.782+0000 7f2eb7cfe640 1 --2- 172.21.15.90:0/2797772726 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2e94077fd0 0x7f2e9407a490 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.782+0000 7f2eb7cfe640 1 --2- 172.21.15.90:0/2797772726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2eb00cbd40 0x7f2eb01572c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.782+0000 7f2eb7cfe640 1 --2- 172.21.15.90:0/2797772726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2eb00cdbd0 0x7f2eb00cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.782+0000 7f2eb7cfe640 1 --2- 172.21.15.90:0/2797772726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e9c004d40 0x7f2eb01f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.782+0000 7f2eb7cfe640 1 -- 172.21.15.90:0/2797772726 >> 172.21.15.90:0/2797772726 conn(0x7f2eb00d4190 msgr2=0x7f2eb015b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:02.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.782+0000 7f2eb7cfe640 1 -- 172.21.15.90:0/2797772726 shutdown_connections 2024-09-10T23:16:02.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.782+0000 7f2eb7cfe640 1 -- 172.21.15.90:0/2797772726 wait complete. 2024-09-10T23:16:02.794 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_non_blocklisted' 2024-09-10T23:16:02.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.894+0000 7f6761eed640 1 -- 172.21.15.90:0/1840208309 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6748004d90 msgr2=0x7f6748005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.894+0000 7f6761eed640 1 --2- 172.21.15.90:0/1840208309 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6748004d90 0x7f6748005210 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6754001690 tx=0x7f6748005830 comp rx=0 tx=0).stop 2024-09-10T23:16:02.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.894+0000 7f675bfff640 1 -- 172.21.15.90:0/1840208309 reap_dead start 2024-09-10T23:16:02.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.894+0000 7f6761eed640 1 -- 172.21.15.90:0/1840208309 shutdown_connections 2024-09-10T23:16:02.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.894+0000 7f6761eed640 1 -- 172.21.15.90:0/1840208309 >> 172.21.15.90:0/1840208309 conn(0x7f675c0cc850 msgr2=0x7f675c0ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:02.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.894+0000 7f6761eed640 1 -- 172.21.15.90:0/1840208309 shutdown_connections 2024-09-10T23:16:02.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.894+0000 7f6761eed640 1 -- 172.21.15.90:0/1840208309 wait complete. 2024-09-10T23:16:02.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.895+0000 7f6761eed640 1 Processor -- start 2024-09-10T23:16:02.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.895+0000 7f6761eed640 1 -- start start 2024-09-10T23:16:02.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f6761eed640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6748004d90 0x7f675c14f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f6761eed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f675c0c8ba0 0x7f675c14fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f6761eed640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f675c0c64b0 0x7f675c150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f6761eed640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f675c0ca7b0 con 0x7f675c0c8ba0 2024-09-10T23:16:02.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f6761eed640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f675c0ca630 con 0x7f6748004d90 2024-09-10T23:16:02.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f6761eed640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f675c15b080 con 0x7f675c0c64b0 2024-09-10T23:16:02.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f675affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f675c0c8ba0 0x7f675c14fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f675affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f675c0c8ba0 0x7f675c14fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37670/0 (socket says 172.21.15.90:37670) 2024-09-10T23:16:02.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f675affd640 1 -- 172.21.15.90:0/2063960070 learned_addr learned my addr 172.21.15.90:0/2063960070 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:02.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f675b7fe640 1 --2- 172.21.15.90:0/2063960070 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6748004d90 0x7f675c14f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f675bfff640 1 --2- 172.21.15.90:0/2063960070 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f675c0c64b0 0x7f675c150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f675affd640 1 -- 172.21.15.90:0/2063960070 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f675c0c64b0 msgr2=0x7f675c150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f675affd640 1 --2- 172.21.15.90:0/2063960070 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f675c0c64b0 0x7f675c150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f675affd640 1 -- 172.21.15.90:0/2063960070 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6748004d90 msgr2=0x7f675c14f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f675affd640 1 --2- 172.21.15.90:0/2063960070 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6748004d90 0x7f675c14f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f675affd640 1 -- 172.21.15.90:0/2063960070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f675c0c9030 con 0x7f675c0c8ba0 2024-09-10T23:16:02.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f675b7fe640 1 --2- 172.21.15.90:0/2063960070 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6748004d90 0x7f675c14f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:02.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.896+0000 7f675affd640 1 --2- 172.21.15.90:0/2063960070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f675c0c8ba0 0x7f675c14fec0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6744004fd0 tx=0x7f674400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.897+0000 7f6753fff640 1 -- 172.21.15.90:0/2063960070 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6744015070 con 0x7f675c0c8ba0 2024-09-10T23:16:02.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.897+0000 7f6753fff640 1 -- 172.21.15.90:0/2063960070 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f674400ce20 con 0x7f675c0c8ba0 2024-09-10T23:16:02.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.897+0000 7f6761eed640 1 -- 172.21.15.90:0/2063960070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f675c0c9310 con 0x7f675c0c8ba0 2024-09-10T23:16:02.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.897+0000 7f6753fff640 1 -- 172.21.15.90:0/2063960070 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6744011680 con 0x7f675c0c8ba0 2024-09-10T23:16:02.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.897+0000 7f6761eed640 1 -- 172.21.15.90:0/2063960070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f675c0c3b50 con 0x7f675c0c8ba0 2024-09-10T23:16:02.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.898+0000 7f6761eed640 1 -- 172.21.15.90:0/2063960070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f675c0cbde0 con 0x7f675c0c8ba0 2024-09-10T23:16:02.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.898+0000 7f6753fff640 1 -- 172.21.15.90:0/2063960070 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6744011820 con 0x7f675c0c8ba0 2024-09-10T23:16:02.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.899+0000 7f6753fff640 1 --2- 172.21.15.90:0/2063960070 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f673c077f70 0x7f673c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.899+0000 7f6753fff640 1 -- 172.21.15.90:0/2063960070 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f674409a5b0 con 0x7f675c0c8ba0 2024-09-10T23:16:02.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.899+0000 7f675b7fe640 1 --2- 172.21.15.90:0/2063960070 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f673c077f70 0x7f673c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.899+0000 7f675b7fe640 1 --2- 172.21.15.90:0/2063960070 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f673c077f70 0x7f673c07a430 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f674c005fd0 tx=0x7f674c0113e0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:02.903+0000 7f6753fff640 1 -- 172.21.15.90:0/2063960070 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f675c0cbde0 con 0x7f675c0c8ba0 2024-09-10T23:16:03.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.149+0000 7f6761eed640 1 -- 172.21.15.90:0/2063960070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_non_blocklisted"]} v 0) -- 0x7f675c0cdcd0 con 0x7f675c0c8ba0 2024-09-10T23:16:03.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.180+0000 7f6753fff640 1 -- 172.21.15.90:0/2063960070 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_non_blocklisted"]}]=0 v104) ==== 160+0+0 (secure 0 0 0) 0x7f6744063440 con 0x7f675c0c8ba0 2024-09-10T23:16:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.181+0000 7f6761eed640 1 -- 172.21.15.90:0/2063960070 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f673c077f70 msgr2=0x7f673c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.181+0000 7f6761eed640 1 --2- 172.21.15.90:0/2063960070 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f673c077f70 0x7f673c07a430 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f674c005fd0 tx=0x7f674c0113e0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.181+0000 7f6761eed640 1 -- 172.21.15.90:0/2063960070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f675c0c8ba0 msgr2=0x7f675c14fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.181+0000 7f6761eed640 1 --2- 172.21.15.90:0/2063960070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f675c0c8ba0 0x7f675c14fec0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6744004fd0 tx=0x7f674400ee00 comp rx=0 tx=0).stop 2024-09-10T23:16:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.181+0000 7f6761eed640 1 -- 172.21.15.90:0/2063960070 shutdown_connections 2024-09-10T23:16:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.181+0000 7f6761eed640 1 --2- 172.21.15.90:0/2063960070 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f673c077f70 0x7f673c07a430 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.181+0000 7f6761eed640 1 --2- 172.21.15.90:0/2063960070 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f675c0c64b0 0x7f675c150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.181+0000 7f6761eed640 1 --2- 172.21.15.90:0/2063960070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f675c0c8ba0 0x7f675c14fec0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.181+0000 7f6761eed640 1 --2- 172.21.15.90:0/2063960070 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6748004d90 0x7f675c14f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.181+0000 7f6761eed640 1 -- 172.21.15.90:0/2063960070 >> 172.21.15.90:0/2063960070 conn(0x7f675c0cc850 msgr2=0x7f675c0acf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.182+0000 7f6761eed640 1 -- 172.21.15.90:0/2063960070 shutdown_connections 2024-09-10T23:16:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.182+0000 7f6761eed640 1 -- 172.21.15.90:0/2063960070 wait complete. 2024-09-10T23:16:03.194 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:16:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.293+0000 7faaca640640 1 -- 172.21.15.90:0/4162979593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faac415ae10 msgr2=0x7faac40b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.293+0000 7faaca640640 1 --2- 172.21.15.90:0/4162979593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faac415ae10 0x7faac40b1850 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7faac40cc2a0 tx=0x7faaac02a530 comp rx=0 tx=0).stop 2024-09-10T23:16:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.294+0000 7faaca640640 1 -- 172.21.15.90:0/4162979593 shutdown_connections 2024-09-10T23:16:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.294+0000 7faaca640640 1 --2- 172.21.15.90:0/4162979593 >> v2:172.21.15.171:3300/0 conn(0x7faac40b1d90 0x7faac40cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.294+0000 7faaca640640 1 --2- 172.21.15.90:0/4162979593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faac415ae10 0x7faac40b1850 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.294+0000 7faaca640640 1 -- 172.21.15.90:0/4162979593 >> 172.21.15.90:0/4162979593 conn(0x7faac40cc850 msgr2=0x7faac40ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.294+0000 7faaca640640 1 -- 172.21.15.90:0/4162979593 shutdown_connections 2024-09-10T23:16:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.294+0000 7faaca640640 1 -- 172.21.15.90:0/4162979593 wait complete. 2024-09-10T23:16:03.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.295+0000 7faaca640640 1 Processor -- start 2024-09-10T23:16:03.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.295+0000 7faaca640640 1 -- start start 2024-09-10T23:16:03.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faaca640640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faac40b1d90 0x7faac4152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:03.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faaca640640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faac415aa30 0x7faac40c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:03.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faaca640640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faac415ae10 0x7faac409c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:03.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faaca640640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faac40ce390 con 0x7faac415ae10 2024-09-10T23:16:03.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faaca640640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faac40ce210 con 0x7faac415aa30 2024-09-10T23:16:03.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faaca640640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faac40ce510 con 0x7faac40b1d90 2024-09-10T23:16:03.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faac8bdd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faac415ae10 0x7faac409c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:03.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faac8bdd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faac415ae10 0x7faac409c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37686/0 (socket says 172.21.15.90:37686) 2024-09-10T23:16:03.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faac8bdd640 1 -- 172.21.15.90:0/3468767457 learned_addr learned my addr 172.21.15.90:0/3468767457 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:03.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faac37fe640 1 --2- 172.21.15.90:0/3468767457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faac415aa30 0x7faac40c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:03.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faac3fff640 1 --2- 172.21.15.90:0/3468767457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faac40b1d90 0x7faac4152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:03.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faac8bdd640 1 -- 172.21.15.90:0/3468767457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faac40b1d90 msgr2=0x7faac4152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faac8bdd640 1 --2- 172.21.15.90:0/3468767457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faac40b1d90 0x7faac4152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faac8bdd640 1 -- 172.21.15.90:0/3468767457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faac415aa30 msgr2=0x7faac40c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faac8bdd640 1 --2- 172.21.15.90:0/3468767457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faac415aa30 0x7faac40c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faac8bdd640 1 -- 172.21.15.90:0/3468767457 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac40b2ca0 con 0x7faac415ae10 2024-09-10T23:16:03.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faac8bdd640 1 --2- 172.21.15.90:0/3468767457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faac415ae10 0x7faac409c0d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7faabc00e960 tx=0x7faabc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:03.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faac0ff9640 1 -- 172.21.15.90:0/3468767457 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc004d20 con 0x7faac415ae10 2024-09-10T23:16:03.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faac0ff9640 1 -- 172.21.15.90:0/3468767457 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faabc00cb20 con 0x7faac415ae10 2024-09-10T23:16:03.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faac0ff9640 1 -- 172.21.15.90:0/3468767457 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc005020 con 0x7faac415ae10 2024-09-10T23:16:03.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.296+0000 7faaca640640 1 -- 172.21.15.90:0/3468767457 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac40b2f80 con 0x7faac415ae10 2024-09-10T23:16:03.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.297+0000 7faaca640640 1 -- 172.21.15.90:0/3468767457 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac40b3540 con 0x7faac415ae10 2024-09-10T23:16:03.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.298+0000 7faaca640640 1 -- 172.21.15.90:0/3468767457 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac40cb380 con 0x7faac415ae10 2024-09-10T23:16:03.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.298+0000 7faac0ff9640 1 -- 172.21.15.90:0/3468767457 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7faabc00f040 con 0x7faac415ae10 2024-09-10T23:16:03.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.298+0000 7faac0ff9640 1 --2- 172.21.15.90:0/3468767457 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faaa4077fa0 0x7faaa407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:03.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.299+0000 7faac0ff9640 1 -- 172.21.15.90:0/3468767457 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7faabc09a050 con 0x7faac415ae10 2024-09-10T23:16:03.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.299+0000 7faac3fff640 1 --2- 172.21.15.90:0/3468767457 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faaa4077fa0 0x7faaa407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:03.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.299+0000 7faac3fff640 1 --2- 172.21.15.90:0/3468767457 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faaa4077fa0 0x7faaa407a460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faab4001700 tx=0x7faab4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:03.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.303+0000 7faac0ff9640 1 -- 172.21.15.90:0/3468767457 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7faac40cb380 con 0x7faac415ae10 2024-09-10T23:16:03.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.480+0000 7faaca640640 1 -- 172.21.15.90:0/3468767457 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7faac40cdcd0 con 0x7faac415ae10 2024-09-10T23:16:03.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.480+0000 7faac0ff9640 1 -- 172.21.15.90:0/3468767457 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v32) ==== 59+0+1998 (secure 0 0 0) 0x7faabc016030 con 0x7faac415ae10 2024-09-10T23:16:03.481 INFO:teuthology.orchestra.run.smithi090.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:16:03.481 INFO:teuthology.orchestra.run.smithi090.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:16:03.481 INFO:teuthology.orchestra.run.smithi090.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:16:03.482 INFO:teuthology.orchestra.run.smithi090.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:16:03.482 INFO:teuthology.orchestra.run.smithi090.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8283.895139 2024-09-10T23:16:03.482 INFO:teuthology.orchestra.run.smithi090.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5684.288500 2024-09-10T23:16:03.482 INFO:teuthology.orchestra.run.smithi090.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5960.411649 2024-09-10T23:16:03.482 INFO:teuthology.orchestra.run.smithi090.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5499.929251 2024-09-10T23:16:03.482 INFO:teuthology.orchestra.run.smithi090.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5373.806301 2024-09-10T23:16:03.482 INFO:teuthology.orchestra.run.smithi090.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5138.908279 2024-09-10T23:16:03.482 INFO:teuthology.orchestra.run.smithi090.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5181.430205 2024-09-10T23:16:03.482 INFO:teuthology.orchestra.run.smithi090.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4880.265977 2024-09-10T23:16:03.482 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_mds 20/20 2024-09-10T23:16:03.482 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:16:03.482 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_ms 2/2 2024-09-10T23:16:03.483 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_debug_frag true 2024-09-10T23:16:03.483 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:16:03.483 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:16:03.483 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_verify_scatter true 2024-09-10T23:16:03.483 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:16:03.483 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:16:03.483 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:16:03.483 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced client_mount_timeout 600 2024-09-10T23:16:03.483 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced debug_client 20/20 2024-09-10T23:16:03.483 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced debug_ms 1/1 2024-09-10T23:16:03.483 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:16:03.483 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:16:03.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.483+0000 7faaca640640 1 -- 172.21.15.90:0/3468767457 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faaa4077fa0 msgr2=0x7faaa407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.483+0000 7faaca640640 1 --2- 172.21.15.90:0/3468767457 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faaa4077fa0 0x7faaa407a460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faab4001700 tx=0x7faab4009040 comp rx=0 tx=0).stop 2024-09-10T23:16:03.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.483+0000 7faaca640640 1 -- 172.21.15.90:0/3468767457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faac415ae10 msgr2=0x7faac409c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.483+0000 7faaca640640 1 --2- 172.21.15.90:0/3468767457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faac415ae10 0x7faac409c0d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7faabc00e960 tx=0x7faabc00ee20 comp rx=0 tx=0).stop 2024-09-10T23:16:03.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.483+0000 7faaca640640 1 -- 172.21.15.90:0/3468767457 shutdown_connections 2024-09-10T23:16:03.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.483+0000 7faaca640640 1 --2- 172.21.15.90:0/3468767457 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7faaa4077fa0 0x7faaa407a460 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.483+0000 7faaca640640 1 --2- 172.21.15.90:0/3468767457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faac415aa30 0x7faac40c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.483+0000 7faaca640640 1 --2- 172.21.15.90:0/3468767457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faac415ae10 0x7faac409c0d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.483+0000 7faaca640640 1 --2- 172.21.15.90:0/3468767457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faac40b1d90 0x7faac4152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.483+0000 7faaca640640 1 -- 172.21.15.90:0/3468767457 >> 172.21.15.90:0/3468767457 conn(0x7faac40cc850 msgr2=0x7faac40ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:03.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.483+0000 7faaca640640 1 -- 172.21.15.90:0/3468767457 shutdown_connections 2024-09-10T23:16:03.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.483+0000 7faaca640640 1 -- 172.21.15.90:0/3468767457 wait complete. 2024-09-10T23:16:03.494 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:16:03.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.597+0000 7f49d56cd640 1 -- 172.21.15.90:0/1588242336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49d00cfd20 msgr2=0x7f49d00d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.597+0000 7f49d56cd640 1 --2- 172.21.15.90:0/1588242336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49d00cfd20 0x7f49d00d2ea0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009830 tx=0x7f49c402a510 comp rx=0 tx=0).stop 2024-09-10T23:16:03.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.598+0000 7f49d56cd640 1 -- 172.21.15.90:0/1588242336 shutdown_connections 2024-09-10T23:16:03.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.598+0000 7f49d56cd640 1 --2- 172.21.15.90:0/1588242336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49d00cfd20 0x7f49d00d2ea0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.598+0000 7f49d56cd640 1 -- 172.21.15.90:0/1588242336 >> 172.21.15.90:0/1588242336 conn(0x7f49d00d4190 msgr2=0x7f49d00d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:03.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.598+0000 7f49d56cd640 1 -- 172.21.15.90:0/1588242336 shutdown_connections 2024-09-10T23:16:03.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.598+0000 7f49d56cd640 1 -- 172.21.15.90:0/1588242336 wait complete. 2024-09-10T23:16:03.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.599+0000 7f49d56cd640 1 Processor -- start 2024-09-10T23:16:03.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.599+0000 7f49d56cd640 1 -- start start 2024-09-10T23:16:03.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49d56cd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49d00cfd20 0x7f49d00cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:03.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49d56cd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49d00d23e0 0x7f49d0151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:03.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49d56cd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49d015e0f0 0x7f49d00cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:03.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49d56cd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f49d00b94a0 con 0x7f49d00cfd20 2024-09-10T23:16:03.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49d56cd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f49d00b9320 con 0x7f49d015e0f0 2024-09-10T23:16:03.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49d56cd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f49d00b9620 con 0x7f49d00d23e0 2024-09-10T23:16:03.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49ceffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49d00cfd20 0x7f49d00cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:03.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49ceffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49d00cfd20 0x7f49d00cdd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37694/0 (socket says 172.21.15.90:37694) 2024-09-10T23:16:03.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49ceffd640 1 -- 172.21.15.90:0/3137514421 learned_addr learned my addr 172.21.15.90:0/3137514421 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:03.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49cf7fe640 1 --2- 172.21.15.90:0/3137514421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49d015e0f0 0x7f49d00cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:03.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49ce7fc640 1 --2- 172.21.15.90:0/3137514421 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49d00d23e0 0x7f49d0151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:03.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49ceffd640 1 -- 172.21.15.90:0/3137514421 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49d00d23e0 msgr2=0x7f49d0151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49ceffd640 1 --2- 172.21.15.90:0/3137514421 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49d00d23e0 0x7f49d0151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49ceffd640 1 -- 172.21.15.90:0/3137514421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49d015e0f0 msgr2=0x7f49d00cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49ceffd640 1 --2- 172.21.15.90:0/3137514421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49d015e0f0 0x7f49d00cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49ceffd640 1 -- 172.21.15.90:0/3137514421 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d01f56b0 con 0x7f49d00cfd20 2024-09-10T23:16:03.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49ceffd640 1 --2- 172.21.15.90:0/3137514421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49d00cfd20 0x7f49d00cdd60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f49c000c430 tx=0x7f49c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:03.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49b77fe640 1 -- 172.21.15.90:0/3137514421 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c0011790 con 0x7f49d00cfd20 2024-09-10T23:16:03.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49b77fe640 1 -- 172.21.15.90:0/3137514421 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49c0017070 con 0x7f49d00cfd20 2024-09-10T23:16:03.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49d56cd640 1 -- 172.21.15.90:0/3137514421 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d01f5990 con 0x7f49d00cfd20 2024-09-10T23:16:03.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49b77fe640 1 -- 172.21.15.90:0/3137514421 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c0011ce0 con 0x7f49d00cfd20 2024-09-10T23:16:03.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.600+0000 7f49d56cd640 1 -- 172.21.15.90:0/3137514421 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d01f6320 con 0x7f49d00cfd20 2024-09-10T23:16:03.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.601+0000 7f49d56cd640 1 -- 172.21.15.90:0/3137514421 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d00b9aa0 con 0x7f49d00cfd20 2024-09-10T23:16:03.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.602+0000 7f49b77fe640 1 -- 172.21.15.90:0/3137514421 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f49c001c460 con 0x7f49d00cfd20 2024-09-10T23:16:03.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.603+0000 7f49b77fe640 1 --2- 172.21.15.90:0/3137514421 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f49bc077fa0 0x7f49bc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:03.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.603+0000 7f49b77fe640 1 -- 172.21.15.90:0/3137514421 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f49c0099710 con 0x7f49d00cfd20 2024-09-10T23:16:03.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.603+0000 7f49ce7fc640 1 --2- 172.21.15.90:0/3137514421 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f49bc077fa0 0x7f49bc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:03.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.603+0000 7f49ce7fc640 1 --2- 172.21.15.90:0/3137514421 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f49bc077fa0 0x7f49bc07a460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f49c4034000 tx=0x7f49c4004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:03.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.607+0000 7f49b77fe640 1 -- 172.21.15.90:0/3137514421 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f49c00625a0 con 0x7f49d00cfd20 2024-09-10T23:16:03.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.780+0000 7f49d56cd640 1 -- 172.21.15.90:0/3137514421 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f49d015ce50 con 0x7f49d00cfd20 2024-09-10T23:16:03.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.784+0000 7f49b77fe640 1 -- 172.21.15.90:0/3137514421 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v33)=0 v33) ==== 122+0+0 (secure 0 0 0) 0x7f49c0061ea0 con 0x7f49d00cfd20 2024-09-10T23:16:03.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.786+0000 7f49d56cd640 1 -- 172.21.15.90:0/3137514421 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f49bc077fa0 msgr2=0x7f49bc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.786+0000 7f49d56cd640 1 --2- 172.21.15.90:0/3137514421 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f49bc077fa0 0x7f49bc07a460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f49c4034000 tx=0x7f49c4004730 comp rx=0 tx=0).stop 2024-09-10T23:16:03.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.786+0000 7f49d56cd640 1 -- 172.21.15.90:0/3137514421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49d00cfd20 msgr2=0x7f49d00cdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.786+0000 7f49d56cd640 1 --2- 172.21.15.90:0/3137514421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49d00cfd20 0x7f49d00cdd60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f49c000c430 tx=0x7f49c000c8f0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.786+0000 7f49d56cd640 1 -- 172.21.15.90:0/3137514421 shutdown_connections 2024-09-10T23:16:03.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.786+0000 7f49d56cd640 1 --2- 172.21.15.90:0/3137514421 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f49bc077fa0 0x7f49bc07a460 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.786+0000 7f49d56cd640 1 --2- 172.21.15.90:0/3137514421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49d015e0f0 0x7f49d00cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.786+0000 7f49d56cd640 1 --2- 172.21.15.90:0/3137514421 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49d00d23e0 0x7f49d0151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.786+0000 7f49d56cd640 1 --2- 172.21.15.90:0/3137514421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49d00cfd20 0x7f49d00cdd60 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.786+0000 7f49d56cd640 1 -- 172.21.15.90:0/3137514421 >> 172.21.15.90:0/3137514421 conn(0x7f49d00d4190 msgr2=0x7f49d00d4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:03.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.786+0000 7f49d56cd640 1 -- 172.21.15.90:0/3137514421 shutdown_connections 2024-09-10T23:16:03.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:03.786+0000 7f49d56cd640 1 -- 172.21.15.90:0/3137514421 wait complete. 2024-09-10T23:16:03.798 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:16:03.799 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:16:03.854 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:16:03.912 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:16:03.912 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:16:03.913 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:03.929 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:16:03.929 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:16:03.929 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:03.948 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:16:03.949 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:16:03.949 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:03.985 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:16:03.986 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:16:03.986 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:04.007 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:16:04.007 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:16:04.007 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:04.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.127+0000 7fb88e7ec640 1 -- 172.21.15.90:0/2426368250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb88815bdb0 msgr2=0x7fb888073a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.127+0000 7fb88e7ec640 1 --2- 172.21.15.90:0/2426368250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb88815bdb0 0x7fb888073a50 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb8880c4480 tx=0x7fb87802a4d0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.127+0000 7fb88e7ec640 1 -- 172.21.15.90:0/2426368250 shutdown_connections 2024-09-10T23:16:04.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.127+0000 7fb88e7ec640 1 --2- 172.21.15.90:0/2426368250 >> v2:172.21.15.171:3300/0 conn(0x7fb8880d0400 0x7fb8880d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.127+0000 7fb88e7ec640 1 --2- 172.21.15.90:0/2426368250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb88815bdb0 0x7fb888073a50 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.127+0000 7fb88e7ec640 1 -- 172.21.15.90:0/2426368250 >> 172.21.15.90:0/2426368250 conn(0x7fb8880cd960 msgr2=0x7fb8880cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:04.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.127+0000 7fb88e7ec640 1 -- 172.21.15.90:0/2426368250 shutdown_connections 2024-09-10T23:16:04.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.127+0000 7fb88e7ec640 1 -- 172.21.15.90:0/2426368250 wait complete. 2024-09-10T23:16:04.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.128+0000 7fb88e7ec640 1 Processor -- start 2024-09-10T23:16:04.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.128+0000 7fb88e7ec640 1 -- start start 2024-09-10T23:16:04.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.129+0000 7fb88e7ec640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb88806cb30 0x7fb88814e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:04.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.129+0000 7fb88e7ec640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8880d0400 0x7fb8881f8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:04.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.129+0000 7fb88e7ec640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb88815bdb0 0x7fb8881f8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:04.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.129+0000 7fb88e7ec640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb88806d350 con 0x7fb88806cb30 2024-09-10T23:16:04.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.129+0000 7fb88e7ec640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb88806d1d0 con 0x7fb88815bdb0 2024-09-10T23:16:04.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.129+0000 7fb88e7ec640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb8880cac80 con 0x7fb8880d0400 2024-09-10T23:16:04.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.129+0000 7fb887fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb88806cb30 0x7fb88814e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:04.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.129+0000 7fb887fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb88806cb30 0x7fb88814e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37718/0 (socket says 172.21.15.90:37718) 2024-09-10T23:16:04.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.129+0000 7fb887fff640 1 -- 172.21.15.90:0/4232623920 learned_addr learned my addr 172.21.15.90:0/4232623920 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:04.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.129+0000 7fb88cd89640 1 --2- 172.21.15.90:0/4232623920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb88815bdb0 0x7fb8881f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:04.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.129+0000 7fb8877fe640 1 --2- 172.21.15.90:0/4232623920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8880d0400 0x7fb8881f8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:04.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.129+0000 7fb887fff640 1 -- 172.21.15.90:0/4232623920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8880d0400 msgr2=0x7fb8881f8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.129+0000 7fb887fff640 1 --2- 172.21.15.90:0/4232623920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8880d0400 0x7fb8881f8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.129+0000 7fb887fff640 1 -- 172.21.15.90:0/4232623920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb88815bdb0 msgr2=0x7fb8881f8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.129+0000 7fb887fff640 1 --2- 172.21.15.90:0/4232623920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb88815bdb0 0x7fb8881f8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.129+0000 7fb887fff640 1 -- 172.21.15.90:0/4232623920 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8880b24d0 con 0x7fb88806cb30 2024-09-10T23:16:04.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.130+0000 7fb887fff640 1 --2- 172.21.15.90:0/4232623920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb88806cb30 0x7fb88814e4e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb878000c00 tx=0x7fb8780039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:04.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.130+0000 7fb884ff9640 1 -- 172.21.15.90:0/4232623920 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87803e030 con 0x7fb88806cb30 2024-09-10T23:16:04.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.130+0000 7fb88e7ec640 1 -- 172.21.15.90:0/4232623920 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8880b27b0 con 0x7fb88806cb30 2024-09-10T23:16:04.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.130+0000 7fb884ff9640 1 -- 172.21.15.90:0/4232623920 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8780047a0 con 0x7fb88806cb30 2024-09-10T23:16:04.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.130+0000 7fb884ff9640 1 -- 172.21.15.90:0/4232623920 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb878035040 con 0x7fb88806cb30 2024-09-10T23:16:04.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.130+0000 7fb88e7ec640 1 -- 172.21.15.90:0/4232623920 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8880b2d70 con 0x7fb88806cb30 2024-09-10T23:16:04.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.131+0000 7fb88e7ec640 1 -- 172.21.15.90:0/4232623920 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb888160570 con 0x7fb88806cb30 2024-09-10T23:16:04.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.131+0000 7fb884ff9640 1 -- 172.21.15.90:0/4232623920 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb878004b70 con 0x7fb88806cb30 2024-09-10T23:16:04.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.132+0000 7fb884ff9640 1 --2- 172.21.15.90:0/4232623920 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb874077f70 0x7fb87407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:04.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.132+0000 7fb884ff9640 1 -- 172.21.15.90:0/4232623920 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7fb8780ba510 con 0x7fb88806cb30 2024-09-10T23:16:04.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.132+0000 7fb8877fe640 1 --2- 172.21.15.90:0/4232623920 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb874077f70 0x7fb87407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:04.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.133+0000 7fb8877fe640 1 --2- 172.21.15.90:0/4232623920 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb874077f70 0x7fb87407a430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb8880c47c0 tx=0x7fb87c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:04.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.136+0000 7fb884ff9640 1 -- 172.21.15.90:0/4232623920 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb878083320 con 0x7fb88806cb30 2024-09-10T23:16:04.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.343+0000 7fb88e7ec640 1 -- 172.21.15.90:0/4232623920 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8880cb2f0 con 0x7fb88806cb30 2024-09-10T23:16:04.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.343+0000 7fb884ff9640 1 -- 172.21.15.90:0/4232623920 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+3917 (secure 0 0 0) 0x7fb878082c20 con 0x7fb88806cb30 2024-09-10T23:16:04.344 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:04.344 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":22,"btime":"2024-09-10T23:15:59:153099+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3694036833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3694036833},{"type":"v1","addr":"172.21.15.171:6836","nonce":3694036833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2893931120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2893931120},{"type":"v1","addr":"172.21.15.171:6837","nonce":2893931120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4148214232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":4148214232},{"type":"v1","addr":"172.21.15.90:6835","nonce":4148214232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/2531112116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2531112116},{"type":"v1","addr":"172.21.15.90:6834","nonce":2531112116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[]} 2024-09-10T23:16:04.345 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 22 2024-09-10T23:16:04.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.345+0000 7fb88e7ec640 1 -- 172.21.15.90:0/4232623920 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb874077f70 msgr2=0x7fb87407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.345+0000 7fb88e7ec640 1 --2- 172.21.15.90:0/4232623920 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb874077f70 0x7fb87407a430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb8880c47c0 tx=0x7fb87c008040 comp rx=0 tx=0).stop 2024-09-10T23:16:04.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.345+0000 7fb88e7ec640 1 -- 172.21.15.90:0/4232623920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb88806cb30 msgr2=0x7fb88814e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.345+0000 7fb88e7ec640 1 --2- 172.21.15.90:0/4232623920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb88806cb30 0x7fb88814e4e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb878000c00 tx=0x7fb8780039e0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.345+0000 7fb88e7ec640 1 -- 172.21.15.90:0/4232623920 shutdown_connections 2024-09-10T23:16:04.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.345+0000 7fb88e7ec640 1 --2- 172.21.15.90:0/4232623920 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb874077f70 0x7fb87407a430 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.345+0000 7fb88e7ec640 1 --2- 172.21.15.90:0/4232623920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb88815bdb0 0x7fb8881f8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.345+0000 7fb88e7ec640 1 --2- 172.21.15.90:0/4232623920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8880d0400 0x7fb8881f8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.345+0000 7fb88e7ec640 1 --2- 172.21.15.90:0/4232623920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb88806cb30 0x7fb88814e4e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.345+0000 7fb88e7ec640 1 -- 172.21.15.90:0/4232623920 >> 172.21.15.90:0/4232623920 conn(0x7fb8880cd960 msgr2=0x7fb88815e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:04.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.345+0000 7fb88e7ec640 1 -- 172.21.15.90:0/4232623920 shutdown_connections 2024-09-10T23:16:04.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.345+0000 7fb88e7ec640 1 -- 172.21.15.90:0/4232623920 wait complete. 2024-09-10T23:16:04.358 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:16:04.358 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:16:04.358 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:16:04.358 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:16:04.358 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:16:04.358 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:16:04.359 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:16:04.359 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:16:04.359 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:16:04.359 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:16:04.359 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:16:04.359 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:16:04.359 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:16:04.360 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:16:04.360 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:16:04.360 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:16:04.367 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:16:04.368 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:16:04.369 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:16:04.369 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:16:04.371 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:16:04.372 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:16:04.373 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:16:04.373 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:16:04.410 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:16:04.410 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:04.411 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:16:04.411 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:04.414 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:16:04.415 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:04.416 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:16:04.416 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:04.416 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:16:04.484 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-09-10T23:16:04.485 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-09-10T23:16:04.497 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-09-10T23:16:04.498 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-09-10T23:16:04.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.523+0000 7f21659f8640 1 -- 172.21.15.90:0/1070887258 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21600b3a00 msgr2=0x7f21600b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.523+0000 7f21659f8640 1 --2- 172.21.15.90:0/1070887258 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21600b3a00 0x7f21600b3eb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2158005fd0 tx=0x7f215802a8b0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.523+0000 7f21659f8640 1 -- 172.21.15.90:0/1070887258 shutdown_connections 2024-09-10T23:16:04.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.523+0000 7f21659f8640 1 --2- 172.21.15.90:0/1070887258 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21600b3a00 0x7f21600b3eb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.523+0000 7f21659f8640 1 --2- 172.21.15.90:0/1070887258 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21600d2470 0x7f21600b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.523+0000 7f21659f8640 1 -- 172.21.15.90:0/1070887258 >> 172.21.15.90:0/1070887258 conn(0x7f216009d2a0 msgr2=0x7f21600d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:04.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.523+0000 7f21659f8640 1 -- 172.21.15.90:0/1070887258 shutdown_connections 2024-09-10T23:16:04.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.523+0000 7f21659f8640 1 -- 172.21.15.90:0/1070887258 wait complete. 2024-09-10T23:16:04.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.524+0000 7f21659f8640 1 Processor -- start 2024-09-10T23:16:04.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.524+0000 7f21659f8640 1 -- start start 2024-09-10T23:16:04.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.525+0000 7f21659f8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21600b3a00 0x7f21600b9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:04.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.525+0000 7f21659f8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21600d1c70 0x7f2160152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:04.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.525+0000 7f21659f8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21600d2470 0x7f21600c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:04.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.525+0000 7f21659f8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f21600b4570 con 0x7f21600d2470 2024-09-10T23:16:04.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.525+0000 7f21659f8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f21600b43f0 con 0x7f21600b3a00 2024-09-10T23:16:04.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.525+0000 7f21659f8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f21600b46f0 con 0x7f21600d1c70 2024-09-10T23:16:04.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.525+0000 7f215f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21600d2470 0x7f21600c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:04.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.525+0000 7f215f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21600d2470 0x7f21600c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37750/0 (socket says 172.21.15.90:37750) 2024-09-10T23:16:04.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.525+0000 7f215f7fe640 1 -- 172.21.15.90:0/3849958189 learned_addr learned my addr 172.21.15.90:0/3849958189 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:04.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.525+0000 7f215e7fc640 1 --2- 172.21.15.90:0/3849958189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21600d1c70 0x7f2160152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:04.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.525+0000 7f215effd640 1 --2- 172.21.15.90:0/3849958189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21600b3a00 0x7f21600b9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:04.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.526+0000 7f215f7fe640 1 -- 172.21.15.90:0/3849958189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21600d1c70 msgr2=0x7f2160152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.526+0000 7f215f7fe640 1 --2- 172.21.15.90:0/3849958189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21600d1c70 0x7f2160152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.526+0000 7f215f7fe640 1 -- 172.21.15.90:0/3849958189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21600b3a00 msgr2=0x7f21600b9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.526+0000 7f215f7fe640 1 --2- 172.21.15.90:0/3849958189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21600b3a00 0x7f21600b9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.526+0000 7f215f7fe640 1 -- 172.21.15.90:0/3849958189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21600c7d70 con 0x7f21600d2470 2024-09-10T23:16:04.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.526+0000 7f215effd640 1 --2- 172.21.15.90:0/3849958189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21600b3a00 0x7f21600b9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:16:04.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.526+0000 7f215f7fe640 1 --2- 172.21.15.90:0/3849958189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21600d2470 0x7f21600c9240 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2158009b30 tx=0x7f21580316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:04.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.526+0000 7f2147fff640 1 -- 172.21.15.90:0/3849958189 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2158040070 con 0x7f21600d2470 2024-09-10T23:16:04.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.526+0000 7f2147fff640 1 -- 172.21.15.90:0/3849958189 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2158004040 con 0x7f21600d2470 2024-09-10T23:16:04.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.526+0000 7f21659f8640 1 -- 172.21.15.90:0/3849958189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21600c8050 con 0x7f21600d2470 2024-09-10T23:16:04.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.526+0000 7f2147fff640 1 -- 172.21.15.90:0/3849958189 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2158004450 con 0x7f21600d2470 2024-09-10T23:16:04.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.526+0000 7f21659f8640 1 -- 172.21.15.90:0/3849958189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21600c8610 con 0x7f21600d2470 2024-09-10T23:16:04.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.527+0000 7f21659f8640 1 -- 172.21.15.90:0/3849958189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21600b3eb0 con 0x7f21600d2470 2024-09-10T23:16:04.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.528+0000 7f2147fff640 1 -- 172.21.15.90:0/3849958189 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f21580045f0 con 0x7f21600d2470 2024-09-10T23:16:04.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.528+0000 7f2147fff640 1 --2- 172.21.15.90:0/3849958189 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f214c077f70 0x7f214c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:04.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.528+0000 7f2147fff640 1 -- 172.21.15.90:0/3849958189 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f21580bb260 con 0x7f21600d2470 2024-09-10T23:16:04.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.528+0000 7f215effd640 1 --2- 172.21.15.90:0/3849958189 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f214c077f70 0x7f214c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:04.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.529+0000 7f215effd640 1 --2- 172.21.15.90:0/3849958189 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f214c077f70 0x7f214c07a430 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f21500097a0 tx=0x7f2150009260 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:04.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.532+0000 7f2147fff640 1 -- 172.21.15.90:0/3849958189 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2158083980 con 0x7f21600d2470 2024-09-10T23:16:04.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:04.716+0000 7f21659f8640 1 -- 172.21.15.90:0/3849958189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f21600d29f0 con 0x7f21600d2470 2024-09-10T23:16:05.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.197+0000 7f2147fff640 1 -- 172.21.15.90:0/3849958189 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) ==== 97+0+0 (secure 0 0 0) 0x7f21580883b0 con 0x7f21600d2470 2024-09-10T23:16:05.198 INFO:teuthology.orchestra.run.smithi090.stderr: removed all blocklist entries 2024-09-10T23:16:05.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.200+0000 7f21659f8640 1 -- 172.21.15.90:0/3849958189 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f214c077f70 msgr2=0x7f214c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.200+0000 7f21659f8640 1 --2- 172.21.15.90:0/3849958189 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f214c077f70 0x7f214c07a430 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f21500097a0 tx=0x7f2150009260 comp rx=0 tx=0).stop 2024-09-10T23:16:05.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.200+0000 7f21659f8640 1 -- 172.21.15.90:0/3849958189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21600d2470 msgr2=0x7f21600c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.200+0000 7f21659f8640 1 --2- 172.21.15.90:0/3849958189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21600d2470 0x7f21600c9240 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2158009b30 tx=0x7f21580316e0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.200+0000 7f21659f8640 1 -- 172.21.15.90:0/3849958189 shutdown_connections 2024-09-10T23:16:05.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.200+0000 7f21659f8640 1 --2- 172.21.15.90:0/3849958189 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f214c077f70 0x7f214c07a430 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.200+0000 7f21659f8640 1 --2- 172.21.15.90:0/3849958189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21600d2470 0x7f21600c9240 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.200+0000 7f21659f8640 1 --2- 172.21.15.90:0/3849958189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21600d1c70 0x7f2160152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.200+0000 7f21659f8640 1 --2- 172.21.15.90:0/3849958189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21600b3a00 0x7f21600b9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.200+0000 7f21659f8640 1 -- 172.21.15.90:0/3849958189 >> 172.21.15.90:0/3849958189 conn(0x7f216009d2a0 msgr2=0x7f21600cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:05.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.200+0000 7f21659f8640 1 -- 172.21.15.90:0/3849958189 shutdown_connections 2024-09-10T23:16:05.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.200+0000 7f21659f8640 1 -- 172.21.15.90:0/3849958189 wait complete. 2024-09-10T23:16:05.213 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:16:05.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.313+0000 7f4bda016640 1 -- 172.21.15.90:0/774117282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4bd40b0940 msgr2=0x7f4bd40cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.313+0000 7f4bda016640 1 --2- 172.21.15.90:0/774117282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4bd40b0940 0x7f4bd40cb5d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4068c20 tx=0x7f4bcc02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.313+0000 7f4bda016640 1 -- 172.21.15.90:0/774117282 shutdown_connections 2024-09-10T23:16:05.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.313+0000 7f4bda016640 1 --2- 172.21.15.90:0/774117282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4bd40b0940 0x7f4bd40cb5d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.313+0000 7f4bda016640 1 --2- 172.21.15.90:0/774117282 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4bd415e260 0x7f4bd40b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.313+0000 7f4bda016640 1 -- 172.21.15.90:0/774117282 >> 172.21.15.90:0/774117282 conn(0x7f4bd40d0490 msgr2=0x7f4bd40d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:05.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.313+0000 7f4bda016640 1 -- 172.21.15.90:0/774117282 shutdown_connections 2024-09-10T23:16:05.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.313+0000 7f4bda016640 1 -- 172.21.15.90:0/774117282 wait complete. 2024-09-10T23:16:05.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.314+0000 7f4bda016640 1 Processor -- start 2024-09-10T23:16:05.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.315+0000 7f4bda016640 1 -- start start 2024-09-10T23:16:05.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.315+0000 7f4bda016640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4bd40b0940 0x7f4bd41577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.315+0000 7f4bda016640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4bd40d1190 0x7f4bd4154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.315+0000 7f4bda016640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bd415e260 0x7f4bd40b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.315+0000 7f4bda016640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd415e850 con 0x7f4bd415e260 2024-09-10T23:16:05.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.315+0000 7f4bda016640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd40af750 con 0x7f4bd40b0940 2024-09-10T23:16:05.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.315+0000 7f4bda016640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd40cf070 con 0x7f4bd40d1190 2024-09-10T23:16:05.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.316+0000 7f4bd3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bd415e260 0x7f4bd40b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.316+0000 7f4bd3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bd415e260 0x7f4bd40b54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37752/0 (socket says 172.21.15.90:37752) 2024-09-10T23:16:05.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.316+0000 7f4bd3fff640 1 -- 172.21.15.90:0/4088202291 learned_addr learned my addr 172.21.15.90:0/4088202291 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:05.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.316+0000 7f4bd37fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4bd40b0940 0x7f4bd41577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.316+0000 7f4bd2ffd640 1 --2- 172.21.15.90:0/4088202291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4bd40d1190 0x7f4bd4154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.316+0000 7f4bd3fff640 1 -- 172.21.15.90:0/4088202291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4bd40d1190 msgr2=0x7f4bd4154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.316+0000 7f4bd3fff640 1 --2- 172.21.15.90:0/4088202291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4bd40d1190 0x7f4bd4154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.316+0000 7f4bd3fff640 1 -- 172.21.15.90:0/4088202291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4bd40b0940 msgr2=0x7f4bd41577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.316+0000 7f4bd3fff640 1 --2- 172.21.15.90:0/4088202291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4bd40b0940 0x7f4bd41577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.316+0000 7f4bd3fff640 1 -- 172.21.15.90:0/4088202291 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd41f6540 con 0x7f4bd415e260 2024-09-10T23:16:05.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.316+0000 7f4bd3fff640 1 --2- 172.21.15.90:0/4088202291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bd415e260 0x7f4bd40b54d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc009920 tx=0x7f4bcc032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:05.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.316+0000 7f4bbbfff640 1 -- 172.21.15.90:0/4088202291 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc040070 con 0x7f4bd415e260 2024-09-10T23:16:05.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.316+0000 7f4bbbfff640 1 -- 172.21.15.90:0/4088202291 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bcc005330 con 0x7f4bd415e260 2024-09-10T23:16:05.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.316+0000 7f4bda016640 1 -- 172.21.15.90:0/4088202291 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd41f6820 con 0x7f4bd415e260 2024-09-10T23:16:05.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.316+0000 7f4bbbfff640 1 -- 172.21.15.90:0/4088202291 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0047a0 con 0x7f4bd415e260 2024-09-10T23:16:05.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.316+0000 7f4bda016640 1 -- 172.21.15.90:0/4088202291 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd41f6de0 con 0x7f4bd415e260 2024-09-10T23:16:05.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.317+0000 7f4bda016640 1 -- 172.21.15.90:0/4088202291 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd41f6fb0 con 0x7f4bd415e260 2024-09-10T23:16:05.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.318+0000 7f4bbbfff640 1 -- 172.21.15.90:0/4088202291 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4bcc04c030 con 0x7f4bd415e260 2024-09-10T23:16:05.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.318+0000 7f4bbbfff640 1 --2- 172.21.15.90:0/4088202291 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4bc0077f70 0x7f4bc007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.319+0000 7f4bbbfff640 1 -- 172.21.15.90:0/4088202291 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7f4bcc0ba9a0 con 0x7f4bd415e260 2024-09-10T23:16:05.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.319+0000 7f4bd37fe640 1 --2- 172.21.15.90:0/4088202291 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4bc0077f70 0x7f4bc007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.319+0000 7f4bd37fe640 1 --2- 172.21.15.90:0/4088202291 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4bc0077f70 0x7f4bc007a430 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4bc40099a0 tx=0x7f4bc4009500 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:05.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.323+0000 7f4bbbfff640 1 -- 172.21.15.90:0/4088202291 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4bcc0831a0 con 0x7f4bd415e260 2024-09-10T23:16:05.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.563+0000 7f4bda016640 1 -- 172.21.15.90:0/4088202291 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f4bd415cb30 con 0x7f4bd415e260 2024-09-10T23:16:05.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.564+0000 7f4bbbfff640 1 -- 172.21.15.90:0/4088202291 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) ==== 80+0+5304 (secure 0 0 0) 0x7f4bcc087bd0 con 0x7f4bd415e260 2024-09-10T23:16:05.565 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:05.565 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:16:05.565 INFO:teuthology.orchestra.run.smithi090.stdout: "auth_dump": [ 2024-09-10T23:16:05.565 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.565 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.a", 2024-09-10T23:16:05.566 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBm/QY6KxAAKT1mZg/6ZcszcNrPmouZfw==", 2024-09-10T23:16:05.566 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.566 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:16:05.566 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:16:05.566 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:16:05.566 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:05.566 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.566 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.566 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.566 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.b", 2024-09-10T23:16:05.566 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmSqPhNhAA3flpsOGFszFMeaPUoHAtJg==", 2024-09-10T23:16:05.566 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.567 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:16:05.567 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:16:05.567 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:16:05.567 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:05.567 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.567 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.567 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.567 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.c", 2024-09-10T23:16:05.567 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmDVE4MhAAHal/PtI10hL4nKdTUO5BiQ==", 2024-09-10T23:16:05.567 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.567 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:16:05.567 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:16:05.567 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:16:05.567 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:05.568 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.568 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.568 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.568 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.d", 2024-09-10T23:16:05.568 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmr3lfAhAAFdZ7zvJmGNFHRwCr+mdY7w==", 2024-09-10T23:16:05.568 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.568 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:16:05.568 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:16:05.568 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:16:05.568 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:05.568 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.568 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.568 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.569 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.0", 2024-09-10T23:16:05.569 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCa0uBmZKxTJRAAfEBB/vykopmDbmREyy227g==", 2024-09-10T23:16:05.569 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.569 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:05.569 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:16:05.569 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:05.569 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.569 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.569 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.569 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.1", 2024-09-10T23:16:05.569 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCd0uBmJHG8NRAAS8QD8Zgrxrxddq7kN4P9Ag==", 2024-09-10T23:16:05.569 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.569 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:05.570 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:16:05.570 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:05.570 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.570 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.570 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.570 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.2", 2024-09-10T23:16:05.570 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCh0uBmtUUmDBAAmYRv9P/wjX8HLVkLatoXuQ==", 2024-09-10T23:16:05.570 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.570 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:05.570 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:16:05.570 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:05.570 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.570 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.570 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.571 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.3", 2024-09-10T23:16:05.571 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCk0uBm4397HBAAGZK0ktD0ORY/0CPlMprYFg==", 2024-09-10T23:16:05.571 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.571 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:05.571 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:16:05.571 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:05.571 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.571 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.571 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.571 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.4", 2024-09-10T23:16:05.572 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCq0uBmBaMINBAAkuhNrc4YFAYQfcxMQenCBQ==", 2024-09-10T23:16:05.572 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.572 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:05.572 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:16:05.572 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:05.572 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.572 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.572 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.572 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.5", 2024-09-10T23:16:05.572 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCu0uBmLOrnCBAAwZTy+62ZN3g5jfH20jB4qw==", 2024-09-10T23:16:05.572 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.572 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:05.572 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:16:05.572 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:05.573 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.573 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.573 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.573 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.6", 2024-09-10T23:16:05.573 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCx0uBmr4bYChAAdWog9uHnYgiiXniefs25DA==", 2024-09-10T23:16:05.573 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.573 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:05.573 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:16:05.573 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:05.573 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.573 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.573 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.573 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.7", 2024-09-10T23:16:05.574 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQC00uBmhU7+DBAAEagAuXuCs1v/vDhIkapi+g==", 2024-09-10T23:16:05.574 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.574 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:05.574 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:16:05.574 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:05.574 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.574 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.574 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.574 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.0", 2024-09-10T23:16:05.574 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmiYBwBhAABMV9erpQ+KZlTmf0kDZ0gw==", 2024-09-10T23:16:05.574 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.574 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:16:05.574 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow r", 2024-09-10T23:16:05.574 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:16:05.575 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.575 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.575 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.575 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.1", 2024-09-10T23:16:05.575 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBm+TBDDxAA4o+iZ4PwpBRpY++ATzt+wg==", 2024-09-10T23:16:05.575 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.575 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:16:05.575 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:16:05.575 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:16:05.575 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:16:05.575 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.575 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.575 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.576 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.2", 2024-09-10T23:16:05.576 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmJYcKDBAArXISnuT+R9uzuQnL3V+wSg==", 2024-09-10T23:16:05.576 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.576 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:16:05.576 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:16:05.576 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:16:05.576 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:16:05.576 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.576 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.576 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.576 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.3", 2024-09-10T23:16:05.576 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmPQvkFBAAaCikPByOvk5xUzTWXdcFPA==", 2024-09-10T23:16:05.576 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.576 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:16:05.577 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:16:05.577 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:16:05.577 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:16:05.577 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.577 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.577 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.577 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.admin", 2024-09-10T23:16:05.577 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmVVIQEBAAY7yzFxxQCyV1YCM3xYC7Og==", 2024-09-10T23:16:05.577 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.577 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:16:05.577 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:16:05.578 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:16:05.578 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:05.578 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.578 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.578 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.578 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.x", 2024-09-10T23:16:05.578 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBm4r0EKBAAIZ4VjoTsUpdB6KFbi7EQLQ==", 2024-09-10T23:16:05.578 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.578 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:16:05.578 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2024-09-10T23:16:05.578 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:05.578 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.578 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:05.579 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.579 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.y", 2024-09-10T23:16:05.579 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmkRSfJBAAWPpV5e4zeX0Es78Xqh9pYw==", 2024-09-10T23:16:05.579 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:05.579 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:16:05.579 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2024-09-10T23:16:05.579 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:05.579 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.579 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.579 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-10T23:16:05.579 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:16:05.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.566+0000 7f4bda016640 1 -- 172.21.15.90:0/4088202291 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4bc0077f70 msgr2=0x7f4bc007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.566+0000 7f4bda016640 1 --2- 172.21.15.90:0/4088202291 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4bc0077f70 0x7f4bc007a430 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4bc40099a0 tx=0x7f4bc4009500 comp rx=0 tx=0).stop 2024-09-10T23:16:05.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.566+0000 7f4bda016640 1 -- 172.21.15.90:0/4088202291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bd415e260 msgr2=0x7f4bd40b54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.566+0000 7f4bda016640 1 --2- 172.21.15.90:0/4088202291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bd415e260 0x7f4bd40b54d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc009920 tx=0x7f4bcc032b90 comp rx=0 tx=0).stop 2024-09-10T23:16:05.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.566+0000 7f4bda016640 1 -- 172.21.15.90:0/4088202291 shutdown_connections 2024-09-10T23:16:05.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.566+0000 7f4bda016640 1 --2- 172.21.15.90:0/4088202291 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4bc0077f70 0x7f4bc007a430 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.566+0000 7f4bda016640 1 --2- 172.21.15.90:0/4088202291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bd415e260 0x7f4bd40b54d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.566+0000 7f4bda016640 1 --2- 172.21.15.90:0/4088202291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4bd40d1190 0x7f4bd4154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.566+0000 7f4bda016640 1 --2- 172.21.15.90:0/4088202291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4bd40b0940 0x7f4bd41577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.566+0000 7f4bda016640 1 -- 172.21.15.90:0/4088202291 >> 172.21.15.90:0/4088202291 conn(0x7f4bd40d0490 msgr2=0x7f4bd406fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:05.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.566+0000 7f4bda016640 1 -- 172.21.15.90:0/4088202291 shutdown_connections 2024-09-10T23:16:05.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.566+0000 7f4bda016640 1 -- 172.21.15.90:0/4088202291 wait complete. 2024-09-10T23:16:05.582 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:16:05.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.683+0000 7fedac29b640 1 -- 172.21.15.90:0/1716728286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda40b1f60 msgr2=0x7feda40cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.683+0000 7fedac29b640 1 --2- 172.21.15.90:0/1716728286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda40b1f60 0x7feda40cdcd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7feda40b5f40 tx=0x7fed9c02a9e0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.683+0000 7fedac29b640 1 -- 172.21.15.90:0/1716728286 shutdown_connections 2024-09-10T23:16:05.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.683+0000 7fedac29b640 1 --2- 172.21.15.90:0/1716728286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda40b1f60 0x7feda40cdcd0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.683+0000 7fedac29b640 1 --2- 172.21.15.90:0/1716728286 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feda415aa30 0x7feda40ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.683+0000 7fedac29b640 1 -- 172.21.15.90:0/1716728286 >> 172.21.15.90:0/1716728286 conn(0x7feda40cc850 msgr2=0x7feda40ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:05.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.683+0000 7fedac29b640 1 -- 172.21.15.90:0/1716728286 shutdown_connections 2024-09-10T23:16:05.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.683+0000 7fedac29b640 1 -- 172.21.15.90:0/1716728286 wait complete. 2024-09-10T23:16:05.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.684+0000 7fedac29b640 1 Processor -- start 2024-09-10T23:16:05.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.684+0000 7fedac29b640 1 -- start start 2024-09-10T23:16:05.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7fedac29b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feda40b1f60 0x7feda414af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7fedac29b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda415aa30 0x7feda409c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7fedac29b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feda41514c0 0x7feda409a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7fedac29b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feda40ce5a0 con 0x7feda415aa30 2024-09-10T23:16:05.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7fedac29b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feda40ce420 con 0x7feda41514c0 2024-09-10T23:16:05.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7fedac29b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7feda40ce720 con 0x7feda40b1f60 2024-09-10T23:16:05.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7feda9836640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda415aa30 0x7feda409c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7feda9836640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda415aa30 0x7feda409c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37760/0 (socket says 172.21.15.90:37760) 2024-09-10T23:16:05.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7feda9836640 1 -- 172.21.15.90:0/2380064576 learned_addr learned my addr 172.21.15.90:0/2380064576 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:05.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7fedaa838640 1 --2- 172.21.15.90:0/2380064576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feda41514c0 0x7feda409a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7fedaa037640 1 --2- 172.21.15.90:0/2380064576 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feda40b1f60 0x7feda414af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7feda9836640 1 -- 172.21.15.90:0/2380064576 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feda40b1f60 msgr2=0x7feda414af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7feda9836640 1 --2- 172.21.15.90:0/2380064576 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feda40b1f60 0x7feda414af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7feda9836640 1 -- 172.21.15.90:0/2380064576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feda41514c0 msgr2=0x7feda409a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7feda9836640 1 --2- 172.21.15.90:0/2380064576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feda41514c0 0x7feda409a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7feda9836640 1 -- 172.21.15.90:0/2380064576 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda409d430 con 0x7feda415aa30 2024-09-10T23:16:05.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7fedaa838640 1 --2- 172.21.15.90:0/2380064576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feda41514c0 0x7feda409a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:05.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7fedaa037640 1 --2- 172.21.15.90:0/2380064576 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feda40b1f60 0x7feda414af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:05.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7feda9836640 1 --2- 172.21.15.90:0/2380064576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda415aa30 0x7feda409c970 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fed9400e6b0 tx=0x7fed9400eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:05.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7fed9affd640 1 -- 172.21.15.90:0/2380064576 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94015070 con 0x7feda415aa30 2024-09-10T23:16:05.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7fed9affd640 1 -- 172.21.15.90:0/2380064576 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed94005360 con 0x7feda415aa30 2024-09-10T23:16:05.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.685+0000 7fedac29b640 1 -- 172.21.15.90:0/2380064576 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda409d710 con 0x7feda415aa30 2024-09-10T23:16:05.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.686+0000 7fed9affd640 1 -- 172.21.15.90:0/2380064576 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94001920 con 0x7feda415aa30 2024-09-10T23:16:05.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.686+0000 7fedac29b640 1 -- 172.21.15.90:0/2380064576 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda40c81d0 con 0x7feda415aa30 2024-09-10T23:16:05.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.686+0000 7fedac29b640 1 -- 172.21.15.90:0/2380064576 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda40cecc0 con 0x7feda415aa30 2024-09-10T23:16:05.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.687+0000 7fed9affd640 1 -- 172.21.15.90:0/2380064576 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fed9400f040 con 0x7feda415aa30 2024-09-10T23:16:05.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.688+0000 7fed9affd640 1 --2- 172.21.15.90:0/2380064576 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fed88077f70 0x7fed8807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.688+0000 7fed9affd640 1 -- 172.21.15.90:0/2380064576 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7fed9409bc90 con 0x7feda415aa30 2024-09-10T23:16:05.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.688+0000 7fedaa037640 1 --2- 172.21.15.90:0/2380064576 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fed88077f70 0x7fed8807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.688+0000 7fedaa037640 1 --2- 172.21.15.90:0/2380064576 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fed88077f70 0x7fed8807a430 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7feda0006fd0 tx=0x7feda0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:05.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.692+0000 7fed9affd640 1 -- 172.21.15.90:0/2380064576 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fed94064b70 con 0x7feda415aa30 2024-09-10T23:16:05.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.867+0000 7fedac29b640 1 -- 172.21.15.90:0/2380064576 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7feda409d8e0 con 0x7feda415aa30 2024-09-10T23:16:05.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.867+0000 7fed9affd640 1 -- 172.21.15.90:0/2380064576 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) ==== 84+0+65 (secure 0 0 0) 0x7fed9406d290 con 0x7feda415aa30 2024-09-10T23:16:05.869 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:05.869 INFO:teuthology.orchestra.run.smithi090.stdout:[ 2024-09-10T23:16:05.869 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:05.869 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 1, 2024-09-10T23:16:05.869 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": ".mgr" 2024-09-10T23:16:05.869 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:05.869 INFO:teuthology.orchestra.run.smithi090.stdout:] 2024-09-10T23:16:05.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.869+0000 7fedac29b640 1 -- 172.21.15.90:0/2380064576 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fed88077f70 msgr2=0x7fed8807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.869+0000 7fedac29b640 1 --2- 172.21.15.90:0/2380064576 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fed88077f70 0x7fed8807a430 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7feda0006fd0 tx=0x7feda0008040 comp rx=0 tx=0).stop 2024-09-10T23:16:05.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.869+0000 7fedac29b640 1 -- 172.21.15.90:0/2380064576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda415aa30 msgr2=0x7feda409c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.869+0000 7fedac29b640 1 --2- 172.21.15.90:0/2380064576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda415aa30 0x7feda409c970 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fed9400e6b0 tx=0x7fed9400eb70 comp rx=0 tx=0).stop 2024-09-10T23:16:05.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.870+0000 7fedac29b640 1 -- 172.21.15.90:0/2380064576 shutdown_connections 2024-09-10T23:16:05.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.870+0000 7fedac29b640 1 --2- 172.21.15.90:0/2380064576 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fed88077f70 0x7fed8807a430 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.870+0000 7fedac29b640 1 --2- 172.21.15.90:0/2380064576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feda41514c0 0x7feda409a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.870+0000 7fedac29b640 1 --2- 172.21.15.90:0/2380064576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda415aa30 0x7feda409c970 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.870+0000 7fedac29b640 1 --2- 172.21.15.90:0/2380064576 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feda40b1f60 0x7feda414af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.870+0000 7fedac29b640 1 -- 172.21.15.90:0/2380064576 >> 172.21.15.90:0/2380064576 conn(0x7feda40cc850 msgr2=0x7feda40af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:05.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.870+0000 7fedac29b640 1 -- 172.21.15.90:0/2380064576 shutdown_connections 2024-09-10T23:16:05.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.870+0000 7fedac29b640 1 -- 172.21.15.90:0/2380064576 wait complete. 2024-09-10T23:16:05.881 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:16:05.881 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:16:05.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.986+0000 7f128b65a640 1 -- 172.21.15.90:0/580175089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1270004d40 msgr2=0x7f12700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.986+0000 7f128b65a640 1 --2- 172.21.15.90:0/580175089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1270004d40 0x7f12700051c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f12840cf5d0 tx=0x7f1270005830 comp rx=0 tx=0).stop 2024-09-10T23:16:05.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.986+0000 7f1289bf7640 1 -- 172.21.15.90:0/580175089 reap_dead start 2024-09-10T23:16:05.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.986+0000 7f128b65a640 1 -- 172.21.15.90:0/580175089 shutdown_connections 2024-09-10T23:16:05.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.986+0000 7f128b65a640 1 -- 172.21.15.90:0/580175089 >> 172.21.15.90:0/580175089 conn(0x7f12840b1650 msgr2=0x7f12840b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:05.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.986+0000 7f128b65a640 1 -- 172.21.15.90:0/580175089 shutdown_connections 2024-09-10T23:16:05.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.986+0000 7f128b65a640 1 -- 172.21.15.90:0/580175089 wait complete. 2024-09-10T23:16:05.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.987+0000 7f128b65a640 1 Processor -- start 2024-09-10T23:16:05.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.988+0000 7f128b65a640 1 -- start start 2024-09-10T23:16:05.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.988+0000 7f128b65a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1270004d40 0x7f12841f6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.988+0000 7f128b65a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1284154550 0x7f12840b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.988+0000 7f128b65a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1284153a90 0x7f12840c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.988+0000 7f128b65a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f12840746f0 con 0x7f1284153a90 2024-09-10T23:16:05.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.988+0000 7f128b65a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f12840cc8d0 con 0x7f1284154550 2024-09-10T23:16:05.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.988+0000 7f128b65a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f128415bb10 con 0x7f1270004d40 2024-09-10T23:16:05.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.988+0000 7f1289bf7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1284153a90 0x7f12840c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.988+0000 7f1289bf7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1284153a90 0x7f12840c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37780/0 (socket says 172.21.15.90:37780) 2024-09-10T23:16:05.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.988+0000 7f1289bf7640 1 -- 172.21.15.90:0/1116144208 learned_addr learned my addr 172.21.15.90:0/1116144208 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:05.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.989+0000 7f1288bf5640 1 --2- 172.21.15.90:0/1116144208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1284154550 0x7f12840b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.989+0000 7f12893f6640 1 --2- 172.21.15.90:0/1116144208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1270004d40 0x7f12841f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.989+0000 7f1289bf7640 1 -- 172.21.15.90:0/1116144208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1270004d40 msgr2=0x7f12841f6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.989+0000 7f1289bf7640 1 --2- 172.21.15.90:0/1116144208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1270004d40 0x7f12841f6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.989+0000 7f1289bf7640 1 -- 172.21.15.90:0/1116144208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1284154550 msgr2=0x7f12840b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.989+0000 7f1289bf7640 1 --2- 172.21.15.90:0/1116144208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1284154550 0x7f12840b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.989+0000 7f1289bf7640 1 -- 172.21.15.90:0/1116144208 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1284154a50 con 0x7f1284153a90 2024-09-10T23:16:05.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.989+0000 7f1289bf7640 1 --2- 172.21.15.90:0/1116144208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1284153a90 0x7f12840c7ed0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f127c00c6d0 tx=0x7f127c004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:05.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.989+0000 7f1279ffb640 1 -- 172.21.15.90:0/1116144208 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c02bbd0 con 0x7f1284153a90 2024-09-10T23:16:05.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.989+0000 7f1279ffb640 1 -- 172.21.15.90:0/1116144208 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f127c02bd70 con 0x7f1284153a90 2024-09-10T23:16:05.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.989+0000 7f1279ffb640 1 -- 172.21.15.90:0/1116144208 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c006290 con 0x7f1284153a90 2024-09-10T23:16:05.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.989+0000 7f128b65a640 1 -- 172.21.15.90:0/1116144208 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1284154d30 con 0x7f1284153a90 2024-09-10T23:16:05.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.989+0000 7f128b65a640 1 -- 172.21.15.90:0/1116144208 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12841f6d40 con 0x7f1284153a90 2024-09-10T23:16:05.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.990+0000 7f128b65a640 1 -- 172.21.15.90:0/1116144208 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12840cc030 con 0x7f1284153a90 2024-09-10T23:16:05.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.991+0000 7f1279ffb640 1 -- 172.21.15.90:0/1116144208 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f127c006430 con 0x7f1284153a90 2024-09-10T23:16:05.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.991+0000 7f1279ffb640 1 --2- 172.21.15.90:0/1116144208 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1268077f70 0x7f126807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.991+0000 7f1279ffb640 1 -- 172.21.15.90:0/1116144208 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7f127c03b020 con 0x7f1284153a90 2024-09-10T23:16:05.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.991+0000 7f12893f6640 1 --2- 172.21.15.90:0/1116144208 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1268077f70 0x7f126807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.992+0000 7f12893f6640 1 --2- 172.21.15.90:0/1116144208 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1268077f70 0x7f126807a430 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1280009b90 tx=0x7f1280005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:05.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:05.995+0000 7f1279ffb640 1 -- 172.21.15.90:0/1116144208 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f12840cc030 con 0x7f1284153a90 2024-09-10T23:16:06.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.171+0000 7f128b65a640 1 -- 172.21.15.90:0/1116144208 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f12840cdc60 con 0x7f1284153a90 2024-09-10T23:16:06.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.217+0000 7f1279ffb640 1 -- 172.21.15.90:0/1116144208 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v54) ==== 138+0+0 (secure 0 0 0) 0x7f127c082220 con 0x7f1284153a90 2024-09-10T23:16:06.219 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' created 2024-09-10T23:16:06.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.220+0000 7f128b65a640 1 -- 172.21.15.90:0/1116144208 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1268077f70 msgr2=0x7f126807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.220+0000 7f128b65a640 1 --2- 172.21.15.90:0/1116144208 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1268077f70 0x7f126807a430 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1280009b90 tx=0x7f1280005f90 comp rx=0 tx=0).stop 2024-09-10T23:16:06.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.220+0000 7f128b65a640 1 -- 172.21.15.90:0/1116144208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1284153a90 msgr2=0x7f12840c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.220+0000 7f128b65a640 1 --2- 172.21.15.90:0/1116144208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1284153a90 0x7f12840c7ed0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f127c00c6d0 tx=0x7f127c004bb0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.220+0000 7f128b65a640 1 -- 172.21.15.90:0/1116144208 shutdown_connections 2024-09-10T23:16:06.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.220+0000 7f128b65a640 1 --2- 172.21.15.90:0/1116144208 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1268077f70 0x7f126807a430 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.220+0000 7f128b65a640 1 --2- 172.21.15.90:0/1116144208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1284154550 0x7f12840b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.220+0000 7f128b65a640 1 --2- 172.21.15.90:0/1116144208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1284153a90 0x7f12840c7ed0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.220+0000 7f128b65a640 1 --2- 172.21.15.90:0/1116144208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1270004d40 0x7f12841f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.220+0000 7f128b65a640 1 -- 172.21.15.90:0/1116144208 >> 172.21.15.90:0/1116144208 conn(0x7f12840b1650 msgr2=0x7f128406e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:06.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.220+0000 7f128b65a640 1 -- 172.21.15.90:0/1116144208 shutdown_connections 2024-09-10T23:16:06.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.220+0000 7f128b65a640 1 -- 172.21.15.90:0/1116144208 wait complete. 2024-09-10T23:16:06.234 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:16:06.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.341+0000 7f20108b1640 1 -- 172.21.15.90:0/1426851084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f200c151a00 msgr2=0x7f200c15bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.341+0000 7f20108b1640 1 --2- 172.21.15.90:0/1426851084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f200c151a00 0x7f200c15bc90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009830 tx=0x7f1ffc02a480 comp rx=0 tx=0).stop 2024-09-10T23:16:06.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.341+0000 7f20108b1640 1 -- 172.21.15.90:0/1426851084 shutdown_connections 2024-09-10T23:16:06.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.341+0000 7f20108b1640 1 --2- 172.21.15.90:0/1426851084 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f200c06fd80 0x7f200c070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.341+0000 7f20108b1640 1 --2- 172.21.15.90:0/1426851084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f200c151a00 0x7f200c15bc90 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.341+0000 7f20108b1640 1 -- 172.21.15.90:0/1426851084 >> 172.21.15.90:0/1426851084 conn(0x7f200c0cfbc0 msgr2=0x7f200c0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:06.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.341+0000 7f20108b1640 1 -- 172.21.15.90:0/1426851084 shutdown_connections 2024-09-10T23:16:06.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.341+0000 7f20108b1640 1 -- 172.21.15.90:0/1426851084 wait complete. 2024-09-10T23:16:06.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.343+0000 7f20108b1640 1 Processor -- start 2024-09-10T23:16:06.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.343+0000 7f20108b1640 1 -- start start 2024-09-10T23:16:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f20108b1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f200c06fd80 0x7f200c1e0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f20108b1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f200c151a00 0x7f200c0c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f20108b1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f200c151de0 0x7f200c0c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f20108b1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f200c0cae00 con 0x7f200c151a00 2024-09-10T23:16:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f20108b1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f200c0cac80 con 0x7f200c06fd80 2024-09-10T23:16:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f20108b1640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f200c0caf80 con 0x7f200c151de0 2024-09-10T23:16:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f2001d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f200c151a00 0x7f200c0c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f2001d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f200c151a00 0x7f200c0c9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37798/0 (socket says 172.21.15.90:37798) 2024-09-10T23:16:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f2001d9b640 1 -- 172.21.15.90:0/3203762886 learned_addr learned my addr 172.21.15.90:0/3203762886 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f200ad9d640 1 --2- 172.21.15.90:0/3203762886 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f200c151de0 0x7f200c0c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f200a59c640 1 --2- 172.21.15.90:0/3203762886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f200c06fd80 0x7f200c1e0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f2001d9b640 1 -- 172.21.15.90:0/3203762886 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f200c151de0 msgr2=0x7f200c0c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f2001d9b640 1 --2- 172.21.15.90:0/3203762886 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f200c151de0 0x7f200c0c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f2001d9b640 1 -- 172.21.15.90:0/3203762886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f200c06fd80 msgr2=0x7f200c1e0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f2001d9b640 1 --2- 172.21.15.90:0/3203762886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f200c06fd80 0x7f200c1e0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f2001d9b640 1 -- 172.21.15.90:0/3203762886 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c145f80 con 0x7f200c151a00 2024-09-10T23:16:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f200a59c640 1 --2- 172.21.15.90:0/3203762886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f200c06fd80 0x7f200c1e0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f2001d9b640 1 --2- 172.21.15.90:0/3203762886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f200c151a00 0x7f200c0c9250 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400c3a0 tx=0x7f1ff400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f20037fe640 1 -- 172.21.15.90:0/3203762886 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4011790 con 0x7f200c151a00 2024-09-10T23:16:06.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f20108b1640 1 -- 172.21.15.90:0/3203762886 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200c1451c0 con 0x7f200c151a00 2024-09-10T23:16:06.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.344+0000 7f20037fe640 1 -- 172.21.15.90:0/3203762886 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ff4017070 con 0x7f200c151a00 2024-09-10T23:16:06.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.345+0000 7f20037fe640 1 -- 172.21.15.90:0/3203762886 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4011cc0 con 0x7f200c151a00 2024-09-10T23:16:06.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.345+0000 7f20108b1640 1 -- 172.21.15.90:0/3203762886 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f200c145780 con 0x7f200c151a00 2024-09-10T23:16:06.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.345+0000 7f20108b1640 1 -- 172.21.15.90:0/3203762886 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f200c06a2b0 con 0x7f200c151a00 2024-09-10T23:16:06.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.346+0000 7f20037fe640 1 -- 172.21.15.90:0/3203762886 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1ff401c460 con 0x7f200c151a00 2024-09-10T23:16:06.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.347+0000 7f20037fe640 1 --2- 172.21.15.90:0/3203762886 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1fec077f70 0x7f1fec07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.347+0000 7f20037fe640 1 -- 172.21.15.90:0/3203762886 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5227+0+0 (secure 0 0 0) 0x7f1ff40998d0 con 0x7f200c151a00 2024-09-10T23:16:06.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.347+0000 7f200a59c640 1 --2- 172.21.15.90:0/3203762886 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1fec077f70 0x7f1fec07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.347+0000 7f200a59c640 1 --2- 172.21.15.90:0/3203762886 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1fec077f70 0x7f1fec07a430 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc034000 tx=0x7f1ffc004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:06.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.351+0000 7f20037fe640 1 -- 172.21.15.90:0/3203762886 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f200c06a2b0 con 0x7f200c151a00 2024-09-10T23:16:06.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:06.528+0000 7f20108b1640 1 -- 172.21.15.90:0/3203762886 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f200c070210 con 0x7f200c151a00 2024-09-10T23:16:07.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.227+0000 7f20037fe640 1 -- 172.21.15.90:0/3203762886 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v55) ==== 170+0+0 (secure 0 0 0) 0x7f1ff4062530 con 0x7f200c151a00 2024-09-10T23:16:07.228 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' created 2024-09-10T23:16:07.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.231+0000 7f20108b1640 1 -- 172.21.15.90:0/3203762886 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1fec077f70 msgr2=0x7f1fec07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.231+0000 7f20108b1640 1 --2- 172.21.15.90:0/3203762886 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1fec077f70 0x7f1fec07a430 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc034000 tx=0x7f1ffc004730 comp rx=0 tx=0).stop 2024-09-10T23:16:07.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.231+0000 7f20108b1640 1 -- 172.21.15.90:0/3203762886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f200c151a00 msgr2=0x7f200c0c9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.231+0000 7f20108b1640 1 --2- 172.21.15.90:0/3203762886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f200c151a00 0x7f200c0c9250 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400c3a0 tx=0x7f1ff400c860 comp rx=0 tx=0).stop 2024-09-10T23:16:07.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.233+0000 7f20108b1640 1 -- 172.21.15.90:0/3203762886 shutdown_connections 2024-09-10T23:16:07.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.234+0000 7f20108b1640 1 --2- 172.21.15.90:0/3203762886 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1fec077f70 0x7f1fec07a430 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.234+0000 7f20108b1640 1 --2- 172.21.15.90:0/3203762886 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f200c151de0 0x7f200c0c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.234+0000 7f20108b1640 1 --2- 172.21.15.90:0/3203762886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f200c151a00 0x7f200c0c9250 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.234+0000 7f20108b1640 1 --2- 172.21.15.90:0/3203762886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f200c06fd80 0x7f200c1e0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.234+0000 7f20108b1640 1 -- 172.21.15.90:0/3203762886 >> 172.21.15.90:0/3203762886 conn(0x7f200c0cfbc0 msgr2=0x7f200c0b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:07.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.236+0000 7f20108b1640 1 -- 172.21.15.90:0/3203762886 shutdown_connections 2024-09-10T23:16:07.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.237+0000 7f20108b1640 1 -- 172.21.15.90:0/3203762886 wait complete. 2024-09-10T23:16:07.256 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:16:07.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.360+0000 7f85c962b640 1 -- 172.21.15.90:0/3460033327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c415bd10 msgr2=0x7f85c40d08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.360+0000 7f85c962b640 1 --2- 172.21.15.90:0/3460033327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c415bd10 0x7f85c40d08e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009830 tx=0x7f85b402a5c0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.360+0000 7f85c962b640 1 -- 172.21.15.90:0/3460033327 shutdown_connections 2024-09-10T23:16:07.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.360+0000 7f85c962b640 1 --2- 172.21.15.90:0/3460033327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c415bd10 0x7f85c40d08e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.360+0000 7f85c962b640 1 -- 172.21.15.90:0/3460033327 >> 172.21.15.90:0/3460033327 conn(0x7f85c40b2950 msgr2=0x7f85c40b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:07.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.360+0000 7f85c962b640 1 -- 172.21.15.90:0/3460033327 shutdown_connections 2024-09-10T23:16:07.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.360+0000 7f85c962b640 1 -- 172.21.15.90:0/3460033327 wait complete. 2024-09-10T23:16:07.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.361+0000 7f85c962b640 1 Processor -- start 2024-09-10T23:16:07.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.361+0000 7f85c962b640 1 -- start start 2024-09-10T23:16:07.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.362+0000 7f85c962b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85c40cd1f0 0x7f85c41562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:07.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.362+0000 7f85c962b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c415bd10 0x7f85c41f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:07.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.362+0000 7f85c962b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85c41603f0 0x7f85c41f6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:07.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.362+0000 7f85c962b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85c406cf80 con 0x7f85c415bd10 2024-09-10T23:16:07.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.362+0000 7f85c962b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f85c406ce00 con 0x7f85c40cd1f0 2024-09-10T23:16:07.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.362+0000 7f85c962b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f85c40cf120 con 0x7f85c41603f0 2024-09-10T23:16:07.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.362+0000 7f85c27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c415bd10 0x7f85c41f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:07.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.362+0000 7f85c27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c415bd10 0x7f85c41f5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37812/0 (socket says 172.21.15.90:37812) 2024-09-10T23:16:07.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.362+0000 7f85c27fc640 1 -- 172.21.15.90:0/3407136992 learned_addr learned my addr 172.21.15.90:0/3407136992 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:07.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.362+0000 7f85c2ffd640 1 --2- 172.21.15.90:0/3407136992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85c40cd1f0 0x7f85c41562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:07.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.362+0000 7f85c37fe640 1 --2- 172.21.15.90:0/3407136992 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85c41603f0 0x7f85c41f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:07.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.362+0000 7f85c27fc640 1 -- 172.21.15.90:0/3407136992 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85c41603f0 msgr2=0x7f85c41f6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.362+0000 7f85c27fc640 1 --2- 172.21.15.90:0/3407136992 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85c41603f0 0x7f85c41f6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.362+0000 7f85c27fc640 1 -- 172.21.15.90:0/3407136992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85c40cd1f0 msgr2=0x7f85c41562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.362+0000 7f85c27fc640 1 --2- 172.21.15.90:0/3407136992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85c40cd1f0 0x7f85c41562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.362+0000 7f85c27fc640 1 -- 172.21.15.90:0/3407136992 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c415e040 con 0x7f85c415bd10 2024-09-10T23:16:07.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.362+0000 7f85c27fc640 1 --2- 172.21.15.90:0/3407136992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c415bd10 0x7f85c41f5f30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f85b800c400 tx=0x7f85b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:07.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.363+0000 7f85ab7fe640 1 -- 172.21.15.90:0/3407136992 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b8011790 con 0x7f85c415bd10 2024-09-10T23:16:07.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.363+0000 7f85ab7fe640 1 -- 172.21.15.90:0/3407136992 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85b8017070 con 0x7f85c415bd10 2024-09-10T23:16:07.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.363+0000 7f85c962b640 1 -- 172.21.15.90:0/3407136992 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c415e320 con 0x7f85c415bd10 2024-09-10T23:16:07.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.363+0000 7f85ab7fe640 1 -- 172.21.15.90:0/3407136992 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b8011ce0 con 0x7f85c415bd10 2024-09-10T23:16:07.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.363+0000 7f85c962b640 1 -- 172.21.15.90:0/3407136992 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c415e8e0 con 0x7f85c415bd10 2024-09-10T23:16:07.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.364+0000 7f85c962b640 1 -- 172.21.15.90:0/3407136992 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85c40cfc90 con 0x7f85c415bd10 2024-09-10T23:16:07.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.364+0000 7f85ab7fe640 1 -- 172.21.15.90:0/3407136992 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f85b801c460 con 0x7f85c415bd10 2024-09-10T23:16:07.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.365+0000 7f85ab7fe640 1 --2- 172.21.15.90:0/3407136992 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f85b0077f70 0x7f85b007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:07.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.365+0000 7f85ab7fe640 1 -- 172.21.15.90:0/3407136992 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5609+0+0 (secure 0 0 0) 0x7f85b80998f0 con 0x7f85c415bd10 2024-09-10T23:16:07.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.365+0000 7f85c2ffd640 1 --2- 172.21.15.90:0/3407136992 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f85b0077f70 0x7f85b007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:07.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.366+0000 7f85c2ffd640 1 --2- 172.21.15.90:0/3407136992 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f85b0077f70 0x7f85b007a430 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f85b4034000 tx=0x7f85b4004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:07.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.370+0000 7f85ab7fe640 1 -- 172.21.15.90:0/3407136992 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f85c40cfc90 con 0x7f85c415bd10 2024-09-10T23:16:07.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:07.582+0000 7f85c962b640 1 -- 172.21.15.90:0/3407136992 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f85c4074210 con 0x7f85c415bd10 2024-09-10T23:16:08.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.231+0000 7f85ab7fe640 1 -- 172.21.15.90:0/3407136992 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v25) ==== 172+0+0 (secure 0 0 0) 0x7f85c4074210 con 0x7f85c415bd10 2024-09-10T23:16:08.233 INFO:teuthology.orchestra.run.smithi090.stderr:new fs with metadata pool 8 and data pool 9 2024-09-10T23:16:08.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.234+0000 7f85c962b640 1 -- 172.21.15.90:0/3407136992 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f85b0077f70 msgr2=0x7f85b007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.234+0000 7f85c962b640 1 --2- 172.21.15.90:0/3407136992 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f85b0077f70 0x7f85b007a430 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f85b4034000 tx=0x7f85b4004730 comp rx=0 tx=0).stop 2024-09-10T23:16:08.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.234+0000 7f85c962b640 1 -- 172.21.15.90:0/3407136992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c415bd10 msgr2=0x7f85c41f5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.234+0000 7f85c962b640 1 --2- 172.21.15.90:0/3407136992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c415bd10 0x7f85c41f5f30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f85b800c400 tx=0x7f85b800c8c0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.234+0000 7f85c962b640 1 -- 172.21.15.90:0/3407136992 shutdown_connections 2024-09-10T23:16:08.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.234+0000 7f85c962b640 1 --2- 172.21.15.90:0/3407136992 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f85b0077f70 0x7f85b007a430 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.234+0000 7f85c962b640 1 --2- 172.21.15.90:0/3407136992 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85c41603f0 0x7f85c41f6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.234+0000 7f85c962b640 1 --2- 172.21.15.90:0/3407136992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c415bd10 0x7f85c41f5f30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.234+0000 7f85c962b640 1 --2- 172.21.15.90:0/3407136992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85c40cd1f0 0x7f85c41562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.234+0000 7f85c962b640 1 -- 172.21.15.90:0/3407136992 >> 172.21.15.90:0/3407136992 conn(0x7f85c40b2950 msgr2=0x7f85c40b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:08.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.235+0000 7f85c962b640 1 -- 172.21.15.90:0/3407136992 shutdown_connections 2024-09-10T23:16:08.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.235+0000 7f85c962b640 1 -- 172.21.15.90:0/3407136992 wait complete. 2024-09-10T23:16:08.251 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:16:08.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.353+0000 7f71c91c6640 1 -- 172.21.15.90:0/297306570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71c415ae10 msgr2=0x7f71c40b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.353+0000 7f71c91c6640 1 --2- 172.21.15.90:0/297306570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71c415ae10 0x7f71c40b1850 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f71ac009830 tx=0x7f71ac02a510 comp rx=0 tx=0).stop 2024-09-10T23:16:08.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.353+0000 7f71c91c6640 1 -- 172.21.15.90:0/297306570 shutdown_connections 2024-09-10T23:16:08.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.353+0000 7f71c91c6640 1 --2- 172.21.15.90:0/297306570 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71c40b1d90 0x7f71c40cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.353+0000 7f71c91c6640 1 --2- 172.21.15.90:0/297306570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71c415ae10 0x7f71c40b1850 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.353+0000 7f71c91c6640 1 -- 172.21.15.90:0/297306570 >> 172.21.15.90:0/297306570 conn(0x7f71c40cc850 msgr2=0x7f71c40ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:08.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.353+0000 7f71c91c6640 1 -- 172.21.15.90:0/297306570 shutdown_connections 2024-09-10T23:16:08.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.353+0000 7f71c91c6640 1 -- 172.21.15.90:0/297306570 wait complete. 2024-09-10T23:16:08.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.354+0000 7f71c91c6640 1 Processor -- start 2024-09-10T23:16:08.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.354+0000 7f71c91c6640 1 -- start start 2024-09-10T23:16:08.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.355+0000 7f71c91c6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71c40b1d90 0x7f71c41f6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.355+0000 7f71c91c6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71c415aa30 0x7f71c40c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.355+0000 7f71c91c6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71c415ae10 0x7f71c40c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.355+0000 7f71c91c6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f71c40ce390 con 0x7f71c40b1d90 2024-09-10T23:16:08.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.355+0000 7f71c91c6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f71c40ce210 con 0x7f71c415ae10 2024-09-10T23:16:08.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.355+0000 7f71c91c6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f71c40ce510 con 0x7f71c415aa30 2024-09-10T23:16:08.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.355+0000 7f71c2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71c40b1d90 0x7f71c41f6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.355+0000 7f71c2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71c40b1d90 0x7f71c41f6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54122/0 (socket says 172.21.15.90:54122) 2024-09-10T23:16:08.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.355+0000 7f71c2d9d640 1 -- 172.21.15.90:0/3897902518 learned_addr learned my addr 172.21.15.90:0/3897902518 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:08.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.355+0000 7f71c259c640 1 --2- 172.21.15.90:0/3897902518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71c415aa30 0x7f71c40c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.355+0000 7f71c359e640 1 --2- 172.21.15.90:0/3897902518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71c415ae10 0x7f71c40c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.355+0000 7f71c2d9d640 1 -- 172.21.15.90:0/3897902518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71c415aa30 msgr2=0x7f71c40c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.355+0000 7f71c2d9d640 1 --2- 172.21.15.90:0/3897902518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71c415aa30 0x7f71c40c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.355+0000 7f71c2d9d640 1 -- 172.21.15.90:0/3897902518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71c415ae10 msgr2=0x7f71c40c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.355+0000 7f71c2d9d640 1 --2- 172.21.15.90:0/3897902518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71c415ae10 0x7f71c40c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.355+0000 7f71c2d9d640 1 -- 172.21.15.90:0/3897902518 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c40c8f20 con 0x7f71c40b1d90 2024-09-10T23:16:08.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.356+0000 7f71c2d9d640 1 --2- 172.21.15.90:0/3897902518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71c40b1d90 0x7f71c41f6540 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00c500 tx=0x7f71bc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:08.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.356+0000 7f71bb7fe640 1 -- 172.21.15.90:0/3897902518 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc017070 con 0x7f71c40b1d90 2024-09-10T23:16:08.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.356+0000 7f71bb7fe640 1 -- 172.21.15.90:0/3897902518 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71bc0035f0 con 0x7f71c40b1d90 2024-09-10T23:16:08.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.356+0000 7f71c91c6640 1 -- 172.21.15.90:0/3897902518 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c40c9260 con 0x7f71c40b1d90 2024-09-10T23:16:08.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.356+0000 7f71bb7fe640 1 -- 172.21.15.90:0/3897902518 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc003a40 con 0x7f71c40b1d90 2024-09-10T23:16:08.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.356+0000 7f71c91c6640 1 -- 172.21.15.90:0/3897902518 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c40c8bf0 con 0x7f71c40b1d90 2024-09-10T23:16:08.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.357+0000 7f71c91c6640 1 -- 172.21.15.90:0/3897902518 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c40cdcd0 con 0x7f71c40b1d90 2024-09-10T23:16:08.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.357+0000 7f71bb7fe640 1 -- 172.21.15.90:0/3897902518 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f71bc003be0 con 0x7f71c40b1d90 2024-09-10T23:16:08.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.358+0000 7f71bb7fe640 1 --2- 172.21.15.90:0/3897902518 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f71a4077f70 0x7f71a407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.358+0000 7f71bb7fe640 1 -- 172.21.15.90:0/3897902518 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7f71bc0994f0 con 0x7f71c40b1d90 2024-09-10T23:16:08.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.358+0000 7f71c259c640 1 --2- 172.21.15.90:0/3897902518 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f71a4077f70 0x7f71a407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.359+0000 7f71c259c640 1 --2- 172.21.15.90:0/3897902518 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f71a4077f70 0x7f71a407a430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f71ac034000 tx=0x7f71ac004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:08.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.362+0000 7f71bb7fe640 1 -- 172.21.15.90:0/3897902518 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f71c40c9260 con 0x7f71c40b1d90 2024-09-10T23:16:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.540+0000 7f71c91c6640 1 -- 172.21.15.90:0/3897902518 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71c40ccc30 con 0x7f71c40b1d90 2024-09-10T23:16:08.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.541+0000 7f71bb7fe640 1 -- 172.21.15.90:0/3897902518 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16738 (secure 0 0 0) 0x7f71bc0619b0 con 0x7f71c40b1d90 2024-09-10T23:16:08.542 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:08.542 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":56,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:16:07.583386+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:16:06.175987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-10T23:16:06.532476+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:16:08.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.543+0000 7f71c91c6640 1 -- 172.21.15.90:0/3897902518 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f71a4077f70 msgr2=0x7f71a407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.543+0000 7f71c91c6640 1 --2- 172.21.15.90:0/3897902518 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f71a4077f70 0x7f71a407a430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f71ac034000 tx=0x7f71ac004730 comp rx=0 tx=0).stop 2024-09-10T23:16:08.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.543+0000 7f71c91c6640 1 -- 172.21.15.90:0/3897902518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71c40b1d90 msgr2=0x7f71c41f6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.543+0000 7f71c91c6640 1 --2- 172.21.15.90:0/3897902518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71c40b1d90 0x7f71c41f6540 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00c500 tx=0x7f71bc00c9c0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.543+0000 7f71c91c6640 1 -- 172.21.15.90:0/3897902518 shutdown_connections 2024-09-10T23:16:08.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.543+0000 7f71c91c6640 1 --2- 172.21.15.90:0/3897902518 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f71a4077f70 0x7f71a407a430 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.543+0000 7f71c91c6640 1 --2- 172.21.15.90:0/3897902518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71c415ae10 0x7f71c40c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.543+0000 7f71c91c6640 1 --2- 172.21.15.90:0/3897902518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71c415aa30 0x7f71c40c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.543+0000 7f71c91c6640 1 --2- 172.21.15.90:0/3897902518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71c40b1d90 0x7f71c41f6540 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.543+0000 7f71c91c6640 1 -- 172.21.15.90:0/3897902518 >> 172.21.15.90:0/3897902518 conn(0x7f71c40cc850 msgr2=0x7f71c40af8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:08.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.543+0000 7f71c91c6640 1 -- 172.21.15.90:0/3897902518 shutdown_connections 2024-09-10T23:16:08.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.543+0000 7f71c91c6640 1 -- 172.21.15.90:0/3897902518 wait complete. 2024-09-10T23:16:08.556 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:16:08.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.655+0000 7f0dc7fda640 1 -- 172.21.15.90:0/2478743243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dc015af10 msgr2=0x7f0dc00cf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.655+0000 7f0dc7fda640 1 --2- 172.21.15.90:0/2478743243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dc015af10 0x7f0dc00cf990 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00ce750 tx=0x7f0db802aa30 comp rx=0 tx=0).stop 2024-09-10T23:16:08.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.655+0000 7f0dc7fda640 1 -- 172.21.15.90:0/2478743243 shutdown_connections 2024-09-10T23:16:08.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.655+0000 7f0dc7fda640 1 --2- 172.21.15.90:0/2478743243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dc015af10 0x7f0dc00cf990 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.655+0000 7f0dc7fda640 1 --2- 172.21.15.90:0/2478743243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dc00ceab0 0x7f0dc00cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.655+0000 7f0dc7fda640 1 --2- 172.21.15.90:0/2478743243 >> v2:172.21.15.171:3300/0 conn(0x7f0dc015ab30 0x7f0dc0071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.655+0000 7f0dc7fda640 1 -- 172.21.15.90:0/2478743243 >> 172.21.15.90:0/2478743243 conn(0x7f0dc00cd960 msgr2=0x7f0dc00cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:08.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.656+0000 7f0dc7fda640 1 -- 172.21.15.90:0/2478743243 shutdown_connections 2024-09-10T23:16:08.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.656+0000 7f0dc7fda640 1 -- 172.21.15.90:0/2478743243 wait complete. 2024-09-10T23:16:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.657+0000 7f0dc7fda640 1 Processor -- start 2024-09-10T23:16:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.657+0000 7f0dc7fda640 1 -- start start 2024-09-10T23:16:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.657+0000 7f0dc7fda640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dc00ceab0 0x7f0dc00b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.657+0000 7f0dc7fda640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dc015ab30 0x7f0dc00c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.657+0000 7f0dc7fda640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dc015af10 0x7f0dc0158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.657+0000 7f0dc7fda640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc0073bd0 con 0x7f0dc00ceab0 2024-09-10T23:16:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.657+0000 7f0dc7fda640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc0073a50 con 0x7f0dc015af10 2024-09-10T23:16:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.657+0000 7f0dc7fda640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc0073d50 con 0x7f0dc015ab30 2024-09-10T23:16:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.658+0000 7f0dc5d76640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dc00ceab0 0x7f0dc00b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.658+0000 7f0dc5d76640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dc00ceab0 0x7f0dc00b68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54142/0 (socket says 172.21.15.90:54142) 2024-09-10T23:16:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.658+0000 7f0dc5d76640 1 -- 172.21.15.90:0/1023360336 learned_addr learned my addr 172.21.15.90:0/1023360336 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.658+0000 7f0dc6577640 1 --2- 172.21.15.90:0/1023360336 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dc015af10 0x7f0dc0158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.658+0000 7f0dc5d76640 1 -- 172.21.15.90:0/1023360336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dc015ab30 msgr2=0x7f0dc00c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.658+0000 7f0dc5d76640 1 --2- 172.21.15.90:0/1023360336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dc015ab30 0x7f0dc00c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.658+0000 7f0dc5d76640 1 -- 172.21.15.90:0/1023360336 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dc015af10 msgr2=0x7f0dc0158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.658+0000 7f0dc5d76640 1 --2- 172.21.15.90:0/1023360336 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dc015af10 0x7f0dc0158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.658+0000 7f0dc5d76640 1 -- 172.21.15.90:0/1023360336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc00c80e0 con 0x7f0dc00ceab0 2024-09-10T23:16:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.658+0000 7f0dc5d76640 1 --2- 172.21.15.90:0/1023360336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dc00ceab0 0x7f0dc00b68b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0db400d950 tx=0x7f0db400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.658+0000 7f0db27fc640 1 -- 172.21.15.90:0/1023360336 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4017070 con 0x7f0dc00ceab0 2024-09-10T23:16:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.658+0000 7f0db27fc640 1 -- 172.21.15.90:0/1023360336 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0db4009d20 con 0x7f0dc00ceab0 2024-09-10T23:16:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.658+0000 7f0dc7fda640 1 -- 172.21.15.90:0/1023360336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc00c83c0 con 0x7f0dc00ceab0 2024-09-10T23:16:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.658+0000 7f0db27fc640 1 -- 172.21.15.90:0/1023360336 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db40106c0 con 0x7f0dc00ceab0 2024-09-10T23:16:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.658+0000 7f0dc7fda640 1 -- 172.21.15.90:0/1023360336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc00b2660 con 0x7f0dc00ceab0 2024-09-10T23:16:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.659+0000 7f0dc7fda640 1 -- 172.21.15.90:0/1023360336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dc006a1b0 con 0x7f0dc00ceab0 2024-09-10T23:16:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.660+0000 7f0db27fc640 1 -- 172.21.15.90:0/1023360336 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0db4010860 con 0x7f0dc00ceab0 2024-09-10T23:16:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.660+0000 7f0db27fc640 1 --2- 172.21.15.90:0/1023360336 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0da4077f70 0x7f0da407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.660+0000 7f0db27fc640 1 -- 172.21.15.90:0/1023360336 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7f0db409a040 con 0x7f0dc00ceab0 2024-09-10T23:16:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.661+0000 7f0dc5575640 1 --2- 172.21.15.90:0/1023360336 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0da4077f70 0x7f0da407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.661+0000 7f0dc5575640 1 --2- 172.21.15.90:0/1023360336 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0da4077f70 0x7f0da407a430 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0058c0 tx=0x7f0dbc005850 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:08.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.665+0000 7f0db27fc640 1 -- 172.21.15.90:0/1023360336 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0dc006a1b0 con 0x7f0dc00ceab0 2024-09-10T23:16:08.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.838+0000 7f0dc7fda640 1 -- 172.21.15.90:0/1023360336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0dc0071190 con 0x7f0dc00ceab0 2024-09-10T23:16:08.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.839+0000 7f0db27fc640 1 -- 172.21.15.90:0/1023360336 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16738 (secure 0 0 0) 0x7f0db4062500 con 0x7f0dc00ceab0 2024-09-10T23:16:08.841 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:08.841 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":56,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:16:07.583386+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:16:06.175987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-10T23:16:06.532476+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:16:08.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.841+0000 7f0dc7fda640 1 -- 172.21.15.90:0/1023360336 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0da4077f70 msgr2=0x7f0da407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.841+0000 7f0dc7fda640 1 --2- 172.21.15.90:0/1023360336 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0da4077f70 0x7f0da407a430 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0058c0 tx=0x7f0dbc005850 comp rx=0 tx=0).stop 2024-09-10T23:16:08.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.841+0000 7f0dc7fda640 1 -- 172.21.15.90:0/1023360336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dc00ceab0 msgr2=0x7f0dc00b68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.841+0000 7f0dc7fda640 1 --2- 172.21.15.90:0/1023360336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dc00ceab0 0x7f0dc00b68b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0db400d950 tx=0x7f0db400de10 comp rx=0 tx=0).stop 2024-09-10T23:16:08.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.842+0000 7f0dc7fda640 1 -- 172.21.15.90:0/1023360336 shutdown_connections 2024-09-10T23:16:08.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.842+0000 7f0dc7fda640 1 --2- 172.21.15.90:0/1023360336 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0da4077f70 0x7f0da407a430 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.842+0000 7f0dc7fda640 1 --2- 172.21.15.90:0/1023360336 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dc015af10 0x7f0dc0158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.842+0000 7f0dc7fda640 1 --2- 172.21.15.90:0/1023360336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dc015ab30 0x7f0dc00c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.842+0000 7f0dc7fda640 1 --2- 172.21.15.90:0/1023360336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dc00ceab0 0x7f0dc00b68b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.842+0000 7f0dc7fda640 1 -- 172.21.15.90:0/1023360336 >> 172.21.15.90:0/1023360336 conn(0x7f0dc00cd960 msgr2=0x7f0dc006d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:08.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.842+0000 7f0dc7fda640 1 -- 172.21.15.90:0/1023360336 shutdown_connections 2024-09-10T23:16:08.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.842+0000 7f0dc7fda640 1 -- 172.21.15.90:0/1023360336 wait complete. 2024-09-10T23:16:08.854 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:16:08.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.957+0000 7f78df833640 1 -- 172.21.15.90:0/144854030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d80d1cd0 msgr2=0x7f78d80d2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.957+0000 7f78df833640 1 --2- 172.21.15.90:0/144854030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d80d1cd0 0x7f78d80d2130 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f78cc005fd0 tx=0x7f78cc02a530 comp rx=0 tx=0).stop 2024-09-10T23:16:08.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.957+0000 7f78df833640 1 -- 172.21.15.90:0/144854030 shutdown_connections 2024-09-10T23:16:08.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.957+0000 7f78df833640 1 --2- 172.21.15.90:0/144854030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d80d1cd0 0x7f78d80d2130 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.957+0000 7f78df833640 1 --2- 172.21.15.90:0/144854030 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d815e0f0 0x7f78d80d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.957+0000 7f78df833640 1 -- 172.21.15.90:0/144854030 >> 172.21.15.90:0/144854030 conn(0x7f78d80d4190 msgr2=0x7f78d80d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:08.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.957+0000 7f78df833640 1 -- 172.21.15.90:0/144854030 shutdown_connections 2024-09-10T23:16:08.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.957+0000 7f78df833640 1 -- 172.21.15.90:0/144854030 wait complete. 2024-09-10T23:16:08.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.958+0000 7f78df833640 1 Processor -- start 2024-09-10T23:16:08.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.958+0000 7f78df833640 1 -- start start 2024-09-10T23:16:08.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.959+0000 7f78df833640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d80d1cd0 0x7f78d806e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.959+0000 7f78df833640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d80d2670 0x7f78d81f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.959+0000 7f78df833640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d815e0f0 0x7f78d81f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.959+0000 7f78df833640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f78d80cf5a0 con 0x7f78d80d2670 2024-09-10T23:16:08.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.959+0000 7f78df833640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f78d80cf420 con 0x7f78d815e0f0 2024-09-10T23:16:08.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.959+0000 7f78df833640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f78d80cf720 con 0x7f78d80d1cd0 2024-09-10T23:16:08.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.959+0000 7f78dcdce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d80d2670 0x7f78d81f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.959+0000 7f78dcdce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d80d2670 0x7f78d81f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54164/0 (socket says 172.21.15.90:54164) 2024-09-10T23:16:08.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.959+0000 7f78dcdce640 1 -- 172.21.15.90:0/1021702018 learned_addr learned my addr 172.21.15.90:0/1021702018 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:08.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.959+0000 7f78dd5cf640 1 --2- 172.21.15.90:0/1021702018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d80d1cd0 0x7f78d806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.959+0000 7f78dddd0640 1 --2- 172.21.15.90:0/1021702018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d815e0f0 0x7f78d81f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.960+0000 7f78dcdce640 1 -- 172.21.15.90:0/1021702018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d80d1cd0 msgr2=0x7f78d806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.960+0000 7f78dcdce640 1 --2- 172.21.15.90:0/1021702018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d80d1cd0 0x7f78d806e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.960+0000 7f78dcdce640 1 -- 172.21.15.90:0/1021702018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d815e0f0 msgr2=0x7f78d81f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:08.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.960+0000 7f78dcdce640 1 --2- 172.21.15.90:0/1021702018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d815e0f0 0x7f78d81f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:08.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.960+0000 7f78dcdce640 1 -- 172.21.15.90:0/1021702018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d81f8050 con 0x7f78d80d2670 2024-09-10T23:16:08.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.960+0000 7f78dd5cf640 1 --2- 172.21.15.90:0/1021702018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d80d1cd0 0x7f78d806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:08.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.960+0000 7f78dcdce640 1 --2- 172.21.15.90:0/1021702018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d80d2670 0x7f78d81f5010 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f78cc000c00 tx=0x7f78cc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:08.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.960+0000 7f78d5ffb640 1 -- 172.21.15.90:0/1021702018 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc03f070 con 0x7f78d80d2670 2024-09-10T23:16:08.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.960+0000 7f78d5ffb640 1 -- 172.21.15.90:0/1021702018 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78cc004890 con 0x7f78d80d2670 2024-09-10T23:16:08.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.960+0000 7f78df833640 1 -- 172.21.15.90:0/1021702018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d81f8330 con 0x7f78d80d2670 2024-09-10T23:16:08.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.960+0000 7f78d5ffb640 1 -- 172.21.15.90:0/1021702018 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc035030 con 0x7f78d80d2670 2024-09-10T23:16:08.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.960+0000 7f78df833640 1 -- 172.21.15.90:0/1021702018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d81f88f0 con 0x7f78d80d2670 2024-09-10T23:16:08.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.961+0000 7f78df833640 1 -- 172.21.15.90:0/1021702018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d80d2130 con 0x7f78d80d2670 2024-09-10T23:16:08.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.962+0000 7f78d5ffb640 1 -- 172.21.15.90:0/1021702018 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f78cc004ce0 con 0x7f78d80d2670 2024-09-10T23:16:08.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.962+0000 7f78d5ffb640 1 --2- 172.21.15.90:0/1021702018 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78c4077f70 0x7f78c407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:08.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.962+0000 7f78d5ffb640 1 -- 172.21.15.90:0/1021702018 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7f78cc0bae50 con 0x7f78d80d2670 2024-09-10T23:16:08.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.962+0000 7f78dd5cf640 1 --2- 172.21.15.90:0/1021702018 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78c4077f70 0x7f78c407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:08.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.963+0000 7f78dd5cf640 1 --2- 172.21.15.90:0/1021702018 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78c4077f70 0x7f78c407a430 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f78c800ae00 tx=0x7f78c800a7e0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:08.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:08.966+0000 7f78d5ffb640 1 -- 172.21.15.90:0/1021702018 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f78cc083390 con 0x7f78d80d2670 2024-09-10T23:16:09.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.176+0000 7f78df833640 1 -- 172.21.15.90:0/1021702018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f78d80d3020 con 0x7f78d80d2670 2024-09-10T23:16:09.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.240+0000 7f78d5ffb640 1 -- 172.21.15.90:0/1021702018 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7f78cc087dc0 con 0x7f78d80d2670 2024-09-10T23:16:09.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.243+0000 7f78df833640 1 -- 172.21.15.90:0/1021702018 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78c4077f70 msgr2=0x7f78c407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:09.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.243+0000 7f78df833640 1 --2- 172.21.15.90:0/1021702018 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78c4077f70 0x7f78c407a430 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f78c800ae00 tx=0x7f78c800a7e0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.243+0000 7f78df833640 1 -- 172.21.15.90:0/1021702018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d80d2670 msgr2=0x7f78d81f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:09.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.243+0000 7f78df833640 1 --2- 172.21.15.90:0/1021702018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d80d2670 0x7f78d81f5010 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f78cc000c00 tx=0x7f78cc0039e0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.243+0000 7f78df833640 1 -- 172.21.15.90:0/1021702018 shutdown_connections 2024-09-10T23:16:09.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.243+0000 7f78df833640 1 --2- 172.21.15.90:0/1021702018 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78c4077f70 0x7f78c407a430 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.243+0000 7f78df833640 1 --2- 172.21.15.90:0/1021702018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d815e0f0 0x7f78d81f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.243+0000 7f78df833640 1 --2- 172.21.15.90:0/1021702018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d80d2670 0x7f78d81f5010 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.243+0000 7f78df833640 1 --2- 172.21.15.90:0/1021702018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d80d1cd0 0x7f78d806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.243+0000 7f78df833640 1 -- 172.21.15.90:0/1021702018 >> 172.21.15.90:0/1021702018 conn(0x7f78d80d4190 msgr2=0x7f78d80cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:09.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.243+0000 7f78df833640 1 -- 172.21.15.90:0/1021702018 shutdown_connections 2024-09-10T23:16:09.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.243+0000 7f78df833640 1 -- 172.21.15.90:0/1021702018 wait complete. 2024-09-10T23:16:09.254 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:16:09.254 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:16:09.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.358+0000 7fb144452640 1 -- 172.21.15.90:0/2459917447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb13c15e0f0 msgr2=0x7fb13c0d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:09.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.358+0000 7fb144452640 1 --2- 172.21.15.90:0/2459917447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb13c15e0f0 0x7fb13c0d2ea0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb138005fd0 tx=0x7fb13802a530 comp rx=0 tx=0).stop 2024-09-10T23:16:09.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.358+0000 7fb144452640 1 -- 172.21.15.90:0/2459917447 shutdown_connections 2024-09-10T23:16:09.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.358+0000 7fb144452640 1 --2- 172.21.15.90:0/2459917447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb13c0d1cd0 0x7fb13c0d2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.358+0000 7fb144452640 1 --2- 172.21.15.90:0/2459917447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb13c15e0f0 0x7fb13c0d2ea0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.358+0000 7fb144452640 1 -- 172.21.15.90:0/2459917447 >> 172.21.15.90:0/2459917447 conn(0x7fb13c0d4190 msgr2=0x7fb13c0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:09.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.358+0000 7fb144452640 1 -- 172.21.15.90:0/2459917447 shutdown_connections 2024-09-10T23:16:09.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.358+0000 7fb144452640 1 -- 172.21.15.90:0/2459917447 wait complete. 2024-09-10T23:16:09.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.359+0000 7fb144452640 1 Processor -- start 2024-09-10T23:16:09.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.359+0000 7fb144452640 1 -- start start 2024-09-10T23:16:09.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.360+0000 7fb144452640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb13c0d1cd0 0x7fb13c0c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:09.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.360+0000 7fb144452640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb13c0d2670 0x7fb13c1f5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:09.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.360+0000 7fb144452640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb13c15e0f0 0x7fb13c0a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:09.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.360+0000 7fb144452640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c0cf5a0 con 0x7fb13c15e0f0 2024-09-10T23:16:09.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.360+0000 7fb144452640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c0cf420 con 0x7fb13c0d1cd0 2024-09-10T23:16:09.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.360+0000 7fb144452640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb13c0cf720 con 0x7fb13c0d2670 2024-09-10T23:16:09.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.360+0000 7fb1429ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb13c15e0f0 0x7fb13c0a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:09.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.360+0000 7fb1429ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb13c15e0f0 0x7fb13c0a1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54194/0 (socket says 172.21.15.90:54194) 2024-09-10T23:16:09.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.360+0000 7fb1429ef640 1 -- 172.21.15.90:0/3917829047 learned_addr learned my addr 172.21.15.90:0/3917829047 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:09.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.360+0000 7fb1419ed640 1 --2- 172.21.15.90:0/3917829047 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb13c0d2670 0x7fb13c1f5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:09.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.360+0000 7fb1421ee640 1 --2- 172.21.15.90:0/3917829047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb13c0d1cd0 0x7fb13c0c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:09.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.360+0000 7fb1429ef640 1 -- 172.21.15.90:0/3917829047 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb13c0d2670 msgr2=0x7fb13c1f5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:09.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.360+0000 7fb1429ef640 1 --2- 172.21.15.90:0/3917829047 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb13c0d2670 0x7fb13c1f5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.360+0000 7fb1429ef640 1 -- 172.21.15.90:0/3917829047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb13c0d1cd0 msgr2=0x7fb13c0c7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:09.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.360+0000 7fb1429ef640 1 --2- 172.21.15.90:0/3917829047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb13c0d1cd0 0x7fb13c0c7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.360+0000 7fb1429ef640 1 -- 172.21.15.90:0/3917829047 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb13c0c82c0 con 0x7fb13c15e0f0 2024-09-10T23:16:09.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.360+0000 7fb1429ef640 1 --2- 172.21.15.90:0/3917829047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb13c15e0f0 0x7fb13c0a1610 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb13400c780 tx=0x7fb13400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:09.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.361+0000 7fb132ffd640 1 -- 172.21.15.90:0/3917829047 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134017070 con 0x7fb13c15e0f0 2024-09-10T23:16:09.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.361+0000 7fb132ffd640 1 -- 172.21.15.90:0/3917829047 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb134005070 con 0x7fb13c15e0f0 2024-09-10T23:16:09.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.361+0000 7fb144452640 1 -- 172.21.15.90:0/3917829047 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb13c0c85a0 con 0x7fb13c15e0f0 2024-09-10T23:16:09.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.361+0000 7fb132ffd640 1 -- 172.21.15.90:0/3917829047 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134005500 con 0x7fb13c15e0f0 2024-09-10T23:16:09.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.361+0000 7fb144452640 1 -- 172.21.15.90:0/3917829047 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb13c0c8b60 con 0x7fb13c15e0f0 2024-09-10T23:16:09.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.361+0000 7fb144452640 1 -- 172.21.15.90:0/3917829047 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb13c0d2110 con 0x7fb13c15e0f0 2024-09-10T23:16:09.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.362+0000 7fb132ffd640 1 -- 172.21.15.90:0/3917829047 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb13400a5e0 con 0x7fb13c15e0f0 2024-09-10T23:16:09.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.363+0000 7fb132ffd640 1 --2- 172.21.15.90:0/3917829047 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb120077f70 0x7fb12007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:09.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.363+0000 7fb132ffd640 1 -- 172.21.15.90:0/3917829047 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fb134099730 con 0x7fb13c15e0f0 2024-09-10T23:16:09.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.363+0000 7fb1421ee640 1 --2- 172.21.15.90:0/3917829047 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb120077f70 0x7fb12007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:09.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.364+0000 7fb1421ee640 1 --2- 172.21.15.90:0/3917829047 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb120077f70 0x7fb12007a430 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb138033000 tx=0x7fb138004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:09.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.367+0000 7fb132ffd640 1 -- 172.21.15.90:0/3917829047 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb134062230 con 0x7fb13c15e0f0 2024-09-10T23:16:09.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:09.575+0000 7fb144452640 1 -- 172.21.15.90:0/3917829047 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb13c0a1b50 con 0x7fb13c15e0f0 2024-09-10T23:16:10.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.243+0000 7fb132ffd640 1 -- 172.21.15.90:0/3917829047 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) ==== 122+0+0 (secure 0 0 0) 0x7fb134061b30 con 0x7fb13c15e0f0 2024-09-10T23:16:10.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.246+0000 7fb144452640 1 -- 172.21.15.90:0/3917829047 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb120077f70 msgr2=0x7fb12007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:10.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.246+0000 7fb144452640 1 --2- 172.21.15.90:0/3917829047 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb120077f70 0x7fb12007a430 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb138033000 tx=0x7fb138004730 comp rx=0 tx=0).stop 2024-09-10T23:16:10.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.246+0000 7fb144452640 1 -- 172.21.15.90:0/3917829047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb13c15e0f0 msgr2=0x7fb13c0a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:10.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.246+0000 7fb144452640 1 --2- 172.21.15.90:0/3917829047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb13c15e0f0 0x7fb13c0a1610 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb13400c780 tx=0x7fb13400cc40 comp rx=0 tx=0).stop 2024-09-10T23:16:10.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.246+0000 7fb144452640 1 -- 172.21.15.90:0/3917829047 shutdown_connections 2024-09-10T23:16:10.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.246+0000 7fb144452640 1 --2- 172.21.15.90:0/3917829047 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb120077f70 0x7fb12007a430 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.246+0000 7fb144452640 1 --2- 172.21.15.90:0/3917829047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb13c15e0f0 0x7fb13c0a1610 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.246+0000 7fb144452640 1 --2- 172.21.15.90:0/3917829047 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb13c0d2670 0x7fb13c1f5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.246+0000 7fb144452640 1 --2- 172.21.15.90:0/3917829047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb13c0d1cd0 0x7fb13c0c7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.246+0000 7fb144452640 1 -- 172.21.15.90:0/3917829047 >> 172.21.15.90:0/3917829047 conn(0x7fb13c0d4190 msgr2=0x7fb13c06ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:10.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.246+0000 7fb144452640 1 -- 172.21.15.90:0/3917829047 shutdown_connections 2024-09-10T23:16:10.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.246+0000 7fb144452640 1 -- 172.21.15.90:0/3917829047 wait complete. 2024-09-10T23:16:10.261 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:16:10.261 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:10.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.362+0000 7fa15c6e6640 1 -- 172.21.15.90:0/3310686796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1540aef50 msgr2=0x7fa1540cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:10.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.362+0000 7fa15c6e6640 1 --2- 172.21.15.90:0/3310686796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1540aef50 0x7fa1540cd9a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa144005fd0 tx=0x7fa14402b880 comp rx=0 tx=0).stop 2024-09-10T23:16:10.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.363+0000 7fa15c6e6640 1 -- 172.21.15.90:0/3310686796 shutdown_connections 2024-09-10T23:16:10.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.363+0000 7fa15c6e6640 1 --2- 172.21.15.90:0/3310686796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1540aef50 0x7fa1540cd9a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.363+0000 7fa15c6e6640 1 -- 172.21.15.90:0/3310686796 >> 172.21.15.90:0/3310686796 conn(0x7fa1540cc850 msgr2=0x7fa1540ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:10.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.363+0000 7fa15c6e6640 1 -- 172.21.15.90:0/3310686796 shutdown_connections 2024-09-10T23:16:10.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.363+0000 7fa15c6e6640 1 -- 172.21.15.90:0/3310686796 wait complete. 2024-09-10T23:16:10.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.364+0000 7fa15c6e6640 1 Processor -- start 2024-09-10T23:16:10.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.364+0000 7fa15c6e6640 1 -- start start 2024-09-10T23:16:10.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.364+0000 7fa15c6e6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1540aef50 0x7fa1541f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:10.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.364+0000 7fa15c6e6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1540ca420 0x7fa1540c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:10.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.364+0000 7fa15c6e6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa154157fc0 0x7fa154074330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:10.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa15c6e6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa1540ca850 con 0x7fa1540ca420 2024-09-10T23:16:10.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa15c6e6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa15406ff10 con 0x7fa1540aef50 2024-09-10T23:16:10.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa15c6e6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa1540ca9d0 con 0x7fa154157fc0 2024-09-10T23:16:10.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa159c81640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1540ca420 0x7fa1540c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:10.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa159c81640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1540ca420 0x7fa1540c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54210/0 (socket says 172.21.15.90:54210) 2024-09-10T23:16:10.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa159c81640 1 -- 172.21.15.90:0/3960695179 learned_addr learned my addr 172.21.15.90:0/3960695179 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:10.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa15a482640 1 --2- 172.21.15.90:0/3960695179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1540aef50 0x7fa1541f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:10.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa15ac83640 1 --2- 172.21.15.90:0/3960695179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa154157fc0 0x7fa154074330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:10.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa159c81640 1 -- 172.21.15.90:0/3960695179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa154157fc0 msgr2=0x7fa154074330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:10.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa159c81640 1 --2- 172.21.15.90:0/3960695179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa154157fc0 0x7fa154074330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa159c81640 1 -- 172.21.15.90:0/3960695179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1540aef50 msgr2=0x7fa1541f4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:10.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa159c81640 1 --2- 172.21.15.90:0/3960695179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1540aef50 0x7fa1541f4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa159c81640 1 -- 172.21.15.90:0/3960695179 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1540c83a0 con 0x7fa1540ca420 2024-09-10T23:16:10.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa15a482640 1 --2- 172.21.15.90:0/3960695179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1540aef50 0x7fa1541f4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:10.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa159c81640 1 --2- 172.21.15.90:0/3960695179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1540ca420 0x7fa1540c9160 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa144034040 tx=0x7fa144003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:10.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa14affd640 1 -- 172.21.15.90:0/3960695179 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa144041070 con 0x7fa1540ca420 2024-09-10T23:16:10.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa14affd640 1 -- 172.21.15.90:0/3960695179 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa144003e00 con 0x7fa1540ca420 2024-09-10T23:16:10.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa15c6e6640 1 -- 172.21.15.90:0/3960695179 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1540c8680 con 0x7fa1540ca420 2024-09-10T23:16:10.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa14affd640 1 -- 172.21.15.90:0/3960695179 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa144004a00 con 0x7fa1540ca420 2024-09-10T23:16:10.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.365+0000 7fa15c6e6640 1 -- 172.21.15.90:0/3960695179 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1540c8c40 con 0x7fa1540ca420 2024-09-10T23:16:10.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.366+0000 7fa15c6e6640 1 -- 172.21.15.90:0/3960695179 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1540cd9a0 con 0x7fa1540ca420 2024-09-10T23:16:10.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.367+0000 7fa14affd640 1 -- 172.21.15.90:0/3960695179 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa14404e030 con 0x7fa1540ca420 2024-09-10T23:16:10.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.368+0000 7fa14affd640 1 --2- 172.21.15.90:0/3960695179 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa138077f70 0x7fa13807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:10.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.368+0000 7fa14affd640 1 -- 172.21.15.90:0/3960695179 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fa1440bcfe0 con 0x7fa1540ca420 2024-09-10T23:16:10.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.368+0000 7fa15a482640 1 --2- 172.21.15.90:0/3960695179 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa138077f70 0x7fa13807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:10.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.368+0000 7fa15a482640 1 --2- 172.21.15.90:0/3960695179 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa138077f70 0x7fa13807a430 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa150000f60 tx=0x7fa150009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:10.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.372+0000 7fa14affd640 1 -- 172.21.15.90:0/3960695179 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa14402f050 con 0x7fa1540ca420 2024-09-10T23:16:10.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.582+0000 7fa15c6e6640 1 -- 172.21.15.90:0/3960695179 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1540c9ec0 con 0x7fa1540ca420 2024-09-10T23:16:10.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.583+0000 7fa14affd640 1 -- 172.21.15.90:0/3960695179 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7fa144085b70 con 0x7fa1540ca420 2024-09-10T23:16:10.585 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:10.585 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":27,"btime":"2024-09-10T23:16:10:241620+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3624303902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3624303902},{"type":"v1","addr":"172.21.15.171:6837","nonce":3624303902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1743356090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1743356090},{"type":"v1","addr":"172.21.15.171:6836","nonce":1743356090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/2007304013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2007304013},{"type":"v1","addr":"172.21.15.90:6833","nonce":2007304013}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:16:07.583350+0000","modified":"2024-09-10T23:16:09.576927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5556":{"gid":5556,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/1708086583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1708086583},{"type":"v1","addr":"172.21.15.90:6835","nonce":1708086583}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5556,"qdb_cluster":[5556]},"id":4}]} 2024-09-10T23:16:10.585 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 27 2024-09-10T23:16:10.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.585+0000 7fa15c6e6640 1 -- 172.21.15.90:0/3960695179 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa138077f70 msgr2=0x7fa13807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:10.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.585+0000 7fa15c6e6640 1 --2- 172.21.15.90:0/3960695179 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa138077f70 0x7fa13807a430 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa150000f60 tx=0x7fa150009040 comp rx=0 tx=0).stop 2024-09-10T23:16:10.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.585+0000 7fa15c6e6640 1 -- 172.21.15.90:0/3960695179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1540ca420 msgr2=0x7fa1540c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:10.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.585+0000 7fa15c6e6640 1 --2- 172.21.15.90:0/3960695179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1540ca420 0x7fa1540c9160 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa144034040 tx=0x7fa144003910 comp rx=0 tx=0).stop 2024-09-10T23:16:10.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.585+0000 7fa15c6e6640 1 -- 172.21.15.90:0/3960695179 shutdown_connections 2024-09-10T23:16:10.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.585+0000 7fa15c6e6640 1 --2- 172.21.15.90:0/3960695179 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa138077f70 0x7fa13807a430 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.585+0000 7fa15c6e6640 1 --2- 172.21.15.90:0/3960695179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa154157fc0 0x7fa154074330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.585+0000 7fa15c6e6640 1 --2- 172.21.15.90:0/3960695179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1540ca420 0x7fa1540c9160 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.585+0000 7fa15c6e6640 1 --2- 172.21.15.90:0/3960695179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1540aef50 0x7fa1541f4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.585+0000 7fa15c6e6640 1 -- 172.21.15.90:0/3960695179 >> 172.21.15.90:0/3960695179 conn(0x7fa1540cc850 msgr2=0x7fa154159d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:10.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.585+0000 7fa15c6e6640 1 -- 172.21.15.90:0/3960695179 shutdown_connections 2024-09-10T23:16:10.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.585+0000 7fa15c6e6640 1 -- 172.21.15.90:0/3960695179 wait complete. 2024-09-10T23:16:10.598 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:16:10.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.697+0000 7fa3f37c2640 1 -- 172.21.15.90:0/1426888234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3ec0d2470 msgr2=0x7fa3ec0b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:10.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.697+0000 7fa3f37c2640 1 --2- 172.21.15.90:0/1426888234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3ec0d2470 0x7fa3ec0b3490 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0ce940 tx=0x7fa3dc02a8b0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.697+0000 7fa3f37c2640 1 -- 172.21.15.90:0/1426888234 shutdown_connections 2024-09-10T23:16:10.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.697+0000 7fa3f37c2640 1 --2- 172.21.15.90:0/1426888234 >> v2:172.21.15.171:3300/0 conn(0x7fa3ec0b3a00 0x7fa3ec0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.697+0000 7fa3f37c2640 1 --2- 172.21.15.90:0/1426888234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3ec0d2470 0x7fa3ec0b3490 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.697+0000 7fa3f37c2640 1 -- 172.21.15.90:0/1426888234 >> 172.21.15.90:0/1426888234 conn(0x7fa3ec09d2a0 msgr2=0x7fa3ec0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:10.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.697+0000 7fa3f37c2640 1 -- 172.21.15.90:0/1426888234 shutdown_connections 2024-09-10T23:16:10.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.697+0000 7fa3f37c2640 1 -- 172.21.15.90:0/1426888234 wait complete. 2024-09-10T23:16:10.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.699+0000 7fa3f37c2640 1 Processor -- start 2024-09-10T23:16:10.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.699+0000 7fa3f37c2640 1 -- start start 2024-09-10T23:16:10.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.699+0000 7fa3f37c2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3ec0b3a00 0x7fa3ec0b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:10.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.699+0000 7fa3f37c2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3ec0d1c70 0x7fa3ec15acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:10.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.699+0000 7fa3f37c2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3ec0d2470 0x7fa3ec1f4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:10.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.699+0000 7fa3f37c2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec0b4570 con 0x7fa3ec0d2470 2024-09-10T23:16:10.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.699+0000 7fa3f37c2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec0b43f0 con 0x7fa3ec0b3a00 2024-09-10T23:16:10.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.699+0000 7fa3f37c2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa3ec0b46f0 con 0x7fa3ec0d1c70 2024-09-10T23:16:10.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.699+0000 7fa3f1d5f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3ec0d2470 0x7fa3ec1f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:10.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.699+0000 7fa3f1d5f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3ec0d2470 0x7fa3ec1f4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54230/0 (socket says 172.21.15.90:54230) 2024-09-10T23:16:10.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.699+0000 7fa3f1d5f640 1 -- 172.21.15.90:0/594125671 learned_addr learned my addr 172.21.15.90:0/594125671 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:10.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.700+0000 7fa3f1d5f640 1 -- 172.21.15.90:0/594125671 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3ec0d1c70 msgr2=0x7fa3ec15acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:10.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.700+0000 7fa3f1d5f640 1 --2- 172.21.15.90:0/594125671 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3ec0d1c70 0x7fa3ec15acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.700+0000 7fa3f1d5f640 1 -- 172.21.15.90:0/594125671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3ec0b3a00 msgr2=0x7fa3ec0b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:10.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.700+0000 7fa3f1d5f640 1 --2- 172.21.15.90:0/594125671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3ec0b3a00 0x7fa3ec0b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.700+0000 7fa3f1d5f640 1 -- 172.21.15.90:0/594125671 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ec1f5660 con 0x7fa3ec0d2470 2024-09-10T23:16:10.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.700+0000 7fa3f1d5f640 1 --2- 172.21.15.90:0/594125671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3ec0d2470 0x7fa3ec1f4af0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400e9a0 tx=0x7fa3e400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:10.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.700+0000 7fa3e9ffb640 1 -- 172.21.15.90:0/594125671 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e400ccc0 con 0x7fa3ec0d2470 2024-09-10T23:16:10.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.700+0000 7fa3e9ffb640 1 -- 172.21.15.90:0/594125671 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3e400ce60 con 0x7fa3ec0d2470 2024-09-10T23:16:10.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.700+0000 7fa3f37c2640 1 -- 172.21.15.90:0/594125671 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3ec0b6f70 con 0x7fa3ec0d2470 2024-09-10T23:16:10.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.700+0000 7fa3e9ffb640 1 -- 172.21.15.90:0/594125671 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4005280 con 0x7fa3ec0d2470 2024-09-10T23:16:10.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.700+0000 7fa3f37c2640 1 -- 172.21.15.90:0/594125671 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3ec161360 con 0x7fa3ec0d2470 2024-09-10T23:16:10.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.701+0000 7fa3f37c2640 1 -- 172.21.15.90:0/594125671 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3ec0b3eb0 con 0x7fa3ec0d2470 2024-09-10T23:16:10.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.702+0000 7fa3e9ffb640 1 -- 172.21.15.90:0/594125671 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa3e4005420 con 0x7fa3ec0d2470 2024-09-10T23:16:10.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.702+0000 7fa3e9ffb640 1 --2- 172.21.15.90:0/594125671 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa3d8077f70 0x7fa3d807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:10.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.702+0000 7fa3e9ffb640 1 -- 172.21.15.90:0/594125671 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fa3e409a880 con 0x7fa3ec0d2470 2024-09-10T23:16:10.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.703+0000 7fa3f155e640 1 --2- 172.21.15.90:0/594125671 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa3d8077f70 0x7fa3d807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:10.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.703+0000 7fa3f155e640 1 --2- 172.21.15.90:0/594125671 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa3d8077f70 0x7fa3d807a430 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc034000 tx=0x7fa3dc004a40 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:10.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.706+0000 7fa3e9ffb640 1 -- 172.21.15.90:0/594125671 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa3e4063410 con 0x7fa3ec0d2470 2024-09-10T23:16:10.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.881+0000 7fa3f37c2640 1 -- 172.21.15.90:0/594125671 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3ec0d1070 con 0x7fa3ec0d2470 2024-09-10T23:16:10.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.882+0000 7fa3e9ffb640 1 -- 172.21.15.90:0/594125671 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16725 (secure 0 0 0) 0x7fa3e4062d10 con 0x7fa3ec0d2470 2024-09-10T23:16:10.884 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:10.884 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":57,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:16:09.203144+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:16:06.175987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-10T23:16:06.532476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:16:10.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.884+0000 7fa3f37c2640 1 -- 172.21.15.90:0/594125671 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa3d8077f70 msgr2=0x7fa3d807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:10.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.884+0000 7fa3f37c2640 1 --2- 172.21.15.90:0/594125671 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa3d8077f70 0x7fa3d807a430 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc034000 tx=0x7fa3dc004a40 comp rx=0 tx=0).stop 2024-09-10T23:16:10.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.884+0000 7fa3f37c2640 1 -- 172.21.15.90:0/594125671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3ec0d2470 msgr2=0x7fa3ec1f4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:10.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.884+0000 7fa3f37c2640 1 --2- 172.21.15.90:0/594125671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3ec0d2470 0x7fa3ec1f4af0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400e9a0 tx=0x7fa3e400eda0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.885+0000 7fa3f37c2640 1 -- 172.21.15.90:0/594125671 shutdown_connections 2024-09-10T23:16:10.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.885+0000 7fa3f37c2640 1 --2- 172.21.15.90:0/594125671 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa3d8077f70 0x7fa3d807a430 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.885+0000 7fa3f37c2640 1 --2- 172.21.15.90:0/594125671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3ec0d2470 0x7fa3ec1f4af0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.885+0000 7fa3f37c2640 1 --2- 172.21.15.90:0/594125671 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3ec0d1c70 0x7fa3ec15acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.885+0000 7fa3f37c2640 1 --2- 172.21.15.90:0/594125671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3ec0b3a00 0x7fa3ec0b7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:10.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.885+0000 7fa3f37c2640 1 -- 172.21.15.90:0/594125671 >> 172.21.15.90:0/594125671 conn(0x7fa3ec09d2a0 msgr2=0x7fa3ec0d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:10.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.885+0000 7fa3f37c2640 1 -- 172.21.15.90:0/594125671 shutdown_connections 2024-09-10T23:16:10.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.885+0000 7fa3f37c2640 1 -- 172.21.15.90:0/594125671 wait complete. 2024-09-10T23:16:10.899 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:16:10.899 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:16:11.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.999+0000 7f2ee0272640 1 -- 172.21.15.90:0/1768980469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed80ca420 msgr2=0x7f2ed80ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.999+0000 7f2ee0272640 1 --2- 172.21.15.90:0/1768980469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed80ca420 0x7f2ed80ca8b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2ed806db00 tx=0x7f2ed002a4d0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.999+0000 7f2ee0272640 1 -- 172.21.15.90:0/1768980469 shutdown_connections 2024-09-10T23:16:11.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.999+0000 7f2ee0272640 1 --2- 172.21.15.90:0/1768980469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed80ca420 0x7f2ed80ca8b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.999+0000 7f2ee0272640 1 --2- 172.21.15.90:0/1768980469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ed80aef50 0x7f2ed80cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.999+0000 7f2ee0272640 1 --2- 172.21.15.90:0/1768980469 >> v2:172.21.15.171:3300/0 conn(0x7f2ed8157fc0 0x7f2ed815b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.999+0000 7f2ee0272640 1 -- 172.21.15.90:0/1768980469 >> 172.21.15.90:0/1768980469 conn(0x7f2ed80cc850 msgr2=0x7f2ed80ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:11.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.999+0000 7f2ee0272640 1 -- 172.21.15.90:0/1768980469 shutdown_connections 2024-09-10T23:16:11.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:10.999+0000 7f2ee0272640 1 -- 172.21.15.90:0/1768980469 wait complete. 2024-09-10T23:16:11.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.000+0000 7f2ee0272640 1 Processor -- start 2024-09-10T23:16:11.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.000+0000 7f2ee0272640 1 -- start start 2024-09-10T23:16:11.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2ee0272640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ed80aef50 0x7f2ed81533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:11.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2ee0272640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ed80ca420 0x7f2ed8159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:11.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2ee0272640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed8157fc0 0x7f2ed80cef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:11.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2ee0272640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed80ce0f0 con 0x7f2ed8157fc0 2024-09-10T23:16:11.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2ee0272640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed806eeb0 con 0x7f2ed80ca420 2024-09-10T23:16:11.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2ee0272640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2ed80b18c0 con 0x7f2ed80aef50 2024-09-10T23:16:11.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2ede80f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed8157fc0 0x7f2ed80cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:11.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2ede80f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed8157fc0 0x7f2ed80cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54260/0 (socket says 172.21.15.90:54260) 2024-09-10T23:16:11.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2ede80f640 1 -- 172.21.15.90:0/2032010739 learned_addr learned my addr 172.21.15.90:0/2032010739 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:11.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2ede00e640 1 --2- 172.21.15.90:0/2032010739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ed80aef50 0x7f2ed81533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:11.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2ede80f640 1 -- 172.21.15.90:0/2032010739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ed80aef50 msgr2=0x7f2ed81533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2edd80d640 1 --2- 172.21.15.90:0/2032010739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ed80ca420 0x7f2ed8159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:11.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2ede80f640 1 --2- 172.21.15.90:0/2032010739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ed80aef50 0x7f2ed81533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2ede80f640 1 -- 172.21.15.90:0/2032010739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ed80ca420 msgr2=0x7f2ed8159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2ede80f640 1 --2- 172.21.15.90:0/2032010739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ed80ca420 0x7f2ed8159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2ede80f640 1 -- 172.21.15.90:0/2032010739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed81559d0 con 0x7f2ed8157fc0 2024-09-10T23:16:11.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2edd80d640 1 --2- 172.21.15.90:0/2032010739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ed80ca420 0x7f2ed8159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:11.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.001+0000 7f2ede80f640 1 --2- 172.21.15.90:0/2032010739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed8157fc0 0x7f2ed80cef80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0009230 tx=0x7f2ed0003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:11.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.002+0000 7f2eceffd640 1 -- 172.21.15.90:0/2032010739 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed003f070 con 0x7f2ed8157fc0 2024-09-10T23:16:11.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.002+0000 7f2eceffd640 1 -- 172.21.15.90:0/2032010739 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ed0004890 con 0x7f2ed8157fc0 2024-09-10T23:16:11.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.002+0000 7f2ee0272640 1 -- 172.21.15.90:0/2032010739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ed8155c70 con 0x7f2ed8157fc0 2024-09-10T23:16:11.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.002+0000 7f2eceffd640 1 -- 172.21.15.90:0/2032010739 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0035030 con 0x7f2ed8157fc0 2024-09-10T23:16:11.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.002+0000 7f2ee0272640 1 -- 172.21.15.90:0/2032010739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ed8156230 con 0x7f2ed8157fc0 2024-09-10T23:16:11.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.003+0000 7f2ee0272640 1 -- 172.21.15.90:0/2032010739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ed80b1e20 con 0x7f2ed8157fc0 2024-09-10T23:16:11.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.003+0000 7f2eceffd640 1 -- 172.21.15.90:0/2032010739 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2ed0004ce0 con 0x7f2ed8157fc0 2024-09-10T23:16:11.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.004+0000 7f2eceffd640 1 --2- 172.21.15.90:0/2032010739 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ebc077f70 0x7f2ebc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:11.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.004+0000 7f2eceffd640 1 -- 172.21.15.90:0/2032010739 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f2ed00bb060 con 0x7f2ed8157fc0 2024-09-10T23:16:11.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.004+0000 7f2ede00e640 1 --2- 172.21.15.90:0/2032010739 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ebc077f70 0x7f2ebc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:11.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.005+0000 7f2ede00e640 1 --2- 172.21.15.90:0/2032010739 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ebc077f70 0x7f2ebc07a430 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4005fd0 tx=0x7f2ed4005ee0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:11.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.008+0000 7f2eceffd640 1 -- 172.21.15.90:0/2032010739 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2ed0083c20 con 0x7f2ed8157fc0 2024-09-10T23:16:11.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.179+0000 7f2ee0272640 1 -- 172.21.15.90:0/2032010739 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ed815af00 con 0x7f2ebc077f70 2024-09-10T23:16:11.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.183+0000 7f2eceffd640 1 -- 172.21.15.90:0/2032010739 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239516 (secure 0 0 0) 0x7f2ed815af00 con 0x7f2ebc077f70 2024-09-10T23:16:11.187 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:11.189 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:16:11.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.186+0000 7f2ee0272640 1 -- 172.21.15.90:0/2032010739 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ebc077f70 msgr2=0x7f2ebc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.186+0000 7f2ee0272640 1 --2- 172.21.15.90:0/2032010739 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ebc077f70 0x7f2ebc07a430 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4005fd0 tx=0x7f2ed4005ee0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.186+0000 7f2ee0272640 1 -- 172.21.15.90:0/2032010739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed8157fc0 msgr2=0x7f2ed80cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.186+0000 7f2ee0272640 1 --2- 172.21.15.90:0/2032010739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed8157fc0 0x7f2ed80cef80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0009230 tx=0x7f2ed0003960 comp rx=0 tx=0).stop 2024-09-10T23:16:11.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.186+0000 7f2ee0272640 1 -- 172.21.15.90:0/2032010739 shutdown_connections 2024-09-10T23:16:11.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.186+0000 7f2ee0272640 1 --2- 172.21.15.90:0/2032010739 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ebc077f70 0x7f2ebc07a430 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.186+0000 7f2ee0272640 1 --2- 172.21.15.90:0/2032010739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ed80ca420 0x7f2ed8159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.186+0000 7f2ee0272640 1 --2- 172.21.15.90:0/2032010739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ed8157fc0 0x7f2ed80cef80 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.186+0000 7f2ee0272640 1 --2- 172.21.15.90:0/2032010739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ed80aef50 0x7f2ed81533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.186+0000 7f2ee0272640 1 -- 172.21.15.90:0/2032010739 >> 172.21.15.90:0/2032010739 conn(0x7f2ed80cc850 msgr2=0x7f2ed815c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:11.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.186+0000 7f2ee0272640 1 -- 172.21.15.90:0/2032010739 shutdown_connections 2024-09-10T23:16:11.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.186+0000 7f2ee0272640 1 -- 172.21.15.90:0/2032010739 wait complete. 2024-09-10T23:16:11.199 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-09-10T23:16:10.454382+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":111,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":226252,"kb_used_data":5844,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748468,"statfs":{"total":773094113280,"available":772862431232,"internally_reserved":0,"allocated":5984256,"data_stored":3097491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.234462"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226388+0000","last_change":"2024-09-10T23:16:08.224593+0000","last_active":"2024-09-10T23:16:08.226388+0000","last_peered":"2024-09-10T23:16:08.226388+0000","last_clean":"2024-09-10T23:16:08.226388+0000","last_became_active":"2024-09-10T23:16:08.224309+0000","last_became_peered":"2024-09-10T23:16:08.224309+0000","last_unstale":"2024-09-10T23:16:08.226388+0000","last_undegraded":"2024-09-10T23:16:08.226388+0000","last_fullsized":"2024-09-10T23:16:08.226388+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:19.742664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226066+0000","last_change":"2024-09-10T23:16:08.218867+0000","last_active":"2024-09-10T23:16:08.226066+0000","last_peered":"2024-09-10T23:16:08.226066+0000","last_clean":"2024-09-10T23:16:08.226066+0000","last_became_active":"2024-09-10T23:16:08.218629+0000","last_became_peered":"2024-09-10T23:16:08.218629+0000","last_unstale":"2024-09-10T23:16:08.226066+0000","last_undegraded":"2024-09-10T23:16:08.226066+0000","last_fullsized":"2024-09-10T23:16:08.226066+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:10.177029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226289+0000","last_change":"2024-09-10T23:16:08.219112+0000","last_active":"2024-09-10T23:16:08.226289+0000","last_peered":"2024-09-10T23:16:08.226289+0000","last_clean":"2024-09-10T23:16:08.226289+0000","last_became_active":"2024-09-10T23:16:08.218847+0000","last_became_peered":"2024-09-10T23:16:08.218847+0000","last_unstale":"2024-09-10T23:16:08.226289+0000","last_undegraded":"2024-09-10T23:16:08.226289+0000","last_fullsized":"2024-09-10T23:16:08.226289+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:55.616925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226106+0000","last_change":"2024-09-10T23:16:08.221753+0000","last_active":"2024-09-10T23:16:08.226106+0000","last_peered":"2024-09-10T23:16:08.226106+0000","last_clean":"2024-09-10T23:16:08.226106+0000","last_became_active":"2024-09-10T23:16:08.221468+0000","last_became_peered":"2024-09-10T23:16:08.221468+0000","last_unstale":"2024-09-10T23:16:08.226106+0000","last_undegraded":"2024-09-10T23:16:08.226106+0000","last_fullsized":"2024-09-10T23:16:08.226106+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:50.862301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226082+0000","last_change":"2024-09-10T23:16:08.218653+0000","last_active":"2024-09-10T23:16:08.226082+0000","last_peered":"2024-09-10T23:16:08.226082+0000","last_clean":"2024-09-10T23:16:08.226082+0000","last_became_active":"2024-09-10T23:16:08.218413+0000","last_became_peered":"2024-09-10T23:16:08.218413+0000","last_unstale":"2024-09-10T23:16:08.226082+0000","last_undegraded":"2024-09-10T23:16:08.226082+0000","last_fullsized":"2024-09-10T23:16:08.226082+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:41.678476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.243786+0000","last_change":"2024-09-10T23:16:07.243432+0000","last_active":"2024-09-10T23:16:08.243786+0000","last_peered":"2024-09-10T23:16:08.243786+0000","last_clean":"2024-09-10T23:16:08.243786+0000","last_became_active":"2024-09-10T23:16:07.243177+0000","last_became_peered":"2024-09-10T23:16:07.243177+0000","last_unstale":"2024-09-10T23:16:08.243786+0000","last_undegraded":"2024-09-10T23:16:08.243786+0000","last_fullsized":"2024-09-10T23:16:08.243786+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:53.240170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226124+0000","last_change":"2024-09-10T23:16:08.220183+0000","last_active":"2024-09-10T23:16:08.226124+0000","last_peered":"2024-09-10T23:16:08.226124+0000","last_clean":"2024-09-10T23:16:08.226124+0000","last_became_active":"2024-09-10T23:16:08.219931+0000","last_became_peered":"2024-09-10T23:16:08.219931+0000","last_unstale":"2024-09-10T23:16:08.226124+0000","last_undegraded":"2024-09-10T23:16:08.226124+0000","last_fullsized":"2024-09-10T23:16:08.226124+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:42.869588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.242872+0000","last_change":"2024-09-10T23:16:07.240650+0000","last_active":"2024-09-10T23:16:08.242872+0000","last_peered":"2024-09-10T23:16:08.242872+0000","last_clean":"2024-09-10T23:16:08.242872+0000","last_became_active":"2024-09-10T23:16:07.240394+0000","last_became_peered":"2024-09-10T23:16:07.240394+0000","last_unstale":"2024-09-10T23:16:08.242872+0000","last_undegraded":"2024-09-10T23:16:08.242872+0000","last_fullsized":"2024-09-10T23:16:08.242872+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:53.615139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.225362+0000","last_change":"2024-09-10T23:16:08.215439+0000","last_active":"2024-09-10T23:16:08.225362+0000","last_peered":"2024-09-10T23:16:08.225362+0000","last_clean":"2024-09-10T23:16:08.225362+0000","last_became_active":"2024-09-10T23:16:08.215177+0000","last_became_peered":"2024-09-10T23:16:08.215177+0000","last_unstale":"2024-09-10T23:16:08.225362+0000","last_undegraded":"2024-09-10T23:16:08.225362+0000","last_fullsized":"2024-09-10T23:16:08.225362+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:05.491789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.240502+0000","last_change":"2024-09-10T23:16:07.244199+0000","last_active":"2024-09-10T23:16:08.240502+0000","last_peered":"2024-09-10T23:16:08.240502+0000","last_clean":"2024-09-10T23:16:08.240502+0000","last_became_active":"2024-09-10T23:16:07.243940+0000","last_became_peered":"2024-09-10T23:16:07.243940+0000","last_unstale":"2024-09-10T23:16:08.240502+0000","last_undegraded":"2024-09-10T23:16:08.240502+0000","last_fullsized":"2024-09-10T23:16:08.240502+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:51.058673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.241990+0000","last_change":"2024-09-10T23:16:07.244013+0000","last_active":"2024-09-10T23:16:08.241990+0000","last_peered":"2024-09-10T23:16:08.241990+0000","last_clean":"2024-09-10T23:16:08.241990+0000","last_became_active":"2024-09-10T23:16:07.243760+0000","last_became_peered":"2024-09-10T23:16:07.243760+0000","last_unstale":"2024-09-10T23:16:08.241990+0000","last_undegraded":"2024-09-10T23:16:08.241990+0000","last_fullsized":"2024-09-10T23:16:08.241990+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:23.111465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.206463+0000","last_change":"2024-09-10T23:16:07.241871+0000","last_active":"2024-09-10T23:16:08.206463+0000","last_peered":"2024-09-10T23:16:08.206463+0000","last_clean":"2024-09-10T23:16:08.206463+0000","last_became_active":"2024-09-10T23:16:07.241609+0000","last_became_peered":"2024-09-10T23:16:07.241609+0000","last_unstale":"2024-09-10T23:16:08.206463+0000","last_undegraded":"2024-09-10T23:16:08.206463+0000","last_fullsized":"2024-09-10T23:16:08.206463+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:51.936391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226003+0000","last_change":"2024-09-10T23:16:08.218101+0000","last_active":"2024-09-10T23:16:08.226003+0000","last_peered":"2024-09-10T23:16:08.226003+0000","last_clean":"2024-09-10T23:16:08.226003+0000","last_became_active":"2024-09-10T23:16:08.217842+0000","last_became_peered":"2024-09-10T23:16:08.217842+0000","last_unstale":"2024-09-10T23:16:08.226003+0000","last_undegraded":"2024-09-10T23:16:08.226003+0000","last_fullsized":"2024-09-10T23:16:08.226003+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:11.019409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.225954+0000","last_change":"2024-09-10T23:16:08.217121+0000","last_active":"2024-09-10T23:16:08.225954+0000","last_peered":"2024-09-10T23:16:08.225954+0000","last_clean":"2024-09-10T23:16:08.225954+0000","last_became_active":"2024-09-10T23:16:08.216844+0000","last_became_peered":"2024-09-10T23:16:08.216844+0000","last_unstale":"2024-09-10T23:16:08.225954+0000","last_undegraded":"2024-09-10T23:16:08.225954+0000","last_fullsized":"2024-09-10T23:16:08.225954+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:44.394190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.206582+0000","last_change":"2024-09-10T23:16:07.243334+0000","last_active":"2024-09-10T23:16:08.206582+0000","last_peered":"2024-09-10T23:16:08.206582+0000","last_clean":"2024-09-10T23:16:08.206582+0000","last_became_active":"2024-09-10T23:16:07.243016+0000","last_became_peered":"2024-09-10T23:16:07.243016+0000","last_unstale":"2024-09-10T23:16:08.206582+0000","last_undegraded":"2024-09-10T23:16:08.206582+0000","last_fullsized":"2024-09-10T23:16:08.206582+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:05.470182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226264+0000","last_change":"2024-09-10T23:16:08.216683+0000","last_active":"2024-09-10T23:16:08.226264+0000","last_peered":"2024-09-10T23:16:08.226264+0000","last_clean":"2024-09-10T23:16:08.226264+0000","last_became_active":"2024-09-10T23:16:08.216398+0000","last_became_peered":"2024-09-10T23:16:08.216398+0000","last_unstale":"2024-09-10T23:16:08.226264+0000","last_undegraded":"2024-09-10T23:16:08.226264+0000","last_fullsized":"2024-09-10T23:16:08.226264+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:44.092540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":157,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T23:16:01.458141+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:16:01.458141+0000","last_peered":"2024-09-10T23:16:01.458141+0000","last_clean":"2024-09-10T23:16:01.458141+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:16:01.458141+0000","last_undegraded":"2024-09-10T23:16:01.458141+0000","last_fullsized":"2024-09-10T23:16:01.458141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":12,"acting":12,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1171456,"data_stored":820951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27596,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":577536,"data_stored":230583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27596,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":577536,"data_stored":230583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27592,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":577536,"data_stored":230583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27592,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":577536,"data_stored":230583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27616,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":602112,"data_stored":240853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27644,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":626688,"data_stored":250967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1273856,"data_stored":862388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:16:11.204 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:16:11.205 INFO:tasks.ceph.mds.c.smithi090.stderr:2024-09-10T23:16:11.203+0000 7f15c2211640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:16:11.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.306+0000 7fb43a20c640 1 -- 172.21.15.90:0/2321940917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb43415aa30 msgr2=0x7fb4340ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.306+0000 7fb43a20c640 1 --2- 172.21.15.90:0/2321940917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb43415aa30 0x7fb4340ca420 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb424005fd0 tx=0x7fb42402aa00 comp rx=0 tx=0).stop 2024-09-10T23:16:11.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.306+0000 7fb43a20c640 1 -- 172.21.15.90:0/2321940917 shutdown_connections 2024-09-10T23:16:11.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.306+0000 7fb43a20c640 1 --2- 172.21.15.90:0/2321940917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb4340b1f60 0x7fb4340cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.306+0000 7fb43a20c640 1 --2- 172.21.15.90:0/2321940917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb43415aa30 0x7fb4340ca420 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.306+0000 7fb43a20c640 1 -- 172.21.15.90:0/2321940917 >> 172.21.15.90:0/2321940917 conn(0x7fb4340cc850 msgr2=0x7fb4340ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:11.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.306+0000 7fb43a20c640 1 -- 172.21.15.90:0/2321940917 shutdown_connections 2024-09-10T23:16:11.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.306+0000 7fb43a20c640 1 -- 172.21.15.90:0/2321940917 wait complete. 2024-09-10T23:16:11.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.307+0000 7fb43a20c640 1 Processor -- start 2024-09-10T23:16:11.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.307+0000 7fb43a20c640 1 -- start start 2024-09-10T23:16:11.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.308+0000 7fb43a20c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb4340b1f60 0x7fb4340c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:11.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.308+0000 7fb43a20c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb43415aa30 0x7fb4340b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:11.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.308+0000 7fb43a20c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4340c6ea0 0x7fb4340c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:11.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.308+0000 7fb43a20c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb4340ce5a0 con 0x7fb43415aa30 2024-09-10T23:16:11.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.308+0000 7fb43a20c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb4340ce420 con 0x7fb4340c6ea0 2024-09-10T23:16:11.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.308+0000 7fb43a20c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb4340ce720 con 0x7fb4340b1f60 2024-09-10T23:16:11.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.308+0000 7fb432ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb43415aa30 0x7fb4340b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:11.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.308+0000 7fb432ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb43415aa30 0x7fb4340b4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54278/0 (socket says 172.21.15.90:54278) 2024-09-10T23:16:11.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.308+0000 7fb432ffd640 1 -- 172.21.15.90:0/3045944957 learned_addr learned my addr 172.21.15.90:0/3045944957 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:11.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.308+0000 7fb4337fe640 1 --2- 172.21.15.90:0/3045944957 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb4340b1f60 0x7fb4340c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:11.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.308+0000 7fb433fff640 1 --2- 172.21.15.90:0/3045944957 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4340c6ea0 0x7fb4340c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:11.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.309+0000 7fb432ffd640 1 -- 172.21.15.90:0/3045944957 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb4340b1f60 msgr2=0x7fb4340c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.309+0000 7fb432ffd640 1 --2- 172.21.15.90:0/3045944957 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb4340b1f60 0x7fb4340c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.309+0000 7fb432ffd640 1 -- 172.21.15.90:0/3045944957 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4340c6ea0 msgr2=0x7fb4340c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.309+0000 7fb432ffd640 1 --2- 172.21.15.90:0/3045944957 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4340c6ea0 0x7fb4340c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.309+0000 7fb432ffd640 1 -- 172.21.15.90:0/3045944957 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43414acf0 con 0x7fb43415aa30 2024-09-10T23:16:11.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.309+0000 7fb4337fe640 1 --2- 172.21.15.90:0/3045944957 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb4340b1f60 0x7fb4340c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:11.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.309+0000 7fb433fff640 1 --2- 172.21.15.90:0/3045944957 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4340c6ea0 0x7fb4340c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:11.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.309+0000 7fb432ffd640 1 --2- 172.21.15.90:0/3045944957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb43415aa30 0x7fb4340b4f30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb42800c440 tx=0x7fb42800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:11.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.309+0000 7fb41bfff640 1 -- 172.21.15.90:0/3045944957 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb428017070 con 0x7fb43415aa30 2024-09-10T23:16:11.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.309+0000 7fb41bfff640 1 -- 172.21.15.90:0/3045944957 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4280035f0 con 0x7fb43415aa30 2024-09-10T23:16:11.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.309+0000 7fb43a20c640 1 -- 172.21.15.90:0/3045944957 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4340c9210 con 0x7fb43415aa30 2024-09-10T23:16:11.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.309+0000 7fb41bfff640 1 -- 172.21.15.90:0/3045944957 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb428003a40 con 0x7fb43415aa30 2024-09-10T23:16:11.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.309+0000 7fb43a20c640 1 -- 172.21.15.90:0/3045944957 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4340c97d0 con 0x7fb43415aa30 2024-09-10T23:16:11.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.310+0000 7fb43a20c640 1 -- 172.21.15.90:0/3045944957 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4340cec50 con 0x7fb43415aa30 2024-09-10T23:16:11.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.310+0000 7fb41bfff640 1 -- 172.21.15.90:0/3045944957 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb428003be0 con 0x7fb43415aa30 2024-09-10T23:16:11.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.311+0000 7fb41bfff640 1 --2- 172.21.15.90:0/3045944957 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb420077f70 0x7fb42007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:11.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.311+0000 7fb41bfff640 1 -- 172.21.15.90:0/3045944957 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fb428099390 con 0x7fb43415aa30 2024-09-10T23:16:11.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.312+0000 7fb4337fe640 1 --2- 172.21.15.90:0/3045944957 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb420077f70 0x7fb42007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:11.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.312+0000 7fb4337fe640 1 --2- 172.21.15.90:0/3045944957 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb420077f70 0x7fb42007a430 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb424035000 tx=0x7fb42403a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:11.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.315+0000 7fb41bfff640 1 -- 172.21.15.90:0/3045944957 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb428061f20 con 0x7fb43415aa30 2024-09-10T23:16:11.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.486+0000 7fb43a20c640 1 -- 172.21.15.90:0/3045944957 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb4340c99a0 con 0x7fb420077f70 2024-09-10T23:16:11.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.491+0000 7fb41bfff640 1 -- 172.21.15.90:0/3045944957 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239516 (secure 0 0 0) 0x7fb4240827b0 con 0x7fb420077f70 2024-09-10T23:16:11.495 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:11.496 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:16:11.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.493+0000 7fb43a20c640 1 -- 172.21.15.90:0/3045944957 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb420077f70 msgr2=0x7fb42007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.493+0000 7fb43a20c640 1 --2- 172.21.15.90:0/3045944957 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb420077f70 0x7fb42007a430 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb424035000 tx=0x7fb42403a040 comp rx=0 tx=0).stop 2024-09-10T23:16:11.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.493+0000 7fb43a20c640 1 -- 172.21.15.90:0/3045944957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb43415aa30 msgr2=0x7fb4340b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.493+0000 7fb43a20c640 1 --2- 172.21.15.90:0/3045944957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb43415aa30 0x7fb4340b4f30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb42800c440 tx=0x7fb42800c900 comp rx=0 tx=0).stop 2024-09-10T23:16:11.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.493+0000 7fb43a20c640 1 -- 172.21.15.90:0/3045944957 shutdown_connections 2024-09-10T23:16:11.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.493+0000 7fb43a20c640 1 --2- 172.21.15.90:0/3045944957 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb420077f70 0x7fb42007a430 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.493+0000 7fb43a20c640 1 --2- 172.21.15.90:0/3045944957 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4340c6ea0 0x7fb4340c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.493+0000 7fb43a20c640 1 --2- 172.21.15.90:0/3045944957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb43415aa30 0x7fb4340b4f30 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.493+0000 7fb43a20c640 1 --2- 172.21.15.90:0/3045944957 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb4340b1f60 0x7fb4340c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.493+0000 7fb43a20c640 1 -- 172.21.15.90:0/3045944957 >> 172.21.15.90:0/3045944957 conn(0x7fb4340cc850 msgr2=0x7fb4340c5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:11.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.493+0000 7fb43a20c640 1 -- 172.21.15.90:0/3045944957 shutdown_connections 2024-09-10T23:16:11.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.493+0000 7fb43a20c640 1 -- 172.21.15.90:0/3045944957 wait complete. 2024-09-10T23:16:11.506 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-09-10T23:16:10.454382+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":111,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":226252,"kb_used_data":5844,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748468,"statfs":{"total":773094113280,"available":772862431232,"internally_reserved":0,"allocated":5984256,"data_stored":3097491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.234462"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226388+0000","last_change":"2024-09-10T23:16:08.224593+0000","last_active":"2024-09-10T23:16:08.226388+0000","last_peered":"2024-09-10T23:16:08.226388+0000","last_clean":"2024-09-10T23:16:08.226388+0000","last_became_active":"2024-09-10T23:16:08.224309+0000","last_became_peered":"2024-09-10T23:16:08.224309+0000","last_unstale":"2024-09-10T23:16:08.226388+0000","last_undegraded":"2024-09-10T23:16:08.226388+0000","last_fullsized":"2024-09-10T23:16:08.226388+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:19.742664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226066+0000","last_change":"2024-09-10T23:16:08.218867+0000","last_active":"2024-09-10T23:16:08.226066+0000","last_peered":"2024-09-10T23:16:08.226066+0000","last_clean":"2024-09-10T23:16:08.226066+0000","last_became_active":"2024-09-10T23:16:08.218629+0000","last_became_peered":"2024-09-10T23:16:08.218629+0000","last_unstale":"2024-09-10T23:16:08.226066+0000","last_undegraded":"2024-09-10T23:16:08.226066+0000","last_fullsized":"2024-09-10T23:16:08.226066+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:10.177029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226289+0000","last_change":"2024-09-10T23:16:08.219112+0000","last_active":"2024-09-10T23:16:08.226289+0000","last_peered":"2024-09-10T23:16:08.226289+0000","last_clean":"2024-09-10T23:16:08.226289+0000","last_became_active":"2024-09-10T23:16:08.218847+0000","last_became_peered":"2024-09-10T23:16:08.218847+0000","last_unstale":"2024-09-10T23:16:08.226289+0000","last_undegraded":"2024-09-10T23:16:08.226289+0000","last_fullsized":"2024-09-10T23:16:08.226289+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:55.616925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226106+0000","last_change":"2024-09-10T23:16:08.221753+0000","last_active":"2024-09-10T23:16:08.226106+0000","last_peered":"2024-09-10T23:16:08.226106+0000","last_clean":"2024-09-10T23:16:08.226106+0000","last_became_active":"2024-09-10T23:16:08.221468+0000","last_became_peered":"2024-09-10T23:16:08.221468+0000","last_unstale":"2024-09-10T23:16:08.226106+0000","last_undegraded":"2024-09-10T23:16:08.226106+0000","last_fullsized":"2024-09-10T23:16:08.226106+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:50.862301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226082+0000","last_change":"2024-09-10T23:16:08.218653+0000","last_active":"2024-09-10T23:16:08.226082+0000","last_peered":"2024-09-10T23:16:08.226082+0000","last_clean":"2024-09-10T23:16:08.226082+0000","last_became_active":"2024-09-10T23:16:08.218413+0000","last_became_peered":"2024-09-10T23:16:08.218413+0000","last_unstale":"2024-09-10T23:16:08.226082+0000","last_undegraded":"2024-09-10T23:16:08.226082+0000","last_fullsized":"2024-09-10T23:16:08.226082+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:41.678476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.243786+0000","last_change":"2024-09-10T23:16:07.243432+0000","last_active":"2024-09-10T23:16:08.243786+0000","last_peered":"2024-09-10T23:16:08.243786+0000","last_clean":"2024-09-10T23:16:08.243786+0000","last_became_active":"2024-09-10T23:16:07.243177+0000","last_became_peered":"2024-09-10T23:16:07.243177+0000","last_unstale":"2024-09-10T23:16:08.243786+0000","last_undegraded":"2024-09-10T23:16:08.243786+0000","last_fullsized":"2024-09-10T23:16:08.243786+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:53.240170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226124+0000","last_change":"2024-09-10T23:16:08.220183+0000","last_active":"2024-09-10T23:16:08.226124+0000","last_peered":"2024-09-10T23:16:08.226124+0000","last_clean":"2024-09-10T23:16:08.226124+0000","last_became_active":"2024-09-10T23:16:08.219931+0000","last_became_peered":"2024-09-10T23:16:08.219931+0000","last_unstale":"2024-09-10T23:16:08.226124+0000","last_undegraded":"2024-09-10T23:16:08.226124+0000","last_fullsized":"2024-09-10T23:16:08.226124+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:42.869588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.242872+0000","last_change":"2024-09-10T23:16:07.240650+0000","last_active":"2024-09-10T23:16:08.242872+0000","last_peered":"2024-09-10T23:16:08.242872+0000","last_clean":"2024-09-10T23:16:08.242872+0000","last_became_active":"2024-09-10T23:16:07.240394+0000","last_became_peered":"2024-09-10T23:16:07.240394+0000","last_unstale":"2024-09-10T23:16:08.242872+0000","last_undegraded":"2024-09-10T23:16:08.242872+0000","last_fullsized":"2024-09-10T23:16:08.242872+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:53.615139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.225362+0000","last_change":"2024-09-10T23:16:08.215439+0000","last_active":"2024-09-10T23:16:08.225362+0000","last_peered":"2024-09-10T23:16:08.225362+0000","last_clean":"2024-09-10T23:16:08.225362+0000","last_became_active":"2024-09-10T23:16:08.215177+0000","last_became_peered":"2024-09-10T23:16:08.215177+0000","last_unstale":"2024-09-10T23:16:08.225362+0000","last_undegraded":"2024-09-10T23:16:08.225362+0000","last_fullsized":"2024-09-10T23:16:08.225362+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:05.491789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.240502+0000","last_change":"2024-09-10T23:16:07.244199+0000","last_active":"2024-09-10T23:16:08.240502+0000","last_peered":"2024-09-10T23:16:08.240502+0000","last_clean":"2024-09-10T23:16:08.240502+0000","last_became_active":"2024-09-10T23:16:07.243940+0000","last_became_peered":"2024-09-10T23:16:07.243940+0000","last_unstale":"2024-09-10T23:16:08.240502+0000","last_undegraded":"2024-09-10T23:16:08.240502+0000","last_fullsized":"2024-09-10T23:16:08.240502+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:51.058673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.241990+0000","last_change":"2024-09-10T23:16:07.244013+0000","last_active":"2024-09-10T23:16:08.241990+0000","last_peered":"2024-09-10T23:16:08.241990+0000","last_clean":"2024-09-10T23:16:08.241990+0000","last_became_active":"2024-09-10T23:16:07.243760+0000","last_became_peered":"2024-09-10T23:16:07.243760+0000","last_unstale":"2024-09-10T23:16:08.241990+0000","last_undegraded":"2024-09-10T23:16:08.241990+0000","last_fullsized":"2024-09-10T23:16:08.241990+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:23.111465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.206463+0000","last_change":"2024-09-10T23:16:07.241871+0000","last_active":"2024-09-10T23:16:08.206463+0000","last_peered":"2024-09-10T23:16:08.206463+0000","last_clean":"2024-09-10T23:16:08.206463+0000","last_became_active":"2024-09-10T23:16:07.241609+0000","last_became_peered":"2024-09-10T23:16:07.241609+0000","last_unstale":"2024-09-10T23:16:08.206463+0000","last_undegraded":"2024-09-10T23:16:08.206463+0000","last_fullsized":"2024-09-10T23:16:08.206463+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:51.936391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226003+0000","last_change":"2024-09-10T23:16:08.218101+0000","last_active":"2024-09-10T23:16:08.226003+0000","last_peered":"2024-09-10T23:16:08.226003+0000","last_clean":"2024-09-10T23:16:08.226003+0000","last_became_active":"2024-09-10T23:16:08.217842+0000","last_became_peered":"2024-09-10T23:16:08.217842+0000","last_unstale":"2024-09-10T23:16:08.226003+0000","last_undegraded":"2024-09-10T23:16:08.226003+0000","last_fullsized":"2024-09-10T23:16:08.226003+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:11.019409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.225954+0000","last_change":"2024-09-10T23:16:08.217121+0000","last_active":"2024-09-10T23:16:08.225954+0000","last_peered":"2024-09-10T23:16:08.225954+0000","last_clean":"2024-09-10T23:16:08.225954+0000","last_became_active":"2024-09-10T23:16:08.216844+0000","last_became_peered":"2024-09-10T23:16:08.216844+0000","last_unstale":"2024-09-10T23:16:08.225954+0000","last_undegraded":"2024-09-10T23:16:08.225954+0000","last_fullsized":"2024-09-10T23:16:08.225954+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:44.394190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.206582+0000","last_change":"2024-09-10T23:16:07.243334+0000","last_active":"2024-09-10T23:16:08.206582+0000","last_peered":"2024-09-10T23:16:08.206582+0000","last_clean":"2024-09-10T23:16:08.206582+0000","last_became_active":"2024-09-10T23:16:07.243016+0000","last_became_peered":"2024-09-10T23:16:07.243016+0000","last_unstale":"2024-09-10T23:16:08.206582+0000","last_undegraded":"2024-09-10T23:16:08.206582+0000","last_fullsized":"2024-09-10T23:16:08.206582+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:05.470182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226264+0000","last_change":"2024-09-10T23:16:08.216683+0000","last_active":"2024-09-10T23:16:08.226264+0000","last_peered":"2024-09-10T23:16:08.226264+0000","last_clean":"2024-09-10T23:16:08.226264+0000","last_became_active":"2024-09-10T23:16:08.216398+0000","last_became_peered":"2024-09-10T23:16:08.216398+0000","last_unstale":"2024-09-10T23:16:08.226264+0000","last_undegraded":"2024-09-10T23:16:08.226264+0000","last_fullsized":"2024-09-10T23:16:08.226264+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:44.092540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":157,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T23:16:01.458141+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:16:01.458141+0000","last_peered":"2024-09-10T23:16:01.458141+0000","last_clean":"2024-09-10T23:16:01.458141+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:16:01.458141+0000","last_undegraded":"2024-09-10T23:16:01.458141+0000","last_fullsized":"2024-09-10T23:16:01.458141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":12,"acting":12,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1171456,"data_stored":820951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27596,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":577536,"data_stored":230583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27596,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":577536,"data_stored":230583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27592,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":577536,"data_stored":230583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27592,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":577536,"data_stored":230583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27616,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":602112,"data_stored":240853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27644,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":626688,"data_stored":250967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1273856,"data_stored":862388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:16:11.510 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:16:11.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.645+0000 7fe0ffc33640 1 -- 172.21.15.90:0/1820055518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0e4004800 msgr2=0x7fe0e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.645+0000 7fe0ffc33640 1 --2- 172.21.15.90:0/1820055518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0e4004800 0x7fe0e4004c80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe0e800c260 tx=0x7fe0e4005830 comp rx=0 tx=0).stop 2024-09-10T23:16:11.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.645+0000 7fe0fe1d0640 1 -- 172.21.15.90:0/1820055518 reap_dead start 2024-09-10T23:16:11.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.645+0000 7fe0ffc33640 1 -- 172.21.15.90:0/1820055518 shutdown_connections 2024-09-10T23:16:11.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.645+0000 7fe0ffc33640 1 -- 172.21.15.90:0/1820055518 >> 172.21.15.90:0/1820055518 conn(0x7fe0f80cc850 msgr2=0x7fe0f80ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:11.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.645+0000 7fe0ffc33640 1 -- 172.21.15.90:0/1820055518 shutdown_connections 2024-09-10T23:16:11.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.645+0000 7fe0ffc33640 1 -- 172.21.15.90:0/1820055518 wait complete. 2024-09-10T23:16:11.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.646+0000 7fe0ffc33640 1 Processor -- start 2024-09-10T23:16:11.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.646+0000 7fe0ffc33640 1 -- start start 2024-09-10T23:16:11.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.647+0000 7fe0ffc33640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0e4004800 0x7fe0f81f3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:11.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.647+0000 7fe0ffc33640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0f80c9ec0 0x7fe0f8157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:11.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.647+0000 7fe0ffc33640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0f80b5790 0x7fe0f81f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:11.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.647+0000 7fe0ffc33640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f80ca420 con 0x7fe0f80c9ec0 2024-09-10T23:16:11.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.647+0000 7fe0ffc33640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f8070a30 con 0x7fe0e4004800 2024-09-10T23:16:11.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.647+0000 7fe0ffc33640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f80ca5a0 con 0x7fe0f80b5790 2024-09-10T23:16:11.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.647+0000 7fe0fd1ce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0f80c9ec0 0x7fe0f8157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:11.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.647+0000 7fe0fd1ce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0f80c9ec0 0x7fe0f8157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54298/0 (socket says 172.21.15.90:54298) 2024-09-10T23:16:11.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.647+0000 7fe0fd1ce640 1 -- 172.21.15.90:0/3393083124 learned_addr learned my addr 172.21.15.90:0/3393083124 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:11.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.647+0000 7fe0fd9cf640 1 --2- 172.21.15.90:0/3393083124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0e4004800 0x7fe0f81f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:11.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.647+0000 7fe0fe1d0640 1 --2- 172.21.15.90:0/3393083124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0f80b5790 0x7fe0f81f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:11.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.648+0000 7fe0fd1ce640 1 -- 172.21.15.90:0/3393083124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0f80b5790 msgr2=0x7fe0f81f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.648+0000 7fe0fd1ce640 1 --2- 172.21.15.90:0/3393083124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0f80b5790 0x7fe0f81f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.648+0000 7fe0fd1ce640 1 -- 172.21.15.90:0/3393083124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0e4004800 msgr2=0x7fe0f81f3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.648+0000 7fe0fd1ce640 1 --2- 172.21.15.90:0/3393083124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0e4004800 0x7fe0f81f3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.648+0000 7fe0fd1ce640 1 -- 172.21.15.90:0/3393083124 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f809b7a0 con 0x7fe0f80c9ec0 2024-09-10T23:16:11.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.648+0000 7fe0fd1ce640 1 --2- 172.21.15.90:0/3393083124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0f80c9ec0 0x7fe0f8157e40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe0e802b0d0 tx=0x7fe0e8001000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:11.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.648+0000 7fe0ee7fc640 1 -- 172.21.15.90:0/3393083124 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8031040 con 0x7fe0f80c9ec0 2024-09-10T23:16:11.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.648+0000 7fe0ee7fc640 1 -- 172.21.15.90:0/3393083124 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0e80035f0 con 0x7fe0f80c9ec0 2024-09-10T23:16:11.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.648+0000 7fe0ffc33640 1 -- 172.21.15.90:0/3393083124 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f809ab90 con 0x7fe0f80c9ec0 2024-09-10T23:16:11.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.648+0000 7fe0ee7fc640 1 -- 172.21.15.90:0/3393083124 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8003a20 con 0x7fe0f80c9ec0 2024-09-10T23:16:11.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.648+0000 7fe0ffc33640 1 -- 172.21.15.90:0/3393083124 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f809b3e0 con 0x7fe0f80c9ec0 2024-09-10T23:16:11.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.649+0000 7fe0ffc33640 1 -- 172.21.15.90:0/3393083124 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0f80b1850 con 0x7fe0f80c9ec0 2024-09-10T23:16:11.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.650+0000 7fe0ee7fc640 1 -- 172.21.15.90:0/3393083124 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe0e8003bc0 con 0x7fe0f80c9ec0 2024-09-10T23:16:11.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.650+0000 7fe0ee7fc640 1 --2- 172.21.15.90:0/3393083124 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe0dc077fa0 0x7fe0dc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:11.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.650+0000 7fe0ee7fc640 1 -- 172.21.15.90:0/3393083124 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fe0e80b9bd0 con 0x7fe0f80c9ec0 2024-09-10T23:16:11.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.650+0000 7fe0fd9cf640 1 --2- 172.21.15.90:0/3393083124 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe0dc077fa0 0x7fe0dc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:11.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.651+0000 7fe0fd9cf640 1 --2- 172.21.15.90:0/3393083124 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe0dc077fa0 0x7fe0dc07a460 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80b5d20 tx=0x7fe0f0005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:11.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.654+0000 7fe0ee7fc640 1 -- 172.21.15.90:0/3393083124 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe0e80826d0 con 0x7fe0f80c9ec0 2024-09-10T23:16:11.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.828+0000 7fe0ffc33640 1 -- 172.21.15.90:0/3393083124 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0f81f26a0 con 0x7fe0dc077fa0 2024-09-10T23:16:11.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.832+0000 7fe0ee7fc640 1 -- 172.21.15.90:0/3393083124 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239516 (secure 0 0 0) 0x7fe0f0012bd0 con 0x7fe0dc077fa0 2024-09-10T23:16:11.837 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:11.838 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:16:11.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.835+0000 7fe0ffc33640 1 -- 172.21.15.90:0/3393083124 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe0dc077fa0 msgr2=0x7fe0dc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.835+0000 7fe0ffc33640 1 --2- 172.21.15.90:0/3393083124 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe0dc077fa0 0x7fe0dc07a460 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80b5d20 tx=0x7fe0f0005f90 comp rx=0 tx=0).stop 2024-09-10T23:16:11.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.835+0000 7fe0ffc33640 1 -- 172.21.15.90:0/3393083124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0f80c9ec0 msgr2=0x7fe0f8157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.835+0000 7fe0ffc33640 1 --2- 172.21.15.90:0/3393083124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0f80c9ec0 0x7fe0f8157e40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe0e802b0d0 tx=0x7fe0e8001000 comp rx=0 tx=0).stop 2024-09-10T23:16:11.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.835+0000 7fe0ffc33640 1 -- 172.21.15.90:0/3393083124 shutdown_connections 2024-09-10T23:16:11.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.835+0000 7fe0ffc33640 1 --2- 172.21.15.90:0/3393083124 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe0dc077fa0 0x7fe0dc07a460 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.835+0000 7fe0ffc33640 1 --2- 172.21.15.90:0/3393083124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0f80b5790 0x7fe0f81f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.835+0000 7fe0ffc33640 1 --2- 172.21.15.90:0/3393083124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0f80c9ec0 0x7fe0f8157e40 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.835+0000 7fe0ffc33640 1 --2- 172.21.15.90:0/3393083124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0e4004800 0x7fe0f81f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.835+0000 7fe0ffc33640 1 -- 172.21.15.90:0/3393083124 >> 172.21.15.90:0/3393083124 conn(0x7fe0f80cc850 msgr2=0x7fe0f80b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:11.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.835+0000 7fe0ffc33640 1 -- 172.21.15.90:0/3393083124 shutdown_connections 2024-09-10T23:16:11.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.835+0000 7fe0ffc33640 1 -- 172.21.15.90:0/3393083124 wait complete. 2024-09-10T23:16:11.847 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-09-10T23:16:10.454382+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":111,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":226252,"kb_used_data":5844,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748468,"statfs":{"total":773094113280,"available":772862431232,"internally_reserved":0,"allocated":5984256,"data_stored":3097491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.234462"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226388+0000","last_change":"2024-09-10T23:16:08.224593+0000","last_active":"2024-09-10T23:16:08.226388+0000","last_peered":"2024-09-10T23:16:08.226388+0000","last_clean":"2024-09-10T23:16:08.226388+0000","last_became_active":"2024-09-10T23:16:08.224309+0000","last_became_peered":"2024-09-10T23:16:08.224309+0000","last_unstale":"2024-09-10T23:16:08.226388+0000","last_undegraded":"2024-09-10T23:16:08.226388+0000","last_fullsized":"2024-09-10T23:16:08.226388+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:19.742664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226066+0000","last_change":"2024-09-10T23:16:08.218867+0000","last_active":"2024-09-10T23:16:08.226066+0000","last_peered":"2024-09-10T23:16:08.226066+0000","last_clean":"2024-09-10T23:16:08.226066+0000","last_became_active":"2024-09-10T23:16:08.218629+0000","last_became_peered":"2024-09-10T23:16:08.218629+0000","last_unstale":"2024-09-10T23:16:08.226066+0000","last_undegraded":"2024-09-10T23:16:08.226066+0000","last_fullsized":"2024-09-10T23:16:08.226066+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:10.177029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226289+0000","last_change":"2024-09-10T23:16:08.219112+0000","last_active":"2024-09-10T23:16:08.226289+0000","last_peered":"2024-09-10T23:16:08.226289+0000","last_clean":"2024-09-10T23:16:08.226289+0000","last_became_active":"2024-09-10T23:16:08.218847+0000","last_became_peered":"2024-09-10T23:16:08.218847+0000","last_unstale":"2024-09-10T23:16:08.226289+0000","last_undegraded":"2024-09-10T23:16:08.226289+0000","last_fullsized":"2024-09-10T23:16:08.226289+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:55.616925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226106+0000","last_change":"2024-09-10T23:16:08.221753+0000","last_active":"2024-09-10T23:16:08.226106+0000","last_peered":"2024-09-10T23:16:08.226106+0000","last_clean":"2024-09-10T23:16:08.226106+0000","last_became_active":"2024-09-10T23:16:08.221468+0000","last_became_peered":"2024-09-10T23:16:08.221468+0000","last_unstale":"2024-09-10T23:16:08.226106+0000","last_undegraded":"2024-09-10T23:16:08.226106+0000","last_fullsized":"2024-09-10T23:16:08.226106+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:50.862301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226082+0000","last_change":"2024-09-10T23:16:08.218653+0000","last_active":"2024-09-10T23:16:08.226082+0000","last_peered":"2024-09-10T23:16:08.226082+0000","last_clean":"2024-09-10T23:16:08.226082+0000","last_became_active":"2024-09-10T23:16:08.218413+0000","last_became_peered":"2024-09-10T23:16:08.218413+0000","last_unstale":"2024-09-10T23:16:08.226082+0000","last_undegraded":"2024-09-10T23:16:08.226082+0000","last_fullsized":"2024-09-10T23:16:08.226082+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:41.678476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.243786+0000","last_change":"2024-09-10T23:16:07.243432+0000","last_active":"2024-09-10T23:16:08.243786+0000","last_peered":"2024-09-10T23:16:08.243786+0000","last_clean":"2024-09-10T23:16:08.243786+0000","last_became_active":"2024-09-10T23:16:07.243177+0000","last_became_peered":"2024-09-10T23:16:07.243177+0000","last_unstale":"2024-09-10T23:16:08.243786+0000","last_undegraded":"2024-09-10T23:16:08.243786+0000","last_fullsized":"2024-09-10T23:16:08.243786+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:53.240170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226124+0000","last_change":"2024-09-10T23:16:08.220183+0000","last_active":"2024-09-10T23:16:08.226124+0000","last_peered":"2024-09-10T23:16:08.226124+0000","last_clean":"2024-09-10T23:16:08.226124+0000","last_became_active":"2024-09-10T23:16:08.219931+0000","last_became_peered":"2024-09-10T23:16:08.219931+0000","last_unstale":"2024-09-10T23:16:08.226124+0000","last_undegraded":"2024-09-10T23:16:08.226124+0000","last_fullsized":"2024-09-10T23:16:08.226124+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:42.869588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.242872+0000","last_change":"2024-09-10T23:16:07.240650+0000","last_active":"2024-09-10T23:16:08.242872+0000","last_peered":"2024-09-10T23:16:08.242872+0000","last_clean":"2024-09-10T23:16:08.242872+0000","last_became_active":"2024-09-10T23:16:07.240394+0000","last_became_peered":"2024-09-10T23:16:07.240394+0000","last_unstale":"2024-09-10T23:16:08.242872+0000","last_undegraded":"2024-09-10T23:16:08.242872+0000","last_fullsized":"2024-09-10T23:16:08.242872+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:53.615139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.225362+0000","last_change":"2024-09-10T23:16:08.215439+0000","last_active":"2024-09-10T23:16:08.225362+0000","last_peered":"2024-09-10T23:16:08.225362+0000","last_clean":"2024-09-10T23:16:08.225362+0000","last_became_active":"2024-09-10T23:16:08.215177+0000","last_became_peered":"2024-09-10T23:16:08.215177+0000","last_unstale":"2024-09-10T23:16:08.225362+0000","last_undegraded":"2024-09-10T23:16:08.225362+0000","last_fullsized":"2024-09-10T23:16:08.225362+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:05.491789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.240502+0000","last_change":"2024-09-10T23:16:07.244199+0000","last_active":"2024-09-10T23:16:08.240502+0000","last_peered":"2024-09-10T23:16:08.240502+0000","last_clean":"2024-09-10T23:16:08.240502+0000","last_became_active":"2024-09-10T23:16:07.243940+0000","last_became_peered":"2024-09-10T23:16:07.243940+0000","last_unstale":"2024-09-10T23:16:08.240502+0000","last_undegraded":"2024-09-10T23:16:08.240502+0000","last_fullsized":"2024-09-10T23:16:08.240502+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:51.058673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.241990+0000","last_change":"2024-09-10T23:16:07.244013+0000","last_active":"2024-09-10T23:16:08.241990+0000","last_peered":"2024-09-10T23:16:08.241990+0000","last_clean":"2024-09-10T23:16:08.241990+0000","last_became_active":"2024-09-10T23:16:07.243760+0000","last_became_peered":"2024-09-10T23:16:07.243760+0000","last_unstale":"2024-09-10T23:16:08.241990+0000","last_undegraded":"2024-09-10T23:16:08.241990+0000","last_fullsized":"2024-09-10T23:16:08.241990+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:23.111465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.206463+0000","last_change":"2024-09-10T23:16:07.241871+0000","last_active":"2024-09-10T23:16:08.206463+0000","last_peered":"2024-09-10T23:16:08.206463+0000","last_clean":"2024-09-10T23:16:08.206463+0000","last_became_active":"2024-09-10T23:16:07.241609+0000","last_became_peered":"2024-09-10T23:16:07.241609+0000","last_unstale":"2024-09-10T23:16:08.206463+0000","last_undegraded":"2024-09-10T23:16:08.206463+0000","last_fullsized":"2024-09-10T23:16:08.206463+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:51.936391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226003+0000","last_change":"2024-09-10T23:16:08.218101+0000","last_active":"2024-09-10T23:16:08.226003+0000","last_peered":"2024-09-10T23:16:08.226003+0000","last_clean":"2024-09-10T23:16:08.226003+0000","last_became_active":"2024-09-10T23:16:08.217842+0000","last_became_peered":"2024-09-10T23:16:08.217842+0000","last_unstale":"2024-09-10T23:16:08.226003+0000","last_undegraded":"2024-09-10T23:16:08.226003+0000","last_fullsized":"2024-09-10T23:16:08.226003+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:11.019409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.225954+0000","last_change":"2024-09-10T23:16:08.217121+0000","last_active":"2024-09-10T23:16:08.225954+0000","last_peered":"2024-09-10T23:16:08.225954+0000","last_clean":"2024-09-10T23:16:08.225954+0000","last_became_active":"2024-09-10T23:16:08.216844+0000","last_became_peered":"2024-09-10T23:16:08.216844+0000","last_unstale":"2024-09-10T23:16:08.225954+0000","last_undegraded":"2024-09-10T23:16:08.225954+0000","last_fullsized":"2024-09-10T23:16:08.225954+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:44.394190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.206582+0000","last_change":"2024-09-10T23:16:07.243334+0000","last_active":"2024-09-10T23:16:08.206582+0000","last_peered":"2024-09-10T23:16:08.206582+0000","last_clean":"2024-09-10T23:16:08.206582+0000","last_became_active":"2024-09-10T23:16:07.243016+0000","last_became_peered":"2024-09-10T23:16:07.243016+0000","last_unstale":"2024-09-10T23:16:08.206582+0000","last_undegraded":"2024-09-10T23:16:08.206582+0000","last_fullsized":"2024-09-10T23:16:08.206582+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:05.470182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226264+0000","last_change":"2024-09-10T23:16:08.216683+0000","last_active":"2024-09-10T23:16:08.226264+0000","last_peered":"2024-09-10T23:16:08.226264+0000","last_clean":"2024-09-10T23:16:08.226264+0000","last_became_active":"2024-09-10T23:16:08.216398+0000","last_became_peered":"2024-09-10T23:16:08.216398+0000","last_unstale":"2024-09-10T23:16:08.226264+0000","last_undegraded":"2024-09-10T23:16:08.226264+0000","last_fullsized":"2024-09-10T23:16:08.226264+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:44.092540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:07.219144+0000","last_change":"2024-09-10T23:16:07.219144+0000","last_active":"2024-09-10T23:16:07.219144+0000","last_peered":"2024-09-10T23:16:07.219144+0000","last_clean":"2024-09-10T23:16:07.219144+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:07.219144+0000","last_undegraded":"2024-09-10T23:16:07.219144+0000","last_fullsized":"2024-09-10T23:16:07.219144+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:06.215463+0000","last_change":"2024-09-10T23:16:06.215463+0000","last_active":"2024-09-10T23:16:06.215463+0000","last_peered":"2024-09-10T23:16:06.215463+0000","last_clean":"2024-09-10T23:16:06.215463+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:06.215463+0000","last_undegraded":"2024-09-10T23:16:06.215463+0000","last_fullsized":"2024-09-10T23:16:06.215463+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":157,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T23:16:01.458141+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:16:01.458141+0000","last_peered":"2024-09-10T23:16:01.458141+0000","last_clean":"2024-09-10T23:16:01.458141+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:16:01.458141+0000","last_undegraded":"2024-09-10T23:16:01.458141+0000","last_fullsized":"2024-09-10T23:16:01.458141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":12,"acting":12,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1171456,"data_stored":820951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27596,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":577536,"data_stored":230583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27596,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":577536,"data_stored":230583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27592,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":577536,"data_stored":230583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27592,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":577536,"data_stored":230583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27616,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":602112,"data_stored":240853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27644,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":626688,"data_stored":250967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1273856,"data_stored":862388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:16:11.853 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3f is not active+clean 2024-09-10T23:16:11.853 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.853 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3e is not active+clean 2024-09-10T23:16:11.854 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.854 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3d is not active+clean 2024-09-10T23:16:11.854 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.854 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3c is not active+clean 2024-09-10T23:16:11.854 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.854 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3b is not active+clean 2024-09-10T23:16:11.854 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.854 INFO:tasks.ceph.ceph_manager.ceph:PG 9.39 is not active+clean 2024-09-10T23:16:11.854 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.854 INFO:tasks.ceph.ceph_manager.ceph:PG 9.38 is not active+clean 2024-09-10T23:16:11.854 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.855 INFO:tasks.ceph.ceph_manager.ceph:PG 9.37 is not active+clean 2024-09-10T23:16:11.855 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.855 INFO:tasks.ceph.ceph_manager.ceph:PG 9.36 is not active+clean 2024-09-10T23:16:11.855 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.855 INFO:tasks.ceph.ceph_manager.ceph:PG 9.35 is not active+clean 2024-09-10T23:16:11.855 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.855 INFO:tasks.ceph.ceph_manager.ceph:PG 9.34 is not active+clean 2024-09-10T23:16:11.855 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.855 INFO:tasks.ceph.ceph_manager.ceph:PG 9.33 is not active+clean 2024-09-10T23:16:11.855 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.856 INFO:tasks.ceph.ceph_manager.ceph:PG 9.32 is not active+clean 2024-09-10T23:16:11.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.856 INFO:tasks.ceph.ceph_manager.ceph:PG 9.31 is not active+clean 2024-09-10T23:16:11.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.856 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2f is not active+clean 2024-09-10T23:16:11.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.856 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2e is not active+clean 2024-09-10T23:16:11.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.856 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2d is not active+clean 2024-09-10T23:16:11.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.857 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2c is not active+clean 2024-09-10T23:16:11.857 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.857 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2b is not active+clean 2024-09-10T23:16:11.857 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.857 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2a is not active+clean 2024-09-10T23:16:11.857 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.857 INFO:tasks.ceph.ceph_manager.ceph:PG 9.29 is not active+clean 2024-09-10T23:16:11.857 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.857 INFO:tasks.ceph.ceph_manager.ceph:PG 9.28 is not active+clean 2024-09-10T23:16:11.857 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.857 INFO:tasks.ceph.ceph_manager.ceph:PG 9.27 is not active+clean 2024-09-10T23:16:11.857 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.858 INFO:tasks.ceph.ceph_manager.ceph:PG 9.26 is not active+clean 2024-09-10T23:16:11.858 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.858 INFO:tasks.ceph.ceph_manager.ceph:PG 9.24 is not active+clean 2024-09-10T23:16:11.858 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.858 INFO:tasks.ceph.ceph_manager.ceph:PG 9.23 is not active+clean 2024-09-10T23:16:11.858 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.858 INFO:tasks.ceph.ceph_manager.ceph:PG 9.22 is not active+clean 2024-09-10T23:16:11.858 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.858 INFO:tasks.ceph.ceph_manager.ceph:PG 9.21 is not active+clean 2024-09-10T23:16:11.859 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.859 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1f is not active+clean 2024-09-10T23:16:11.859 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.859 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1e is not active+clean 2024-09-10T23:16:11.859 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.859 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1c is not active+clean 2024-09-10T23:16:11.859 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.859 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1a is not active+clean 2024-09-10T23:16:11.859 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.859 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1b is not active+clean 2024-09-10T23:16:11.859 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.860 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1b is not active+clean 2024-09-10T23:16:11.860 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.860 INFO:tasks.ceph.ceph_manager.ceph:PG 9.18 is not active+clean 2024-09-10T23:16:11.860 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.860 INFO:tasks.ceph.ceph_manager.ceph:PG 8.19 is not active+clean 2024-09-10T23:16:11.860 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.860 INFO:tasks.ceph.ceph_manager.ceph:PG 9.19 is not active+clean 2024-09-10T23:16:11.860 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.860 INFO:tasks.ceph.ceph_manager.ceph:PG 8.18 is not active+clean 2024-09-10T23:16:11.861 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.861 INFO:tasks.ceph.ceph_manager.ceph:PG 9.16 is not active+clean 2024-09-10T23:16:11.861 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.861 INFO:tasks.ceph.ceph_manager.ceph:PG 8.17 is not active+clean 2024-09-10T23:16:11.861 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.861 INFO:tasks.ceph.ceph_manager.ceph:PG 9.17 is not active+clean 2024-09-10T23:16:11.861 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.861 INFO:tasks.ceph.ceph_manager.ceph:PG 8.16 is not active+clean 2024-09-10T23:16:11.861 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.861 INFO:tasks.ceph.ceph_manager.ceph:PG 9.14 is not active+clean 2024-09-10T23:16:11.862 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.862 INFO:tasks.ceph.ceph_manager.ceph:PG 8.15 is not active+clean 2024-09-10T23:16:11.862 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.862 INFO:tasks.ceph.ceph_manager.ceph:PG 9.15 is not active+clean 2024-09-10T23:16:11.862 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.863 INFO:tasks.ceph.ceph_manager.ceph:PG 8.14 is not active+clean 2024-09-10T23:16:11.863 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.863 INFO:tasks.ceph.ceph_manager.ceph:PG 9.12 is not active+clean 2024-09-10T23:16:11.863 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.863 INFO:tasks.ceph.ceph_manager.ceph:PG 8.13 is not active+clean 2024-09-10T23:16:11.863 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.863 INFO:tasks.ceph.ceph_manager.ceph:PG 9.13 is not active+clean 2024-09-10T23:16:11.863 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.863 INFO:tasks.ceph.ceph_manager.ceph:PG 8.12 is not active+clean 2024-09-10T23:16:11.863 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.864 INFO:tasks.ceph.ceph_manager.ceph:PG 9.10 is not active+clean 2024-09-10T23:16:11.864 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.864 INFO:tasks.ceph.ceph_manager.ceph:PG 8.11 is not active+clean 2024-09-10T23:16:11.864 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.864 INFO:tasks.ceph.ceph_manager.ceph:PG 9.11 is not active+clean 2024-09-10T23:16:11.864 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.865 INFO:tasks.ceph.ceph_manager.ceph:PG 8.10 is not active+clean 2024-09-10T23:16:11.865 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.865 INFO:tasks.ceph.ceph_manager.ceph:PG 9.e is not active+clean 2024-09-10T23:16:11.865 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.865 INFO:tasks.ceph.ceph_manager.ceph:PG 8.f is not active+clean 2024-09-10T23:16:11.865 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.865 INFO:tasks.ceph.ceph_manager.ceph:PG 9.f is not active+clean 2024-09-10T23:16:11.865 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.865 INFO:tasks.ceph.ceph_manager.ceph:PG 9.c is not active+clean 2024-09-10T23:16:11.865 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.866 INFO:tasks.ceph.ceph_manager.ceph:PG 8.d is not active+clean 2024-09-10T23:16:11.866 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.866 INFO:tasks.ceph.ceph_manager.ceph:PG 9.d is not active+clean 2024-09-10T23:16:11.866 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.866 INFO:tasks.ceph.ceph_manager.ceph:PG 9.a is not active+clean 2024-09-10T23:16:11.866 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.866 INFO:tasks.ceph.ceph_manager.ceph:PG 8.b is not active+clean 2024-09-10T23:16:11.866 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.866 INFO:tasks.ceph.ceph_manager.ceph:PG 8.a is not active+clean 2024-09-10T23:16:11.867 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.867 INFO:tasks.ceph.ceph_manager.ceph:PG 8.8 is not active+clean 2024-09-10T23:16:11.867 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.867 INFO:tasks.ceph.ceph_manager.ceph:PG 9.6 is not active+clean 2024-09-10T23:16:11.867 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.867 INFO:tasks.ceph.ceph_manager.ceph:PG 8.7 is not active+clean 2024-09-10T23:16:11.867 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.867 INFO:tasks.ceph.ceph_manager.ceph:PG 9.7 is not active+clean 2024-09-10T23:16:11.867 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.867 INFO:tasks.ceph.ceph_manager.ceph:PG 9.4 is not active+clean 2024-09-10T23:16:11.868 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.868 INFO:tasks.ceph.ceph_manager.ceph:PG 8.5 is not active+clean 2024-09-10T23:16:11.868 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.868 INFO:tasks.ceph.ceph_manager.ceph:PG 8.4 is not active+clean 2024-09-10T23:16:11.868 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.869 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2 is not active+clean 2024-09-10T23:16:11.869 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.869 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3 is not active+clean 2024-09-10T23:16:11.869 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.869 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3 is not active+clean 2024-09-10T23:16:11.870 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.870 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2 is not active+clean 2024-09-10T23:16:11.870 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.870 INFO:tasks.ceph.ceph_manager.ceph:PG 9.0 is not active+clean 2024-09-10T23:16:11.870 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.871 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1 is not active+clean 2024-09-10T23:16:11.871 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.871 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1 is not active+clean 2024-09-10T23:16:11.871 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.871 INFO:tasks.ceph.ceph_manager.ceph:PG 8.0 is not active+clean 2024-09-10T23:16:11.872 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.872 INFO:tasks.ceph.ceph_manager.ceph:PG 9.8 is not active+clean 2024-09-10T23:16:11.872 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:07.219144+0000', 'last_change': '2024-09-10T23:16:07.219144+0000', 'last_active': '2024-09-10T23:16:07.219144+0000', 'last_peered': '2024-09-10T23:16:07.219144+0000', 'last_clean': '2024-09-10T23:16:07.219144+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:07.219144+0000', 'last_undegraded': '2024-09-10T23:16:07.219144+0000', 'last_fullsized': '2024-09-10T23:16:07.219144+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:07.219144+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.872 INFO:tasks.ceph.ceph_manager.ceph:PG 8.9 is not active+clean 2024-09-10T23:16:11.872 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:16:06.215463+0000', 'last_change': '2024-09-10T23:16:06.215463+0000', 'last_active': '2024-09-10T23:16:06.215463+0000', 'last_peered': '2024-09-10T23:16:06.215463+0000', 'last_clean': '2024-09-10T23:16:06.215463+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:16:06.215463+0000', 'last_undegraded': '2024-09-10T23:16:06.215463+0000', 'last_fullsized': '2024-09-10T23:16:06.215463+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'last_clean_scrub_stamp': '2024-09-10T23:16:06.215463+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:16:11.873 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:16:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.985+0000 7f5294df3640 1 -- 172.21.15.90:0/652898498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f529015e260 msgr2=0x7f52900b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.985+0000 7f5294df3640 1 --2- 172.21.15.90:0/652898498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f529015e260 0x7f52900b0400 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f52900b2ff0 tx=0x7f528002a410 comp rx=0 tx=0).stop 2024-09-10T23:16:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.985+0000 7f5294df3640 1 -- 172.21.15.90:0/652898498 shutdown_connections 2024-09-10T23:16:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.985+0000 7f5294df3640 1 --2- 172.21.15.90:0/652898498 >> v2:172.21.15.171:3300/0 conn(0x7f52900b0940 0x7f52900cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.985+0000 7f5294df3640 1 --2- 172.21.15.90:0/652898498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f529015e260 0x7f52900b0400 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.985+0000 7f5294df3640 1 -- 172.21.15.90:0/652898498 >> 172.21.15.90:0/652898498 conn(0x7f52900d0490 msgr2=0x7f52900d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.985+0000 7f5294df3640 1 -- 172.21.15.90:0/652898498 shutdown_connections 2024-09-10T23:16:11.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.985+0000 7f5294df3640 1 -- 172.21.15.90:0/652898498 wait complete. 2024-09-10T23:16:11.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.987+0000 7f5294df3640 1 Processor -- start 2024-09-10T23:16:11.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.987+0000 7f5294df3640 1 -- start start 2024-09-10T23:16:11.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.987+0000 7f5294df3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52900b0940 0x7f52901f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:11.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.987+0000 7f5294df3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52900d1190 0x7f52900ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:11.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.987+0000 7f5294df3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f529015e260 0x7f52900cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:11.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f5294df3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f529015e7c0 con 0x7f529015e260 2024-09-10T23:16:11.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f5294df3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f529015e640 con 0x7f52900b0940 2024-09-10T23:16:11.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f5294df3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f52900cf070 con 0x7f52900d1190 2024-09-10T23:16:11.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f528ed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f529015e260 0x7f52900cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:11.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f528ed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f529015e260 0x7f52900cd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54322/0 (socket says 172.21.15.90:54322) 2024-09-10T23:16:11.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f528ed9d640 1 -- 172.21.15.90:0/780543191 learned_addr learned my addr 172.21.15.90:0/780543191 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:11.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f528e59c640 1 --2- 172.21.15.90:0/780543191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52900b0940 0x7f52901f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:11.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f5285d9b640 1 --2- 172.21.15.90:0/780543191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52900d1190 0x7f52900ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:11.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f528ed9d640 1 -- 172.21.15.90:0/780543191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52900d1190 msgr2=0x7f52900ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f528ed9d640 1 --2- 172.21.15.90:0/780543191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52900d1190 0x7f52900ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f528ed9d640 1 -- 172.21.15.90:0/780543191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52900b0940 msgr2=0x7f52901f1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:11.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f528ed9d640 1 --2- 172.21.15.90:0/780543191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52900b0940 0x7f52901f1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:11.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f528ed9d640 1 -- 172.21.15.90:0/780543191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52900b5d80 con 0x7f529015e260 2024-09-10T23:16:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f528ed9d640 1 --2- 172.21.15.90:0/780543191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f529015e260 0x7f52900cd450 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f528800cd10 tx=0x7f528800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f52877fe640 1 -- 172.21.15.90:0/780543191 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5288003970 con 0x7f529015e260 2024-09-10T23:16:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f52877fe640 1 -- 172.21.15.90:0/780543191 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5288003c00 con 0x7f529015e260 2024-09-10T23:16:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f5294df3640 1 -- 172.21.15.90:0/780543191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52900b6040 con 0x7f529015e260 2024-09-10T23:16:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f52877fe640 1 -- 172.21.15.90:0/780543191 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5288004030 con 0x7f529015e260 2024-09-10T23:16:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.988+0000 7f5294df3640 1 -- 172.21.15.90:0/780543191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52900c4d50 con 0x7f529015e260 2024-09-10T23:16:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.989+0000 7f5294df3640 1 -- 172.21.15.90:0/780543191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52900b0400 con 0x7f529015e260 2024-09-10T23:16:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.990+0000 7f52877fe640 1 -- 172.21.15.90:0/780543191 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f52880041d0 con 0x7f529015e260 2024-09-10T23:16:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.991+0000 7f52877fe640 1 --2- 172.21.15.90:0/780543191 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5270077f70 0x7f527007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.991+0000 7f52877fe640 1 -- 172.21.15.90:0/780543191 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f528809a570 con 0x7f529015e260 2024-09-10T23:16:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.991+0000 7f528e59c640 1 --2- 172.21.15.90:0/780543191 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5270077f70 0x7f527007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.991+0000 7f528e59c640 1 --2- 172.21.15.90:0/780543191 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5270077f70 0x7f527007a430 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5280033000 tx=0x7f5280004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:11.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:11.995+0000 7f52877fe640 1 -- 172.21.15.90:0/780543191 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5288014070 con 0x7f529015e260 2024-09-10T23:16:12.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.237+0000 7f5294df3640 1 -- 172.21.15.90:0/780543191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f52900afca0 con 0x7f529015e260 2024-09-10T23:16:12.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.237+0000 7f52877fe640 1 -- 172.21.15.90:0/780543191 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1549 (secure 0 0 0) 0x7f5288062a20 con 0x7f529015e260 2024-09-10T23:16:12.239 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:12.239 INFO:teuthology.orchestra.run.smithi090.stdout:{"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":120,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":57,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010065,"num_in_osds":8,"osd_in_since":1726010055,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":80},{"state_name":"active+clean","count":17}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590950,"bytes_used":231682048,"bytes_avail":772862431232,"bytes_total":773094113280,"unknown_pgs_ratio":0.82474225759506226,"write_bytes_sec":241,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":27,"btime":"2024-09-10T23:16:10:241620+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5556}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-09-10T23:15:58.451948+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:16:12.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.239+0000 7f5294df3640 1 -- 172.21.15.90:0/780543191 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5270077f70 msgr2=0x7f527007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:12.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.239+0000 7f5294df3640 1 --2- 172.21.15.90:0/780543191 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5270077f70 0x7f527007a430 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5280033000 tx=0x7f5280004730 comp rx=0 tx=0).stop 2024-09-10T23:16:12.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.239+0000 7f5294df3640 1 -- 172.21.15.90:0/780543191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f529015e260 msgr2=0x7f52900cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:12.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.239+0000 7f5294df3640 1 --2- 172.21.15.90:0/780543191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f529015e260 0x7f52900cd450 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f528800cd10 tx=0x7f528800a620 comp rx=0 tx=0).stop 2024-09-10T23:16:12.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.239+0000 7f5294df3640 1 -- 172.21.15.90:0/780543191 shutdown_connections 2024-09-10T23:16:12.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.239+0000 7f5294df3640 1 --2- 172.21.15.90:0/780543191 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5270077f70 0x7f527007a430 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.239+0000 7f5294df3640 1 --2- 172.21.15.90:0/780543191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f529015e260 0x7f52900cd450 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.239+0000 7f5294df3640 1 --2- 172.21.15.90:0/780543191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52900d1190 0x7f52900ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.239+0000 7f5294df3640 1 --2- 172.21.15.90:0/780543191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52900b0940 0x7f52901f1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.239+0000 7f5294df3640 1 -- 172.21.15.90:0/780543191 >> 172.21.15.90:0/780543191 conn(0x7f52900d0490 msgr2=0x7f52900b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:12.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.239+0000 7f5294df3640 1 -- 172.21.15.90:0/780543191 shutdown_connections 2024-09-10T23:16:12.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.239+0000 7f5294df3640 1 -- 172.21.15.90:0/780543191 wait complete. 2024-09-10T23:16:12.252 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T23:16:12.252 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:16:12.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.350+0000 7efe84310640 1 -- 172.21.15.90:0/98917661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe7c157fc0 msgr2=0x7efe7c15b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:12.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.350+0000 7efe84310640 1 --2- 172.21.15.90:0/98917661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe7c157fc0 0x7efe7c15b290 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7efe78005fd0 tx=0x7efe7802a490 comp rx=0 tx=0).stop 2024-09-10T23:16:12.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.350+0000 7efe84310640 1 -- 172.21.15.90:0/98917661 shutdown_connections 2024-09-10T23:16:12.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.350+0000 7efe84310640 1 --2- 172.21.15.90:0/98917661 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe7c0ca420 0x7efe7c0ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.350+0000 7efe84310640 1 --2- 172.21.15.90:0/98917661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe7c157fc0 0x7efe7c15b290 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.350+0000 7efe84310640 1 -- 172.21.15.90:0/98917661 >> 172.21.15.90:0/98917661 conn(0x7efe7c0cc850 msgr2=0x7efe7c0ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:12.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.350+0000 7efe84310640 1 -- 172.21.15.90:0/98917661 shutdown_connections 2024-09-10T23:16:12.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.350+0000 7efe84310640 1 -- 172.21.15.90:0/98917661 wait complete. 2024-09-10T23:16:12.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.351+0000 7efe84310640 1 Processor -- start 2024-09-10T23:16:12.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.351+0000 7efe84310640 1 -- start start 2024-09-10T23:16:12.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe84310640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe7c0aef50 0x7efe7c0b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:12.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe84310640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe7c0ca420 0x7efe7c14ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:12.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe84310640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe7c157fc0 0x7efe7c151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:12.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe84310640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efe7c0b1a40 con 0x7efe7c0aef50 2024-09-10T23:16:12.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe84310640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efe7c0b18c0 con 0x7efe7c157fc0 2024-09-10T23:16:12.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe84310640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efe7c0b1bc0 con 0x7efe7c0ca420 2024-09-10T23:16:12.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe820ac640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe7c0aef50 0x7efe7c0b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:12.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe820ac640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe7c0aef50 0x7efe7c0b3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54350/0 (socket says 172.21.15.90:54350) 2024-09-10T23:16:12.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe820ac640 1 -- 172.21.15.90:0/2765561418 learned_addr learned my addr 172.21.15.90:0/2765561418 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:12.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe828ad640 1 --2- 172.21.15.90:0/2765561418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe7c157fc0 0x7efe7c151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:12.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe818ab640 1 --2- 172.21.15.90:0/2765561418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe7c0ca420 0x7efe7c14ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:12.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe820ac640 1 -- 172.21.15.90:0/2765561418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe7c0ca420 msgr2=0x7efe7c14ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:12.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe820ac640 1 --2- 172.21.15.90:0/2765561418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe7c0ca420 0x7efe7c14ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe820ac640 1 -- 172.21.15.90:0/2765561418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe7c157fc0 msgr2=0x7efe7c151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:12.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe820ac640 1 --2- 172.21.15.90:0/2765561418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe7c157fc0 0x7efe7c151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe820ac640 1 -- 172.21.15.90:0/2765561418 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7c0726d0 con 0x7efe7c0aef50 2024-09-10T23:16:12.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe818ab640 1 --2- 172.21.15.90:0/2765561418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe7c0ca420 0x7efe7c14ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:12.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe820ac640 1 --2- 172.21.15.90:0/2765561418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe7c0aef50 0x7efe7c0b3150 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7efe78034040 tx=0x7efe78003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:12.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe72ffd640 1 -- 172.21.15.90:0/2765561418 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7803e030 con 0x7efe7c0aef50 2024-09-10T23:16:12.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe72ffd640 1 -- 172.21.15.90:0/2765561418 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe780047a0 con 0x7efe7c0aef50 2024-09-10T23:16:12.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe72ffd640 1 -- 172.21.15.90:0/2765561418 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78035040 con 0x7efe7c0aef50 2024-09-10T23:16:12.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.352+0000 7efe84310640 1 -- 172.21.15.90:0/2765561418 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe7c072970 con 0x7efe7c0aef50 2024-09-10T23:16:12.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.353+0000 7efe84310640 1 -- 172.21.15.90:0/2765561418 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe7c151a10 con 0x7efe7c0aef50 2024-09-10T23:16:12.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.353+0000 7efe84310640 1 -- 172.21.15.90:0/2765561418 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe7c151810 con 0x7efe7c0aef50 2024-09-10T23:16:12.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.354+0000 7efe72ffd640 1 -- 172.21.15.90:0/2765561418 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7efe78004bf0 con 0x7efe7c0aef50 2024-09-10T23:16:12.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.354+0000 7efe72ffd640 1 --2- 172.21.15.90:0/2765561418 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efe60077f70 0x7efe6007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:12.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.355+0000 7efe72ffd640 1 -- 172.21.15.90:0/2765561418 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7efe780ba730 con 0x7efe7c0aef50 2024-09-10T23:16:12.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.355+0000 7efe818ab640 1 --2- 172.21.15.90:0/2765561418 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efe60077f70 0x7efe6007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:12.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.355+0000 7efe818ab640 1 --2- 172.21.15.90:0/2765561418 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efe60077f70 0x7efe6007a430 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efe7c15aa10 tx=0x7efe6c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:12.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.359+0000 7efe72ffd640 1 -- 172.21.15.90:0/2765561418 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7efe7c15b7d0 con 0x7efe7c0aef50 2024-09-10T23:16:12.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.531+0000 7efe84310640 1 -- 172.21.15.90:0/2765561418 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efe7c0ca890 con 0x7efe60077f70 2024-09-10T23:16:12.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.535+0000 7efe72ffd640 1 -- 172.21.15.90:0/2765561418 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251941 (secure 0 0 0) 0x7efe6c056840 con 0x7efe60077f70 2024-09-10T23:16:12.539 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:12.541 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:16:12.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.538+0000 7efe84310640 1 -- 172.21.15.90:0/2765561418 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efe60077f70 msgr2=0x7efe6007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:12.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.538+0000 7efe84310640 1 --2- 172.21.15.90:0/2765561418 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efe60077f70 0x7efe6007a430 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efe7c15aa10 tx=0x7efe6c009040 comp rx=0 tx=0).stop 2024-09-10T23:16:12.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.538+0000 7efe84310640 1 -- 172.21.15.90:0/2765561418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe7c0aef50 msgr2=0x7efe7c0b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:12.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.538+0000 7efe84310640 1 --2- 172.21.15.90:0/2765561418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe7c0aef50 0x7efe7c0b3150 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7efe78034040 tx=0x7efe78003970 comp rx=0 tx=0).stop 2024-09-10T23:16:12.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.538+0000 7efe84310640 1 -- 172.21.15.90:0/2765561418 shutdown_connections 2024-09-10T23:16:12.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.538+0000 7efe84310640 1 --2- 172.21.15.90:0/2765561418 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efe60077f70 0x7efe6007a430 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.538+0000 7efe84310640 1 --2- 172.21.15.90:0/2765561418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe7c157fc0 0x7efe7c151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.538+0000 7efe84310640 1 --2- 172.21.15.90:0/2765561418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe7c0ca420 0x7efe7c14ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.538+0000 7efe84310640 1 --2- 172.21.15.90:0/2765561418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe7c0aef50 0x7efe7c0b3150 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.538+0000 7efe84310640 1 -- 172.21.15.90:0/2765561418 >> 172.21.15.90:0/2765561418 conn(0x7efe7c0cc850 msgr2=0x7efe7c0ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:12.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.538+0000 7efe84310640 1 -- 172.21.15.90:0/2765561418 shutdown_connections 2024-09-10T23:16:12.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:12.538+0000 7efe84310640 1 -- 172.21.15.90:0/2765561418 wait complete. 2024-09-10T23:16:12.551 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-09-10T23:16:12.454876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226872,"kb_used_data":6468,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747848,"statfs":{"total":773094113280,"available":772861796352,"internally_reserved":0,"allocated":6623232,"data_stored":3375664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001437"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262019+0000","last_change":"2024-09-10T23:16:08.221745+0000","last_active":"2024-09-10T23:16:10.262019+0000","last_peered":"2024-09-10T23:16:10.262019+0000","last_clean":"2024-09-10T23:16:10.262019+0000","last_became_active":"2024-09-10T23:16:08.220693+0000","last_became_peered":"2024-09-10T23:16:08.220693+0000","last_unstale":"2024-09-10T23:16:10.262019+0000","last_undegraded":"2024-09-10T23:16:10.262019+0000","last_fullsized":"2024-09-10T23:16:10.262019+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:49.939329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262419+0000","last_change":"2024-09-10T23:16:08.221371+0000","last_active":"2024-09-10T23:16:10.262419+0000","last_peered":"2024-09-10T23:16:10.262419+0000","last_clean":"2024-09-10T23:16:10.262419+0000","last_became_active":"2024-09-10T23:16:08.221107+0000","last_became_peered":"2024-09-10T23:16:08.221107+0000","last_unstale":"2024-09-10T23:16:10.262419+0000","last_undegraded":"2024-09-10T23:16:10.262419+0000","last_fullsized":"2024-09-10T23:16:10.262419+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:14.283540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262622+0000","last_change":"2024-09-10T23:16:08.223915+0000","last_active":"2024-09-10T23:16:10.262622+0000","last_peered":"2024-09-10T23:16:10.262622+0000","last_clean":"2024-09-10T23:16:10.262622+0000","last_became_active":"2024-09-10T23:16:08.222976+0000","last_became_peered":"2024-09-10T23:16:08.222976+0000","last_unstale":"2024-09-10T23:16:10.262622+0000","last_undegraded":"2024-09-10T23:16:10.262622+0000","last_fullsized":"2024-09-10T23:16:10.262622+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:28.712258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.211016+0000","last_change":"2024-09-10T23:16:08.221738+0000","last_active":"2024-09-10T23:16:09.211016+0000","last_peered":"2024-09-10T23:16:09.211016+0000","last_clean":"2024-09-10T23:16:09.211016+0000","last_became_active":"2024-09-10T23:16:08.221475+0000","last_became_peered":"2024-09-10T23:16:08.221475+0000","last_unstale":"2024-09-10T23:16:09.211016+0000","last_undegraded":"2024-09-10T23:16:09.211016+0000","last_fullsized":"2024-09-10T23:16:09.211016+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:34.031526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262029+0000","last_change":"2024-09-10T23:16:08.218292+0000","last_active":"2024-09-10T23:16:10.262029+0000","last_peered":"2024-09-10T23:16:10.262029+0000","last_clean":"2024-09-10T23:16:10.262029+0000","last_became_active":"2024-09-10T23:16:08.217972+0000","last_became_peered":"2024-09-10T23:16:08.217972+0000","last_unstale":"2024-09-10T23:16:10.262029+0000","last_undegraded":"2024-09-10T23:16:10.262029+0000","last_fullsized":"2024-09-10T23:16:10.262029+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:15.373698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226388+0000","last_change":"2024-09-10T23:16:08.224593+0000","last_active":"2024-09-10T23:16:08.226388+0000","last_peered":"2024-09-10T23:16:08.226388+0000","last_clean":"2024-09-10T23:16:08.226388+0000","last_became_active":"2024-09-10T23:16:08.224309+0000","last_became_peered":"2024-09-10T23:16:08.224309+0000","last_unstale":"2024-09-10T23:16:08.226388+0000","last_undegraded":"2024-09-10T23:16:08.226388+0000","last_fullsized":"2024-09-10T23:16:08.226388+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:19.742664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262629+0000","last_change":"2024-09-10T23:16:08.217936+0000","last_active":"2024-09-10T23:16:10.262629+0000","last_peered":"2024-09-10T23:16:10.262629+0000","last_clean":"2024-09-10T23:16:10.262629+0000","last_became_active":"2024-09-10T23:16:08.217668+0000","last_became_peered":"2024-09-10T23:16:08.217668+0000","last_unstale":"2024-09-10T23:16:10.262629+0000","last_undegraded":"2024-09-10T23:16:10.262629+0000","last_fullsized":"2024-09-10T23:16:10.262629+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:37.028734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261703+0000","last_change":"2024-09-10T23:16:08.223317+0000","last_active":"2024-09-10T23:16:10.261703+0000","last_peered":"2024-09-10T23:16:10.261703+0000","last_clean":"2024-09-10T23:16:10.261703+0000","last_became_active":"2024-09-10T23:16:08.223020+0000","last_became_peered":"2024-09-10T23:16:08.223020+0000","last_unstale":"2024-09-10T23:16:10.261703+0000","last_undegraded":"2024-09-10T23:16:10.261703+0000","last_fullsized":"2024-09-10T23:16:10.261703+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:22.041624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262254+0000","last_change":"2024-09-10T23:16:08.215544+0000","last_active":"2024-09-10T23:16:10.262254+0000","last_peered":"2024-09-10T23:16:10.262254+0000","last_clean":"2024-09-10T23:16:10.262254+0000","last_became_active":"2024-09-10T23:16:08.215261+0000","last_became_peered":"2024-09-10T23:16:08.215261+0000","last_unstale":"2024-09-10T23:16:10.262254+0000","last_undegraded":"2024-09-10T23:16:10.262254+0000","last_fullsized":"2024-09-10T23:16:10.262254+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:35.429144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209018+0000","last_change":"2024-09-10T23:16:08.215858+0000","last_active":"2024-09-10T23:16:09.209018+0000","last_peered":"2024-09-10T23:16:09.209018+0000","last_clean":"2024-09-10T23:16:09.209018+0000","last_became_active":"2024-09-10T23:16:08.215511+0000","last_became_peered":"2024-09-10T23:16:08.215511+0000","last_unstale":"2024-09-10T23:16:09.209018+0000","last_undegraded":"2024-09-10T23:16:09.209018+0000","last_fullsized":"2024-09-10T23:16:09.209018+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:21.981991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209145+0000","last_change":"2024-09-10T23:16:08.220980+0000","last_active":"2024-09-10T23:16:09.209145+0000","last_peered":"2024-09-10T23:16:09.209145+0000","last_clean":"2024-09-10T23:16:09.209145+0000","last_became_active":"2024-09-10T23:16:08.220709+0000","last_became_peered":"2024-09-10T23:16:08.220709+0000","last_unstale":"2024-09-10T23:16:09.209145+0000","last_undegraded":"2024-09-10T23:16:09.209145+0000","last_fullsized":"2024-09-10T23:16:09.209145+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:17:06.123113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.211028+0000","last_change":"2024-09-10T23:16:08.216936+0000","last_active":"2024-09-10T23:16:09.211028+0000","last_peered":"2024-09-10T23:16:09.211028+0000","last_clean":"2024-09-10T23:16:09.211028+0000","last_became_active":"2024-09-10T23:16:08.216650+0000","last_became_peered":"2024-09-10T23:16:08.216650+0000","last_unstale":"2024-09-10T23:16:09.211028+0000","last_undegraded":"2024-09-10T23:16:09.211028+0000","last_fullsized":"2024-09-10T23:16:09.211028+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:48.800232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210160+0000","last_change":"2024-09-10T23:16:08.226117+0000","last_active":"2024-09-10T23:16:09.210160+0000","last_peered":"2024-09-10T23:16:09.210160+0000","last_clean":"2024-09-10T23:16:09.210160+0000","last_became_active":"2024-09-10T23:16:08.225805+0000","last_became_peered":"2024-09-10T23:16:08.225805+0000","last_unstale":"2024-09-10T23:16:09.210160+0000","last_undegraded":"2024-09-10T23:16:09.210160+0000","last_fullsized":"2024-09-10T23:16:09.210160+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:21.571049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262631+0000","last_change":"2024-09-10T23:16:08.224422+0000","last_active":"2024-09-10T23:16:10.262631+0000","last_peered":"2024-09-10T23:16:10.262631+0000","last_clean":"2024-09-10T23:16:10.262631+0000","last_became_active":"2024-09-10T23:16:08.224175+0000","last_became_peered":"2024-09-10T23:16:08.224175+0000","last_unstale":"2024-09-10T23:16:10.262631+0000","last_undegraded":"2024-09-10T23:16:10.262631+0000","last_fullsized":"2024-09-10T23:16:10.262631+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:03.425760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262261+0000","last_change":"2024-09-10T23:16:08.219482+0000","last_active":"2024-09-10T23:16:10.262261+0000","last_peered":"2024-09-10T23:16:10.262261+0000","last_clean":"2024-09-10T23:16:10.262261+0000","last_became_active":"2024-09-10T23:16:08.219123+0000","last_became_peered":"2024-09-10T23:16:08.219123+0000","last_unstale":"2024-09-10T23:16:10.262261+0000","last_undegraded":"2024-09-10T23:16:10.262261+0000","last_fullsized":"2024-09-10T23:16:10.262261+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:52.313487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226066+0000","last_change":"2024-09-10T23:16:08.218867+0000","last_active":"2024-09-10T23:16:08.226066+0000","last_peered":"2024-09-10T23:16:08.226066+0000","last_clean":"2024-09-10T23:16:08.226066+0000","last_became_active":"2024-09-10T23:16:08.218629+0000","last_became_peered":"2024-09-10T23:16:08.218629+0000","last_unstale":"2024-09-10T23:16:08.226066+0000","last_undegraded":"2024-09-10T23:16:08.226066+0000","last_fullsized":"2024-09-10T23:16:08.226066+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:10.177029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262331+0000","last_change":"2024-09-10T23:16:08.220361+0000","last_active":"2024-09-10T23:16:10.262331+0000","last_peered":"2024-09-10T23:16:10.262331+0000","last_clean":"2024-09-10T23:16:10.262331+0000","last_became_active":"2024-09-10T23:16:08.220077+0000","last_became_peered":"2024-09-10T23:16:08.220077+0000","last_unstale":"2024-09-10T23:16:10.262331+0000","last_undegraded":"2024-09-10T23:16:10.262331+0000","last_fullsized":"2024-09-10T23:16:10.262331+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:44.112275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262522+0000","last_change":"2024-09-10T23:16:08.226182+0000","last_active":"2024-09-10T23:16:10.262522+0000","last_peered":"2024-09-10T23:16:10.262522+0000","last_clean":"2024-09-10T23:16:10.262522+0000","last_became_active":"2024-09-10T23:16:08.225727+0000","last_became_peered":"2024-09-10T23:16:08.225727+0000","last_unstale":"2024-09-10T23:16:10.262522+0000","last_undegraded":"2024-09-10T23:16:10.262522+0000","last_fullsized":"2024-09-10T23:16:10.262522+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:02.104576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261850+0000","last_change":"2024-09-10T23:16:08.221264+0000","last_active":"2024-09-10T23:16:10.261850+0000","last_peered":"2024-09-10T23:16:10.261850+0000","last_clean":"2024-09-10T23:16:10.261850+0000","last_became_active":"2024-09-10T23:16:08.220962+0000","last_became_peered":"2024-09-10T23:16:08.220962+0000","last_unstale":"2024-09-10T23:16:10.261850+0000","last_undegraded":"2024-09-10T23:16:10.261850+0000","last_fullsized":"2024-09-10T23:16:10.261850+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:06.022447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262538+0000","last_change":"2024-09-10T23:16:08.227508+0000","last_active":"2024-09-10T23:16:10.262538+0000","last_peered":"2024-09-10T23:16:10.262538+0000","last_clean":"2024-09-10T23:16:10.262538+0000","last_became_active":"2024-09-10T23:16:08.227234+0000","last_became_peered":"2024-09-10T23:16:08.227234+0000","last_unstale":"2024-09-10T23:16:10.262538+0000","last_undegraded":"2024-09-10T23:16:10.262538+0000","last_fullsized":"2024-09-10T23:16:10.262538+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:39.876694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261769+0000","last_change":"2024-09-10T23:16:08.219867+0000","last_active":"2024-09-10T23:16:10.261769+0000","last_peered":"2024-09-10T23:16:10.261769+0000","last_clean":"2024-09-10T23:16:10.261769+0000","last_became_active":"2024-09-10T23:16:08.219560+0000","last_became_peered":"2024-09-10T23:16:08.219560+0000","last_unstale":"2024-09-10T23:16:10.261769+0000","last_undegraded":"2024-09-10T23:16:10.261769+0000","last_fullsized":"2024-09-10T23:16:10.261769+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:27.410153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261934+0000","last_change":"2024-09-10T23:16:08.225757+0000","last_active":"2024-09-10T23:16:10.261934+0000","last_peered":"2024-09-10T23:16:10.261934+0000","last_clean":"2024-09-10T23:16:10.261934+0000","last_became_active":"2024-09-10T23:16:08.225222+0000","last_became_peered":"2024-09-10T23:16:08.225222+0000","last_unstale":"2024-09-10T23:16:10.261934+0000","last_undegraded":"2024-09-10T23:16:10.261934+0000","last_fullsized":"2024-09-10T23:16:10.261934+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:46.972942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262556+0000","last_change":"2024-09-10T23:16:08.223165+0000","last_active":"2024-09-10T23:16:10.262556+0000","last_peered":"2024-09-10T23:16:10.262556+0000","last_clean":"2024-09-10T23:16:10.262556+0000","last_became_active":"2024-09-10T23:16:08.222819+0000","last_became_peered":"2024-09-10T23:16:08.222819+0000","last_unstale":"2024-09-10T23:16:10.262556+0000","last_undegraded":"2024-09-10T23:16:10.262556+0000","last_fullsized":"2024-09-10T23:16:10.262556+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:10.789779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210565+0000","last_change":"2024-09-10T23:16:08.226150+0000","last_active":"2024-09-10T23:16:09.210565+0000","last_peered":"2024-09-10T23:16:09.210565+0000","last_clean":"2024-09-10T23:16:09.210565+0000","last_became_active":"2024-09-10T23:16:08.225845+0000","last_became_peered":"2024-09-10T23:16:08.225845+0000","last_unstale":"2024-09-10T23:16:09.210565+0000","last_undegraded":"2024-09-10T23:16:09.210565+0000","last_fullsized":"2024-09-10T23:16:09.210565+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:53.459435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261990+0000","last_change":"2024-09-10T23:16:08.219668+0000","last_active":"2024-09-10T23:16:10.261990+0000","last_peered":"2024-09-10T23:16:10.261990+0000","last_clean":"2024-09-10T23:16:10.261990+0000","last_became_active":"2024-09-10T23:16:08.219383+0000","last_became_peered":"2024-09-10T23:16:08.219383+0000","last_unstale":"2024-09-10T23:16:10.261990+0000","last_undegraded":"2024-09-10T23:16:10.261990+0000","last_fullsized":"2024-09-10T23:16:10.261990+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:53.990780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210406+0000","last_change":"2024-09-10T23:16:08.214264+0000","last_active":"2024-09-10T23:16:09.210406+0000","last_peered":"2024-09-10T23:16:09.210406+0000","last_clean":"2024-09-10T23:16:09.210406+0000","last_became_active":"2024-09-10T23:16:08.213994+0000","last_became_peered":"2024-09-10T23:16:08.213994+0000","last_unstale":"2024-09-10T23:16:09.210406+0000","last_undegraded":"2024-09-10T23:16:09.210406+0000","last_fullsized":"2024-09-10T23:16:09.210406+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:22.656611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226289+0000","last_change":"2024-09-10T23:16:08.219112+0000","last_active":"2024-09-10T23:16:08.226289+0000","last_peered":"2024-09-10T23:16:08.226289+0000","last_clean":"2024-09-10T23:16:08.226289+0000","last_became_active":"2024-09-10T23:16:08.218847+0000","last_became_peered":"2024-09-10T23:16:08.218847+0000","last_unstale":"2024-09-10T23:16:08.226289+0000","last_undegraded":"2024-09-10T23:16:08.226289+0000","last_fullsized":"2024-09-10T23:16:08.226289+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:55.616925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261944+0000","last_change":"2024-09-10T23:16:08.218973+0000","last_active":"2024-09-10T23:16:10.261944+0000","last_peered":"2024-09-10T23:16:10.261944+0000","last_clean":"2024-09-10T23:16:10.261944+0000","last_became_active":"2024-09-10T23:16:08.218660+0000","last_became_peered":"2024-09-10T23:16:08.218660+0000","last_unstale":"2024-09-10T23:16:10.261944+0000","last_undegraded":"2024-09-10T23:16:10.261944+0000","last_fullsized":"2024-09-10T23:16:10.261944+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:00.308208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262375+0000","last_change":"2024-09-10T23:16:08.217652+0000","last_active":"2024-09-10T23:16:10.262375+0000","last_peered":"2024-09-10T23:16:10.262375+0000","last_clean":"2024-09-10T23:16:10.262375+0000","last_became_active":"2024-09-10T23:16:08.217347+0000","last_became_peered":"2024-09-10T23:16:08.217347+0000","last_unstale":"2024-09-10T23:16:10.262375+0000","last_undegraded":"2024-09-10T23:16:10.262375+0000","last_fullsized":"2024-09-10T23:16:10.262375+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:35.291935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262011+0000","last_change":"2024-09-10T23:16:08.222602+0000","last_active":"2024-09-10T23:16:10.262011+0000","last_peered":"2024-09-10T23:16:10.262011+0000","last_clean":"2024-09-10T23:16:10.262011+0000","last_became_active":"2024-09-10T23:16:08.222137+0000","last_became_peered":"2024-09-10T23:16:08.222137+0000","last_unstale":"2024-09-10T23:16:10.262011+0000","last_undegraded":"2024-09-10T23:16:10.262011+0000","last_fullsized":"2024-09-10T23:16:10.262011+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:03.228388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261645+0000","last_change":"2024-09-10T23:16:08.220495+0000","last_active":"2024-09-10T23:16:10.261645+0000","last_peered":"2024-09-10T23:16:10.261645+0000","last_clean":"2024-09-10T23:16:10.261645+0000","last_became_active":"2024-09-10T23:16:08.220175+0000","last_became_peered":"2024-09-10T23:16:08.220175+0000","last_unstale":"2024-09-10T23:16:10.261645+0000","last_undegraded":"2024-09-10T23:16:10.261645+0000","last_fullsized":"2024-09-10T23:16:10.261645+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:03.264573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226106+0000","last_change":"2024-09-10T23:16:08.221753+0000","last_active":"2024-09-10T23:16:08.226106+0000","last_peered":"2024-09-10T23:16:08.226106+0000","last_clean":"2024-09-10T23:16:08.226106+0000","last_became_active":"2024-09-10T23:16:08.221468+0000","last_became_peered":"2024-09-10T23:16:08.221468+0000","last_unstale":"2024-09-10T23:16:08.226106+0000","last_undegraded":"2024-09-10T23:16:08.226106+0000","last_fullsized":"2024-09-10T23:16:08.226106+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:50.862301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226082+0000","last_change":"2024-09-10T23:16:08.218653+0000","last_active":"2024-09-10T23:16:08.226082+0000","last_peered":"2024-09-10T23:16:08.226082+0000","last_clean":"2024-09-10T23:16:08.226082+0000","last_became_active":"2024-09-10T23:16:08.218413+0000","last_became_peered":"2024-09-10T23:16:08.218413+0000","last_unstale":"2024-09-10T23:16:08.226082+0000","last_undegraded":"2024-09-10T23:16:08.226082+0000","last_fullsized":"2024-09-10T23:16:08.226082+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:41.678476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.243786+0000","last_change":"2024-09-10T23:16:07.243432+0000","last_active":"2024-09-10T23:16:08.243786+0000","last_peered":"2024-09-10T23:16:08.243786+0000","last_clean":"2024-09-10T23:16:08.243786+0000","last_became_active":"2024-09-10T23:16:07.243177+0000","last_became_peered":"2024-09-10T23:16:07.243177+0000","last_unstale":"2024-09-10T23:16:08.243786+0000","last_undegraded":"2024-09-10T23:16:08.243786+0000","last_fullsized":"2024-09-10T23:16:08.243786+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:53.240170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209042+0000","last_change":"2024-09-10T23:16:08.220835+0000","last_active":"2024-09-10T23:16:09.209042+0000","last_peered":"2024-09-10T23:16:09.209042+0000","last_clean":"2024-09-10T23:16:09.209042+0000","last_became_active":"2024-09-10T23:16:08.220555+0000","last_became_peered":"2024-09-10T23:16:08.220555+0000","last_unstale":"2024-09-10T23:16:09.209042+0000","last_undegraded":"2024-09-10T23:16:09.209042+0000","last_fullsized":"2024-09-10T23:16:09.209042+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:49.764365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262378+0000","last_change":"2024-09-10T23:16:07.247199+0000","last_active":"2024-09-10T23:16:10.262378+0000","last_peered":"2024-09-10T23:16:10.262378+0000","last_clean":"2024-09-10T23:16:10.262378+0000","last_became_active":"2024-09-10T23:16:07.246886+0000","last_became_peered":"2024-09-10T23:16:07.246886+0000","last_unstale":"2024-09-10T23:16:10.262378+0000","last_undegraded":"2024-09-10T23:16:10.262378+0000","last_fullsized":"2024-09-10T23:16:10.262378+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:14.931355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226124+0000","last_change":"2024-09-10T23:16:08.220183+0000","last_active":"2024-09-10T23:16:08.226124+0000","last_peered":"2024-09-10T23:16:08.226124+0000","last_clean":"2024-09-10T23:16:08.226124+0000","last_became_active":"2024-09-10T23:16:08.219931+0000","last_became_peered":"2024-09-10T23:16:08.219931+0000","last_unstale":"2024-09-10T23:16:08.226124+0000","last_undegraded":"2024-09-10T23:16:08.226124+0000","last_fullsized":"2024-09-10T23:16:08.226124+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:42.869588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.242872+0000","last_change":"2024-09-10T23:16:07.240650+0000","last_active":"2024-09-10T23:16:08.242872+0000","last_peered":"2024-09-10T23:16:08.242872+0000","last_clean":"2024-09-10T23:16:08.242872+0000","last_became_active":"2024-09-10T23:16:07.240394+0000","last_became_peered":"2024-09-10T23:16:07.240394+0000","last_unstale":"2024-09-10T23:16:08.242872+0000","last_undegraded":"2024-09-10T23:16:08.242872+0000","last_fullsized":"2024-09-10T23:16:08.242872+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:53.615139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.225362+0000","last_change":"2024-09-10T23:16:08.215439+0000","last_active":"2024-09-10T23:16:08.225362+0000","last_peered":"2024-09-10T23:16:08.225362+0000","last_clean":"2024-09-10T23:16:08.225362+0000","last_became_active":"2024-09-10T23:16:08.215177+0000","last_became_peered":"2024-09-10T23:16:08.215177+0000","last_unstale":"2024-09-10T23:16:08.225362+0000","last_undegraded":"2024-09-10T23:16:08.225362+0000","last_fullsized":"2024-09-10T23:16:08.225362+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:05.491789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.211125+0000","last_change":"2024-09-10T23:16:07.247286+0000","last_active":"2024-09-10T23:16:09.211125+0000","last_peered":"2024-09-10T23:16:09.211125+0000","last_clean":"2024-09-10T23:16:09.211125+0000","last_became_active":"2024-09-10T23:16:07.246107+0000","last_became_peered":"2024-09-10T23:16:07.246107+0000","last_unstale":"2024-09-10T23:16:09.211125+0000","last_undegraded":"2024-09-10T23:16:09.211125+0000","last_fullsized":"2024-09-10T23:16:09.211125+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:26.075661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262211+0000","last_change":"2024-09-10T23:16:08.225483+0000","last_active":"2024-09-10T23:16:10.262211+0000","last_peered":"2024-09-10T23:16:10.262211+0000","last_clean":"2024-09-10T23:16:10.262211+0000","last_became_active":"2024-09-10T23:16:08.224744+0000","last_became_peered":"2024-09-10T23:16:08.224744+0000","last_unstale":"2024-09-10T23:16:10.262211+0000","last_undegraded":"2024-09-10T23:16:10.262211+0000","last_fullsized":"2024-09-10T23:16:10.262211+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:42.110085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261734+0000","last_change":"2024-09-10T23:16:07.242137+0000","last_active":"2024-09-10T23:16:10.261734+0000","last_peered":"2024-09-10T23:16:10.261734+0000","last_clean":"2024-09-10T23:16:10.261734+0000","last_became_active":"2024-09-10T23:16:07.241872+0000","last_became_peered":"2024-09-10T23:16:07.241872+0000","last_unstale":"2024-09-10T23:16:10.261734+0000","last_undegraded":"2024-09-10T23:16:10.261734+0000","last_fullsized":"2024-09-10T23:16:10.261734+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:20.978310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262440+0000","last_change":"2024-09-10T23:16:08.227179+0000","last_active":"2024-09-10T23:16:10.262440+0000","last_peered":"2024-09-10T23:16:10.262440+0000","last_clean":"2024-09-10T23:16:10.262440+0000","last_became_active":"2024-09-10T23:16:08.226899+0000","last_became_peered":"2024-09-10T23:16:08.226899+0000","last_unstale":"2024-09-10T23:16:10.262440+0000","last_undegraded":"2024-09-10T23:16:10.262440+0000","last_fullsized":"2024-09-10T23:16:10.262440+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:51.649482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.240502+0000","last_change":"2024-09-10T23:16:07.244199+0000","last_active":"2024-09-10T23:16:08.240502+0000","last_peered":"2024-09-10T23:16:08.240502+0000","last_clean":"2024-09-10T23:16:08.240502+0000","last_became_active":"2024-09-10T23:16:07.243940+0000","last_became_peered":"2024-09-10T23:16:07.243940+0000","last_unstale":"2024-09-10T23:16:08.240502+0000","last_undegraded":"2024-09-10T23:16:08.240502+0000","last_fullsized":"2024-09-10T23:16:08.240502+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:51.058673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210639+0000","last_change":"2024-09-10T23:16:08.218735+0000","last_active":"2024-09-10T23:16:09.210639+0000","last_peered":"2024-09-10T23:16:09.210639+0000","last_clean":"2024-09-10T23:16:09.210639+0000","last_became_active":"2024-09-10T23:16:08.218245+0000","last_became_peered":"2024-09-10T23:16:08.218245+0000","last_unstale":"2024-09-10T23:16:09.210639+0000","last_undegraded":"2024-09-10T23:16:09.210639+0000","last_fullsized":"2024-09-10T23:16:09.210639+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:48.184784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210656+0000","last_change":"2024-09-10T23:16:07.242377+0000","last_active":"2024-09-10T23:16:09.210656+0000","last_peered":"2024-09-10T23:16:09.210656+0000","last_clean":"2024-09-10T23:16:09.210656+0000","last_became_active":"2024-09-10T23:16:07.242072+0000","last_became_peered":"2024-09-10T23:16:07.242072+0000","last_unstale":"2024-09-10T23:16:09.210656+0000","last_undegraded":"2024-09-10T23:16:09.210656+0000","last_fullsized":"2024-09-10T23:16:09.210656+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:52.234083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262117+0000","last_change":"2024-09-10T23:16:08.219446+0000","last_active":"2024-09-10T23:16:10.262117+0000","last_peered":"2024-09-10T23:16:10.262117+0000","last_clean":"2024-09-10T23:16:10.262117+0000","last_became_active":"2024-09-10T23:16:08.219043+0000","last_became_peered":"2024-09-10T23:16:08.219043+0000","last_unstale":"2024-09-10T23:16:10.262117+0000","last_undegraded":"2024-09-10T23:16:10.262117+0000","last_fullsized":"2024-09-10T23:16:10.262117+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:54.834435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261479+0000","last_change":"2024-09-10T23:16:07.246922+0000","last_active":"2024-09-10T23:16:10.261479+0000","last_peered":"2024-09-10T23:16:10.261479+0000","last_clean":"2024-09-10T23:16:10.261479+0000","last_became_active":"2024-09-10T23:16:07.246544+0000","last_became_peered":"2024-09-10T23:16:07.246544+0000","last_unstale":"2024-09-10T23:16:10.261479+0000","last_undegraded":"2024-09-10T23:16:10.261479+0000","last_fullsized":"2024-09-10T23:16:10.261479+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:42.272959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262359+0000","last_change":"2024-09-10T23:16:08.220665+0000","last_active":"2024-09-10T23:16:10.262359+0000","last_peered":"2024-09-10T23:16:10.262359+0000","last_clean":"2024-09-10T23:16:10.262359+0000","last_became_active":"2024-09-10T23:16:08.220376+0000","last_became_peered":"2024-09-10T23:16:08.220376+0000","last_unstale":"2024-09-10T23:16:10.262359+0000","last_undegraded":"2024-09-10T23:16:10.262359+0000","last_fullsized":"2024-09-10T23:16:10.262359+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:10.175097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262175+0000","last_change":"2024-09-10T23:16:07.250203+0000","last_active":"2024-09-10T23:16:10.262175+0000","last_peered":"2024-09-10T23:16:10.262175+0000","last_clean":"2024-09-10T23:16:10.262175+0000","last_became_active":"2024-09-10T23:16:07.249962+0000","last_became_peered":"2024-09-10T23:16:07.249962+0000","last_unstale":"2024-09-10T23:16:10.262175+0000","last_undegraded":"2024-09-10T23:16:10.262175+0000","last_fullsized":"2024-09-10T23:16:10.262175+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:10:38.952964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262430+0000","last_change":"2024-09-10T23:16:08.224866+0000","last_active":"2024-09-10T23:16:10.262430+0000","last_peered":"2024-09-10T23:16:10.262430+0000","last_clean":"2024-09-10T23:16:10.262430+0000","last_became_active":"2024-09-10T23:16:08.224576+0000","last_became_peered":"2024-09-10T23:16:08.224576+0000","last_unstale":"2024-09-10T23:16:10.262430+0000","last_undegraded":"2024-09-10T23:16:10.262430+0000","last_fullsized":"2024-09-10T23:16:10.262430+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:23.914405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262502+0000","last_change":"2024-09-10T23:16:07.242578+0000","last_active":"2024-09-10T23:16:10.262502+0000","last_peered":"2024-09-10T23:16:10.262502+0000","last_clean":"2024-09-10T23:16:10.262502+0000","last_became_active":"2024-09-10T23:16:07.242328+0000","last_became_peered":"2024-09-10T23:16:07.242328+0000","last_unstale":"2024-09-10T23:16:10.262502+0000","last_undegraded":"2024-09-10T23:16:10.262502+0000","last_fullsized":"2024-09-10T23:16:10.262502+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:21.652930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.208860+0000","last_change":"2024-09-10T23:16:08.218853+0000","last_active":"2024-09-10T23:16:09.208860+0000","last_peered":"2024-09-10T23:16:09.208860+0000","last_clean":"2024-09-10T23:16:09.208860+0000","last_became_active":"2024-09-10T23:16:08.218606+0000","last_became_peered":"2024-09-10T23:16:08.218606+0000","last_unstale":"2024-09-10T23:16:09.208860+0000","last_undegraded":"2024-09-10T23:16:09.208860+0000","last_fullsized":"2024-09-10T23:16:09.208860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:23.219087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262749+0000","last_change":"2024-09-10T23:16:07.249408+0000","last_active":"2024-09-10T23:16:10.262749+0000","last_peered":"2024-09-10T23:16:10.262749+0000","last_clean":"2024-09-10T23:16:10.262749+0000","last_became_active":"2024-09-10T23:16:07.249172+0000","last_became_peered":"2024-09-10T23:16:07.249172+0000","last_unstale":"2024-09-10T23:16:10.262749+0000","last_undegraded":"2024-09-10T23:16:10.262749+0000","last_fullsized":"2024-09-10T23:16:10.262749+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:30.768916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262419+0000","last_change":"2024-09-10T23:16:08.218703+0000","last_active":"2024-09-10T23:16:10.262419+0000","last_peered":"2024-09-10T23:16:10.262419+0000","last_clean":"2024-09-10T23:16:10.262419+0000","last_became_active":"2024-09-10T23:16:08.218241+0000","last_became_peered":"2024-09-10T23:16:08.218241+0000","last_unstale":"2024-09-10T23:16:10.262419+0000","last_undegraded":"2024-09-10T23:16:10.262419+0000","last_fullsized":"2024-09-10T23:16:10.262419+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:17.010232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262572+0000","last_change":"2024-09-10T23:16:07.245791+0000","last_active":"2024-09-10T23:16:10.262572+0000","last_peered":"2024-09-10T23:16:10.262572+0000","last_clean":"2024-09-10T23:16:10.262572+0000","last_became_active":"2024-09-10T23:16:07.245524+0000","last_became_peered":"2024-09-10T23:16:07.245524+0000","last_unstale":"2024-09-10T23:16:10.262572+0000","last_undegraded":"2024-09-10T23:16:10.262572+0000","last_fullsized":"2024-09-10T23:16:10.262572+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:20.821601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209964+0000","last_change":"2024-09-10T23:16:08.220916+0000","last_active":"2024-09-10T23:16:09.209964+0000","last_peered":"2024-09-10T23:16:09.209964+0000","last_clean":"2024-09-10T23:16:09.209964+0000","last_became_active":"2024-09-10T23:16:08.220564+0000","last_became_peered":"2024-09-10T23:16:08.220564+0000","last_unstale":"2024-09-10T23:16:09.209964+0000","last_undegraded":"2024-09-10T23:16:09.209964+0000","last_fullsized":"2024-09-10T23:16:09.209964+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:33:54.089374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262155+0000","last_change":"2024-09-10T23:16:07.243362+0000","last_active":"2024-09-10T23:16:10.262155+0000","last_peered":"2024-09-10T23:16:10.262155+0000","last_clean":"2024-09-10T23:16:10.262155+0000","last_became_active":"2024-09-10T23:16:07.242429+0000","last_became_peered":"2024-09-10T23:16:07.242429+0000","last_unstale":"2024-09-10T23:16:10.262155+0000","last_undegraded":"2024-09-10T23:16:10.262155+0000","last_fullsized":"2024-09-10T23:16:10.262155+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:02.224707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262269+0000","last_change":"2024-09-10T23:16:08.223572+0000","last_active":"2024-09-10T23:16:10.262269+0000","last_peered":"2024-09-10T23:16:10.262269+0000","last_clean":"2024-09-10T23:16:10.262269+0000","last_became_active":"2024-09-10T23:16:08.222661+0000","last_became_peered":"2024-09-10T23:16:08.222661+0000","last_unstale":"2024-09-10T23:16:10.262269+0000","last_undegraded":"2024-09-10T23:16:10.262269+0000","last_fullsized":"2024-09-10T23:16:10.262269+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:48.800232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209713+0000","last_change":"2024-09-10T23:16:07.248634+0000","last_active":"2024-09-10T23:16:09.209713+0000","last_peered":"2024-09-10T23:16:09.209713+0000","last_clean":"2024-09-10T23:16:09.209713+0000","last_became_active":"2024-09-10T23:16:07.248274+0000","last_became_peered":"2024-09-10T23:16:07.248274+0000","last_unstale":"2024-09-10T23:16:09.209713+0000","last_undegraded":"2024-09-10T23:16:09.209713+0000","last_fullsized":"2024-09-10T23:16:09.209713+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:10.006129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262261+0000","last_change":"2024-09-10T23:16:08.218722+0000","last_active":"2024-09-10T23:16:10.262261+0000","last_peered":"2024-09-10T23:16:10.262261+0000","last_clean":"2024-09-10T23:16:10.262261+0000","last_became_active":"2024-09-10T23:16:08.218442+0000","last_became_peered":"2024-09-10T23:16:08.218442+0000","last_unstale":"2024-09-10T23:16:10.262261+0000","last_undegraded":"2024-09-10T23:16:10.262261+0000","last_fullsized":"2024-09-10T23:16:10.262261+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:20:23.553899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210394+0000","last_change":"2024-09-10T23:16:07.246890+0000","last_active":"2024-09-10T23:16:09.210394+0000","last_peered":"2024-09-10T23:16:09.210394+0000","last_clean":"2024-09-10T23:16:09.210394+0000","last_became_active":"2024-09-10T23:16:07.246158+0000","last_became_peered":"2024-09-10T23:16:07.246158+0000","last_unstale":"2024-09-10T23:16:09.210394+0000","last_undegraded":"2024-09-10T23:16:09.210394+0000","last_fullsized":"2024-09-10T23:16:09.210394+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:15.703595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262170+0000","last_change":"2024-09-10T23:16:08.223823+0000","last_active":"2024-09-10T23:16:10.262170+0000","last_peered":"2024-09-10T23:16:10.262170+0000","last_clean":"2024-09-10T23:16:10.262170+0000","last_became_active":"2024-09-10T23:16:08.223546+0000","last_became_peered":"2024-09-10T23:16:08.223546+0000","last_unstale":"2024-09-10T23:16:10.262170+0000","last_undegraded":"2024-09-10T23:16:10.262170+0000","last_fullsized":"2024-09-10T23:16:10.262170+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:34.031526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":23,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261735+0000","last_change":"2024-09-10T23:16:07.250840+0000","last_active":"2024-09-10T23:16:10.261735+0000","last_peered":"2024-09-10T23:16:10.261735+0000","last_clean":"2024-09-10T23:16:10.261735+0000","last_became_active":"2024-09-10T23:16:07.250571+0000","last_became_peered":"2024-09-10T23:16:07.250571+0000","last_unstale":"2024-09-10T23:16:10.261735+0000","last_undegraded":"2024-09-10T23:16:10.261735+0000","last_fullsized":"2024-09-10T23:16:10.261735+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:08.202449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262572+0000","last_change":"2024-09-10T23:16:08.221947+0000","last_active":"2024-09-10T23:16:10.262572+0000","last_peered":"2024-09-10T23:16:10.262572+0000","last_clean":"2024-09-10T23:16:10.262572+0000","last_became_active":"2024-09-10T23:16:08.221586+0000","last_became_peered":"2024-09-10T23:16:08.221586+0000","last_unstale":"2024-09-10T23:16:10.262572+0000","last_undegraded":"2024-09-10T23:16:10.262572+0000","last_fullsized":"2024-09-10T23:16:10.262572+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:53.020253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262258+0000","last_change":"2024-09-10T23:16:07.242698+0000","last_active":"2024-09-10T23:16:10.262258+0000","last_peered":"2024-09-10T23:16:10.262258+0000","last_clean":"2024-09-10T23:16:10.262258+0000","last_became_active":"2024-09-10T23:16:07.242451+0000","last_became_peered":"2024-09-10T23:16:07.242451+0000","last_unstale":"2024-09-10T23:16:10.262258+0000","last_undegraded":"2024-09-10T23:16:10.262258+0000","last_fullsized":"2024-09-10T23:16:10.262258+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:41.904749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210453+0000","last_change":"2024-09-10T23:16:08.220196+0000","last_active":"2024-09-10T23:16:09.210453+0000","last_peered":"2024-09-10T23:16:09.210453+0000","last_clean":"2024-09-10T23:16:09.210453+0000","last_became_active":"2024-09-10T23:16:08.219799+0000","last_became_peered":"2024-09-10T23:16:08.219799+0000","last_unstale":"2024-09-10T23:16:09.210453+0000","last_undegraded":"2024-09-10T23:16:09.210453+0000","last_fullsized":"2024-09-10T23:16:09.210453+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:42.908430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.241990+0000","last_change":"2024-09-10T23:16:07.244013+0000","last_active":"2024-09-10T23:16:08.241990+0000","last_peered":"2024-09-10T23:16:08.241990+0000","last_clean":"2024-09-10T23:16:08.241990+0000","last_became_active":"2024-09-10T23:16:07.243760+0000","last_became_peered":"2024-09-10T23:16:07.243760+0000","last_unstale":"2024-09-10T23:16:08.241990+0000","last_undegraded":"2024-09-10T23:16:08.241990+0000","last_fullsized":"2024-09-10T23:16:08.241990+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:23.111465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262559+0000","last_change":"2024-09-10T23:16:08.222513+0000","last_active":"2024-09-10T23:16:10.262559+0000","last_peered":"2024-09-10T23:16:10.262559+0000","last_clean":"2024-09-10T23:16:10.262559+0000","last_became_active":"2024-09-10T23:16:08.222212+0000","last_became_peered":"2024-09-10T23:16:08.222212+0000","last_unstale":"2024-09-10T23:16:10.262559+0000","last_undegraded":"2024-09-10T23:16:10.262559+0000","last_fullsized":"2024-09-10T23:16:10.262559+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:03.899036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210913+0000","last_change":"2024-09-10T23:16:07.248434+0000","last_active":"2024-09-10T23:16:09.210913+0000","last_peered":"2024-09-10T23:16:09.210913+0000","last_clean":"2024-09-10T23:16:09.210913+0000","last_became_active":"2024-09-10T23:16:07.248190+0000","last_became_peered":"2024-09-10T23:16:07.248190+0000","last_unstale":"2024-09-10T23:16:09.210913+0000","last_undegraded":"2024-09-10T23:16:09.210913+0000","last_fullsized":"2024-09-10T23:16:09.210913+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:22.233787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262662+0000","last_change":"2024-09-10T23:16:08.224904+0000","last_active":"2024-09-10T23:16:10.262662+0000","last_peered":"2024-09-10T23:16:10.262662+0000","last_clean":"2024-09-10T23:16:10.262662+0000","last_became_active":"2024-09-10T23:16:08.224619+0000","last_became_peered":"2024-09-10T23:16:08.224619+0000","last_unstale":"2024-09-10T23:16:10.262662+0000","last_undegraded":"2024-09-10T23:16:10.262662+0000","last_fullsized":"2024-09-10T23:16:10.262662+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:10.515057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.206463+0000","last_change":"2024-09-10T23:16:07.241871+0000","last_active":"2024-09-10T23:16:08.206463+0000","last_peered":"2024-09-10T23:16:08.206463+0000","last_clean":"2024-09-10T23:16:08.206463+0000","last_became_active":"2024-09-10T23:16:07.241609+0000","last_became_peered":"2024-09-10T23:16:07.241609+0000","last_unstale":"2024-09-10T23:16:08.206463+0000","last_undegraded":"2024-09-10T23:16:08.206463+0000","last_fullsized":"2024-09-10T23:16:08.206463+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:51.936391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210151+0000","last_change":"2024-09-10T23:16:08.220448+0000","last_active":"2024-09-10T23:16:09.210151+0000","last_peered":"2024-09-10T23:16:09.210151+0000","last_clean":"2024-09-10T23:16:09.210151+0000","last_became_active":"2024-09-10T23:16:08.219886+0000","last_became_peered":"2024-09-10T23:16:08.219886+0000","last_unstale":"2024-09-10T23:16:09.210151+0000","last_undegraded":"2024-09-10T23:16:09.210151+0000","last_fullsized":"2024-09-10T23:16:09.210151+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:15.935036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262554+0000","last_change":"2024-09-10T23:16:07.242926+0000","last_active":"2024-09-10T23:16:10.262554+0000","last_peered":"2024-09-10T23:16:10.262554+0000","last_clean":"2024-09-10T23:16:10.262554+0000","last_became_active":"2024-09-10T23:16:07.242676+0000","last_became_peered":"2024-09-10T23:16:07.242676+0000","last_unstale":"2024-09-10T23:16:10.262554+0000","last_undegraded":"2024-09-10T23:16:10.262554+0000","last_fullsized":"2024-09-10T23:16:10.262554+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:33.027845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226003+0000","last_change":"2024-09-10T23:16:08.218101+0000","last_active":"2024-09-10T23:16:08.226003+0000","last_peered":"2024-09-10T23:16:08.226003+0000","last_clean":"2024-09-10T23:16:08.226003+0000","last_became_active":"2024-09-10T23:16:08.217842+0000","last_became_peered":"2024-09-10T23:16:08.217842+0000","last_unstale":"2024-09-10T23:16:08.226003+0000","last_undegraded":"2024-09-10T23:16:08.226003+0000","last_fullsized":"2024-09-10T23:16:08.226003+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:11.019409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.208789+0000","last_change":"2024-09-10T23:16:07.242064+0000","last_active":"2024-09-10T23:16:09.208789+0000","last_peered":"2024-09-10T23:16:09.208789+0000","last_clean":"2024-09-10T23:16:09.208789+0000","last_became_active":"2024-09-10T23:16:07.241807+0000","last_became_peered":"2024-09-10T23:16:07.241807+0000","last_unstale":"2024-09-10T23:16:09.208789+0000","last_undegraded":"2024-09-10T23:16:09.208789+0000","last_fullsized":"2024-09-10T23:16:09.208789+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:16.706730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.225954+0000","last_change":"2024-09-10T23:16:08.217121+0000","last_active":"2024-09-10T23:16:08.225954+0000","last_peered":"2024-09-10T23:16:08.225954+0000","last_clean":"2024-09-10T23:16:08.225954+0000","last_became_active":"2024-09-10T23:16:08.216844+0000","last_became_peered":"2024-09-10T23:16:08.216844+0000","last_unstale":"2024-09-10T23:16:08.225954+0000","last_undegraded":"2024-09-10T23:16:08.225954+0000","last_fullsized":"2024-09-10T23:16:08.225954+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:44.394190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209640+0000","last_change":"2024-09-10T23:16:07.245913+0000","last_active":"2024-09-10T23:16:09.209640+0000","last_peered":"2024-09-10T23:16:09.209640+0000","last_clean":"2024-09-10T23:16:09.209640+0000","last_became_active":"2024-09-10T23:16:07.245627+0000","last_became_peered":"2024-09-10T23:16:07.245627+0000","last_unstale":"2024-09-10T23:16:09.209640+0000","last_undegraded":"2024-09-10T23:16:09.209640+0000","last_fullsized":"2024-09-10T23:16:09.209640+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:24.601059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210608+0000","last_change":"2024-09-10T23:16:08.221121+0000","last_active":"2024-09-10T23:16:09.210608+0000","last_peered":"2024-09-10T23:16:09.210608+0000","last_clean":"2024-09-10T23:16:09.210608+0000","last_became_active":"2024-09-10T23:16:08.220841+0000","last_became_peered":"2024-09-10T23:16:08.220841+0000","last_unstale":"2024-09-10T23:16:09.210608+0000","last_undegraded":"2024-09-10T23:16:09.210608+0000","last_fullsized":"2024-09-10T23:16:09.210608+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:27.410153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209052+0000","last_change":"2024-09-10T23:16:07.237259+0000","last_active":"2024-09-10T23:16:09.209052+0000","last_peered":"2024-09-10T23:16:09.209052+0000","last_clean":"2024-09-10T23:16:09.209052+0000","last_became_active":"2024-09-10T23:16:07.236983+0000","last_became_peered":"2024-09-10T23:16:07.236983+0000","last_unstale":"2024-09-10T23:16:09.209052+0000","last_undegraded":"2024-09-10T23:16:09.209052+0000","last_fullsized":"2024-09-10T23:16:09.209052+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:10.006129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210651+0000","last_change":"2024-09-10T23:16:08.217212+0000","last_active":"2024-09-10T23:16:09.210651+0000","last_peered":"2024-09-10T23:16:09.210651+0000","last_clean":"2024-09-10T23:16:09.210651+0000","last_became_active":"2024-09-10T23:16:08.216808+0000","last_became_peered":"2024-09-10T23:16:08.216808+0000","last_unstale":"2024-09-10T23:16:09.210651+0000","last_undegraded":"2024-09-10T23:16:09.210651+0000","last_fullsized":"2024-09-10T23:16:09.210651+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:03.228388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.206582+0000","last_change":"2024-09-10T23:16:07.243334+0000","last_active":"2024-09-10T23:16:08.206582+0000","last_peered":"2024-09-10T23:16:08.206582+0000","last_clean":"2024-09-10T23:16:08.206582+0000","last_became_active":"2024-09-10T23:16:07.243016+0000","last_became_peered":"2024-09-10T23:16:07.243016+0000","last_unstale":"2024-09-10T23:16:08.206582+0000","last_undegraded":"2024-09-10T23:16:08.206582+0000","last_fullsized":"2024-09-10T23:16:08.206582+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:05.470182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.208942+0000","last_change":"2024-09-10T23:16:08.218782+0000","last_active":"2024-09-10T23:16:09.208942+0000","last_peered":"2024-09-10T23:16:09.208942+0000","last_clean":"2024-09-10T23:16:09.208942+0000","last_became_active":"2024-09-10T23:16:08.217288+0000","last_became_peered":"2024-09-10T23:16:08.217288+0000","last_unstale":"2024-09-10T23:16:09.208942+0000","last_undegraded":"2024-09-10T23:16:09.208942+0000","last_fullsized":"2024-09-10T23:16:09.208942+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:25.080754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209975+0000","last_change":"2024-09-10T23:16:07.243591+0000","last_active":"2024-09-10T23:16:09.209975+0000","last_peered":"2024-09-10T23:16:09.209975+0000","last_clean":"2024-09-10T23:16:09.209975+0000","last_became_active":"2024-09-10T23:16:07.243135+0000","last_became_peered":"2024-09-10T23:16:07.243135+0000","last_unstale":"2024-09-10T23:16:09.209975+0000","last_undegraded":"2024-09-10T23:16:09.209975+0000","last_fullsized":"2024-09-10T23:16:09.209975+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:16.706730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:16:08.226264+0000","last_change":"2024-09-10T23:16:08.216683+0000","last_active":"2024-09-10T23:16:08.226264+0000","last_peered":"2024-09-10T23:16:08.226264+0000","last_clean":"2024-09-10T23:16:08.226264+0000","last_became_active":"2024-09-10T23:16:08.216398+0000","last_became_peered":"2024-09-10T23:16:08.216398+0000","last_unstale":"2024-09-10T23:16:08.226264+0000","last_undegraded":"2024-09-10T23:16:08.226264+0000","last_fullsized":"2024-09-10T23:16:08.226264+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:44.092540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.211119+0000","last_change":"2024-09-10T23:16:07.244150+0000","last_active":"2024-09-10T23:16:09.211119+0000","last_peered":"2024-09-10T23:16:09.211119+0000","last_clean":"2024-09-10T23:16:09.211119+0000","last_became_active":"2024-09-10T23:16:07.243818+0000","last_became_peered":"2024-09-10T23:16:07.243818+0000","last_unstale":"2024-09-10T23:16:09.211119+0000","last_undegraded":"2024-09-10T23:16:09.211119+0000","last_fullsized":"2024-09-10T23:16:09.211119+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:53.790347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262465+0000","last_change":"2024-09-10T23:16:08.218204+0000","last_active":"2024-09-10T23:16:10.262465+0000","last_peered":"2024-09-10T23:16:10.262465+0000","last_clean":"2024-09-10T23:16:10.262465+0000","last_became_active":"2024-09-10T23:16:08.217921+0000","last_became_peered":"2024-09-10T23:16:08.217921+0000","last_unstale":"2024-09-10T23:16:10.262465+0000","last_undegraded":"2024-09-10T23:16:10.262465+0000","last_fullsized":"2024-09-10T23:16:10.262465+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:51.387433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.208726+0000","last_change":"2024-09-10T23:16:07.246842+0000","last_active":"2024-09-10T23:16:09.208726+0000","last_peered":"2024-09-10T23:16:09.208726+0000","last_clean":"2024-09-10T23:16:09.208726+0000","last_became_active":"2024-09-10T23:16:07.246594+0000","last_became_peered":"2024-09-10T23:16:07.246594+0000","last_unstale":"2024-09-10T23:16:09.208726+0000","last_undegraded":"2024-09-10T23:16:09.208726+0000","last_fullsized":"2024-09-10T23:16:09.208726+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:20.115661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262449+0000","last_change":"2024-09-10T23:16:08.224091+0000","last_active":"2024-09-10T23:16:10.262449+0000","last_peered":"2024-09-10T23:16:10.262449+0000","last_clean":"2024-09-10T23:16:10.262449+0000","last_became_active":"2024-09-10T23:16:08.223208+0000","last_became_peered":"2024-09-10T23:16:08.223208+0000","last_unstale":"2024-09-10T23:16:10.262449+0000","last_undegraded":"2024-09-10T23:16:10.262449+0000","last_fullsized":"2024-09-10T23:16:10.262449+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:21.692908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261646+0000","last_change":"2024-09-10T23:16:07.246764+0000","last_active":"2024-09-10T23:16:10.261646+0000","last_peered":"2024-09-10T23:16:10.261646+0000","last_clean":"2024-09-10T23:16:10.261646+0000","last_became_active":"2024-09-10T23:16:07.246492+0000","last_became_peered":"2024-09-10T23:16:07.246492+0000","last_unstale":"2024-09-10T23:16:10.261646+0000","last_undegraded":"2024-09-10T23:16:10.261646+0000","last_fullsized":"2024-09-10T23:16:10.261646+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:48.760684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.208702+0000","last_change":"2024-09-10T23:16:08.217894+0000","last_active":"2024-09-10T23:16:09.208702+0000","last_peered":"2024-09-10T23:16:09.208702+0000","last_clean":"2024-09-10T23:16:09.208702+0000","last_became_active":"2024-09-10T23:16:08.217632+0000","last_became_peered":"2024-09-10T23:16:08.217632+0000","last_unstale":"2024-09-10T23:16:09.208702+0000","last_undegraded":"2024-09-10T23:16:09.208702+0000","last_fullsized":"2024-09-10T23:16:09.208702+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:22.728080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.208653+0000","last_change":"2024-09-10T23:16:07.245294+0000","last_active":"2024-09-10T23:16:09.208653+0000","last_peered":"2024-09-10T23:16:09.208653+0000","last_clean":"2024-09-10T23:16:09.208653+0000","last_became_active":"2024-09-10T23:16:07.245035+0000","last_became_peered":"2024-09-10T23:16:07.245035+0000","last_unstale":"2024-09-10T23:16:09.208653+0000","last_undegraded":"2024-09-10T23:16:09.208653+0000","last_fullsized":"2024-09-10T23:16:09.208653+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:27.666822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262006+0000","last_change":"2024-09-10T23:16:08.218638+0000","last_active":"2024-09-10T23:16:10.262006+0000","last_peered":"2024-09-10T23:16:10.262006+0000","last_clean":"2024-09-10T23:16:10.262006+0000","last_became_active":"2024-09-10T23:16:08.218381+0000","last_became_peered":"2024-09-10T23:16:08.218381+0000","last_unstale":"2024-09-10T23:16:10.262006+0000","last_undegraded":"2024-09-10T23:16:10.262006+0000","last_fullsized":"2024-09-10T23:16:10.262006+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:54.606307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262009+0000","last_change":"2024-09-10T23:16:07.247138+0000","last_active":"2024-09-10T23:16:10.262009+0000","last_peered":"2024-09-10T23:16:10.262009+0000","last_clean":"2024-09-10T23:16:10.262009+0000","last_became_active":"2024-09-10T23:16:07.246657+0000","last_became_peered":"2024-09-10T23:16:07.246657+0000","last_unstale":"2024-09-10T23:16:10.262009+0000","last_undegraded":"2024-09-10T23:16:10.262009+0000","last_fullsized":"2024-09-10T23:16:10.262009+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:26.406472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261899+0000","last_change":"2024-09-10T23:16:08.227513+0000","last_active":"2024-09-10T23:16:10.261899+0000","last_peered":"2024-09-10T23:16:10.261899+0000","last_clean":"2024-09-10T23:16:10.261899+0000","last_became_active":"2024-09-10T23:16:08.227238+0000","last_became_peered":"2024-09-10T23:16:08.227238+0000","last_unstale":"2024-09-10T23:16:10.261899+0000","last_undegraded":"2024-09-10T23:16:10.261899+0000","last_fullsized":"2024-09-10T23:16:10.261899+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:45.047866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209752+0000","last_change":"2024-09-10T23:16:07.244949+0000","last_active":"2024-09-10T23:16:09.209752+0000","last_peered":"2024-09-10T23:16:09.209752+0000","last_clean":"2024-09-10T23:16:09.209752+0000","last_became_active":"2024-09-10T23:16:07.244622+0000","last_became_peered":"2024-09-10T23:16:07.244622+0000","last_unstale":"2024-09-10T23:16:09.209752+0000","last_undegraded":"2024-09-10T23:16:09.209752+0000","last_fullsized":"2024-09-10T23:16:09.209752+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:27.666822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":170,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262619+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:16:10.262619+0000","last_peered":"2024-09-10T23:16:10.262619+0000","last_clean":"2024-09-10T23:16:10.262619+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:16:10.262619+0000","last_undegraded":"2024-09-10T23:16:10.262619+0000","last_fullsized":"2024-09-10T23:16:10.262619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1277952,"data_stored":866654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":675840,"data_stored":276126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":276778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509464,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":675840,"data_stored":271438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":269882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":276182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":679936,"data_stored":276216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1273856,"data_stored":862388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:16:15.556 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:16:15.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.669+0000 7f62b9416640 1 -- 172.21.15.90:0/2693272279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62a0003a00 msgr2=0x7f62a0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:15.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.669+0000 7f62b9416640 1 --2- 172.21.15.90:0/2693272279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62a0003a00 0x7f62a0003e20 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009b50 tx=0x7f62a0005830 comp rx=0 tx=0).stop 2024-09-10T23:16:15.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.669+0000 7f62b37fe640 1 -- 172.21.15.90:0/2693272279 reap_dead start 2024-09-10T23:16:15.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.669+0000 7f62b9416640 1 -- 172.21.15.90:0/2693272279 shutdown_connections 2024-09-10T23:16:15.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.669+0000 7f62b9416640 1 -- 172.21.15.90:0/2693272279 >> 172.21.15.90:0/2693272279 conn(0x7f62b409d2a0 msgr2=0x7f62b40d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:15.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.669+0000 7f62b9416640 1 -- 172.21.15.90:0/2693272279 shutdown_connections 2024-09-10T23:16:15.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.669+0000 7f62b9416640 1 -- 172.21.15.90:0/2693272279 wait complete. 2024-09-10T23:16:15.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.670+0000 7f62b9416640 1 Processor -- start 2024-09-10T23:16:15.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.670+0000 7f62b9416640 1 -- start start 2024-09-10T23:16:15.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.671+0000 7f62b9416640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62a0003a00 0x7f62b40c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:15.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.671+0000 7f62b9416640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62b41f4110 0x7f62b40b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:15.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.671+0000 7f62b9416640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b40b1c30 0x7f62b40b90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:15.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.671+0000 7f62b9416640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f62b415e4a0 con 0x7f62b40b1c30 2024-09-10T23:16:15.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.671+0000 7f62b9416640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f62b415e320 con 0x7f62a0003a00 2024-09-10T23:16:15.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.671+0000 7f62b9416640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f62b40b4a10 con 0x7f62b41f4110 2024-09-10T23:16:15.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.671+0000 7f62b37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b40b1c30 0x7f62b40b90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.671+0000 7f62b37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b40b1c30 0x7f62b40b90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54376/0 (socket says 172.21.15.90:54376) 2024-09-10T23:16:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.671+0000 7f62b37fe640 1 -- 172.21.15.90:0/4007055148 learned_addr learned my addr 172.21.15.90:0/4007055148 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.671+0000 7f62b2ffd640 1 --2- 172.21.15.90:0/4007055148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62a0003a00 0x7f62b40c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.671+0000 7f62b27fc640 1 --2- 172.21.15.90:0/4007055148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62b41f4110 0x7f62b40b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.672+0000 7f62b37fe640 1 -- 172.21.15.90:0/4007055148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62b41f4110 msgr2=0x7f62b40b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.672+0000 7f62b37fe640 1 --2- 172.21.15.90:0/4007055148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62b41f4110 0x7f62b40b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.672+0000 7f62b37fe640 1 -- 172.21.15.90:0/4007055148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62a0003a00 msgr2=0x7f62b40c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.672+0000 7f62b37fe640 1 --2- 172.21.15.90:0/4007055148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62a0003a00 0x7f62b40c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.672+0000 7f62b37fe640 1 -- 172.21.15.90:0/4007055148 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b41f81d0 con 0x7f62b40b1c30 2024-09-10T23:16:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.672+0000 7f62b37fe640 1 --2- 172.21.15.90:0/4007055148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b40b1c30 0x7f62b40b90a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f62b40b6c90 tx=0x7f62ac0064e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.672+0000 7f62ab7fe640 1 -- 172.21.15.90:0/4007055148 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac015020 con 0x7f62b40b1c30 2024-09-10T23:16:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.672+0000 7f62ab7fe640 1 -- 172.21.15.90:0/4007055148 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62ac010980 con 0x7f62b40b1c30 2024-09-10T23:16:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.672+0000 7f62b9416640 1 -- 172.21.15.90:0/4007055148 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b41f84b0 con 0x7f62b40b1c30 2024-09-10T23:16:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.672+0000 7f62ab7fe640 1 -- 172.21.15.90:0/4007055148 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac010dd0 con 0x7f62b40b1c30 2024-09-10T23:16:15.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.672+0000 7f62b9416640 1 -- 172.21.15.90:0/4007055148 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b41f8a70 con 0x7f62b40b1c30 2024-09-10T23:16:15.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.673+0000 7f62b9416640 1 -- 172.21.15.90:0/4007055148 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62b40d17e0 con 0x7f62b40b1c30 2024-09-10T23:16:15.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.673+0000 7f62ab7fe640 1 -- 172.21.15.90:0/4007055148 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f62ac011460 con 0x7f62b40b1c30 2024-09-10T23:16:15.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.674+0000 7f62ab7fe640 1 --2- 172.21.15.90:0/4007055148 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6294077fa0 0x7f629407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:15.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.674+0000 7f62ab7fe640 1 -- 172.21.15.90:0/4007055148 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f62ac09aae0 con 0x7f62b40b1c30 2024-09-10T23:16:15.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.674+0000 7f62b2ffd640 1 --2- 172.21.15.90:0/4007055148 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6294077fa0 0x7f629407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:15.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.675+0000 7f62b2ffd640 1 --2- 172.21.15.90:0/4007055148 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6294077fa0 0x7f629407a460 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f62a4035000 tx=0x7f62a402d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:15.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.678+0000 7f62ab7fe640 1 -- 172.21.15.90:0/4007055148 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f62ac01f020 con 0x7f62b40b1c30 2024-09-10T23:16:15.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.851+0000 7f62b9416640 1 -- 172.21.15.90:0/4007055148 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f62b40cbc00 con 0x7f6294077fa0 2024-09-10T23:16:15.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.856+0000 7f62ab7fe640 1 -- 172.21.15.90:0/4007055148 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251931 (secure 0 0 0) 0x7f62b40cbc00 con 0x7f6294077fa0 2024-09-10T23:16:15.859 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:15.861 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:16:15.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.859+0000 7f62b9416640 1 -- 172.21.15.90:0/4007055148 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6294077fa0 msgr2=0x7f629407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:15.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.859+0000 7f62b9416640 1 --2- 172.21.15.90:0/4007055148 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6294077fa0 0x7f629407a460 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f62a4035000 tx=0x7f62a402d040 comp rx=0 tx=0).stop 2024-09-10T23:16:15.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.859+0000 7f62b9416640 1 -- 172.21.15.90:0/4007055148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b40b1c30 msgr2=0x7f62b40b90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:15.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.859+0000 7f62b9416640 1 --2- 172.21.15.90:0/4007055148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b40b1c30 0x7f62b40b90a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f62b40b6c90 tx=0x7f62ac0064e0 comp rx=0 tx=0).stop 2024-09-10T23:16:15.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.859+0000 7f62b9416640 1 -- 172.21.15.90:0/4007055148 shutdown_connections 2024-09-10T23:16:15.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.859+0000 7f62b9416640 1 --2- 172.21.15.90:0/4007055148 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6294077fa0 0x7f629407a460 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:15.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.859+0000 7f62b9416640 1 --2- 172.21.15.90:0/4007055148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b40b1c30 0x7f62b40b90a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:15.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.859+0000 7f62b9416640 1 --2- 172.21.15.90:0/4007055148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62b41f4110 0x7f62b40b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:15.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.859+0000 7f62b9416640 1 --2- 172.21.15.90:0/4007055148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62a0003a00 0x7f62b40c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:15.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.859+0000 7f62b9416640 1 -- 172.21.15.90:0/4007055148 >> 172.21.15.90:0/4007055148 conn(0x7f62b409d2a0 msgr2=0x7f62b4160730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:15.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.859+0000 7f62b9416640 1 -- 172.21.15.90:0/4007055148 shutdown_connections 2024-09-10T23:16:15.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:15.859+0000 7f62b9416640 1 -- 172.21.15.90:0/4007055148 wait complete. 2024-09-10T23:16:15.871 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-09-10T23:16:14.455495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226872,"kb_used_data":6480,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747848,"statfs":{"total":773094113280,"available":772861796352,"internally_reserved":0,"allocated":6635520,"data_stored":3381964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.223408"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262019+0000","last_change":"2024-09-10T23:16:08.221745+0000","last_active":"2024-09-10T23:16:10.262019+0000","last_peered":"2024-09-10T23:16:10.262019+0000","last_clean":"2024-09-10T23:16:10.262019+0000","last_became_active":"2024-09-10T23:16:08.220693+0000","last_became_peered":"2024-09-10T23:16:08.220693+0000","last_unstale":"2024-09-10T23:16:10.262019+0000","last_undegraded":"2024-09-10T23:16:10.262019+0000","last_fullsized":"2024-09-10T23:16:10.262019+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:49.939329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262419+0000","last_change":"2024-09-10T23:16:08.221371+0000","last_active":"2024-09-10T23:16:10.262419+0000","last_peered":"2024-09-10T23:16:10.262419+0000","last_clean":"2024-09-10T23:16:10.262419+0000","last_became_active":"2024-09-10T23:16:08.221107+0000","last_became_peered":"2024-09-10T23:16:08.221107+0000","last_unstale":"2024-09-10T23:16:10.262419+0000","last_undegraded":"2024-09-10T23:16:10.262419+0000","last_fullsized":"2024-09-10T23:16:10.262419+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:14.283540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262622+0000","last_change":"2024-09-10T23:16:08.223915+0000","last_active":"2024-09-10T23:16:10.262622+0000","last_peered":"2024-09-10T23:16:10.262622+0000","last_clean":"2024-09-10T23:16:10.262622+0000","last_became_active":"2024-09-10T23:16:08.222976+0000","last_became_peered":"2024-09-10T23:16:08.222976+0000","last_unstale":"2024-09-10T23:16:10.262622+0000","last_undegraded":"2024-09-10T23:16:10.262622+0000","last_fullsized":"2024-09-10T23:16:10.262622+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:28.712258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.211016+0000","last_change":"2024-09-10T23:16:08.221738+0000","last_active":"2024-09-10T23:16:09.211016+0000","last_peered":"2024-09-10T23:16:09.211016+0000","last_clean":"2024-09-10T23:16:09.211016+0000","last_became_active":"2024-09-10T23:16:08.221475+0000","last_became_peered":"2024-09-10T23:16:08.221475+0000","last_unstale":"2024-09-10T23:16:09.211016+0000","last_undegraded":"2024-09-10T23:16:09.211016+0000","last_fullsized":"2024-09-10T23:16:09.211016+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:34.031526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262029+0000","last_change":"2024-09-10T23:16:08.218292+0000","last_active":"2024-09-10T23:16:10.262029+0000","last_peered":"2024-09-10T23:16:10.262029+0000","last_clean":"2024-09-10T23:16:10.262029+0000","last_became_active":"2024-09-10T23:16:08.217972+0000","last_became_peered":"2024-09-10T23:16:08.217972+0000","last_unstale":"2024-09-10T23:16:10.262029+0000","last_undegraded":"2024-09-10T23:16:10.262029+0000","last_fullsized":"2024-09-10T23:16:10.262029+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:15.373698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.327809+0000","last_change":"2024-09-10T23:16:08.224593+0000","last_active":"2024-09-10T23:16:09.327809+0000","last_peered":"2024-09-10T23:16:09.327809+0000","last_clean":"2024-09-10T23:16:09.327809+0000","last_became_active":"2024-09-10T23:16:08.224309+0000","last_became_peered":"2024-09-10T23:16:08.224309+0000","last_unstale":"2024-09-10T23:16:09.327809+0000","last_undegraded":"2024-09-10T23:16:09.327809+0000","last_fullsized":"2024-09-10T23:16:09.327809+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:20.736574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262629+0000","last_change":"2024-09-10T23:16:08.217936+0000","last_active":"2024-09-10T23:16:10.262629+0000","last_peered":"2024-09-10T23:16:10.262629+0000","last_clean":"2024-09-10T23:16:10.262629+0000","last_became_active":"2024-09-10T23:16:08.217668+0000","last_became_peered":"2024-09-10T23:16:08.217668+0000","last_unstale":"2024-09-10T23:16:10.262629+0000","last_undegraded":"2024-09-10T23:16:10.262629+0000","last_fullsized":"2024-09-10T23:16:10.262629+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:37.028734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261703+0000","last_change":"2024-09-10T23:16:08.223317+0000","last_active":"2024-09-10T23:16:10.261703+0000","last_peered":"2024-09-10T23:16:10.261703+0000","last_clean":"2024-09-10T23:16:10.261703+0000","last_became_active":"2024-09-10T23:16:08.223020+0000","last_became_peered":"2024-09-10T23:16:08.223020+0000","last_unstale":"2024-09-10T23:16:10.261703+0000","last_undegraded":"2024-09-10T23:16:10.261703+0000","last_fullsized":"2024-09-10T23:16:10.261703+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:22.041624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262254+0000","last_change":"2024-09-10T23:16:08.215544+0000","last_active":"2024-09-10T23:16:10.262254+0000","last_peered":"2024-09-10T23:16:10.262254+0000","last_clean":"2024-09-10T23:16:10.262254+0000","last_became_active":"2024-09-10T23:16:08.215261+0000","last_became_peered":"2024-09-10T23:16:08.215261+0000","last_unstale":"2024-09-10T23:16:10.262254+0000","last_undegraded":"2024-09-10T23:16:10.262254+0000","last_fullsized":"2024-09-10T23:16:10.262254+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:35.429144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209018+0000","last_change":"2024-09-10T23:16:08.215858+0000","last_active":"2024-09-10T23:16:09.209018+0000","last_peered":"2024-09-10T23:16:09.209018+0000","last_clean":"2024-09-10T23:16:09.209018+0000","last_became_active":"2024-09-10T23:16:08.215511+0000","last_became_peered":"2024-09-10T23:16:08.215511+0000","last_unstale":"2024-09-10T23:16:09.209018+0000","last_undegraded":"2024-09-10T23:16:09.209018+0000","last_fullsized":"2024-09-10T23:16:09.209018+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:21.981991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209145+0000","last_change":"2024-09-10T23:16:08.220980+0000","last_active":"2024-09-10T23:16:09.209145+0000","last_peered":"2024-09-10T23:16:09.209145+0000","last_clean":"2024-09-10T23:16:09.209145+0000","last_became_active":"2024-09-10T23:16:08.220709+0000","last_became_peered":"2024-09-10T23:16:08.220709+0000","last_unstale":"2024-09-10T23:16:09.209145+0000","last_undegraded":"2024-09-10T23:16:09.209145+0000","last_fullsized":"2024-09-10T23:16:09.209145+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:17:06.123113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.211028+0000","last_change":"2024-09-10T23:16:08.216936+0000","last_active":"2024-09-10T23:16:09.211028+0000","last_peered":"2024-09-10T23:16:09.211028+0000","last_clean":"2024-09-10T23:16:09.211028+0000","last_became_active":"2024-09-10T23:16:08.216650+0000","last_became_peered":"2024-09-10T23:16:08.216650+0000","last_unstale":"2024-09-10T23:16:09.211028+0000","last_undegraded":"2024-09-10T23:16:09.211028+0000","last_fullsized":"2024-09-10T23:16:09.211028+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:48.800232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210160+0000","last_change":"2024-09-10T23:16:08.226117+0000","last_active":"2024-09-10T23:16:09.210160+0000","last_peered":"2024-09-10T23:16:09.210160+0000","last_clean":"2024-09-10T23:16:09.210160+0000","last_became_active":"2024-09-10T23:16:08.225805+0000","last_became_peered":"2024-09-10T23:16:08.225805+0000","last_unstale":"2024-09-10T23:16:09.210160+0000","last_undegraded":"2024-09-10T23:16:09.210160+0000","last_fullsized":"2024-09-10T23:16:09.210160+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:21.571049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262631+0000","last_change":"2024-09-10T23:16:08.224422+0000","last_active":"2024-09-10T23:16:10.262631+0000","last_peered":"2024-09-10T23:16:10.262631+0000","last_clean":"2024-09-10T23:16:10.262631+0000","last_became_active":"2024-09-10T23:16:08.224175+0000","last_became_peered":"2024-09-10T23:16:08.224175+0000","last_unstale":"2024-09-10T23:16:10.262631+0000","last_undegraded":"2024-09-10T23:16:10.262631+0000","last_fullsized":"2024-09-10T23:16:10.262631+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:03.425760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262261+0000","last_change":"2024-09-10T23:16:08.219482+0000","last_active":"2024-09-10T23:16:10.262261+0000","last_peered":"2024-09-10T23:16:10.262261+0000","last_clean":"2024-09-10T23:16:10.262261+0000","last_became_active":"2024-09-10T23:16:08.219123+0000","last_became_peered":"2024-09-10T23:16:08.219123+0000","last_unstale":"2024-09-10T23:16:10.262261+0000","last_undegraded":"2024-09-10T23:16:10.262261+0000","last_fullsized":"2024-09-10T23:16:10.262261+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:52.313487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.327718+0000","last_change":"2024-09-10T23:16:08.218867+0000","last_active":"2024-09-10T23:16:09.327718+0000","last_peered":"2024-09-10T23:16:09.327718+0000","last_clean":"2024-09-10T23:16:09.327718+0000","last_became_active":"2024-09-10T23:16:08.218629+0000","last_became_peered":"2024-09-10T23:16:08.218629+0000","last_unstale":"2024-09-10T23:16:09.327718+0000","last_undegraded":"2024-09-10T23:16:09.327718+0000","last_fullsized":"2024-09-10T23:16:09.327718+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:46:04.585893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262331+0000","last_change":"2024-09-10T23:16:08.220361+0000","last_active":"2024-09-10T23:16:10.262331+0000","last_peered":"2024-09-10T23:16:10.262331+0000","last_clean":"2024-09-10T23:16:10.262331+0000","last_became_active":"2024-09-10T23:16:08.220077+0000","last_became_peered":"2024-09-10T23:16:08.220077+0000","last_unstale":"2024-09-10T23:16:10.262331+0000","last_undegraded":"2024-09-10T23:16:10.262331+0000","last_fullsized":"2024-09-10T23:16:10.262331+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:44.112275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262522+0000","last_change":"2024-09-10T23:16:08.226182+0000","last_active":"2024-09-10T23:16:10.262522+0000","last_peered":"2024-09-10T23:16:10.262522+0000","last_clean":"2024-09-10T23:16:10.262522+0000","last_became_active":"2024-09-10T23:16:08.225727+0000","last_became_peered":"2024-09-10T23:16:08.225727+0000","last_unstale":"2024-09-10T23:16:10.262522+0000","last_undegraded":"2024-09-10T23:16:10.262522+0000","last_fullsized":"2024-09-10T23:16:10.262522+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:02.104576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261850+0000","last_change":"2024-09-10T23:16:08.221264+0000","last_active":"2024-09-10T23:16:10.261850+0000","last_peered":"2024-09-10T23:16:10.261850+0000","last_clean":"2024-09-10T23:16:10.261850+0000","last_became_active":"2024-09-10T23:16:08.220962+0000","last_became_peered":"2024-09-10T23:16:08.220962+0000","last_unstale":"2024-09-10T23:16:10.261850+0000","last_undegraded":"2024-09-10T23:16:10.261850+0000","last_fullsized":"2024-09-10T23:16:10.261850+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:06.022447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262538+0000","last_change":"2024-09-10T23:16:08.227508+0000","last_active":"2024-09-10T23:16:10.262538+0000","last_peered":"2024-09-10T23:16:10.262538+0000","last_clean":"2024-09-10T23:16:10.262538+0000","last_became_active":"2024-09-10T23:16:08.227234+0000","last_became_peered":"2024-09-10T23:16:08.227234+0000","last_unstale":"2024-09-10T23:16:10.262538+0000","last_undegraded":"2024-09-10T23:16:10.262538+0000","last_fullsized":"2024-09-10T23:16:10.262538+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:39.876694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261769+0000","last_change":"2024-09-10T23:16:08.219867+0000","last_active":"2024-09-10T23:16:10.261769+0000","last_peered":"2024-09-10T23:16:10.261769+0000","last_clean":"2024-09-10T23:16:10.261769+0000","last_became_active":"2024-09-10T23:16:08.219560+0000","last_became_peered":"2024-09-10T23:16:08.219560+0000","last_unstale":"2024-09-10T23:16:10.261769+0000","last_undegraded":"2024-09-10T23:16:10.261769+0000","last_fullsized":"2024-09-10T23:16:10.261769+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:27.410153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261934+0000","last_change":"2024-09-10T23:16:08.225757+0000","last_active":"2024-09-10T23:16:10.261934+0000","last_peered":"2024-09-10T23:16:10.261934+0000","last_clean":"2024-09-10T23:16:10.261934+0000","last_became_active":"2024-09-10T23:16:08.225222+0000","last_became_peered":"2024-09-10T23:16:08.225222+0000","last_unstale":"2024-09-10T23:16:10.261934+0000","last_undegraded":"2024-09-10T23:16:10.261934+0000","last_fullsized":"2024-09-10T23:16:10.261934+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:46.972942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262556+0000","last_change":"2024-09-10T23:16:08.223165+0000","last_active":"2024-09-10T23:16:10.262556+0000","last_peered":"2024-09-10T23:16:10.262556+0000","last_clean":"2024-09-10T23:16:10.262556+0000","last_became_active":"2024-09-10T23:16:08.222819+0000","last_became_peered":"2024-09-10T23:16:08.222819+0000","last_unstale":"2024-09-10T23:16:10.262556+0000","last_undegraded":"2024-09-10T23:16:10.262556+0000","last_fullsized":"2024-09-10T23:16:10.262556+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:10.789779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210565+0000","last_change":"2024-09-10T23:16:08.226150+0000","last_active":"2024-09-10T23:16:09.210565+0000","last_peered":"2024-09-10T23:16:09.210565+0000","last_clean":"2024-09-10T23:16:09.210565+0000","last_became_active":"2024-09-10T23:16:08.225845+0000","last_became_peered":"2024-09-10T23:16:08.225845+0000","last_unstale":"2024-09-10T23:16:09.210565+0000","last_undegraded":"2024-09-10T23:16:09.210565+0000","last_fullsized":"2024-09-10T23:16:09.210565+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:53.459435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261990+0000","last_change":"2024-09-10T23:16:08.219668+0000","last_active":"2024-09-10T23:16:10.261990+0000","last_peered":"2024-09-10T23:16:10.261990+0000","last_clean":"2024-09-10T23:16:10.261990+0000","last_became_active":"2024-09-10T23:16:08.219383+0000","last_became_peered":"2024-09-10T23:16:08.219383+0000","last_unstale":"2024-09-10T23:16:10.261990+0000","last_undegraded":"2024-09-10T23:16:10.261990+0000","last_fullsized":"2024-09-10T23:16:10.261990+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:53.990780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210406+0000","last_change":"2024-09-10T23:16:08.214264+0000","last_active":"2024-09-10T23:16:09.210406+0000","last_peered":"2024-09-10T23:16:09.210406+0000","last_clean":"2024-09-10T23:16:09.210406+0000","last_became_active":"2024-09-10T23:16:08.213994+0000","last_became_peered":"2024-09-10T23:16:08.213994+0000","last_unstale":"2024-09-10T23:16:09.210406+0000","last_undegraded":"2024-09-10T23:16:09.210406+0000","last_fullsized":"2024-09-10T23:16:09.210406+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:22.656611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.328159+0000","last_change":"2024-09-10T23:16:08.219112+0000","last_active":"2024-09-10T23:16:09.328159+0000","last_peered":"2024-09-10T23:16:09.328159+0000","last_clean":"2024-09-10T23:16:09.328159+0000","last_became_active":"2024-09-10T23:16:08.218847+0000","last_became_peered":"2024-09-10T23:16:08.218847+0000","last_unstale":"2024-09-10T23:16:09.328159+0000","last_undegraded":"2024-09-10T23:16:09.328159+0000","last_fullsized":"2024-09-10T23:16:09.328159+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:56.811017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261944+0000","last_change":"2024-09-10T23:16:08.218973+0000","last_active":"2024-09-10T23:16:10.261944+0000","last_peered":"2024-09-10T23:16:10.261944+0000","last_clean":"2024-09-10T23:16:10.261944+0000","last_became_active":"2024-09-10T23:16:08.218660+0000","last_became_peered":"2024-09-10T23:16:08.218660+0000","last_unstale":"2024-09-10T23:16:10.261944+0000","last_undegraded":"2024-09-10T23:16:10.261944+0000","last_fullsized":"2024-09-10T23:16:10.261944+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:00.308208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262375+0000","last_change":"2024-09-10T23:16:08.217652+0000","last_active":"2024-09-10T23:16:10.262375+0000","last_peered":"2024-09-10T23:16:10.262375+0000","last_clean":"2024-09-10T23:16:10.262375+0000","last_became_active":"2024-09-10T23:16:08.217347+0000","last_became_peered":"2024-09-10T23:16:08.217347+0000","last_unstale":"2024-09-10T23:16:10.262375+0000","last_undegraded":"2024-09-10T23:16:10.262375+0000","last_fullsized":"2024-09-10T23:16:10.262375+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:35.291935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262011+0000","last_change":"2024-09-10T23:16:08.222602+0000","last_active":"2024-09-10T23:16:10.262011+0000","last_peered":"2024-09-10T23:16:10.262011+0000","last_clean":"2024-09-10T23:16:10.262011+0000","last_became_active":"2024-09-10T23:16:08.222137+0000","last_became_peered":"2024-09-10T23:16:08.222137+0000","last_unstale":"2024-09-10T23:16:10.262011+0000","last_undegraded":"2024-09-10T23:16:10.262011+0000","last_fullsized":"2024-09-10T23:16:10.262011+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:03.228388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261645+0000","last_change":"2024-09-10T23:16:08.220495+0000","last_active":"2024-09-10T23:16:10.261645+0000","last_peered":"2024-09-10T23:16:10.261645+0000","last_clean":"2024-09-10T23:16:10.261645+0000","last_became_active":"2024-09-10T23:16:08.220175+0000","last_became_peered":"2024-09-10T23:16:08.220175+0000","last_unstale":"2024-09-10T23:16:10.261645+0000","last_undegraded":"2024-09-10T23:16:10.261645+0000","last_fullsized":"2024-09-10T23:16:10.261645+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:03.264573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.327786+0000","last_change":"2024-09-10T23:16:08.221753+0000","last_active":"2024-09-10T23:16:09.327786+0000","last_peered":"2024-09-10T23:16:09.327786+0000","last_clean":"2024-09-10T23:16:09.327786+0000","last_became_active":"2024-09-10T23:16:08.221468+0000","last_became_peered":"2024-09-10T23:16:08.221468+0000","last_unstale":"2024-09-10T23:16:09.327786+0000","last_undegraded":"2024-09-10T23:16:09.327786+0000","last_fullsized":"2024-09-10T23:16:09.327786+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:21.481875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.328301+0000","last_change":"2024-09-10T23:16:08.218653+0000","last_active":"2024-09-10T23:16:09.328301+0000","last_peered":"2024-09-10T23:16:09.328301+0000","last_clean":"2024-09-10T23:16:09.328301+0000","last_became_active":"2024-09-10T23:16:08.218413+0000","last_became_peered":"2024-09-10T23:16:08.218413+0000","last_unstale":"2024-09-10T23:16:09.328301+0000","last_undegraded":"2024-09-10T23:16:09.328301+0000","last_fullsized":"2024-09-10T23:16:09.328301+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:57.785810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.328297+0000","last_change":"2024-09-10T23:16:07.243432+0000","last_active":"2024-09-10T23:16:09.328297+0000","last_peered":"2024-09-10T23:16:09.328297+0000","last_clean":"2024-09-10T23:16:09.328297+0000","last_became_active":"2024-09-10T23:16:07.243177+0000","last_became_peered":"2024-09-10T23:16:07.243177+0000","last_unstale":"2024-09-10T23:16:09.328297+0000","last_undegraded":"2024-09-10T23:16:09.328297+0000","last_fullsized":"2024-09-10T23:16:09.328297+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:53.240170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209042+0000","last_change":"2024-09-10T23:16:08.220835+0000","last_active":"2024-09-10T23:16:09.209042+0000","last_peered":"2024-09-10T23:16:09.209042+0000","last_clean":"2024-09-10T23:16:09.209042+0000","last_became_active":"2024-09-10T23:16:08.220555+0000","last_became_peered":"2024-09-10T23:16:08.220555+0000","last_unstale":"2024-09-10T23:16:09.209042+0000","last_undegraded":"2024-09-10T23:16:09.209042+0000","last_fullsized":"2024-09-10T23:16:09.209042+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:49.764365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262378+0000","last_change":"2024-09-10T23:16:07.247199+0000","last_active":"2024-09-10T23:16:10.262378+0000","last_peered":"2024-09-10T23:16:10.262378+0000","last_clean":"2024-09-10T23:16:10.262378+0000","last_became_active":"2024-09-10T23:16:07.246886+0000","last_became_peered":"2024-09-10T23:16:07.246886+0000","last_unstale":"2024-09-10T23:16:10.262378+0000","last_undegraded":"2024-09-10T23:16:10.262378+0000","last_fullsized":"2024-09-10T23:16:10.262378+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:14.931355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.328155+0000","last_change":"2024-09-10T23:16:08.220183+0000","last_active":"2024-09-10T23:16:09.328155+0000","last_peered":"2024-09-10T23:16:09.328155+0000","last_clean":"2024-09-10T23:16:09.328155+0000","last_became_active":"2024-09-10T23:16:08.219931+0000","last_became_peered":"2024-09-10T23:16:08.219931+0000","last_unstale":"2024-09-10T23:16:09.328155+0000","last_undegraded":"2024-09-10T23:16:09.328155+0000","last_fullsized":"2024-09-10T23:16:09.328155+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:26.104133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.328361+0000","last_change":"2024-09-10T23:16:07.240650+0000","last_active":"2024-09-10T23:16:09.328361+0000","last_peered":"2024-09-10T23:16:09.328361+0000","last_clean":"2024-09-10T23:16:09.328361+0000","last_became_active":"2024-09-10T23:16:07.240394+0000","last_became_peered":"2024-09-10T23:16:07.240394+0000","last_unstale":"2024-09-10T23:16:09.328361+0000","last_undegraded":"2024-09-10T23:16:09.328361+0000","last_fullsized":"2024-09-10T23:16:09.328361+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:53.615139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.328215+0000","last_change":"2024-09-10T23:16:08.215439+0000","last_active":"2024-09-10T23:16:09.328215+0000","last_peered":"2024-09-10T23:16:09.328215+0000","last_clean":"2024-09-10T23:16:09.328215+0000","last_became_active":"2024-09-10T23:16:08.215177+0000","last_became_peered":"2024-09-10T23:16:08.215177+0000","last_unstale":"2024-09-10T23:16:09.328215+0000","last_undegraded":"2024-09-10T23:16:09.328215+0000","last_fullsized":"2024-09-10T23:16:09.328215+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:33.986042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.211125+0000","last_change":"2024-09-10T23:16:07.247286+0000","last_active":"2024-09-10T23:16:09.211125+0000","last_peered":"2024-09-10T23:16:09.211125+0000","last_clean":"2024-09-10T23:16:09.211125+0000","last_became_active":"2024-09-10T23:16:07.246107+0000","last_became_peered":"2024-09-10T23:16:07.246107+0000","last_unstale":"2024-09-10T23:16:09.211125+0000","last_undegraded":"2024-09-10T23:16:09.211125+0000","last_fullsized":"2024-09-10T23:16:09.211125+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:26.075661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262211+0000","last_change":"2024-09-10T23:16:08.225483+0000","last_active":"2024-09-10T23:16:10.262211+0000","last_peered":"2024-09-10T23:16:10.262211+0000","last_clean":"2024-09-10T23:16:10.262211+0000","last_became_active":"2024-09-10T23:16:08.224744+0000","last_became_peered":"2024-09-10T23:16:08.224744+0000","last_unstale":"2024-09-10T23:16:10.262211+0000","last_undegraded":"2024-09-10T23:16:10.262211+0000","last_fullsized":"2024-09-10T23:16:10.262211+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:42.110085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261734+0000","last_change":"2024-09-10T23:16:07.242137+0000","last_active":"2024-09-10T23:16:10.261734+0000","last_peered":"2024-09-10T23:16:10.261734+0000","last_clean":"2024-09-10T23:16:10.261734+0000","last_became_active":"2024-09-10T23:16:07.241872+0000","last_became_peered":"2024-09-10T23:16:07.241872+0000","last_unstale":"2024-09-10T23:16:10.261734+0000","last_undegraded":"2024-09-10T23:16:10.261734+0000","last_fullsized":"2024-09-10T23:16:10.261734+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:20.978310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262440+0000","last_change":"2024-09-10T23:16:08.227179+0000","last_active":"2024-09-10T23:16:10.262440+0000","last_peered":"2024-09-10T23:16:10.262440+0000","last_clean":"2024-09-10T23:16:10.262440+0000","last_became_active":"2024-09-10T23:16:08.226899+0000","last_became_peered":"2024-09-10T23:16:08.226899+0000","last_unstale":"2024-09-10T23:16:10.262440+0000","last_undegraded":"2024-09-10T23:16:10.262440+0000","last_fullsized":"2024-09-10T23:16:10.262440+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:51.649482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.327973+0000","last_change":"2024-09-10T23:16:07.244199+0000","last_active":"2024-09-10T23:16:09.327973+0000","last_peered":"2024-09-10T23:16:09.327973+0000","last_clean":"2024-09-10T23:16:09.327973+0000","last_became_active":"2024-09-10T23:16:07.243940+0000","last_became_peered":"2024-09-10T23:16:07.243940+0000","last_unstale":"2024-09-10T23:16:09.327973+0000","last_undegraded":"2024-09-10T23:16:09.327973+0000","last_fullsized":"2024-09-10T23:16:09.327973+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:51.058673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210639+0000","last_change":"2024-09-10T23:16:08.218735+0000","last_active":"2024-09-10T23:16:09.210639+0000","last_peered":"2024-09-10T23:16:09.210639+0000","last_clean":"2024-09-10T23:16:09.210639+0000","last_became_active":"2024-09-10T23:16:08.218245+0000","last_became_peered":"2024-09-10T23:16:08.218245+0000","last_unstale":"2024-09-10T23:16:09.210639+0000","last_undegraded":"2024-09-10T23:16:09.210639+0000","last_fullsized":"2024-09-10T23:16:09.210639+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:48.184784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210656+0000","last_change":"2024-09-10T23:16:07.242377+0000","last_active":"2024-09-10T23:16:09.210656+0000","last_peered":"2024-09-10T23:16:09.210656+0000","last_clean":"2024-09-10T23:16:09.210656+0000","last_became_active":"2024-09-10T23:16:07.242072+0000","last_became_peered":"2024-09-10T23:16:07.242072+0000","last_unstale":"2024-09-10T23:16:09.210656+0000","last_undegraded":"2024-09-10T23:16:09.210656+0000","last_fullsized":"2024-09-10T23:16:09.210656+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:52.234083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262117+0000","last_change":"2024-09-10T23:16:08.219446+0000","last_active":"2024-09-10T23:16:10.262117+0000","last_peered":"2024-09-10T23:16:10.262117+0000","last_clean":"2024-09-10T23:16:10.262117+0000","last_became_active":"2024-09-10T23:16:08.219043+0000","last_became_peered":"2024-09-10T23:16:08.219043+0000","last_unstale":"2024-09-10T23:16:10.262117+0000","last_undegraded":"2024-09-10T23:16:10.262117+0000","last_fullsized":"2024-09-10T23:16:10.262117+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:54.834435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261479+0000","last_change":"2024-09-10T23:16:07.246922+0000","last_active":"2024-09-10T23:16:10.261479+0000","last_peered":"2024-09-10T23:16:10.261479+0000","last_clean":"2024-09-10T23:16:10.261479+0000","last_became_active":"2024-09-10T23:16:07.246544+0000","last_became_peered":"2024-09-10T23:16:07.246544+0000","last_unstale":"2024-09-10T23:16:10.261479+0000","last_undegraded":"2024-09-10T23:16:10.261479+0000","last_fullsized":"2024-09-10T23:16:10.261479+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:42.272959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262359+0000","last_change":"2024-09-10T23:16:08.220665+0000","last_active":"2024-09-10T23:16:10.262359+0000","last_peered":"2024-09-10T23:16:10.262359+0000","last_clean":"2024-09-10T23:16:10.262359+0000","last_became_active":"2024-09-10T23:16:08.220376+0000","last_became_peered":"2024-09-10T23:16:08.220376+0000","last_unstale":"2024-09-10T23:16:10.262359+0000","last_undegraded":"2024-09-10T23:16:10.262359+0000","last_fullsized":"2024-09-10T23:16:10.262359+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:10.175097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262175+0000","last_change":"2024-09-10T23:16:07.250203+0000","last_active":"2024-09-10T23:16:10.262175+0000","last_peered":"2024-09-10T23:16:10.262175+0000","last_clean":"2024-09-10T23:16:10.262175+0000","last_became_active":"2024-09-10T23:16:07.249962+0000","last_became_peered":"2024-09-10T23:16:07.249962+0000","last_unstale":"2024-09-10T23:16:10.262175+0000","last_undegraded":"2024-09-10T23:16:10.262175+0000","last_fullsized":"2024-09-10T23:16:10.262175+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:10:38.952964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262430+0000","last_change":"2024-09-10T23:16:08.224866+0000","last_active":"2024-09-10T23:16:10.262430+0000","last_peered":"2024-09-10T23:16:10.262430+0000","last_clean":"2024-09-10T23:16:10.262430+0000","last_became_active":"2024-09-10T23:16:08.224576+0000","last_became_peered":"2024-09-10T23:16:08.224576+0000","last_unstale":"2024-09-10T23:16:10.262430+0000","last_undegraded":"2024-09-10T23:16:10.262430+0000","last_fullsized":"2024-09-10T23:16:10.262430+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:23.914405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262502+0000","last_change":"2024-09-10T23:16:07.242578+0000","last_active":"2024-09-10T23:16:10.262502+0000","last_peered":"2024-09-10T23:16:10.262502+0000","last_clean":"2024-09-10T23:16:10.262502+0000","last_became_active":"2024-09-10T23:16:07.242328+0000","last_became_peered":"2024-09-10T23:16:07.242328+0000","last_unstale":"2024-09-10T23:16:10.262502+0000","last_undegraded":"2024-09-10T23:16:10.262502+0000","last_fullsized":"2024-09-10T23:16:10.262502+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:21.652930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.208860+0000","last_change":"2024-09-10T23:16:08.218853+0000","last_active":"2024-09-10T23:16:09.208860+0000","last_peered":"2024-09-10T23:16:09.208860+0000","last_clean":"2024-09-10T23:16:09.208860+0000","last_became_active":"2024-09-10T23:16:08.218606+0000","last_became_peered":"2024-09-10T23:16:08.218606+0000","last_unstale":"2024-09-10T23:16:09.208860+0000","last_undegraded":"2024-09-10T23:16:09.208860+0000","last_fullsized":"2024-09-10T23:16:09.208860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:23.219087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262749+0000","last_change":"2024-09-10T23:16:07.249408+0000","last_active":"2024-09-10T23:16:10.262749+0000","last_peered":"2024-09-10T23:16:10.262749+0000","last_clean":"2024-09-10T23:16:10.262749+0000","last_became_active":"2024-09-10T23:16:07.249172+0000","last_became_peered":"2024-09-10T23:16:07.249172+0000","last_unstale":"2024-09-10T23:16:10.262749+0000","last_undegraded":"2024-09-10T23:16:10.262749+0000","last_fullsized":"2024-09-10T23:16:10.262749+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:30.768916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262419+0000","last_change":"2024-09-10T23:16:08.218703+0000","last_active":"2024-09-10T23:16:10.262419+0000","last_peered":"2024-09-10T23:16:10.262419+0000","last_clean":"2024-09-10T23:16:10.262419+0000","last_became_active":"2024-09-10T23:16:08.218241+0000","last_became_peered":"2024-09-10T23:16:08.218241+0000","last_unstale":"2024-09-10T23:16:10.262419+0000","last_undegraded":"2024-09-10T23:16:10.262419+0000","last_fullsized":"2024-09-10T23:16:10.262419+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:17.010232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262572+0000","last_change":"2024-09-10T23:16:07.245791+0000","last_active":"2024-09-10T23:16:10.262572+0000","last_peered":"2024-09-10T23:16:10.262572+0000","last_clean":"2024-09-10T23:16:10.262572+0000","last_became_active":"2024-09-10T23:16:07.245524+0000","last_became_peered":"2024-09-10T23:16:07.245524+0000","last_unstale":"2024-09-10T23:16:10.262572+0000","last_undegraded":"2024-09-10T23:16:10.262572+0000","last_fullsized":"2024-09-10T23:16:10.262572+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:20.821601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209964+0000","last_change":"2024-09-10T23:16:08.220916+0000","last_active":"2024-09-10T23:16:09.209964+0000","last_peered":"2024-09-10T23:16:09.209964+0000","last_clean":"2024-09-10T23:16:09.209964+0000","last_became_active":"2024-09-10T23:16:08.220564+0000","last_became_peered":"2024-09-10T23:16:08.220564+0000","last_unstale":"2024-09-10T23:16:09.209964+0000","last_undegraded":"2024-09-10T23:16:09.209964+0000","last_fullsized":"2024-09-10T23:16:09.209964+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:33:54.089374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262155+0000","last_change":"2024-09-10T23:16:07.243362+0000","last_active":"2024-09-10T23:16:10.262155+0000","last_peered":"2024-09-10T23:16:10.262155+0000","last_clean":"2024-09-10T23:16:10.262155+0000","last_became_active":"2024-09-10T23:16:07.242429+0000","last_became_peered":"2024-09-10T23:16:07.242429+0000","last_unstale":"2024-09-10T23:16:10.262155+0000","last_undegraded":"2024-09-10T23:16:10.262155+0000","last_fullsized":"2024-09-10T23:16:10.262155+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:02.224707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262269+0000","last_change":"2024-09-10T23:16:08.223572+0000","last_active":"2024-09-10T23:16:10.262269+0000","last_peered":"2024-09-10T23:16:10.262269+0000","last_clean":"2024-09-10T23:16:10.262269+0000","last_became_active":"2024-09-10T23:16:08.222661+0000","last_became_peered":"2024-09-10T23:16:08.222661+0000","last_unstale":"2024-09-10T23:16:10.262269+0000","last_undegraded":"2024-09-10T23:16:10.262269+0000","last_fullsized":"2024-09-10T23:16:10.262269+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:48.800232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209713+0000","last_change":"2024-09-10T23:16:07.248634+0000","last_active":"2024-09-10T23:16:09.209713+0000","last_peered":"2024-09-10T23:16:09.209713+0000","last_clean":"2024-09-10T23:16:09.209713+0000","last_became_active":"2024-09-10T23:16:07.248274+0000","last_became_peered":"2024-09-10T23:16:07.248274+0000","last_unstale":"2024-09-10T23:16:09.209713+0000","last_undegraded":"2024-09-10T23:16:09.209713+0000","last_fullsized":"2024-09-10T23:16:09.209713+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:10.006129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262261+0000","last_change":"2024-09-10T23:16:08.218722+0000","last_active":"2024-09-10T23:16:10.262261+0000","last_peered":"2024-09-10T23:16:10.262261+0000","last_clean":"2024-09-10T23:16:10.262261+0000","last_became_active":"2024-09-10T23:16:08.218442+0000","last_became_peered":"2024-09-10T23:16:08.218442+0000","last_unstale":"2024-09-10T23:16:10.262261+0000","last_undegraded":"2024-09-10T23:16:10.262261+0000","last_fullsized":"2024-09-10T23:16:10.262261+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:20:23.553899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210394+0000","last_change":"2024-09-10T23:16:07.246890+0000","last_active":"2024-09-10T23:16:09.210394+0000","last_peered":"2024-09-10T23:16:09.210394+0000","last_clean":"2024-09-10T23:16:09.210394+0000","last_became_active":"2024-09-10T23:16:07.246158+0000","last_became_peered":"2024-09-10T23:16:07.246158+0000","last_unstale":"2024-09-10T23:16:09.210394+0000","last_undegraded":"2024-09-10T23:16:09.210394+0000","last_fullsized":"2024-09-10T23:16:09.210394+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:15.703595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262170+0000","last_change":"2024-09-10T23:16:08.223823+0000","last_active":"2024-09-10T23:16:10.262170+0000","last_peered":"2024-09-10T23:16:10.262170+0000","last_clean":"2024-09-10T23:16:10.262170+0000","last_became_active":"2024-09-10T23:16:08.223546+0000","last_became_peered":"2024-09-10T23:16:08.223546+0000","last_unstale":"2024-09-10T23:16:10.262170+0000","last_undegraded":"2024-09-10T23:16:10.262170+0000","last_fullsized":"2024-09-10T23:16:10.262170+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:34.031526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":23,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261735+0000","last_change":"2024-09-10T23:16:07.250840+0000","last_active":"2024-09-10T23:16:10.261735+0000","last_peered":"2024-09-10T23:16:10.261735+0000","last_clean":"2024-09-10T23:16:10.261735+0000","last_became_active":"2024-09-10T23:16:07.250571+0000","last_became_peered":"2024-09-10T23:16:07.250571+0000","last_unstale":"2024-09-10T23:16:10.261735+0000","last_undegraded":"2024-09-10T23:16:10.261735+0000","last_fullsized":"2024-09-10T23:16:10.261735+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:08.202449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262572+0000","last_change":"2024-09-10T23:16:08.221947+0000","last_active":"2024-09-10T23:16:10.262572+0000","last_peered":"2024-09-10T23:16:10.262572+0000","last_clean":"2024-09-10T23:16:10.262572+0000","last_became_active":"2024-09-10T23:16:08.221586+0000","last_became_peered":"2024-09-10T23:16:08.221586+0000","last_unstale":"2024-09-10T23:16:10.262572+0000","last_undegraded":"2024-09-10T23:16:10.262572+0000","last_fullsized":"2024-09-10T23:16:10.262572+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:53.020253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262258+0000","last_change":"2024-09-10T23:16:07.242698+0000","last_active":"2024-09-10T23:16:10.262258+0000","last_peered":"2024-09-10T23:16:10.262258+0000","last_clean":"2024-09-10T23:16:10.262258+0000","last_became_active":"2024-09-10T23:16:07.242451+0000","last_became_peered":"2024-09-10T23:16:07.242451+0000","last_unstale":"2024-09-10T23:16:10.262258+0000","last_undegraded":"2024-09-10T23:16:10.262258+0000","last_fullsized":"2024-09-10T23:16:10.262258+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:41.904749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210453+0000","last_change":"2024-09-10T23:16:08.220196+0000","last_active":"2024-09-10T23:16:09.210453+0000","last_peered":"2024-09-10T23:16:09.210453+0000","last_clean":"2024-09-10T23:16:09.210453+0000","last_became_active":"2024-09-10T23:16:08.219799+0000","last_became_peered":"2024-09-10T23:16:08.219799+0000","last_unstale":"2024-09-10T23:16:09.210453+0000","last_undegraded":"2024-09-10T23:16:09.210453+0000","last_fullsized":"2024-09-10T23:16:09.210453+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:42.908430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.328404+0000","last_change":"2024-09-10T23:16:07.244013+0000","last_active":"2024-09-10T23:16:09.328404+0000","last_peered":"2024-09-10T23:16:09.328404+0000","last_clean":"2024-09-10T23:16:09.328404+0000","last_became_active":"2024-09-10T23:16:07.243760+0000","last_became_peered":"2024-09-10T23:16:07.243760+0000","last_unstale":"2024-09-10T23:16:09.328404+0000","last_undegraded":"2024-09-10T23:16:09.328404+0000","last_fullsized":"2024-09-10T23:16:09.328404+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:23.111465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262559+0000","last_change":"2024-09-10T23:16:08.222513+0000","last_active":"2024-09-10T23:16:10.262559+0000","last_peered":"2024-09-10T23:16:10.262559+0000","last_clean":"2024-09-10T23:16:10.262559+0000","last_became_active":"2024-09-10T23:16:08.222212+0000","last_became_peered":"2024-09-10T23:16:08.222212+0000","last_unstale":"2024-09-10T23:16:10.262559+0000","last_undegraded":"2024-09-10T23:16:10.262559+0000","last_fullsized":"2024-09-10T23:16:10.262559+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:03.899036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210913+0000","last_change":"2024-09-10T23:16:07.248434+0000","last_active":"2024-09-10T23:16:09.210913+0000","last_peered":"2024-09-10T23:16:09.210913+0000","last_clean":"2024-09-10T23:16:09.210913+0000","last_became_active":"2024-09-10T23:16:07.248190+0000","last_became_peered":"2024-09-10T23:16:07.248190+0000","last_unstale":"2024-09-10T23:16:09.210913+0000","last_undegraded":"2024-09-10T23:16:09.210913+0000","last_fullsized":"2024-09-10T23:16:09.210913+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:22.233787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262662+0000","last_change":"2024-09-10T23:16:08.224904+0000","last_active":"2024-09-10T23:16:10.262662+0000","last_peered":"2024-09-10T23:16:10.262662+0000","last_clean":"2024-09-10T23:16:10.262662+0000","last_became_active":"2024-09-10T23:16:08.224619+0000","last_became_peered":"2024-09-10T23:16:08.224619+0000","last_unstale":"2024-09-10T23:16:10.262662+0000","last_undegraded":"2024-09-10T23:16:10.262662+0000","last_fullsized":"2024-09-10T23:16:10.262662+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:10.515057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.328160+0000","last_change":"2024-09-10T23:16:07.241871+0000","last_active":"2024-09-10T23:16:09.328160+0000","last_peered":"2024-09-10T23:16:09.328160+0000","last_clean":"2024-09-10T23:16:09.328160+0000","last_became_active":"2024-09-10T23:16:07.241609+0000","last_became_peered":"2024-09-10T23:16:07.241609+0000","last_unstale":"2024-09-10T23:16:09.328160+0000","last_undegraded":"2024-09-10T23:16:09.328160+0000","last_fullsized":"2024-09-10T23:16:09.328160+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:51.936391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210151+0000","last_change":"2024-09-10T23:16:08.220448+0000","last_active":"2024-09-10T23:16:09.210151+0000","last_peered":"2024-09-10T23:16:09.210151+0000","last_clean":"2024-09-10T23:16:09.210151+0000","last_became_active":"2024-09-10T23:16:08.219886+0000","last_became_peered":"2024-09-10T23:16:08.219886+0000","last_unstale":"2024-09-10T23:16:09.210151+0000","last_undegraded":"2024-09-10T23:16:09.210151+0000","last_fullsized":"2024-09-10T23:16:09.210151+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:15.935036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262554+0000","last_change":"2024-09-10T23:16:07.242926+0000","last_active":"2024-09-10T23:16:10.262554+0000","last_peered":"2024-09-10T23:16:10.262554+0000","last_clean":"2024-09-10T23:16:10.262554+0000","last_became_active":"2024-09-10T23:16:07.242676+0000","last_became_peered":"2024-09-10T23:16:07.242676+0000","last_unstale":"2024-09-10T23:16:10.262554+0000","last_undegraded":"2024-09-10T23:16:10.262554+0000","last_fullsized":"2024-09-10T23:16:10.262554+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:33.027845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.328115+0000","last_change":"2024-09-10T23:16:08.218101+0000","last_active":"2024-09-10T23:16:09.328115+0000","last_peered":"2024-09-10T23:16:09.328115+0000","last_clean":"2024-09-10T23:16:09.328115+0000","last_became_active":"2024-09-10T23:16:08.217842+0000","last_became_peered":"2024-09-10T23:16:08.217842+0000","last_unstale":"2024-09-10T23:16:09.328115+0000","last_undegraded":"2024-09-10T23:16:09.328115+0000","last_fullsized":"2024-09-10T23:16:09.328115+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:28.309795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.208789+0000","last_change":"2024-09-10T23:16:07.242064+0000","last_active":"2024-09-10T23:16:09.208789+0000","last_peered":"2024-09-10T23:16:09.208789+0000","last_clean":"2024-09-10T23:16:09.208789+0000","last_became_active":"2024-09-10T23:16:07.241807+0000","last_became_peered":"2024-09-10T23:16:07.241807+0000","last_unstale":"2024-09-10T23:16:09.208789+0000","last_undegraded":"2024-09-10T23:16:09.208789+0000","last_fullsized":"2024-09-10T23:16:09.208789+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:16.706730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.327776+0000","last_change":"2024-09-10T23:16:08.217121+0000","last_active":"2024-09-10T23:16:09.327776+0000","last_peered":"2024-09-10T23:16:09.327776+0000","last_clean":"2024-09-10T23:16:09.327776+0000","last_became_active":"2024-09-10T23:16:08.216844+0000","last_became_peered":"2024-09-10T23:16:08.216844+0000","last_unstale":"2024-09-10T23:16:09.327776+0000","last_undegraded":"2024-09-10T23:16:09.327776+0000","last_fullsized":"2024-09-10T23:16:09.327776+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:31.936174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209640+0000","last_change":"2024-09-10T23:16:07.245913+0000","last_active":"2024-09-10T23:16:09.209640+0000","last_peered":"2024-09-10T23:16:09.209640+0000","last_clean":"2024-09-10T23:16:09.209640+0000","last_became_active":"2024-09-10T23:16:07.245627+0000","last_became_peered":"2024-09-10T23:16:07.245627+0000","last_unstale":"2024-09-10T23:16:09.209640+0000","last_undegraded":"2024-09-10T23:16:09.209640+0000","last_fullsized":"2024-09-10T23:16:09.209640+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:24.601059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210608+0000","last_change":"2024-09-10T23:16:08.221121+0000","last_active":"2024-09-10T23:16:09.210608+0000","last_peered":"2024-09-10T23:16:09.210608+0000","last_clean":"2024-09-10T23:16:09.210608+0000","last_became_active":"2024-09-10T23:16:08.220841+0000","last_became_peered":"2024-09-10T23:16:08.220841+0000","last_unstale":"2024-09-10T23:16:09.210608+0000","last_undegraded":"2024-09-10T23:16:09.210608+0000","last_fullsized":"2024-09-10T23:16:09.210608+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:27.410153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209052+0000","last_change":"2024-09-10T23:16:07.237259+0000","last_active":"2024-09-10T23:16:09.209052+0000","last_peered":"2024-09-10T23:16:09.209052+0000","last_clean":"2024-09-10T23:16:09.209052+0000","last_became_active":"2024-09-10T23:16:07.236983+0000","last_became_peered":"2024-09-10T23:16:07.236983+0000","last_unstale":"2024-09-10T23:16:09.209052+0000","last_undegraded":"2024-09-10T23:16:09.209052+0000","last_fullsized":"2024-09-10T23:16:09.209052+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:10.006129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.210651+0000","last_change":"2024-09-10T23:16:08.217212+0000","last_active":"2024-09-10T23:16:09.210651+0000","last_peered":"2024-09-10T23:16:09.210651+0000","last_clean":"2024-09-10T23:16:09.210651+0000","last_became_active":"2024-09-10T23:16:08.216808+0000","last_became_peered":"2024-09-10T23:16:08.216808+0000","last_unstale":"2024-09-10T23:16:09.210651+0000","last_undegraded":"2024-09-10T23:16:09.210651+0000","last_fullsized":"2024-09-10T23:16:09.210651+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:03.228388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.328450+0000","last_change":"2024-09-10T23:16:07.243334+0000","last_active":"2024-09-10T23:16:09.328450+0000","last_peered":"2024-09-10T23:16:09.328450+0000","last_clean":"2024-09-10T23:16:09.328450+0000","last_became_active":"2024-09-10T23:16:07.243016+0000","last_became_peered":"2024-09-10T23:16:07.243016+0000","last_unstale":"2024-09-10T23:16:09.328450+0000","last_undegraded":"2024-09-10T23:16:09.328450+0000","last_fullsized":"2024-09-10T23:16:09.328450+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:05.470182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.208942+0000","last_change":"2024-09-10T23:16:08.218782+0000","last_active":"2024-09-10T23:16:09.208942+0000","last_peered":"2024-09-10T23:16:09.208942+0000","last_clean":"2024-09-10T23:16:09.208942+0000","last_became_active":"2024-09-10T23:16:08.217288+0000","last_became_peered":"2024-09-10T23:16:08.217288+0000","last_unstale":"2024-09-10T23:16:09.208942+0000","last_undegraded":"2024-09-10T23:16:09.208942+0000","last_fullsized":"2024-09-10T23:16:09.208942+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:25.080754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209975+0000","last_change":"2024-09-10T23:16:07.243591+0000","last_active":"2024-09-10T23:16:09.209975+0000","last_peered":"2024-09-10T23:16:09.209975+0000","last_clean":"2024-09-10T23:16:09.209975+0000","last_became_active":"2024-09-10T23:16:07.243135+0000","last_became_peered":"2024-09-10T23:16:07.243135+0000","last_unstale":"2024-09-10T23:16:09.209975+0000","last_undegraded":"2024-09-10T23:16:09.209975+0000","last_fullsized":"2024-09-10T23:16:09.209975+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:16.706730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.328393+0000","last_change":"2024-09-10T23:16:08.216683+0000","last_active":"2024-09-10T23:16:09.328393+0000","last_peered":"2024-09-10T23:16:09.328393+0000","last_clean":"2024-09-10T23:16:09.328393+0000","last_became_active":"2024-09-10T23:16:08.216398+0000","last_became_peered":"2024-09-10T23:16:08.216398+0000","last_unstale":"2024-09-10T23:16:09.328393+0000","last_undegraded":"2024-09-10T23:16:09.328393+0000","last_fullsized":"2024-09-10T23:16:09.328393+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:51.112980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.211119+0000","last_change":"2024-09-10T23:16:07.244150+0000","last_active":"2024-09-10T23:16:09.211119+0000","last_peered":"2024-09-10T23:16:09.211119+0000","last_clean":"2024-09-10T23:16:09.211119+0000","last_became_active":"2024-09-10T23:16:07.243818+0000","last_became_peered":"2024-09-10T23:16:07.243818+0000","last_unstale":"2024-09-10T23:16:09.211119+0000","last_undegraded":"2024-09-10T23:16:09.211119+0000","last_fullsized":"2024-09-10T23:16:09.211119+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:53.790347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262465+0000","last_change":"2024-09-10T23:16:08.218204+0000","last_active":"2024-09-10T23:16:10.262465+0000","last_peered":"2024-09-10T23:16:10.262465+0000","last_clean":"2024-09-10T23:16:10.262465+0000","last_became_active":"2024-09-10T23:16:08.217921+0000","last_became_peered":"2024-09-10T23:16:08.217921+0000","last_unstale":"2024-09-10T23:16:10.262465+0000","last_undegraded":"2024-09-10T23:16:10.262465+0000","last_fullsized":"2024-09-10T23:16:10.262465+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:51.387433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.208726+0000","last_change":"2024-09-10T23:16:07.246842+0000","last_active":"2024-09-10T23:16:09.208726+0000","last_peered":"2024-09-10T23:16:09.208726+0000","last_clean":"2024-09-10T23:16:09.208726+0000","last_became_active":"2024-09-10T23:16:07.246594+0000","last_became_peered":"2024-09-10T23:16:07.246594+0000","last_unstale":"2024-09-10T23:16:09.208726+0000","last_undegraded":"2024-09-10T23:16:09.208726+0000","last_fullsized":"2024-09-10T23:16:09.208726+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:20.115661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262449+0000","last_change":"2024-09-10T23:16:08.224091+0000","last_active":"2024-09-10T23:16:10.262449+0000","last_peered":"2024-09-10T23:16:10.262449+0000","last_clean":"2024-09-10T23:16:10.262449+0000","last_became_active":"2024-09-10T23:16:08.223208+0000","last_became_peered":"2024-09-10T23:16:08.223208+0000","last_unstale":"2024-09-10T23:16:10.262449+0000","last_undegraded":"2024-09-10T23:16:10.262449+0000","last_fullsized":"2024-09-10T23:16:10.262449+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:21.692908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261646+0000","last_change":"2024-09-10T23:16:07.246764+0000","last_active":"2024-09-10T23:16:10.261646+0000","last_peered":"2024-09-10T23:16:10.261646+0000","last_clean":"2024-09-10T23:16:10.261646+0000","last_became_active":"2024-09-10T23:16:07.246492+0000","last_became_peered":"2024-09-10T23:16:07.246492+0000","last_unstale":"2024-09-10T23:16:10.261646+0000","last_undegraded":"2024-09-10T23:16:10.261646+0000","last_fullsized":"2024-09-10T23:16:10.261646+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:48.760684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.208702+0000","last_change":"2024-09-10T23:16:08.217894+0000","last_active":"2024-09-10T23:16:09.208702+0000","last_peered":"2024-09-10T23:16:09.208702+0000","last_clean":"2024-09-10T23:16:09.208702+0000","last_became_active":"2024-09-10T23:16:08.217632+0000","last_became_peered":"2024-09-10T23:16:08.217632+0000","last_unstale":"2024-09-10T23:16:09.208702+0000","last_undegraded":"2024-09-10T23:16:09.208702+0000","last_fullsized":"2024-09-10T23:16:09.208702+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:22.728080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.208653+0000","last_change":"2024-09-10T23:16:07.245294+0000","last_active":"2024-09-10T23:16:09.208653+0000","last_peered":"2024-09-10T23:16:09.208653+0000","last_clean":"2024-09-10T23:16:09.208653+0000","last_became_active":"2024-09-10T23:16:07.245035+0000","last_became_peered":"2024-09-10T23:16:07.245035+0000","last_unstale":"2024-09-10T23:16:09.208653+0000","last_undegraded":"2024-09-10T23:16:09.208653+0000","last_fullsized":"2024-09-10T23:16:09.208653+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:27.666822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262006+0000","last_change":"2024-09-10T23:16:08.218638+0000","last_active":"2024-09-10T23:16:10.262006+0000","last_peered":"2024-09-10T23:16:10.262006+0000","last_clean":"2024-09-10T23:16:10.262006+0000","last_became_active":"2024-09-10T23:16:08.218381+0000","last_became_peered":"2024-09-10T23:16:08.218381+0000","last_unstale":"2024-09-10T23:16:10.262006+0000","last_undegraded":"2024-09-10T23:16:10.262006+0000","last_fullsized":"2024-09-10T23:16:10.262006+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:54.606307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262009+0000","last_change":"2024-09-10T23:16:07.247138+0000","last_active":"2024-09-10T23:16:10.262009+0000","last_peered":"2024-09-10T23:16:10.262009+0000","last_clean":"2024-09-10T23:16:10.262009+0000","last_became_active":"2024-09-10T23:16:07.246657+0000","last_became_peered":"2024-09-10T23:16:07.246657+0000","last_unstale":"2024-09-10T23:16:10.262009+0000","last_undegraded":"2024-09-10T23:16:10.262009+0000","last_fullsized":"2024-09-10T23:16:10.262009+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:26.406472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.261899+0000","last_change":"2024-09-10T23:16:08.227513+0000","last_active":"2024-09-10T23:16:10.261899+0000","last_peered":"2024-09-10T23:16:10.261899+0000","last_clean":"2024-09-10T23:16:10.261899+0000","last_became_active":"2024-09-10T23:16:08.227238+0000","last_became_peered":"2024-09-10T23:16:08.227238+0000","last_unstale":"2024-09-10T23:16:10.261899+0000","last_undegraded":"2024-09-10T23:16:10.261899+0000","last_fullsized":"2024-09-10T23:16:10.261899+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:07.219144+0000","last_clean_scrub_stamp":"2024-09-10T23:16:07.219144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:45.047866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:09.209752+0000","last_change":"2024-09-10T23:16:07.244949+0000","last_active":"2024-09-10T23:16:09.209752+0000","last_peered":"2024-09-10T23:16:09.209752+0000","last_clean":"2024-09-10T23:16:09.209752+0000","last_became_active":"2024-09-10T23:16:07.244622+0000","last_became_peered":"2024-09-10T23:16:07.244622+0000","last_unstale":"2024-09-10T23:16:09.209752+0000","last_undegraded":"2024-09-10T23:16:09.209752+0000","last_fullsized":"2024-09-10T23:16:09.209752+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:06.215463+0000","last_clean_scrub_stamp":"2024-09-10T23:16:06.215463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:27.666822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":170,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:16:10.262619+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:16:10.262619+0000","last_peered":"2024-09-10T23:16:10.262619+0000","last_clean":"2024-09-10T23:16:10.262619+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:16:10.262619+0000","last_undegraded":"2024-09-10T23:16:10.262619+0000","last_fullsized":"2024-09-10T23:16:10.262619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1277952,"data_stored":866654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":675840,"data_stored":276126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":276778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509464,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":675840,"data_stored":271438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":269882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":276182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":679936,"data_stored":276216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1286144,"data_stored":868688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:16:15.874 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:16:15.875 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:16:16.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.018+0000 7fc796ee6640 1 -- 172.21.15.90:0/624938429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc790151a00 msgr2=0x7fc79015bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:16.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.018+0000 7fc796ee6640 1 --2- 172.21.15.90:0/624938429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc790151a00 0x7fc79015bc90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc7900747f0 tx=0x7fc78002a4a0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.018+0000 7fc796ee6640 1 -- 172.21.15.90:0/624938429 shutdown_connections 2024-09-10T23:16:16.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.018+0000 7fc796ee6640 1 --2- 172.21.15.90:0/624938429 >> v2:172.21.15.171:3300/0 conn(0x7fc790151de0 0x7fc790072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.018+0000 7fc796ee6640 1 --2- 172.21.15.90:0/624938429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc790151a00 0x7fc79015bc90 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.018+0000 7fc796ee6640 1 -- 172.21.15.90:0/624938429 >> 172.21.15.90:0/624938429 conn(0x7fc7900cfbc0 msgr2=0x7fc7900cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:16.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.018+0000 7fc796ee6640 1 -- 172.21.15.90:0/624938429 shutdown_connections 2024-09-10T23:16:16.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.018+0000 7fc796ee6640 1 -- 172.21.15.90:0/624938429 wait complete. 2024-09-10T23:16:16.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.019+0000 7fc796ee6640 1 Processor -- start 2024-09-10T23:16:16.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.020+0000 7fc796ee6640 1 -- start start 2024-09-10T23:16:16.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.020+0000 7fc796ee6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc79006fd80 0x7fc7901502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:16.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.020+0000 7fc796ee6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc790151a00 0x7fc7900c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:16.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.020+0000 7fc796ee6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc790151de0 0x7fc7900c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:16.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.020+0000 7fc796ee6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc7900705a0 con 0x7fc790151de0 2024-09-10T23:16:16.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.020+0000 7fc796ee6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc790070420 con 0x7fc790151a00 2024-09-10T23:16:16.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.020+0000 7fc796ee6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc7900c91c0 con 0x7fc79006fd80 2024-09-10T23:16:16.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.021+0000 7fc795483640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc790151de0 0x7fc7900c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:16.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.021+0000 7fc795483640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc790151de0 0x7fc7900c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54386/0 (socket says 172.21.15.90:54386) 2024-09-10T23:16:16.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.021+0000 7fc795483640 1 -- 172.21.15.90:0/627917383 learned_addr learned my addr 172.21.15.90:0/627917383 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:16.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.021+0000 7fc794c82640 1 --2- 172.21.15.90:0/627917383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc79006fd80 0x7fc7901502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:16.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.021+0000 7fc78ffff640 1 --2- 172.21.15.90:0/627917383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc790151a00 0x7fc7900c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:16.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.021+0000 7fc795483640 1 -- 172.21.15.90:0/627917383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc79006fd80 msgr2=0x7fc7901502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:16.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.021+0000 7fc795483640 1 --2- 172.21.15.90:0/627917383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc79006fd80 0x7fc7901502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.021+0000 7fc795483640 1 -- 172.21.15.90:0/627917383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc790151a00 msgr2=0x7fc7900c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:16.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.021+0000 7fc795483640 1 --2- 172.21.15.90:0/627917383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc790151a00 0x7fc7900c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.021+0000 7fc795483640 1 -- 172.21.15.90:0/627917383 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7901e7820 con 0x7fc790151de0 2024-09-10T23:16:16.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.021+0000 7fc795483640 1 --2- 172.21.15.90:0/627917383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc790151de0 0x7fc7900c7670 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc78800cbc0 tx=0x7fc78800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:16.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.021+0000 7fc78d7fa640 1 -- 172.21.15.90:0/627917383 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc788016020 con 0x7fc790151de0 2024-09-10T23:16:16.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.021+0000 7fc78d7fa640 1 -- 172.21.15.90:0/627917383 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc78800ae30 con 0x7fc790151de0 2024-09-10T23:16:16.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.021+0000 7fc796ee6640 1 -- 172.21.15.90:0/627917383 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7900c93f0 con 0x7fc790151de0 2024-09-10T23:16:16.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.021+0000 7fc78d7fa640 1 -- 172.21.15.90:0/627917383 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc788012660 con 0x7fc790151de0 2024-09-10T23:16:16.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.021+0000 7fc796ee6640 1 -- 172.21.15.90:0/627917383 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7900c9690 con 0x7fc790151de0 2024-09-10T23:16:16.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.022+0000 7fc796ee6640 1 -- 172.21.15.90:0/627917383 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc79015bc90 con 0x7fc790151de0 2024-09-10T23:16:16.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.023+0000 7fc78d7fa640 1 -- 172.21.15.90:0/627917383 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc78801b400 con 0x7fc790151de0 2024-09-10T23:16:16.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.023+0000 7fc78d7fa640 1 --2- 172.21.15.90:0/627917383 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc770077f70 0x7fc77007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:16.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.024+0000 7fc78d7fa640 1 -- 172.21.15.90:0/627917383 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fc78809a680 con 0x7fc790151de0 2024-09-10T23:16:16.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.024+0000 7fc794c82640 1 --2- 172.21.15.90:0/627917383 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc770077f70 0x7fc77007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:16.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.024+0000 7fc794c82640 1 --2- 172.21.15.90:0/627917383 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc770077f70 0x7fc77007a430 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc780034000 tx=0x7fc780004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:16.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.028+0000 7fc78d7fa640 1 -- 172.21.15.90:0/627917383 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc788020020 con 0x7fc790151de0 2024-09-10T23:16:16.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.275+0000 7fc796ee6640 1 -- 172.21.15.90:0/627917383 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc79006ea50 con 0x7fc790151de0 2024-09-10T23:16:16.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.277+0000 7fc78d7fa640 1 -- 172.21.15.90:0/627917383 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v27) ==== 190+0+147 (secure 0 0 0) 0x7fc788063210 con 0x7fc790151de0 2024-09-10T23:16:16.278 INFO:teuthology.orchestra.run.smithi090.stdout:[client.0] 2024-09-10T23:16:16.278 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCX0uBmiYBwBhAABMV9erpQ+KZlTmf0kDZ0gw== 2024-09-10T23:16:16.279 INFO:teuthology.orchestra.run.smithi090.stdout: caps mds = "allow" 2024-09-10T23:16:16.279 INFO:teuthology.orchestra.run.smithi090.stdout: caps mon = "allow r" 2024-09-10T23:16:16.279 INFO:teuthology.orchestra.run.smithi090.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:16:16.279 INFO:teuthology.orchestra.run.smithi090.stderr:updated caps for client.0 2024-09-10T23:16:16.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.280+0000 7fc796ee6640 1 -- 172.21.15.90:0/627917383 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc770077f70 msgr2=0x7fc77007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:16.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.280+0000 7fc796ee6640 1 --2- 172.21.15.90:0/627917383 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc770077f70 0x7fc77007a430 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc780034000 tx=0x7fc780004730 comp rx=0 tx=0).stop 2024-09-10T23:16:16.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.280+0000 7fc796ee6640 1 -- 172.21.15.90:0/627917383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc790151de0 msgr2=0x7fc7900c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:16.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.280+0000 7fc796ee6640 1 --2- 172.21.15.90:0/627917383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc790151de0 0x7fc7900c7670 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc78800cbc0 tx=0x7fc78800a430 comp rx=0 tx=0).stop 2024-09-10T23:16:16.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.280+0000 7fc796ee6640 1 -- 172.21.15.90:0/627917383 shutdown_connections 2024-09-10T23:16:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.280+0000 7fc796ee6640 1 --2- 172.21.15.90:0/627917383 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc770077f70 0x7fc77007a430 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.280+0000 7fc796ee6640 1 --2- 172.21.15.90:0/627917383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc790151a00 0x7fc7900c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.280+0000 7fc796ee6640 1 --2- 172.21.15.90:0/627917383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc790151de0 0x7fc7900c7670 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.280+0000 7fc796ee6640 1 --2- 172.21.15.90:0/627917383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc79006fd80 0x7fc7901502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.280+0000 7fc796ee6640 1 -- 172.21.15.90:0/627917383 >> 172.21.15.90:0/627917383 conn(0x7fc7900cfbc0 msgr2=0x7fc79006ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.280+0000 7fc796ee6640 1 -- 172.21.15.90:0/627917383 shutdown_connections 2024-09-10T23:16:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.280+0000 7fc796ee6640 1 -- 172.21.15.90:0/627917383 wait complete. 2024-09-10T23:16:16.292 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:16.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.393+0000 7f79dfa7f640 1 -- 172.21.15.90:0/1721069288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79c0003c30 msgr2=0x7f79c0004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:16.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.393+0000 7f79dfa7f640 1 --2- 172.21.15.90:0/1721069288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79c0003c30 0x7f79c0004030 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f79c8001830 tx=0x7f79c0005830 comp rx=0 tx=0).stop 2024-09-10T23:16:16.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.393+0000 7f79dfa7f640 1 -- 172.21.15.90:0/1721069288 shutdown_connections 2024-09-10T23:16:16.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.393+0000 7f79dfa7f640 1 --2- 172.21.15.90:0/1721069288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79c0003c30 0x7f79c0004030 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.393+0000 7f79dfa7f640 1 -- 172.21.15.90:0/1721069288 >> 172.21.15.90:0/1721069288 conn(0x7f79d809d2a0 msgr2=0x7f79d80d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:16.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.393+0000 7f79dfa7f640 1 -- 172.21.15.90:0/1721069288 shutdown_connections 2024-09-10T23:16:16.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.393+0000 7f79dfa7f640 1 -- 172.21.15.90:0/1721069288 wait complete. 2024-09-10T23:16:16.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.394+0000 7f79dfa7f640 1 Processor -- start 2024-09-10T23:16:16.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.394+0000 7f79dfa7f640 1 -- start start 2024-09-10T23:16:16.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79dfa7f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79c0003c30 0x7f79d80b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:16.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79dfa7f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79d80cd3f0 0x7f79d81f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79dfa7f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79d80cd870 0x7f79d81f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79dfa7f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f79d80d2850 con 0x7f79d80cd870 2024-09-10T23:16:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79dfa7f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f79d80cec80 con 0x7f79d80cd3f0 2024-09-10T23:16:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79dfa7f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f79d80d29d0 con 0x7f79c0003c30 2024-09-10T23:16:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79de01c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79d80cd870 0x7f79d81f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79de01c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79d80cd870 0x7f79d81f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54400/0 (socket says 172.21.15.90:54400) 2024-09-10T23:16:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79de01c640 1 -- 172.21.15.90:0/2793322011 learned_addr learned my addr 172.21.15.90:0/2793322011 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79dd01a640 1 --2- 172.21.15.90:0/2793322011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79d80cd3f0 0x7f79d81f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79dd81b640 1 --2- 172.21.15.90:0/2793322011 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79c0003c30 0x7f79d80b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79de01c640 1 -- 172.21.15.90:0/2793322011 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79c0003c30 msgr2=0x7f79d80b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79de01c640 1 --2- 172.21.15.90:0/2793322011 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79c0003c30 0x7f79d80b6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79de01c640 1 -- 172.21.15.90:0/2793322011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79d80cd3f0 msgr2=0x7f79d81f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79de01c640 1 --2- 172.21.15.90:0/2793322011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79d80cd3f0 0x7f79d81f7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79de01c640 1 -- 172.21.15.90:0/2793322011 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d81f8a60 con 0x7f79d80cd870 2024-09-10T23:16:16.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79dd01a640 1 --2- 172.21.15.90:0/2793322011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79d80cd3f0 0x7f79d81f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:16.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79dd81b640 1 --2- 172.21.15.90:0/2793322011 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79c0003c30 0x7f79d80b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:16.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79de01c640 1 --2- 172.21.15.90:0/2793322011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79d80cd870 0x7f79d81f83c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f79d809da10 tx=0x7f79d0011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:16.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.395+0000 7f79d67fc640 1 -- 172.21.15.90:0/2793322011 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d0004260 con 0x7f79d80cd870 2024-09-10T23:16:16.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.396+0000 7f79d67fc640 1 -- 172.21.15.90:0/2793322011 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79d0016070 con 0x7f79d80cd870 2024-09-10T23:16:16.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.396+0000 7f79d67fc640 1 -- 172.21.15.90:0/2793322011 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d000fa90 con 0x7f79d80cd870 2024-09-10T23:16:16.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.396+0000 7f79dfa7f640 1 -- 172.21.15.90:0/2793322011 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d815fb80 con 0x7f79d80cd870 2024-09-10T23:16:16.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.396+0000 7f79dfa7f640 1 -- 172.21.15.90:0/2793322011 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d8154110 con 0x7f79d80cd870 2024-09-10T23:16:16.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.397+0000 7f79dfa7f640 1 -- 172.21.15.90:0/2793322011 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d815ccb0 con 0x7f79d80cd870 2024-09-10T23:16:16.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.397+0000 7f79d67fc640 1 -- 172.21.15.90:0/2793322011 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f79d000fc30 con 0x7f79d80cd870 2024-09-10T23:16:16.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.398+0000 7f79d67fc640 1 --2- 172.21.15.90:0/2793322011 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f79c4077f70 0x7f79c407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:16.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.398+0000 7f79d67fc640 1 -- 172.21.15.90:0/2793322011 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f79d009a5d0 con 0x7f79d80cd870 2024-09-10T23:16:16.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.398+0000 7f79dd81b640 1 --2- 172.21.15.90:0/2793322011 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f79c4077f70 0x7f79c407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:16.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.399+0000 7f79dd81b640 1 --2- 172.21.15.90:0/2793322011 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f79c4077f70 0x7f79c407a430 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f79c8032000 tx=0x7f79c8001360 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:16.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.402+0000 7f79d67fc640 1 -- 172.21.15.90:0/2793322011 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f79d0063160 con 0x7f79d80cd870 2024-09-10T23:16:16.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.613+0000 7f79dfa7f640 1 -- 172.21.15.90:0/2793322011 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79d815c9d0 con 0x7f79d80cd870 2024-09-10T23:16:16.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.613+0000 7f79d67fc640 1 -- 172.21.15.90:0/2793322011 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7f79d0062a60 con 0x7f79d80cd870 2024-09-10T23:16:16.614 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:16.614 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":27,"btime":"2024-09-10T23:16:10:241620+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3624303902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3624303902},{"type":"v1","addr":"172.21.15.171:6837","nonce":3624303902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1743356090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1743356090},{"type":"v1","addr":"172.21.15.171:6836","nonce":1743356090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/2007304013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2007304013},{"type":"v1","addr":"172.21.15.90:6833","nonce":2007304013}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:16:07.583350+0000","modified":"2024-09-10T23:16:09.576927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5556":{"gid":5556,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/1708086583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1708086583},{"type":"v1","addr":"172.21.15.90:6835","nonce":1708086583}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5556,"qdb_cluster":[5556]},"id":4}]} 2024-09-10T23:16:16.615 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 27 2024-09-10T23:16:16.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.615+0000 7f79dfa7f640 1 -- 172.21.15.90:0/2793322011 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f79c4077f70 msgr2=0x7f79c407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:16.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.615+0000 7f79dfa7f640 1 --2- 172.21.15.90:0/2793322011 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f79c4077f70 0x7f79c407a430 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f79c8032000 tx=0x7f79c8001360 comp rx=0 tx=0).stop 2024-09-10T23:16:16.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.615+0000 7f79dfa7f640 1 -- 172.21.15.90:0/2793322011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79d80cd870 msgr2=0x7f79d81f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:16.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.615+0000 7f79dfa7f640 1 --2- 172.21.15.90:0/2793322011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79d80cd870 0x7f79d81f83c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f79d809da10 tx=0x7f79d0011b30 comp rx=0 tx=0).stop 2024-09-10T23:16:16.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.615+0000 7f79dfa7f640 1 -- 172.21.15.90:0/2793322011 shutdown_connections 2024-09-10T23:16:16.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.615+0000 7f79dfa7f640 1 --2- 172.21.15.90:0/2793322011 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f79c4077f70 0x7f79c407a430 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.615+0000 7f79dfa7f640 1 --2- 172.21.15.90:0/2793322011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79d80cd3f0 0x7f79d81f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.615+0000 7f79dfa7f640 1 --2- 172.21.15.90:0/2793322011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79d80cd870 0x7f79d81f83c0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.615+0000 7f79dfa7f640 1 --2- 172.21.15.90:0/2793322011 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79c0003c30 0x7f79d80b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.615+0000 7f79dfa7f640 1 -- 172.21.15.90:0/2793322011 >> 172.21.15.90:0/2793322011 conn(0x7f79d809d2a0 msgr2=0x7f79d80d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:16.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.615+0000 7f79dfa7f640 1 -- 172.21.15.90:0/2793322011 shutdown_connections 2024-09-10T23:16:16.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:16.615+0000 7f79dfa7f640 1 -- 172.21.15.90:0/2793322011 wait complete. 2024-09-10T23:16:17.029 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:16:07.583350+0000', 'modified': '2024-09-10T23:16:09.576927+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5556}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5556': {'gid': 5556, 'name': 'c', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.90:6835/1708086583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6834', 'nonce': 1708086583}, {'type': 'v1', 'addr': '172.21.15.90:6835', 'nonce': 1708086583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5556, 'qdb_cluster': [5556]} 2024-09-10T23:16:17.029 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:16:17.030 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T23:16:17.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.131+0000 7fd0beeed640 1 -- 172.21.15.90:0/1952022932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0b80d2960 msgr2=0x7fd0b80cfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:17.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.131+0000 7fd0beeed640 1 --2- 172.21.15.90:0/1952022932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0b80d2960 0x7fd0b80cfe50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac005fd0 tx=0x7fd0ac02a5d0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.131+0000 7fd0beeed640 1 -- 172.21.15.90:0/1952022932 shutdown_connections 2024-09-10T23:16:17.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.131+0000 7fd0beeed640 1 --2- 172.21.15.90:0/1952022932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0b80d0390 0x7fd0b80b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.131+0000 7fd0beeed640 1 --2- 172.21.15.90:0/1952022932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0b80d2960 0x7fd0b80cfe50 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.131+0000 7fd0beeed640 1 -- 172.21.15.90:0/1952022932 >> 172.21.15.90:0/1952022932 conn(0x7fd0b80d1dd0 msgr2=0x7fd0b80d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:17.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.131+0000 7fd0beeed640 1 -- 172.21.15.90:0/1952022932 shutdown_connections 2024-09-10T23:16:17.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.131+0000 7fd0beeed640 1 -- 172.21.15.90:0/1952022932 wait complete. 2024-09-10T23:16:17.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.132+0000 7fd0beeed640 1 Processor -- start 2024-09-10T23:16:17.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.132+0000 7fd0beeed640 1 -- start start 2024-09-10T23:16:17.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.133+0000 7fd0beeed640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0b80d0390 0x7fd0b81f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.133+0000 7fd0beeed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0b80d2960 0x7fd0b806f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.133+0000 7fd0beeed640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0b815c0c0 0x7fd0b80cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.133+0000 7fd0beeed640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b80b54f0 con 0x7fd0b80d2960 2024-09-10T23:16:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.133+0000 7fd0beeed640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b80b5370 con 0x7fd0b80d0390 2024-09-10T23:16:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.133+0000 7fd0beeed640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd0b80b5670 con 0x7fd0b815c0c0 2024-09-10T23:16:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.133+0000 7fd0b7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0b80d2960 0x7fd0b806f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.133+0000 7fd0b7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0b80d2960 0x7fd0b806f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54410/0 (socket says 172.21.15.90:54410) 2024-09-10T23:16:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.133+0000 7fd0b7fff640 1 -- 172.21.15.90:0/379495109 learned_addr learned my addr 172.21.15.90:0/379495109 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.133+0000 7fd0bd48a640 1 --2- 172.21.15.90:0/379495109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0b815c0c0 0x7fd0b80cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.133+0000 7fd0bcc89640 1 --2- 172.21.15.90:0/379495109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0b80d0390 0x7fd0b81f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.134+0000 7fd0b7fff640 1 -- 172.21.15.90:0/379495109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0b815c0c0 msgr2=0x7fd0b80cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.134+0000 7fd0b7fff640 1 --2- 172.21.15.90:0/379495109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0b815c0c0 0x7fd0b80cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.134+0000 7fd0b7fff640 1 -- 172.21.15.90:0/379495109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0b80d0390 msgr2=0x7fd0b81f8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.134+0000 7fd0b7fff640 1 --2- 172.21.15.90:0/379495109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0b80d0390 0x7fd0b81f8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.134+0000 7fd0b7fff640 1 -- 172.21.15.90:0/379495109 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b81f9170 con 0x7fd0b80d2960 2024-09-10T23:16:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.134+0000 7fd0b7fff640 1 --2- 172.21.15.90:0/379495109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0b80d2960 0x7fd0b806f010 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0099f0 tx=0x7fd0ac0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.134+0000 7fd0b57fa640 1 -- 172.21.15.90:0/379495109 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac03f070 con 0x7fd0b80d2960 2024-09-10T23:16:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.134+0000 7fd0b57fa640 1 -- 172.21.15.90:0/379495109 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0ac005600 con 0x7fd0b80d2960 2024-09-10T23:16:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.134+0000 7fd0beeed640 1 -- 172.21.15.90:0/379495109 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b806f550 con 0x7fd0b80d2960 2024-09-10T23:16:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.134+0000 7fd0b57fa640 1 -- 172.21.15.90:0/379495109 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac035030 con 0x7fd0b80d2960 2024-09-10T23:16:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.134+0000 7fd0beeed640 1 -- 172.21.15.90:0/379495109 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0b806e250 con 0x7fd0b80d2960 2024-09-10T23:16:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.136+0000 7fd0b57fa640 1 -- 172.21.15.90:0/379495109 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd0ac004a00 con 0x7fd0b80d2960 2024-09-10T23:16:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.136+0000 7fd0b57fa640 1 --2- 172.21.15.90:0/379495109 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0a4077f70 0x7fd0a407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.136+0000 7fd0b57fa640 1 -- 172.21.15.90:0/379495109 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fd0ac0bac20 con 0x7fd0b80d2960 2024-09-10T23:16:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.136+0000 7fd0bcc89640 1 --2- 172.21.15.90:0/379495109 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0a4077f70 0x7fd0a407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.137+0000 7fd0c1cc4740 1 Processor -- start 2024-09-10T23:16:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.137+0000 7fd0bcc89640 1 --2- 172.21.15.90:0/379495109 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0a4077f70 0x7fd0a407a430 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8007fd0 tx=0x7fd0a8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.137+0000 7fd0c1cc4740 1 -- start start 2024-09-10T23:16:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0c1cc4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0c91b0 0x55dbca0a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0c1cc4740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0e8df0 0x55dbca0e91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0c1cc4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca09e5f0 0x55dbca09ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0c1cc4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55dbca015820 con 0x55dbca0c91b0 2024-09-10T23:16:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0c1cc4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55dbca004c50 con 0x55dbca09e5f0 2024-09-10T23:16:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0c1cc4740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55dbca008a60 con 0x55dbca0e8df0 2024-09-10T23:16:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0bcc89640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0c91b0 0x55dbca0a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0bcc89640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0c91b0 0x55dbca0a0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54426/0 (socket says 172.21.15.90:54426) 2024-09-10T23:16:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0bcc89640 1 -- 172.21.15.90:0/2134851450 learned_addr learned my addr 172.21.15.90:0/2134851450 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0bd48a640 1 --2- 172.21.15.90:0/2134851450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca09e5f0 0x55dbca09ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0b7fff640 1 --2- 172.21.15.90:0/2134851450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0e8df0 0x55dbca0e91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0bcc89640 1 -- 172.21.15.90:0/2134851450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0e8df0 msgr2=0x55dbca0e91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0bcc89640 1 --2- 172.21.15.90:0/2134851450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0e8df0 0x55dbca0e91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0bcc89640 1 -- 172.21.15.90:0/2134851450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca09e5f0 msgr2=0x55dbca09ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0bcc89640 1 --2- 172.21.15.90:0/2134851450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca09e5f0 0x55dbca09ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0bcc89640 1 -- 172.21.15.90:0/2134851450 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbc9d66850 con 0x55dbca0c91b0 2024-09-10T23:16:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0b7fff640 1 --2- 172.21.15.90:0/2134851450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0e8df0 0x55dbca0e91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd0bcc89640 1 --2- 172.21.15.90:0/2134851450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0c91b0 0x55dbca0a0b20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800f990 tx=0x7fd0a8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b28b4350e02f34 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd09e7fc640 1 -- 172.21.15.90:0/2134851450 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8025070 con 0x55dbca0c91b0 2024-09-10T23:16:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd09e7fc640 1 -- 172.21.15.90:0/2134851450 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0a801b050 con 0x55dbca0c91b0 2024-09-10T23:16:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.138+0000 7fd09e7fc640 1 -- 172.21.15.90:0/2134851450 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8014e40 con 0x55dbca0c91b0 2024-09-10T23:16:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.139+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2134851450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0c91b0 msgr2=0x55dbca0a0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.139+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/2134851450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0c91b0 0x55dbca0a0b20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800f990 tx=0x7fd0a8012000 comp rx=0 tx=0).stop 2024-09-10T23:16:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.139+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2134851450 shutdown_connections 2024-09-10T23:16:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.139+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/2134851450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca09e5f0 0x55dbca09ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.139+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/2134851450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0e8df0 0x55dbca0e91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.139+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/2134851450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0c91b0 0x55dbca0a0b20 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.139+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2134851450 >> 172.21.15.90:0/2134851450 conn(0x55dbca09f6a0 msgr2=0x55dbca0a30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.139+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2134851450 shutdown_connections 2024-09-10T23:16:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.139+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2134851450 wait complete. 2024-09-10T23:16:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.140+0000 7fd0c1cc4740 1 -- start start 2024-09-10T23:16:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.140+0000 7fd0c1cc4740 1 Processor -- start 2024-09-10T23:16:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0c1cc4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca0c91b0 0x55dbca0c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0c1cc4740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0e8df0 0x55dbca0e1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0c1cc4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca0e05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0c1cc4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55dbc9d75620 con 0x55dbca0e18d0 2024-09-10T23:16:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0c1cc4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55dbc9faa5f0 con 0x55dbca0c91b0 2024-09-10T23:16:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0c1cc4740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55dbca09db30 con 0x55dbca0e8df0 2024-09-10T23:16:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0c1cc4740 10 client.0 _ll_register_callbacks cb 0x55dbc9fae0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:16:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0bd48a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca0e05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0bd48a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca0e05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54436/0 (socket says 172.21.15.90:54436) 2024-09-10T23:16:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0bd48a640 1 -- 172.21.15.90:0/2967186831 learned_addr learned my addr 172.21.15.90:0/2967186831 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0bcc89640 1 --2- 172.21.15.90:0/2967186831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca0c91b0 0x55dbca0c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0b7fff640 1 --2- 172.21.15.90:0/2967186831 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0e8df0 0x55dbca0e1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0bd48a640 1 -- 172.21.15.90:0/2967186831 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0e8df0 msgr2=0x55dbca0e1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0bd48a640 1 --2- 172.21.15.90:0/2967186831 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0e8df0 0x55dbca0e1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0bd48a640 1 -- 172.21.15.90:0/2967186831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca0c91b0 msgr2=0x55dbca0c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0bd48a640 1 --2- 172.21.15.90:0/2967186831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca0c91b0 0x55dbca0c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0bd48a640 1 -- 172.21.15.90:0/2967186831 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbc9ddd6b0 con 0x55dbca0e18d0 2024-09-10T23:16:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0b7fff640 1 --2- 172.21.15.90:0/2967186831 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0e8df0 0x55dbca0e1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0bd48a640 1 --2- 172.21.15.90:0/2967186831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca0e05c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd0b00139f0 tx=0x7fd0b0013eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6795c5b49578362c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0977fe640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:16:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0977fe640 1 -- 172.21.15.90:0/2967186831 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0003970 con 0x55dbca0e18d0 2024-09-10T23:16:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0977fe640 1 -- 172.21.15.90:0/2967186831 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fd0b0003b10 con 0x55dbca0e18d0 2024-09-10T23:16:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2967186831 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0a801b050 con 0x55dbca0e18d0 2024-09-10T23:16:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0977fe640 1 -- 172.21.15.90:0/2967186831 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd0b0003d10 con 0x55dbca0e18d0 2024-09-10T23:16:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0c1cc4740 10 client.5712 fetch_fsmap learned FSMap version 27 2024-09-10T23:16:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.141+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2967186831 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55dbca0c4020 con 0x55dbca0e18d0 2024-09-10T23:16:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.142+0000 7fd0977fe640 1 -- 172.21.15.90:0/2967186831 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0a801b050 con 0x55dbca0e18d0 2024-09-10T23:16:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.142+0000 7fd0977fe640 1 -- 172.21.15.90:0/2967186831 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fd0b0024050 con 0x55dbca0e18d0 2024-09-10T23:16:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.142+0000 7fd0c1cc4740 10 client.5712 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:16:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.142+0000 7fd0c1cc4740 10 client.5712 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:16:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.142+0000 7fd0c1cc4740 20 client.5712 populate_metadata read hostname 'smithi090' 2024-09-10T23:16:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.142+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/2967186831 >> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] conn(0x55dbca0fba40 0x55dbca0c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.142+0000 7fd0c1cc4740 4 client.5712 mds_command: new command op to 5556 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:16:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.142+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2967186831 --> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbca017770 con 0x55dbca0fba40 2024-09-10T23:16:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.142+0000 7fd0bcc89640 1 --2- 172.21.15.90:0/2967186831 >> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] conn(0x55dbca0fba40 0x55dbca0c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.142+0000 7fd0977fe640 10 client.5712 ms_handle_connect on v2:172.21.15.90:6834/1708086583 2024-09-10T23:16:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.142+0000 7fd0bcc89640 1 --2- 172.21.15.90:0/2967186831 >> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] conn(0x55dbca0fba40 0x55dbca0c32d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10d583d8202ff75b server_cookie=4670db3f9cd22db5 in_seq=0 out_seq=0 2024-09-10T23:16:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.143+0000 7fd0977fe640 1 -- 172.21.15.90:0/2967186831 <== mds.0 v2:172.21.15.90:6834/1708086583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dbca017770 con 0x55dbca0fba40 2024-09-10T23:16:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.143+0000 7fd0977fe640 10 client.5712 handle_command_reply: tid=0 2024-09-10T23:16:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.143+0000 7fd0c1cc4740 1 client.5712 shutdown 2024-09-10T23:16:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.143+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2967186831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 msgr2=0x55dbca0e05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.143+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/2967186831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca0e05c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd0b00139f0 tx=0x7fd0b0013eb0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.143+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2967186831 shutdown_connections 2024-09-10T23:16:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.143+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/2967186831 >> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] conn(0x55dbca0fba40 0x55dbca0c32d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.143+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/2967186831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca0e05c0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.143+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/2967186831 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0e8df0 0x55dbca0e1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.143+0000 7fd0977fe640 0 client.5712 ms_handle_reset on v2:172.21.15.90:6834/1708086583 2024-09-10T23:16:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.143+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/2967186831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca0c91b0 0x55dbca0c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.143+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2967186831 >> 172.21.15.90:0/2967186831 conn(0x55dbca09e5f0 msgr2=0x55dbca0c9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.143+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2967186831 shutdown_connections 2024-09-10T23:16:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.143+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2967186831 wait complete. 2024-09-10T23:16:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.143+0000 7fd0c1cc4740 20 client.5712 trim_cache size 0 max 16384 2024-09-10T23:16:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.161+0000 7fd0c1cc4740 1 Processor -- start 2024-09-10T23:16:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.161+0000 7fd0c1cc4740 1 -- start start 2024-09-10T23:16:17.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.162+0000 7fd0c1cc4740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0c91b0 0x55dbca09cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.162+0000 7fd0c1cc4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca09d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.162+0000 7fd0c1cc4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca0e8df0 0x55dbca10bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.162+0000 7fd0c1cc4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b81f4b00 con 0x55dbca0e18d0 2024-09-10T23:16:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.162+0000 7fd0c1cc4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b81f3e60 con 0x55dbca0e8df0 2024-09-10T23:16:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.162+0000 7fd0c1cc4740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd0b81f44b0 con 0x55dbca0c91b0 2024-09-10T23:16:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.162+0000 7fd0b7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca09d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.162+0000 7fd0b7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca09d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54440/0 (socket says 172.21.15.90:54440) 2024-09-10T23:16:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.162+0000 7fd0b7fff640 1 -- 172.21.15.90:0/2445889519 learned_addr learned my addr 172.21.15.90:0/2445889519 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.162+0000 7fd0b7fff640 1 -- 172.21.15.90:0/2445889519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0c91b0 msgr2=0x55dbca09cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.162+0000 7fd0b7fff640 1 --2- 172.21.15.90:0/2445889519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0c91b0 0x55dbca09cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.162+0000 7fd0b7fff640 1 -- 172.21.15.90:0/2445889519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca0e8df0 msgr2=0x55dbca10bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.162+0000 7fd0b7fff640 1 --2- 172.21.15.90:0/2445889519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca0e8df0 0x55dbca10bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.162+0000 7fd0b7fff640 1 -- 172.21.15.90:0/2445889519 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbca0e1fe0 con 0x55dbca0e18d0 2024-09-10T23:16:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.162+0000 7fd0b7fff640 1 --2- 172.21.15.90:0/2445889519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca09d0d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0803d0 tx=0x7fd0ac07f0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c548ae5d3c1f41 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.162+0000 7fd09dffb640 1 -- 172.21.15.90:0/2445889519 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac049040 con 0x55dbca0e18d0 2024-09-10T23:16:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.162+0000 7fd09dffb640 1 -- 172.21.15.90:0/2445889519 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0ac08a0d0 con 0x55dbca0e18d0 2024-09-10T23:16:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.163+0000 7fd09dffb640 1 -- 172.21.15.90:0/2445889519 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac0828d0 con 0x55dbca0e18d0 2024-09-10T23:16:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.163+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2445889519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 msgr2=0x55dbca09d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.163+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/2445889519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca09d0d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0803d0 tx=0x7fd0ac07f0c0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.163+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2445889519 shutdown_connections 2024-09-10T23:16:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.163+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/2445889519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca0e8df0 0x55dbca10bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.163+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/2445889519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca09d0d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.163+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/2445889519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0c91b0 0x55dbca09cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.163+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2445889519 >> 172.21.15.90:0/2445889519 conn(0x55dbca09e5f0 msgr2=0x55dbca09ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.163+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2445889519 shutdown_connections 2024-09-10T23:16:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.163+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/2445889519 wait complete. 2024-09-10T23:16:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.164+0000 7fd0c1cc4740 1 -- start start 2024-09-10T23:16:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.164+0000 7fd0c1cc4740 1 Processor -- start 2024-09-10T23:16:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0c1cc4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca0c91b0 0x55dbca09d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0c1cc4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca16d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0c1cc4740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0e8df0 0x55dbca160910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0c1cc4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55dbca0fb8c0 con 0x55dbca0e18d0 2024-09-10T23:16:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0c1cc4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55dbca0c56a0 con 0x55dbca0c91b0 2024-09-10T23:16:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0c1cc4740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55dbca0fbf10 con 0x55dbca0e8df0 2024-09-10T23:16:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0c1cc4740 10 client.0 _ll_register_callbacks cb 0x7fd0b0009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:16:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0b7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca16d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0b7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca16d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54452/0 (socket says 172.21.15.90:54452) 2024-09-10T23:16:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0b7fff640 1 -- 172.21.15.90:0/3123960934 learned_addr learned my addr 172.21.15.90:0/3123960934 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0bcc89640 1 --2- 172.21.15.90:0/3123960934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca0c91b0 0x55dbca09d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0bd48a640 1 --2- 172.21.15.90:0/3123960934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0e8df0 0x55dbca160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0b7fff640 1 -- 172.21.15.90:0/3123960934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0e8df0 msgr2=0x55dbca160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0b7fff640 1 --2- 172.21.15.90:0/3123960934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0e8df0 0x55dbca160910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0b7fff640 1 -- 172.21.15.90:0/3123960934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca0c91b0 msgr2=0x55dbca09d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0b7fff640 1 --2- 172.21.15.90:0/3123960934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca0c91b0 0x55dbca09d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0b7fff640 1 -- 172.21.15.90:0/3123960934 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbca0c0a10 con 0x55dbca0e18d0 2024-09-10T23:16:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0bcc89640 1 --2- 172.21.15.90:0/3123960934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca0c91b0 0x55dbca09d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0b7fff640 1 --2- 172.21.15.90:0/3123960934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca16d600 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac08c010 tx=0x7fd0ac08c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ba8ef635183d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0977fe640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:16:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0977fe640 1 -- 172.21.15.90:0/3123960934 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac049040 con 0x55dbca0e18d0 2024-09-10T23:16:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0977fe640 1 -- 172.21.15.90:0/3123960934 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fd0ac0825d0 con 0x55dbca0e18d0 2024-09-10T23:16:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/3123960934 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dbca013220 con 0x55dbca0e18d0 2024-09-10T23:16:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0977fe640 1 -- 172.21.15.90:0/3123960934 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd0ac082c70 con 0x55dbca0e18d0 2024-09-10T23:16:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0c1cc4740 10 client.5718 fetch_fsmap learned FSMap version 27 2024-09-10T23:16:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.165+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/3123960934 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55dbca102420 con 0x55dbca0e18d0 2024-09-10T23:16:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0977fe640 1 -- 172.21.15.90:0/3123960934 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55dbca013220 con 0x55dbca0e18d0 2024-09-10T23:16:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0977fe640 1 -- 172.21.15.90:0/3123960934 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fd0ac098ba0 con 0x55dbca0e18d0 2024-09-10T23:16:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0c1cc4740 10 client.5718 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:16:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0c1cc4740 10 client.5718 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:16:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0c1cc4740 20 client.5718 populate_metadata read hostname 'smithi090' 2024-09-10T23:16:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/3123960934 >> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] conn(0x55dbca0dfdf0 0x55dbca0e01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0c1cc4740 4 client.5718 mds_command: new command op to 5556 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:16:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/3123960934 --> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] -- command(tid 0: {"prefix": "status"}) -- 0x55dbca010650 con 0x55dbca0dfdf0 2024-09-10T23:16:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0bcc89640 1 --2- 172.21.15.90:0/3123960934 >> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] conn(0x55dbca0dfdf0 0x55dbca0e01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0977fe640 10 client.5718 ms_handle_connect on v2:172.21.15.90:6834/1708086583 2024-09-10T23:16:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0bcc89640 1 --2- 172.21.15.90:0/3123960934 >> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] conn(0x55dbca0dfdf0 0x55dbca0e01d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75152f572f5b3623 server_cookie=a06156f02ba4b05 in_seq=0 out_seq=0 2024-09-10T23:16:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0977fe640 1 -- 172.21.15.90:0/3123960934 <== mds.0 v2:172.21.15.90:6834/1708086583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55dbca010650 con 0x55dbca0dfdf0 2024-09-10T23:16:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0977fe640 10 client.5718 handle_command_reply: tid=0 2024-09-10T23:16:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0c1cc4740 1 client.5718 shutdown 2024-09-10T23:16:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/3123960934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 msgr2=0x55dbca16d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/3123960934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca16d600 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac08c010 tx=0x7fd0ac08c350 comp rx=0 tx=0).stop 2024-09-10T23:16:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/3123960934 shutdown_connections 2024-09-10T23:16:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.166+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/3123960934 >> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] conn(0x55dbca0dfdf0 0x55dbca0e01d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/3123960934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dbca0e8df0 0x55dbca160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/3123960934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dbca0e18d0 0x55dbca16d600 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0977fe640 0 client.5718 ms_handle_reset on v2:172.21.15.90:6834/1708086583 2024-09-10T23:16:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0c1cc4740 1 --2- 172.21.15.90:0/3123960934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbca0c91b0 0x55dbca09d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/3123960934 >> 172.21.15.90:0/3123960934 conn(0x55dbca09e5f0 msgr2=0x55dbca0c9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/3123960934 shutdown_connections 2024-09-10T23:16:17.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0c1cc4740 1 -- 172.21.15.90:0/3123960934 wait complete. 2024-09-10T23:16:17.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0c1cc4740 20 client.5718 trim_cache size 0 max 16384 2024-09-10T23:16:17.174 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:16:17.174 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd", 2024-09-10T23:16:17.174 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2024-09-10T23:16:17.174 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 5556, 2024-09-10T23:16:17.174 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-09-10T23:16:17.174 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-09-10T23:16:17.174 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2024-09-10T23:16:17.174 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 8.9342585450000005, 2024-09-10T23:16:17.175 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 27, 2024-09-10T23:16:17.175 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 57, 2024-09-10T23:16:17.175 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 57, 2024-09-10T23:16:17.175 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 12.680567577 2024-09-10T23:16:17.175 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:16:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0beeed640 1 -- 172.21.15.90:0/379495109 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0a4077f70 msgr2=0x7fd0a407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0beeed640 1 --2- 172.21.15.90:0/379495109 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0a4077f70 0x7fd0a407a430 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8007fd0 tx=0x7fd0a8009040 comp rx=0 tx=0).stop 2024-09-10T23:16:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0beeed640 1 -- 172.21.15.90:0/379495109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0b80d2960 msgr2=0x7fd0b806f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0beeed640 1 --2- 172.21.15.90:0/379495109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0b80d2960 0x7fd0b806f010 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0099f0 tx=0x7fd0ac0038a0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0beeed640 1 -- 172.21.15.90:0/379495109 shutdown_connections 2024-09-10T23:16:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0beeed640 1 --2- 172.21.15.90:0/379495109 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0a4077f70 0x7fd0a407a430 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0beeed640 1 --2- 172.21.15.90:0/379495109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0b815c0c0 0x7fd0b80cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0beeed640 1 --2- 172.21.15.90:0/379495109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0b80d2960 0x7fd0b806f010 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0beeed640 1 --2- 172.21.15.90:0/379495109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0b80d0390 0x7fd0b81f8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0beeed640 1 -- 172.21.15.90:0/379495109 >> 172.21.15.90:0/379495109 conn(0x7fd0b80d1dd0 msgr2=0x7fd0b80b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0beeed640 1 -- 172.21.15.90:0/379495109 shutdown_connections 2024-09-10T23:16:17.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.167+0000 7fd0beeed640 1 -- 172.21.15.90:0/379495109 wait complete. 2024-09-10T23:16:17.179 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:16:17.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.278+0000 7f0256471640 1 -- 172.21.15.90:0/2353701008 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f025015aa30 msgr2=0x7f02500ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.278+0000 7f0256471640 1 --2- 172.21.15.90:0/2353701008 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f025015aa30 0x7f02500ca420 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0250072cb0 tx=0x7f024002a4d0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.278+0000 7f0256471640 1 -- 172.21.15.90:0/2353701008 shutdown_connections 2024-09-10T23:16:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.278+0000 7f0256471640 1 --2- 172.21.15.90:0/2353701008 >> v2:172.21.15.171:3300/0 conn(0x7f02500b1f60 0x7f02500cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.278+0000 7f0256471640 1 --2- 172.21.15.90:0/2353701008 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f025015aa30 0x7f02500ca420 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.278+0000 7f0256471640 1 -- 172.21.15.90:0/2353701008 >> 172.21.15.90:0/2353701008 conn(0x7f02500cc850 msgr2=0x7f02500ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.278+0000 7f0256471640 1 -- 172.21.15.90:0/2353701008 shutdown_connections 2024-09-10T23:16:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.278+0000 7f0256471640 1 -- 172.21.15.90:0/2353701008 wait complete. 2024-09-10T23:16:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.279+0000 7f0256471640 1 Processor -- start 2024-09-10T23:16:17.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.280+0000 7f0256471640 1 -- start start 2024-09-10T23:16:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.280+0000 7f0256471640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02500b1f60 0x7f02500c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.280+0000 7f0256471640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f025015aa30 0x7f0250151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.280+0000 7f0256471640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02500c9a80 0x7f0250152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.280+0000 7f0256471640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f02500ce390 con 0x7f02500b1f60 2024-09-10T23:16:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.280+0000 7f0256471640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f02500ce210 con 0x7f025015aa30 2024-09-10T23:16:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.280+0000 7f0256471640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f02500ce510 con 0x7f02500c9a80 2024-09-10T23:16:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.281+0000 7f024ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02500b1f60 0x7f02500c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.281+0000 7f024ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02500b1f60 0x7f02500c7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54480/0 (socket says 172.21.15.90:54480) 2024-09-10T23:16:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.281+0000 7f024ffff640 1 -- 172.21.15.90:0/4224062864 learned_addr learned my addr 172.21.15.90:0/4224062864 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:17.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.281+0000 7f0254a0e640 1 --2- 172.21.15.90:0/4224062864 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02500c9a80 0x7f0250152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.281+0000 7f024f7fe640 1 --2- 172.21.15.90:0/4224062864 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f025015aa30 0x7f0250151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.281+0000 7f024ffff640 1 -- 172.21.15.90:0/4224062864 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02500c9a80 msgr2=0x7f0250152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:17.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.281+0000 7f024ffff640 1 --2- 172.21.15.90:0/4224062864 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02500c9a80 0x7f0250152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.281+0000 7f024ffff640 1 -- 172.21.15.90:0/4224062864 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f025015aa30 msgr2=0x7f0250151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:17.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.281+0000 7f024ffff640 1 --2- 172.21.15.90:0/4224062864 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f025015aa30 0x7f0250151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.281+0000 7f024ffff640 1 -- 172.21.15.90:0/4224062864 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f025015d1c0 con 0x7f02500b1f60 2024-09-10T23:16:17.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.281+0000 7f024ffff640 1 --2- 172.21.15.90:0/4224062864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02500b1f60 0x7f02500c7470 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f02400099c0 tx=0x7f02400039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:17.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.282+0000 7f024cff9640 1 -- 172.21.15.90:0/4224062864 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024003f070 con 0x7f02500b1f60 2024-09-10T23:16:17.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.282+0000 7f024cff9640 1 -- 172.21.15.90:0/4224062864 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0240004890 con 0x7f02500b1f60 2024-09-10T23:16:17.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.282+0000 7f0256471640 1 -- 172.21.15.90:0/4224062864 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f025015d460 con 0x7f02500b1f60 2024-09-10T23:16:17.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.282+0000 7f024cff9640 1 -- 172.21.15.90:0/4224062864 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240035030 con 0x7f02500b1f60 2024-09-10T23:16:17.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.282+0000 7f0256471640 1 -- 172.21.15.90:0/4224062864 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f025015da20 con 0x7f02500b1f60 2024-09-10T23:16:17.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.283+0000 7f0256471640 1 -- 172.21.15.90:0/4224062864 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02500cdcd0 con 0x7f02500b1f60 2024-09-10T23:16:17.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.284+0000 7f024cff9640 1 -- 172.21.15.90:0/4224062864 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0240004ce0 con 0x7f02500b1f60 2024-09-10T23:16:17.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.284+0000 7f024cff9640 1 --2- 172.21.15.90:0/4224062864 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f023c077f70 0x7f023c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:17.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.285+0000 7f024cff9640 1 -- 172.21.15.90:0/4224062864 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f02400bae50 con 0x7f02500b1f60 2024-09-10T23:16:17.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.285+0000 7f024f7fe640 1 --2- 172.21.15.90:0/4224062864 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f023c077f70 0x7f023c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:17.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.285+0000 7f024f7fe640 1 --2- 172.21.15.90:0/4224062864 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f023c077f70 0x7f023c07a430 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0244004f60 tx=0x7f0244007e30 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:17.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.289+0000 7f024cff9640 1 -- 172.21.15.90:0/4224062864 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0240083390 con 0x7f02500b1f60 2024-09-10T23:16:17.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.496+0000 7f0256471640 1 -- 172.21.15.90:0/4224062864 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f02501529a0 con 0x7f02500b1f60 2024-09-10T23:16:17.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.496+0000 7f024cff9640 1 -- 172.21.15.90:0/4224062864 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f0240087dc0 con 0x7f02500b1f60 2024-09-10T23:16:17.497 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:16:17.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.498+0000 7f0256471640 1 -- 172.21.15.90:0/4224062864 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f023c077f70 msgr2=0x7f023c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:17.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.498+0000 7f0256471640 1 --2- 172.21.15.90:0/4224062864 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f023c077f70 0x7f023c07a430 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0244004f60 tx=0x7f0244007e30 comp rx=0 tx=0).stop 2024-09-10T23:16:17.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.498+0000 7f0256471640 1 -- 172.21.15.90:0/4224062864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02500b1f60 msgr2=0x7f02500c7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:17.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.498+0000 7f0256471640 1 --2- 172.21.15.90:0/4224062864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02500b1f60 0x7f02500c7470 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f02400099c0 tx=0x7f02400039e0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.498+0000 7f0256471640 1 -- 172.21.15.90:0/4224062864 shutdown_connections 2024-09-10T23:16:17.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.498+0000 7f0256471640 1 --2- 172.21.15.90:0/4224062864 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f023c077f70 0x7f023c07a430 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.498+0000 7f0256471640 1 --2- 172.21.15.90:0/4224062864 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f025015aa30 0x7f0250151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.498+0000 7f0256471640 1 --2- 172.21.15.90:0/4224062864 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02500c9a80 0x7f0250152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.498+0000 7f0256471640 1 --2- 172.21.15.90:0/4224062864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02500b1f60 0x7f02500c7470 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:17.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.498+0000 7f0256471640 1 -- 172.21.15.90:0/4224062864 >> 172.21.15.90:0/4224062864 conn(0x7f02500cc850 msgr2=0x7f02500ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:17.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.499+0000 7f0256471640 1 -- 172.21.15.90:0/4224062864 shutdown_connections 2024-09-10T23:16:17.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17.499+0000 7f0256471640 1 -- 172.21.15.90:0/4224062864 wait complete. 2024-09-10T23:16:17.510 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:16:17.510 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:16:17.510 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2024-09-10T23:16:17.510 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:16:17.510 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:17.510 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:16:17.510 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:16:17.510 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:16:17.510 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:16:17.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:17.511 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2024-09-10T23:16:17.526 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:16:17.526 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:16:17.527 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:17.528 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:16:17.528 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:17.528 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:16:17.528 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42670sec preferred_lft 42670sec 2024-09-10T23:16:17.528 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link noprefixroute 2024-09-10T23:16:17.528 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:17.528 INFO:teuthology.orchestra.run.smithi090.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:16:17.528 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:17.528 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:16:17.528 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:17.528 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::882a:a9ff:fefc:893f/64 scope link 2024-09-10T23:16:17.528 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:17.528 INFO:teuthology.orchestra.run.smithi090.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:16:17.529 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 76:ad:51:1a:2a:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:17.529 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::74ad:51ff:fe1a:2a60/64 scope link 2024-09-10T23:16:17.529 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:17.529 INFO:teuthology.orchestra.run.smithi090.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:16:17.529 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:16:17.529 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::3414:abff:fe49:366c/64 scope link 2024-09-10T23:16:17.529 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:17.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:17.529 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:16:17.590 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-09-10T23:16:17.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:17.592 DEBUG:teuthology.orchestra.run.smithi090:> route 2024-09-10T23:16:17.647 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2024-09-10T23:16:17.649 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:16:17.649 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:16:17.649 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:16:17.649 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:16:17.649 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:17.649 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:16:17.649 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:16:17.649 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:16:17.650 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:16:17.650 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:16:17.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:17.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:17.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:17.773 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-10T23:16:17.789 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:16:17.789 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:16:17.789 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:16:17.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:17.789 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2024-09-10T23:16:17.853 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:17.854 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:17.909 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:16:17.910 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:17.910 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:17.965 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:16:17.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:17.965 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:16:18.048 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:16:18.048 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:16:18.048 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:16:18.056 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:16:18.056 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:16:18.057 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:16:18.057 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:16:18.057 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:16:18.061 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:16:18.061 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:16:18.062 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:16:18.062 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:16:18.062 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:16:18.062 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:16:18.062 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:16:18.062 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:16:18.062 INFO:teuthology.orchestra.run.smithi090.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T23:16:18.062 INFO:teuthology.orchestra.run.smithi090.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:16:18.062 INFO:teuthology.orchestra.run.smithi090.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:16:18.063 INFO:teuthology.orchestra.run.smithi090.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:16:18.063 INFO:teuthology.orchestra.run.smithi090.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:16:18.064 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:16:18.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:18.064 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:18.131 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:16:18.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:16:18.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:18.230 INFO:teuthology.orchestra.run.smithi090.stdout:client5727 2024-09-10T23:16:18.230 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:16:18.230 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:18.246 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:16:18.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.388+0000 7fae16317640 1 -- 172.21.15.90:0/3586123929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae1006f160 msgr2=0x7fae100ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:18.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.388+0000 7fae16317640 1 --2- 172.21.15.90:0/3586123929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae1006f160 0x7fae100ca420 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fae100701c0 tx=0x7fae0802aa30 comp rx=0 tx=0).stop 2024-09-10T23:16:18.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.388+0000 7fae16317640 1 -- 172.21.15.90:0/3586123929 shutdown_connections 2024-09-10T23:16:18.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.388+0000 7fae16317640 1 --2- 172.21.15.90:0/3586123929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae1006f160 0x7fae100ca420 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:18.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.388+0000 7fae16317640 1 --2- 172.21.15.90:0/3586123929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae1006f850 0x7fae1006ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:18.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.388+0000 7fae16317640 1 --2- 172.21.15.90:0/3586123929 >> v2:172.21.15.171:3300/0 conn(0x7fae1015bcb0 0x7fae100cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:18.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.388+0000 7fae16317640 1 -- 172.21.15.90:0/3586123929 >> 172.21.15.90:0/3586123929 conn(0x7fae100cc850 msgr2=0x7fae100ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:18.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.388+0000 7fae16317640 1 -- 172.21.15.90:0/3586123929 shutdown_connections 2024-09-10T23:16:18.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.388+0000 7fae16317640 1 -- 172.21.15.90:0/3586123929 wait complete. 2024-09-10T23:16:18.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.389+0000 7fae16317640 1 Processor -- start 2024-09-10T23:16:18.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.389+0000 7fae16317640 1 -- start start 2024-09-10T23:16:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.390+0000 7fae16317640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae1006f160 0x7fae100b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.390+0000 7fae16317640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae1006f850 0x7fae100c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.390+0000 7fae16317640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae1015bcb0 0x7fae100c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.390+0000 7fae16317640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fae100cacf0 con 0x7fae1006f160 2024-09-10T23:16:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.390+0000 7fae16317640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fae100cab70 con 0x7fae1015bcb0 2024-09-10T23:16:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.390+0000 7fae16317640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fae1015c1d0 con 0x7fae1006f850 2024-09-10T23:16:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.390+0000 7fae0ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae1006f160 0x7fae100b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.390+0000 7fae0ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae1006f160 0x7fae100b5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42746/0 (socket says 172.21.15.90:42746) 2024-09-10T23:16:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.390+0000 7fae0ffff640 1 -- 172.21.15.90:0/3554348289 learned_addr learned my addr 172.21.15.90:0/3554348289 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.390+0000 7fae148b4640 1 --2- 172.21.15.90:0/3554348289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae1015bcb0 0x7fae100c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.390+0000 7fae0ffff640 1 -- 172.21.15.90:0/3554348289 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae1006f850 msgr2=0x7fae100c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.390+0000 7fae0ffff640 1 --2- 172.21.15.90:0/3554348289 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae1006f850 0x7fae100c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:18.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.390+0000 7fae0ffff640 1 -- 172.21.15.90:0/3554348289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae1015bcb0 msgr2=0x7fae100c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:18.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.390+0000 7fae0ffff640 1 --2- 172.21.15.90:0/3554348289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae1015bcb0 0x7fae100c3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:18.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.390+0000 7fae0ffff640 1 -- 172.21.15.90:0/3554348289 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1014cad0 con 0x7fae1006f160 2024-09-10T23:16:18.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.390+0000 7fae0ffff640 1 --2- 172.21.15.90:0/3554348289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae1006f160 0x7fae100b5090 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fae0000b440 tx=0x7fae0000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:18.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.390+0000 7fae0cff9640 1 -- 172.21.15.90:0/3554348289 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00015020 con 0x7fae1006f160 2024-09-10T23:16:18.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.391+0000 7fae0cff9640 1 -- 172.21.15.90:0/3554348289 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae00011980 con 0x7fae1006f160 2024-09-10T23:16:18.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.391+0000 7fae0cff9640 1 -- 172.21.15.90:0/3554348289 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00011dd0 con 0x7fae1006f160 2024-09-10T23:16:18.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.391+0000 7fae16317640 1 -- 172.21.15.90:0/3554348289 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1014bd10 con 0x7fae1006f160 2024-09-10T23:16:18.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.391+0000 7fae16317640 1 -- 172.21.15.90:0/3554348289 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae1014c2d0 con 0x7fae1006f160 2024-09-10T23:16:18.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.392+0000 7fae16317640 1 -- 172.21.15.90:0/3554348289 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae1006ec20 con 0x7fae1006f160 2024-09-10T23:16:18.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.392+0000 7fae0cff9640 1 -- 172.21.15.90:0/3554348289 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fae0001a400 con 0x7fae1006f160 2024-09-10T23:16:18.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.393+0000 7fae0cff9640 1 --2- 172.21.15.90:0/3554348289 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fadfc077f70 0x7fadfc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:18.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.393+0000 7fae0cff9640 1 -- 172.21.15.90:0/3554348289 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fae0009a110 con 0x7fae1006f160 2024-09-10T23:16:18.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.393+0000 7fae0f7fe640 1 --2- 172.21.15.90:0/3554348289 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fadfc077f70 0x7fadfc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:18.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.394+0000 7fae0f7fe640 1 --2- 172.21.15.90:0/3554348289 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fadfc077f70 0x7fadfc07a430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fae10159c60 tx=0x7fae04006c90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:18.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.397+0000 7fae0cff9640 1 -- 172.21.15.90:0/3554348289 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fae0001f020 con 0x7fae1006f160 2024-09-10T23:16:18.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.611+0000 7fae16317640 1 -- 172.21.15.90:0/3554348289 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fae100b12f0 con 0x7fae1006f160 2024-09-10T23:16:18.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.611+0000 7fae0cff9640 1 -- 172.21.15.90:0/3554348289 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7fae0000d040 con 0x7fae1006f160 2024-09-10T23:16:18.612 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:16:18.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.613+0000 7fae16317640 1 -- 172.21.15.90:0/3554348289 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fadfc077f70 msgr2=0x7fadfc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:18.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.613+0000 7fae16317640 1 --2- 172.21.15.90:0/3554348289 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fadfc077f70 0x7fadfc07a430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fae10159c60 tx=0x7fae04006c90 comp rx=0 tx=0).stop 2024-09-10T23:16:18.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.613+0000 7fae16317640 1 -- 172.21.15.90:0/3554348289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae1006f160 msgr2=0x7fae100b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:18.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.613+0000 7fae16317640 1 --2- 172.21.15.90:0/3554348289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae1006f160 0x7fae100b5090 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fae0000b440 tx=0x7fae0000b900 comp rx=0 tx=0).stop 2024-09-10T23:16:18.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.613+0000 7fae16317640 1 -- 172.21.15.90:0/3554348289 shutdown_connections 2024-09-10T23:16:18.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.613+0000 7fae16317640 1 --2- 172.21.15.90:0/3554348289 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fadfc077f70 0x7fadfc07a430 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:18.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.613+0000 7fae16317640 1 --2- 172.21.15.90:0/3554348289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae1015bcb0 0x7fae100c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:18.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.613+0000 7fae16317640 1 --2- 172.21.15.90:0/3554348289 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae1006f850 0x7fae100c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:18.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.613+0000 7fae16317640 1 --2- 172.21.15.90:0/3554348289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae1006f160 0x7fae100b5090 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:18.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.613+0000 7fae16317640 1 -- 172.21.15.90:0/3554348289 >> 172.21.15.90:0/3554348289 conn(0x7fae100cc850 msgr2=0x7fae100add00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:18.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.613+0000 7fae16317640 1 -- 172.21.15.90:0/3554348289 shutdown_connections 2024-09-10T23:16:18.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:18.613+0000 7fae16317640 1 -- 172.21.15.90:0/3554348289 wait complete. 2024-09-10T23:16:18.625 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:16:18.625 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:16:18.625 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-09-10T23:16:18.626 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T23:16:18.626 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:18.626 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:16:18.626 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:16:18.626 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:16:18.626 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:16:18.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:18.626 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-09-10T23:16:18.646 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:16:18.646 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:16:18.648 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:18.648 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:16:18.648 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42652sec preferred_lft 42652sec 2024-09-10T23:16:18.648 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link noprefixroute 2024-09-10T23:16:18.648 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:18.648 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:16:18.648 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:18.648 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:16:18.648 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:18.648 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::c18:12ff:fe41:788b/64 scope link 2024-09-10T23:16:18.648 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:18.648 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:16:18.649 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:16:18.649 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a0e4:c6ff:fe48:8d44/64 scope link 2024-09-10T23:16:18.649 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:18.649 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:16:18.649 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a6:c9:8b:0f:78:86 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:16:18.649 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a4c9:8bff:fe0f:7886/64 scope link 2024-09-10T23:16:18.649 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:18.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:18.649 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:16:18.715 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-09-10T23:16:18.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:18.717 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-09-10T23:16:18.775 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-09-10T23:16:18.775 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:16:18.775 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:16:18.775 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:16:18.775 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:16:18.776 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:18.776 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:16:18.776 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:16:18.776 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:16:18.776 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:16:18.776 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:16:18.870 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:16:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:18.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:16:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:18.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:18.909 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-09-10T23:16:18.924 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T23:16:18.925 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T23:16:18.925 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:16:18.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:18.925 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-09-10T23:16:18.989 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:18.990 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:19.045 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:16:19.045 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:19.045 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:19.101 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:16:19.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:19.101 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:16:19.184 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:16:19.184 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:16:19.184 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:16:19.193 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:16:19.193 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:16:19.193 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:16:19.193 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:16:19.193 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:16:19.198 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:16:19.198 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:16:19.198 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:16:19.199 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:16:19.199 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:16:19.199 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:16:19.199 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:16:19.199 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:16:19.199 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T23:16:19.199 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:16:19.199 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:16:19.199 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:16:19.200 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:16:19.201 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:16:19.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:19.201 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:19.266 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:16:19.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:16:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:16:19.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:16:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:19.363 INFO:teuthology.orchestra.run.smithi171.stdout:client5383 2024-09-10T23:16:19.364 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:16:19.364 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:19.380 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_session_blocklist_on_evict False 2024-09-10T23:16:19.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.497+0000 7ffb33abd640 1 -- 172.21.15.90:0/599460494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb2c0b9a10 msgr2=0x7ffb2c0d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:19.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.497+0000 7ffb33abd640 1 --2- 172.21.15.90:0/599460494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb2c0b9a10 0x7ffb2c0d2ea0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ffb24005fd0 tx=0x7ffb2402a940 comp rx=0 tx=0).stop 2024-09-10T23:16:19.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.497+0000 7ffb33abd640 1 -- 172.21.15.90:0/599460494 shutdown_connections 2024-09-10T23:16:19.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.497+0000 7ffb33abd640 1 --2- 172.21.15.90:0/599460494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb2c0b9a10 0x7ffb2c0d2ea0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.497+0000 7ffb33abd640 1 -- 172.21.15.90:0/599460494 >> 172.21.15.90:0/599460494 conn(0x7ffb2c0d4190 msgr2=0x7ffb2c0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:19.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.497+0000 7ffb33abd640 1 -- 172.21.15.90:0/599460494 shutdown_connections 2024-09-10T23:16:19.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.497+0000 7ffb33abd640 1 -- 172.21.15.90:0/599460494 wait complete. 2024-09-10T23:16:19.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.499+0000 7ffb33abd640 1 Processor -- start 2024-09-10T23:16:19.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.499+0000 7ffb33abd640 1 -- start start 2024-09-10T23:16:19.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.499+0000 7ffb33abd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb2c0b9a10 0x7ffb2c161200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:19.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.499+0000 7ffb33abd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb2c0cfd20 0x7ffb2c1f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:19.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.499+0000 7ffb33abd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb2c15e0f0 0x7ffb2c06d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:19.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.499+0000 7ffb33abd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c169320 con 0x7ffb2c15e0f0 2024-09-10T23:16:19.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.499+0000 7ffb33abd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c1691a0 con 0x7ffb2c0cfd20 2024-09-10T23:16:19.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.499+0000 7ffb33abd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffb2c1694a0 con 0x7ffb2c0b9a10 2024-09-10T23:16:19.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.499+0000 7ffb3205a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb2c15e0f0 0x7ffb2c06d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:19.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.500+0000 7ffb3205a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb2c15e0f0 0x7ffb2c06d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42772/0 (socket says 172.21.15.90:42772) 2024-09-10T23:16:19.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.500+0000 7ffb3205a640 1 -- 172.21.15.90:0/383179481 learned_addr learned my addr 172.21.15.90:0/383179481 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:19.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.500+0000 7ffb31859640 1 --2- 172.21.15.90:0/383179481 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb2c0b9a10 0x7ffb2c161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:19.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.500+0000 7ffb31058640 1 --2- 172.21.15.90:0/383179481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb2c0cfd20 0x7ffb2c1f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:19.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.500+0000 7ffb3205a640 1 -- 172.21.15.90:0/383179481 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb2c0b9a10 msgr2=0x7ffb2c161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:19.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.500+0000 7ffb3205a640 1 --2- 172.21.15.90:0/383179481 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb2c0b9a10 0x7ffb2c161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.500+0000 7ffb3205a640 1 -- 172.21.15.90:0/383179481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb2c0cfd20 msgr2=0x7ffb2c1f5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:19.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.500+0000 7ffb3205a640 1 --2- 172.21.15.90:0/383179481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb2c0cfd20 0x7ffb2c1f5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.500+0000 7ffb3205a640 1 -- 172.21.15.90:0/383179481 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2c0c73e0 con 0x7ffb2c15e0f0 2024-09-10T23:16:19.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.500+0000 7ffb3205a640 1 --2- 172.21.15.90:0/383179481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb2c15e0f0 0x7ffb2c06d9f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ffb24009cd0 tx=0x7ffb24031ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:19.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.500+0000 7ffb227fc640 1 -- 172.21.15.90:0/383179481 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24030430 con 0x7ffb2c15e0f0 2024-09-10T23:16:19.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.500+0000 7ffb227fc640 1 -- 172.21.15.90:0/383179481 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb24004260 con 0x7ffb2c15e0f0 2024-09-10T23:16:19.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.500+0000 7ffb33abd640 1 -- 172.21.15.90:0/383179481 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2c0c6e20 con 0x7ffb2c15e0f0 2024-09-10T23:16:19.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.500+0000 7ffb227fc640 1 -- 172.21.15.90:0/383179481 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb240046b0 con 0x7ffb2c15e0f0 2024-09-10T23:16:19.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.500+0000 7ffb33abd640 1 -- 172.21.15.90:0/383179481 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb2c1f5010 con 0x7ffb2c15e0f0 2024-09-10T23:16:19.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.501+0000 7ffb33abd640 1 -- 172.21.15.90:0/383179481 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb2c0d2ea0 con 0x7ffb2c15e0f0 2024-09-10T23:16:19.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.502+0000 7ffb227fc640 1 -- 172.21.15.90:0/383179481 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ffb2402f070 con 0x7ffb2c15e0f0 2024-09-10T23:16:19.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.502+0000 7ffb227fc640 1 --2- 172.21.15.90:0/383179481 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb10077f70 0x7ffb1007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:19.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.503+0000 7ffb227fc640 1 -- 172.21.15.90:0/383179481 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7ffb240bb190 con 0x7ffb2c15e0f0 2024-09-10T23:16:19.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.503+0000 7ffb31859640 1 --2- 172.21.15.90:0/383179481 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb10077f70 0x7ffb1007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:19.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.503+0000 7ffb31859640 1 --2- 172.21.15.90:0/383179481 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb10077f70 0x7ffb1007a430 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffb28007fd0 tx=0x7ffb28001370 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:19.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.506+0000 7ffb227fc640 1 -- 172.21.15.90:0/383179481 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ffb240836d0 con 0x7ffb2c15e0f0 2024-09-10T23:16:19.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.682+0000 7ffb33abd640 1 -- 172.21.15.90:0/383179481 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mds_session_blocklist_on_evict}] v 0) -- 0x7ffb2c06ae00 con 0x7ffb2c15e0f0 2024-09-10T23:16:19.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.685+0000 7ffb227fc640 1 -- 172.21.15.90:0/383179481 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_session_blocklist_on_evict}]=0 v34)=0 v34) ==== 132+0+0 (secure 0 0 0) 0x7ffb24088100 con 0x7ffb2c15e0f0 2024-09-10T23:16:19.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.687+0000 7ffb33abd640 1 -- 172.21.15.90:0/383179481 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb10077f70 msgr2=0x7ffb1007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:19.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.687+0000 7ffb33abd640 1 --2- 172.21.15.90:0/383179481 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb10077f70 0x7ffb1007a430 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffb28007fd0 tx=0x7ffb28001370 comp rx=0 tx=0).stop 2024-09-10T23:16:19.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.687+0000 7ffb33abd640 1 -- 172.21.15.90:0/383179481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb2c15e0f0 msgr2=0x7ffb2c06d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:19.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.687+0000 7ffb33abd640 1 --2- 172.21.15.90:0/383179481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb2c15e0f0 0x7ffb2c06d9f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ffb24009cd0 tx=0x7ffb24031ea0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.687+0000 7ffb33abd640 1 -- 172.21.15.90:0/383179481 shutdown_connections 2024-09-10T23:16:19.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.687+0000 7ffb33abd640 1 --2- 172.21.15.90:0/383179481 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb10077f70 0x7ffb1007a430 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.687+0000 7ffb33abd640 1 --2- 172.21.15.90:0/383179481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb2c0cfd20 0x7ffb2c1f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.687+0000 7ffb33abd640 1 --2- 172.21.15.90:0/383179481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb2c15e0f0 0x7ffb2c06d9f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.687+0000 7ffb33abd640 1 --2- 172.21.15.90:0/383179481 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb2c0b9a10 0x7ffb2c161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.687+0000 7ffb33abd640 1 -- 172.21.15.90:0/383179481 >> 172.21.15.90:0/383179481 conn(0x7ffb2c0d4190 msgr2=0x7ffb2c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:19.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.688+0000 7ffb33abd640 1 -- 172.21.15.90:0/383179481 shutdown_connections 2024-09-10T23:16:19.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.688+0000 7ffb33abd640 1 -- 172.21.15.90:0/383179481 wait complete. 2024-09-10T23:16:19.811 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-09-10T23:16:19.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.918+0000 7f4836ad4640 1 -- 172.21.15.90:0/2006446588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48300d2670 msgr2=0x7f48300ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:19.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.918+0000 7f4836ad4640 1 --2- 172.21.15.90:0/2006446588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48300d2670 0x7f48300ced10 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f483006d3e0 tx=0x7f482802a560 comp rx=0 tx=0).stop 2024-09-10T23:16:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.918+0000 7f4836ad4640 1 -- 172.21.15.90:0/2006446588 shutdown_connections 2024-09-10T23:16:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.918+0000 7f4836ad4640 1 --2- 172.21.15.90:0/2006446588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48300d2670 0x7f48300ced10 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.918+0000 7f4836ad4640 1 --2- 172.21.15.90:0/2006446588 >> v2:172.21.15.171:3300/0 conn(0x7f48300d1cd0 0x7f48300d2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.918+0000 7f4836ad4640 1 --2- 172.21.15.90:0/2006446588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f483015e0f0 0x7f48300d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.918+0000 7f4836ad4640 1 -- 172.21.15.90:0/2006446588 >> 172.21.15.90:0/2006446588 conn(0x7f48300d4190 msgr2=0x7f48300d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.918+0000 7f4836ad4640 1 -- 172.21.15.90:0/2006446588 shutdown_connections 2024-09-10T23:16:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.918+0000 7f4836ad4640 1 -- 172.21.15.90:0/2006446588 wait complete. 2024-09-10T23:16:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.919+0000 7f4836ad4640 1 Processor -- start 2024-09-10T23:16:19.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.919+0000 7f4836ad4640 1 -- start start 2024-09-10T23:16:19.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.920+0000 7f4836ad4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48300d1cd0 0x7f483015e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:19.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.920+0000 7f4836ad4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48300d2670 0x7f4830160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:19.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.920+0000 7f4836ad4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f483015e0f0 0x7f483006df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:19.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.920+0000 7f4836ad4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f48300cf7e0 con 0x7f483015e0f0 2024-09-10T23:16:19.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.920+0000 7f4836ad4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f48300cf660 con 0x7f48300d1cd0 2024-09-10T23:16:19.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.920+0000 7f4836ad4640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f48300cf960 con 0x7f48300d2670 2024-09-10T23:16:19.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.920+0000 7f4835071640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f483015e0f0 0x7f483006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:19.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.920+0000 7f4835071640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f483015e0f0 0x7f483006df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42796/0 (socket says 172.21.15.90:42796) 2024-09-10T23:16:19.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.920+0000 7f4835071640 1 -- 172.21.15.90:0/2322835234 learned_addr learned my addr 172.21.15.90:0/2322835234 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:19.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.920+0000 7f482ffff640 1 --2- 172.21.15.90:0/2322835234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48300d2670 0x7f4830160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:19.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.920+0000 7f4834870640 1 --2- 172.21.15.90:0/2322835234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48300d1cd0 0x7f483015e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:19.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.921+0000 7f4835071640 1 -- 172.21.15.90:0/2322835234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48300d2670 msgr2=0x7f4830160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:19.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.921+0000 7f4835071640 1 --2- 172.21.15.90:0/2322835234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48300d2670 0x7f4830160940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.921+0000 7f4835071640 1 -- 172.21.15.90:0/2322835234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48300d1cd0 msgr2=0x7f483015e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:19.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.921+0000 7f4835071640 1 --2- 172.21.15.90:0/2322835234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48300d1cd0 0x7f483015e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.921+0000 7f4835071640 1 -- 172.21.15.90:0/2322835234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483015efb0 con 0x7f483015e0f0 2024-09-10T23:16:19.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.921+0000 7f4835071640 1 --2- 172.21.15.90:0/2322835234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f483015e0f0 0x7f483006df10 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4828009230 tx=0x7f4828003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:19.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.921+0000 7f482d7fa640 1 -- 172.21.15.90:0/2322835234 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482803f070 con 0x7f483015e0f0 2024-09-10T23:16:19.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.921+0000 7f482d7fa640 1 -- 172.21.15.90:0/2322835234 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48280047a0 con 0x7f483015e0f0 2024-09-10T23:16:19.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.921+0000 7f4836ad4640 1 -- 172.21.15.90:0/2322835234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f483015f290 con 0x7f483015e0f0 2024-09-10T23:16:19.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.921+0000 7f482d7fa640 1 -- 172.21.15.90:0/2322835234 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828035030 con 0x7f483015e0f0 2024-09-10T23:16:19.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.921+0000 7f4836ad4640 1 -- 172.21.15.90:0/2322835234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f483015f850 con 0x7f483015e0f0 2024-09-10T23:16:19.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.922+0000 7f4836ad4640 1 -- 172.21.15.90:0/2322835234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48300cfe10 con 0x7f483015e0f0 2024-09-10T23:16:19.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.923+0000 7f482d7fa640 1 -- 172.21.15.90:0/2322835234 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4828004bf0 con 0x7f483015e0f0 2024-09-10T23:16:19.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.923+0000 7f482d7fa640 1 --2- 172.21.15.90:0/2322835234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4810077f70 0x7f481007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:19.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.924+0000 7f482d7fa640 1 -- 172.21.15.90:0/2322835234 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f48280bae20 con 0x7f483015e0f0 2024-09-10T23:16:19.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.924+0000 7f4834870640 1 --2- 172.21.15.90:0/2322835234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4810077f70 0x7f481007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:19.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.924+0000 7f4834870640 1 --2- 172.21.15.90:0/2322835234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4810077f70 0x7f481007a430 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4820004630 tx=0x7f482000b2e0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:19.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:19.928+0000 7f482d7fa640 1 -- 172.21.15.90:0/2322835234 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f48280832d0 con 0x7f483015e0f0 2024-09-10T23:16:20.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.138+0000 7f4836ad4640 1 -- 172.21.15.90:0/2322835234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) -- 0x7f48300d0c10 con 0x7f483015e0f0 2024-09-10T23:16:20.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.690+0000 7f482d7fa640 1 -- 172.21.15.90:0/2322835234 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v28) ==== 105+0+0 (secure 0 0 0) 0x7f482808c040 con 0x7f483015e0f0 2024-09-10T23:16:20.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.692+0000 7f4836ad4640 1 -- 172.21.15.90:0/2322835234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4810077f70 msgr2=0x7f481007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:20.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.692+0000 7f4836ad4640 1 --2- 172.21.15.90:0/2322835234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4810077f70 0x7f481007a430 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4820004630 tx=0x7f482000b2e0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.692+0000 7f4836ad4640 1 -- 172.21.15.90:0/2322835234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f483015e0f0 msgr2=0x7f483006df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:20.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.692+0000 7f4836ad4640 1 --2- 172.21.15.90:0/2322835234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f483015e0f0 0x7f483006df10 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4828009230 tx=0x7f4828003960 comp rx=0 tx=0).stop 2024-09-10T23:16:20.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.692+0000 7f4836ad4640 1 -- 172.21.15.90:0/2322835234 shutdown_connections 2024-09-10T23:16:20.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.692+0000 7f4836ad4640 1 --2- 172.21.15.90:0/2322835234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4810077f70 0x7f481007a430 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.692+0000 7f4836ad4640 1 --2- 172.21.15.90:0/2322835234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f483015e0f0 0x7f483006df10 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.692+0000 7f4836ad4640 1 --2- 172.21.15.90:0/2322835234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48300d2670 0x7f4830160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.692+0000 7f4836ad4640 1 --2- 172.21.15.90:0/2322835234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48300d1cd0 0x7f483015e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.692+0000 7f4836ad4640 1 -- 172.21.15.90:0/2322835234 >> 172.21.15.90:0/2322835234 conn(0x7f48300d4190 msgr2=0x7f48300d1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:20.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.692+0000 7f4836ad4640 1 -- 172.21.15.90:0/2322835234 shutdown_connections 2024-09-10T23:16:20.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.692+0000 7f4836ad4640 1 -- 172.21.15.90:0/2322835234 wait complete. 2024-09-10T23:16:20.708 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:20.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.810+0000 7fc4dece2640 1 -- 172.21.15.90:0/3054022075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4c0004d40 msgr2=0x7fc4c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:20.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.810+0000 7fc4dece2640 1 --2- 172.21.15.90:0/3054022075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4c0004d40 0x7fc4c00051c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0009f00 tx=0x7fc4c0005830 comp rx=0 tx=0).stop 2024-09-10T23:16:20.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.810+0000 7fc4dd27f640 1 -- 172.21.15.90:0/3054022075 reap_dead start 2024-09-10T23:16:20.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.810+0000 7fc4dece2640 1 -- 172.21.15.90:0/3054022075 shutdown_connections 2024-09-10T23:16:20.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.810+0000 7fc4dece2640 1 -- 172.21.15.90:0/3054022075 >> 172.21.15.90:0/3054022075 conn(0x7fc4d809d2a0 msgr2=0x7fc4d80d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:20.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.810+0000 7fc4dece2640 1 -- 172.21.15.90:0/3054022075 shutdown_connections 2024-09-10T23:16:20.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.810+0000 7fc4dece2640 1 -- 172.21.15.90:0/3054022075 wait complete. 2024-09-10T23:16:20.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.811+0000 7fc4dece2640 1 Processor -- start 2024-09-10T23:16:20.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.811+0000 7fc4dece2640 1 -- start start 2024-09-10T23:16:20.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.812+0000 7fc4dece2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4c0004d40 0x7fc4d81f80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:20.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.812+0000 7fc4dece2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d81f8620 0x7fc4d815ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:20.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.812+0000 7fc4dece2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4d815f010 0x7fc4d815f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:20.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.812+0000 7fc4dece2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d80b3eb0 con 0x7fc4d81f8620 2024-09-10T23:16:20.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.812+0000 7fc4dece2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d80cec80 con 0x7fc4c0004d40 2024-09-10T23:16:20.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.812+0000 7fc4dece2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d80b4030 con 0x7fc4d815f010 2024-09-10T23:16:20.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.812+0000 7fc4d7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d81f8620 0x7fc4d815ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:20.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.812+0000 7fc4d7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d81f8620 0x7fc4d815ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42808/0 (socket says 172.21.15.90:42808) 2024-09-10T23:16:20.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.812+0000 7fc4d7fff640 1 -- 172.21.15.90:0/1464329761 learned_addr learned my addr 172.21.15.90:0/1464329761 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:20.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.812+0000 7fc4d7fff640 1 -- 172.21.15.90:0/1464329761 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4d815f010 msgr2=0x7fc4d815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:20.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.812+0000 7fc4d7fff640 1 --2- 172.21.15.90:0/1464329761 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4d815f010 0x7fc4d815f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.812+0000 7fc4d7fff640 1 -- 172.21.15.90:0/1464329761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4c0004d40 msgr2=0x7fc4d81f80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:20.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.812+0000 7fc4d7fff640 1 --2- 172.21.15.90:0/1464329761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4c0004d40 0x7fc4d81f80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.812+0000 7fc4d7fff640 1 -- 172.21.15.90:0/1464329761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d815fb90 con 0x7fc4d81f8620 2024-09-10T23:16:20.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.812+0000 7fc4d7fff640 1 --2- 172.21.15.90:0/1464329761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d81f8620 0x7fc4d815ead0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc011a00 tx=0x7fc4cc011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:20.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.812+0000 7fc4d57fa640 1 -- 172.21.15.90:0/1464329761 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc00fd50 con 0x7fc4d81f8620 2024-09-10T23:16:20.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.813+0000 7fc4d57fa640 1 -- 172.21.15.90:0/1464329761 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4cc004020 con 0x7fc4d81f8620 2024-09-10T23:16:20.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.813+0000 7fc4d57fa640 1 -- 172.21.15.90:0/1464329761 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc004450 con 0x7fc4d81f8620 2024-09-10T23:16:20.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.813+0000 7fc4dece2640 1 -- 172.21.15.90:0/1464329761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d815fe70 con 0x7fc4d81f8620 2024-09-10T23:16:20.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.813+0000 7fc4dece2640 1 -- 172.21.15.90:0/1464329761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d80b7070 con 0x7fc4d81f8620 2024-09-10T23:16:20.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.814+0000 7fc4dece2640 1 -- 172.21.15.90:0/1464329761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d8069ae0 con 0x7fc4d81f8620 2024-09-10T23:16:20.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.814+0000 7fc4d57fa640 1 -- 172.21.15.90:0/1464329761 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc4cc0035f0 con 0x7fc4d81f8620 2024-09-10T23:16:20.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.815+0000 7fc4d57fa640 1 --2- 172.21.15.90:0/1464329761 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc4c4077f70 0x7fc4c407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:20.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.815+0000 7fc4d57fa640 1 -- 172.21.15.90:0/1464329761 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fc4cc09a9b0 con 0x7fc4d81f8620 2024-09-10T23:16:20.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.815+0000 7fc4dca7e640 1 --2- 172.21.15.90:0/1464329761 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc4c4077f70 0x7fc4c407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:20.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.816+0000 7fc4dca7e640 1 --2- 172.21.15.90:0/1464329761 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc4c4077f70 0x7fc4c407a430 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8001330 tx=0x7fc4c8000ed0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:20.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:20.819+0000 7fc4d57fa640 1 -- 172.21.15.90:0/1464329761 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc4d8069ae0 con 0x7fc4d81f8620 2024-09-10T23:16:21.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:21.029+0000 7fc4dece2640 1 -- 172.21.15.90:0/1464329761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4d80b3490 con 0x7fc4d81f8620 2024-09-10T23:16:21.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:21.030+0000 7fc4d57fa640 1 -- 172.21.15.90:0/1464329761 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5245 (secure 0 0 0) 0x7fc4cc063540 con 0x7fc4d81f8620 2024-09-10T23:16:21.031 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:21.031 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":29,"btime":"2024-09-10T23:16:20:695654+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3624303902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3624303902},{"type":"v1","addr":"172.21.15.171:6837","nonce":3624303902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1743356090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1743356090},{"type":"v1","addr":"172.21.15.171:6836","nonce":1743356090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:16:07.583350+0000","modified":"2024-09-10T23:16:20.695642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5556,"mds_1":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":1,"incarnation":29,"state":"up:creating","state_seq":1,"addr":"172.21.15.90:6833/2007304013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2007304013},{"type":"v1","addr":"172.21.15.90:6833","nonce":2007304013}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5556":{"gid":5556,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/1708086583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1708086583},{"type":"v1","addr":"172.21.15.90:6835","nonce":1708086583}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5556,"qdb_cluster":[5556]},"id":4}]} 2024-09-10T23:16:21.031 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 29 2024-09-10T23:16:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:21.032+0000 7fc4dece2640 1 -- 172.21.15.90:0/1464329761 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc4c4077f70 msgr2=0x7fc4c407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:21.032+0000 7fc4dece2640 1 --2- 172.21.15.90:0/1464329761 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc4c4077f70 0x7fc4c407a430 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8001330 tx=0x7fc4c8000ed0 comp rx=0 tx=0).stop 2024-09-10T23:16:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:21.032+0000 7fc4dece2640 1 -- 172.21.15.90:0/1464329761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d81f8620 msgr2=0x7fc4d815ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:21.032+0000 7fc4dece2640 1 --2- 172.21.15.90:0/1464329761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d81f8620 0x7fc4d815ead0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc011a00 tx=0x7fc4cc011ec0 comp rx=0 tx=0).stop 2024-09-10T23:16:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:21.032+0000 7fc4dece2640 1 -- 172.21.15.90:0/1464329761 shutdown_connections 2024-09-10T23:16:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:21.032+0000 7fc4dece2640 1 --2- 172.21.15.90:0/1464329761 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc4c4077f70 0x7fc4c407a430 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:21.032+0000 7fc4dece2640 1 --2- 172.21.15.90:0/1464329761 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4d815f010 0x7fc4d815f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:21.032+0000 7fc4dece2640 1 --2- 172.21.15.90:0/1464329761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d81f8620 0x7fc4d815ead0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:21.032+0000 7fc4dece2640 1 --2- 172.21.15.90:0/1464329761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4c0004d40 0x7fc4d81f80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:21.032+0000 7fc4dece2640 1 -- 172.21.15.90:0/1464329761 >> 172.21.15.90:0/1464329761 conn(0x7fc4d809d2a0 msgr2=0x7fc4d806ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:21.032+0000 7fc4dece2640 1 -- 172.21.15.90:0/1464329761 shutdown_connections 2024-09-10T23:16:21.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:21.032+0000 7fc4dece2640 1 -- 172.21.15.90:0/1464329761 wait complete. 2024-09-10T23:16:21.447 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:16:07.583350+0000', 'modified': '2024-09-10T23:16:20.695642+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 5556, 'mds_1': 5553}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5553': {'gid': 5553, 'name': 'a', 'rank': 1, 'incarnation': 29, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.90:6833/2007304013', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6832', 'nonce': 2007304013}, {'type': 'v1', 'addr': '172.21.15.90:6833', 'nonce': 2007304013}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5556': {'gid': 5556, 'name': 'c', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.90:6835/1708086583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6834', 'nonce': 1708086583}, {'type': 'v1', 'addr': '172.21.15.90:6835', 'nonce': 1708086583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5556, 'qdb_cluster': [5556]} 2024-09-10T23:16:21.447 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5553:up:creating 2024-09-10T23:16:22.449 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:22.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.561+0000 7f07b3c70640 1 -- 172.21.15.90:0/3164223336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ac0d2470 msgr2=0x7f07ac0b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:22.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.561+0000 7f07b3c70640 1 --2- 172.21.15.90:0/3164223336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ac0d2470 0x7f07ac0b3490 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f07a8005fd0 tx=0x7f07a802a5d0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.561+0000 7f07b3c70640 1 -- 172.21.15.90:0/3164223336 shutdown_connections 2024-09-10T23:16:22.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.561+0000 7f07b3c70640 1 --2- 172.21.15.90:0/3164223336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07ac0b3a00 0x7f07ac0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.561+0000 7f07b3c70640 1 --2- 172.21.15.90:0/3164223336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ac0d2470 0x7f07ac0b3490 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.561+0000 7f07b3c70640 1 -- 172.21.15.90:0/3164223336 >> 172.21.15.90:0/3164223336 conn(0x7f07ac09d2a0 msgr2=0x7f07ac0d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:22.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.562+0000 7f07b3c70640 1 -- 172.21.15.90:0/3164223336 shutdown_connections 2024-09-10T23:16:22.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.562+0000 7f07b3c70640 1 -- 172.21.15.90:0/3164223336 wait complete. 2024-09-10T23:16:22.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.563+0000 7f07b3c70640 1 Processor -- start 2024-09-10T23:16:22.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.563+0000 7f07b3c70640 1 -- start start 2024-09-10T23:16:22.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b3c70640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07ac0b3a00 0x7f07ac0b97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:22.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b3c70640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07ac0d1c70 0x7f07ac1f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:22.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b3c70640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ac0d2470 0x7f07ac0c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:22.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b3c70640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac0b4570 con 0x7f07ac0d2470 2024-09-10T23:16:22.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b3c70640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac0b43f0 con 0x7f07ac0d1c70 2024-09-10T23:16:22.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b3c70640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f07ac0b46f0 con 0x7f07ac0b3a00 2024-09-10T23:16:22.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b220d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ac0d2470 0x7f07ac0c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:22.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b220d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ac0d2470 0x7f07ac0c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42828/0 (socket says 172.21.15.90:42828) 2024-09-10T23:16:22.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b220d640 1 -- 172.21.15.90:0/4259886735 learned_addr learned my addr 172.21.15.90:0/4259886735 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:22.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b1a0c640 1 --2- 172.21.15.90:0/4259886735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07ac0b3a00 0x7f07ac0b97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:22.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b120b640 1 --2- 172.21.15.90:0/4259886735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07ac0d1c70 0x7f07ac1f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:22.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b220d640 1 -- 172.21.15.90:0/4259886735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07ac0b3a00 msgr2=0x7f07ac0b97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:22.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b220d640 1 --2- 172.21.15.90:0/4259886735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07ac0b3a00 0x7f07ac0b97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b220d640 1 -- 172.21.15.90:0/4259886735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07ac0d1c70 msgr2=0x7f07ac1f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:22.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b220d640 1 --2- 172.21.15.90:0/4259886735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07ac0d1c70 0x7f07ac1f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b220d640 1 -- 172.21.15.90:0/4259886735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ac1f5720 con 0x7f07ac0d2470 2024-09-10T23:16:22.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b220d640 1 --2- 172.21.15.90:0/4259886735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ac0d2470 0x7f07ac0c8950 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f07a400eb40 tx=0x7f07a400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:22.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07a27fc640 1 -- 172.21.15.90:0/4259886735 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a4004b20 con 0x7f07ac0d2470 2024-09-10T23:16:22.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07a27fc640 1 -- 172.21.15.90:0/4259886735 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07a4004ce0 con 0x7f07ac0d2470 2024-09-10T23:16:22.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07b3c70640 1 -- 172.21.15.90:0/4259886735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07ac0c7bd0 con 0x7f07ac0d2470 2024-09-10T23:16:22.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.564+0000 7f07a27fc640 1 -- 172.21.15.90:0/4259886735 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a4005280 con 0x7f07ac0d2470 2024-09-10T23:16:22.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.565+0000 7f07b3c70640 1 -- 172.21.15.90:0/4259886735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07ac0c7e70 con 0x7f07ac0d2470 2024-09-10T23:16:22.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.565+0000 7f07b3c70640 1 -- 172.21.15.90:0/4259886735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07ac0b3eb0 con 0x7f07ac0d2470 2024-09-10T23:16:22.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.566+0000 7f07a27fc640 1 -- 172.21.15.90:0/4259886735 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f07a4005420 con 0x7f07ac0d2470 2024-09-10T23:16:22.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.567+0000 7f07a27fc640 1 --2- 172.21.15.90:0/4259886735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0790077f70 0x7f079007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:22.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.567+0000 7f07a27fc640 1 -- 172.21.15.90:0/4259886735 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f07a409a9e0 con 0x7f07ac0d2470 2024-09-10T23:16:22.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.567+0000 7f07b1a0c640 1 --2- 172.21.15.90:0/4259886735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0790077f70 0x7f079007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:22.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.567+0000 7f07b1a0c640 1 --2- 172.21.15.90:0/4259886735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0790077f70 0x7f079007a430 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f07a8033000 tx=0x7f07a8004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:22.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.571+0000 7f07a27fc640 1 -- 172.21.15.90:0/4259886735 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f07ac1f5720 con 0x7f07ac0d2470 2024-09-10T23:16:22.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.782+0000 7f07b3c70640 1 -- 172.21.15.90:0/4259886735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07ac06e000 con 0x7f07ac0d2470 2024-09-10T23:16:22.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.783+0000 7f07a27fc640 1 -- 172.21.15.90:0/4259886735 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5248 (secure 0 0 0) 0x7f07a4062e90 con 0x7f07ac0d2470 2024-09-10T23:16:22.784 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:22.784 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":30,"btime":"2024-09-10T23:16:21:698628+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3624303902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3624303902},{"type":"v1","addr":"172.21.15.171:6837","nonce":3624303902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1743356090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1743356090},{"type":"v1","addr":"172.21.15.171:6836","nonce":1743356090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:16:07.583350+0000","modified":"2024-09-10T23:16:21.698624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5556,"mds_1":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":1,"incarnation":29,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6833/2007304013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2007304013},{"type":"v1","addr":"172.21.15.90:6833","nonce":2007304013}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5556":{"gid":5556,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/1708086583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1708086583},{"type":"v1","addr":"172.21.15.90:6835","nonce":1708086583}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5556,"qdb_cluster":[5553,5556]},"id":4}]} 2024-09-10T23:16:22.784 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 30 2024-09-10T23:16:22.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.785+0000 7f07b3c70640 1 -- 172.21.15.90:0/4259886735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0790077f70 msgr2=0x7f079007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:22.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.785+0000 7f07b3c70640 1 --2- 172.21.15.90:0/4259886735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0790077f70 0x7f079007a430 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f07a8033000 tx=0x7f07a8004730 comp rx=0 tx=0).stop 2024-09-10T23:16:22.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.785+0000 7f07b3c70640 1 -- 172.21.15.90:0/4259886735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ac0d2470 msgr2=0x7f07ac0c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:22.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.785+0000 7f07b3c70640 1 --2- 172.21.15.90:0/4259886735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ac0d2470 0x7f07ac0c8950 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f07a400eb40 tx=0x7f07a400c2d0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.785+0000 7f07b3c70640 1 -- 172.21.15.90:0/4259886735 shutdown_connections 2024-09-10T23:16:22.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.785+0000 7f07b3c70640 1 --2- 172.21.15.90:0/4259886735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0790077f70 0x7f079007a430 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.785+0000 7f07b3c70640 1 --2- 172.21.15.90:0/4259886735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07ac0d1c70 0x7f07ac1f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.785+0000 7f07b3c70640 1 --2- 172.21.15.90:0/4259886735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07ac0d2470 0x7f07ac0c8950 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.785+0000 7f07b3c70640 1 --2- 172.21.15.90:0/4259886735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07ac0b3a00 0x7f07ac0b97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.785+0000 7f07b3c70640 1 -- 172.21.15.90:0/4259886735 >> 172.21.15.90:0/4259886735 conn(0x7f07ac09d2a0 msgr2=0x7f07ac06d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:22.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.785+0000 7f07b3c70640 1 -- 172.21.15.90:0/4259886735 shutdown_connections 2024-09-10T23:16:22.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:22.785+0000 7f07b3c70640 1 -- 172.21.15.90:0/4259886735 wait complete. 2024-09-10T23:16:23.199 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:16:07.583350+0000', 'modified': '2024-09-10T23:16:21.698624+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 5556, 'mds_1': 5553}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5553': {'gid': 5553, 'name': 'a', 'rank': 1, 'incarnation': 29, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.90:6833/2007304013', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6832', 'nonce': 2007304013}, {'type': 'v1', 'addr': '172.21.15.90:6833', 'nonce': 2007304013}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5556': {'gid': 5556, 'name': 'c', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.90:6835/1708086583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6834', 'nonce': 1708086583}, {'type': 'v1', 'addr': '172.21.15.90:6835', 'nonce': 1708086583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5556, 'qdb_cluster': [5553, 5556]} 2024-09-10T23:16:23.200 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2024-09-10T23:16:23.200 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T23:16:23.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.305+0000 7f1675ee6640 1 -- 172.21.15.90:0/1062242760 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f167015ab30 msgr2=0x7f1670071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.305+0000 7f1675ee6640 1 --2- 172.21.15.90:0/1062242760 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f167015ab30 0x7f1670071190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1660005fd0 tx=0x7f166002aa80 comp rx=0 tx=0).stop 2024-09-10T23:16:23.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.305+0000 7f1675ee6640 1 -- 172.21.15.90:0/1062242760 shutdown_connections 2024-09-10T23:16:23.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.305+0000 7f1675ee6640 1 --2- 172.21.15.90:0/1062242760 >> v2:172.21.15.171:3300/0 conn(0x7f16700ceab0 0x7f16700cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.305+0000 7f1675ee6640 1 --2- 172.21.15.90:0/1062242760 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f167015ab30 0x7f1670071190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.305+0000 7f1675ee6640 1 -- 172.21.15.90:0/1062242760 >> 172.21.15.90:0/1062242760 conn(0x7f16700cd960 msgr2=0x7f16700cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:23.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.305+0000 7f1675ee6640 1 -- 172.21.15.90:0/1062242760 shutdown_connections 2024-09-10T23:16:23.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.305+0000 7f1675ee6640 1 -- 172.21.15.90:0/1062242760 wait complete. 2024-09-10T23:16:23.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.306+0000 7f1675ee6640 1 Processor -- start 2024-09-10T23:16:23.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.306+0000 7f1675ee6640 1 -- start start 2024-09-10T23:16:23.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f1675ee6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16700ceab0 0x7f1670150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f1675ee6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f167015ab30 0x7f16701f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f1675ee6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f167015af10 0x7f16700b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f1675ee6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f16700cfd20 con 0x7f167015ab30 2024-09-10T23:16:23.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f1675ee6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f16700cfba0 con 0x7f16700ceab0 2024-09-10T23:16:23.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f1675ee6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f16700cfea0 con 0x7f167015af10 2024-09-10T23:16:23.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f166effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f167015ab30 0x7f16701f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f166effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f167015ab30 0x7f16701f6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42838/0 (socket says 172.21.15.90:42838) 2024-09-10T23:16:23.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f166effd640 1 -- 172.21.15.90:0/2354226562 learned_addr learned my addr 172.21.15.90:0/2354226562 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:23.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f166f7fe640 1 --2- 172.21.15.90:0/2354226562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16700ceab0 0x7f1670150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f166ffff640 1 --2- 172.21.15.90:0/2354226562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f167015af10 0x7f16700b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f166effd640 1 -- 172.21.15.90:0/2354226562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f167015af10 msgr2=0x7f16700b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f166effd640 1 --2- 172.21.15.90:0/2354226562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f167015af10 0x7f16700b5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f166effd640 1 -- 172.21.15.90:0/2354226562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16700ceab0 msgr2=0x7f1670150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f166effd640 1 --2- 172.21.15.90:0/2354226562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16700ceab0 0x7f1670150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f166effd640 1 -- 172.21.15.90:0/2354226562 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16700b5f50 con 0x7f167015ab30 2024-09-10T23:16:23.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f166effd640 1 --2- 172.21.15.90:0/2354226562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f167015ab30 0x7f16701f6c90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f166400e790 tx=0x7f166400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.307+0000 7f1657fff640 1 -- 172.21.15.90:0/2354226562 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166400eea0 con 0x7f167015ab30 2024-09-10T23:16:23.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.308+0000 7f1657fff640 1 -- 172.21.15.90:0/2354226562 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f166400ccc0 con 0x7f167015ab30 2024-09-10T23:16:23.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.308+0000 7f1675ee6640 1 -- 172.21.15.90:0/2354226562 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1670152220 con 0x7f167015ab30 2024-09-10T23:16:23.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.308+0000 7f1657fff640 1 -- 172.21.15.90:0/2354226562 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1664004280 con 0x7f167015ab30 2024-09-10T23:16:23.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.308+0000 7f1675ee6640 1 -- 172.21.15.90:0/2354226562 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16701527e0 con 0x7f167015ab30 2024-09-10T23:16:23.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.309+0000 7f1657fff640 1 -- 172.21.15.90:0/2354226562 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f16640035f0 con 0x7f167015ab30 2024-09-10T23:16:23.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.310+0000 7f1657fff640 1 --2- 172.21.15.90:0/2354226562 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f165c077fa0 0x7f165c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.310+0000 7f1657fff640 1 -- 172.21.15.90:0/2354226562 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f166409a540 con 0x7f167015ab30 2024-09-10T23:16:23.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.310+0000 7f166f7fe640 1 --2- 172.21.15.90:0/2354226562 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f165c077fa0 0x7f165c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.310+0000 7f166f7fe640 1 --2- 172.21.15.90:0/2354226562 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f165c077fa0 0x7f165c07a460 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1660035000 tx=0x7f1660039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.310+0000 7f1678cb4740 1 Processor -- start 2024-09-10T23:16:23.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.310+0000 7f1678cb4740 1 -- start start 2024-09-10T23:16:23.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.311+0000 7f1678cb4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc30ef0 0x5619afc09090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.311+0000 7f1678cb4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc0f310 0x5619afc312d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.311+0000 7f1678cb4740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc53df0 0x5619afc54260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.311+0000 7f1678cb4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5619afb80820 con 0x5619afc0f310 2024-09-10T23:16:23.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.311+0000 7f1678cb4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5619afb6fc50 con 0x5619afc30ef0 2024-09-10T23:16:23.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.311+0000 7f1678cb4740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x5619afb73a60 con 0x5619afc53df0 2024-09-10T23:16:23.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.311+0000 7f166effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc0f310 0x5619afc312d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.311+0000 7f166effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc0f310 0x5619afc312d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42850/0 (socket says 172.21.15.90:42850) 2024-09-10T23:16:23.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.312+0000 7f166effd640 1 -- 172.21.15.90:0/3126372910 learned_addr learned my addr 172.21.15.90:0/3126372910 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:23.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.312+0000 7f166ffff640 1 --2- 172.21.15.90:0/3126372910 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc53df0 0x5619afc54260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.312+0000 7f166f7fe640 1 --2- 172.21.15.90:0/3126372910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc30ef0 0x5619afc09090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.312+0000 7f166effd640 1 -- 172.21.15.90:0/3126372910 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc53df0 msgr2=0x5619afc54260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:23.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.312+0000 7f166effd640 1 --2- 172.21.15.90:0/3126372910 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc53df0 0x5619afc54260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.312+0000 7f166effd640 1 -- 172.21.15.90:0/3126372910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc30ef0 msgr2=0x5619afc09090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:23.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.312+0000 7f166effd640 1 --2- 172.21.15.90:0/3126372910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc30ef0 0x5619afc09090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.312+0000 7f166effd640 1 -- 172.21.15.90:0/3126372910 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619af8d1850 con 0x5619afc0f310 2024-09-10T23:16:23.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.312+0000 7f166effd640 1 --2- 172.21.15.90:0/3126372910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc0f310 0x5619afc312d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1664098a90 tx=0x7f1664062160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7657c6a020050be2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.312+0000 7f16557fa640 1 -- 172.21.15.90:0/3126372910 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16640629f0 con 0x5619afc0f310 2024-09-10T23:16:23.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.312+0000 7f16557fa640 1 -- 172.21.15.90:0/3126372910 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1664067420 con 0x5619afc0f310 2024-09-10T23:16:23.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.312+0000 7f16557fa640 1 -- 172.21.15.90:0/3126372910 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166406be40 con 0x5619afc0f310 2024-09-10T23:16:23.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.313+0000 7f1678cb4740 1 -- 172.21.15.90:0/3126372910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc0f310 msgr2=0x5619afc312d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.313+0000 7f1678cb4740 1 --2- 172.21.15.90:0/3126372910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc0f310 0x5619afc312d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1664098a90 tx=0x7f1664062160 comp rx=0 tx=0).stop 2024-09-10T23:16:23.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.313+0000 7f1678cb4740 1 -- 172.21.15.90:0/3126372910 shutdown_connections 2024-09-10T23:16:23.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.313+0000 7f1678cb4740 1 --2- 172.21.15.90:0/3126372910 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc53df0 0x5619afc54260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.313+0000 7f1678cb4740 1 --2- 172.21.15.90:0/3126372910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc0f310 0x5619afc312d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.313+0000 7f1678cb4740 1 --2- 172.21.15.90:0/3126372910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc30ef0 0x5619afc09090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.313+0000 7f1678cb4740 1 -- 172.21.15.90:0/3126372910 >> 172.21.15.90:0/3126372910 conn(0x5619afc0a6a0 msgr2=0x5619afc0e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:23.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.313+0000 7f1678cb4740 1 -- 172.21.15.90:0/3126372910 shutdown_connections 2024-09-10T23:16:23.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.313+0000 7f1678cb4740 1 -- 172.21.15.90:0/3126372910 wait complete. 2024-09-10T23:16:23.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.313+0000 7f1678cb4740 1 -- start start 2024-09-10T23:16:23.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.313+0000 7f1678cb4740 1 Processor -- start 2024-09-10T23:16:23.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.314+0000 7f1678cb4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc30ef0 0x5619afc4dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.314+0000 7f1678cb4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc53df0 0x5619afc34720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.314+0000 7f1678cb4740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc66f80 0x5619afc67400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.314+0000 7f1678cb4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5619af8e0620 con 0x5619afc53df0 2024-09-10T23:16:23.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.314+0000 7f1678cb4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5619afb155f0 con 0x5619afc30ef0 2024-09-10T23:16:23.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.314+0000 7f1678cb4740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x5619afc095d0 con 0x5619afc66f80 2024-09-10T23:16:23.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.314+0000 7f1678cb4740 10 client.0 _ll_register_callbacks cb 0x5619afb190a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:16:23.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.314+0000 7f166effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc53df0 0x5619afc34720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.314+0000 7f166effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc53df0 0x5619afc34720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42864/0 (socket says 172.21.15.90:42864) 2024-09-10T23:16:23.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.314+0000 7f166effd640 1 -- 172.21.15.90:0/1970382916 learned_addr learned my addr 172.21.15.90:0/1970382916 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:23.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.314+0000 7f166f7fe640 1 --2- 172.21.15.90:0/1970382916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc30ef0 0x5619afc4dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.314+0000 7f166ffff640 1 --2- 172.21.15.90:0/1970382916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc66f80 0x5619afc67400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f166effd640 1 -- 172.21.15.90:0/1970382916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc66f80 msgr2=0x5619afc67400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:23.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f166effd640 1 --2- 172.21.15.90:0/1970382916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc66f80 0x5619afc67400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f166effd640 1 -- 172.21.15.90:0/1970382916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc30ef0 msgr2=0x5619afc4dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:23.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f166effd640 1 --2- 172.21.15.90:0/1970382916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc30ef0 0x5619afc4dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f166effd640 1 -- 172.21.15.90:0/1970382916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619af9486b0 con 0x5619afc53df0 2024-09-10T23:16:23.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f166effd640 1 --2- 172.21.15.90:0/1970382916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc53df0 0x5619afc34720 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1664009fd0 tx=0x7f1664009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7219ca122e92aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f164e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:16:23.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f164e7fc640 1 -- 172.21.15.90:0/1970382916 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166407c040 con 0x5619afc53df0 2024-09-10T23:16:23.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f164e7fc640 1 -- 172.21.15.90:0/1970382916 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f166409a270 con 0x5619afc53df0 2024-09-10T23:16:23.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f1678cb4740 1 -- 172.21.15.90:0/1970382916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1664067420 con 0x5619afc53df0 2024-09-10T23:16:23.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f164e7fc640 1 -- 172.21.15.90:0/1970382916 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1664061c50 con 0x5619afc53df0 2024-09-10T23:16:23.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f1678cb4740 10 client.5769 fetch_fsmap learned FSMap version 30 2024-09-10T23:16:23.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f1678cb4740 1 -- 172.21.15.90:0/1970382916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x5619afc4d830 con 0x5619afc53df0 2024-09-10T23:16:23.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f164e7fc640 1 -- 172.21.15.90:0/1970382916 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1664067420 con 0x5619afc53df0 2024-09-10T23:16:23.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f164e7fc640 1 -- 172.21.15.90:0/1970382916 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) ==== 3522+0+0 (secure 0 0 0) 0x7f1664061df0 con 0x5619afc53df0 2024-09-10T23:16:23.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f1678cb4740 10 client.5769 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:16:23.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f1678cb4740 10 client.5769 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:16:23.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f1678cb4740 20 client.5769 populate_metadata read hostname 'smithi090' 2024-09-10T23:16:23.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f1678cb4740 1 --2- 172.21.15.90:0/1970382916 >> [v2:172.21.15.90:6832/2007304013,v1:172.21.15.90:6833/2007304013] conn(0x5619afc6a5b0 0x5619afc6a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f1678cb4740 4 client.5769 mds_command: new command op to 5553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:16:23.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f1678cb4740 1 -- 172.21.15.90:0/1970382916 --> [v2:172.21.15.90:6832/2007304013,v1:172.21.15.90:6833/2007304013] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619afb82770 con 0x5619afc6a5b0 2024-09-10T23:16:23.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.315+0000 7f166f7fe640 1 --2- 172.21.15.90:0/1970382916 >> [v2:172.21.15.90:6832/2007304013,v1:172.21.15.90:6833/2007304013] conn(0x5619afc6a5b0 0x5619afc6a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.316+0000 7f164e7fc640 10 client.5769 ms_handle_connect on v2:172.21.15.90:6832/2007304013 2024-09-10T23:16:23.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.316+0000 7f166f7fe640 1 --2- 172.21.15.90:0/1970382916 >> [v2:172.21.15.90:6832/2007304013,v1:172.21.15.90:6833/2007304013] conn(0x5619afc6a5b0 0x5619afc6a990 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7f763b1bd86e3515 server_cookie=a9a3c4ac56fd98ea in_seq=0 out_seq=0 2024-09-10T23:16:23.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.316+0000 7f164e7fc640 1 -- 172.21.15.90:0/1970382916 <== mds.1 v2:172.21.15.90:6832/2007304013 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5619afb82770 con 0x5619afc6a5b0 2024-09-10T23:16:23.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.316+0000 7f164e7fc640 10 client.5769 handle_command_reply: tid=0 2024-09-10T23:16:23.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.316+0000 7f1678cb4740 1 client.5769 shutdown 2024-09-10T23:16:23.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.316+0000 7f1678cb4740 1 -- 172.21.15.90:0/1970382916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc53df0 msgr2=0x5619afc34720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.316+0000 7f1678cb4740 1 --2- 172.21.15.90:0/1970382916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc53df0 0x5619afc34720 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1664009fd0 tx=0x7f1664009670 comp rx=0 tx=0).stop 2024-09-10T23:16:23.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.316+0000 7f1678cb4740 1 -- 172.21.15.90:0/1970382916 shutdown_connections 2024-09-10T23:16:23.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.316+0000 7f1678cb4740 1 --2- 172.21.15.90:0/1970382916 >> [v2:172.21.15.90:6832/2007304013,v1:172.21.15.90:6833/2007304013] conn(0x5619afc6a5b0 0x5619afc6a990 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.316+0000 7f1678cb4740 1 --2- 172.21.15.90:0/1970382916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc66f80 0x5619afc67400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.316+0000 7f1678cb4740 1 --2- 172.21.15.90:0/1970382916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc53df0 0x5619afc34720 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.316+0000 7f164e7fc640 0 client.5769 ms_handle_reset on v2:172.21.15.90:6832/2007304013 2024-09-10T23:16:23.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.316+0000 7f1678cb4740 1 --2- 172.21.15.90:0/1970382916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc30ef0 0x5619afc4dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.316+0000 7f1678cb4740 1 -- 172.21.15.90:0/1970382916 >> 172.21.15.90:0/1970382916 conn(0x5619afc0f310 msgr2=0x5619afc56170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:23.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.317+0000 7f1678cb4740 1 -- 172.21.15.90:0/1970382916 shutdown_connections 2024-09-10T23:16:23.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.317+0000 7f1678cb4740 1 -- 172.21.15.90:0/1970382916 wait complete. 2024-09-10T23:16:23.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.317+0000 7f1678cb4740 20 client.5769 trim_cache size 0 max 16384 2024-09-10T23:16:23.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.334+0000 7f1678cb4740 1 Processor -- start 2024-09-10T23:16:23.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.334+0000 7f1678cb4740 1 -- start start 2024-09-10T23:16:23.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.335+0000 7f1678cb4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc30ef0 0x5619afc0e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.335+0000 7f1678cb4740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc53df0 0x5619afc038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.335+0000 7f1678cb4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc66f80 0x5619afc70e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.335+0000 7f1678cb4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1670154290 con 0x5619afc66f80 2024-09-10T23:16:23.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.335+0000 7f1678cb4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f16700b1940 con 0x5619afc30ef0 2024-09-10T23:16:23.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.335+0000 7f1678cb4740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f16700b1f90 con 0x5619afc53df0 2024-09-10T23:16:23.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.335+0000 7f166ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc66f80 0x5619afc70e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.335+0000 7f166ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc66f80 0x5619afc70e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42866/0 (socket says 172.21.15.90:42866) 2024-09-10T23:16:23.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.335+0000 7f166ffff640 1 -- 172.21.15.90:0/1675274644 learned_addr learned my addr 172.21.15.90:0/1675274644 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:23.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.336+0000 7f166f7fe640 1 --2- 172.21.15.90:0/1675274644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc30ef0 0x5619afc0e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.336+0000 7f166effd640 1 --2- 172.21.15.90:0/1675274644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc53df0 0x5619afc038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.336+0000 7f166ffff640 1 -- 172.21.15.90:0/1675274644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc53df0 msgr2=0x5619afc038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:23.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.336+0000 7f166ffff640 1 --2- 172.21.15.90:0/1675274644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc53df0 0x5619afc038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.336+0000 7f166ffff640 1 -- 172.21.15.90:0/1675274644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc30ef0 msgr2=0x5619afc0e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:23.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.336+0000 7f166ffff640 1 --2- 172.21.15.90:0/1675274644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc30ef0 0x5619afc0e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.336+0000 7f166ffff640 1 -- 172.21.15.90:0/1675274644 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619afc08fc0 con 0x5619afc66f80 2024-09-10T23:16:23.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.336+0000 7f166effd640 1 --2- 172.21.15.90:0/1675274644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc53df0 0x5619afc038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:23.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.336+0000 7f166ffff640 1 --2- 172.21.15.90:0/1675274644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc66f80 0x5619afc70e10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1668003700 tx=0x7f1668007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b29e062c81667a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.336+0000 7f1654ff9640 1 -- 172.21.15.90:0/1675274644 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16680017a0 con 0x5619afc66f80 2024-09-10T23:16:23.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.336+0000 7f1654ff9640 1 -- 172.21.15.90:0/1675274644 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1668001a30 con 0x5619afc66f80 2024-09-10T23:16:23.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.336+0000 7f1654ff9640 1 -- 172.21.15.90:0/1675274644 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668016450 con 0x5619afc66f80 2024-09-10T23:16:23.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.336+0000 7f1678cb4740 1 -- 172.21.15.90:0/1675274644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc66f80 msgr2=0x5619afc70e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.337+0000 7f1678cb4740 1 --2- 172.21.15.90:0/1675274644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc66f80 0x5619afc70e10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1668003700 tx=0x7f1668007d70 comp rx=0 tx=0).stop 2024-09-10T23:16:23.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.337+0000 7f1678cb4740 1 -- 172.21.15.90:0/1675274644 shutdown_connections 2024-09-10T23:16:23.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.337+0000 7f1678cb4740 1 --2- 172.21.15.90:0/1675274644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc66f80 0x5619afc70e10 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.337+0000 7f1678cb4740 1 --2- 172.21.15.90:0/1675274644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc53df0 0x5619afc038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.337+0000 7f1678cb4740 1 --2- 172.21.15.90:0/1675274644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc30ef0 0x5619afc0e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.337+0000 7f1678cb4740 1 -- 172.21.15.90:0/1675274644 >> 172.21.15.90:0/1675274644 conn(0x5619afc0f310 msgr2=0x5619afc667c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:23.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.337+0000 7f1678cb4740 1 -- 172.21.15.90:0/1675274644 shutdown_connections 2024-09-10T23:16:23.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.337+0000 7f1678cb4740 1 -- 172.21.15.90:0/1675274644 wait complete. 2024-09-10T23:16:23.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.337+0000 7f1678cb4740 1 -- start start 2024-09-10T23:16:23.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.337+0000 7f1678cb4740 1 Processor -- start 2024-09-10T23:16:23.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f1678cb4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc30ef0 0x5619afc70e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f1678cb4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc53df0 0x5619afc79a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f1678cb4740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc66f80 0x5619afcdba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f1678cb4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5619afc51610 con 0x5619afc30ef0 2024-09-10T23:16:23.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f1678cb4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5619af8e0620 con 0x5619afc53df0 2024-09-10T23:16:23.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f1678cb4740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x5619afc51390 con 0x5619afc66f80 2024-09-10T23:16:23.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f1678cb4740 10 client.0 _ll_register_callbacks cb 0x7f1664062850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:16:23.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f166f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc30ef0 0x5619afc70e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f166f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc30ef0 0x5619afc70e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42872/0 (socket says 172.21.15.90:42872) 2024-09-10T23:16:23.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f166f7fe640 1 -- 172.21.15.90:0/3508084072 learned_addr learned my addr 172.21.15.90:0/3508084072 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:23.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f166effd640 1 --2- 172.21.15.90:0/3508084072 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc53df0 0x5619afc79a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f166ffff640 1 --2- 172.21.15.90:0/3508084072 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc66f80 0x5619afcdba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f166f7fe640 1 -- 172.21.15.90:0/3508084072 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc66f80 msgr2=0x5619afcdba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:23.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f166f7fe640 1 --2- 172.21.15.90:0/3508084072 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc66f80 0x5619afcdba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f166f7fe640 1 -- 172.21.15.90:0/3508084072 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc53df0 msgr2=0x5619afc79a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:23.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f166f7fe640 1 --2- 172.21.15.90:0/3508084072 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc53df0 0x5619afc79a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f166f7fe640 1 -- 172.21.15.90:0/3508084072 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619afc79fa0 con 0x5619afc30ef0 2024-09-10T23:16:23.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.338+0000 7f166effd640 1 --2- 172.21.15.90:0/3508084072 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc53df0 0x5619afc79a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:23.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f166f7fe640 1 --2- 172.21.15.90:0/3508084072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc30ef0 0x5619afc70e10 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1660009d90 tx=0x7f1660004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d755d9232cf15c22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f164e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:16:23.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f164e7fc640 1 -- 172.21.15.90:0/3508084072 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166005d060 con 0x5619afc30ef0 2024-09-10T23:16:23.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f164e7fc640 1 -- 172.21.15.90:0/3508084072 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f16600538e0 con 0x5619afc30ef0 2024-09-10T23:16:23.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f1678cb4740 1 -- 172.21.15.90:0/3508084072 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1668001a30 con 0x5619afc30ef0 2024-09-10T23:16:23.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f164e7fc640 1 -- 172.21.15.90:0/3508084072 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1660063050 con 0x5619afc30ef0 2024-09-10T23:16:23.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f1678cb4740 10 client.5775 fetch_fsmap learned FSMap version 30 2024-09-10T23:16:23.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f1678cb4740 1 -- 172.21.15.90:0/3508084072 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x5619afc7b660 con 0x5619afc30ef0 2024-09-10T23:16:23.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f164e7fc640 1 -- 172.21.15.90:0/3508084072 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1668001a30 con 0x5619afc30ef0 2024-09-10T23:16:23.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f164e7fc640 1 -- 172.21.15.90:0/3508084072 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) ==== 3522+0+0 (secure 0 0 0) 0x7f1660066020 con 0x5619afc30ef0 2024-09-10T23:16:23.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f1678cb4740 10 client.5775 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:16:23.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f1678cb4740 10 client.5775 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:16:23.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f1678cb4740 20 client.5775 populate_metadata read hostname 'smithi090' 2024-09-10T23:16:23.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f1678cb4740 1 --2- 172.21.15.90:0/3508084072 >> [v2:172.21.15.90:6832/2007304013,v1:172.21.15.90:6833/2007304013] conn(0x5619afc0cbc0 0x5619afc2f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f1678cb4740 4 client.5775 mds_command: new command op to 5553 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:16:23.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f1678cb4740 1 -- 172.21.15.90:0/3508084072 --> [v2:172.21.15.90:6832/2007304013,v1:172.21.15.90:6833/2007304013] -- command(tid 0: {"prefix": "status"}) -- 0x5619afb7e220 con 0x5619afc0cbc0 2024-09-10T23:16:23.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f166effd640 1 --2- 172.21.15.90:0/3508084072 >> [v2:172.21.15.90:6832/2007304013,v1:172.21.15.90:6833/2007304013] conn(0x5619afc0cbc0 0x5619afc2f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f166effd640 1 --2- 172.21.15.90:0/3508084072 >> [v2:172.21.15.90:6832/2007304013,v1:172.21.15.90:6833/2007304013] conn(0x5619afc0cbc0 0x5619afc2f810 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4a1421d0372088b5 server_cookie=6df639e848d06fbf in_seq=0 out_seq=0 2024-09-10T23:16:23.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.339+0000 7f164e7fc640 10 client.5775 ms_handle_connect on v2:172.21.15.90:6832/2007304013 2024-09-10T23:16:23.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f164e7fc640 1 -- 172.21.15.90:0/3508084072 <== mds.1 v2:172.21.15.90:6832/2007304013 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5619afb7e220 con 0x5619afc0cbc0 2024-09-10T23:16:23.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f164e7fc640 10 client.5775 handle_command_reply: tid=0 2024-09-10T23:16:23.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f1678cb4740 1 client.5775 shutdown 2024-09-10T23:16:23.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f1678cb4740 1 -- 172.21.15.90:0/3508084072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc30ef0 msgr2=0x5619afc70e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f1678cb4740 1 --2- 172.21.15.90:0/3508084072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc30ef0 0x5619afc70e10 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1660009d90 tx=0x7f1660004ab0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f1678cb4740 1 -- 172.21.15.90:0/3508084072 shutdown_connections 2024-09-10T23:16:23.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f1678cb4740 1 --2- 172.21.15.90:0/3508084072 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619afc53df0 0x5619afc79a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f1678cb4740 1 --2- 172.21.15.90:0/3508084072 >> [v2:172.21.15.90:6832/2007304013,v1:172.21.15.90:6833/2007304013] conn(0x5619afc0cbc0 0x5619afc2f810 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f1678cb4740 1 --2- 172.21.15.90:0/3508084072 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5619afc66f80 0x5619afcdba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f164e7fc640 0 client.5775 ms_handle_reset on v2:172.21.15.90:6832/2007304013 2024-09-10T23:16:23.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f1678cb4740 1 --2- 172.21.15.90:0/3508084072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619afc30ef0 0x5619afc70e10 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f1678cb4740 1 -- 172.21.15.90:0/3508084072 >> 172.21.15.90:0/3508084072 conn(0x5619afc0f310 msgr2=0x5619afc038e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:23.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f1678cb4740 1 -- 172.21.15.90:0/3508084072 shutdown_connections 2024-09-10T23:16:23.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f1678cb4740 1 -- 172.21.15.90:0/3508084072 wait complete. 2024-09-10T23:16:23.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f1678cb4740 20 client.5775 trim_cache size 0 max 16384 2024-09-10T23:16:23.349 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:16:23.349 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd", 2024-09-10T23:16:23.350 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 1, 2024-09-10T23:16:23.350 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 5553, 2024-09-10T23:16:23.350 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-09-10T23:16:23.350 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-09-10T23:16:23.350 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2024-09-10T23:16:23.350 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 2.6419024059999998, 2024-09-10T23:16:23.350 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 30, 2024-09-10T23:16:23.350 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 57, 2024-09-10T23:16:23.350 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 57, 2024-09-10T23:16:23.350 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 18.855178212999999 2024-09-10T23:16:23.350 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:16:23.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f1675ee6640 1 -- 172.21.15.90:0/2354226562 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f165c077fa0 msgr2=0x7f165c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f1675ee6640 1 --2- 172.21.15.90:0/2354226562 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f165c077fa0 0x7f165c07a460 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1660035000 tx=0x7f1660039040 comp rx=0 tx=0).stop 2024-09-10T23:16:23.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f1675ee6640 1 -- 172.21.15.90:0/2354226562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f167015ab30 msgr2=0x7f16701f6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.340+0000 7f1675ee6640 1 --2- 172.21.15.90:0/2354226562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f167015ab30 0x7f16701f6c90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f166400e790 tx=0x7f166400ec50 comp rx=0 tx=0).stop 2024-09-10T23:16:23.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.341+0000 7f1675ee6640 1 -- 172.21.15.90:0/2354226562 shutdown_connections 2024-09-10T23:16:23.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.341+0000 7f1675ee6640 1 --2- 172.21.15.90:0/2354226562 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f165c077fa0 0x7f165c07a460 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.341+0000 7f1675ee6640 1 --2- 172.21.15.90:0/2354226562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f167015af10 0x7f16700b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.341+0000 7f1675ee6640 1 --2- 172.21.15.90:0/2354226562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f167015ab30 0x7f16701f6c90 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.341+0000 7f1675ee6640 1 --2- 172.21.15.90:0/2354226562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16700ceab0 0x7f1670150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.341+0000 7f1675ee6640 1 -- 172.21.15.90:0/2354226562 >> 172.21.15.90:0/2354226562 conn(0x7f16700cd960 msgr2=0x7f16700cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:23.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.341+0000 7f1675ee6640 1 -- 172.21.15.90:0/2354226562 shutdown_connections 2024-09-10T23:16:23.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.341+0000 7f1675ee6640 1 -- 172.21.15.90:0/2354226562 wait complete. 2024-09-10T23:16:23.353 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T23:16:23.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.453+0000 7f71bebda640 1 -- 172.21.15.90:0/3532299174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b806f850 msgr2=0x7f71b80b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.453+0000 7f71bebda640 1 --2- 172.21.15.90:0/3532299174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b806f850 0x7f71b80b1850 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f71b0005fd0 tx=0x7f71b002a8b0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.454+0000 7f71bebda640 1 -- 172.21.15.90:0/3532299174 shutdown_connections 2024-09-10T23:16:23.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.454+0000 7f71bebda640 1 --2- 172.21.15.90:0/3532299174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b806f850 0x7f71b80b1850 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.454+0000 7f71bebda640 1 -- 172.21.15.90:0/3532299174 >> 172.21.15.90:0/3532299174 conn(0x7f71b80cc850 msgr2=0x7f71b80ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:23.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.454+0000 7f71bebda640 1 -- 172.21.15.90:0/3532299174 shutdown_connections 2024-09-10T23:16:23.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.454+0000 7f71bebda640 1 -- 172.21.15.90:0/3532299174 wait complete. 2024-09-10T23:16:23.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.455+0000 7f71bebda640 1 Processor -- start 2024-09-10T23:16:23.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.455+0000 7f71bebda640 1 -- start start 2024-09-10T23:16:23.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71bebda640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71b806f850 0x7f71b809a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71bebda640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b80cb7e0 0x7f71b815aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71bebda640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71b815bcb0 0x7f71b80b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71bebda640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f71b80cacb0 con 0x7f71b80cb7e0 2024-09-10T23:16:23.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71bebda640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f71b80cab30 con 0x7f71b806f850 2024-09-10T23:16:23.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71bebda640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f71b80b1d90 con 0x7f71b815bcb0 2024-09-10T23:16:23.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71affff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b80cb7e0 0x7f71b815aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71affff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b80cb7e0 0x7f71b815aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42886/0 (socket says 172.21.15.90:42886) 2024-09-10T23:16:23.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71affff640 1 -- 172.21.15.90:0/269380146 learned_addr learned my addr 172.21.15.90:0/269380146 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:23.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71bc976640 1 --2- 172.21.15.90:0/269380146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71b806f850 0x7f71b809a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71bd177640 1 --2- 172.21.15.90:0/269380146 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71b815bcb0 0x7f71b80b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71affff640 1 -- 172.21.15.90:0/269380146 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71b815bcb0 msgr2=0x7f71b80b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71affff640 1 --2- 172.21.15.90:0/269380146 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71b815bcb0 0x7f71b80b4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71affff640 1 -- 172.21.15.90:0/269380146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71b806f850 msgr2=0x7f71b809a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71affff640 1 --2- 172.21.15.90:0/269380146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71b806f850 0x7f71b809a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71affff640 1 -- 172.21.15.90:0/269380146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b81f6720 con 0x7f71b80cb7e0 2024-09-10T23:16:23.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71bd177640 1 --2- 172.21.15.90:0/269380146 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71b815bcb0 0x7f71b80b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:23.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71affff640 1 --2- 172.21.15.90:0/269380146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b80cb7e0 0x7f71b815aed0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f71a800c430 tx=0x7f71a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71ad7fa640 1 -- 172.21.15.90:0/269380146 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8011790 con 0x7f71b80cb7e0 2024-09-10T23:16:23.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71ad7fa640 1 -- 172.21.15.90:0/269380146 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71a8017070 con 0x7f71b80cb7e0 2024-09-10T23:16:23.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71bebda640 1 -- 172.21.15.90:0/269380146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b81f5870 con 0x7f71b80cb7e0 2024-09-10T23:16:23.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71ad7fa640 1 -- 172.21.15.90:0/269380146 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8011d00 con 0x7f71b80cb7e0 2024-09-10T23:16:23.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.456+0000 7f71bebda640 1 -- 172.21.15.90:0/269380146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b81f5df0 con 0x7f71b80cb7e0 2024-09-10T23:16:23.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.458+0000 7f71ad7fa640 1 -- 172.21.15.90:0/269380146 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f71a801c460 con 0x7f71b80cb7e0 2024-09-10T23:16:23.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.459+0000 7f71ad7fa640 1 --2- 172.21.15.90:0/269380146 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f71a4077f70 0x7f71a407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.459+0000 7f71ad7fa640 1 -- 172.21.15.90:0/269380146 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f71a8099c30 con 0x7f71b80cb7e0 2024-09-10T23:16:23.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.459+0000 7f71bc976640 1 --2- 172.21.15.90:0/269380146 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f71a4077f70 0x7f71a407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.459+0000 7f71c1a86740 1 Processor -- start 2024-09-10T23:16:23.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.459+0000 7f71c1a86740 1 -- start start 2024-09-10T23:16:23.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.460+0000 7f71bc976640 1 --2- 172.21.15.90:0/269380146 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f71a4077f70 0x7f71a407a430 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f71b4001720 tx=0x7f71b4007e90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.460+0000 7f71c1a86740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fa11b0 0x560238f78b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.460+0000 7f71c1a86740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fc0df0 0x560238fc11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.460+0000 7f71c1a86740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238f765f0 0x560238f76a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.460+0000 7f71c1a86740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560238eed820 con 0x560238fa11b0 2024-09-10T23:16:23.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.460+0000 7f71c1a86740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560238edcc50 con 0x560238fc0df0 2024-09-10T23:16:23.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.460+0000 7f71c1a86740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x560238ee0a60 con 0x560238f765f0 2024-09-10T23:16:23.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.460+0000 7f71bc976640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fa11b0 0x560238f78b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.460+0000 7f71bc976640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fa11b0 0x560238f78b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42900/0 (socket says 172.21.15.90:42900) 2024-09-10T23:16:23.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.460+0000 7f71bc976640 1 -- 172.21.15.90:0/2481256888 learned_addr learned my addr 172.21.15.90:0/2481256888 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:23.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.460+0000 7f71affff640 1 --2- 172.21.15.90:0/2481256888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fc0df0 0x560238fc11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.460+0000 7f71bd177640 1 --2- 172.21.15.90:0/2481256888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238f765f0 0x560238f76a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.460+0000 7f71bc976640 1 -- 172.21.15.90:0/2481256888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238f765f0 msgr2=0x560238f76a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:23.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.460+0000 7f71bc976640 1 --2- 172.21.15.90:0/2481256888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238f765f0 0x560238f76a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.460+0000 7f71bc976640 1 -- 172.21.15.90:0/2481256888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fc0df0 msgr2=0x560238fc11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:23.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.460+0000 7f71bc976640 1 --2- 172.21.15.90:0/2481256888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fc0df0 0x560238fc11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.460+0000 7f71bc976640 1 -- 172.21.15.90:0/2481256888 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560238c3e850 con 0x560238fa11b0 2024-09-10T23:16:23.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.461+0000 7f71bc976640 1 --2- 172.21.15.90:0/2481256888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fa11b0 0x560238f78b20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f71b400fb20 tx=0x7f71b4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83965d31fb573cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.461+0000 7f719e7fc640 1 -- 172.21.15.90:0/2481256888 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b401b050 con 0x560238fa11b0 2024-09-10T23:16:23.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.461+0000 7f719e7fc640 1 -- 172.21.15.90:0/2481256888 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71b4025070 con 0x560238fa11b0 2024-09-10T23:16:23.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.461+0000 7f719e7fc640 1 -- 172.21.15.90:0/2481256888 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4020440 con 0x560238fa11b0 2024-09-10T23:16:23.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.461+0000 7f71c1a86740 1 -- 172.21.15.90:0/2481256888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fa11b0 msgr2=0x560238f78b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.461+0000 7f71c1a86740 1 --2- 172.21.15.90:0/2481256888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fa11b0 0x560238f78b20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f71b400fb20 tx=0x7f71b4012000 comp rx=0 tx=0).stop 2024-09-10T23:16:23.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.461+0000 7f71c1a86740 1 -- 172.21.15.90:0/2481256888 shutdown_connections 2024-09-10T23:16:23.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.461+0000 7f71c1a86740 1 --2- 172.21.15.90:0/2481256888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fc0df0 0x560238fc11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.461+0000 7f71c1a86740 1 --2- 172.21.15.90:0/2481256888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238f765f0 0x560238f76a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.461+0000 7f71c1a86740 1 --2- 172.21.15.90:0/2481256888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fa11b0 0x560238f78b20 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.461+0000 7f71c1a86740 1 -- 172.21.15.90:0/2481256888 >> 172.21.15.90:0/2481256888 conn(0x560238f776a0 msgr2=0x560238f7b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:23.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.461+0000 7f71c1a86740 1 -- 172.21.15.90:0/2481256888 shutdown_connections 2024-09-10T23:16:23.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.461+0000 7f71c1a86740 1 -- 172.21.15.90:0/2481256888 wait complete. 2024-09-10T23:16:23.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.462+0000 7f71c1a86740 1 -- start start 2024-09-10T23:16:23.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.462+0000 7f71c1a86740 1 Processor -- start 2024-09-10T23:16:23.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.463+0000 7f71c1a86740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238fa11b0 0x560238fa2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.463+0000 7f71c1a86740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fc0df0 0x560238fb9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.463+0000 7f71c1a86740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fb9650 0x560238f9cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.463+0000 7f71c1a86740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560238c4d620 con 0x560238fb9650 2024-09-10T23:16:23.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.463+0000 7f71c1a86740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560238e825f0 con 0x560238fc0df0 2024-09-10T23:16:23.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.463+0000 7f71c1a86740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x560238f75b30 con 0x560238fa11b0 2024-09-10T23:16:23.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.463+0000 7f71c1a86740 10 client.0 _ll_register_callbacks cb 0x560238e860a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:16:23.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.463+0000 7f71bd177640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fb9650 0x560238f9cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.463+0000 7f71bd177640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fb9650 0x560238f9cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42908/0 (socket says 172.21.15.90:42908) 2024-09-10T23:16:23.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.463+0000 7f71bd177640 1 -- 172.21.15.90:0/4234420385 learned_addr learned my addr 172.21.15.90:0/4234420385 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:23.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.463+0000 7f71bc976640 1 --2- 172.21.15.90:0/4234420385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238fa11b0 0x560238fa2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.463+0000 7f71affff640 1 --2- 172.21.15.90:0/4234420385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fc0df0 0x560238fb9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.463+0000 7f71bd177640 1 -- 172.21.15.90:0/4234420385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238fa11b0 msgr2=0x560238fa2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:23.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.463+0000 7f71bd177640 1 --2- 172.21.15.90:0/4234420385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238fa11b0 0x560238fa2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.463+0000 7f71bd177640 1 -- 172.21.15.90:0/4234420385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fc0df0 msgr2=0x560238fb9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:23.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.463+0000 7f71bd177640 1 --2- 172.21.15.90:0/4234420385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fc0df0 0x560238fb9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.463+0000 7f71bd177640 1 -- 172.21.15.90:0/4234420385 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560238cb56b0 con 0x560238fb9650 2024-09-10T23:16:23.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.464+0000 7f71bd177640 1 --2- 172.21.15.90:0/4234420385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fb9650 0x560238f9cc90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f71b0006010 tx=0x7f71b0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7404c31ff93b8680 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.464+0000 7f71977fe640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:16:23.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.464+0000 7f71977fe640 1 -- 172.21.15.90:0/4234420385 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0004700 con 0x560238fb9650 2024-09-10T23:16:23.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.464+0000 7f71977fe640 1 -- 172.21.15.90:0/4234420385 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f71b0046480 con 0x560238fb9650 2024-09-10T23:16:23.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.464+0000 7f71c1a86740 1 -- 172.21.15.90:0/4234420385 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71b4025070 con 0x560238fb9650 2024-09-10T23:16:23.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.464+0000 7f71977fe640 1 -- 172.21.15.90:0/4234420385 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f71b0046680 con 0x560238fb9650 2024-09-10T23:16:23.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.464+0000 7f71c1a86740 10 client.5790 fetch_fsmap learned FSMap version 30 2024-09-10T23:16:23.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.464+0000 7f71c1a86740 1 -- 172.21.15.90:0/4234420385 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x560238fa44e0 con 0x560238fb9650 2024-09-10T23:16:23.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.464+0000 7f71977fe640 1 -- 172.21.15.90:0/4234420385 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71b4025070 con 0x560238fb9650 2024-09-10T23:16:23.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.464+0000 7f71977fe640 1 -- 172.21.15.90:0/4234420385 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) ==== 3522+0+0 (secure 0 0 0) 0x7f71b0046820 con 0x560238fb9650 2024-09-10T23:16:23.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.464+0000 7f71c1a86740 10 client.5790 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:16:23.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.464+0000 7f71c1a86740 10 client.5790 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:16:23.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.464+0000 7f71c1a86740 20 client.5790 populate_metadata read hostname 'smithi090' 2024-09-10T23:16:23.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.464+0000 7f71c1a86740 1 --2- 172.21.15.90:0/4234420385 >> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] conn(0x560238f890a0 0x560238f89480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.464+0000 7f71c1a86740 4 client.5790 mds_command: new command op to 5556 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:16:23.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.464+0000 7f71c1a86740 1 -- 172.21.15.90:0/4234420385 --> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560238eef770 con 0x560238f890a0 2024-09-10T23:16:23.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.464+0000 7f71bc976640 1 --2- 172.21.15.90:0/4234420385 >> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] conn(0x560238f890a0 0x560238f89480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.465+0000 7f71977fe640 10 client.5790 ms_handle_connect on v2:172.21.15.90:6834/1708086583 2024-09-10T23:16:23.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.465+0000 7f71bc976640 1 --2- 172.21.15.90:0/4234420385 >> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] conn(0x560238f890a0 0x560238f89480 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=895d54cbf7613f6a server_cookie=ae183730374043a4 in_seq=0 out_seq=0 2024-09-10T23:16:23.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.465+0000 7f71977fe640 1 -- 172.21.15.90:0/4234420385 <== mds.0 v2:172.21.15.90:6834/1708086583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560238eef770 con 0x560238f890a0 2024-09-10T23:16:23.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.465+0000 7f71977fe640 10 client.5790 handle_command_reply: tid=0 2024-09-10T23:16:23.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.465+0000 7f71c1a86740 1 client.5790 shutdown 2024-09-10T23:16:23.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.465+0000 7f71c1a86740 1 -- 172.21.15.90:0/4234420385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fb9650 msgr2=0x560238f9cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.465+0000 7f71c1a86740 1 --2- 172.21.15.90:0/4234420385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fb9650 0x560238f9cc90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f71b0006010 tx=0x7f71b0004040 comp rx=0 tx=0).stop 2024-09-10T23:16:23.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.465+0000 7f71c1a86740 1 -- 172.21.15.90:0/4234420385 shutdown_connections 2024-09-10T23:16:23.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.465+0000 7f71c1a86740 1 --2- 172.21.15.90:0/4234420385 >> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] conn(0x560238f890a0 0x560238f89480 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.465+0000 7f71c1a86740 1 --2- 172.21.15.90:0/4234420385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fc0df0 0x560238fb9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.465+0000 7f71c1a86740 1 --2- 172.21.15.90:0/4234420385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fb9650 0x560238f9cc90 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.465+0000 7f71c1a86740 1 --2- 172.21.15.90:0/4234420385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238fa11b0 0x560238fa2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.465+0000 7f71977fe640 0 client.5790 ms_handle_reset on v2:172.21.15.90:6834/1708086583 2024-09-10T23:16:23.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.465+0000 7f71c1a86740 1 -- 172.21.15.90:0/4234420385 >> 172.21.15.90:0/4234420385 conn(0x560238f765f0 msgr2=0x560238fa1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:23.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.466+0000 7f71c1a86740 1 -- 172.21.15.90:0/4234420385 shutdown_connections 2024-09-10T23:16:23.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.466+0000 7f71c1a86740 1 -- 172.21.15.90:0/4234420385 wait complete. 2024-09-10T23:16:23.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.466+0000 7f71c1a86740 20 client.5790 trim_cache size 0 max 16384 2024-09-10T23:16:23.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.483+0000 7f71c1a86740 1 Processor -- start 2024-09-10T23:16:23.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.483+0000 7f71c1a86740 1 -- start start 2024-09-10T23:16:23.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.484+0000 7f71c1a86740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fa11b0 0x560238fa3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.484+0000 7f71c1a86740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238fb9650 0x560238f76bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.484+0000 7f71c1a86740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fc0df0 0x560238fe38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.484+0000 7f71c1a86740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f71b81fef70 con 0x560238fa11b0 2024-09-10T23:16:23.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.484+0000 7f71c1a86740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f71b81f31a0 con 0x560238fc0df0 2024-09-10T23:16:23.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.484+0000 7f71c1a86740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f71b80c4610 con 0x560238fb9650 2024-09-10T23:16:23.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.484+0000 7f71bc976640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fa11b0 0x560238fa3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.484+0000 7f71bc976640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fa11b0 0x560238fa3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42920/0 (socket says 172.21.15.90:42920) 2024-09-10T23:16:23.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.484+0000 7f71bc976640 1 -- 172.21.15.90:0/4258592824 learned_addr learned my addr 172.21.15.90:0/4258592824 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:23.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.484+0000 7f71bc976640 1 -- 172.21.15.90:0/4258592824 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238fb9650 msgr2=0x560238f76bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:23.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.484+0000 7f71bc976640 1 --2- 172.21.15.90:0/4258592824 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238fb9650 0x560238f76bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.484+0000 7f71bc976640 1 -- 172.21.15.90:0/4258592824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fc0df0 msgr2=0x560238fe38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:23.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.484+0000 7f71bc976640 1 --2- 172.21.15.90:0/4258592824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fc0df0 0x560238fe38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.484+0000 7f71bc976640 1 -- 172.21.15.90:0/4258592824 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560238fbb0a0 con 0x560238fa11b0 2024-09-10T23:16:23.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.485+0000 7f71bc976640 1 --2- 172.21.15.90:0/4258592824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fa11b0 0x560238fa3170 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f71b4022040 tx=0x7f71b4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9813bace8e4e12ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.485+0000 7f719dffb640 1 -- 172.21.15.90:0/4258592824 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b401b040 con 0x560238fa11b0 2024-09-10T23:16:23.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.485+0000 7f719dffb640 1 -- 172.21.15.90:0/4258592824 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71b4025040 con 0x560238fa11b0 2024-09-10T23:16:23.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.485+0000 7f719dffb640 1 -- 172.21.15.90:0/4258592824 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4006b80 con 0x560238fa11b0 2024-09-10T23:16:23.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.485+0000 7f71c1a86740 1 -- 172.21.15.90:0/4258592824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fa11b0 msgr2=0x560238fa3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.485+0000 7f71c1a86740 1 --2- 172.21.15.90:0/4258592824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fa11b0 0x560238fa3170 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f71b4022040 tx=0x7f71b4000bc0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.485+0000 7f71c1a86740 1 -- 172.21.15.90:0/4258592824 shutdown_connections 2024-09-10T23:16:23.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.485+0000 7f71c1a86740 1 --2- 172.21.15.90:0/4258592824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fc0df0 0x560238fe38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.485+0000 7f71c1a86740 1 --2- 172.21.15.90:0/4258592824 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238fb9650 0x560238f76bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.485+0000 7f71c1a86740 1 --2- 172.21.15.90:0/4258592824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fa11b0 0x560238fa3170 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.485+0000 7f71c1a86740 1 -- 172.21.15.90:0/4258592824 >> 172.21.15.90:0/4258592824 conn(0x560238f765f0 msgr2=0x560238fc11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:23.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.485+0000 7f71c1a86740 1 -- 172.21.15.90:0/4258592824 shutdown_connections 2024-09-10T23:16:23.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.485+0000 7f71c1a86740 1 -- 172.21.15.90:0/4258592824 wait complete. 2024-09-10T23:16:23.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.486+0000 7f71c1a86740 1 -- start start 2024-09-10T23:16:23.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.486+0000 7f71c1a86740 1 Processor -- start 2024-09-10T23:16:23.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71c1a86740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238fa11b0 0x560238fcee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71c1a86740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fb9650 0x560238fd2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71c1a86740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fc0df0 0x560238f98b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71c1a86740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560238fd35b0 con 0x560238fc0df0 2024-09-10T23:16:23.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71c1a86740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560238f89ca0 con 0x560238fb9650 2024-09-10T23:16:23.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71c1a86740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x560238f8b490 con 0x560238fa11b0 2024-09-10T23:16:23.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71c1a86740 10 client.0 _ll_register_callbacks cb 0x7f71b0009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:16:23.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71bd177640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fc0df0 0x560238f98b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71bd177640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fc0df0 0x560238f98b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42926/0 (socket says 172.21.15.90:42926) 2024-09-10T23:16:23.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71bd177640 1 -- 172.21.15.90:0/3396229015 learned_addr learned my addr 172.21.15.90:0/3396229015 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:23.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71bc976640 1 --2- 172.21.15.90:0/3396229015 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238fa11b0 0x560238fcee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71affff640 1 --2- 172.21.15.90:0/3396229015 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fb9650 0x560238fd2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71bd177640 1 -- 172.21.15.90:0/3396229015 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238fa11b0 msgr2=0x560238fcee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:23.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71bd177640 1 --2- 172.21.15.90:0/3396229015 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238fa11b0 0x560238fcee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71bd177640 1 -- 172.21.15.90:0/3396229015 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fb9650 msgr2=0x560238fd2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:23.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71bd177640 1 --2- 172.21.15.90:0/3396229015 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fb9650 0x560238fd2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71bd177640 1 -- 172.21.15.90:0/3396229015 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560238fd2aa0 con 0x560238fc0df0 2024-09-10T23:16:23.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71affff640 1 --2- 172.21.15.90:0/3396229015 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fb9650 0x560238fd2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:23.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71bd177640 1 --2- 172.21.15.90:0/3396229015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fc0df0 0x560238f98b00 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f71b0005c60 tx=0x7f71b0009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641a1527485ec132 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71977fe640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:16:23.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71977fe640 1 -- 172.21.15.90:0/3396229015 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0004500 con 0x560238fc0df0 2024-09-10T23:16:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71977fe640 1 -- 172.21.15.90:0/3396229015 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f71b00046a0 con 0x560238fc0df0 2024-09-10T23:16:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.487+0000 7f71c1a86740 1 -- 172.21.15.90:0/3396229015 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71b4025040 con 0x560238fc0df0 2024-09-10T23:16:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.488+0000 7f71977fe640 1 -- 172.21.15.90:0/3396229015 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f71b0052450 con 0x560238fc0df0 2024-09-10T23:16:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.488+0000 7f71c1a86740 10 client.5796 fetch_fsmap learned FSMap version 30 2024-09-10T23:16:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.488+0000 7f71c1a86740 1 -- 172.21.15.90:0/3396229015 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x560238fe4230 con 0x560238fc0df0 2024-09-10T23:16:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.488+0000 7f71977fe640 1 -- 172.21.15.90:0/3396229015 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71b4025040 con 0x560238fc0df0 2024-09-10T23:16:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.488+0000 7f71977fe640 1 -- 172.21.15.90:0/3396229015 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) ==== 3522+0+0 (secure 0 0 0) 0x7f71b0063080 con 0x560238fc0df0 2024-09-10T23:16:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.488+0000 7f71c1a86740 10 client.5796 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:16:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.488+0000 7f71c1a86740 10 client.5796 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:16:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.488+0000 7f71c1a86740 20 client.5796 populate_metadata read hostname 'smithi090' 2024-09-10T23:16:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.488+0000 7f71c1a86740 1 --2- 172.21.15.90:0/3396229015 >> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] conn(0x560238fb8080 0x560238fb8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.488+0000 7f71c1a86740 4 client.5796 mds_command: new command op to 5556 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:16:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.488+0000 7f71c1a86740 1 -- 172.21.15.90:0/3396229015 --> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] -- command(tid 0: {"prefix": "status"}) -- 0x560238eeb220 con 0x560238fb8080 2024-09-10T23:16:23.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.488+0000 7f71bc976640 1 --2- 172.21.15.90:0/3396229015 >> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] conn(0x560238fb8080 0x560238fb8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.488+0000 7f71977fe640 10 client.5796 ms_handle_connect on v2:172.21.15.90:6834/1708086583 2024-09-10T23:16:23.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.488+0000 7f71bc976640 1 --2- 172.21.15.90:0/3396229015 >> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] conn(0x560238fb8080 0x560238fb8460 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6b93dc35c2a51c1 server_cookie=9155b62ddf0293eb in_seq=0 out_seq=0 2024-09-10T23:16:23.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71977fe640 1 -- 172.21.15.90:0/3396229015 <== mds.0 v2:172.21.15.90:6834/1708086583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x560238eeb220 con 0x560238fb8080 2024-09-10T23:16:23.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71977fe640 10 client.5796 handle_command_reply: tid=0 2024-09-10T23:16:23.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71c1a86740 1 client.5796 shutdown 2024-09-10T23:16:23.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71c1a86740 1 -- 172.21.15.90:0/3396229015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fc0df0 msgr2=0x560238f98b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71c1a86740 1 --2- 172.21.15.90:0/3396229015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fc0df0 0x560238f98b00 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f71b0005c60 tx=0x7f71b0009940 comp rx=0 tx=0).stop 2024-09-10T23:16:23.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71c1a86740 1 -- 172.21.15.90:0/3396229015 shutdown_connections 2024-09-10T23:16:23.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71c1a86740 1 --2- 172.21.15.90:0/3396229015 >> [v2:172.21.15.90:6834/1708086583,v1:172.21.15.90:6835/1708086583] conn(0x560238fb8080 0x560238fb8460 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71c1a86740 1 --2- 172.21.15.90:0/3396229015 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560238fb9650 0x560238fd2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71977fe640 0 client.5796 ms_handle_reset on v2:172.21.15.90:6834/1708086583 2024-09-10T23:16:23.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71c1a86740 1 --2- 172.21.15.90:0/3396229015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560238fc0df0 0x560238f98b00 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71c1a86740 1 --2- 172.21.15.90:0/3396229015 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560238fa11b0 0x560238fcee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71c1a86740 1 -- 172.21.15.90:0/3396229015 >> 172.21.15.90:0/3396229015 conn(0x560238f765f0 msgr2=0x560238f76bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:23.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71c1a86740 1 -- 172.21.15.90:0/3396229015 shutdown_connections 2024-09-10T23:16:23.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71c1a86740 1 -- 172.21.15.90:0/3396229015 wait complete. 2024-09-10T23:16:23.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71c1a86740 20 client.5796 trim_cache size 0 max 16384 2024-09-10T23:16:23.499 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:16:23.500 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd", 2024-09-10T23:16:23.500 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2024-09-10T23:16:23.500 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 5556, 2024-09-10T23:16:23.500 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-09-10T23:16:23.500 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-09-10T23:16:23.500 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2024-09-10T23:16:23.500 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 15.256529643, 2024-09-10T23:16:23.500 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 30, 2024-09-10T23:16:23.500 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 57, 2024-09-10T23:16:23.500 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 57, 2024-09-10T23:16:23.500 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 19.002839350999999 2024-09-10T23:16:23.500 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:16:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71bebda640 1 -- 172.21.15.90:0/269380146 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f71a4077f70 msgr2=0x7f71a407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71bebda640 1 --2- 172.21.15.90:0/269380146 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f71a4077f70 0x7f71a407a430 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f71b4001720 tx=0x7f71b4007e90 comp rx=0 tx=0).stop 2024-09-10T23:16:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71bebda640 1 -- 172.21.15.90:0/269380146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b80cb7e0 msgr2=0x7f71b815aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.489+0000 7f71bebda640 1 --2- 172.21.15.90:0/269380146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b80cb7e0 0x7f71b815aed0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f71a800c430 tx=0x7f71a800c8f0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.490+0000 7f71bebda640 1 -- 172.21.15.90:0/269380146 shutdown_connections 2024-09-10T23:16:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.490+0000 7f71bebda640 1 --2- 172.21.15.90:0/269380146 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f71a4077f70 0x7f71a407a430 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.490+0000 7f71bebda640 1 --2- 172.21.15.90:0/269380146 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71b815bcb0 0x7f71b80b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.490+0000 7f71bebda640 1 --2- 172.21.15.90:0/269380146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71b80cb7e0 0x7f71b815aed0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.490+0000 7f71bebda640 1 --2- 172.21.15.90:0/269380146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71b806f850 0x7f71b809a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.490+0000 7f71bebda640 1 -- 172.21.15.90:0/269380146 >> 172.21.15.90:0/269380146 conn(0x7f71b80cc850 msgr2=0x7f71b80ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.490+0000 7f71bebda640 1 -- 172.21.15.90:0/269380146 shutdown_connections 2024-09-10T23:16:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.490+0000 7f71bebda640 1 -- 172.21.15.90:0/269380146 wait complete. 2024-09-10T23:16:23.505 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:16:23.507 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:16:23.548 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2024-09-10T23:16:23.548 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2024-09-10T23:16:23.548 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:16:23.548 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2024-09-10T23:16:23.548 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.548 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2024-09-10T23:16:23.549 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.549 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2024-09-10T23:16:23.549 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.549 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2024-09-10T23:16:23.549 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2024-09-10T23:16:23.549 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.549 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2024-09-10T23:16:23.549 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2024-09-10T23:16:23.549 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.549 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:16:23.549 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2024-09-10T23:16:23.549 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.549 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:16:23.550 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:16:23.550 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.550 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2024-09-10T23:16:23.550 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.550 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2024-09-10T23:16:23.550 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2024-09-10T23:16:23.550 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:16:23.550 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:16:23.550 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2024-09-10T23:16:23.550 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:16:23.550 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2024-09-10T23:16:23.550 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:16:23.550 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:16:23.551 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2024-09-10T23:16:23.551 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.551 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:16:23.551 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.551 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2024-09-10T23:16:23.551 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.551 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2024-09-10T23:16:23.551 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.551 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2024-09-10T23:16:23.551 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2024-09-10T23:16:23.551 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2024-09-10T23:16:23.551 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.90,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-09-10T23:16:23.551 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on skipped message = False 2024-09-10T23:16:23.551 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = 1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd 2024-09-10T23:16:23.552 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.552 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2024-09-10T23:16:23.552 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2024-09-10T23:16:23.552 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.552 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2024-09-10T23:16:23.552 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2024-09-10T23:16:23.552 INFO:teuthology.orchestra.run.smithi090.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:16:23.552 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.552 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2024-09-10T23:16:23.552 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2024-09-10T23:16:23.552 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.552 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2024-09-10T23:16:23.553 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2024-09-10T23:16:23.553 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2024-09-10T23:16:23.553 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug trim objects = true 2024-09-10T23:16:23.553 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.553 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2024-09-10T23:16:23.553 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2024-09-10T23:16:23.553 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.553 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:16:23.553 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.553 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2024-09-10T23:16:23.553 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.553 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2024-09-10T23:16:23.553 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.553 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:16:23.554 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2024-09-10T23:16:23.554 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.554 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2024-09-10T23:16:23.554 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2024-09-10T23:16:23.554 INFO:teuthology.orchestra.run.smithi090.stdout: bdev async discard = True 2024-09-10T23:16:23.554 INFO:teuthology.orchestra.run.smithi090.stdout: bdev enable discard = True 2024-09-10T23:16:23.554 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore allocator = bitmap 2024-09-10T23:16:23.554 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2024-09-10T23:16:23.554 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2024-09-10T23:16:23.554 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 1/20 2024-09-10T23:16:23.554 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 1/20 2024-09-10T23:16:23.554 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-10T23:16:23.554 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2024-09-10T23:16:23.554 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 4/10 2024-09-10T23:16:23.554 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:16:23.555 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2024-09-10T23:16:23.555 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:16:23.555 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:16:23.555 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2024-09-10T23:16:23.555 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.555 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2024-09-10T23:16:23.555 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-10T23:16:23.555 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2024-09-10T23:16:23.555 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-10T23:16:23.555 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-10T23:16:23.555 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:16:23.555 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:16:23.555 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2024-09-10T23:16:23.556 INFO:teuthology.orchestra.run.smithi090.stdout: client mount timeout = 30 2024-09-10T23:16:23.556 INFO:teuthology.orchestra.run.smithi090.stdout: debug client = 20 2024-09-10T23:16:23.556 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.556 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2024-09-10T23:16:23.556 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-10T23:16:23.556 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-10T23:16:23.556 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2024-09-10T23:16:23.556 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-10T23:16:23.556 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2024-09-10T23:16:23.556 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2024-09-10T23:16:23.556 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:16:23.556 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2024-09-10T23:16:23.556 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2024-09-10T23:16:23.557 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:16:23.557 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.557 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:16:23.557 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:16:23.557 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:16:23.557 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.557 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:16:23.557 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:16:23.557 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:16:23.557 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.557 INFO:teuthology.orchestra.run.smithi090.stdout: # 1m isn't quite enough 2024-09-10T23:16:23.557 INFO:teuthology.orchestra.run.smithi090.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:16:23.557 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.558 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:16:23.558 INFO:teuthology.orchestra.run.smithi090.stdout: mon down mkfs grace = 300 2024-09-10T23:16:23.558 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:23.558 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2024-09-10T23:16:23.558 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2024-09-10T23:16:23.558 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2024-09-10T23:16:23.558 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2024-09-10T23:16:23.558 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:16:23.558 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:16:23.558 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = "" 2024-09-10T23:16:23.558 INFO:teuthology.orchestra.run.smithi090.stdout: client reconnect stale = True 2024-09-10T23:16:23.558 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2024-09-10T23:16:23.558 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2024-09-10T23:16:23.559 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2024-09-10T23:16:23.559 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-09-10T23:16:23.559 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2024-09-10T23:16:23.559 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2024-09-10T23:16:23.559 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2024-09-10T23:16:23.559 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2024-09-10T23:16:23.560 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2024-09-10T23:16:23.560 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:16:23.560 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2024-09-10T23:16:23.560 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.560 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2024-09-10T23:16:23.560 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.560 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2024-09-10T23:16:23.560 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.560 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2024-09-10T23:16:23.560 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2024-09-10T23:16:23.560 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.561 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2024-09-10T23:16:23.561 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2024-09-10T23:16:23.561 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.561 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:16:23.561 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2024-09-10T23:16:23.561 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.561 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:16:23.561 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:16:23.561 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.561 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2024-09-10T23:16:23.561 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.561 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2024-09-10T23:16:23.562 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2024-09-10T23:16:23.562 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:16:23.562 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:16:23.562 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2024-09-10T23:16:23.562 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:16:23.562 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2024-09-10T23:16:23.562 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:16:23.562 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:16:23.562 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2024-09-10T23:16:23.562 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.562 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:16:23.562 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.562 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2024-09-10T23:16:23.562 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.563 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2024-09-10T23:16:23.563 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.563 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2024-09-10T23:16:23.563 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2024-09-10T23:16:23.563 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2024-09-10T23:16:23.563 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = "172.21.15.90,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-09-10T23:16:23.563 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on skipped message = False 2024-09-10T23:16:23.563 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = 1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd 2024-09-10T23:16:23.563 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.563 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2024-09-10T23:16:23.563 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2024-09-10T23:16:23.563 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.563 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2024-09-10T23:16:23.563 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2024-09-10T23:16:23.564 INFO:teuthology.orchestra.run.smithi171.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:16:23.564 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.564 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2024-09-10T23:16:23.564 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2024-09-10T23:16:23.564 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.564 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2024-09-10T23:16:23.564 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2024-09-10T23:16:23.564 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2024-09-10T23:16:23.564 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug trim objects = true 2024-09-10T23:16:23.564 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.564 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2024-09-10T23:16:23.564 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2024-09-10T23:16:23.564 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.565 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:16:23.565 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.565 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2024-09-10T23:16:23.565 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.565 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2024-09-10T23:16:23.565 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.565 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:16:23.565 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2024-09-10T23:16:23.565 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.565 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2024-09-10T23:16:23.565 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2024-09-10T23:16:23.565 INFO:teuthology.orchestra.run.smithi171.stdout: bdev async discard = True 2024-09-10T23:16:23.565 INFO:teuthology.orchestra.run.smithi171.stdout: bdev enable discard = True 2024-09-10T23:16:23.566 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore allocator = bitmap 2024-09-10T23:16:23.566 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2024-09-10T23:16:23.566 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2024-09-10T23:16:23.566 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 1/20 2024-09-10T23:16:23.566 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 1/20 2024-09-10T23:16:23.566 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-10T23:16:23.566 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2024-09-10T23:16:23.566 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 4/10 2024-09-10T23:16:23.566 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:16:23.566 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2024-09-10T23:16:23.566 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:16:23.567 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:16:23.567 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2024-09-10T23:16:23.567 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.567 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2024-09-10T23:16:23.567 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-10T23:16:23.567 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2024-09-10T23:16:23.567 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-09-10T23:16:23.567 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-09-10T23:16:23.567 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:16:23.567 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:16:23.567 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2024-09-10T23:16:23.567 INFO:teuthology.orchestra.run.smithi171.stdout: client mount timeout = 30 2024-09-10T23:16:23.567 INFO:teuthology.orchestra.run.smithi171.stdout: debug client = 20 2024-09-10T23:16:23.567 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.568 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2024-09-10T23:16:23.568 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-10T23:16:23.568 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-09-10T23:16:23.568 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2024-09-10T23:16:23.568 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-09-10T23:16:23.568 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2024-09-10T23:16:23.568 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2024-09-10T23:16:23.568 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:16:23.568 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2024-09-10T23:16:23.568 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2024-09-10T23:16:23.568 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:16:23.568 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.568 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:16:23.569 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:16:23.569 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:16:23.569 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.569 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:16:23.569 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:16:23.569 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:16:23.569 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.569 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2024-09-10T23:16:23.569 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:16:23.569 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.569 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:16:23.569 INFO:teuthology.orchestra.run.smithi171.stdout: mon down mkfs grace = 300 2024-09-10T23:16:23.569 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:16:23.569 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2024-09-10T23:16:23.570 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2024-09-10T23:16:23.570 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = true 2024-09-10T23:16:23.570 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2024-09-10T23:16:23.570 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:16:23.570 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:16:23.570 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = "" 2024-09-10T23:16:23.570 INFO:teuthology.orchestra.run.smithi171.stdout: client reconnect stale = True 2024-09-10T23:16:23.570 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2024-09-10T23:16:23.570 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b] 2024-09-10T23:16:23.570 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c] 2024-09-10T23:16:23.570 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2024-09-10T23:16:23.570 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2024-09-10T23:16:23.570 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2024-09-10T23:16:23.570 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.d] 2024-09-10T23:16:23.572 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:16:23.572 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:23.629 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:16:23.629 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:23.685 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:16:23.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.827+0000 7f398b40f640 1 -- 172.21.15.90:0/138559034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f398406fc60 msgr2=0x7f39840cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.827+0000 7f398b40f640 1 --2- 172.21.15.90:0/138559034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f398406fc60 0x7f39840cdfd0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f398406dfb0 tx=0x7f397c02a560 comp rx=0 tx=0).stop 2024-09-10T23:16:23.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.827+0000 7f398b40f640 1 -- 172.21.15.90:0/138559034 shutdown_connections 2024-09-10T23:16:23.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.827+0000 7f398b40f640 1 --2- 172.21.15.90:0/138559034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f398406fc60 0x7f39840cdfd0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.827+0000 7f398b40f640 1 --2- 172.21.15.90:0/138559034 >> v2:172.21.15.171:3300/0 conn(0x7f398415f750 0x7f3984073de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.827+0000 7f398b40f640 1 -- 172.21.15.90:0/138559034 >> 172.21.15.90:0/138559034 conn(0x7f39840b19c0 msgr2=0x7f39840b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:23.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.827+0000 7f398b40f640 1 -- 172.21.15.90:0/138559034 shutdown_connections 2024-09-10T23:16:23.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.827+0000 7f398b40f640 1 -- 172.21.15.90:0/138559034 wait complete. 2024-09-10T23:16:23.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.828+0000 7f398b40f640 1 Processor -- start 2024-09-10T23:16:23.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.828+0000 7f398b40f640 1 -- start start 2024-09-10T23:16:23.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.829+0000 7f398b40f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f398406fc60 0x7f398409cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.829+0000 7f398b40f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39840cdb90 0x7f398415e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.829+0000 7f398b40f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f398415f750 0x7f398415aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.829+0000 7f398b40f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39840cc9f0 con 0x7f398406fc60 2024-09-10T23:16:23.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.829+0000 7f398b40f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f39840cc870 con 0x7f398415f750 2024-09-10T23:16:23.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.829+0000 7f398b40f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f39840ccb70 con 0x7f39840cdb90 2024-09-10T23:16:23.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.829+0000 7f39891ab640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f398406fc60 0x7f398409cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.829+0000 7f39891ab640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f398406fc60 0x7f398409cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42936/0 (socket says 172.21.15.90:42936) 2024-09-10T23:16:23.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.829+0000 7f39891ab640 1 -- 172.21.15.90:0/1659998945 learned_addr learned my addr 172.21.15.90:0/1659998945 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:23.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.829+0000 7f39899ac640 1 --2- 172.21.15.90:0/1659998945 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f398415f750 0x7f398415aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.829+0000 7f39889aa640 1 --2- 172.21.15.90:0/1659998945 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39840cdb90 0x7f398415e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.829+0000 7f39891ab640 1 -- 172.21.15.90:0/1659998945 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39840cdb90 msgr2=0x7f398415e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.829+0000 7f39891ab640 1 --2- 172.21.15.90:0/1659998945 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39840cdb90 0x7f398415e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.830+0000 7f39891ab640 1 -- 172.21.15.90:0/1659998945 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f398415f750 msgr2=0x7f398415aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.830+0000 7f39891ab640 1 --2- 172.21.15.90:0/1659998945 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f398415f750 0x7f398415aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.830+0000 7f39891ab640 1 -- 172.21.15.90:0/1659998945 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39841f5f10 con 0x7f398406fc60 2024-09-10T23:16:23.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.830+0000 7f39891ab640 1 --2- 172.21.15.90:0/1659998945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f398406fc60 0x7f398409cf60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f397400ba50 tx=0x7f397400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.830+0000 7f3981ffb640 1 -- 172.21.15.90:0/1659998945 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974019070 con 0x7f398406fc60 2024-09-10T23:16:23.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.830+0000 7f3981ffb640 1 -- 172.21.15.90:0/1659998945 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f397400ccf0 con 0x7f398406fc60 2024-09-10T23:16:23.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.830+0000 7f398b40f640 1 -- 172.21.15.90:0/1659998945 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39841f61f0 con 0x7f398406fc60 2024-09-10T23:16:23.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.830+0000 7f3981ffb640 1 -- 172.21.15.90:0/1659998945 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39740146a0 con 0x7f398406fc60 2024-09-10T23:16:23.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.830+0000 7f398b40f640 1 -- 172.21.15.90:0/1659998945 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39841f67b0 con 0x7f398406fc60 2024-09-10T23:16:23.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.831+0000 7f398b40f640 1 -- 172.21.15.90:0/1659998945 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39840cd100 con 0x7f398406fc60 2024-09-10T23:16:23.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.831+0000 7f3981ffb640 1 -- 172.21.15.90:0/1659998945 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f397401d3b0 con 0x7f398406fc60 2024-09-10T23:16:23.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.832+0000 7f3981ffb640 1 --2- 172.21.15.90:0/1659998945 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3970077f70 0x7f397007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.832+0000 7f3981ffb640 1 -- 172.21.15.90:0/1659998945 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f3974099d70 con 0x7f398406fc60 2024-09-10T23:16:23.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.832+0000 7f39889aa640 1 --2- 172.21.15.90:0/1659998945 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3970077f70 0x7f397007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.833+0000 7f39889aa640 1 --2- 172.21.15.90:0/1659998945 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3970077f70 0x7f397007a430 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3978007fd0 tx=0x7f3978009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:23.836+0000 7f3981ffb640 1 -- 172.21.15.90:0/1659998945 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3974062900 con 0x7f398406fc60 2024-09-10T23:16:24.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.021+0000 7f398b40f640 1 -- 172.21.15.90:0/1659998945 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f39840af160 con 0x7f398406fc60 2024-09-10T23:16:24.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.022+0000 7f3981ffb640 1 -- 172.21.15.90:0/1659998945 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) ==== 80+0+0 (secure 0 0 0) 0x7f3974062200 con 0x7f398406fc60 2024-09-10T23:16:24.023 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:16:24.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.024+0000 7f398b40f640 1 -- 172.21.15.90:0/1659998945 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3970077f70 msgr2=0x7f397007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:24.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.024+0000 7f398b40f640 1 --2- 172.21.15.90:0/1659998945 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3970077f70 0x7f397007a430 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3978007fd0 tx=0x7f3978009040 comp rx=0 tx=0).stop 2024-09-10T23:16:24.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.024+0000 7f398b40f640 1 -- 172.21.15.90:0/1659998945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f398406fc60 msgr2=0x7f398409cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:24.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.024+0000 7f398b40f640 1 --2- 172.21.15.90:0/1659998945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f398406fc60 0x7f398409cf60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f397400ba50 tx=0x7f397400bf10 comp rx=0 tx=0).stop 2024-09-10T23:16:24.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.024+0000 7f398b40f640 1 -- 172.21.15.90:0/1659998945 shutdown_connections 2024-09-10T23:16:24.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.024+0000 7f398b40f640 1 --2- 172.21.15.90:0/1659998945 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3970077f70 0x7f397007a430 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.024+0000 7f398b40f640 1 --2- 172.21.15.90:0/1659998945 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f398415f750 0x7f398415aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.024+0000 7f398b40f640 1 --2- 172.21.15.90:0/1659998945 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39840cdb90 0x7f398415e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.024+0000 7f398b40f640 1 --2- 172.21.15.90:0/1659998945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f398406fc60 0x7f398409cf60 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.024+0000 7f398b40f640 1 -- 172.21.15.90:0/1659998945 >> 172.21.15.90:0/1659998945 conn(0x7f39840b19c0 msgr2=0x7f39840b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:24.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.024+0000 7f398b40f640 1 -- 172.21.15.90:0/1659998945 shutdown_connections 2024-09-10T23:16:24.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.024+0000 7f398b40f640 1 -- 172.21.15.90:0/1659998945 wait complete. 2024-09-10T23:16:24.036 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T23:16:24.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:24.036 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:24.064 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:16:24.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:24.064 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:16:24.120 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:16:24.120 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:24.177 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:16:24.177 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:16:24.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.317+0000 7f348ebec640 1 -- 172.21.15.90:0/3607875528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f348815f750 msgr2=0x7f3488073de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:24.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.317+0000 7f348ebec640 1 --2- 172.21.15.90:0/3607875528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f348815f750 0x7f3488073de0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f348815fb30 tx=0x7f347802aa30 comp rx=0 tx=0).stop 2024-09-10T23:16:24.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.317+0000 7f348ebec640 1 -- 172.21.15.90:0/3607875528 shutdown_connections 2024-09-10T23:16:24.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.317+0000 7f348ebec640 1 --2- 172.21.15.90:0/3607875528 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f348806f550 0x7f348806f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.317+0000 7f348ebec640 1 --2- 172.21.15.90:0/3607875528 >> v2:172.21.15.171:3300/0 conn(0x7f34880cdb90 0x7f34880cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.317+0000 7f348ebec640 1 --2- 172.21.15.90:0/3607875528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f348815f750 0x7f3488073de0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.317+0000 7f348ebec640 1 -- 172.21.15.90:0/3607875528 >> 172.21.15.90:0/3607875528 conn(0x7f34880b19c0 msgr2=0x7f34880b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:24.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.317+0000 7f348ebec640 1 -- 172.21.15.90:0/3607875528 shutdown_connections 2024-09-10T23:16:24.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.317+0000 7f348ebec640 1 -- 172.21.15.90:0/3607875528 wait complete. 2024-09-10T23:16:24.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.318+0000 7f348ebec640 1 Processor -- start 2024-09-10T23:16:24.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.318+0000 7f348ebec640 1 -- start start 2024-09-10T23:16:24.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f348ebec640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f348806f550 0x7f348809c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:24.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f348ebec640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34880cdb90 0x7f3488151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:24.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f348ebec640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f348815f750 0x7f348809d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:24.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f348ebec640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f348815fd50 con 0x7f348806f550 2024-09-10T23:16:24.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f348ebec640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f348815fbd0 con 0x7f348815f750 2024-09-10T23:16:24.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f348ebec640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f348815fed0 con 0x7f34880cdb90 2024-09-10T23:16:24.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f348c988640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f348806f550 0x7f348809c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:24.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f348c988640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f348806f550 0x7f348809c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42944/0 (socket says 172.21.15.90:42944) 2024-09-10T23:16:24.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f348c988640 1 -- 172.21.15.90:0/2663703693 learned_addr learned my addr 172.21.15.90:0/2663703693 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:24.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f348d189640 1 --2- 172.21.15.90:0/2663703693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f348815f750 0x7f348809d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:24.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f3487fff640 1 --2- 172.21.15.90:0/2663703693 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34880cdb90 0x7f3488151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:24.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f348c988640 1 -- 172.21.15.90:0/2663703693 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34880cdb90 msgr2=0x7f3488151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:24.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f348c988640 1 --2- 172.21.15.90:0/2663703693 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34880cdb90 0x7f3488151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f348c988640 1 -- 172.21.15.90:0/2663703693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f348815f750 msgr2=0x7f348809d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:24.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f348c988640 1 --2- 172.21.15.90:0/2663703693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f348815f750 0x7f348809d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f348c988640 1 -- 172.21.15.90:0/2663703693 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348815e550 con 0x7f348806f550 2024-09-10T23:16:24.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f348d189640 1 --2- 172.21.15.90:0/2663703693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f348815f750 0x7f348809d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:24.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.319+0000 7f3487fff640 1 --2- 172.21.15.90:0/2663703693 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34880cdb90 0x7f3488151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:24.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.320+0000 7f348c988640 1 --2- 172.21.15.90:0/2663703693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f348806f550 0x7f348809c040 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3478009bf0 tx=0x7f3478003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:24.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.320+0000 7f34857fa640 1 -- 172.21.15.90:0/2663703693 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478033050 con 0x7f348806f550 2024-09-10T23:16:24.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.320+0000 7f34857fa640 1 -- 172.21.15.90:0/2663703693 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3478004550 con 0x7f348806f550 2024-09-10T23:16:24.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.320+0000 7f34857fa640 1 -- 172.21.15.90:0/2663703693 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478038450 con 0x7f348806f550 2024-09-10T23:16:24.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.320+0000 7f348ebec640 1 -- 172.21.15.90:0/2663703693 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348815e830 con 0x7f348806f550 2024-09-10T23:16:24.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.320+0000 7f348ebec640 1 -- 172.21.15.90:0/2663703693 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f348815edf0 con 0x7f348806f550 2024-09-10T23:16:24.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.321+0000 7f348ebec640 1 -- 172.21.15.90:0/2663703693 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34880cdfd0 con 0x7f348806f550 2024-09-10T23:16:24.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.321+0000 7f34857fa640 1 -- 172.21.15.90:0/2663703693 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3478040070 con 0x7f348806f550 2024-09-10T23:16:24.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.322+0000 7f34857fa640 1 --2- 172.21.15.90:0/2663703693 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3468077f70 0x7f346807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:24.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.322+0000 7f34857fa640 1 -- 172.21.15.90:0/2663703693 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f34780bb1e0 con 0x7f348806f550 2024-09-10T23:16:24.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.322+0000 7f3487fff640 1 --2- 172.21.15.90:0/2663703693 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3468077f70 0x7f346807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:24.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.323+0000 7f3487fff640 1 --2- 172.21.15.90:0/2663703693 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3468077f70 0x7f346807a430 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3470006fd0 tx=0x7f3470008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:24.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.326+0000 7f34857fa640 1 -- 172.21.15.90:0/2663703693 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3478083d50 con 0x7f348806f550 2024-09-10T23:16:24.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.537+0000 7f348ebec640 1 -- 172.21.15.90:0/2663703693 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f34880cd0c0 con 0x7f348806f550 2024-09-10T23:16:24.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.537+0000 7f34857fa640 1 -- 172.21.15.90:0/2663703693 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) ==== 53+0+73 (secure 0 0 0) 0x7f3478083650 con 0x7f348806f550 2024-09-10T23:16:24.539 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:16:24.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.540+0000 7f348ebec640 1 -- 172.21.15.90:0/2663703693 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3468077f70 msgr2=0x7f346807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:24.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.540+0000 7f348ebec640 1 --2- 172.21.15.90:0/2663703693 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3468077f70 0x7f346807a430 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3470006fd0 tx=0x7f3470008040 comp rx=0 tx=0).stop 2024-09-10T23:16:24.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.540+0000 7f348ebec640 1 -- 172.21.15.90:0/2663703693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f348806f550 msgr2=0x7f348809c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:24.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.540+0000 7f348ebec640 1 --2- 172.21.15.90:0/2663703693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f348806f550 0x7f348809c040 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3478009bf0 tx=0x7f3478003f10 comp rx=0 tx=0).stop 2024-09-10T23:16:24.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.540+0000 7f348ebec640 1 -- 172.21.15.90:0/2663703693 shutdown_connections 2024-09-10T23:16:24.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.540+0000 7f348ebec640 1 --2- 172.21.15.90:0/2663703693 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3468077f70 0x7f346807a430 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.540+0000 7f348ebec640 1 --2- 172.21.15.90:0/2663703693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f348815f750 0x7f348809d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.540+0000 7f348ebec640 1 --2- 172.21.15.90:0/2663703693 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34880cdb90 0x7f3488151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.540+0000 7f348ebec640 1 --2- 172.21.15.90:0/2663703693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f348806f550 0x7f348809c040 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.540+0000 7f348ebec640 1 -- 172.21.15.90:0/2663703693 >> 172.21.15.90:0/2663703693 conn(0x7f34880b19c0 msgr2=0x7f34880cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:24.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.540+0000 7f348ebec640 1 -- 172.21.15.90:0/2663703693 shutdown_connections 2024-09-10T23:16:24.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24.540+0000 7f348ebec640 1 -- 172.21.15.90:0/2663703693 wait complete. 2024-09-10T23:16:24.551 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:16:24.551 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:16:24.551 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2024-09-10T23:16:24.551 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:16:24.551 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:24.551 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:16:24.551 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:16:24.552 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:16:24.552 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:16:24.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:24.552 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2024-09-10T23:16:24.567 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:16:24.568 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:16:24.568 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:16:24.568 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:24.568 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-10T23:16:24.568 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:24.568 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:16:24.568 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:24.568 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2024-09-10T23:16:24.568 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:16:24.568 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:24.568 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2024-09-10T23:16:24.569 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:16:24.569 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:24.569 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:16:24.569 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:24.569 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:16:24.569 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42663sec preferred_lft 42663sec 2024-09-10T23:16:24.569 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link noprefixroute 2024-09-10T23:16:24.569 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:24.569 INFO:teuthology.orchestra.run.smithi090.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:16:24.569 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:24.569 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:16:24.569 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:24.569 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::882a:a9ff:fefc:893f/64 scope link 2024-09-10T23:16:24.570 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:24.570 INFO:teuthology.orchestra.run.smithi090.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:16:24.570 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 76:ad:51:1a:2a:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:24.570 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::74ad:51ff:fe1a:2a60/64 scope link 2024-09-10T23:16:24.570 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:24.570 INFO:teuthology.orchestra.run.smithi090.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:16:24.570 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:16:24.570 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::3414:abff:fe49:366c/64 scope link 2024-09-10T23:16:24.570 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:24.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:24.570 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:16:24.631 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-09-10T23:16:24.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:24.633 DEBUG:teuthology.orchestra.run.smithi090:> route 2024-09-10T23:16:24.689 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2024-09-10T23:16:24.689 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:16:24.689 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:16:24.689 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:16:24.689 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:16:24.689 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:24.689 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:16:24.690 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:16:24.690 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:16:24.690 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:16:24.690 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:16:24.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:24.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:24.810 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:16:24.813 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:16:24.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:24.815 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-10T23:16:24.872 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:16:24.872 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:16:24.872 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:16:24.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:24.873 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2024-09-10T23:16:24.938 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:24.938 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:24.994 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:16:24.994 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:24.994 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:25.050 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:16:25.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:25.050 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:16:25.134 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:16:25.135 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:16:25.135 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:16:25.143 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:16:25.143 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:16:25.143 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:16:25.143 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:16:25.143 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:16:25.149 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:16:25.149 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:16:25.149 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:16:25.149 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:16:25.149 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:16:25.149 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:16:25.149 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:16:25.149 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:16:25.150 INFO:teuthology.orchestra.run.smithi090.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T23:16:25.150 INFO:teuthology.orchestra.run.smithi090.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:16:25.150 INFO:teuthology.orchestra.run.smithi090.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:16:25.150 INFO:teuthology.orchestra.run.smithi090.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:16:25.150 INFO:teuthology.orchestra.run.smithi090.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:16:25.151 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:16:25.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:25.152 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:25.176 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:16:25.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:16:25.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:25.271 INFO:teuthology.orchestra.run.smithi090.stdout:client5204 2024-09-10T23:16:25.272 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:16:25.272 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:25.287 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:16:25.288 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:25.308 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:16:25.308 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:25.367 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:16:25.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.468+0000 7f32d2add640 1 -- 172.21.15.90:0/2890055058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32cc0b3310 msgr2=0x7f32cc0b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.468+0000 7f32d2add640 1 --2- 172.21.15.90:0/2890055058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32cc0b3310 0x7f32cc0b24e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f32cc0af0c0 tx=0x7f32bc02a4d0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.468+0000 7f32d2add640 1 -- 172.21.15.90:0/2890055058 shutdown_connections 2024-09-10T23:16:25.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.468+0000 7f32d2add640 1 --2- 172.21.15.90:0/2890055058 >> v2:172.21.15.171:3300/0 conn(0x7f32cc15e970 0x7f32cc0727c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.468+0000 7f32d2add640 1 --2- 172.21.15.90:0/2890055058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32cc0b3310 0x7f32cc0b24e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.468+0000 7f32d2add640 1 -- 172.21.15.90:0/2890055058 >> 172.21.15.90:0/2890055058 conn(0x7f32cc0b19c0 msgr2=0x7f32cc0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:25.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.468+0000 7f32d2add640 1 -- 172.21.15.90:0/2890055058 shutdown_connections 2024-09-10T23:16:25.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.468+0000 7f32d2add640 1 -- 172.21.15.90:0/2890055058 wait complete. 2024-09-10T23:16:25.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.469+0000 7f32d2add640 1 Processor -- start 2024-09-10T23:16:25.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.469+0000 7f32d2add640 1 -- start start 2024-09-10T23:16:25.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.470+0000 7f32d2add640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32cc0b3310 0x7f32cc143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.470+0000 7f32d2add640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32cc0ceca0 0x7f32cc150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.470+0000 7f32d2add640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32cc14de10 0x7f32cc14e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.470+0000 7f32d2add640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc15bb40 con 0x7f32cc14de10 2024-09-10T23:16:25.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.470+0000 7f32d2add640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc15b9c0 con 0x7f32cc0ceca0 2024-09-10T23:16:25.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.470+0000 7f32d2add640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f32cc15bcc0 con 0x7f32cc0b3310 2024-09-10T23:16:25.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.470+0000 7f32d107a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32cc14de10 0x7f32cc14e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:25.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.470+0000 7f32d107a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32cc14de10 0x7f32cc14e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42976/0 (socket says 172.21.15.90:42976) 2024-09-10T23:16:25.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.470+0000 7f32d107a640 1 -- 172.21.15.90:0/3614216983 learned_addr learned my addr 172.21.15.90:0/3614216983 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:25.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.470+0000 7f32d107a640 1 -- 172.21.15.90:0/3614216983 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32cc0b3310 msgr2=0x7f32cc143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.470+0000 7f32d107a640 1 --2- 172.21.15.90:0/3614216983 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32cc0b3310 0x7f32cc143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.470+0000 7f32d107a640 1 -- 172.21.15.90:0/3614216983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32cc0ceca0 msgr2=0x7f32cc150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.470+0000 7f32d107a640 1 --2- 172.21.15.90:0/3614216983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32cc0ceca0 0x7f32cc150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.470+0000 7f32d107a640 1 -- 172.21.15.90:0/3614216983 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32cc06fbc0 con 0x7f32cc14de10 2024-09-10T23:16:25.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.471+0000 7f32d107a640 1 --2- 172.21.15.90:0/3614216983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32cc14de10 0x7f32cc14e2a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f32c400c780 tx=0x7f32c400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:25.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.471+0000 7f32c97fa640 1 -- 172.21.15.90:0/3614216983 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4017070 con 0x7f32cc14de10 2024-09-10T23:16:25.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.471+0000 7f32c97fa640 1 -- 172.21.15.90:0/3614216983 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32c4005070 con 0x7f32cc14de10 2024-09-10T23:16:25.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.471+0000 7f32c97fa640 1 -- 172.21.15.90:0/3614216983 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4005500 con 0x7f32cc14de10 2024-09-10T23:16:25.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.471+0000 7f32d2add640 1 -- 172.21.15.90:0/3614216983 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32cc06fea0 con 0x7f32cc14de10 2024-09-10T23:16:25.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.471+0000 7f32d2add640 1 -- 172.21.15.90:0/3614216983 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32cc15c8f0 con 0x7f32cc14de10 2024-09-10T23:16:25.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.472+0000 7f32d2add640 1 -- 172.21.15.90:0/3614216983 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32cc0b4f50 con 0x7f32cc14de10 2024-09-10T23:16:25.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.472+0000 7f32c97fa640 1 -- 172.21.15.90:0/3614216983 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f32c400a5e0 con 0x7f32cc14de10 2024-09-10T23:16:25.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.473+0000 7f32c97fa640 1 --2- 172.21.15.90:0/3614216983 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f32b8077f70 0x7f32b807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.473+0000 7f32c97fa640 1 -- 172.21.15.90:0/3614216983 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f32c4099790 con 0x7f32cc14de10 2024-09-10T23:16:25.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.473+0000 7f32d0879640 1 --2- 172.21.15.90:0/3614216983 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f32b8077f70 0x7f32b807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:25.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.474+0000 7f32d0879640 1 --2- 172.21.15.90:0/3614216983 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f32b8077f70 0x7f32b807a430 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f32bc033000 tx=0x7f32bc0046c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:25.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.477+0000 7f32c97fa640 1 -- 172.21.15.90:0/3614216983 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f32c4062290 con 0x7f32cc14de10 2024-09-10T23:16:25.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.664+0000 7f32d2add640 1 -- 172.21.15.90:0/3614216983 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f32cc0708d0 con 0x7f32cc14de10 2024-09-10T23:16:25.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.665+0000 7f32c97fa640 1 -- 172.21.15.90:0/3614216983 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) ==== 80+0+0 (secure 0 0 0) 0x7f32c4061b90 con 0x7f32cc14de10 2024-09-10T23:16:25.666 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:16:25.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.667+0000 7f32d2add640 1 -- 172.21.15.90:0/3614216983 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f32b8077f70 msgr2=0x7f32b807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.667+0000 7f32d2add640 1 --2- 172.21.15.90:0/3614216983 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f32b8077f70 0x7f32b807a430 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f32bc033000 tx=0x7f32bc0046c0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.667+0000 7f32d2add640 1 -- 172.21.15.90:0/3614216983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32cc14de10 msgr2=0x7f32cc14e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.667+0000 7f32d2add640 1 --2- 172.21.15.90:0/3614216983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32cc14de10 0x7f32cc14e2a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f32c400c780 tx=0x7f32c400cc40 comp rx=0 tx=0).stop 2024-09-10T23:16:25.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.667+0000 7f32d2add640 1 -- 172.21.15.90:0/3614216983 shutdown_connections 2024-09-10T23:16:25.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.667+0000 7f32d2add640 1 --2- 172.21.15.90:0/3614216983 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f32b8077f70 0x7f32b807a430 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.667+0000 7f32d2add640 1 --2- 172.21.15.90:0/3614216983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32cc0ceca0 0x7f32cc150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.667+0000 7f32d2add640 1 --2- 172.21.15.90:0/3614216983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32cc14de10 0x7f32cc14e2a0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.667+0000 7f32d2add640 1 --2- 172.21.15.90:0/3614216983 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32cc0b3310 0x7f32cc143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.667+0000 7f32d2add640 1 -- 172.21.15.90:0/3614216983 >> 172.21.15.90:0/3614216983 conn(0x7f32cc0b19c0 msgr2=0x7f32cc0adac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:25.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.667+0000 7f32d2add640 1 -- 172.21.15.90:0/3614216983 shutdown_connections 2024-09-10T23:16:25.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.667+0000 7f32d2add640 1 -- 172.21.15.90:0/3614216983 wait complete. 2024-09-10T23:16:25.678 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T23:16:25.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:25.678 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:25.712 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:16:25.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:25.713 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T23:16:25.770 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:16:25.771 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:25.828 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:16:25.828 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:16:25.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.929+0000 7fa9a608c640 1 -- 172.21.15.90:0/3033710660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9a00b3310 msgr2=0x7fa9a00b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.929+0000 7fa9a608c640 1 --2- 172.21.15.90:0/3033710660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9a00b3310 0x7fa9a00b24e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0075000 tx=0x7fa99002a980 comp rx=0 tx=0).stop 2024-09-10T23:16:25.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.929+0000 7fa9a608c640 1 -- 172.21.15.90:0/3033710660 shutdown_connections 2024-09-10T23:16:25.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.929+0000 7fa9a608c640 1 --2- 172.21.15.90:0/3033710660 >> v2:172.21.15.171:3300/0 conn(0x7fa9a00ceca0 0x7fa9a00cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.929+0000 7fa9a608c640 1 --2- 172.21.15.90:0/3033710660 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9a015e970 0x7fa9a00727c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.929+0000 7fa9a608c640 1 --2- 172.21.15.90:0/3033710660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9a00b3310 0x7fa9a00b24e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.929+0000 7fa9a608c640 1 -- 172.21.15.90:0/3033710660 >> 172.21.15.90:0/3033710660 conn(0x7fa9a00b19c0 msgr2=0x7fa9a00b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:25.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.929+0000 7fa9a608c640 1 -- 172.21.15.90:0/3033710660 shutdown_connections 2024-09-10T23:16:25.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.929+0000 7fa9a608c640 1 -- 172.21.15.90:0/3033710660 wait complete. 2024-09-10T23:16:25.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.930+0000 7fa9a608c640 1 Processor -- start 2024-09-10T23:16:25.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.930+0000 7fa9a608c640 1 -- start start 2024-09-10T23:16:25.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.931+0000 7fa9a608c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9a00b3310 0x7fa9a01465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.931+0000 7fa9a608c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9a00ceca0 0x7fa9a01f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.931+0000 7fa9a608c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9a009d100 0x7fa9a01f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.931+0000 7fa9a608c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a015b7b0 con 0x7fa9a00b3310 2024-09-10T23:16:25.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.931+0000 7fa9a608c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a00af780 con 0x7fa9a00ceca0 2024-09-10T23:16:25.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.931+0000 7fa9a608c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a015b930 con 0x7fa9a009d100 2024-09-10T23:16:25.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.931+0000 7fa99f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9a00b3310 0x7fa9a01465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:25.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.931+0000 7fa99f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9a00b3310 0x7fa9a01465e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42988/0 (socket says 172.21.15.90:42988) 2024-09-10T23:16:25.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.931+0000 7fa99f7fe640 1 -- 172.21.15.90:0/3593568239 learned_addr learned my addr 172.21.15.90:0/3593568239 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:25.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.931+0000 7fa99f7fe640 1 -- 172.21.15.90:0/3593568239 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9a009d100 msgr2=0x7fa9a01f1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.931+0000 7fa99f7fe640 1 --2- 172.21.15.90:0/3593568239 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9a009d100 0x7fa9a01f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.931+0000 7fa99f7fe640 1 -- 172.21.15.90:0/3593568239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9a00ceca0 msgr2=0x7fa9a01f5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.931+0000 7fa99effd640 1 --2- 172.21.15.90:0/3593568239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9a00ceca0 0x7fa9a01f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:25.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.931+0000 7fa99f7fe640 1 --2- 172.21.15.90:0/3593568239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9a00ceca0 0x7fa9a01f5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.931+0000 7fa99f7fe640 1 -- 172.21.15.90:0/3593568239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a01f6020 con 0x7fa9a00b3310 2024-09-10T23:16:25.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.931+0000 7fa99f7fe640 1 --2- 172.21.15.90:0/3593568239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9a00b3310 0x7fa9a01465e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa990009d60 tx=0x7fa990003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:25.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.932+0000 7fa987fff640 1 -- 172.21.15.90:0/3593568239 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990034050 con 0x7fa9a00b3310 2024-09-10T23:16:25.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.932+0000 7fa987fff640 1 -- 172.21.15.90:0/3593568239 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9900045d0 con 0x7fa9a00b3310 2024-09-10T23:16:25.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.932+0000 7fa9a608c640 1 -- 172.21.15.90:0/3593568239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a009c060 con 0x7fa9a00b3310 2024-09-10T23:16:25.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.932+0000 7fa987fff640 1 -- 172.21.15.90:0/3593568239 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990043440 con 0x7fa9a00b3310 2024-09-10T23:16:25.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.932+0000 7fa9a608c640 1 -- 172.21.15.90:0/3593568239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a009c620 con 0x7fa9a00b3310 2024-09-10T23:16:25.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.933+0000 7fa9a608c640 1 -- 172.21.15.90:0/3593568239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a0076d40 con 0x7fa9a00b3310 2024-09-10T23:16:25.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.933+0000 7fa987fff640 1 -- 172.21.15.90:0/3593568239 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa990041070 con 0x7fa9a00b3310 2024-09-10T23:16:25.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.934+0000 7fa987fff640 1 --2- 172.21.15.90:0/3593568239 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa98c077f70 0x7fa98c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.934+0000 7fa987fff640 1 -- 172.21.15.90:0/3593568239 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fa9900bb2a0 con 0x7fa9a00b3310 2024-09-10T23:16:25.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.934+0000 7fa99effd640 1 --2- 172.21.15.90:0/3593568239 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa98c077f70 0x7fa98c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:25.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.935+0000 7fa99effd640 1 --2- 172.21.15.90:0/3593568239 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa98c077f70 0x7fa98c07a430 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0149f30 tx=0x7fa994005be0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:25.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:25.938+0000 7fa987fff640 1 -- 172.21.15.90:0/3593568239 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa9a0076d40 con 0x7fa9a00b3310 2024-09-10T23:16:26.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:26.147+0000 7fa9a608c640 1 -- 172.21.15.90:0/3593568239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa9a00b15d0 con 0x7fa9a00b3310 2024-09-10T23:16:26.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:26.148+0000 7fa987fff640 1 -- 172.21.15.90:0/3593568239 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) ==== 53+0+73 (secure 0 0 0) 0x7fa9a00b15d0 con 0x7fa9a00b3310 2024-09-10T23:16:26.149 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:16:26.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:26.150+0000 7fa9a608c640 1 -- 172.21.15.90:0/3593568239 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa98c077f70 msgr2=0x7fa98c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:26.150+0000 7fa9a608c640 1 --2- 172.21.15.90:0/3593568239 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa98c077f70 0x7fa98c07a430 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0149f30 tx=0x7fa994005be0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:26.150+0000 7fa9a608c640 1 -- 172.21.15.90:0/3593568239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9a00b3310 msgr2=0x7fa9a01465e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:26.150+0000 7fa9a608c640 1 --2- 172.21.15.90:0/3593568239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9a00b3310 0x7fa9a01465e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa990009d60 tx=0x7fa990003f70 comp rx=0 tx=0).stop 2024-09-10T23:16:26.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:26.150+0000 7fa9a608c640 1 -- 172.21.15.90:0/3593568239 shutdown_connections 2024-09-10T23:16:26.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:26.150+0000 7fa9a608c640 1 --2- 172.21.15.90:0/3593568239 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa98c077f70 0x7fa98c07a430 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:26.150+0000 7fa9a608c640 1 --2- 172.21.15.90:0/3593568239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9a00ceca0 0x7fa9a01f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:26.150+0000 7fa9a608c640 1 --2- 172.21.15.90:0/3593568239 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9a009d100 0x7fa9a01f1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:26.150+0000 7fa9a608c640 1 --2- 172.21.15.90:0/3593568239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9a00b3310 0x7fa9a01465e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:26.150+0000 7fa9a608c640 1 -- 172.21.15.90:0/3593568239 >> 172.21.15.90:0/3593568239 conn(0x7fa9a00b19c0 msgr2=0x7fa9a00b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:26.150+0000 7fa9a608c640 1 -- 172.21.15.90:0/3593568239 shutdown_connections 2024-09-10T23:16:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:26.150+0000 7fa9a608c640 1 -- 172.21.15.90:0/3593568239 wait complete. 2024-09-10T23:16:26.162 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:16:26.162 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:16:26.162 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-09-10T23:16:26.162 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T23:16:26.162 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:26.162 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:16:26.162 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:16:26.162 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:16:26.163 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:16:26.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:26.163 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-09-10T23:16:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:16:26.183 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:16:26.183 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:16:26.183 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:26.183 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-09-10T23:16:26.183 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:16:26.183 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:26.183 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-09-10T23:16:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:16:26.183 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:26.184 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-09-10T23:16:26.184 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:16:26.184 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:26.184 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:16:26.184 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:26.184 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:16:26.184 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42645sec preferred_lft 42645sec 2024-09-10T23:16:26.184 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link noprefixroute 2024-09-10T23:16:26.184 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:26.184 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:16:26.184 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:26.184 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:16:26.184 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:26.185 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::c18:12ff:fe41:788b/64 scope link 2024-09-10T23:16:26.185 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:26.185 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:16:26.185 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:16:26.185 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a0e4:c6ff:fe48:8d44/64 scope link 2024-09-10T23:16:26.185 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:26.185 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:16:26.185 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a6:c9:8b:0f:78:86 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:16:26.185 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a4c9:8bff:fe0f:7886/64 scope link 2024-09-10T23:16:26.185 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:26.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:26.186 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:16:26.252 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-09-10T23:16:26.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:26.253 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-09-10T23:16:26.312 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-09-10T23:16:26.313 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:16:26.313 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:16:26.313 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:16:26.313 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:16:26.313 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:26.313 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:16:26.313 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:16:26.314 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:16:26.314 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:16:26.314 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:16:26.405 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:16:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:26.439 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:16:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:26.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:26.445 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-09-10T23:16:26.461 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T23:16:26.461 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T23:16:26.461 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:16:26.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:26.461 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-09-10T23:16:26.527 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:26.528 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:26.583 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:16:26.583 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:26.583 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:26.639 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:16:26.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:26.639 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:16:26.724 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:16:26.724 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:16:26.724 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:16:26.733 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:16:26.733 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:16:26.733 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:16:26.733 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:16:26.733 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:16:26.737 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:16:26.737 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:16:26.738 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:16:26.738 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:16:26.738 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:16:26.738 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:16:26.738 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:16:26.738 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:16:26.738 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T23:16:26.738 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:16:26.739 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:16:26.739 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:16:26.739 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:16:26.740 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:16:26.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:26.740 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:26.764 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:16:26.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:16:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:16:26.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:16:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:26.863 INFO:teuthology.orchestra.run.smithi171.stdout:client5207 2024-09-10T23:16:26.863 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:16:26.863 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:26.879 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir {d0,d1} && touch {d0,d1}/file') 2024-09-10T23:16:26.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:16:26.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:26.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:26.948 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d0) 2024-09-10T23:16:27.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:27.022 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1) 2024-09-10T23:16:27.038 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T23:16:27.191 INFO:teuthology.orchestra.run.smithi090.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"9","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":1},"nref":5}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T23:16:27.191 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 2, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 5, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "9" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T23:16:27.192 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d0', 0), ('/d1', 1)] 2024-09-10T23:16:29.192 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T23:16:29.317 INFO:teuthology.orchestra.run.smithi090.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"9","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":1},"nref":5}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T23:16:29.321 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 2, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 5, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "9" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T23:16:29.321 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d0', 0), ('/d1', 1)] 2024-09-10T23:16:31.322 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T23:16:31.448 INFO:teuthology.orchestra.run.smithi090.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T23:16:31.448 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T23:16:31.448 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d0', 0), ('/d1', 1)] 2024-09-10T23:16:33.449 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T23:16:33.574 INFO:teuthology.orchestra.run.smithi090.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T23:16:33.575 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T23:16:33.575 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d0', 0), ('/d1', 1)] 2024-09-10T23:16:35.576 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T23:16:35.701 INFO:teuthology.orchestra.run.smithi090.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"14","version":"14","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d0","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}}] 2024-09-10T23:16:35.702 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000001", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "3", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/d0", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T23:16:35.702 INFO:tasks.cephfs.cephfs_test_case:[('/d0', 0), ('/d1', 1)] =?= [('/d0', 0), ('/d1', 1)] 2024-09-10T23:16:35.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:35.702 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch d0/f0) 2024-09-10T23:16:35.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:35.719 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch d1/f0) 2024-09-10T23:16:35.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:35.779 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch d0/f1) 2024-09-10T23:16:35.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:35.802 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch d1/f1) 2024-09-10T23:16:35.863 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-10T23:16:35.979 INFO:teuthology.orchestra.run.smithi090.stdout:[{"id":5204,"entity":{"name":{"type":"client","num":5204},"addr":{"type":"v1","addr":"172.21.15.90:0","nonce":887689376}},"state":"open","num_leases":3,"num_caps":5,"request_load_avg":8,"uptime":9.0378572350000006,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":14.750450414802621,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":13,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000003","length":500}],"inst":"client.5204 v1:172.21.15.90:0/887689376","completed_requests":[{"tid":13,"created_ino":"0x100000001f8"}],"prealloc_inos":[{"start":"0x10000000003","length":500},{"start":"0x100000001f9","length":999}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi090","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":5207,"entity":{"name":{"type":"client","num":5207},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":178733992}},"state":"open","num_leases":1,"num_caps":4,"request_load_avg":5,"uptime":9.148855481,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":7.9359344044476208,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":8,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5207 v1:192.168.0.1:0/178733992","completed_requests":[],"prealloc_inos":[{"start":"0x100000005e1","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi171","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-10T23:16:35.979 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi090", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x100000001f8", "tid": 13 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000003" } ], "entity": { "addr": { "addr": "172.21.15.90:0", "nonce": 887689376, "type": "v1" }, "name": { "num": 5204, "type": "client" } }, "id": 5204, "inst": "client.5204 v1:172.21.15.90:0/887689376", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 13, "num_caps": 5, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 3, "prealloc_inos": [ { "length": 500, "start": "0x10000000003" }, { "length": 999, "start": "0x100000001f9" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 14.750450414802621 }, "state": "open", "uptime": 9.037857235 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 178733992, "type": "v1" }, "name": { "num": 5207, "type": "client" } }, "id": 5207, "inst": "client.5207 v1:192.168.0.1:0/178733992", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 8, "num_caps": 4, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x100000005e1" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 5, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 7.935934404447621 }, "state": "open", "uptime": 9.148855481 } ] 2024-09-10T23:16:35.980 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-10T23:16:36.096 INFO:teuthology.orchestra.run.smithi090.stdout:[{"id":5207,"entity":{"name":{"type":"client","num":5207},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":178733992}},"state":"open","num_leases":1,"num_caps":3,"request_load_avg":1,"uptime":9.3528522590000005,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":6.9346874674612868,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":8,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5207 v1:192.168.0.1:0/178733992","completed_requests":[{"tid":8,"created_ino":"0x200000003e9"}],"prealloc_inos":[{"start":"0x200000003ea","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi171","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":5204,"entity":{"name":{"type":"client","num":5204},"addr":{"type":"v1","addr":"172.21.15.90:0","nonce":887689376}},"state":"open","num_leases":1,"num_caps":4,"request_load_avg":4,"uptime":10.941827159000001,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":9.9031574859758997,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":13,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5204 v1:172.21.15.90:0/887689376","completed_requests":[{"tid":14,"created_ino":"0x20000000000"}],"prealloc_inos":[{"start":"0x20000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi090","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-10T23:16:36.097 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x200000003e9", "tid": 8 } ], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 178733992, "type": "v1" }, "name": { "num": 5207, "type": "client" } }, "id": 5207, "inst": "client.5207 v1:192.168.0.1:0/178733992", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 8, "num_caps": 3, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x200000003ea" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 1, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 6.934687467461287 }, "state": "open", "uptime": 9.352852259 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi090", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x20000000000", "tid": 14 } ], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.90:0", "nonce": 887689376, "type": "v1" }, "name": { "num": 5204, "type": "client" } }, "id": 5204, "inst": "client.5204 v1:172.21.15.90:0/887689376", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 13, "num_caps": 4, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x20000000001" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 4, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 9.9031574859759 }, "state": "open", "uptime": 10.941827159 } ] 2024-09-10T23:16:36.097 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:16:36.097 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:36.113 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:16:36.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:16:36.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:36.208 INFO:teuthology.orchestra.run.smithi090.stdout:client5204 2024-09-10T23:16:36.209 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session evict 5204 2024-09-10T23:16:36.348 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-09-10T23:16:36.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:36.349 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch d0/f00) 2024-09-10T23:16:36.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:36.631 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch d1/f00) 2024-09-10T23:16:36.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:36.648 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch d0/f10) 2024-09-10T23:16:36.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:36.667 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch d1/f10) 2024-09-10T23:16:46.729 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-10T23:16:46.858 INFO:teuthology.orchestra.run.smithi090.stdout:[{"id":5204,"entity":{"name":{"type":"client","num":5204},"addr":{"type":"v1","addr":"172.21.15.90:0","nonce":887689376}},"state":"open","num_leases":1,"num_caps":2,"request_load_avg":0,"uptime":10.223838502,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":3.9066550431191556,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":18,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5204 v1:172.21.15.90:0/887689376","completed_requests":[{"tid":18,"created_ino":"0x10000000003"}],"prealloc_inos":[{"start":"0x10000000004","length":499},{"start":"0x100000001f9","length":501}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi090","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":5207,"entity":{"name":{"type":"client","num":5207},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":178733992}},"state":"open","num_leases":2,"num_caps":5,"request_load_avg":5,"uptime":20.027683635999999,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":10.66918909624232,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":9,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x100000005e2","length":500}],"inst":"client.5207 v1:192.168.0.1:0/178733992","completed_requests":[{"tid":9,"created_ino":"0x100000005e1"}],"prealloc_inos":[{"start":"0x100000005e2","length":999}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi171","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-10T23:16:46.859 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi090", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x10000000003", "tid": 18 } ], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.90:0", "nonce": 887689376, "type": "v1" }, "name": { "num": 5204, "type": "client" } }, "id": 5204, "inst": "client.5204 v1:172.21.15.90:0/887689376", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 18, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 1, "prealloc_inos": [ { "length": 499, "start": "0x10000000004" }, { "length": 501, "start": "0x100000001f9" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 3.9066550431191556 }, "state": "open", "uptime": 10.223838502 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x100000005e1", "tid": 9 } ], "delegated_inos": [ { "length": 500, "start": "0x100000005e2" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 178733992, "type": "v1" }, "name": { "num": 5207, "type": "client" } }, "id": 5207, "inst": "client.5207 v1:192.168.0.1:0/178733992", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 9, "num_caps": 5, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 2, "prealloc_inos": [ { "length": 999, "start": "0x100000005e2" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 5, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 10.66918909624232 }, "state": "open", "uptime": 20.027683636 } ] 2024-09-10T23:16:46.860 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-10T23:16:46.976 INFO:teuthology.orchestra.run.smithi090.stdout:[{"id":5207,"entity":{"name":{"type":"client","num":5207},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":178733992}},"state":"open","num_leases":2,"num_caps":4,"request_load_avg":2,"uptime":20.231680414,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":9.6924026317263081,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":9,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x200000003eb","length":500}],"inst":"client.5207 v1:192.168.0.1:0/178733992","completed_requests":[{"tid":10,"created_ino":"0x200000003ea"}],"prealloc_inos":[{"start":"0x200000003eb","length":999}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi171","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":5204,"entity":{"name":{"type":"client","num":5204},"addr":{"type":"v1","addr":"172.21.15.90:0","nonce":887689376}},"state":"open","num_leases":2,"num_caps":5,"request_load_avg":5,"uptime":21.820655314,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0.92661058652456618,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":12.586654071821652,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":20,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x20000000002","length":500}],"inst":"client.5204 v1:172.21.15.90:0/887689376","completed_requests":[{"tid":20,"created_ino":"0x20000000001"}],"prealloc_inos":[{"start":"0x20000000002","length":999}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi090","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-10T23:16:46.976 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x200000003ea", "tid": 10 } ], "delegated_inos": [ { "length": 500, "start": "0x200000003eb" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 178733992, "type": "v1" }, "name": { "num": 5207, "type": "client" } }, "id": 5207, "inst": "client.5207 v1:192.168.0.1:0/178733992", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 9, "num_caps": 4, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 2, "prealloc_inos": [ { "length": 999, "start": "0x200000003eb" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 9.692402631726308 }, "state": "open", "uptime": 20.231680414 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi090", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x20000000001", "tid": 20 } ], "delegated_inos": [ { "length": 500, "start": "0x20000000002" } ], "entity": { "addr": { "addr": "172.21.15.90:0", "nonce": 887689376, "type": "v1" }, "name": { "num": 5204, "type": "client" } }, "id": 5204, "inst": "client.5204 v1:172.21.15.90:0/887689376", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 20, "num_caps": 5, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 2, "prealloc_inos": [ { "length": 999, "start": "0x20000000002" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0.9266105865245662 }, "request_load_avg": 5, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 12.586654071821652 }, "state": "open", "uptime": 21.820655314 } ] 2024-09-10T23:16:46.976 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:16:46.977 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:16:46.977 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:46.993 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:16:46.993 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:47.048 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:16:47.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.190+0000 7f00a56b6640 1 -- 172.21.15.90:0/1581240946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00a015f570 msgr2=0x7f00a00ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.190+0000 7f00a56b6640 1 --2- 172.21.15.90:0/1581240946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00a015f570 0x7f00a00ce5f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f0090005fd0 tx=0x7f009002aa10 comp rx=0 tx=0).stop 2024-09-10T23:16:47.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.190+0000 7f00a56b6640 1 -- 172.21.15.90:0/1581240946 shutdown_connections 2024-09-10T23:16:47.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.190+0000 7f00a56b6640 1 --2- 172.21.15.90:0/1581240946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00a00b26f0 0x7f00a00ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.190+0000 7f00a56b6640 1 --2- 172.21.15.90:0/1581240946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00a015f570 0x7f00a00ce5f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.190+0000 7f00a56b6640 1 -- 172.21.15.90:0/1581240946 >> 172.21.15.90:0/1581240946 conn(0x7f00a00d1ee0 msgr2=0x7f00a00d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:47.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.190+0000 7f00a56b6640 1 -- 172.21.15.90:0/1581240946 shutdown_connections 2024-09-10T23:16:47.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.190+0000 7f00a56b6640 1 -- 172.21.15.90:0/1581240946 wait complete. 2024-09-10T23:16:47.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.191+0000 7f00a56b6640 1 Processor -- start 2024-09-10T23:16:47.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.191+0000 7f00a56b6640 1 -- start start 2024-09-10T23:16:47.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f00a56b6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00a00b26f0 0x7f00a00c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:47.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f00a56b6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00a00d2a00 0x7f00a01555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:47.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f00a56b6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00a015f570 0x7f00a00c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:47.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f00a56b6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f00a00ce0a0 con 0x7f00a015f570 2024-09-10T23:16:47.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f00a56b6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f00a00ce220 con 0x7f00a00b26f0 2024-09-10T23:16:47.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f00a56b6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f00a00d0460 con 0x7f00a00d2a00 2024-09-10T23:16:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f009f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00a015f570 0x7f00a00c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f009f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00a015f570 0x7f00a00c6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41150/0 (socket says 172.21.15.90:41150) 2024-09-10T23:16:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f009f7fe640 1 -- 172.21.15.90:0/4062683926 learned_addr learned my addr 172.21.15.90:0/4062683926 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f009e7fc640 1 --2- 172.21.15.90:0/4062683926 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00a00d2a00 0x7f00a01555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f009effd640 1 --2- 172.21.15.90:0/4062683926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00a00b26f0 0x7f00a00c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f009f7fe640 1 -- 172.21.15.90:0/4062683926 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00a00d2a00 msgr2=0x7f00a01555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f009f7fe640 1 --2- 172.21.15.90:0/4062683926 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00a00d2a00 0x7f00a01555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f009f7fe640 1 -- 172.21.15.90:0/4062683926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00a00b26f0 msgr2=0x7f00a00c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f009f7fe640 1 --2- 172.21.15.90:0/4062683926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00a00b26f0 0x7f00a00c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f009f7fe640 1 -- 172.21.15.90:0/4062683926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a01f34f0 con 0x7f00a015f570 2024-09-10T23:16:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f009e7fc640 1 --2- 172.21.15.90:0/4062683926 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00a00d2a00 0x7f00a01555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.192+0000 7f009effd640 1 --2- 172.21.15.90:0/4062683926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00a00b26f0 0x7f00a00c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:47.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.193+0000 7f009f7fe640 1 --2- 172.21.15.90:0/4062683926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00a015f570 0x7f00a00c6560 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f009800d720 tx=0x7f009800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:47.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.193+0000 7f00977fe640 1 -- 172.21.15.90:0/4062683926 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098017070 con 0x7f00a015f570 2024-09-10T23:16:47.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.193+0000 7f00977fe640 1 -- 172.21.15.90:0/4062683926 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0098009cc0 con 0x7f00a015f570 2024-09-10T23:16:47.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.193+0000 7f00a56b6640 1 -- 172.21.15.90:0/4062683926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a01f3850 con 0x7f00a015f570 2024-09-10T23:16:47.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.193+0000 7f00977fe640 1 -- 172.21.15.90:0/4062683926 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098005280 con 0x7f00a015f570 2024-09-10T23:16:47.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.193+0000 7f00a56b6640 1 -- 172.21.15.90:0/4062683926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a01f3e10 con 0x7f00a015f570 2024-09-10T23:16:47.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.194+0000 7f00a56b6640 1 -- 172.21.15.90:0/4062683926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a00d0930 con 0x7f00a015f570 2024-09-10T23:16:47.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.194+0000 7f00977fe640 1 -- 172.21.15.90:0/4062683926 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0098005420 con 0x7f00a015f570 2024-09-10T23:16:47.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.195+0000 7f00977fe640 1 --2- 172.21.15.90:0/4062683926 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0080077f70 0x7f008007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:47.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.195+0000 7f00977fe640 1 -- 172.21.15.90:0/4062683926 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f009809a3a0 con 0x7f00a015f570 2024-09-10T23:16:47.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.195+0000 7f009effd640 1 --2- 172.21.15.90:0/4062683926 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0080077f70 0x7f008007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:47.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.196+0000 7f009effd640 1 --2- 172.21.15.90:0/4062683926 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0080077f70 0x7f008007a430 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0090035000 tx=0x7f0090004ab0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:47.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.198+0000 7f00977fe640 1 -- 172.21.15.90:0/4062683926 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0098062e80 con 0x7f00a015f570 2024-09-10T23:16:47.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.389+0000 7f00a56b6640 1 -- 172.21.15.90:0/4062683926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f00a00d2510 con 0x7f00a015f570 2024-09-10T23:16:47.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.389+0000 7f00977fe640 1 -- 172.21.15.90:0/4062683926 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) ==== 80+0+0 (secure 0 0 0) 0x7f0098062780 con 0x7f00a015f570 2024-09-10T23:16:47.390 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:16:47.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.392+0000 7f00a56b6640 1 -- 172.21.15.90:0/4062683926 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0080077f70 msgr2=0x7f008007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.392+0000 7f00a56b6640 1 --2- 172.21.15.90:0/4062683926 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0080077f70 0x7f008007a430 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0090035000 tx=0x7f0090004ab0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.392+0000 7f00a56b6640 1 -- 172.21.15.90:0/4062683926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00a015f570 msgr2=0x7f00a00c6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.392+0000 7f00a56b6640 1 --2- 172.21.15.90:0/4062683926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00a015f570 0x7f00a00c6560 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f009800d720 tx=0x7f009800dbe0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.392+0000 7f00a56b6640 1 -- 172.21.15.90:0/4062683926 shutdown_connections 2024-09-10T23:16:47.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.392+0000 7f00a56b6640 1 --2- 172.21.15.90:0/4062683926 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0080077f70 0x7f008007a430 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.392+0000 7f00a56b6640 1 --2- 172.21.15.90:0/4062683926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00a015f570 0x7f00a00c6560 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.392+0000 7f00a56b6640 1 --2- 172.21.15.90:0/4062683926 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00a00d2a00 0x7f00a01555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.392+0000 7f00a56b6640 1 --2- 172.21.15.90:0/4062683926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00a00b26f0 0x7f00a00c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.392+0000 7f00a56b6640 1 -- 172.21.15.90:0/4062683926 >> 172.21.15.90:0/4062683926 conn(0x7f00a00d1ee0 msgr2=0x7f00a00709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:47.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.392+0000 7f00a56b6640 1 -- 172.21.15.90:0/4062683926 shutdown_connections 2024-09-10T23:16:47.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.392+0000 7f00a56b6640 1 -- 172.21.15.90:0/4062683926 wait complete. 2024-09-10T23:16:47.403 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T23:16:47.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:47.404 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-10T23:16:47.453 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:16:47.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:47.454 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:16:47.482 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:16:47.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.622+0000 7f70847ad640 1 -- 172.21.15.90:0/1106118638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f707c0d1190 msgr2=0x7f707c0d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.622+0000 7f70847ad640 1 --2- 172.21.15.90:0/1106118638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f707c0d1190 0x7f707c0d28c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7070009830 tx=0x7f707002a480 comp rx=0 tx=0).stop 2024-09-10T23:16:47.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.622+0000 7f70847ad640 1 -- 172.21.15.90:0/1106118638 shutdown_connections 2024-09-10T23:16:47.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.622+0000 7f70847ad640 1 --2- 172.21.15.90:0/1106118638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f707c0d1190 0x7f707c0d28c0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.622+0000 7f70847ad640 1 -- 172.21.15.90:0/1106118638 >> 172.21.15.90:0/1106118638 conn(0x7f707c0d4090 msgr2=0x7f707c0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:47.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.622+0000 7f70847ad640 1 -- 172.21.15.90:0/1106118638 shutdown_connections 2024-09-10T23:16:47.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.622+0000 7f70847ad640 1 -- 172.21.15.90:0/1106118638 wait complete. 2024-09-10T23:16:47.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.624+0000 7f70847ad640 1 Processor -- start 2024-09-10T23:16:47.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.624+0000 7f70847ad640 1 -- start start 2024-09-10T23:16:47.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.624+0000 7f70847ad640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f707c0d1190 0x7f707c1f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:47.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.624+0000 7f70847ad640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f707c0d16f0 0x7f707c0a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:47.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.624+0000 7f70847ad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f707c15e310 0x7f707c1608b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:47.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.624+0000 7f70847ad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f707c0d3510 con 0x7f707c15e310 2024-09-10T23:16:47.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.624+0000 7f70847ad640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f707c0d4d90 con 0x7f707c0d1190 2024-09-10T23:16:47.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.624+0000 7f70847ad640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f707c0d3690 con 0x7f707c0d16f0 2024-09-10T23:16:47.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.624+0000 7f7082d4a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f707c15e310 0x7f707c1608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:47.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.624+0000 7f7082d4a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f707c15e310 0x7f707c1608b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41164/0 (socket says 172.21.15.90:41164) 2024-09-10T23:16:47.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.624+0000 7f7082d4a640 1 -- 172.21.15.90:0/62388987 learned_addr learned my addr 172.21.15.90:0/62388987 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:47.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.625+0000 7f7082549640 1 --2- 172.21.15.90:0/62388987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f707c0d1190 0x7f707c1f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:47.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.625+0000 7f7081d48640 1 --2- 172.21.15.90:0/62388987 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f707c0d16f0 0x7f707c0a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:47.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.625+0000 7f7082d4a640 1 -- 172.21.15.90:0/62388987 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f707c0d16f0 msgr2=0x7f707c0a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.625+0000 7f7082d4a640 1 --2- 172.21.15.90:0/62388987 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f707c0d16f0 0x7f707c0a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.625+0000 7f7082d4a640 1 -- 172.21.15.90:0/62388987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f707c0d1190 msgr2=0x7f707c1f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.625+0000 7f7082d4a640 1 --2- 172.21.15.90:0/62388987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f707c0d1190 0x7f707c1f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.625+0000 7f7082d4a640 1 -- 172.21.15.90:0/62388987 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707c0b8880 con 0x7f707c15e310 2024-09-10T23:16:47.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.625+0000 7f7082549640 1 --2- 172.21.15.90:0/62388987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f707c0d1190 0x7f707c1f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:47.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.625+0000 7f7082d4a640 1 --2- 172.21.15.90:0/62388987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f707c15e310 0x7f707c1608b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f707400c3c0 tx=0x7f707400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:47.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.625+0000 7f707affd640 1 -- 172.21.15.90:0/62388987 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7074017070 con 0x7f707c15e310 2024-09-10T23:16:47.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.625+0000 7f707affd640 1 -- 172.21.15.90:0/62388987 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70740035f0 con 0x7f707c15e310 2024-09-10T23:16:47.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.625+0000 7f70847ad640 1 -- 172.21.15.90:0/62388987 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f707c1f5a60 con 0x7f707c15e310 2024-09-10T23:16:47.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.625+0000 7f707affd640 1 -- 172.21.15.90:0/62388987 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7074003a40 con 0x7f707c15e310 2024-09-10T23:16:47.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.625+0000 7f70847ad640 1 -- 172.21.15.90:0/62388987 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f707c15ef10 con 0x7f707c15e310 2024-09-10T23:16:47.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.626+0000 7f70847ad640 1 -- 172.21.15.90:0/62388987 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f707c0d3b80 con 0x7f707c15e310 2024-09-10T23:16:47.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.627+0000 7f707affd640 1 -- 172.21.15.90:0/62388987 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7074003be0 con 0x7f707c15e310 2024-09-10T23:16:47.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.627+0000 7f707affd640 1 --2- 172.21.15.90:0/62388987 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7068077f70 0x7f706807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:47.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.627+0000 7f707affd640 1 -- 172.21.15.90:0/62388987 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f70740993b0 con 0x7f707c15e310 2024-09-10T23:16:47.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.627+0000 7f7082549640 1 --2- 172.21.15.90:0/62388987 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7068077f70 0x7f706807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:47.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.628+0000 7f7082549640 1 --2- 172.21.15.90:0/62388987 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7068077f70 0x7f706807a430 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f706c007fd0 tx=0x7f706c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:47.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.631+0000 7f707affd640 1 -- 172.21.15.90:0/62388987 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f707c1f5a60 con 0x7f707c15e310 2024-09-10T23:16:47.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.846+0000 7f70847ad640 1 -- 172.21.15.90:0/62388987 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f707c0008d0 con 0x7f707c15e310 2024-09-10T23:16:47.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.846+0000 7f707affd640 1 -- 172.21.15.90:0/62388987 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) ==== 53+0+73 (secure 0 0 0) 0x7f7074061eb0 con 0x7f707c15e310 2024-09-10T23:16:47.847 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:16:47.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.848+0000 7f70847ad640 1 -- 172.21.15.90:0/62388987 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7068077f70 msgr2=0x7f706807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.848+0000 7f70847ad640 1 --2- 172.21.15.90:0/62388987 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7068077f70 0x7f706807a430 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f706c007fd0 tx=0x7f706c009040 comp rx=0 tx=0).stop 2024-09-10T23:16:47.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.848+0000 7f70847ad640 1 -- 172.21.15.90:0/62388987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f707c15e310 msgr2=0x7f707c1608b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.848+0000 7f70847ad640 1 --2- 172.21.15.90:0/62388987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f707c15e310 0x7f707c1608b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f707400c3c0 tx=0x7f707400c880 comp rx=0 tx=0).stop 2024-09-10T23:16:47.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.848+0000 7f70847ad640 1 -- 172.21.15.90:0/62388987 shutdown_connections 2024-09-10T23:16:47.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.848+0000 7f70847ad640 1 --2- 172.21.15.90:0/62388987 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7068077f70 0x7f706807a430 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.848+0000 7f70847ad640 1 --2- 172.21.15.90:0/62388987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f707c15e310 0x7f707c1608b0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.848+0000 7f70847ad640 1 --2- 172.21.15.90:0/62388987 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f707c0d16f0 0x7f707c0a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.848+0000 7f70847ad640 1 --2- 172.21.15.90:0/62388987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f707c0d1190 0x7f707c1f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.848+0000 7f70847ad640 1 -- 172.21.15.90:0/62388987 >> 172.21.15.90:0/62388987 conn(0x7f707c0d4090 msgr2=0x7f707c0b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:47.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.849+0000 7f70847ad640 1 -- 172.21.15.90:0/62388987 shutdown_connections 2024-09-10T23:16:47.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:47.849+0000 7f70847ad640 1 -- 172.21.15.90:0/62388987 wait complete. 2024-09-10T23:16:47.860 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:16:47.860 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:16:47.861 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2024-09-10T23:16:47.861 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:16:47.861 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:47.861 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:16:47.861 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:16:47.861 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:16:47.861 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:16:47.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:47.861 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2024-09-10T23:16:47.877 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:16:47.877 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:16:47.877 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:16:47.877 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:47.877 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-10T23:16:47.877 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:47.877 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:16:47.877 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:47.878 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2024-09-10T23:16:47.878 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:16:47.878 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:47.878 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2024-09-10T23:16:47.878 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:16:47.878 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:47.878 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:16:47.878 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:47.878 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:16:47.878 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42640sec preferred_lft 42640sec 2024-09-10T23:16:47.878 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link noprefixroute 2024-09-10T23:16:47.878 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:47.878 INFO:teuthology.orchestra.run.smithi090.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:16:47.879 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:47.879 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:16:47.879 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:47.879 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::882a:a9ff:fefc:893f/64 scope link 2024-09-10T23:16:47.879 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:47.879 INFO:teuthology.orchestra.run.smithi090.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:16:47.879 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 76:ad:51:1a:2a:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:47.879 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::74ad:51ff:fe1a:2a60/64 scope link 2024-09-10T23:16:47.879 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:47.879 INFO:teuthology.orchestra.run.smithi090.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:16:47.879 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:16:47.879 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::3414:abff:fe49:366c/64 scope link 2024-09-10T23:16:47.879 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:47.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:47.880 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:16:47.941 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-09-10T23:16:47.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:47.942 DEBUG:teuthology.orchestra.run.smithi090:> route 2024-09-10T23:16:47.999 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2024-09-10T23:16:47.999 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:16:47.999 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:16:47.999 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:16:47.999 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:16:47.999 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:47.999 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:16:48.000 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:16:48.000 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:16:48.000 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:16:48.000 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:16:48.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:48.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:48.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:48.124 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-10T23:16:48.139 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:16:48.139 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:16:48.139 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:16:48.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:48.140 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2024-09-10T23:16:48.204 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:48.205 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:48.259 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:16:48.260 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:48.260 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:48.314 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:16:48.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:48.315 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:16:48.398 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:16:48.398 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:16:48.398 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:16:48.406 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:16:48.407 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:16:48.407 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:16:48.407 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:16:48.407 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:16:48.412 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:16:48.413 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:16:48.413 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:16:48.413 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:16:48.413 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:16:48.413 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:16:48.413 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:16:48.413 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:16:48.413 INFO:teuthology.orchestra.run.smithi090.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T23:16:48.413 INFO:teuthology.orchestra.run.smithi090.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:16:48.414 INFO:teuthology.orchestra.run.smithi090.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:16:48.414 INFO:teuthology.orchestra.run.smithi090.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:16:48.414 INFO:teuthology.orchestra.run.smithi090.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:16:48.415 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:16:48.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:48.415 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:48.479 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:16:48.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:16:48.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:48.575 INFO:teuthology.orchestra.run.smithi090.stdout:client5219 2024-09-10T23:16:48.576 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:16:48.576 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:48.591 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:16:48.591 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:16:48.675 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:16:48.721 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:16:48.722 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:16:48.722 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:16:48.722 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:48.738 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:16:48.738 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:48.794 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:16:48.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.934+0000 7f07034b6640 1 -- 172.21.15.90:0/615885819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06e8004d20 msgr2=0x7f06e8005120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.934+0000 7f07034b6640 1 --2- 172.21.15.90:0/615885819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06e8004d20 0x7f06e8005120 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009b80 tx=0x7f06e8006940 comp rx=0 tx=0).stop 2024-09-10T23:16:48.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.934+0000 7f0701a53640 1 -- 172.21.15.90:0/615885819 reap_dead start 2024-09-10T23:16:48.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.934+0000 7f07034b6640 1 -- 172.21.15.90:0/615885819 shutdown_connections 2024-09-10T23:16:48.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.934+0000 7f07034b6640 1 -- 172.21.15.90:0/615885819 >> 172.21.15.90:0/615885819 conn(0x7f06fc0b19c0 msgr2=0x7f06fc0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:48.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.934+0000 7f07034b6640 1 -- 172.21.15.90:0/615885819 shutdown_connections 2024-09-10T23:16:48.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.934+0000 7f07034b6640 1 -- 172.21.15.90:0/615885819 wait complete. 2024-09-10T23:16:48.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.935+0000 7f07034b6640 1 Processor -- start 2024-09-10T23:16:48.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.935+0000 7f07034b6640 1 -- start start 2024-09-10T23:16:48.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.936+0000 7f07034b6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06e8004d20 0x7f06fc14f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.936+0000 7f07034b6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06fc15b220 0x7f06fc15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.936+0000 7f07034b6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06fc0b0a40 0x7f06fc0b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.936+0000 7f07034b6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc0cdd10 con 0x7f06fc0b0a40 2024-09-10T23:16:48.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.936+0000 7f07034b6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc0cdb90 con 0x7f06e8004d20 2024-09-10T23:16:48.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.936+0000 7f07034b6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f06fc0cde90 con 0x7f06fc15b220 2024-09-10T23:16:48.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.936+0000 7f0701a53640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06fc0b0a40 0x7f06fc0b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.936+0000 7f0701a53640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06fc0b0a40 0x7f06fc0b0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59664/0 (socket says 172.21.15.90:59664) 2024-09-10T23:16:48.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.936+0000 7f0701a53640 1 -- 172.21.15.90:0/2506575105 learned_addr learned my addr 172.21.15.90:0/2506575105 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:48.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.936+0000 7f0700a51640 1 --2- 172.21.15.90:0/2506575105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06fc15b220 0x7f06fc15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.936+0000 7f0701252640 1 --2- 172.21.15.90:0/2506575105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06e8004d20 0x7f06fc14f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.936+0000 7f0701a53640 1 -- 172.21.15.90:0/2506575105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06fc15b220 msgr2=0x7f06fc15d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.936+0000 7f0701a53640 1 --2- 172.21.15.90:0/2506575105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06fc15b220 0x7f06fc15d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.936+0000 7f0701a53640 1 -- 172.21.15.90:0/2506575105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06e8004d20 msgr2=0x7f06fc14f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.936+0000 7f0701a53640 1 --2- 172.21.15.90:0/2506575105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06e8004d20 0x7f06fc14f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.936+0000 7f0701a53640 1 -- 172.21.15.90:0/2506575105 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06fc15d720 con 0x7f06fc0b0a40 2024-09-10T23:16:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.937+0000 7f0701a53640 1 --2- 172.21.15.90:0/2506575105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06fc0b0a40 0x7f06fc0b0ed0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0b3790 tx=0x7f06f4001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.937+0000 7f06f1ffb640 1 -- 172.21.15.90:0/2506575105 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f4015020 con 0x7f06fc0b0a40 2024-09-10T23:16:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.937+0000 7f06f1ffb640 1 -- 172.21.15.90:0/2506575105 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06f4011960 con 0x7f06fc0b0a40 2024-09-10T23:16:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.937+0000 7f07034b6640 1 -- 172.21.15.90:0/2506575105 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06fc09d830 con 0x7f06fc0b0a40 2024-09-10T23:16:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.937+0000 7f06f1ffb640 1 -- 172.21.15.90:0/2506575105 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f4011db0 con 0x7f06fc0b0a40 2024-09-10T23:16:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.937+0000 7f07034b6640 1 -- 172.21.15.90:0/2506575105 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06fc15aa20 con 0x7f06fc0b0a40 2024-09-10T23:16:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.938+0000 7f07034b6640 1 -- 172.21.15.90:0/2506575105 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06fc0cd0b0 con 0x7f06fc0b0a40 2024-09-10T23:16:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.939+0000 7f06f1ffb640 1 -- 172.21.15.90:0/2506575105 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f06f401a400 con 0x7f06fc0b0a40 2024-09-10T23:16:48.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.939+0000 7f06f1ffb640 1 --2- 172.21.15.90:0/2506575105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f06e0077fa0 0x7f06e007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.939+0000 7f06f1ffb640 1 -- 172.21.15.90:0/2506575105 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f06f409aa10 con 0x7f06fc0b0a40 2024-09-10T23:16:48.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.939+0000 7f0701252640 1 --2- 172.21.15.90:0/2506575105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f06e0077fa0 0x7f06e007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.940+0000 7f0701252640 1 --2- 172.21.15.90:0/2506575105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f06e0077fa0 0x7f06e007a460 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f06f8035000 tx=0x7f06f802d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:48.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:48.943+0000 7f06f1ffb640 1 -- 172.21.15.90:0/2506575105 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f06f401f020 con 0x7f06fc0b0a40 2024-09-10T23:16:49.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.134+0000 7f07034b6640 1 -- 172.21.15.90:0/2506575105 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f06fc0af100 con 0x7f06fc0b0a40 2024-09-10T23:16:49.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.134+0000 7f06f1ffb640 1 -- 172.21.15.90:0/2506575105 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) ==== 80+0+0 (secure 0 0 0) 0x7f06f40635a0 con 0x7f06fc0b0a40 2024-09-10T23:16:49.135 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:16:49.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.137+0000 7f07034b6640 1 -- 172.21.15.90:0/2506575105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f06e0077fa0 msgr2=0x7f06e007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:49.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.137+0000 7f07034b6640 1 --2- 172.21.15.90:0/2506575105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f06e0077fa0 0x7f06e007a460 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f06f8035000 tx=0x7f06f802d040 comp rx=0 tx=0).stop 2024-09-10T23:16:49.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.137+0000 7f07034b6640 1 -- 172.21.15.90:0/2506575105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06fc0b0a40 msgr2=0x7f06fc0b0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:49.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.137+0000 7f07034b6640 1 --2- 172.21.15.90:0/2506575105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06fc0b0a40 0x7f06fc0b0ed0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0b3790 tx=0x7f06f4001b80 comp rx=0 tx=0).stop 2024-09-10T23:16:49.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.137+0000 7f07034b6640 1 -- 172.21.15.90:0/2506575105 shutdown_connections 2024-09-10T23:16:49.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.137+0000 7f07034b6640 1 --2- 172.21.15.90:0/2506575105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f06e0077fa0 0x7f06e007a460 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.137+0000 7f07034b6640 1 --2- 172.21.15.90:0/2506575105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06fc0b0a40 0x7f06fc0b0ed0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.137+0000 7f07034b6640 1 --2- 172.21.15.90:0/2506575105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06fc15b220 0x7f06fc15d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.137+0000 7f07034b6640 1 --2- 172.21.15.90:0/2506575105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06e8004d20 0x7f06fc14f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.137+0000 7f07034b6640 1 -- 172.21.15.90:0/2506575105 >> 172.21.15.90:0/2506575105 conn(0x7f06fc0b19c0 msgr2=0x7f06fc06fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:49.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.137+0000 7f07034b6640 1 -- 172.21.15.90:0/2506575105 shutdown_connections 2024-09-10T23:16:49.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.137+0000 7f07034b6640 1 -- 172.21.15.90:0/2506575105 wait complete. 2024-09-10T23:16:49.149 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T23:16:49.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:49.149 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:49.177 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:16:49.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:49.177 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:16:49.234 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:16:49.234 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:16:49.234 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:49.254 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:16:49.254 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:49.314 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:16:49.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.415+0000 7fb6208ed640 1 -- 172.21.15.90:0/3447740617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb61c0cf860 msgr2=0x7fb61c15e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:49.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.415+0000 7fb6208ed640 1 --2- 172.21.15.90:0/3447740617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb61c0cf860 0x7fb61c15e180 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0cda60 tx=0x7fb61002a530 comp rx=0 tx=0).stop 2024-09-10T23:16:49.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.415+0000 7fb6208ed640 1 -- 172.21.15.90:0/3447740617 shutdown_connections 2024-09-10T23:16:49.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.415+0000 7fb6208ed640 1 --2- 172.21.15.90:0/3447740617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb61c0cf860 0x7fb61c15e180 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.415+0000 7fb6208ed640 1 --2- 172.21.15.90:0/3447740617 >> v2:172.21.15.171:3300/0 conn(0x7fb61c0b44a0 0x7fb61c0b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.415+0000 7fb6208ed640 1 -- 172.21.15.90:0/3447740617 >> 172.21.15.90:0/3447740617 conn(0x7fb61c0b19c0 msgr2=0x7fb61c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:49.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.415+0000 7fb6208ed640 1 -- 172.21.15.90:0/3447740617 shutdown_connections 2024-09-10T23:16:49.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.415+0000 7fb6208ed640 1 -- 172.21.15.90:0/3447740617 wait complete. 2024-09-10T23:16:49.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.416+0000 7fb6208ed640 1 Processor -- start 2024-09-10T23:16:49.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.416+0000 7fb6208ed640 1 -- start start 2024-09-10T23:16:49.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.417+0000 7fb6208ed640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb61c0b44a0 0x7fb61c150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:49.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.417+0000 7fb6208ed640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb61c0cd470 0x7fb61c157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:49.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.417+0000 7fb6208ed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb61c0cf860 0x7fb61c1f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:49.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.417+0000 7fb6208ed640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c0ced20 con 0x7fb61c0cf860 2024-09-10T23:16:49.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.417+0000 7fb6208ed640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c0ceba0 con 0x7fb61c0cd470 2024-09-10T23:16:49.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.417+0000 7fb6208ed640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb61c15a8c0 con 0x7fb61c0b44a0 2024-09-10T23:16:49.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.417+0000 7fb61ad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb61c0cf860 0x7fb61c1f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:49.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.417+0000 7fb61ad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb61c0cf860 0x7fb61c1f69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59690/0 (socket says 172.21.15.90:59690) 2024-09-10T23:16:49.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.417+0000 7fb61ad9d640 1 -- 172.21.15.90:0/3191958898 learned_addr learned my addr 172.21.15.90:0/3191958898 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:49.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.417+0000 7fb619d9b640 1 --2- 172.21.15.90:0/3191958898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb61c0cd470 0x7fb61c157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:49.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.417+0000 7fb61a59c640 1 --2- 172.21.15.90:0/3191958898 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb61c0b44a0 0x7fb61c150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:49.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.418+0000 7fb61ad9d640 1 -- 172.21.15.90:0/3191958898 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb61c0b44a0 msgr2=0x7fb61c150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:49.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.418+0000 7fb61ad9d640 1 --2- 172.21.15.90:0/3191958898 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb61c0b44a0 0x7fb61c150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.418+0000 7fb61ad9d640 1 -- 172.21.15.90:0/3191958898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb61c0cd470 msgr2=0x7fb61c157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:49.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.418+0000 7fb61ad9d640 1 --2- 172.21.15.90:0/3191958898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb61c0cd470 0x7fb61c157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.418+0000 7fb61ad9d640 1 -- 172.21.15.90:0/3191958898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61c1508a0 con 0x7fb61c0cf860 2024-09-10T23:16:49.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.418+0000 7fb61ad9d640 1 --2- 172.21.15.90:0/3191958898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb61c0cf860 0x7fb61c1f69a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb61400c7a0 tx=0x7fb61400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:49.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.418+0000 7fb60affd640 1 -- 172.21.15.90:0/3191958898 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb614017070 con 0x7fb61c0cf860 2024-09-10T23:16:49.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.418+0000 7fb60affd640 1 -- 172.21.15.90:0/3191958898 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb614005070 con 0x7fb61c0cf860 2024-09-10T23:16:49.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.418+0000 7fb60affd640 1 -- 172.21.15.90:0/3191958898 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6140054c0 con 0x7fb61c0cf860 2024-09-10T23:16:49.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.418+0000 7fb6208ed640 1 -- 172.21.15.90:0/3191958898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb61c151ef0 con 0x7fb61c0cf860 2024-09-10T23:16:49.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.418+0000 7fb6208ed640 1 -- 172.21.15.90:0/3191958898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb61c1524b0 con 0x7fb61c0cf860 2024-09-10T23:16:49.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.419+0000 7fb6208ed640 1 -- 172.21.15.90:0/3191958898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb61c0b4880 con 0x7fb61c0cf860 2024-09-10T23:16:49.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.420+0000 7fb60affd640 1 -- 172.21.15.90:0/3191958898 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb614005660 con 0x7fb61c0cf860 2024-09-10T23:16:49.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.420+0000 7fb60affd640 1 --2- 172.21.15.90:0/3191958898 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5fc077f70 0x7fb5fc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:49.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.420+0000 7fb60affd640 1 -- 172.21.15.90:0/3191958898 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fb614099680 con 0x7fb61c0cf860 2024-09-10T23:16:49.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.420+0000 7fb61a59c640 1 --2- 172.21.15.90:0/3191958898 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5fc077f70 0x7fb5fc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:49.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.421+0000 7fb61a59c640 1 --2- 172.21.15.90:0/3191958898 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5fc077f70 0x7fb5fc07a430 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009890 tx=0x7fb60c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:49.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.424+0000 7fb60affd640 1 -- 172.21.15.90:0/3191958898 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb614062170 con 0x7fb61c0cf860 2024-09-10T23:16:49.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.610+0000 7fb6208ed640 1 -- 172.21.15.90:0/3191958898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb61c0cc480 con 0x7fb61c0cf860 2024-09-10T23:16:49.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.611+0000 7fb60affd640 1 -- 172.21.15.90:0/3191958898 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) ==== 80+0+0 (secure 0 0 0) 0x7fb614061a70 con 0x7fb61c0cf860 2024-09-10T23:16:49.612 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:16:49.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.613+0000 7fb6208ed640 1 -- 172.21.15.90:0/3191958898 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5fc077f70 msgr2=0x7fb5fc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:49.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.613+0000 7fb6208ed640 1 --2- 172.21.15.90:0/3191958898 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5fc077f70 0x7fb5fc07a430 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009890 tx=0x7fb60c008040 comp rx=0 tx=0).stop 2024-09-10T23:16:49.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.613+0000 7fb6208ed640 1 -- 172.21.15.90:0/3191958898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb61c0cf860 msgr2=0x7fb61c1f69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:49.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.613+0000 7fb6208ed640 1 --2- 172.21.15.90:0/3191958898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb61c0cf860 0x7fb61c1f69a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb61400c7a0 tx=0x7fb61400cc60 comp rx=0 tx=0).stop 2024-09-10T23:16:49.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.613+0000 7fb6208ed640 1 -- 172.21.15.90:0/3191958898 shutdown_connections 2024-09-10T23:16:49.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.613+0000 7fb6208ed640 1 --2- 172.21.15.90:0/3191958898 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5fc077f70 0x7fb5fc07a430 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.613+0000 7fb6208ed640 1 --2- 172.21.15.90:0/3191958898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb61c0cd470 0x7fb61c157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.613+0000 7fb6208ed640 1 --2- 172.21.15.90:0/3191958898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb61c0cf860 0x7fb61c1f69a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.613+0000 7fb6208ed640 1 --2- 172.21.15.90:0/3191958898 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb61c0b44a0 0x7fb61c150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.613+0000 7fb6208ed640 1 -- 172.21.15.90:0/3191958898 >> 172.21.15.90:0/3191958898 conn(0x7fb61c0b19c0 msgr2=0x7fb61c073de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:49.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.613+0000 7fb6208ed640 1 -- 172.21.15.90:0/3191958898 shutdown_connections 2024-09-10T23:16:49.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.613+0000 7fb6208ed640 1 -- 172.21.15.90:0/3191958898 wait complete. 2024-09-10T23:16:49.625 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T23:16:49.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:49.625 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:49.687 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:16:49.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:49.688 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T23:16:49.724 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:16:49.724 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:16:49.724 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:49.748 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:16:49.748 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:16:49.748 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:16:49.748 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:49.780 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:16:49.781 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:49.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.889+0000 7f59c9a7f640 1 -- 172.21.15.90:0/483849225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c40cdb90 msgr2=0x7f59c40cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:49.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.889+0000 7f59c9a7f640 1 --2- 172.21.15.90:0/483849225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c40cdb90 0x7f59c40cdfd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f59b8005fd0 tx=0x7f59b802a5d0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.889+0000 7f59c9a7f640 1 -- 172.21.15.90:0/483849225 shutdown_connections 2024-09-10T23:16:49.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.889+0000 7f59c9a7f640 1 --2- 172.21.15.90:0/483849225 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c406f550 0x7f59c406f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.889+0000 7f59c9a7f640 1 --2- 172.21.15.90:0/483849225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c40cdb90 0x7f59c40cdfd0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.889+0000 7f59c9a7f640 1 -- 172.21.15.90:0/483849225 >> 172.21.15.90:0/483849225 conn(0x7f59c40b19c0 msgr2=0x7f59c40b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:49.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.889+0000 7f59c9a7f640 1 -- 172.21.15.90:0/483849225 shutdown_connections 2024-09-10T23:16:49.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.889+0000 7f59c9a7f640 1 -- 172.21.15.90:0/483849225 wait complete. 2024-09-10T23:16:49.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.890+0000 7f59c9a7f640 1 Processor -- start 2024-09-10T23:16:49.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.890+0000 7f59c9a7f640 1 -- start start 2024-09-10T23:16:49.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.891+0000 7f59c9a7f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c406f550 0x7f59c414e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:49.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.891+0000 7f59c9a7f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c40cdb90 0x7f59c4157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:49.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.891+0000 7f59c9a7f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59c415f750 0x7f59c4158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:49.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.891+0000 7f59c9a7f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f59c40cc940 con 0x7f59c40cdb90 2024-09-10T23:16:49.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.891+0000 7f59c9a7f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f59c40cc7c0 con 0x7f59c415f750 2024-09-10T23:16:49.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.891+0000 7f59c9a7f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f59c40ccac0 con 0x7f59c406f550 2024-09-10T23:16:49.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.891+0000 7f59c2ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c40cdb90 0x7f59c4157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:49.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.891+0000 7f59c2ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c40cdb90 0x7f59c4157d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59716/0 (socket says 172.21.15.90:59716) 2024-09-10T23:16:49.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.891+0000 7f59c2ffd640 1 -- 172.21.15.90:0/3805159600 learned_addr learned my addr 172.21.15.90:0/3805159600 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:49.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.891+0000 7f59c3fff640 1 --2- 172.21.15.90:0/3805159600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59c415f750 0x7f59c4158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:49.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.891+0000 7f59c37fe640 1 --2- 172.21.15.90:0/3805159600 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c406f550 0x7f59c414e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:49.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.891+0000 7f59c2ffd640 1 -- 172.21.15.90:0/3805159600 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c406f550 msgr2=0x7f59c414e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:49.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.891+0000 7f59c2ffd640 1 --2- 172.21.15.90:0/3805159600 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c406f550 0x7f59c414e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.891+0000 7f59c2ffd640 1 -- 172.21.15.90:0/3805159600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59c415f750 msgr2=0x7f59c4158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:49.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.891+0000 7f59c2ffd640 1 --2- 172.21.15.90:0/3805159600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59c415f750 0x7f59c4158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:49.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.891+0000 7f59c2ffd640 1 -- 172.21.15.90:0/3805159600 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c4158b70 con 0x7f59c40cdb90 2024-09-10T23:16:49.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.891+0000 7f59c2ffd640 1 --2- 172.21.15.90:0/3805159600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c40cdb90 0x7f59c4157d20 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009850 tx=0x7f59b80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:49.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.892+0000 7f59abfff640 1 -- 172.21.15.90:0/3805159600 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b803f070 con 0x7f59c40cdb90 2024-09-10T23:16:49.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.892+0000 7f59abfff640 1 -- 172.21.15.90:0/3805159600 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59b8005600 con 0x7f59c40cdb90 2024-09-10T23:16:49.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.892+0000 7f59abfff640 1 -- 172.21.15.90:0/3805159600 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8035030 con 0x7f59c40cdb90 2024-09-10T23:16:49.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.892+0000 7f59c9a7f640 1 -- 172.21.15.90:0/3805159600 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c4155f60 con 0x7f59c40cdb90 2024-09-10T23:16:49.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.892+0000 7f59c9a7f640 1 -- 172.21.15.90:0/3805159600 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c41f8610 con 0x7f59c40cdb90 2024-09-10T23:16:49.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.893+0000 7f59c9a7f640 1 -- 172.21.15.90:0/3805159600 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c414ece0 con 0x7f59c40cdb90 2024-09-10T23:16:49.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.893+0000 7f59abfff640 1 -- 172.21.15.90:0/3805159600 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f59b80049e0 con 0x7f59c40cdb90 2024-09-10T23:16:49.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.894+0000 7f59abfff640 1 --2- 172.21.15.90:0/3805159600 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f59b0077f70 0x7f59b007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:49.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.894+0000 7f59abfff640 1 -- 172.21.15.90:0/3805159600 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f59b80baba0 con 0x7f59c40cdb90 2024-09-10T23:16:49.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.894+0000 7f59c37fe640 1 --2- 172.21.15.90:0/3805159600 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f59b0077f70 0x7f59b007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:49.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.894+0000 7f59c37fe640 1 --2- 172.21.15.90:0/3805159600 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f59b0077f70 0x7f59b007a430 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f59b4001720 tx=0x7f59b4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:49.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:49.898+0000 7f59abfff640 1 -- 172.21.15.90:0/3805159600 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f59c4158b70 con 0x7f59c40cdb90 2024-09-10T23:16:50.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.105+0000 7f59c9a7f640 1 -- 172.21.15.90:0/3805159600 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59c40cdfd0 con 0x7f59c40cdb90 2024-09-10T23:16:50.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.105+0000 7f59abfff640 1 -- 172.21.15.90:0/3805159600 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5249 (secure 0 0 0) 0x7f59b80830e0 con 0x7f59c40cdb90 2024-09-10T23:16:50.106 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:50.107 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"btime":"2024-09-10T23:16:34:728656+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3624303902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3624303902},{"type":"v1","addr":"172.21.15.171:6837","nonce":3624303902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1743356090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1743356090},{"type":"v1","addr":"172.21.15.171:6836","nonce":1743356090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:16:07.583350+0000","modified":"2024-09-10T23:16:34.490056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5556,"mds_1":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":1,"incarnation":29,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6833/2007304013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2007304013},{"type":"v1","addr":"172.21.15.90:6833","nonce":2007304013}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5556":{"gid":5556,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/1708086583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1708086583},{"type":"v1","addr":"172.21.15.90:6835","nonce":1708086583}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5556,"qdb_cluster":[5556,5553]},"id":4}]} 2024-09-10T23:16:50.107 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 31 2024-09-10T23:16:50.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.107+0000 7f59c9a7f640 1 -- 172.21.15.90:0/3805159600 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f59b0077f70 msgr2=0x7f59b007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.107+0000 7f59c9a7f640 1 --2- 172.21.15.90:0/3805159600 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f59b0077f70 0x7f59b007a430 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f59b4001720 tx=0x7f59b4009040 comp rx=0 tx=0).stop 2024-09-10T23:16:50.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.108+0000 7f59c9a7f640 1 -- 172.21.15.90:0/3805159600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c40cdb90 msgr2=0x7f59c4157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.108+0000 7f59c9a7f640 1 --2- 172.21.15.90:0/3805159600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c40cdb90 0x7f59c4157d20 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009850 tx=0x7f59b80038a0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.108+0000 7f59c9a7f640 1 -- 172.21.15.90:0/3805159600 shutdown_connections 2024-09-10T23:16:50.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.108+0000 7f59c9a7f640 1 --2- 172.21.15.90:0/3805159600 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f59b0077f70 0x7f59b007a430 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.108+0000 7f59c9a7f640 1 --2- 172.21.15.90:0/3805159600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59c415f750 0x7f59c4158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.108+0000 7f59c9a7f640 1 --2- 172.21.15.90:0/3805159600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c40cdb90 0x7f59c4157d20 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.108+0000 7f59c9a7f640 1 --2- 172.21.15.90:0/3805159600 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59c406f550 0x7f59c414e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.108+0000 7f59c9a7f640 1 -- 172.21.15.90:0/3805159600 >> 172.21.15.90:0/3805159600 conn(0x7f59c40b19c0 msgr2=0x7f59c40b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:50.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.108+0000 7f59c9a7f640 1 -- 172.21.15.90:0/3805159600 shutdown_connections 2024-09-10T23:16:50.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.108+0000 7f59c9a7f640 1 -- 172.21.15.90:0/3805159600 wait complete. 2024-09-10T23:16:50.119 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:50.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.219+0000 7f0eb1f3d640 1 -- 172.21.15.90:0/1677405221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0eac0cdb90 msgr2=0x7f0eac0cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.219+0000 7f0eb1f3d640 1 --2- 172.21.15.90:0/1677405221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0eac0cdb90 0x7f0eac0cdfd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0009830 tx=0x7f0ea002a5c0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.219+0000 7f0eb1f3d640 1 -- 172.21.15.90:0/1677405221 shutdown_connections 2024-09-10T23:16:50.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.219+0000 7f0eb1f3d640 1 --2- 172.21.15.90:0/1677405221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0eac0cdb90 0x7f0eac0cdfd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.219+0000 7f0eb1f3d640 1 -- 172.21.15.90:0/1677405221 >> 172.21.15.90:0/1677405221 conn(0x7f0eac0b19c0 msgr2=0x7f0eac0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:50.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.219+0000 7f0eb1f3d640 1 -- 172.21.15.90:0/1677405221 shutdown_connections 2024-09-10T23:16:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.219+0000 7f0eb1f3d640 1 -- 172.21.15.90:0/1677405221 wait complete. 2024-09-10T23:16:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.220+0000 7f0eb1f3d640 1 Processor -- start 2024-09-10T23:16:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.220+0000 7f0eb1f3d640 1 -- start start 2024-09-10T23:16:50.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.221+0000 7f0eb1f3d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0eac06f550 0x7f0eac152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:50.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.221+0000 7f0eb1f3d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0eac0cdb90 0x7f0eac13f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:50.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.221+0000 7f0eb1f3d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0eac15f750 0x7f0eac13f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:50.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.221+0000 7f0eb1f3d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0eac1674d0 con 0x7f0eac06f550 2024-09-10T23:16:50.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.221+0000 7f0eb1f3d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0eac167350 con 0x7f0eac0cdb90 2024-09-10T23:16:50.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.221+0000 7f0eb1f3d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0eac167650 con 0x7f0eac15f750 2024-09-10T23:16:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.221+0000 7f0eab7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0eac06f550 0x7f0eac152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.221+0000 7f0eab7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0eac06f550 0x7f0eac152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59720/0 (socket says 172.21.15.90:59720) 2024-09-10T23:16:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.221+0000 7f0eab7fe640 1 -- 172.21.15.90:0/1475203360 learned_addr learned my addr 172.21.15.90:0/1475203360 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.221+0000 7f0eabfff640 1 --2- 172.21.15.90:0/1475203360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0eac15f750 0x7f0eac13f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.221+0000 7f0eab7fe640 1 -- 172.21.15.90:0/1475203360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0eac15f750 msgr2=0x7f0eac13f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.221+0000 7f0eaaffd640 1 --2- 172.21.15.90:0/1475203360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0eac0cdb90 0x7f0eac13f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.221+0000 7f0eab7fe640 1 --2- 172.21.15.90:0/1475203360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0eac15f750 0x7f0eac13f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.221+0000 7f0eab7fe640 1 -- 172.21.15.90:0/1475203360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0eac0cdb90 msgr2=0x7f0eac13f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.221+0000 7f0eab7fe640 1 --2- 172.21.15.90:0/1475203360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0eac0cdb90 0x7f0eac13f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.221+0000 7f0eab7fe640 1 -- 172.21.15.90:0/1475203360 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eac150ba0 con 0x7f0eac06f550 2024-09-10T23:16:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.222+0000 7f0eab7fe640 1 --2- 172.21.15.90:0/1475203360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0eac06f550 0x7f0eac152650 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00c7a0 tx=0x7f0e9c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.222+0000 7f0e93fff640 1 -- 172.21.15.90:0/1475203360 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c017070 con 0x7f0eac06f550 2024-09-10T23:16:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.222+0000 7f0e93fff640 1 -- 172.21.15.90:0/1475203360 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e9c005070 con 0x7f0eac06f550 2024-09-10T23:16:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.222+0000 7f0eb1f3d640 1 -- 172.21.15.90:0/1475203360 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eac150e80 con 0x7f0eac06f550 2024-09-10T23:16:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.222+0000 7f0e93fff640 1 -- 172.21.15.90:0/1475203360 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c0054a0 con 0x7f0eac06f550 2024-09-10T23:16:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.222+0000 7f0eb1f3d640 1 -- 172.21.15.90:0/1475203360 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eac14ff20 con 0x7f0eac06f550 2024-09-10T23:16:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.223+0000 7f0eb1f3d640 1 -- 172.21.15.90:0/1475203360 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eac0cdfd0 con 0x7f0eac06f550 2024-09-10T23:16:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.223+0000 7f0e93fff640 1 -- 172.21.15.90:0/1475203360 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0e9c005640 con 0x7f0eac06f550 2024-09-10T23:16:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.224+0000 7f0e93fff640 1 --2- 172.21.15.90:0/1475203360 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0e98077f70 0x7f0e9807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.224+0000 7f0e93fff640 1 -- 172.21.15.90:0/1475203360 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f0e9c099670 con 0x7f0eac06f550 2024-09-10T23:16:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.224+0000 7f0eaaffd640 1 --2- 172.21.15.90:0/1475203360 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0e98077f70 0x7f0e9807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.225+0000 7f0eaaffd640 1 --2- 172.21.15.90:0/1475203360 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0e98077f70 0x7f0e9807a430 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0034000 tx=0x7f0ea0004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:50.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.228+0000 7f0e93fff640 1 -- 172.21.15.90:0/1475203360 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0e9c062200 con 0x7f0eac06f550 2024-09-10T23:16:50.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.438+0000 7f0eb1f3d640 1 -- 172.21.15.90:0/1475203360 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0eac0af160 con 0x7f0eac06f550 2024-09-10T23:16:50.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.438+0000 7f0e93fff640 1 -- 172.21.15.90:0/1475203360 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5249 (secure 0 0 0) 0x7f0e9c061b00 con 0x7f0eac06f550 2024-09-10T23:16:50.533 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:50.533 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"btime":"2024-09-10T23:16:34:728656+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3624303902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3624303902},{"type":"v1","addr":"172.21.15.171:6837","nonce":3624303902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1743356090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1743356090},{"type":"v1","addr":"172.21.15.171:6836","nonce":1743356090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:16:07.583350+0000","modified":"2024-09-10T23:16:34.490056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5556,"mds_1":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":1,"incarnation":29,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6833/2007304013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2007304013},{"type":"v1","addr":"172.21.15.90:6833","nonce":2007304013}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5556":{"gid":5556,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/1708086583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1708086583},{"type":"v1","addr":"172.21.15.90:6835","nonce":1708086583}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5556,"qdb_cluster":[5556,5553]},"id":4}]} 2024-09-10T23:16:50.534 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 31 2024-09-10T23:16:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.441+0000 7f0eb1f3d640 1 -- 172.21.15.90:0/1475203360 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0e98077f70 msgr2=0x7f0e9807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.441+0000 7f0eb1f3d640 1 --2- 172.21.15.90:0/1475203360 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0e98077f70 0x7f0e9807a430 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0034000 tx=0x7f0ea0004730 comp rx=0 tx=0).stop 2024-09-10T23:16:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.441+0000 7f0eb1f3d640 1 -- 172.21.15.90:0/1475203360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0eac06f550 msgr2=0x7f0eac152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.441+0000 7f0eb1f3d640 1 --2- 172.21.15.90:0/1475203360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0eac06f550 0x7f0eac152650 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00c7a0 tx=0x7f0e9c00cc60 comp rx=0 tx=0).stop 2024-09-10T23:16:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.441+0000 7f0eb1f3d640 1 -- 172.21.15.90:0/1475203360 shutdown_connections 2024-09-10T23:16:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.441+0000 7f0eb1f3d640 1 --2- 172.21.15.90:0/1475203360 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0e98077f70 0x7f0e9807a430 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.441+0000 7f0eb1f3d640 1 --2- 172.21.15.90:0/1475203360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0eac0cdb90 0x7f0eac13f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.441+0000 7f0eb1f3d640 1 --2- 172.21.15.90:0/1475203360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0eac15f750 0x7f0eac13f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.441+0000 7f0eb1f3d640 1 --2- 172.21.15.90:0/1475203360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0eac06f550 0x7f0eac152650 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.441+0000 7f0eb1f3d640 1 -- 172.21.15.90:0/1475203360 >> 172.21.15.90:0/1475203360 conn(0x7f0eac0b19c0 msgr2=0x7f0eac0cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.441+0000 7f0eb1f3d640 1 -- 172.21.15.90:0/1475203360 shutdown_connections 2024-09-10T23:16:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.441+0000 7f0eb1f3d640 1 -- 172.21.15.90:0/1475203360 wait complete. 2024-09-10T23:16:50.536 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:16:50.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.638+0000 7f669fc85640 1 -- 172.21.15.90:0/3359748871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66980d16f0 msgr2=0x7f66980d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.638+0000 7f669fc85640 1 --2- 172.21.15.90:0/3359748871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66980d16f0 0x7f66980d0fc0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f669808e8c0 tx=0x7f668c02a4d0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.638+0000 7f669fc85640 1 -- 172.21.15.90:0/3359748871 shutdown_connections 2024-09-10T23:16:50.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.638+0000 7f669fc85640 1 --2- 172.21.15.90:0/3359748871 >> v2:172.21.15.171:3300/0 conn(0x7f66980d4b80 0x7f669806d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.638+0000 7f669fc85640 1 --2- 172.21.15.90:0/3359748871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66980d16f0 0x7f66980d0fc0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.638+0000 7f669fc85640 1 --2- 172.21.15.90:0/3359748871 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f669815e310 0x7f66980d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.638+0000 7f669fc85640 1 -- 172.21.15.90:0/3359748871 >> 172.21.15.90:0/3359748871 conn(0x7f66980d4090 msgr2=0x7f66980d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:50.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.638+0000 7f669fc85640 1 -- 172.21.15.90:0/3359748871 shutdown_connections 2024-09-10T23:16:50.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.638+0000 7f669fc85640 1 -- 172.21.15.90:0/3359748871 wait complete. 2024-09-10T23:16:50.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.639+0000 7f669fc85640 1 Processor -- start 2024-09-10T23:16:50.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.639+0000 7f669fc85640 1 -- start start 2024-09-10T23:16:50.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.640+0000 7f669fc85640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66980d16f0 0x7f669815e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:50.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.640+0000 7f669fc85640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66980d4b80 0x7f66981f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:50.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.640+0000 7f669fc85640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f669815e310 0x7f66980cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:50.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.640+0000 7f669fc85640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f669806dfc0 con 0x7f66980d16f0 2024-09-10T23:16:50.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.640+0000 7f669fc85640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f669806de40 con 0x7f669815e310 2024-09-10T23:16:50.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.640+0000 7f669fc85640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f669806e140 con 0x7f66980d4b80 2024-09-10T23:16:50.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.640+0000 7f669da21640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66980d16f0 0x7f669815e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:50.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.640+0000 7f669da21640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66980d16f0 0x7f669815e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59746/0 (socket says 172.21.15.90:59746) 2024-09-10T23:16:50.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.640+0000 7f669da21640 1 -- 172.21.15.90:0/2360278372 learned_addr learned my addr 172.21.15.90:0/2360278372 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:50.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.641+0000 7f669da21640 1 -- 172.21.15.90:0/2360278372 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66980d4b80 msgr2=0x7f66981f4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.641+0000 7f669da21640 1 --2- 172.21.15.90:0/2360278372 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66980d4b80 0x7f66981f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.641+0000 7f669da21640 1 -- 172.21.15.90:0/2360278372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f669815e310 msgr2=0x7f66980cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.641+0000 7f669da21640 1 --2- 172.21.15.90:0/2360278372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f669815e310 0x7f66980cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.641+0000 7f669da21640 1 -- 172.21.15.90:0/2360278372 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669815b700 con 0x7f66980d16f0 2024-09-10T23:16:50.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.641+0000 7f669da21640 1 --2- 172.21.15.90:0/2360278372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66980d16f0 0x7f669815e900 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f668800ea20 tx=0x7f668800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:50.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.641+0000 7f66967fc640 1 -- 172.21.15.90:0/2360278372 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668800cde0 con 0x7f66980d16f0 2024-09-10T23:16:50.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.641+0000 7f66967fc640 1 -- 172.21.15.90:0/2360278372 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6688011560 con 0x7f66980d16f0 2024-09-10T23:16:50.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.641+0000 7f669fc85640 1 -- 172.21.15.90:0/2360278372 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f669815b9e0 con 0x7f66980d16f0 2024-09-10T23:16:50.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.641+0000 7f66967fc640 1 -- 172.21.15.90:0/2360278372 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6688011990 con 0x7f66980d16f0 2024-09-10T23:16:50.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.641+0000 7f669fc85640 1 -- 172.21.15.90:0/2360278372 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66980cb200 con 0x7f66980d16f0 2024-09-10T23:16:50.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.642+0000 7f669fc85640 1 -- 172.21.15.90:0/2360278372 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f669806d6f0 con 0x7f66980d16f0 2024-09-10T23:16:50.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.642+0000 7f66967fc640 1 -- 172.21.15.90:0/2360278372 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6688022030 con 0x7f66980d16f0 2024-09-10T23:16:50.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.643+0000 7f66967fc640 1 --2- 172.21.15.90:0/2360278372 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6684077f70 0x7f668407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:50.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.643+0000 7f66967fc640 1 -- 172.21.15.90:0/2360278372 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f668809a6d0 con 0x7f66980d16f0 2024-09-10T23:16:50.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.644+0000 7f669d220640 1 --2- 172.21.15.90:0/2360278372 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6684077f70 0x7f668407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:50.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.644+0000 7f669d220640 1 --2- 172.21.15.90:0/2360278372 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6684077f70 0x7f668407a430 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f668c033000 tx=0x7f668c0046c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:50.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.648+0000 7f66967fc640 1 -- 172.21.15.90:0/2360278372 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6688016030 con 0x7f66980d16f0 2024-09-10T23:16:50.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.823+0000 7f669fc85640 1 -- 172.21.15.90:0/2360278372 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66980b65d0 con 0x7f66980d16f0 2024-09-10T23:16:50.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.824+0000 7f66967fc640 1 -- 172.21.15.90:0/2360278372 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16725 (secure 0 0 0) 0x7f66880631d0 con 0x7f66980d16f0 2024-09-10T23:16:50.825 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:50.826 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":57,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:16:09.203144+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:16:06.175987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-10T23:16:06.532476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:16:50.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.827+0000 7f669fc85640 1 -- 172.21.15.90:0/2360278372 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6684077f70 msgr2=0x7f668407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.827+0000 7f669fc85640 1 --2- 172.21.15.90:0/2360278372 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6684077f70 0x7f668407a430 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f668c033000 tx=0x7f668c0046c0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.827+0000 7f669fc85640 1 -- 172.21.15.90:0/2360278372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66980d16f0 msgr2=0x7f669815e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.827+0000 7f669fc85640 1 --2- 172.21.15.90:0/2360278372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66980d16f0 0x7f669815e900 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f668800ea20 tx=0x7f668800eee0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.827+0000 7f669fc85640 1 -- 172.21.15.90:0/2360278372 shutdown_connections 2024-09-10T23:16:50.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.827+0000 7f669fc85640 1 --2- 172.21.15.90:0/2360278372 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6684077f70 0x7f668407a430 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.827+0000 7f669fc85640 1 --2- 172.21.15.90:0/2360278372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f669815e310 0x7f66980cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.827+0000 7f669fc85640 1 --2- 172.21.15.90:0/2360278372 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66980d4b80 0x7f66981f4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.827+0000 7f669fc85640 1 --2- 172.21.15.90:0/2360278372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66980d16f0 0x7f669815e900 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.827+0000 7f669fc85640 1 -- 172.21.15.90:0/2360278372 >> 172.21.15.90:0/2360278372 conn(0x7f66980d4090 msgr2=0x7f66980b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:50.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.827+0000 7f669fc85640 1 -- 172.21.15.90:0/2360278372 shutdown_connections 2024-09-10T23:16:50.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.827+0000 7f669fc85640 1 -- 172.21.15.90:0/2360278372 wait complete. 2024-09-10T23:16:50.838 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:16:50.838 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:50.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.938+0000 7f56a97a3640 1 -- 172.21.15.90:0/263907643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f568c004800 msgr2=0x7f568c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.938+0000 7f56a97a3640 1 --2- 172.21.15.90:0/263907643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f568c004800 0x7f568c004c80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f56980016c0 tx=0x7f568c005830 comp rx=0 tx=0).stop 2024-09-10T23:16:50.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.938+0000 7f56a37fe640 1 -- 172.21.15.90:0/263907643 reap_dead start 2024-09-10T23:16:50.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.938+0000 7f56a97a3640 1 -- 172.21.15.90:0/263907643 shutdown_connections 2024-09-10T23:16:50.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.938+0000 7f56a97a3640 1 -- 172.21.15.90:0/263907643 >> 172.21.15.90:0/263907643 conn(0x7f56a40d4090 msgr2=0x7f56a40d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:50.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.939+0000 7f56a97a3640 1 -- 172.21.15.90:0/263907643 shutdown_connections 2024-09-10T23:16:50.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.939+0000 7f56a97a3640 1 -- 172.21.15.90:0/263907643 wait complete. 2024-09-10T23:16:50.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.940+0000 7f56a97a3640 1 Processor -- start 2024-09-10T23:16:50.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.940+0000 7f56a97a3640 1 -- start start 2024-09-10T23:16:50.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a97a3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f568c004800 0x7f56a40c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:50.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a97a3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56a40cc380 0x7f56a40cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:50.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a97a3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56a414fe30 0x7f56a40ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:50.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a97a3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56a406d850 con 0x7f56a414fe30 2024-09-10T23:16:50.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a97a3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f56a406d6d0 con 0x7f568c004800 2024-09-10T23:16:50.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a97a3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f56a406d9d0 con 0x7f56a40cc380 2024-09-10T23:16:50.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56a414fe30 0x7f56a40ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:50.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56a414fe30 0x7f56a40ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59768/0 (socket says 172.21.15.90:59768) 2024-09-10T23:16:50.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a37fe640 1 -- 172.21.15.90:0/86484099 learned_addr learned my addr 172.21.15.90:0/86484099 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:50.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a2ffd640 1 --2- 172.21.15.90:0/86484099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f568c004800 0x7f56a40c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:50.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a27fc640 1 --2- 172.21.15.90:0/86484099 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56a40cc380 0x7f56a40cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:50.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a37fe640 1 -- 172.21.15.90:0/86484099 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56a40cc380 msgr2=0x7f56a40cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a37fe640 1 --2- 172.21.15.90:0/86484099 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56a40cc380 0x7f56a40cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a37fe640 1 -- 172.21.15.90:0/86484099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f568c004800 msgr2=0x7f56a40c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a37fe640 1 --2- 172.21.15.90:0/86484099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f568c004800 0x7f56a40c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a37fe640 1 -- 172.21.15.90:0/86484099 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a40c8100 con 0x7f56a414fe30 2024-09-10T23:16:50.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a2ffd640 1 --2- 172.21.15.90:0/86484099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f568c004800 0x7f56a40c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:50.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a37fe640 1 --2- 172.21.15.90:0/86484099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56a414fe30 0x7f56a40ca2c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f569c005fd0 tx=0x7f569c00fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:50.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f568b7fe640 1 -- 172.21.15.90:0/86484099 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c015070 con 0x7f56a414fe30 2024-09-10T23:16:50.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f568b7fe640 1 -- 172.21.15.90:0/86484099 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f569c004b20 con 0x7f56a414fe30 2024-09-10T23:16:50.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a97a3640 1 -- 172.21.15.90:0/86484099 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56a41f53e0 con 0x7f56a414fe30 2024-09-10T23:16:50.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f568b7fe640 1 -- 172.21.15.90:0/86484099 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c00d8c0 con 0x7f56a414fe30 2024-09-10T23:16:50.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.941+0000 7f56a97a3640 1 -- 172.21.15.90:0/86484099 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56a41f59a0 con 0x7f56a414fe30 2024-09-10T23:16:50.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.942+0000 7f56a97a3640 1 -- 172.21.15.90:0/86484099 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56a40cf180 con 0x7f56a414fe30 2024-09-10T23:16:50.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.943+0000 7f568b7fe640 1 -- 172.21.15.90:0/86484099 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f569c00c070 con 0x7f56a414fe30 2024-09-10T23:16:50.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.943+0000 7f568b7fe640 1 --2- 172.21.15.90:0/86484099 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5690077f70 0x7f569007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:50.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.943+0000 7f568b7fe640 1 -- 172.21.15.90:0/86484099 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f569c09a270 con 0x7f56a414fe30 2024-09-10T23:16:50.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.944+0000 7f56a2ffd640 1 --2- 172.21.15.90:0/86484099 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5690077f70 0x7f569007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:50.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.944+0000 7f56a2ffd640 1 --2- 172.21.15.90:0/86484099 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5690077f70 0x7f569007a430 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5694006d30 tx=0x7f5694001590 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:50.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:50.947+0000 7f568b7fe640 1 -- 172.21.15.90:0/86484099 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f569c062e00 con 0x7f56a414fe30 2024-09-10T23:16:51.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.154+0000 7f56a97a3640 1 -- 172.21.15.90:0/86484099 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56a408e130 con 0x7f56a414fe30 2024-09-10T23:16:51.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.155+0000 7f568b7fe640 1 -- 172.21.15.90:0/86484099 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5249 (secure 0 0 0) 0x7f569c062700 con 0x7f56a414fe30 2024-09-10T23:16:51.156 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:51.156 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"btime":"2024-09-10T23:16:34:728656+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3624303902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3624303902},{"type":"v1","addr":"172.21.15.171:6837","nonce":3624303902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1743356090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1743356090},{"type":"v1","addr":"172.21.15.171:6836","nonce":1743356090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:16:07.583350+0000","modified":"2024-09-10T23:16:34.490056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5556,"mds_1":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":1,"incarnation":29,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6833/2007304013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2007304013},{"type":"v1","addr":"172.21.15.90:6833","nonce":2007304013}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5556":{"gid":5556,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/1708086583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1708086583},{"type":"v1","addr":"172.21.15.90:6835","nonce":1708086583}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5556,"qdb_cluster":[5556,5553]},"id":4}]} 2024-09-10T23:16:51.156 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 31 2024-09-10T23:16:51.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.157+0000 7f56a97a3640 1 -- 172.21.15.90:0/86484099 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5690077f70 msgr2=0x7f569007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.157+0000 7f56a97a3640 1 --2- 172.21.15.90:0/86484099 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5690077f70 0x7f569007a430 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5694006d30 tx=0x7f5694001590 comp rx=0 tx=0).stop 2024-09-10T23:16:51.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.157+0000 7f56a97a3640 1 -- 172.21.15.90:0/86484099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56a414fe30 msgr2=0x7f56a40ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.157+0000 7f56a97a3640 1 --2- 172.21.15.90:0/86484099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56a414fe30 0x7f56a40ca2c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f569c005fd0 tx=0x7f569c00fd90 comp rx=0 tx=0).stop 2024-09-10T23:16:51.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.157+0000 7f56a97a3640 1 -- 172.21.15.90:0/86484099 shutdown_connections 2024-09-10T23:16:51.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.157+0000 7f56a97a3640 1 --2- 172.21.15.90:0/86484099 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5690077f70 0x7f569007a430 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.157+0000 7f56a97a3640 1 --2- 172.21.15.90:0/86484099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56a414fe30 0x7f56a40ca2c0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.157+0000 7f56a97a3640 1 --2- 172.21.15.90:0/86484099 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56a40cc380 0x7f56a40cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.157+0000 7f56a97a3640 1 --2- 172.21.15.90:0/86484099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f568c004800 0x7f56a40c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.157+0000 7f56a97a3640 1 -- 172.21.15.90:0/86484099 >> 172.21.15.90:0/86484099 conn(0x7f56a40d4090 msgr2=0x7f56a40b7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:51.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.157+0000 7f56a97a3640 1 -- 172.21.15.90:0/86484099 shutdown_connections 2024-09-10T23:16:51.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.157+0000 7f56a97a3640 1 -- 172.21.15.90:0/86484099 wait complete. 2024-09-10T23:16:51.168 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:51.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.269+0000 7f597e2ef640 1 -- 172.21.15.90:0/4025753838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59780b44a0 msgr2=0x7f59780b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.269+0000 7f597e2ef640 1 --2- 172.21.15.90:0/4025753838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59780b44a0 0x7f59780b4880 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f59780cda30 tx=0x7f596802b7f0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.269+0000 7f597e2ef640 1 -- 172.21.15.90:0/4025753838 shutdown_connections 2024-09-10T23:16:51.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.269+0000 7f597e2ef640 1 --2- 172.21.15.90:0/4025753838 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59780cd470 0x7f597815e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.269+0000 7f597e2ef640 1 --2- 172.21.15.90:0/4025753838 >> v2:172.21.15.171:3300/0 conn(0x7f59780cf860 0x7f597815e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.269+0000 7f597e2ef640 1 --2- 172.21.15.90:0/4025753838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59780b44a0 0x7f59780b4880 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.269+0000 7f597e2ef640 1 -- 172.21.15.90:0/4025753838 >> 172.21.15.90:0/4025753838 conn(0x7f59780b19c0 msgr2=0x7f59780b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:51.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.269+0000 7f597e2ef640 1 -- 172.21.15.90:0/4025753838 shutdown_connections 2024-09-10T23:16:51.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.269+0000 7f597e2ef640 1 -- 172.21.15.90:0/4025753838 wait complete. 2024-09-10T23:16:51.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.270+0000 7f597e2ef640 1 Processor -- start 2024-09-10T23:16:51.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.270+0000 7f597e2ef640 1 -- start start 2024-09-10T23:16:51.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.271+0000 7f597e2ef640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59780b44a0 0x7f59781f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.271+0000 7f597e2ef640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59780cd470 0x7f5978156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.271+0000 7f597e2ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59780cf860 0x7f59780c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.271+0000 7f597e2ef640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f597806e870 con 0x7f59780cf860 2024-09-10T23:16:51.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.271+0000 7f597e2ef640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f597806e6f0 con 0x7f59780cd470 2024-09-10T23:16:51.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.271+0000 7f597e2ef640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f597815a8c0 con 0x7f59780b44a0 2024-09-10T23:16:51.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.271+0000 7f597c88c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59780cf860 0x7f59780c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.271+0000 7f597c88c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59780cf860 0x7f59780c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59788/0 (socket says 172.21.15.90:59788) 2024-09-10T23:16:51.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.271+0000 7f597c88c640 1 -- 172.21.15.90:0/3902966305 learned_addr learned my addr 172.21.15.90:0/3902966305 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:51.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.271+0000 7f5977fff640 1 --2- 172.21.15.90:0/3902966305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59780b44a0 0x7f59781f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.271+0000 7f59777fe640 1 --2- 172.21.15.90:0/3902966305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59780cd470 0x7f5978156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.271+0000 7f597c88c640 1 -- 172.21.15.90:0/3902966305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59780b44a0 msgr2=0x7f59781f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.271+0000 7f597c88c640 1 --2- 172.21.15.90:0/3902966305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59780b44a0 0x7f59781f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.271+0000 7f597c88c640 1 -- 172.21.15.90:0/3902966305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59780cd470 msgr2=0x7f5978156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.271+0000 7f597c88c640 1 --2- 172.21.15.90:0/3902966305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59780cd470 0x7f5978156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.271+0000 7f597c88c640 1 -- 172.21.15.90:0/3902966305 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5978155fd0 con 0x7f59780cf860 2024-09-10T23:16:51.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.271+0000 7f597c88c640 1 --2- 172.21.15.90:0/3902966305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59780cf860 0x7f59780c9040 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f597000e980 tx=0x7f597000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:51.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.272+0000 7f5974ff9640 1 -- 172.21.15.90:0/3902966305 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970004d20 con 0x7f59780cf860 2024-09-10T23:16:51.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.272+0000 7f5974ff9640 1 -- 172.21.15.90:0/3902966305 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f597000cac0 con 0x7f59780cf860 2024-09-10T23:16:51.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.272+0000 7f5974ff9640 1 -- 172.21.15.90:0/3902966305 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970005020 con 0x7f59780cf860 2024-09-10T23:16:51.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.272+0000 7f597e2ef640 1 -- 172.21.15.90:0/3902966305 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59781f5210 con 0x7f59780cf860 2024-09-10T23:16:51.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.272+0000 7f597e2ef640 1 -- 172.21.15.90:0/3902966305 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59781f5ab0 con 0x7f59780cf860 2024-09-10T23:16:51.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.273+0000 7f597e2ef640 1 -- 172.21.15.90:0/3902966305 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f597815edc0 con 0x7f59780cf860 2024-09-10T23:16:51.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.273+0000 7f5974ff9640 1 -- 172.21.15.90:0/3902966305 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f597000f040 con 0x7f59780cf860 2024-09-10T23:16:51.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.274+0000 7f5974ff9640 1 --2- 172.21.15.90:0/3902966305 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5964077f70 0x7f596407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.274+0000 7f5974ff9640 1 -- 172.21.15.90:0/3902966305 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f597009a1f0 con 0x7f59780cf860 2024-09-10T23:16:51.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.274+0000 7f5977fff640 1 --2- 172.21.15.90:0/3902966305 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5964077f70 0x7f596407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.275+0000 7f5977fff640 1 --2- 172.21.15.90:0/3902966305 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5964077f70 0x7f596407a430 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5968035000 tx=0x7f5968004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:51.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.278+0000 7f5974ff9640 1 -- 172.21.15.90:0/3902966305 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5970016030 con 0x7f59780cf860 2024-09-10T23:16:51.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.487+0000 7f597e2ef640 1 -- 172.21.15.90:0/3902966305 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59780cc480 con 0x7f59780cf860 2024-09-10T23:16:51.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.488+0000 7f5974ff9640 1 -- 172.21.15.90:0/3902966305 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5249 (secure 0 0 0) 0x7f5970062730 con 0x7f59780cf860 2024-09-10T23:16:51.489 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:51.489 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"btime":"2024-09-10T23:16:34:728656+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3624303902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3624303902},{"type":"v1","addr":"172.21.15.171:6837","nonce":3624303902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1743356090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1743356090},{"type":"v1","addr":"172.21.15.171:6836","nonce":1743356090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:16:07.583350+0000","modified":"2024-09-10T23:16:34.490056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5556,"mds_1":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"a","rank":1,"incarnation":29,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6833/2007304013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2007304013},{"type":"v1","addr":"172.21.15.90:6833","nonce":2007304013}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5556":{"gid":5556,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/1708086583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1708086583},{"type":"v1","addr":"172.21.15.90:6835","nonce":1708086583}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5556,"qdb_cluster":[5556,5553]},"id":4}]} 2024-09-10T23:16:51.489 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 31 2024-09-10T23:16:51.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.490+0000 7f597e2ef640 1 -- 172.21.15.90:0/3902966305 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5964077f70 msgr2=0x7f596407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.490+0000 7f597e2ef640 1 --2- 172.21.15.90:0/3902966305 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5964077f70 0x7f596407a430 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5968035000 tx=0x7f5968004730 comp rx=0 tx=0).stop 2024-09-10T23:16:51.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.490+0000 7f597e2ef640 1 -- 172.21.15.90:0/3902966305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59780cf860 msgr2=0x7f59780c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.490+0000 7f597e2ef640 1 --2- 172.21.15.90:0/3902966305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59780cf860 0x7f59780c9040 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f597000e980 tx=0x7f597000ee40 comp rx=0 tx=0).stop 2024-09-10T23:16:51.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.490+0000 7f597e2ef640 1 -- 172.21.15.90:0/3902966305 shutdown_connections 2024-09-10T23:16:51.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.490+0000 7f597e2ef640 1 --2- 172.21.15.90:0/3902966305 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5964077f70 0x7f596407a430 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.490+0000 7f597e2ef640 1 --2- 172.21.15.90:0/3902966305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59780cd470 0x7f5978156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.490+0000 7f597e2ef640 1 --2- 172.21.15.90:0/3902966305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59780cf860 0x7f59780c9040 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.490+0000 7f597e2ef640 1 --2- 172.21.15.90:0/3902966305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59780b44a0 0x7f59781f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.490+0000 7f597e2ef640 1 -- 172.21.15.90:0/3902966305 >> 172.21.15.90:0/3902966305 conn(0x7f59780b19c0 msgr2=0x7f59780ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:51.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.490+0000 7f597e2ef640 1 -- 172.21.15.90:0/3902966305 shutdown_connections 2024-09-10T23:16:51.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.490+0000 7f597e2ef640 1 -- 172.21.15.90:0/3902966305 wait complete. 2024-09-10T23:16:51.502 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:16:51.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.602+0000 7fb1da4b6640 1 -- 172.21.15.90:0/3550610588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d415f750 msgr2=0x7fb1d4073de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.602+0000 7fb1da4b6640 1 --2- 172.21.15.90:0/3550610588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d415f750 0x7fb1d4073de0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4005fd0 tx=0x7fb1c402a530 comp rx=0 tx=0).stop 2024-09-10T23:16:51.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.602+0000 7fb1da4b6640 1 -- 172.21.15.90:0/3550610588 shutdown_connections 2024-09-10T23:16:51.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.602+0000 7fb1da4b6640 1 --2- 172.21.15.90:0/3550610588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1d406fc60 0x7fb1d40cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.602+0000 7fb1da4b6640 1 --2- 172.21.15.90:0/3550610588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d415f750 0x7fb1d4073de0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.602+0000 7fb1da4b6640 1 -- 172.21.15.90:0/3550610588 >> 172.21.15.90:0/3550610588 conn(0x7fb1d40b19c0 msgr2=0x7fb1d40b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:51.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.602+0000 7fb1da4b6640 1 -- 172.21.15.90:0/3550610588 shutdown_connections 2024-09-10T23:16:51.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.602+0000 7fb1da4b6640 1 -- 172.21.15.90:0/3550610588 wait complete. 2024-09-10T23:16:51.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.603+0000 7fb1da4b6640 1 Processor -- start 2024-09-10T23:16:51.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.603+0000 7fb1da4b6640 1 -- start start 2024-09-10T23:16:51.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.604+0000 7fb1da4b6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d406fc60 0x7fb1d4153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.604+0000 7fb1da4b6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1d40cdb90 0x7fb1d41e7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.604+0000 7fb1da4b6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1d415f750 0x7fb1d41e8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.604+0000 7fb1da4b6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d40cc940 con 0x7fb1d406fc60 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.604+0000 7fb1da4b6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d40cc7c0 con 0x7fb1d415f750 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.604+0000 7fb1da4b6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d40ccac0 con 0x7fb1d40cdb90 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.604+0000 7fb1d3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d406fc60 0x7fb1d4153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.604+0000 7fb1d3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d406fc60 0x7fb1d4153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59816/0 (socket says 172.21.15.90:59816) 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.604+0000 7fb1d3fff640 1 -- 172.21.15.90:0/574607602 learned_addr learned my addr 172.21.15.90:0/574607602 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.604+0000 7fb1d8a53640 1 --2- 172.21.15.90:0/574607602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1d415f750 0x7fb1d41e8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.604+0000 7fb1d37fe640 1 --2- 172.21.15.90:0/574607602 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1d40cdb90 0x7fb1d41e7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.605+0000 7fb1d3fff640 1 -- 172.21.15.90:0/574607602 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1d40cdb90 msgr2=0x7fb1d41e7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.605+0000 7fb1d3fff640 1 --2- 172.21.15.90:0/574607602 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1d40cdb90 0x7fb1d41e7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.605+0000 7fb1d3fff640 1 -- 172.21.15.90:0/574607602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1d415f750 msgr2=0x7fb1d41e8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.605+0000 7fb1d3fff640 1 --2- 172.21.15.90:0/574607602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1d415f750 0x7fb1d41e8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.605+0000 7fb1d3fff640 1 -- 172.21.15.90:0/574607602 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d409da90 con 0x7fb1d406fc60 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.605+0000 7fb1d8a53640 1 --2- 172.21.15.90:0/574607602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1d415f750 0x7fb1d41e8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:51.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.605+0000 7fb1d3fff640 1 --2- 172.21.15.90:0/574607602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d406fc60 0x7fb1d4153ec0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4034040 tx=0x7fb1c40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:51.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.605+0000 7fb1d0ff9640 1 -- 172.21.15.90:0/574607602 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c403e030 con 0x7fb1d406fc60 2024-09-10T23:16:51.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.605+0000 7fb1d0ff9640 1 -- 172.21.15.90:0/574607602 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1c4003d90 con 0x7fb1d406fc60 2024-09-10T23:16:51.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.605+0000 7fb1da4b6640 1 -- 172.21.15.90:0/574607602 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d41e63e0 con 0x7fb1d406fc60 2024-09-10T23:16:51.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.605+0000 7fb1d0ff9640 1 -- 172.21.15.90:0/574607602 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4035040 con 0x7fb1d406fc60 2024-09-10T23:16:51.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.605+0000 7fb1da4b6640 1 -- 172.21.15.90:0/574607602 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d41e69a0 con 0x7fb1d406fc60 2024-09-10T23:16:51.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.606+0000 7fb1da4b6640 1 -- 172.21.15.90:0/574607602 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d40af160 con 0x7fb1d406fc60 2024-09-10T23:16:51.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.607+0000 7fb1d0ff9640 1 -- 172.21.15.90:0/574607602 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb1c40049e0 con 0x7fb1d406fc60 2024-09-10T23:16:51.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.607+0000 7fb1d0ff9640 1 --2- 172.21.15.90:0/574607602 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb1c0077fa0 0x7fb1c007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.607+0000 7fb1d0ff9640 1 -- 172.21.15.90:0/574607602 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fb1c40ba920 con 0x7fb1d406fc60 2024-09-10T23:16:51.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.607+0000 7fb1d37fe640 1 --2- 172.21.15.90:0/574607602 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb1c0077fa0 0x7fb1c007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.608+0000 7fb1d37fe640 1 --2- 172.21.15.90:0/574607602 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb1c0077fa0 0x7fb1c007a460 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb1d41e9820 tx=0x7fb1c8007e30 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:51.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.611+0000 7fb1d0ff9640 1 -- 172.21.15.90:0/574607602 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb1c4082dd0 con 0x7fb1d406fc60 2024-09-10T23:16:51.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.787+0000 7fb1da4b6640 1 -- 172.21.15.90:0/574607602 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1d40b26e0 con 0x7fb1d406fc60 2024-09-10T23:16:51.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.788+0000 7fb1d0ff9640 1 -- 172.21.15.90:0/574607602 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16725 (secure 0 0 0) 0x7fb1c4087800 con 0x7fb1d406fc60 2024-09-10T23:16:51.789 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:51.789 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":57,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:16:09.203144+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:16:06.175987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-10T23:16:06.532476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:16:51.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.790+0000 7fb1da4b6640 1 -- 172.21.15.90:0/574607602 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb1c0077fa0 msgr2=0x7fb1c007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.790+0000 7fb1da4b6640 1 --2- 172.21.15.90:0/574607602 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb1c0077fa0 0x7fb1c007a460 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb1d41e9820 tx=0x7fb1c8007e30 comp rx=0 tx=0).stop 2024-09-10T23:16:51.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.790+0000 7fb1da4b6640 1 -- 172.21.15.90:0/574607602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d406fc60 msgr2=0x7fb1d4153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.790+0000 7fb1da4b6640 1 --2- 172.21.15.90:0/574607602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d406fc60 0x7fb1d4153ec0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4034040 tx=0x7fb1c40038a0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.790+0000 7fb1da4b6640 1 -- 172.21.15.90:0/574607602 shutdown_connections 2024-09-10T23:16:51.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.790+0000 7fb1da4b6640 1 --2- 172.21.15.90:0/574607602 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb1c0077fa0 0x7fb1c007a460 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.790+0000 7fb1da4b6640 1 --2- 172.21.15.90:0/574607602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1d415f750 0x7fb1d41e8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.790+0000 7fb1da4b6640 1 --2- 172.21.15.90:0/574607602 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1d40cdb90 0x7fb1d41e7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.790+0000 7fb1da4b6640 1 --2- 172.21.15.90:0/574607602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d406fc60 0x7fb1d4153ec0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.790+0000 7fb1da4b6640 1 -- 172.21.15.90:0/574607602 >> 172.21.15.90:0/574607602 conn(0x7fb1d40b19c0 msgr2=0x7fb1d415fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:51.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.790+0000 7fb1da4b6640 1 -- 172.21.15.90:0/574607602 shutdown_connections 2024-09-10T23:16:51.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.790+0000 7fb1da4b6640 1 -- 172.21.15.90:0/574607602 wait complete. 2024-09-10T23:16:51.802 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:16:51.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.903+0000 7fe67fd53640 1 -- 172.21.15.90:0/1607355805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67815e310 msgr2=0x7fe6780d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.903+0000 7fe67fd53640 1 --2- 172.21.15.90:0/1607355805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67815e310 0x7fe6780d0a80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe674009830 tx=0x7fe67402a480 comp rx=0 tx=0).stop 2024-09-10T23:16:51.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.903+0000 7fe67fd53640 1 -- 172.21.15.90:0/1607355805 shutdown_connections 2024-09-10T23:16:51.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.903+0000 7fe67fd53640 1 --2- 172.21.15.90:0/1607355805 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6780d16f0 0x7fe6780d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.903+0000 7fe67fd53640 1 --2- 172.21.15.90:0/1607355805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67815e310 0x7fe6780d0a80 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.903+0000 7fe67fd53640 1 -- 172.21.15.90:0/1607355805 >> 172.21.15.90:0/1607355805 conn(0x7fe6780d4090 msgr2=0x7fe6780d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:51.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.903+0000 7fe67fd53640 1 -- 172.21.15.90:0/1607355805 shutdown_connections 2024-09-10T23:16:51.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.903+0000 7fe67fd53640 1 -- 172.21.15.90:0/1607355805 wait complete. 2024-09-10T23:16:51.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.905+0000 7fe67fd53640 1 Processor -- start 2024-09-10T23:16:51.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.905+0000 7fe67fd53640 1 -- start start 2024-09-10T23:16:51.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.905+0000 7fe67fd53640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6780d16f0 0x7fe6780c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.905+0000 7fe67fd53640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6780d4b80 0x7fe6781f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.905+0000 7fe67fd53640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67815e310 0x7fe6780c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.905+0000 7fe67fd53640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe67806de00 con 0x7fe67815e310 2024-09-10T23:16:51.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.905+0000 7fe67fd53640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe6780d3ae0 con 0x7fe6780d16f0 2024-09-10T23:16:51.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.905+0000 7fe67fd53640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe67806df80 con 0x7fe6780d4b80 2024-09-10T23:16:51.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.906+0000 7fe67e2f0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67815e310 0x7fe6780c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.906+0000 7fe67e2f0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67815e310 0x7fe6780c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59838/0 (socket says 172.21.15.90:59838) 2024-09-10T23:16:51.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.906+0000 7fe67e2f0640 1 -- 172.21.15.90:0/2927082018 learned_addr learned my addr 172.21.15.90:0/2927082018 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:51.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.906+0000 7fe67d2ee640 1 --2- 172.21.15.90:0/2927082018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6780d4b80 0x7fe6781f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.906+0000 7fe67e2f0640 1 -- 172.21.15.90:0/2927082018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6780d4b80 msgr2=0x7fe6781f4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.906+0000 7fe67e2f0640 1 --2- 172.21.15.90:0/2927082018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6780d4b80 0x7fe6781f4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.906+0000 7fe67e2f0640 1 -- 172.21.15.90:0/2927082018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6780d16f0 msgr2=0x7fe6780c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.906+0000 7fe67e2f0640 1 --2- 172.21.15.90:0/2927082018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6780d16f0 0x7fe6780c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.906+0000 7fe67e2f0640 1 -- 172.21.15.90:0/2927082018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6780c96d0 con 0x7fe67815e310 2024-09-10T23:16:51.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.906+0000 7fe67e2f0640 1 --2- 172.21.15.90:0/2927082018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67815e310 0x7fe6780c8d80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe67000cbc0 tx=0x7fe67000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:51.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.906+0000 7fe66e7fc640 1 -- 172.21.15.90:0/2927082018 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670016020 con 0x7fe67815e310 2024-09-10T23:16:51.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.906+0000 7fe66e7fc640 1 -- 172.21.15.90:0/2927082018 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe67000ae30 con 0x7fe67815e310 2024-09-10T23:16:51.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.906+0000 7fe67fd53640 1 -- 172.21.15.90:0/2927082018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6780c7cd0 con 0x7fe67815e310 2024-09-10T23:16:51.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.906+0000 7fe66e7fc640 1 -- 172.21.15.90:0/2927082018 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670012660 con 0x7fe67815e310 2024-09-10T23:16:51.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.906+0000 7fe67fd53640 1 -- 172.21.15.90:0/2927082018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6780c8290 con 0x7fe67815e310 2024-09-10T23:16:51.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.907+0000 7fe67fd53640 1 -- 172.21.15.90:0/2927082018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe67806e4a0 con 0x7fe67815e310 2024-09-10T23:16:51.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.908+0000 7fe66e7fc640 1 -- 172.21.15.90:0/2927082018 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe67001b400 con 0x7fe67815e310 2024-09-10T23:16:51.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.908+0000 7fe66e7fc640 1 --2- 172.21.15.90:0/2927082018 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe65c077f70 0x7fe65c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.908+0000 7fe66e7fc640 1 -- 172.21.15.90:0/2927082018 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fe67009a7e0 con 0x7fe67815e310 2024-09-10T23:16:51.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.908+0000 7fe67daef640 1 --2- 172.21.15.90:0/2927082018 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe65c077f70 0x7fe65c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.909+0000 7fe67daef640 1 --2- 172.21.15.90:0/2927082018 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe65c077f70 0x7fe65c07a430 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe674034000 tx=0x7fe6740046c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:51.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:51.912+0000 7fe66e7fc640 1 -- 172.21.15.90:0/2927082018 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe670020020 con 0x7fe67815e310 2024-09-10T23:16:52.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.121+0000 7fe67fd53640 1 -- 172.21.15.90:0/2927082018 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe6780c8460 con 0x7fe67815e310 2024-09-10T23:16:52.123 INFO:tasks.ceph.mon.a.smithi090.stderr:2024-09-10T23:16:52.122+0000 7f1a0c84c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:16:52.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.124+0000 7fe66e7fc640 1 -- 172.21.15.90:0/2927082018 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) ==== 161+0+0 (secure 0 0 0) 0x7fe670063250 con 0x7fe67815e310 2024-09-10T23:16:52.125 INFO:teuthology.orchestra.run.smithi090.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:16:52.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.127+0000 7fe67fd53640 1 -- 172.21.15.90:0/2927082018 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe65c077f70 msgr2=0x7fe65c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:52.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.127+0000 7fe67fd53640 1 --2- 172.21.15.90:0/2927082018 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe65c077f70 0x7fe65c07a430 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe674034000 tx=0x7fe6740046c0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.127+0000 7fe67fd53640 1 -- 172.21.15.90:0/2927082018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67815e310 msgr2=0x7fe6780c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:52.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.127+0000 7fe67fd53640 1 --2- 172.21.15.90:0/2927082018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67815e310 0x7fe6780c8d80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe67000cbc0 tx=0x7fe67000a430 comp rx=0 tx=0).stop 2024-09-10T23:16:52.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.128+0000 7fe67fd53640 1 -- 172.21.15.90:0/2927082018 shutdown_connections 2024-09-10T23:16:52.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.128+0000 7fe67fd53640 1 --2- 172.21.15.90:0/2927082018 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe65c077f70 0x7fe65c07a430 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.128+0000 7fe67fd53640 1 --2- 172.21.15.90:0/2927082018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67815e310 0x7fe6780c8d80 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.128+0000 7fe67fd53640 1 --2- 172.21.15.90:0/2927082018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6780d4b80 0x7fe6781f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.128+0000 7fe67fd53640 1 --2- 172.21.15.90:0/2927082018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6780d16f0 0x7fe6780c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.128+0000 7fe67fd53640 1 -- 172.21.15.90:0/2927082018 >> 172.21.15.90:0/2927082018 conn(0x7fe6780d4090 msgr2=0x7fe6780d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:52.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.128+0000 7fe67fd53640 1 -- 172.21.15.90:0/2927082018 shutdown_connections 2024-09-10T23:16:52.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.128+0000 7fe67fd53640 1 -- 172.21.15.90:0/2927082018 wait complete. 2024-09-10T23:16:52.141 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:16:52.163 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-09-10T23:16:52.164 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-09-10T23:16:52.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.244+0000 7f0354917640 1 -- 172.21.15.90:0/879836684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035015a1d0 msgr2=0x7f03500cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:52.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.245+0000 7f0354917640 1 --2- 172.21.15.90:0/879836684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035015a1d0 0x7f03500cdb90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f035015dc50 tx=0x7f034002a4d0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.245+0000 7f0354917640 1 -- 172.21.15.90:0/879836684 shutdown_connections 2024-09-10T23:16:52.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.245+0000 7f0354917640 1 --2- 172.21.15.90:0/879836684 >> v2:172.21.15.171:3300/0 conn(0x7f035006f860 0x7f035006fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.245+0000 7f0354917640 1 --2- 172.21.15.90:0/879836684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035015a1d0 0x7f03500cdb90 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.245+0000 7f0354917640 1 -- 172.21.15.90:0/879836684 >> 172.21.15.90:0/879836684 conn(0x7f03500b19c0 msgr2=0x7f03500b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:52.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.245+0000 7f0354917640 1 -- 172.21.15.90:0/879836684 shutdown_connections 2024-09-10T23:16:52.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.245+0000 7f0354917640 1 -- 172.21.15.90:0/879836684 wait complete. 2024-09-10T23:16:52.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.246+0000 7f0354917640 1 Processor -- start 2024-09-10T23:16:52.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.246+0000 7f0354917640 1 -- start start 2024-09-10T23:16:52.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f0354917640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f035006e6f0 0x7f03500c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:52.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f0354917640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035006f860 0x7f03500c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:52.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f0354917640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f035015a1d0 0x7f03501502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:52.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f0354917640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f035006f4d0 con 0x7f035006f860 2024-09-10T23:16:52.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f0354917640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0350070ac0 con 0x7f035006e6f0 2024-09-10T23:16:52.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f0354917640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f03500b4c70 con 0x7f035015a1d0 2024-09-10T23:16:52.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f034dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035006f860 0x7f03500c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:52.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f034dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035006f860 0x7f03500c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59886/0 (socket says 172.21.15.90:59886) 2024-09-10T23:16:52.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f034dd9b640 1 -- 172.21.15.90:0/1104569230 learned_addr learned my addr 172.21.15.90:0/1104569230 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:52.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f034e59c640 1 --2- 172.21.15.90:0/1104569230 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f035006e6f0 0x7f03500c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:52.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f034ed9d640 1 --2- 172.21.15.90:0/1104569230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f035015a1d0 0x7f03501502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:52.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f034dd9b640 1 -- 172.21.15.90:0/1104569230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f035015a1d0 msgr2=0x7f03501502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:52.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f034dd9b640 1 --2- 172.21.15.90:0/1104569230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f035015a1d0 0x7f03501502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f034dd9b640 1 -- 172.21.15.90:0/1104569230 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f035006e6f0 msgr2=0x7f03500c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:52.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f034dd9b640 1 --2- 172.21.15.90:0/1104569230 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f035006e6f0 0x7f03500c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f034dd9b640 1 -- 172.21.15.90:0/1104569230 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035015e650 con 0x7f035006f860 2024-09-10T23:16:52.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f034ed9d640 1 --2- 172.21.15.90:0/1104569230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f035015a1d0 0x7f03501502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:52.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f034dd9b640 1 --2- 172.21.15.90:0/1104569230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035006f860 0x7f03500c6970 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f034400c410 tx=0x7f034400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:52.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f033effd640 1 -- 172.21.15.90:0/1104569230 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0344017070 con 0x7f035006f860 2024-09-10T23:16:52.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f033effd640 1 -- 172.21.15.90:0/1104569230 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03440035f0 con 0x7f035006f860 2024-09-10T23:16:52.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f0354917640 1 -- 172.21.15.90:0/1104569230 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03500c4e80 con 0x7f035006f860 2024-09-10T23:16:52.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.247+0000 7f033effd640 1 -- 172.21.15.90:0/1104569230 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0344003a80 con 0x7f035006f860 2024-09-10T23:16:52.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.248+0000 7f0354917640 1 -- 172.21.15.90:0/1104569230 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03500c5440 con 0x7f035006f860 2024-09-10T23:16:52.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.249+0000 7f0354917640 1 -- 172.21.15.90:0/1104569230 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0350073ee0 con 0x7f035006f860 2024-09-10T23:16:52.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.249+0000 7f033effd640 1 -- 172.21.15.90:0/1104569230 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0344003c20 con 0x7f035006f860 2024-09-10T23:16:52.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.250+0000 7f033effd640 1 --2- 172.21.15.90:0/1104569230 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0330077f70 0x7f033007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:52.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.250+0000 7f033effd640 1 -- 172.21.15.90:0/1104569230 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5881+0+0 (secure 0 0 0) 0x7f03440993e0 con 0x7f035006f860 2024-09-10T23:16:52.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.250+0000 7f034e59c640 1 --2- 172.21.15.90:0/1104569230 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0330077f70 0x7f033007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:52.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.250+0000 7f034e59c640 1 --2- 172.21.15.90:0/1104569230 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0330077f70 0x7f033007a430 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0340033000 tx=0x7f0340004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:52.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.254+0000 7f033effd640 1 -- 172.21.15.90:0/1104569230 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0350073ee0 con 0x7f035006f860 2024-09-10T23:16:52.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:52.462+0000 7f0354917640 1 -- 172.21.15.90:0/1104569230 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f03500b3800 con 0x7f035006f860 2024-09-10T23:16:53.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.129+0000 7f033effd640 1 -- 172.21.15.90:0/1104569230 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) ==== 104+0+0 (secure 0 0 0) 0x7f03500b3800 con 0x7f035006f860 2024-09-10T23:16:53.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.132+0000 7f0354917640 1 -- 172.21.15.90:0/1104569230 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0330077f70 msgr2=0x7f033007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:53.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.132+0000 7f0354917640 1 --2- 172.21.15.90:0/1104569230 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0330077f70 0x7f033007a430 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0340033000 tx=0x7f0340004730 comp rx=0 tx=0).stop 2024-09-10T23:16:53.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.132+0000 7f0354917640 1 -- 172.21.15.90:0/1104569230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035006f860 msgr2=0x7f03500c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:53.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.132+0000 7f0354917640 1 --2- 172.21.15.90:0/1104569230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035006f860 0x7f03500c6970 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f034400c410 tx=0x7f034400c8d0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.132+0000 7f0354917640 1 -- 172.21.15.90:0/1104569230 shutdown_connections 2024-09-10T23:16:53.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.132+0000 7f0354917640 1 --2- 172.21.15.90:0/1104569230 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0330077f70 0x7f033007a430 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.132+0000 7f0354917640 1 --2- 172.21.15.90:0/1104569230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f035015a1d0 0x7f03501502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.132+0000 7f0354917640 1 --2- 172.21.15.90:0/1104569230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f035006f860 0x7f03500c6970 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.132+0000 7f0354917640 1 --2- 172.21.15.90:0/1104569230 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f035006e6f0 0x7f03500c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.132+0000 7f0354917640 1 -- 172.21.15.90:0/1104569230 >> 172.21.15.90:0/1104569230 conn(0x7f03500b19c0 msgr2=0x7f03500b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:53.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.132+0000 7f0354917640 1 -- 172.21.15.90:0/1104569230 shutdown_connections 2024-09-10T23:16:53.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.132+0000 7f0354917640 1 -- 172.21.15.90:0/1104569230 wait complete. 2024-09-10T23:16:53.146 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:16:53.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.294+0000 7f4ec6e7f640 1 -- 172.21.15.90:0/2031173962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4eb0003a30 msgr2=0x7f4eb0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:53.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.294+0000 7f4ec6e7f640 1 --2- 172.21.15.90:0/2031173962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4eb0003a30 0x7f4eb0003e50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4006fc0 tx=0x7f4eb0005830 comp rx=0 tx=0).stop 2024-09-10T23:16:53.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.294+0000 7f4ec541c640 1 -- 172.21.15.90:0/2031173962 reap_dead start 2024-09-10T23:16:53.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.294+0000 7f4ec6e7f640 1 -- 172.21.15.90:0/2031173962 shutdown_connections 2024-09-10T23:16:53.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.294+0000 7f4ec6e7f640 1 -- 172.21.15.90:0/2031173962 >> 172.21.15.90:0/2031173962 conn(0x7f4ec00b2b90 msgr2=0x7f4ec00b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:53.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.294+0000 7f4ec6e7f640 1 -- 172.21.15.90:0/2031173962 shutdown_connections 2024-09-10T23:16:53.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.294+0000 7f4ec6e7f640 1 -- 172.21.15.90:0/2031173962 wait complete. 2024-09-10T23:16:53.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.295+0000 7f4ec6e7f640 1 Processor -- start 2024-09-10T23:16:53.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.295+0000 7f4ec6e7f640 1 -- start start 2024-09-10T23:16:53.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.296+0000 7f4ec6e7f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4eb0003a30 0x7f4ec01e5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.296+0000 7f4ec6e7f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ec0145910 0x7f4ec009c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.296+0000 7f4ec6e7f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ec0146450 0x7f4ec015a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.296+0000 7f4ec6e7f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec00b07b0 con 0x7f4eb0003a30 2024-09-10T23:16:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.296+0000 7f4ec6e7f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec00b0630 con 0x7f4ec0145910 2024-09-10T23:16:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.296+0000 7f4ec6e7f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4ec009cd30 con 0x7f4ec0146450 2024-09-10T23:16:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.296+0000 7f4ec4c1b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4eb0003a30 0x7f4ec01e5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.296+0000 7f4ec4c1b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4eb0003a30 0x7f4ec01e5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59892/0 (socket says 172.21.15.90:59892) 2024-09-10T23:16:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.296+0000 7f4ec4c1b640 1 -- 172.21.15.90:0/3081894490 learned_addr learned my addr 172.21.15.90:0/3081894490 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.296+0000 7f4ec4c1b640 1 -- 172.21.15.90:0/3081894490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ec0146450 msgr2=0x7f4ec015a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.296+0000 7f4ec4c1b640 1 --2- 172.21.15.90:0/3081894490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ec0146450 0x7f4ec015a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.296+0000 7f4ec4c1b640 1 -- 172.21.15.90:0/3081894490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ec0145910 msgr2=0x7f4ec009c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.296+0000 7f4ec4c1b640 1 --2- 172.21.15.90:0/3081894490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ec0145910 0x7f4ec009c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.296+0000 7f4ec4c1b640 1 -- 172.21.15.90:0/3081894490 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec009d010 con 0x7f4eb0003a30 2024-09-10T23:16:53.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.296+0000 7f4ec4c1b640 1 --2- 172.21.15.90:0/3081894490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4eb0003a30 0x7f4ec01e5020 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4eb400c350 tx=0x7f4eb4006d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:53.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.297+0000 7f4ebd7fa640 1 -- 172.21.15.90:0/3081894490 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4031040 con 0x7f4eb0003a30 2024-09-10T23:16:53.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.297+0000 7f4ec6e7f640 1 -- 172.21.15.90:0/3081894490 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec009d2f0 con 0x7f4eb0003a30 2024-09-10T23:16:53.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.297+0000 7f4ebd7fa640 1 -- 172.21.15.90:0/3081894490 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4eb40035f0 con 0x7f4eb0003a30 2024-09-10T23:16:53.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.297+0000 7f4ebd7fa640 1 -- 172.21.15.90:0/3081894490 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4003a00 con 0x7f4eb0003a30 2024-09-10T23:16:53.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.297+0000 7f4ec6e7f640 1 -- 172.21.15.90:0/3081894490 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec009d8b0 con 0x7f4eb0003a30 2024-09-10T23:16:53.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.298+0000 7f4ec6e7f640 1 -- 172.21.15.90:0/3081894490 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ec015c370 con 0x7f4eb0003a30 2024-09-10T23:16:53.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.298+0000 7f4ebd7fa640 1 -- 172.21.15.90:0/3081894490 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4eb4003ba0 con 0x7f4eb0003a30 2024-09-10T23:16:53.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.299+0000 7f4ebd7fa640 1 --2- 172.21.15.90:0/3081894490 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4ea4077fa0 0x7f4ea407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.299+0000 7f4ebd7fa640 1 -- 172.21.15.90:0/3081894490 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5881+0+0 (secure 0 0 0) 0x7f4eb40ba2c0 con 0x7f4eb0003a30 2024-09-10T23:16:53.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.299+0000 7f4ebffff640 1 --2- 172.21.15.90:0/3081894490 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4ea4077fa0 0x7f4ea407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:53.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.300+0000 7f4ebffff640 1 --2- 172.21.15.90:0/3081894490 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4ea4077fa0 0x7f4ea407a460 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4ec015ece0 tx=0x7f4eac006a60 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:53.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.303+0000 7f4ebd7fa640 1 -- 172.21.15.90:0/3081894490 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4eb4082d10 con 0x7f4eb0003a30 2024-09-10T23:16:53.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:53.477+0000 7f4ec6e7f640 1 -- 172.21.15.90:0/3081894490 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4ec006cd10 con 0x7f4eb0003a30 2024-09-10T23:16:54.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.131+0000 7f4ebd7fa640 1 -- 172.21.15.90:0/3081894490 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v59) ==== 181+0+0 (secure 0 0 0) 0x7f4eb4082610 con 0x7f4eb0003a30 2024-09-10T23:16:54.132 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:16:54.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.133+0000 7f4ec6e7f640 1 -- 172.21.15.90:0/3081894490 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4ea4077fa0 msgr2=0x7f4ea407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:54.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.133+0000 7f4ec6e7f640 1 --2- 172.21.15.90:0/3081894490 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4ea4077fa0 0x7f4ea407a460 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4ec015ece0 tx=0x7f4eac006a60 comp rx=0 tx=0).stop 2024-09-10T23:16:54.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.133+0000 7f4ec6e7f640 1 -- 172.21.15.90:0/3081894490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4eb0003a30 msgr2=0x7f4ec01e5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:54.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.133+0000 7f4ec6e7f640 1 --2- 172.21.15.90:0/3081894490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4eb0003a30 0x7f4ec01e5020 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4eb400c350 tx=0x7f4eb4006d00 comp rx=0 tx=0).stop 2024-09-10T23:16:54.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.133+0000 7f4ec6e7f640 1 -- 172.21.15.90:0/3081894490 shutdown_connections 2024-09-10T23:16:54.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.133+0000 7f4ec6e7f640 1 --2- 172.21.15.90:0/3081894490 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4ea4077fa0 0x7f4ea407a460 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.133+0000 7f4ec6e7f640 1 --2- 172.21.15.90:0/3081894490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ec0145910 0x7f4ec009c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.133+0000 7f4ec6e7f640 1 --2- 172.21.15.90:0/3081894490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ec0146450 0x7f4ec015a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.133+0000 7f4ec6e7f640 1 --2- 172.21.15.90:0/3081894490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4eb0003a30 0x7f4ec01e5020 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.133+0000 7f4ec6e7f640 1 -- 172.21.15.90:0/3081894490 >> 172.21.15.90:0/3081894490 conn(0x7f4ec00b2b90 msgr2=0x7f4ec0159460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:54.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.133+0000 7f4ec6e7f640 1 -- 172.21.15.90:0/3081894490 shutdown_connections 2024-09-10T23:16:54.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.133+0000 7f4ec6e7f640 1 -- 172.21.15.90:0/3081894490 wait complete. 2024-09-10T23:16:54.149 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:16:54.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.257+0000 7f4e1bc33640 1 -- 172.21.15.90:0/2528177086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e141433f0 msgr2=0x7f4e140b2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:54.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.257+0000 7f4e1bc33640 1 --2- 172.21.15.90:0/2528177086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e141433f0 0x7f4e140b2ff0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4e140b2840 tx=0x7f4e0402a560 comp rx=0 tx=0).stop 2024-09-10T23:16:54.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.257+0000 7f4e1bc33640 1 -- 172.21.15.90:0/2528177086 shutdown_connections 2024-09-10T23:16:54.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.257+0000 7f4e1bc33640 1 --2- 172.21.15.90:0/2528177086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e140b3530 0x7f4e1415dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.257+0000 7f4e1bc33640 1 --2- 172.21.15.90:0/2528177086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e141433f0 0x7f4e140b2ff0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.257+0000 7f4e1bc33640 1 --2- 172.21.15.90:0/2528177086 >> v2:172.21.15.171:3300/0 conn(0x7f4e140af460 0x7f4e1406f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.257+0000 7f4e1bc33640 1 -- 172.21.15.90:0/2528177086 >> 172.21.15.90:0/2528177086 conn(0x7f4e140b1aa0 msgr2=0x7f4e140b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:54.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.257+0000 7f4e1bc33640 1 -- 172.21.15.90:0/2528177086 shutdown_connections 2024-09-10T23:16:54.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.257+0000 7f4e1bc33640 1 -- 172.21.15.90:0/2528177086 wait complete. 2024-09-10T23:16:54.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.258+0000 7f4e1bc33640 1 Processor -- start 2024-09-10T23:16:54.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.258+0000 7f4e1bc33640 1 -- start start 2024-09-10T23:16:54.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e1bc33640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e140af460 0x7f4e14141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:54.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e1bc33640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e140b3530 0x7f4e14140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:54.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e1bc33640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e141433f0 0x7f4e140cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:54.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e1bc33640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4e14070a30 con 0x7f4e140b3530 2024-09-10T23:16:54.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e1bc33640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4e140708b0 con 0x7f4e141433f0 2024-09-10T23:16:54.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e1bc33640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4e14072e80 con 0x7f4e140af460 2024-09-10T23:16:54.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e191ce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e140b3530 0x7f4e14140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:54.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e191ce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e140b3530 0x7f4e14140dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59904/0 (socket says 172.21.15.90:59904) 2024-09-10T23:16:54.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e191ce640 1 -- 172.21.15.90:0/1007805038 learned_addr learned my addr 172.21.15.90:0/1007805038 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:54.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e1a1d0640 1 --2- 172.21.15.90:0/1007805038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e141433f0 0x7f4e140cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:54.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e199cf640 1 --2- 172.21.15.90:0/1007805038 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e140af460 0x7f4e14141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:54.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e191ce640 1 -- 172.21.15.90:0/1007805038 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e140af460 msgr2=0x7f4e14141450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:54.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e191ce640 1 --2- 172.21.15.90:0/1007805038 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e140af460 0x7f4e14141450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e191ce640 1 -- 172.21.15.90:0/1007805038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e141433f0 msgr2=0x7f4e140cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:54.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e191ce640 1 --2- 172.21.15.90:0/1007805038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e141433f0 0x7f4e140cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e191ce640 1 -- 172.21.15.90:0/1007805038 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e140ce570 con 0x7f4e140b3530 2024-09-10T23:16:54.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e1a1d0640 1 --2- 172.21.15.90:0/1007805038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e141433f0 0x7f4e140cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:54.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e191ce640 1 --2- 172.21.15.90:0/1007805038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e140b3530 0x7f4e14140dc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4e04034040 tx=0x7f4e040039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:54.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e0a7fc640 1 -- 172.21.15.90:0/1007805038 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0403e030 con 0x7f4e140b3530 2024-09-10T23:16:54.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e0a7fc640 1 -- 172.21.15.90:0/1007805038 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e040047a0 con 0x7f4e140b3530 2024-09-10T23:16:54.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e1bc33640 1 -- 172.21.15.90:0/1007805038 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e140ce850 con 0x7f4e140b3530 2024-09-10T23:16:54.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e0a7fc640 1 -- 172.21.15.90:0/1007805038 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04035040 con 0x7f4e140b3530 2024-09-10T23:16:54.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.259+0000 7f4e1bc33640 1 -- 172.21.15.90:0/1007805038 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e140ccb70 con 0x7f4e140b3530 2024-09-10T23:16:54.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.260+0000 7f4e1bc33640 1 -- 172.21.15.90:0/1007805038 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e1406f070 con 0x7f4e140b3530 2024-09-10T23:16:54.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.261+0000 7f4e0a7fc640 1 -- 172.21.15.90:0/1007805038 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4e04004bf0 con 0x7f4e140b3530 2024-09-10T23:16:54.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.261+0000 7f4e0a7fc640 1 --2- 172.21.15.90:0/1007805038 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4df8077f70 0x7f4df807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:54.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.262+0000 7f4e0a7fc640 1 -- 172.21.15.90:0/1007805038 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5443+0+0 (secure 0 0 0) 0x7f4e040ba620 con 0x7f4e140b3530 2024-09-10T23:16:54.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.262+0000 7f4e199cf640 1 --2- 172.21.15.90:0/1007805038 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4df8077f70 0x7f4df807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:54.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.262+0000 7f4e199cf640 1 --2- 172.21.15.90:0/1007805038 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4df8077f70 0x7f4df807a430 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4e14142180 tx=0x7f4e10005e50 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:54.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.266+0000 7f4e0a7fc640 1 -- 172.21.15.90:0/1007805038 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4e04083220 con 0x7f4e140b3530 2024-09-10T23:16:54.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:54.441+0000 7f4e1bc33640 1 -- 172.21.15.90:0/1007805038 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4e14069a80 con 0x7f4e140b3530 2024-09-10T23:16:54.875 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:16:54.878 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:16:55.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.137+0000 7f4e0a7fc640 1 -- 172.21.15.90:0/1007805038 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v60) ==== 169+0+0 (secure 0 0 0) 0x7f4e04082b20 con 0x7f4e140b3530 2024-09-10T23:16:55.139 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' removed 2024-09-10T23:16:55.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.140+0000 7f4e1bc33640 1 -- 172.21.15.90:0/1007805038 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4df8077f70 msgr2=0x7f4df807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:55.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.140+0000 7f4e1bc33640 1 --2- 172.21.15.90:0/1007805038 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4df8077f70 0x7f4df807a430 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4e14142180 tx=0x7f4e10005e50 comp rx=0 tx=0).stop 2024-09-10T23:16:55.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.140+0000 7f4e1bc33640 1 -- 172.21.15.90:0/1007805038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e140b3530 msgr2=0x7f4e14140dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:55.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.140+0000 7f4e1bc33640 1 --2- 172.21.15.90:0/1007805038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e140b3530 0x7f4e14140dc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4e04034040 tx=0x7f4e040039e0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.140+0000 7f4e1bc33640 1 -- 172.21.15.90:0/1007805038 shutdown_connections 2024-09-10T23:16:55.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.140+0000 7f4e1bc33640 1 --2- 172.21.15.90:0/1007805038 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4df8077f70 0x7f4df807a430 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.140+0000 7f4e1bc33640 1 --2- 172.21.15.90:0/1007805038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e141433f0 0x7f4e140cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.140+0000 7f4e1bc33640 1 --2- 172.21.15.90:0/1007805038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e140b3530 0x7f4e14140dc0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.140+0000 7f4e1bc33640 1 --2- 172.21.15.90:0/1007805038 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e140af460 0x7f4e14141450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.140+0000 7f4e1bc33640 1 -- 172.21.15.90:0/1007805038 >> 172.21.15.90:0/1007805038 conn(0x7f4e140b1aa0 msgr2=0x7f4e141e85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:55.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.140+0000 7f4e1bc33640 1 -- 172.21.15.90:0/1007805038 shutdown_connections 2024-09-10T23:16:55.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.140+0000 7f4e1bc33640 1 -- 172.21.15.90:0/1007805038 wait complete. 2024-09-10T23:16:55.157 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:16:55.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.261+0000 7f754876b640 1 -- 172.21.15.90:0/3444344514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f752c003a50 msgr2=0x7f752c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:55.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.261+0000 7f754876b640 1 --2- 172.21.15.90:0/3444344514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f752c003a50 0x7f752c003e70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f753c00bb20 tx=0x7f752c005830 comp rx=0 tx=0).stop 2024-09-10T23:16:55.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.261+0000 7f754876b640 1 -- 172.21.15.90:0/3444344514 shutdown_connections 2024-09-10T23:16:55.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.261+0000 7f754876b640 1 --2- 172.21.15.90:0/3444344514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f752c003a50 0x7f752c003e70 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.261+0000 7f754876b640 1 -- 172.21.15.90:0/3444344514 >> 172.21.15.90:0/3444344514 conn(0x7f75400b19c0 msgr2=0x7f75400b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:55.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.261+0000 7f754876b640 1 -- 172.21.15.90:0/3444344514 shutdown_connections 2024-09-10T23:16:55.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.261+0000 7f754876b640 1 -- 172.21.15.90:0/3444344514 wait complete. 2024-09-10T23:16:55.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.262+0000 7f754876b640 1 Processor -- start 2024-09-10T23:16:55.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.262+0000 7f754876b640 1 -- start start 2024-09-10T23:16:55.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.263+0000 7f754876b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f752c003a50 0x7f754014a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:55.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.263+0000 7f754876b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f754006f310 0x7f754006fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:55.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.263+0000 7f754876b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f754006ff40 0x7f75400b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:55.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.263+0000 7f754876b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f75400b2870 con 0x7f754006f310 2024-09-10T23:16:55.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.263+0000 7f754876b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f75400b26f0 con 0x7f752c003a50 2024-09-10T23:16:55.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.263+0000 7f754876b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f75400727c0 con 0x7f754006ff40 2024-09-10T23:16:55.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.263+0000 7f7545d06640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f754006f310 0x7f754006fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:55.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.263+0000 7f7545d06640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f754006f310 0x7f754006fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59922/0 (socket says 172.21.15.90:59922) 2024-09-10T23:16:55.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.263+0000 7f7545d06640 1 -- 172.21.15.90:0/4117983091 learned_addr learned my addr 172.21.15.90:0/4117983091 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:55.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.263+0000 7f7546507640 1 --2- 172.21.15.90:0/4117983091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f752c003a50 0x7f754014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:55.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.263+0000 7f7546d08640 1 --2- 172.21.15.90:0/4117983091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f754006ff40 0x7f75400b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:55.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.263+0000 7f7545d06640 1 -- 172.21.15.90:0/4117983091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f754006ff40 msgr2=0x7f75400b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:55.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.263+0000 7f7545d06640 1 --2- 172.21.15.90:0/4117983091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f754006ff40 0x7f75400b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.263+0000 7f7545d06640 1 -- 172.21.15.90:0/4117983091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f752c003a50 msgr2=0x7f754014a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:55.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.263+0000 7f7545d06640 1 --2- 172.21.15.90:0/4117983091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f752c003a50 0x7f754014a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.263+0000 7f7545d06640 1 -- 172.21.15.90:0/4117983091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75400703e0 con 0x7f754006f310 2024-09-10T23:16:55.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.264+0000 7f7545d06640 1 --2- 172.21.15.90:0/4117983091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f754006f310 0x7f754006fa00 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f753000e570 tx=0x7f753000ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:55.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.264+0000 7f7536ffd640 1 -- 172.21.15.90:0/4117983091 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530015070 con 0x7f754006f310 2024-09-10T23:16:55.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.264+0000 7f7536ffd640 1 -- 172.21.15.90:0/4117983091 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75300109a0 con 0x7f754006f310 2024-09-10T23:16:55.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.264+0000 7f754876b640 1 -- 172.21.15.90:0/4117983091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f754006e830 con 0x7f754006f310 2024-09-10T23:16:55.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.264+0000 7f7536ffd640 1 -- 172.21.15.90:0/4117983091 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530010df0 con 0x7f754006f310 2024-09-10T23:16:55.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.264+0000 7f754876b640 1 -- 172.21.15.90:0/4117983091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f754006edf0 con 0x7f754006f310 2024-09-10T23:16:55.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.265+0000 7f754876b640 1 -- 172.21.15.90:0/4117983091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7540072cc0 con 0x7f754006f310 2024-09-10T23:16:55.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.265+0000 7f7536ffd640 1 -- 172.21.15.90:0/4117983091 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7530011460 con 0x7f754006f310 2024-09-10T23:16:55.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.266+0000 7f7536ffd640 1 --2- 172.21.15.90:0/4117983091 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7524077f70 0x7f752407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:55.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.266+0000 7f7536ffd640 1 -- 172.21.15.90:0/4117983091 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5029+0+0 (secure 0 0 0) 0x7f753009a060 con 0x7f754006f310 2024-09-10T23:16:55.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.266+0000 7f7546507640 1 --2- 172.21.15.90:0/4117983091 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7524077f70 0x7f752407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:55.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.266+0000 7f7546507640 1 --2- 172.21.15.90:0/4117983091 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7524077f70 0x7f752407a430 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f753c036000 tx=0x7f753c03c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:55.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.270+0000 7f7536ffd640 1 -- 172.21.15.90:0/4117983091 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f75300627c0 con 0x7f754006f310 2024-09-10T23:16:55.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.449+0000 7f754876b640 1 -- 172.21.15.90:0/4117983091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f75400b4f50 con 0x7f754006f310 2024-09-10T23:16:55.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.452+0000 7f7536ffd640 1 -- 172.21.15.90:0/4117983091 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v35) ==== 71+0+0 (secure 0 0 0) 0x7f75300671f0 con 0x7f754006f310 2024-09-10T23:16:55.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.454+0000 7f754876b640 1 -- 172.21.15.90:0/4117983091 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7524077f70 msgr2=0x7f752407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.454+0000 7f754876b640 1 --2- 172.21.15.90:0/4117983091 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7524077f70 0x7f752407a430 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f753c036000 tx=0x7f753c03c040 comp rx=0 tx=0).stop 2024-09-10T23:16:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.454+0000 7f754876b640 1 -- 172.21.15.90:0/4117983091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f754006f310 msgr2=0x7f754006fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.454+0000 7f754876b640 1 --2- 172.21.15.90:0/4117983091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f754006f310 0x7f754006fa00 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f753000e570 tx=0x7f753000ea30 comp rx=0 tx=0).stop 2024-09-10T23:16:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.455+0000 7f754876b640 1 -- 172.21.15.90:0/4117983091 shutdown_connections 2024-09-10T23:16:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.455+0000 7f754876b640 1 --2- 172.21.15.90:0/4117983091 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7524077f70 0x7f752407a430 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.455+0000 7f754876b640 1 --2- 172.21.15.90:0/4117983091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f754006ff40 0x7f75400b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.455+0000 7f754876b640 1 --2- 172.21.15.90:0/4117983091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f754006f310 0x7f754006fa00 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.455+0000 7f754876b640 1 --2- 172.21.15.90:0/4117983091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f752c003a50 0x7f754014a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.455+0000 7f754876b640 1 -- 172.21.15.90:0/4117983091 >> 172.21.15.90:0/4117983091 conn(0x7f75400b19c0 msgr2=0x7f7540073100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.455+0000 7f754876b640 1 -- 172.21.15.90:0/4117983091 shutdown_connections 2024-09-10T23:16:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.455+0000 7f754876b640 1 -- 172.21.15.90:0/4117983091 wait complete. 2024-09-10T23:16:55.466 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_non_blocklisted' 2024-09-10T23:16:55.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.566+0000 7fce586b8640 1 -- 172.21.15.90:0/1305339208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce500d38d0 msgr2=0x7fce500d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:55.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.566+0000 7fce586b8640 1 --2- 172.21.15.90:0/1305339208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce500d38d0 0x7fce500d0fc0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fce40005fd0 tx=0x7fce4002a820 comp rx=0 tx=0).stop 2024-09-10T23:16:55.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.566+0000 7fce586b8640 1 -- 172.21.15.90:0/1305339208 shutdown_connections 2024-09-10T23:16:55.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.566+0000 7fce586b8640 1 --2- 172.21.15.90:0/1305339208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce500d38d0 0x7fce500d0fc0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.566+0000 7fce586b8640 1 --2- 172.21.15.90:0/1305339208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce5015e310 0x7fce500d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.566+0000 7fce586b8640 1 -- 172.21.15.90:0/1305339208 >> 172.21.15.90:0/1305339208 conn(0x7fce500d4090 msgr2=0x7fce500d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:55.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.566+0000 7fce586b8640 1 -- 172.21.15.90:0/1305339208 shutdown_connections 2024-09-10T23:16:55.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.566+0000 7fce586b8640 1 -- 172.21.15.90:0/1305339208 wait complete. 2024-09-10T23:16:55.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.568+0000 7fce586b8640 1 Processor -- start 2024-09-10T23:16:55.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.568+0000 7fce586b8640 1 -- start start 2024-09-10T23:16:55.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.568+0000 7fce586b8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce500d16f0 0x7fce500cd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:55.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.568+0000 7fce586b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce500d38d0 0x7fce501533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:55.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.568+0000 7fce586b8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce5015e310 0x7fce500b8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:55.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.568+0000 7fce586b8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce5006de00 con 0x7fce500d16f0 2024-09-10T23:16:55.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.568+0000 7fce586b8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fce500d4d90 con 0x7fce5015e310 2024-09-10T23:16:55.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.568+0000 7fce586b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fce5006df80 con 0x7fce500d38d0 2024-09-10T23:16:55.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.568+0000 7fce56454640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce500d16f0 0x7fce500cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:55.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.568+0000 7fce56454640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce500d16f0 0x7fce500cd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59942/0 (socket says 172.21.15.90:59942) 2024-09-10T23:16:55.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.568+0000 7fce56454640 1 -- 172.21.15.90:0/3318747519 learned_addr learned my addr 172.21.15.90:0/3318747519 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:55.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.569+0000 7fce55c53640 1 --2- 172.21.15.90:0/3318747519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce500d38d0 0x7fce501533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:55.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.569+0000 7fce56454640 1 -- 172.21.15.90:0/3318747519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce500d38d0 msgr2=0x7fce501533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:55.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.569+0000 7fce56454640 1 --2- 172.21.15.90:0/3318747519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce500d38d0 0x7fce501533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.569+0000 7fce56c55640 1 --2- 172.21.15.90:0/3318747519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce5015e310 0x7fce500b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:55.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.569+0000 7fce56454640 1 -- 172.21.15.90:0/3318747519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce5015e310 msgr2=0x7fce500b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:55.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.569+0000 7fce56454640 1 --2- 172.21.15.90:0/3318747519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce5015e310 0x7fce500b8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.569+0000 7fce56454640 1 -- 172.21.15.90:0/3318747519 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce500b7110 con 0x7fce500d16f0 2024-09-10T23:16:55.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.569+0000 7fce56454640 1 --2- 172.21.15.90:0/3318747519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce500d16f0 0x7fce500cd990 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fce4800c970 tx=0x7fce4800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:55.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.569+0000 7fce4effd640 1 -- 172.21.15.90:0/3318747519 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce48007bb0 con 0x7fce500d16f0 2024-09-10T23:16:55.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.569+0000 7fce4effd640 1 -- 172.21.15.90:0/3318747519 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce48007e40 con 0x7fce500d16f0 2024-09-10T23:16:55.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.569+0000 7fce586b8640 1 -- 172.21.15.90:0/3318747519 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce500b73f0 con 0x7fce500d16f0 2024-09-10T23:16:55.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.569+0000 7fce4effd640 1 -- 172.21.15.90:0/3318747519 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce48005280 con 0x7fce500d16f0 2024-09-10T23:16:55.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.569+0000 7fce586b8640 1 -- 172.21.15.90:0/3318747519 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce500b79b0 con 0x7fce500d16f0 2024-09-10T23:16:55.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.570+0000 7fce586b8640 1 -- 172.21.15.90:0/3318747519 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce5015e6f0 con 0x7fce500d16f0 2024-09-10T23:16:55.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.571+0000 7fce4effd640 1 -- 172.21.15.90:0/3318747519 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fce48005420 con 0x7fce500d16f0 2024-09-10T23:16:55.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.571+0000 7fce4effd640 1 --2- 172.21.15.90:0/3318747519 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce3c077f70 0x7fce3c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:55.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.571+0000 7fce4effd640 1 -- 172.21.15.90:0/3318747519 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5029+0+0 (secure 0 0 0) 0x7fce48099f20 con 0x7fce500d16f0 2024-09-10T23:16:55.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.571+0000 7fce55c53640 1 --2- 172.21.15.90:0/3318747519 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce3c077f70 0x7fce3c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:55.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.572+0000 7fce55c53640 1 --2- 172.21.15.90:0/3318747519 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce3c077f70 0x7fce3c07a430 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce500cd2a0 tx=0x7fce44009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:55.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.575+0000 7fce4effd640 1 -- 172.21.15.90:0/3318747519 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fce48014030 con 0x7fce500d16f0 2024-09-10T23:16:55.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:55.815+0000 7fce586b8640 1 -- 172.21.15.90:0/3318747519 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_non_blocklisted"]} v 0) -- 0x7fce5015d860 con 0x7fce500d16f0 2024-09-10T23:16:56.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.139+0000 7fce4effd640 1 -- 172.21.15.90:0/3318747519 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_non_blocklisted"]}]=0 v145) ==== 157+0+0 (secure 0 0 0) 0x7fce48062e10 con 0x7fce500d16f0 2024-09-10T23:16:56.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.141+0000 7fce586b8640 1 -- 172.21.15.90:0/3318747519 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce3c077f70 msgr2=0x7fce3c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:56.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.141+0000 7fce586b8640 1 --2- 172.21.15.90:0/3318747519 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce3c077f70 0x7fce3c07a430 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce500cd2a0 tx=0x7fce44009040 comp rx=0 tx=0).stop 2024-09-10T23:16:56.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.141+0000 7fce586b8640 1 -- 172.21.15.90:0/3318747519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce500d16f0 msgr2=0x7fce500cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.141+0000 7fce586b8640 1 --2- 172.21.15.90:0/3318747519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce500d16f0 0x7fce500cd990 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fce4800c970 tx=0x7fce4800ce30 comp rx=0 tx=0).stop 2024-09-10T23:16:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.141+0000 7fce586b8640 1 -- 172.21.15.90:0/3318747519 shutdown_connections 2024-09-10T23:16:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.141+0000 7fce586b8640 1 --2- 172.21.15.90:0/3318747519 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce3c077f70 0x7fce3c07a430 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.141+0000 7fce586b8640 1 --2- 172.21.15.90:0/3318747519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce5015e310 0x7fce500b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.141+0000 7fce586b8640 1 --2- 172.21.15.90:0/3318747519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce500d38d0 0x7fce501533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.141+0000 7fce586b8640 1 --2- 172.21.15.90:0/3318747519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce500d16f0 0x7fce500cd990 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.141+0000 7fce586b8640 1 -- 172.21.15.90:0/3318747519 >> 172.21.15.90:0/3318747519 conn(0x7fce500d4090 msgr2=0x7fce500b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.141+0000 7fce586b8640 1 -- 172.21.15.90:0/3318747519 shutdown_connections 2024-09-10T23:16:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.141+0000 7fce586b8640 1 -- 172.21.15.90:0/3318747519 wait complete. 2024-09-10T23:16:56.154 INFO:tasks.cephfs_test_runner:Check that mds evicts without blocklisting client ... ok 2024-09-10T23:16:56.154 INFO:tasks.cephfs_test_runner:Starting test: test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-10T23:16:56.154 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:16:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.256+0000 7fce73194640 1 -- 172.21.15.90:0/3059523197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce6c0cf3b0 msgr2=0x7fce6c0b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.256+0000 7fce73194640 1 --2- 172.21.15.90:0/3059523197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce6c0cf3b0 0x7fce6c0b24e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fce64005fd0 tx=0x7fce6402a820 comp rx=0 tx=0).stop 2024-09-10T23:16:56.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.256+0000 7fce73194640 1 -- 172.21.15.90:0/3059523197 shutdown_connections 2024-09-10T23:16:56.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.256+0000 7fce73194640 1 --2- 172.21.15.90:0/3059523197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce6c0cf3b0 0x7fce6c0b24e0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.256+0000 7fce73194640 1 -- 172.21.15.90:0/3059523197 >> 172.21.15.90:0/3059523197 conn(0x7fce6c0b19c0 msgr2=0x7fce6c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:56.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.256+0000 7fce73194640 1 -- 172.21.15.90:0/3059523197 shutdown_connections 2024-09-10T23:16:56.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.256+0000 7fce73194640 1 -- 172.21.15.90:0/3059523197 wait complete. 2024-09-10T23:16:56.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.257+0000 7fce73194640 1 Processor -- start 2024-09-10T23:16:56.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.257+0000 7fce73194640 1 -- start start 2024-09-10T23:16:56.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.258+0000 7fce73194640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce6c0b3310 0x7fce6c09d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:56.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.258+0000 7fce73194640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce6c0cf3b0 0x7fce6c09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:56.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.258+0000 7fce73194640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce6c09b740 0x7fce6c1524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:56.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.258+0000 7fce73194640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c15bb40 con 0x7fce6c09b740 2024-09-10T23:16:56.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.258+0000 7fce73194640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c15b9c0 con 0x7fce6c0cf3b0 2024-09-10T23:16:56.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.258+0000 7fce73194640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fce6c15bcc0 con 0x7fce6c0b3310 2024-09-10T23:16:56.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.258+0000 7fce71731640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce6c09b740 0x7fce6c1524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:56.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.258+0000 7fce71731640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce6c09b740 0x7fce6c1524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59958/0 (socket says 172.21.15.90:59958) 2024-09-10T23:16:56.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.258+0000 7fce71731640 1 -- 172.21.15.90:0/715260299 learned_addr learned my addr 172.21.15.90:0/715260299 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:56.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.258+0000 7fce6bfff640 1 --2- 172.21.15.90:0/715260299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce6c0cf3b0 0x7fce6c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:56.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.258+0000 7fce70f30640 1 --2- 172.21.15.90:0/715260299 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce6c0b3310 0x7fce6c09d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:56.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.258+0000 7fce71731640 1 -- 172.21.15.90:0/715260299 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce6c0b3310 msgr2=0x7fce6c09d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:56.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.258+0000 7fce71731640 1 --2- 172.21.15.90:0/715260299 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce6c0b3310 0x7fce6c09d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.259+0000 7fce71731640 1 -- 172.21.15.90:0/715260299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce6c0cf3b0 msgr2=0x7fce6c09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:56.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.259+0000 7fce71731640 1 --2- 172.21.15.90:0/715260299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce6c0cf3b0 0x7fce6c09aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.259+0000 7fce71731640 1 -- 172.21.15.90:0/715260299 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6c09af90 con 0x7fce6c09b740 2024-09-10T23:16:56.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.259+0000 7fce6bfff640 1 --2- 172.21.15.90:0/715260299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce6c0cf3b0 0x7fce6c09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:56.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.259+0000 7fce70f30640 1 --2- 172.21.15.90:0/715260299 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce6c0b3310 0x7fce6c09d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:56.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.259+0000 7fce71731640 1 --2- 172.21.15.90:0/715260299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce6c09b740 0x7fce6c1524d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fce64006010 tx=0x7fce64032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:56.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.259+0000 7fce697fa640 1 -- 172.21.15.90:0/715260299 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce64037040 con 0x7fce6c09b740 2024-09-10T23:16:56.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.259+0000 7fce73194640 1 -- 172.21.15.90:0/715260299 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6c1f86d0 con 0x7fce6c09b740 2024-09-10T23:16:56.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.259+0000 7fce697fa640 1 -- 172.21.15.90:0/715260299 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce64042070 con 0x7fce6c09b740 2024-09-10T23:16:56.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.259+0000 7fce697fa640 1 -- 172.21.15.90:0/715260299 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce640042a0 con 0x7fce6c09b740 2024-09-10T23:16:56.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.259+0000 7fce73194640 1 -- 172.21.15.90:0/715260299 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce6c1f8c90 con 0x7fce6c09b740 2024-09-10T23:16:56.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.260+0000 7fce73194640 1 -- 172.21.15.90:0/715260299 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce6c15c170 con 0x7fce6c09b740 2024-09-10T23:16:56.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.260+0000 7fce697fa640 1 -- 172.21.15.90:0/715260299 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fce6403a030 con 0x7fce6c09b740 2024-09-10T23:16:56.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.261+0000 7fce697fa640 1 --2- 172.21.15.90:0/715260299 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce58077f70 0x7fce5807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:56.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.261+0000 7fce697fa640 1 -- 172.21.15.90:0/715260299 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5029+0+0 (secure 0 0 0) 0x7fce640ba570 con 0x7fce6c09b740 2024-09-10T23:16:56.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.261+0000 7fce70f30640 1 --2- 172.21.15.90:0/715260299 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce58077f70 0x7fce5807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:56.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.262+0000 7fce70f30640 1 --2- 172.21.15.90:0/715260299 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce58077f70 0x7fce5807a430 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0738e0 tx=0x7fce5c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:56.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.265+0000 7fce697fa640 1 -- 172.21.15.90:0/715260299 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fce64083290 con 0x7fce6c09b740 2024-09-10T23:16:56.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.438+0000 7fce73194640 1 -- 172.21.15.90:0/715260299 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce6c15ae50 con 0x7fce6c09b740 2024-09-10T23:16:56.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.439+0000 7fce697fa640 1 -- 172.21.15.90:0/715260299 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+13162 (secure 0 0 0) 0x7fce64082b90 con 0x7fce6c09b740 2024-09-10T23:16:56.440 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:56.440 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":60,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:16:55.132293+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6833/2007304013":"2024-09-11T23:16:52.122896+0000","172.21.15.90:6832/2007304013":"2024-09-11T23:16:52.122896+0000","172.21.15.90:6835/1708086583":"2024-09-11T23:16:52.122907+0000","172.21.15.90:6834/1708086583":"2024-09-11T23:16:52.122907+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:16:56.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.441+0000 7fce73194640 1 -- 172.21.15.90:0/715260299 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce58077f70 msgr2=0x7fce5807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:56.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.441+0000 7fce73194640 1 --2- 172.21.15.90:0/715260299 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce58077f70 0x7fce5807a430 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0738e0 tx=0x7fce5c009040 comp rx=0 tx=0).stop 2024-09-10T23:16:56.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.441+0000 7fce73194640 1 -- 172.21.15.90:0/715260299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce6c09b740 msgr2=0x7fce6c1524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:56.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.441+0000 7fce73194640 1 --2- 172.21.15.90:0/715260299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce6c09b740 0x7fce6c1524d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fce64006010 tx=0x7fce64032d10 comp rx=0 tx=0).stop 2024-09-10T23:16:56.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.441+0000 7fce73194640 1 -- 172.21.15.90:0/715260299 shutdown_connections 2024-09-10T23:16:56.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.441+0000 7fce73194640 1 --2- 172.21.15.90:0/715260299 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce58077f70 0x7fce5807a430 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.441+0000 7fce73194640 1 --2- 172.21.15.90:0/715260299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce6c0cf3b0 0x7fce6c09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.441+0000 7fce73194640 1 --2- 172.21.15.90:0/715260299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce6c09b740 0x7fce6c1524d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.441+0000 7fce73194640 1 --2- 172.21.15.90:0/715260299 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce6c0b3310 0x7fce6c09d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.441+0000 7fce73194640 1 -- 172.21.15.90:0/715260299 >> 172.21.15.90:0/715260299 conn(0x7fce6c0b19c0 msgr2=0x7fce6c0adca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:56.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.441+0000 7fce73194640 1 -- 172.21.15.90:0/715260299 shutdown_connections 2024-09-10T23:16:56.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.441+0000 7fce73194640 1 -- 172.21.15.90:0/715260299 wait complete. 2024-09-10T23:16:56.454 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:14:26.449950+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:16:56.454 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:16:56.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.559+0000 7f5db9f32640 1 -- 172.21.15.90:0/1685335964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d9c004d40 msgr2=0x7f5d9c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:56.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.559+0000 7f5db9f32640 1 --2- 172.21.15.90:0/1685335964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d9c004d40 0x7f5d9c0051c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5dac009b50 tx=0x7f5d9c005830 comp rx=0 tx=0).stop 2024-09-10T23:16:56.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.559+0000 7f5db3fff640 1 -- 172.21.15.90:0/1685335964 reap_dead start 2024-09-10T23:16:56.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.559+0000 7f5db9f32640 1 -- 172.21.15.90:0/1685335964 shutdown_connections 2024-09-10T23:16:56.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.559+0000 7f5db9f32640 1 -- 172.21.15.90:0/1685335964 >> 172.21.15.90:0/1685335964 conn(0x7f5db40d4090 msgr2=0x7f5db40d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:56.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.559+0000 7f5db9f32640 1 -- 172.21.15.90:0/1685335964 shutdown_connections 2024-09-10T23:16:56.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.559+0000 7f5db9f32640 1 -- 172.21.15.90:0/1685335964 wait complete. 2024-09-10T23:16:56.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.560+0000 7f5db9f32640 1 Processor -- start 2024-09-10T23:16:56.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.560+0000 7f5db9f32640 1 -- start start 2024-09-10T23:16:56.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.561+0000 7f5db9f32640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d9c004d40 0x7f5db40b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:56.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.561+0000 7f5db9f32640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5db4160d40 0x7f5db40ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:56.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.561+0000 7f5db9f32640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db41611a0 0x7f5db41f3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:56.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.561+0000 7f5db9f32640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5db40d28c0 con 0x7f5db41611a0 2024-09-10T23:16:56.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.561+0000 7f5db9f32640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5db40d4d90 con 0x7f5d9c004d40 2024-09-10T23:16:56.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.561+0000 7f5db9f32640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5db40d2a40 con 0x7f5db4160d40 2024-09-10T23:16:56.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.561+0000 7f5db3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db41611a0 0x7f5db41f3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:56.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.561+0000 7f5db3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db41611a0 0x7f5db41f3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59968/0 (socket says 172.21.15.90:59968) 2024-09-10T23:16:56.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.561+0000 7f5db3fff640 1 -- 172.21.15.90:0/1709095629 learned_addr learned my addr 172.21.15.90:0/1709095629 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:56.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.561+0000 7f5db2ffd640 1 --2- 172.21.15.90:0/1709095629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5db4160d40 0x7f5db40ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:56.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.561+0000 7f5db37fe640 1 --2- 172.21.15.90:0/1709095629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d9c004d40 0x7f5db40b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:56.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.561+0000 7f5db3fff640 1 -- 172.21.15.90:0/1709095629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5db4160d40 msgr2=0x7f5db40ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:56.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.561+0000 7f5db3fff640 1 --2- 172.21.15.90:0/1709095629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5db4160d40 0x7f5db40ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.561+0000 7f5db3fff640 1 -- 172.21.15.90:0/1709095629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d9c004d40 msgr2=0x7f5db40b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:56.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.561+0000 7f5db3fff640 1 --2- 172.21.15.90:0/1709095629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d9c004d40 0x7f5db40b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.561+0000 7f5db3fff640 1 -- 172.21.15.90:0/1709095629 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db41f8180 con 0x7f5db41611a0 2024-09-10T23:16:56.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.562+0000 7f5db3fff640 1 --2- 172.21.15.90:0/1709095629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db41611a0 0x7f5db41f3b70 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5dac02b4f0 tx=0x7f5dac033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:56.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.562+0000 7f5d9bfff640 1 -- 172.21.15.90:0/1709095629 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac038040 con 0x7f5db41611a0 2024-09-10T23:16:56.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.562+0000 7f5d9bfff640 1 -- 172.21.15.90:0/1709095629 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dac004110 con 0x7f5db41611a0 2024-09-10T23:16:56.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.562+0000 7f5db9f32640 1 -- 172.21.15.90:0/1709095629 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db41f8460 con 0x7f5db41611a0 2024-09-10T23:16:56.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.562+0000 7f5d9bfff640 1 -- 172.21.15.90:0/1709095629 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac0336e0 con 0x7f5db41611a0 2024-09-10T23:16:56.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.562+0000 7f5db9f32640 1 -- 172.21.15.90:0/1709095629 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db41f8a20 con 0x7f5db41611a0 2024-09-10T23:16:56.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.563+0000 7f5db9f32640 1 -- 172.21.15.90:0/1709095629 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db415f870 con 0x7f5db41611a0 2024-09-10T23:16:56.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.563+0000 7f5d9bfff640 1 -- 172.21.15.90:0/1709095629 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5dac03b070 con 0x7f5db41611a0 2024-09-10T23:16:56.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.564+0000 7f5d9bfff640 1 --2- 172.21.15.90:0/1709095629 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5da0077f70 0x7f5da007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:56.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.564+0000 7f5d9bfff640 1 -- 172.21.15.90:0/1709095629 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5029+0+0 (secure 0 0 0) 0x7f5dac0b9690 con 0x7f5db41611a0 2024-09-10T23:16:56.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.564+0000 7f5db37fe640 1 --2- 172.21.15.90:0/1709095629 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5da0077f70 0x7f5da007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:56.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.565+0000 7f5db37fe640 1 --2- 172.21.15.90:0/1709095629 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5da0077f70 0x7f5da007a430 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5da4001b90 tx=0x7f5da4006b20 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:56.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.568+0000 7f5d9bfff640 1 -- 172.21.15.90:0/1709095629 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5dac081de0 con 0x7f5db41611a0 2024-09-10T23:16:56.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.742+0000 7f5db9f32640 1 -- 172.21.15.90:0/1709095629 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5db40b31e0 con 0x7f5db41611a0 2024-09-10T23:16:56.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.742+0000 7f5d9bfff640 1 -- 172.21.15.90:0/1709095629 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7f5dac086810 con 0x7f5db41611a0 2024-09-10T23:16:56.743 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-09-10T23:16:56.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.744+0000 7f5db9f32640 1 -- 172.21.15.90:0/1709095629 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5da0077f70 msgr2=0x7f5da007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:56.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.744+0000 7f5db9f32640 1 --2- 172.21.15.90:0/1709095629 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5da0077f70 0x7f5da007a430 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5da4001b90 tx=0x7f5da4006b20 comp rx=0 tx=0).stop 2024-09-10T23:16:56.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.744+0000 7f5db9f32640 1 -- 172.21.15.90:0/1709095629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db41611a0 msgr2=0x7f5db41f3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:56.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.744+0000 7f5db9f32640 1 --2- 172.21.15.90:0/1709095629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db41611a0 0x7f5db41f3b70 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5dac02b4f0 tx=0x7f5dac033670 comp rx=0 tx=0).stop 2024-09-10T23:16:56.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.744+0000 7f5db9f32640 1 -- 172.21.15.90:0/1709095629 shutdown_connections 2024-09-10T23:16:56.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.744+0000 7f5db9f32640 1 --2- 172.21.15.90:0/1709095629 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5da0077f70 0x7f5da007a430 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.744+0000 7f5db9f32640 1 --2- 172.21.15.90:0/1709095629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db41611a0 0x7f5db41f3b70 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.744+0000 7f5db9f32640 1 --2- 172.21.15.90:0/1709095629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5db4160d40 0x7f5db40ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.744+0000 7f5db9f32640 1 --2- 172.21.15.90:0/1709095629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d9c004d40 0x7f5db40b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.744+0000 7f5db9f32640 1 -- 172.21.15.90:0/1709095629 >> 172.21.15.90:0/1709095629 conn(0x7f5db40d4090 msgr2=0x7f5db40b9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:56.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.744+0000 7f5db9f32640 1 -- 172.21.15.90:0/1709095629 shutdown_connections 2024-09-10T23:16:56.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.744+0000 7f5db9f32640 1 -- 172.21.15.90:0/1709095629 wait complete. 2024-09-10T23:16:56.756 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject' 2024-09-10T23:16:56.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.855+0000 7fdc5a6c6640 1 -- 172.21.15.90:0/2233151027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc5415e310 msgr2=0x7fdc540d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:56.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.855+0000 7fdc5a6c6640 1 --2- 172.21.15.90:0/2233151027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc5415e310 0x7fdc540d0a80 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009830 tx=0x7fdc4402a480 comp rx=0 tx=0).stop 2024-09-10T23:16:56.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.855+0000 7fdc5a6c6640 1 -- 172.21.15.90:0/2233151027 shutdown_connections 2024-09-10T23:16:56.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.855+0000 7fdc5a6c6640 1 --2- 172.21.15.90:0/2233151027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc5415e310 0x7fdc540d0a80 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.855+0000 7fdc5a6c6640 1 -- 172.21.15.90:0/2233151027 >> 172.21.15.90:0/2233151027 conn(0x7fdc540d4090 msgr2=0x7fdc540d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:56.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.855+0000 7fdc5a6c6640 1 -- 172.21.15.90:0/2233151027 shutdown_connections 2024-09-10T23:16:56.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.855+0000 7fdc5a6c6640 1 -- 172.21.15.90:0/2233151027 wait complete. 2024-09-10T23:16:56.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.857+0000 7fdc5a6c6640 1 Processor -- start 2024-09-10T23:16:56.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.857+0000 7fdc5a6c6640 1 -- start start 2024-09-10T23:16:56.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.857+0000 7fdc5a6c6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc540d16f0 0x7fdc540b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:56.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.857+0000 7fdc5a6c6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc540d38d0 0x7fdc541f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:56.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.857+0000 7fdc5a6c6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc5415e310 0x7fdc54153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:56.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.857+0000 7fdc5a6c6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdc540d4d00 con 0x7fdc540d16f0 2024-09-10T23:16:56.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.857+0000 7fdc5a6c6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdc540d4b80 con 0x7fdc540d38d0 2024-09-10T23:16:56.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.857+0000 7fdc5a6c6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdc540d4e80 con 0x7fdc5415e310 2024-09-10T23:16:56.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.857+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc540d16f0 0x7fdc540b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:56.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.857+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc540d16f0 0x7fdc540b6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59998/0 (socket says 172.21.15.90:59998) 2024-09-10T23:16:56.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.857+0000 7fdc53fff640 1 -- 172.21.15.90:0/4149850044 learned_addr learned my addr 172.21.15.90:0/4149850044 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:56.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.858+0000 7fdc58c63640 1 --2- 172.21.15.90:0/4149850044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc5415e310 0x7fdc54153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:56.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.858+0000 7fdc4bfff640 1 --2- 172.21.15.90:0/4149850044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc540d38d0 0x7fdc541f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:56.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.858+0000 7fdc53fff640 1 -- 172.21.15.90:0/4149850044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc5415e310 msgr2=0x7fdc54153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:56.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.858+0000 7fdc53fff640 1 --2- 172.21.15.90:0/4149850044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc5415e310 0x7fdc54153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.858+0000 7fdc53fff640 1 -- 172.21.15.90:0/4149850044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc540d38d0 msgr2=0x7fdc541f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:56.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.858+0000 7fdc53fff640 1 --2- 172.21.15.90:0/4149850044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc540d38d0 0x7fdc541f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.858+0000 7fdc53fff640 1 -- 172.21.15.90:0/4149850044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc540b9870 con 0x7fdc540d16f0 2024-09-10T23:16:56.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.858+0000 7fdc53fff640 1 --2- 172.21.15.90:0/4149850044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc540d16f0 0x7fdc540b6ec0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009950 tx=0x7fdc44033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:56.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.858+0000 7fdc517fa640 1 -- 172.21.15.90:0/4149850044 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44031d60 con 0x7fdc540d16f0 2024-09-10T23:16:56.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.858+0000 7fdc5a6c6640 1 -- 172.21.15.90:0/4149850044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5415f940 con 0x7fdc540d16f0 2024-09-10T23:16:56.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.858+0000 7fdc517fa640 1 -- 172.21.15.90:0/4149850044 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc440330d0 con 0x7fdc540d16f0 2024-09-10T23:16:56.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.858+0000 7fdc517fa640 1 -- 172.21.15.90:0/4149850044 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44033520 con 0x7fdc540d16f0 2024-09-10T23:16:56.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.858+0000 7fdc5a6c6640 1 -- 172.21.15.90:0/4149850044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc540b9af0 con 0x7fdc540d16f0 2024-09-10T23:16:56.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.859+0000 7fdc5a6c6640 1 -- 172.21.15.90:0/4149850044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc540d12d0 con 0x7fdc540d16f0 2024-09-10T23:16:56.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.860+0000 7fdc517fa640 1 -- 172.21.15.90:0/4149850044 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdc440035f0 con 0x7fdc540d16f0 2024-09-10T23:16:56.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.860+0000 7fdc517fa640 1 --2- 172.21.15.90:0/4149850044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdc34077f70 0x7fdc3407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:56.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.860+0000 7fdc517fa640 1 -- 172.21.15.90:0/4149850044 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5029+0+0 (secure 0 0 0) 0x7fdc440bafd0 con 0x7fdc540d16f0 2024-09-10T23:16:56.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.860+0000 7fdc4bfff640 1 --2- 172.21.15.90:0/4149850044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdc34077f70 0x7fdc3407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:56.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.861+0000 7fdc4bfff640 1 --2- 172.21.15.90:0/4149850044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdc34077f70 0x7fdc3407a430 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdc541f86c0 tx=0x7fdc3c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:56.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:56.864+0000 7fdc517fa640 1 -- 172.21.15.90:0/4149850044 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdc5415f940 con 0x7fdc540d16f0 2024-09-10T23:16:57.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.104+0000 7fdc5a6c6640 1 -- 172.21.15.90:0/4149850044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]} v 0) -- 0x7fdc54161b70 con 0x7fdc540d16f0 2024-09-10T23:16:57.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.145+0000 7fdc517fa640 1 -- 172.21.15.90:0/4149850044 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]}]=0 v146) ==== 145+0+0 (secure 0 0 0) 0x7fdc540b9870 con 0x7fdc540d16f0 2024-09-10T23:16:57.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.147+0000 7fdc5a6c6640 1 -- 172.21.15.90:0/4149850044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdc34077f70 msgr2=0x7fdc3407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:57.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.147+0000 7fdc5a6c6640 1 --2- 172.21.15.90:0/4149850044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdc34077f70 0x7fdc3407a430 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdc541f86c0 tx=0x7fdc3c009040 comp rx=0 tx=0).stop 2024-09-10T23:16:57.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.147+0000 7fdc5a6c6640 1 -- 172.21.15.90:0/4149850044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc540d16f0 msgr2=0x7fdc540b6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:57.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.147+0000 7fdc5a6c6640 1 --2- 172.21.15.90:0/4149850044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc540d16f0 0x7fdc540b6ec0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009950 tx=0x7fdc44033d60 comp rx=0 tx=0).stop 2024-09-10T23:16:57.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.147+0000 7fdc5a6c6640 1 -- 172.21.15.90:0/4149850044 shutdown_connections 2024-09-10T23:16:57.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.147+0000 7fdc5a6c6640 1 --2- 172.21.15.90:0/4149850044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdc34077f70 0x7fdc3407a430 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.147+0000 7fdc5a6c6640 1 --2- 172.21.15.90:0/4149850044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc540d38d0 0x7fdc541f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.147+0000 7fdc5a6c6640 1 --2- 172.21.15.90:0/4149850044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc5415e310 0x7fdc54153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.147+0000 7fdc5a6c6640 1 --2- 172.21.15.90:0/4149850044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc540d16f0 0x7fdc540b6ec0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.147+0000 7fdc5a6c6640 1 -- 172.21.15.90:0/4149850044 >> 172.21.15.90:0/4149850044 conn(0x7fdc540d4090 msgr2=0x7fdc540b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:57.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.148+0000 7fdc5a6c6640 1 -- 172.21.15.90:0/4149850044 shutdown_connections 2024-09-10T23:16:57.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.148+0000 7fdc5a6c6640 1 -- 172.21.15.90:0/4149850044 wait complete. 2024-09-10T23:16:57.159 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:16:57.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.258+0000 7fb0eec7f640 1 -- 172.21.15.90:0/3132572574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0e80cd470 msgr2=0x7fb0e815e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:57.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.258+0000 7fb0eec7f640 1 --2- 172.21.15.90:0/3132572574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0e80cd470 0x7fb0e815e890 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80cda60 tx=0x7fb0e002aa30 comp rx=0 tx=0).stop 2024-09-10T23:16:57.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.258+0000 7fb0eec7f640 1 -- 172.21.15.90:0/3132572574 shutdown_connections 2024-09-10T23:16:57.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.258+0000 7fb0eec7f640 1 --2- 172.21.15.90:0/3132572574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0e80cd470 0x7fb0e815e890 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.258+0000 7fb0eec7f640 1 --2- 172.21.15.90:0/3132572574 >> v2:172.21.15.171:3300/0 conn(0x7fb0e80b44a0 0x7fb0e80b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.258+0000 7fb0eec7f640 1 -- 172.21.15.90:0/3132572574 >> 172.21.15.90:0/3132572574 conn(0x7fb0e80b19c0 msgr2=0x7fb0e80b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:57.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.258+0000 7fb0eec7f640 1 -- 172.21.15.90:0/3132572574 shutdown_connections 2024-09-10T23:16:57.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.258+0000 7fb0eec7f640 1 -- 172.21.15.90:0/3132572574 wait complete. 2024-09-10T23:16:57.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.259+0000 7fb0eec7f640 1 Processor -- start 2024-09-10T23:16:57.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.259+0000 7fb0eec7f640 1 -- start start 2024-09-10T23:16:57.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.260+0000 7fb0eec7f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0e80b44a0 0x7fb0e81490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:57.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.260+0000 7fb0eec7f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0e80cd470 0x7fb0e81f49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:57.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.260+0000 7fb0eec7f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0e80cf860 0x7fb0e80c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:57.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.260+0000 7fb0eec7f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e80ced20 con 0x7fb0e80b44a0 2024-09-10T23:16:57.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.260+0000 7fb0eec7f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e80ceba0 con 0x7fb0e80cf860 2024-09-10T23:16:57.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.260+0000 7fb0eec7f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb0e815a8c0 con 0x7fb0e80cd470 2024-09-10T23:16:57.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.260+0000 7fb0eca1b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0e80b44a0 0x7fb0e81490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:57.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.260+0000 7fb0eca1b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0e80b44a0 0x7fb0e81490c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60018/0 (socket says 172.21.15.90:60018) 2024-09-10T23:16:57.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.260+0000 7fb0eca1b640 1 -- 172.21.15.90:0/3838320609 learned_addr learned my addr 172.21.15.90:0/3838320609 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:57.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.261+0000 7fb0ed21c640 1 --2- 172.21.15.90:0/3838320609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0e80cf860 0x7fb0e80c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:57.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.261+0000 7fb0e7fff640 1 --2- 172.21.15.90:0/3838320609 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0e80cd470 0x7fb0e81f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:57.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.261+0000 7fb0eca1b640 1 -- 172.21.15.90:0/3838320609 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0e80cd470 msgr2=0x7fb0e81f49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:57.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.261+0000 7fb0eca1b640 1 --2- 172.21.15.90:0/3838320609 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0e80cd470 0x7fb0e81f49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.261+0000 7fb0eca1b640 1 -- 172.21.15.90:0/3838320609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0e80cf860 msgr2=0x7fb0e80c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:57.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.261+0000 7fb0eca1b640 1 --2- 172.21.15.90:0/3838320609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0e80cf860 0x7fb0e80c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.261+0000 7fb0eca1b640 1 -- 172.21.15.90:0/3838320609 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e80ace20 con 0x7fb0e80b44a0 2024-09-10T23:16:57.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.261+0000 7fb0e7fff640 1 --2- 172.21.15.90:0/3838320609 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0e80cd470 0x7fb0e81f49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:57.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.261+0000 7fb0eca1b640 1 --2- 172.21.15.90:0/3838320609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0e80b44a0 0x7fb0e81490c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00b410 tx=0x7fb0dc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:57.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.261+0000 7fb0e57fa640 1 -- 172.21.15.90:0/3838320609 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc015020 con 0x7fb0e80b44a0 2024-09-10T23:16:57.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.261+0000 7fb0e57fa640 1 -- 172.21.15.90:0/3838320609 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0dc011940 con 0x7fb0e80b44a0 2024-09-10T23:16:57.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.261+0000 7fb0eec7f640 1 -- 172.21.15.90:0/3838320609 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e81f5230 con 0x7fb0e80b44a0 2024-09-10T23:16:57.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.261+0000 7fb0e57fa640 1 -- 172.21.15.90:0/3838320609 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc011d90 con 0x7fb0e80b44a0 2024-09-10T23:16:57.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.261+0000 7fb0eec7f640 1 -- 172.21.15.90:0/3838320609 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e81f4ee0 con 0x7fb0e80b44a0 2024-09-10T23:16:57.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.262+0000 7fb0eec7f640 1 -- 172.21.15.90:0/3838320609 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0e815ee20 con 0x7fb0e80b44a0 2024-09-10T23:16:57.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.263+0000 7fb0e57fa640 1 -- 172.21.15.90:0/3838320609 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb0dc01a400 con 0x7fb0e80b44a0 2024-09-10T23:16:57.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.263+0000 7fb0e57fa640 1 --2- 172.21.15.90:0/3838320609 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb0cc077f70 0x7fb0cc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:57.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.264+0000 7fb0e57fa640 1 -- 172.21.15.90:0/3838320609 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5029+0+0 (secure 0 0 0) 0x7fb0dc099d00 con 0x7fb0e80b44a0 2024-09-10T23:16:57.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.264+0000 7fb0e7fff640 1 --2- 172.21.15.90:0/3838320609 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb0cc077f70 0x7fb0cc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:57.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.264+0000 7fb0e7fff640 1 --2- 172.21.15.90:0/3838320609 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb0cc077f70 0x7fb0cc07a430 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8149e50 tx=0x7fb0d4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:57.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.268+0000 7fb0e57fa640 1 -- 172.21.15.90:0/3838320609 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb0dc01f020 con 0x7fb0e80b44a0 2024-09-10T23:16:57.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.440+0000 7fb0eec7f640 1 -- 172.21.15.90:0/3838320609 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fb0e80cc480 con 0x7fb0e80b44a0 2024-09-10T23:16:57.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.440+0000 7fb0e57fa640 1 -- 172.21.15.90:0/3838320609 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v35) ==== 59+0+1998 (secure 0 0 0) 0x7fb0dc062aa0 con 0x7fb0e80b44a0 2024-09-10T23:16:57.442 INFO:teuthology.orchestra.run.smithi090.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:16:57.442 INFO:teuthology.orchestra.run.smithi090.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:16:57.442 INFO:teuthology.orchestra.run.smithi090.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:16:57.442 INFO:teuthology.orchestra.run.smithi090.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:16:57.442 INFO:teuthology.orchestra.run.smithi090.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8283.895139 2024-09-10T23:16:57.442 INFO:teuthology.orchestra.run.smithi090.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5684.288500 2024-09-10T23:16:57.442 INFO:teuthology.orchestra.run.smithi090.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5960.411649 2024-09-10T23:16:57.442 INFO:teuthology.orchestra.run.smithi090.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5499.929251 2024-09-10T23:16:57.442 INFO:teuthology.orchestra.run.smithi090.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5373.806301 2024-09-10T23:16:57.442 INFO:teuthology.orchestra.run.smithi090.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5138.908279 2024-09-10T23:16:57.442 INFO:teuthology.orchestra.run.smithi090.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5181.430205 2024-09-10T23:16:57.442 INFO:teuthology.orchestra.run.smithi090.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4880.265977 2024-09-10T23:16:57.443 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_mds 20/20 2024-09-10T23:16:57.443 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:16:57.443 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_ms 2/2 2024-09-10T23:16:57.443 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_debug_frag true 2024-09-10T23:16:57.443 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:16:57.443 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:16:57.443 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_verify_scatter true 2024-09-10T23:16:57.443 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:16:57.443 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:16:57.443 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:16:57.443 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced client_mount_timeout 600 2024-09-10T23:16:57.443 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced debug_client 20/20 2024-09-10T23:16:57.443 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced debug_ms 1/1 2024-09-10T23:16:57.443 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:16:57.444 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:16:57.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.442+0000 7fb0eec7f640 1 -- 172.21.15.90:0/3838320609 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb0cc077f70 msgr2=0x7fb0cc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:57.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.442+0000 7fb0eec7f640 1 --2- 172.21.15.90:0/3838320609 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb0cc077f70 0x7fb0cc07a430 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8149e50 tx=0x7fb0d4009040 comp rx=0 tx=0).stop 2024-09-10T23:16:57.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.442+0000 7fb0eec7f640 1 -- 172.21.15.90:0/3838320609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0e80b44a0 msgr2=0x7fb0e81490c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:57.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.442+0000 7fb0eec7f640 1 --2- 172.21.15.90:0/3838320609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0e80b44a0 0x7fb0e81490c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00b410 tx=0x7fb0dc00b8d0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.443+0000 7fb0eec7f640 1 -- 172.21.15.90:0/3838320609 shutdown_connections 2024-09-10T23:16:57.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.443+0000 7fb0eec7f640 1 --2- 172.21.15.90:0/3838320609 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb0cc077f70 0x7fb0cc07a430 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.443+0000 7fb0eec7f640 1 --2- 172.21.15.90:0/3838320609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0e80cf860 0x7fb0e80c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.443+0000 7fb0eec7f640 1 --2- 172.21.15.90:0/3838320609 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0e80cd470 0x7fb0e81f49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.443+0000 7fb0eec7f640 1 --2- 172.21.15.90:0/3838320609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0e80b44a0 0x7fb0e81490c0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.443+0000 7fb0eec7f640 1 -- 172.21.15.90:0/3838320609 >> 172.21.15.90:0/3838320609 conn(0x7fb0e80b19c0 msgr2=0x7fb0e8159bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:57.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.443+0000 7fb0eec7f640 1 -- 172.21.15.90:0/3838320609 shutdown_connections 2024-09-10T23:16:57.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.443+0000 7fb0eec7f640 1 -- 172.21.15.90:0/3838320609 wait complete. 2024-09-10T23:16:57.454 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:16:57.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.557+0000 7fd97eda0640 1 -- 172.21.15.90:0/3883943133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd968003c10 msgr2=0x7fd968004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:57.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.557+0000 7fd97eda0640 1 --2- 172.21.15.90:0/3883943133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd968003c10 0x7fd968004010 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd96c006fb0 tx=0x7fd968005830 comp rx=0 tx=0).stop 2024-09-10T23:16:57.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.557+0000 7fd97d33d640 1 -- 172.21.15.90:0/3883943133 reap_dead start 2024-09-10T23:16:57.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.557+0000 7fd97eda0640 1 -- 172.21.15.90:0/3883943133 shutdown_connections 2024-09-10T23:16:57.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.557+0000 7fd97eda0640 1 -- 172.21.15.90:0/3883943133 >> 172.21.15.90:0/3883943133 conn(0x7fd9780b19c0 msgr2=0x7fd9780b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:57.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.557+0000 7fd97eda0640 1 -- 172.21.15.90:0/3883943133 shutdown_connections 2024-09-10T23:16:57.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.557+0000 7fd97eda0640 1 -- 172.21.15.90:0/3883943133 wait complete. 2024-09-10T23:16:57.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.558+0000 7fd97eda0640 1 Processor -- start 2024-09-10T23:16:57.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.558+0000 7fd97eda0640 1 -- start start 2024-09-10T23:16:57.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.559+0000 7fd97eda0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd968003c10 0x7fd97809c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:57.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.559+0000 7fd97eda0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd97815d7f0 0x7fd97806fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:57.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.559+0000 7fd97eda0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd97815dc50 0x7fd9780702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:57.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.559+0000 7fd97eda0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd9780b2870 con 0x7fd97815d7f0 2024-09-10T23:16:57.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.559+0000 7fd97eda0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd9780b26f0 con 0x7fd97815dc50 2024-09-10T23:16:57.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.559+0000 7fd97eda0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd97815bec0 con 0x7fd968003c10 2024-09-10T23:16:57.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.559+0000 7fd977fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd97815d7f0 0x7fd97806fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:57.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.559+0000 7fd977fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd97815d7f0 0x7fd97806fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60036/0 (socket says 172.21.15.90:60036) 2024-09-10T23:16:57.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.559+0000 7fd977fff640 1 -- 172.21.15.90:0/232818445 learned_addr learned my addr 172.21.15.90:0/232818445 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:57.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.559+0000 7fd97d33d640 1 --2- 172.21.15.90:0/232818445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd97815dc50 0x7fd9780702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:57.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.559+0000 7fd97cb3c640 1 --2- 172.21.15.90:0/232818445 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd968003c10 0x7fd97809c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:57.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.559+0000 7fd977fff640 1 -- 172.21.15.90:0/232818445 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd968003c10 msgr2=0x7fd97809c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:57.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.559+0000 7fd977fff640 1 --2- 172.21.15.90:0/232818445 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd968003c10 0x7fd97809c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.559+0000 7fd977fff640 1 -- 172.21.15.90:0/232818445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd97815dc50 msgr2=0x7fd9780702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:57.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.559+0000 7fd977fff640 1 --2- 172.21.15.90:0/232818445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd97815dc50 0x7fd9780702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.559+0000 7fd977fff640 1 -- 172.21.15.90:0/232818445 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9781f8090 con 0x7fd97815d7f0 2024-09-10T23:16:57.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.559+0000 7fd97d33d640 1 --2- 172.21.15.90:0/232818445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd97815dc50 0x7fd9780702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:57.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.560+0000 7fd977fff640 1 --2- 172.21.15.90:0/232818445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd97815d7f0 0x7fd97806fd80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd964011a50 tx=0x7fd964011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:57.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.560+0000 7fd9757fa640 1 -- 172.21.15.90:0/232818445 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96401f070 con 0x7fd97815d7f0 2024-09-10T23:16:57.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.560+0000 7fd9757fa640 1 -- 172.21.15.90:0/232818445 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd96400fe80 con 0x7fd97815d7f0 2024-09-10T23:16:57.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.560+0000 7fd97eda0640 1 -- 172.21.15.90:0/232818445 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9781f8370 con 0x7fd97815d7f0 2024-09-10T23:16:57.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.560+0000 7fd9757fa640 1 -- 172.21.15.90:0/232818445 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd964012690 con 0x7fd97815d7f0 2024-09-10T23:16:57.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.560+0000 7fd97eda0640 1 -- 172.21.15.90:0/232818445 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9781f8930 con 0x7fd97815d7f0 2024-09-10T23:16:57.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.561+0000 7fd97eda0640 1 -- 172.21.15.90:0/232818445 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd97815e970 con 0x7fd97815d7f0 2024-09-10T23:16:57.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.561+0000 7fd9757fa640 1 -- 172.21.15.90:0/232818445 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd964012830 con 0x7fd97815d7f0 2024-09-10T23:16:57.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.562+0000 7fd9757fa640 1 --2- 172.21.15.90:0/232818445 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd95c077fa0 0x7fd95c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:57.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.562+0000 7fd9757fa640 1 -- 172.21.15.90:0/232818445 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5029+0+0 (secure 0 0 0) 0x7fd96409a830 con 0x7fd97815d7f0 2024-09-10T23:16:57.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.562+0000 7fd97cb3c640 1 --2- 172.21.15.90:0/232818445 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd95c077fa0 0x7fd95c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:57.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.563+0000 7fd97cb3c640 1 --2- 172.21.15.90:0/232818445 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd95c077fa0 0x7fd95c07a460 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd96c033000 tx=0x7fd96c02d000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:57.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.566+0000 7fd9757fa640 1 -- 172.21.15.90:0/232818445 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd964062f80 con 0x7fd97815d7f0 2024-09-10T23:16:57.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.741+0000 7fd97eda0640 1 -- 172.21.15.90:0/232818445 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd9780708d0 con 0x7fd97815d7f0 2024-09-10T23:16:57.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.744+0000 7fd9757fa640 1 -- 172.21.15.90:0/232818445 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7fd9640679b0 con 0x7fd97815d7f0 2024-09-10T23:16:57.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.746+0000 7fd97eda0640 1 -- 172.21.15.90:0/232818445 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd95c077fa0 msgr2=0x7fd95c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:57.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.746+0000 7fd97eda0640 1 --2- 172.21.15.90:0/232818445 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd95c077fa0 0x7fd95c07a460 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd96c033000 tx=0x7fd96c02d000 comp rx=0 tx=0).stop 2024-09-10T23:16:57.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.746+0000 7fd97eda0640 1 -- 172.21.15.90:0/232818445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd97815d7f0 msgr2=0x7fd97806fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:57.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.746+0000 7fd97eda0640 1 --2- 172.21.15.90:0/232818445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd97815d7f0 0x7fd97806fd80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd964011a50 tx=0x7fd964011f10 comp rx=0 tx=0).stop 2024-09-10T23:16:57.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.746+0000 7fd97eda0640 1 -- 172.21.15.90:0/232818445 shutdown_connections 2024-09-10T23:16:57.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.746+0000 7fd97eda0640 1 --2- 172.21.15.90:0/232818445 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd95c077fa0 0x7fd95c07a460 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.746+0000 7fd97eda0640 1 --2- 172.21.15.90:0/232818445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd97815dc50 0x7fd9780702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.746+0000 7fd97eda0640 1 --2- 172.21.15.90:0/232818445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd97815d7f0 0x7fd97806fd80 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.746+0000 7fd97eda0640 1 --2- 172.21.15.90:0/232818445 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd968003c10 0x7fd97809c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:57.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.746+0000 7fd97eda0640 1 -- 172.21.15.90:0/232818445 >> 172.21.15.90:0/232818445 conn(0x7fd9780b19c0 msgr2=0x7fd97815aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:57.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.746+0000 7fd97eda0640 1 -- 172.21.15.90:0/232818445 shutdown_connections 2024-09-10T23:16:57.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:57.746+0000 7fd97eda0640 1 -- 172.21.15.90:0/232818445 wait complete. 2024-09-10T23:16:57.758 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:16:57.758 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:16:57.794 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:16:57.846 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:16:57.846 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:16:57.846 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:57.861 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:16:57.861 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:16:57.862 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:57.879 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:16:57.880 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:16:57.880 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:57.917 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:16:57.918 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:16:57.918 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:57.937 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:16:57.938 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:16:57.938 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:58.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.058+0000 7f6613bda640 1 -- 172.21.15.90:0/2218217541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f660c0ceca0 msgr2=0x7f660c0cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:58.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.058+0000 7f6613bda640 1 --2- 172.21.15.90:0/2218217541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f660c0ceca0 0x7f660c0cf0b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f660c0af0c0 tx=0x7f660402a820 comp rx=0 tx=0).stop 2024-09-10T23:16:58.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.059+0000 7f6613bda640 1 -- 172.21.15.90:0/2218217541 shutdown_connections 2024-09-10T23:16:58.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.059+0000 7f6613bda640 1 --2- 172.21.15.90:0/2218217541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f660c0ceca0 0x7f660c0cf0b0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:58.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.059+0000 7f6613bda640 1 --2- 172.21.15.90:0/2218217541 >> v2:172.21.15.171:3300/0 conn(0x7f660c15e970 0x7f660c0b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.059+0000 7f6613bda640 1 -- 172.21.15.90:0/2218217541 >> 172.21.15.90:0/2218217541 conn(0x7f660c0b19c0 msgr2=0x7f660c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.059+0000 7f6613bda640 1 -- 172.21.15.90:0/2218217541 shutdown_connections 2024-09-10T23:16:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.059+0000 7f6613bda640 1 -- 172.21.15.90:0/2218217541 wait complete. 2024-09-10T23:16:58.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.060+0000 7f6613bda640 1 Processor -- start 2024-09-10T23:16:58.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.060+0000 7f6613bda640 1 -- start start 2024-09-10T23:16:58.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.060+0000 7f6613bda640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f660c0b3310 0x7f660c1444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:58.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.060+0000 7f6613bda640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f660c0ceca0 0x7f660c15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:58.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f6613bda640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f660c1f6c60 0x7f660c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f6613bda640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f660c15bb40 con 0x7f660c0ceca0 2024-09-10T23:16:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f6613bda640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f660c15b9c0 con 0x7f660c0b3310 2024-09-10T23:16:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f6613bda640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f660c15bcc0 con 0x7f660c1f6c60 2024-09-10T23:16:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f6611175640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f660c0ceca0 0x7f660c15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f6611175640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f660c0ceca0 0x7f660c15abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60064/0 (socket says 172.21.15.90:60064) 2024-09-10T23:16:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f6611175640 1 -- 172.21.15.90:0/450812884 learned_addr learned my addr 172.21.15.90:0/450812884 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f6611976640 1 --2- 172.21.15.90:0/450812884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f660c0b3310 0x7f660c1444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f6612177640 1 --2- 172.21.15.90:0/450812884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f660c1f6c60 0x7f660c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f6611175640 1 -- 172.21.15.90:0/450812884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f660c1f6c60 msgr2=0x7f660c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f6611175640 1 --2- 172.21.15.90:0/450812884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f660c1f6c60 0x7f660c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f6611175640 1 -- 172.21.15.90:0/450812884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f660c0b3310 msgr2=0x7f660c1444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f6611175640 1 --2- 172.21.15.90:0/450812884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f660c0b3310 0x7f660c1444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:58.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f6611175640 1 -- 172.21.15.90:0/450812884 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660c1424f0 con 0x7f660c0ceca0 2024-09-10T23:16:58.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f6611175640 1 --2- 172.21.15.90:0/450812884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f660c0ceca0 0x7f660c15abe0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00c9a0 tx=0x7f65fc00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:58.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f66027fc640 1 -- 172.21.15.90:0/450812884 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc007bb0 con 0x7f660c0ceca0 2024-09-10T23:16:58.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f66027fc640 1 -- 172.21.15.90:0/450812884 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65fc007e40 con 0x7f660c0ceca0 2024-09-10T23:16:58.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f66027fc640 1 -- 172.21.15.90:0/450812884 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc00f690 con 0x7f660c0ceca0 2024-09-10T23:16:58.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f6613bda640 1 -- 172.21.15.90:0/450812884 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f660c144af0 con 0x7f660c0ceca0 2024-09-10T23:16:58.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.061+0000 7f6613bda640 1 -- 172.21.15.90:0/450812884 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f660c1450b0 con 0x7f660c0ceca0 2024-09-10T23:16:58.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.062+0000 7f6613bda640 1 -- 172.21.15.90:0/450812884 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f660c15c1e0 con 0x7f660c0ceca0 2024-09-10T23:16:58.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.063+0000 7f66027fc640 1 -- 172.21.15.90:0/450812884 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f65fc020030 con 0x7f660c0ceca0 2024-09-10T23:16:58.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.063+0000 7f66027fc640 1 --2- 172.21.15.90:0/450812884 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f65f0077f70 0x7f65f007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:58.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.063+0000 7f66027fc640 1 -- 172.21.15.90:0/450812884 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5029+0+0 (secure 0 0 0) 0x7f65fc099dc0 con 0x7f660c0ceca0 2024-09-10T23:16:58.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.064+0000 7f6611976640 1 --2- 172.21.15.90:0/450812884 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f65f0077f70 0x7f65f007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:58.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.064+0000 7f6611976640 1 --2- 172.21.15.90:0/450812884 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f65f0077f70 0x7f65f007a430 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6608007fd0 tx=0x7f6608009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:58.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.067+0000 7f66027fc640 1 -- 172.21.15.90:0/450812884 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f65fc014030 con 0x7f660c0ceca0 2024-09-10T23:16:58.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.279+0000 7f6613bda640 1 -- 172.21.15.90:0/450812884 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f660c1426c0 con 0x7f660c0ceca0 2024-09-10T23:16:58.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.279+0000 7f66027fc640 1 -- 172.21.15.90:0/450812884 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+3917 (secure 0 0 0) 0x7f65fc0625a0 con 0x7f660c0ceca0 2024-09-10T23:16:58.280 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:58.281 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":33,"btime":"2024-09-10T23:16:53:125744+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3624303902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3624303902},{"type":"v1","addr":"172.21.15.171:6837","nonce":3624303902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1743356090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1743356090},{"type":"v1","addr":"172.21.15.171:6836","nonce":1743356090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5910,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1318243363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1318243363},{"type":"v1","addr":"172.21.15.90:6833","nonce":1318243363}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5913,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2223930053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2223930053},{"type":"v1","addr":"172.21.15.90:6835","nonce":2223930053}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[]} 2024-09-10T23:16:58.281 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 33 2024-09-10T23:16:58.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.281+0000 7f6613bda640 1 -- 172.21.15.90:0/450812884 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f65f0077f70 msgr2=0x7f65f007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:58.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.281+0000 7f6613bda640 1 --2- 172.21.15.90:0/450812884 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f65f0077f70 0x7f65f007a430 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6608007fd0 tx=0x7f6608009040 comp rx=0 tx=0).stop 2024-09-10T23:16:58.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.281+0000 7f6613bda640 1 -- 172.21.15.90:0/450812884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f660c0ceca0 msgr2=0x7f660c15abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:58.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.281+0000 7f6613bda640 1 --2- 172.21.15.90:0/450812884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f660c0ceca0 0x7f660c15abe0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00c9a0 tx=0x7f65fc00ce60 comp rx=0 tx=0).stop 2024-09-10T23:16:58.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.282+0000 7f6613bda640 1 -- 172.21.15.90:0/450812884 shutdown_connections 2024-09-10T23:16:58.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.282+0000 7f6613bda640 1 --2- 172.21.15.90:0/450812884 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f65f0077f70 0x7f65f007a430 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:58.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.282+0000 7f6613bda640 1 --2- 172.21.15.90:0/450812884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f660c1f6c60 0x7f660c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:58.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.282+0000 7f6613bda640 1 --2- 172.21.15.90:0/450812884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f660c0ceca0 0x7f660c15abe0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:58.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.282+0000 7f6613bda640 1 --2- 172.21.15.90:0/450812884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f660c0b3310 0x7f660c1444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:58.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.282+0000 7f6613bda640 1 -- 172.21.15.90:0/450812884 >> 172.21.15.90:0/450812884 conn(0x7f660c0b19c0 msgr2=0x7f660c0ccd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:58.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.282+0000 7f6613bda640 1 -- 172.21.15.90:0/450812884 shutdown_connections 2024-09-10T23:16:58.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.282+0000 7f6613bda640 1 -- 172.21.15.90:0/450812884 wait complete. 2024-09-10T23:16:58.294 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:16:58.294 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:16:58.294 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:16:58.294 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:16:58.295 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:16:58.295 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:16:58.295 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:16:58.295 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:16:58.295 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:16:58.295 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:16:58.296 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:16:58.296 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:16:58.296 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:16:58.296 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:16:58.296 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:16:58.297 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:16:58.305 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:16:58.305 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:16:58.306 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:16:58.306 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:16:58.307 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:16:58.307 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:16:58.308 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:16:58.309 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:16:58.347 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:16:58.348 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:58.349 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:16:58.349 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:58.350 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:16:58.350 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:58.350 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:16:58.351 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:58.351 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:16:58.423 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-09-10T23:16:58.423 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-09-10T23:16:58.432 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-09-10T23:16:58.432 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-09-10T23:16:58.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.456+0000 7ff954818640 1 -- 172.21.15.90:0/2708800809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9500d16f0 msgr2=0x7ff9500d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:58.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.456+0000 7ff954818640 1 --2- 172.21.15.90:0/2708800809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9500d16f0 0x7ff9500d0fc0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff95008e8c0 tx=0x7ff94402a4d0 comp rx=0 tx=0).stop 2024-09-10T23:16:58.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.456+0000 7ff954818640 1 -- 172.21.15.90:0/2708800809 shutdown_connections 2024-09-10T23:16:58.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.456+0000 7ff954818640 1 --2- 172.21.15.90:0/2708800809 >> v2:172.21.15.171:3300/0 conn(0x7ff9500d4b80 0x7ff95006d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:58.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.456+0000 7ff954818640 1 --2- 172.21.15.90:0/2708800809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9500d16f0 0x7ff9500d0fc0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:58.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.456+0000 7ff954818640 1 --2- 172.21.15.90:0/2708800809 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff95015e310 0x7ff9500d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:58.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.456+0000 7ff954818640 1 -- 172.21.15.90:0/2708800809 >> 172.21.15.90:0/2708800809 conn(0x7ff9500d4090 msgr2=0x7ff9500d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:58.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.456+0000 7ff954818640 1 -- 172.21.15.90:0/2708800809 shutdown_connections 2024-09-10T23:16:58.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.456+0000 7ff954818640 1 -- 172.21.15.90:0/2708800809 wait complete. 2024-09-10T23:16:58.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.457+0000 7ff954818640 1 Processor -- start 2024-09-10T23:16:58.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.457+0000 7ff954818640 1 -- start start 2024-09-10T23:16:58.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.458+0000 7ff954818640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9500d16f0 0x7ff9501f7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:58.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.458+0000 7ff954818640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9500d4b80 0x7ff9500b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:58.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.458+0000 7ff954818640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff95015e310 0x7ff9501f8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:58.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.458+0000 7ff954818640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff95006dfc0 con 0x7ff95015e310 2024-09-10T23:16:58.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.458+0000 7ff954818640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff95006de40 con 0x7ff9500d4b80 2024-09-10T23:16:58.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.458+0000 7ff954818640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff95006e140 con 0x7ff9500d16f0 2024-09-10T23:16:58.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.458+0000 7ff94ed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff95015e310 0x7ff9501f8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:58.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.458+0000 7ff94ed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff95015e310 0x7ff9501f8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58882/0 (socket says 172.21.15.90:58882) 2024-09-10T23:16:58.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.458+0000 7ff94ed9d640 1 -- 172.21.15.90:0/3200949881 learned_addr learned my addr 172.21.15.90:0/3200949881 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:58.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.458+0000 7ff94dd9b640 1 --2- 172.21.15.90:0/3200949881 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9500d4b80 0x7ff9500b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:58.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.458+0000 7ff94e59c640 1 --2- 172.21.15.90:0/3200949881 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9500d16f0 0x7ff9501f7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:58.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.459+0000 7ff94ed9d640 1 -- 172.21.15.90:0/3200949881 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9500d16f0 msgr2=0x7ff9501f7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:58.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.459+0000 7ff94ed9d640 1 --2- 172.21.15.90:0/3200949881 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9500d16f0 0x7ff9501f7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:58.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.459+0000 7ff94ed9d640 1 -- 172.21.15.90:0/3200949881 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9500d4b80 msgr2=0x7ff9500b77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:58.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.459+0000 7ff94ed9d640 1 --2- 172.21.15.90:0/3200949881 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9500d4b80 0x7ff9500b77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:58.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.459+0000 7ff94ed9d640 1 -- 172.21.15.90:0/3200949881 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9500ce420 con 0x7ff95015e310 2024-09-10T23:16:58.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.459+0000 7ff94ed9d640 1 --2- 172.21.15.90:0/3200949881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff95015e310 0x7ff9501f8300 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff94800d6b0 tx=0x7ff94800db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:58.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.459+0000 7ff93effd640 1 -- 172.21.15.90:0/3200949881 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff948017070 con 0x7ff95015e310 2024-09-10T23:16:58.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.459+0000 7ff93effd640 1 -- 172.21.15.90:0/3200949881 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff948004310 con 0x7ff95015e310 2024-09-10T23:16:58.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.459+0000 7ff954818640 1 -- 172.21.15.90:0/3200949881 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9500b7d10 con 0x7ff95015e310 2024-09-10T23:16:58.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.459+0000 7ff93effd640 1 -- 172.21.15.90:0/3200949881 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff948009a80 con 0x7ff95015e310 2024-09-10T23:16:58.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.459+0000 7ff954818640 1 -- 172.21.15.90:0/3200949881 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9500b8290 con 0x7ff95015e310 2024-09-10T23:16:58.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.460+0000 7ff954818640 1 -- 172.21.15.90:0/3200949881 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff95006d6f0 con 0x7ff95015e310 2024-09-10T23:16:58.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.461+0000 7ff93effd640 1 -- 172.21.15.90:0/3200949881 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff948009c20 con 0x7ff95015e310 2024-09-10T23:16:58.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.461+0000 7ff93effd640 1 --2- 172.21.15.90:0/3200949881 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff930077ff0 0x7ff93007a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:58.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.461+0000 7ff93effd640 1 -- 172.21.15.90:0/3200949881 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5029+0+0 (secure 0 0 0) 0x7ff9480999e0 con 0x7ff95015e310 2024-09-10T23:16:58.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.461+0000 7ff94e59c640 1 --2- 172.21.15.90:0/3200949881 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff930077ff0 0x7ff93007a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:58.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.462+0000 7ff94e59c640 1 --2- 172.21.15.90:0/3200949881 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff930077ff0 0x7ff93007a4b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff940005fd0 tx=0x7ff9400095e0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:58.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.465+0000 7ff93effd640 1 -- 172.21.15.90:0/3200949881 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff9500ce420 con 0x7ff95015e310 2024-09-10T23:16:58.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:58.649+0000 7ff954818640 1 -- 172.21.15.90:0/3200949881 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff9500b4a10 con 0x7ff95015e310 2024-09-10T23:16:59.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.157+0000 7ff93effd640 1 -- 172.21.15.90:0/3200949881 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) ==== 97+0+0 (secure 0 0 0) 0x7ff9480622a0 con 0x7ff95015e310 2024-09-10T23:16:59.158 INFO:teuthology.orchestra.run.smithi090.stderr: removed all blocklist entries 2024-09-10T23:16:59.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.160+0000 7ff954818640 1 -- 172.21.15.90:0/3200949881 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff930077ff0 msgr2=0x7ff93007a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:59.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.160+0000 7ff954818640 1 --2- 172.21.15.90:0/3200949881 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff930077ff0 0x7ff93007a4b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff940005fd0 tx=0x7ff9400095e0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.160+0000 7ff954818640 1 -- 172.21.15.90:0/3200949881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff95015e310 msgr2=0x7ff9501f8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:59.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.160+0000 7ff954818640 1 --2- 172.21.15.90:0/3200949881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff95015e310 0x7ff9501f8300 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff94800d6b0 tx=0x7ff94800db70 comp rx=0 tx=0).stop 2024-09-10T23:16:59.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.160+0000 7ff954818640 1 -- 172.21.15.90:0/3200949881 shutdown_connections 2024-09-10T23:16:59.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.160+0000 7ff954818640 1 --2- 172.21.15.90:0/3200949881 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff930077ff0 0x7ff93007a4b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.160+0000 7ff954818640 1 --2- 172.21.15.90:0/3200949881 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9500d4b80 0x7ff9500b77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.160+0000 7ff954818640 1 --2- 172.21.15.90:0/3200949881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff95015e310 0x7ff9501f8300 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.160+0000 7ff954818640 1 --2- 172.21.15.90:0/3200949881 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9500d16f0 0x7ff9501f7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.160+0000 7ff954818640 1 -- 172.21.15.90:0/3200949881 >> 172.21.15.90:0/3200949881 conn(0x7ff9500d4090 msgr2=0x7ff9500b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:59.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.160+0000 7ff954818640 1 -- 172.21.15.90:0/3200949881 shutdown_connections 2024-09-10T23:16:59.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.160+0000 7ff954818640 1 -- 172.21.15.90:0/3200949881 wait complete. 2024-09-10T23:16:59.174 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:16:59.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.275+0000 7ff966023640 1 -- 172.21.15.90:0/2439798444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9600cd470 msgr2=0x7ff96015e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:59.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.275+0000 7ff966023640 1 --2- 172.21.15.90:0/2439798444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9600cd470 0x7ff96015e6c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff9600723d0 tx=0x7ff95802a580 comp rx=0 tx=0).stop 2024-09-10T23:16:59.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.275+0000 7ff966023640 1 -- 172.21.15.90:0/2439798444 shutdown_connections 2024-09-10T23:16:59.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.275+0000 7ff966023640 1 --2- 172.21.15.90:0/2439798444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9600cd470 0x7ff96015e6c0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.275+0000 7ff966023640 1 --2- 172.21.15.90:0/2439798444 >> v2:172.21.15.171:3300/0 conn(0x7ff9600cf860 0x7ff96015e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.275+0000 7ff966023640 1 --2- 172.21.15.90:0/2439798444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9600b44a0 0x7ff9600b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.275+0000 7ff966023640 1 -- 172.21.15.90:0/2439798444 >> 172.21.15.90:0/2439798444 conn(0x7ff9600b19c0 msgr2=0x7ff9600b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:59.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.275+0000 7ff966023640 1 -- 172.21.15.90:0/2439798444 shutdown_connections 2024-09-10T23:16:59.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.275+0000 7ff966023640 1 -- 172.21.15.90:0/2439798444 wait complete. 2024-09-10T23:16:59.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.276+0000 7ff966023640 1 Processor -- start 2024-09-10T23:16:59.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.276+0000 7ff966023640 1 -- start start 2024-09-10T23:16:59.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.277+0000 7ff966023640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9600b44a0 0x7ff9601f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:59.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.277+0000 7ff966023640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9600cd470 0x7ff9600addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:59.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.277+0000 7ff966023640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9600cf860 0x7ff9600cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.277+0000 7ff966023640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff96015aa40 con 0x7ff9600cd470 2024-09-10T23:16:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.277+0000 7ff966023640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff96015a8c0 con 0x7ff9600b44a0 2024-09-10T23:16:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.277+0000 7ff966023640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff96015ec00 con 0x7ff9600cf860 2024-09-10T23:16:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.277+0000 7ff95effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9600cd470 0x7ff9600addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.277+0000 7ff95effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9600cd470 0x7ff9600addd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58890/0 (socket says 172.21.15.90:58890) 2024-09-10T23:16:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.277+0000 7ff95effd640 1 -- 172.21.15.90:0/3990776431 learned_addr learned my addr 172.21.15.90:0/3990776431 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.277+0000 7ff95ffff640 1 --2- 172.21.15.90:0/3990776431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9600cf860 0x7ff9600cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.277+0000 7ff95f7fe640 1 --2- 172.21.15.90:0/3990776431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9600b44a0 0x7ff9601f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.277+0000 7ff95effd640 1 -- 172.21.15.90:0/3990776431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9600cf860 msgr2=0x7ff9600cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.277+0000 7ff95effd640 1 --2- 172.21.15.90:0/3990776431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9600cf860 0x7ff9600cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.277+0000 7ff95effd640 1 -- 172.21.15.90:0/3990776431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9600b44a0 msgr2=0x7ff9601f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.277+0000 7ff95effd640 1 --2- 172.21.15.90:0/3990776431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9600b44a0 0x7ff9601f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.277+0000 7ff95effd640 1 -- 172.21.15.90:0/3990776431 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9600ae540 con 0x7ff9600cd470 2024-09-10T23:16:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.277+0000 7ff95ffff640 1 --2- 172.21.15.90:0/3990776431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9600cf860 0x7ff9600cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.278+0000 7ff95effd640 1 --2- 172.21.15.90:0/3990776431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9600cd470 0x7ff9600addd0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff95400b390 tx=0x7ff95400b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.278+0000 7ff947fff640 1 -- 172.21.15.90:0/3990776431 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954015020 con 0x7ff9600cd470 2024-09-10T23:16:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.278+0000 7ff947fff640 1 -- 172.21.15.90:0/3990776431 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff954011920 con 0x7ff9600cd470 2024-09-10T23:16:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.278+0000 7ff966023640 1 -- 172.21.15.90:0/3990776431 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9600ae820 con 0x7ff9600cd470 2024-09-10T23:16:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.278+0000 7ff947fff640 1 -- 172.21.15.90:0/3990776431 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954011d50 con 0x7ff9600cd470 2024-09-10T23:16:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.278+0000 7ff966023640 1 -- 172.21.15.90:0/3990776431 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9600aede0 con 0x7ff9600cd470 2024-09-10T23:16:59.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.279+0000 7ff966023640 1 -- 172.21.15.90:0/3990776431 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9600ceca0 con 0x7ff9600cd470 2024-09-10T23:16:59.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.279+0000 7ff947fff640 1 -- 172.21.15.90:0/3990776431 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff95401a400 con 0x7ff9600cd470 2024-09-10T23:16:59.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.280+0000 7ff947fff640 1 --2- 172.21.15.90:0/3990776431 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff94c077f70 0x7ff94c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:59.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.280+0000 7ff947fff640 1 -- 172.21.15.90:0/3990776431 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4857+0+0 (secure 0 0 0) 0x7ff954099c10 con 0x7ff9600cd470 2024-09-10T23:16:59.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.280+0000 7ff95f7fe640 1 --2- 172.21.15.90:0/3990776431 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff94c077f70 0x7ff94c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:59.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.280+0000 7ff95f7fe640 1 --2- 172.21.15.90:0/3990776431 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff94c077f70 0x7ff94c07a430 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff950009f20 tx=0x7ff9500094f0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:59.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.284+0000 7ff947fff640 1 -- 172.21.15.90:0/3990776431 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff95401f020 con 0x7ff9600cd470 2024-09-10T23:16:59.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.528+0000 7ff966023640 1 -- 172.21.15.90:0/3990776431 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff9600cbad0 con 0x7ff9600cd470 2024-09-10T23:16:59.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.528+0000 7ff947fff640 1 -- 172.21.15.90:0/3990776431 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v27) ==== 80+0+5304 (secure 0 0 0) 0x7ff954062a60 con 0x7ff9600cd470 2024-09-10T23:16:59.529 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:59.529 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:16:59.529 INFO:teuthology.orchestra.run.smithi090.stdout: "auth_dump": [ 2024-09-10T23:16:59.529 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.a", 2024-09-10T23:16:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBm/QY6KxAAKT1mZg/6ZcszcNrPmouZfw==", 2024-09-10T23:16:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:16:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:16:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:16:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.b", 2024-09-10T23:16:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmSqPhNhAA3flpsOGFszFMeaPUoHAtJg==", 2024-09-10T23:16:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:16:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:16:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:16:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.c", 2024-09-10T23:16:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmDVE4MhAAHal/PtI10hL4nKdTUO5BiQ==", 2024-09-10T23:16:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:16:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:16:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:16:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.d", 2024-09-10T23:16:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmr3lfAhAAFdZ7zvJmGNFHRwCr+mdY7w==", 2024-09-10T23:16:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:16:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:16:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:16:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.0", 2024-09-10T23:16:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCa0uBmZKxTJRAAfEBB/vykopmDbmREyy227g==", 2024-09-10T23:16:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:16:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.1", 2024-09-10T23:16:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCd0uBmJHG8NRAAS8QD8Zgrxrxddq7kN4P9Ag==", 2024-09-10T23:16:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:16:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.2", 2024-09-10T23:16:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCh0uBmtUUmDBAAmYRv9P/wjX8HLVkLatoXuQ==", 2024-09-10T23:16:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:16:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.3", 2024-09-10T23:16:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCk0uBm4397HBAAGZK0ktD0ORY/0CPlMprYFg==", 2024-09-10T23:16:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:16:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.4", 2024-09-10T23:16:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCq0uBmBaMINBAAkuhNrc4YFAYQfcxMQenCBQ==", 2024-09-10T23:16:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:16:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.5", 2024-09-10T23:16:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCu0uBmLOrnCBAAwZTy+62ZN3g5jfH20jB4qw==", 2024-09-10T23:16:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:16:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.6", 2024-09-10T23:16:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCx0uBmr4bYChAAdWog9uHnYgiiXniefs25DA==", 2024-09-10T23:16:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:16:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.7", 2024-09-10T23:16:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQC00uBmhU7+DBAAEagAuXuCs1v/vDhIkapi+g==", 2024-09-10T23:16:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:16:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.0", 2024-09-10T23:16:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmiYBwBhAABMV9erpQ+KZlTmf0kDZ0gw==", 2024-09-10T23:16:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:16:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow r", 2024-09-10T23:16:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:16:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.1", 2024-09-10T23:16:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBm+TBDDxAA4o+iZ4PwpBRpY++ATzt+wg==", 2024-09-10T23:16:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:16:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:16:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:16:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:16:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.2", 2024-09-10T23:16:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmJYcKDBAArXISnuT+R9uzuQnL3V+wSg==", 2024-09-10T23:16:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:16:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:16:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:16:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:16:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.3", 2024-09-10T23:16:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmPQvkFBAAaCikPByOvk5xUzTWXdcFPA==", 2024-09-10T23:16:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:16:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:16:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:16:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:16:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.admin", 2024-09-10T23:16:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmVVIQEBAAY7yzFxxQCyV1YCM3xYC7Og==", 2024-09-10T23:16:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:16:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:16:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:16:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.x", 2024-09-10T23:16:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBm4r0EKBAAIZ4VjoTsUpdB6KFbi7EQLQ==", 2024-09-10T23:16:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:16:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2024-09-10T23:16:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:16:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.y", 2024-09-10T23:16:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmkRSfJBAAWPpV5e4zeX0Es78Xqh9pYw==", 2024-09-10T23:16:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:16:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:16:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2024-09-10T23:16:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:16:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-10T23:16:59.542 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:16:59.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.530+0000 7ff966023640 1 -- 172.21.15.90:0/3990776431 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff94c077f70 msgr2=0x7ff94c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:59.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.530+0000 7ff966023640 1 --2- 172.21.15.90:0/3990776431 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff94c077f70 0x7ff94c07a430 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff950009f20 tx=0x7ff9500094f0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.530+0000 7ff966023640 1 -- 172.21.15.90:0/3990776431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9600cd470 msgr2=0x7ff9600addd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:59.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.530+0000 7ff966023640 1 --2- 172.21.15.90:0/3990776431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9600cd470 0x7ff9600addd0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff95400b390 tx=0x7ff95400b850 comp rx=0 tx=0).stop 2024-09-10T23:16:59.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.530+0000 7ff966023640 1 -- 172.21.15.90:0/3990776431 shutdown_connections 2024-09-10T23:16:59.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.530+0000 7ff966023640 1 --2- 172.21.15.90:0/3990776431 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff94c077f70 0x7ff94c07a430 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.530+0000 7ff966023640 1 --2- 172.21.15.90:0/3990776431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9600cf860 0x7ff9600cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.530+0000 7ff966023640 1 --2- 172.21.15.90:0/3990776431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9600cd470 0x7ff9600addd0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.530+0000 7ff966023640 1 --2- 172.21.15.90:0/3990776431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9600b44a0 0x7ff9601f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.531+0000 7ff966023640 1 -- 172.21.15.90:0/3990776431 >> 172.21.15.90:0/3990776431 conn(0x7ff9600b19c0 msgr2=0x7ff9600cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:59.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.531+0000 7ff966023640 1 -- 172.21.15.90:0/3990776431 shutdown_connections 2024-09-10T23:16:59.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.531+0000 7ff966023640 1 -- 172.21.15.90:0/3990776431 wait complete. 2024-09-10T23:16:59.545 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:16:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.646+0000 7f7cafcbd640 1 -- 172.21.15.90:0/823582163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ca815a1d0 msgr2=0x7f7ca80cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.646+0000 7f7cafcbd640 1 --2- 172.21.15.90:0/823582163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ca815a1d0 0x7f7ca80cdb90 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7ca806e640 tx=0x7f7ca402adc0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.646+0000 7f7cafcbd640 1 -- 172.21.15.90:0/823582163 shutdown_connections 2024-09-10T23:16:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.646+0000 7f7cafcbd640 1 --2- 172.21.15.90:0/823582163 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ca806f860 0x7f7ca806fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.646+0000 7f7cafcbd640 1 --2- 172.21.15.90:0/823582163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ca815a1d0 0x7f7ca80cdb90 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.646+0000 7f7cafcbd640 1 -- 172.21.15.90:0/823582163 >> 172.21.15.90:0/823582163 conn(0x7f7ca80b19c0 msgr2=0x7f7ca80b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.646+0000 7f7cafcbd640 1 -- 172.21.15.90:0/823582163 shutdown_connections 2024-09-10T23:16:59.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.646+0000 7f7cafcbd640 1 -- 172.21.15.90:0/823582163 wait complete. 2024-09-10T23:16:59.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.647+0000 7f7cafcbd640 1 Processor -- start 2024-09-10T23:16:59.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.647+0000 7f7cafcbd640 1 -- start start 2024-09-10T23:16:59.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cafcbd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ca806e6f0 0x7f7ca809d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:59.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cafcbd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ca806f860 0x7f7ca809aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:59.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cafcbd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ca815a1d0 0x7f7ca81f6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:59.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cafcbd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca8070ac0 con 0x7f7ca806e6f0 2024-09-10T23:16:59.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cafcbd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca80b43e0 con 0x7f7ca806f860 2024-09-10T23:16:59.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cafcbd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca809caa0 con 0x7f7ca815a1d0 2024-09-10T23:16:59.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cada59640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ca806e6f0 0x7f7ca809d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:59.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cada59640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ca806e6f0 0x7f7ca809d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58902/0 (socket says 172.21.15.90:58902) 2024-09-10T23:16:59.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cada59640 1 -- 172.21.15.90:0/1498759717 learned_addr learned my addr 172.21.15.90:0/1498759717 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:59.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cad258640 1 --2- 172.21.15.90:0/1498759717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ca806f860 0x7f7ca809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:59.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cada59640 1 -- 172.21.15.90:0/1498759717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ca815a1d0 msgr2=0x7f7ca81f6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:59.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cae25a640 1 --2- 172.21.15.90:0/1498759717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ca815a1d0 0x7f7ca81f6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:59.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cada59640 1 --2- 172.21.15.90:0/1498759717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ca815a1d0 0x7f7ca81f6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cada59640 1 -- 172.21.15.90:0/1498759717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ca806f860 msgr2=0x7f7ca809aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:59.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cada59640 1 --2- 172.21.15.90:0/1498759717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ca806f860 0x7f7ca809aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cada59640 1 -- 172.21.15.90:0/1498759717 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca809cd80 con 0x7f7ca806e6f0 2024-09-10T23:16:59.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cada59640 1 --2- 172.21.15.90:0/1498759717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ca806e6f0 0x7f7ca809d860 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4000c00 tx=0x7f7ca4009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:59.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7c9e7fc640 1 -- 172.21.15.90:0/1498759717 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4040020 con 0x7f7ca806e6f0 2024-09-10T23:16:59.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7c9e7fc640 1 -- 172.21.15.90:0/1498759717 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ca402b910 con 0x7f7ca806e6f0 2024-09-10T23:16:59.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7c9e7fc640 1 -- 172.21.15.90:0/1498759717 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca402bd60 con 0x7f7ca806e6f0 2024-09-10T23:16:59.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cafcbd640 1 -- 172.21.15.90:0/1498759717 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca809d060 con 0x7f7ca806e6f0 2024-09-10T23:16:59.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.648+0000 7f7cafcbd640 1 -- 172.21.15.90:0/1498759717 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca809c750 con 0x7f7ca806e6f0 2024-09-10T23:16:59.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.649+0000 7f7cafcbd640 1 -- 172.21.15.90:0/1498759717 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca806fcf0 con 0x7f7ca806e6f0 2024-09-10T23:16:59.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.650+0000 7f7c9e7fc640 1 -- 172.21.15.90:0/1498759717 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7ca40035f0 con 0x7f7ca806e6f0 2024-09-10T23:16:59.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.651+0000 7f7c9e7fc640 1 --2- 172.21.15.90:0/1498759717 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c8c077f70 0x7f7c8c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:59.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.651+0000 7f7c9e7fc640 1 -- 172.21.15.90:0/1498759717 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4857+0+0 (secure 0 0 0) 0x7f7ca40ba100 con 0x7f7ca806e6f0 2024-09-10T23:16:59.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.651+0000 7f7cad258640 1 --2- 172.21.15.90:0/1498759717 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c8c077f70 0x7f7c8c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:59.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.651+0000 7f7cad258640 1 --2- 172.21.15.90:0/1498759717 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c8c077f70 0x7f7c8c07a430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8159120 tx=0x7f7c98009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:59.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.655+0000 7f7c9e7fc640 1 -- 172.21.15.90:0/1498759717 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7ca404a030 con 0x7f7ca806e6f0 2024-09-10T23:16:59.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.830+0000 7f7cafcbd640 1 -- 172.21.15.90:0/1498759717 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7ca80ce6c0 con 0x7f7ca806e6f0 2024-09-10T23:16:59.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.830+0000 7f7c9e7fc640 1 -- 172.21.15.90:0/1498759717 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) ==== 84+0+65 (secure 0 0 0) 0x7f7ca4082fe0 con 0x7f7ca806e6f0 2024-09-10T23:16:59.831 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:16:59.832 INFO:teuthology.orchestra.run.smithi090.stdout:[ 2024-09-10T23:16:59.832 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:16:59.832 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 1, 2024-09-10T23:16:59.832 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": ".mgr" 2024-09-10T23:16:59.832 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:16:59.832 INFO:teuthology.orchestra.run.smithi090.stdout:] 2024-09-10T23:16:59.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.832+0000 7f7cafcbd640 1 -- 172.21.15.90:0/1498759717 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c8c077f70 msgr2=0x7f7c8c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:59.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.832+0000 7f7cafcbd640 1 --2- 172.21.15.90:0/1498759717 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c8c077f70 0x7f7c8c07a430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8159120 tx=0x7f7c98009040 comp rx=0 tx=0).stop 2024-09-10T23:16:59.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.832+0000 7f7cafcbd640 1 -- 172.21.15.90:0/1498759717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ca806e6f0 msgr2=0x7f7ca809d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:59.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.832+0000 7f7cafcbd640 1 --2- 172.21.15.90:0/1498759717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ca806e6f0 0x7f7ca809d860 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4000c00 tx=0x7f7ca4009850 comp rx=0 tx=0).stop 2024-09-10T23:16:59.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.832+0000 7f7cafcbd640 1 -- 172.21.15.90:0/1498759717 shutdown_connections 2024-09-10T23:16:59.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.832+0000 7f7cafcbd640 1 --2- 172.21.15.90:0/1498759717 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c8c077f70 0x7f7c8c07a430 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.832+0000 7f7cafcbd640 1 --2- 172.21.15.90:0/1498759717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ca806f860 0x7f7ca809aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.833+0000 7f7cafcbd640 1 --2- 172.21.15.90:0/1498759717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ca815a1d0 0x7f7ca81f6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.833+0000 7f7cafcbd640 1 --2- 172.21.15.90:0/1498759717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ca806e6f0 0x7f7ca809d860 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.833+0000 7f7cafcbd640 1 -- 172.21.15.90:0/1498759717 >> 172.21.15.90:0/1498759717 conn(0x7f7ca80b19c0 msgr2=0x7f7ca8073cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:59.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.833+0000 7f7cafcbd640 1 -- 172.21.15.90:0/1498759717 shutdown_connections 2024-09-10T23:16:59.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.833+0000 7f7cafcbd640 1 -- 172.21.15.90:0/1498759717 wait complete. 2024-09-10T23:16:59.845 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:16:59.845 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:16:59.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.950+0000 7f78d99a3640 1 -- 172.21.15.90:0/3870553557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d06f0 msgr2=0x7f78d40cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:59.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.950+0000 7f78d99a3640 1 --2- 172.21.15.90:0/3870553557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d06f0 0x7f78d40cfde0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f78c4005fd0 tx=0x7f78c402a8b0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.950+0000 7f78d99a3640 1 -- 172.21.15.90:0/3870553557 shutdown_connections 2024-09-10T23:16:59.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.950+0000 7f78d99a3640 1 --2- 172.21.15.90:0/3870553557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d40d0ad0 0x7f78d40cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.950+0000 7f78d99a3640 1 --2- 172.21.15.90:0/3870553557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d06f0 0x7f78d40cfde0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.950+0000 7f78d99a3640 1 -- 172.21.15.90:0/3870553557 >> 172.21.15.90:0/3870553557 conn(0x7f78d40d1ec0 msgr2=0x7f78d40d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:59.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.950+0000 7f78d99a3640 1 -- 172.21.15.90:0/3870553557 shutdown_connections 2024-09-10T23:16:59.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.950+0000 7f78d99a3640 1 -- 172.21.15.90:0/3870553557 wait complete. 2024-09-10T23:16:59.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.951+0000 7f78d99a3640 1 Processor -- start 2024-09-10T23:16:59.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.951+0000 7f78d99a3640 1 -- start start 2024-09-10T23:16:59.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.952+0000 7f78d99a3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d40b31a0 0x7f78d40cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:59.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.952+0000 7f78d99a3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d06f0 0x7f78d40c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.952+0000 7f78d99a3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d40d0ad0 0x7f78d40c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.952+0000 7f78d99a3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f78d40cd950 con 0x7f78d40d06f0 2024-09-10T23:16:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.952+0000 7f78d99a3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f78d40cd7d0 con 0x7f78d40b31a0 2024-09-10T23:16:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.952+0000 7f78d99a3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f78d40b1820 con 0x7f78d40d0ad0 2024-09-10T23:16:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.952+0000 7f78d27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d06f0 0x7f78d40c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.952+0000 7f78d27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d06f0 0x7f78d40c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58918/0 (socket says 172.21.15.90:58918) 2024-09-10T23:16:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.952+0000 7f78d27fc640 1 -- 172.21.15.90:0/1047318376 learned_addr learned my addr 172.21.15.90:0/1047318376 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:16:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.952+0000 7f78d37fe640 1 --2- 172.21.15.90:0/1047318376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d40d0ad0 0x7f78d40c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.952+0000 7f78d2ffd640 1 --2- 172.21.15.90:0/1047318376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d40b31a0 0x7f78d40cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.952+0000 7f78d27fc640 1 -- 172.21.15.90:0/1047318376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d40d0ad0 msgr2=0x7f78d40c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.952+0000 7f78d27fc640 1 --2- 172.21.15.90:0/1047318376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d40d0ad0 0x7f78d40c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.952+0000 7f78d27fc640 1 -- 172.21.15.90:0/1047318376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d40b31a0 msgr2=0x7f78d40cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:59.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.952+0000 7f78d27fc640 1 --2- 172.21.15.90:0/1047318376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d40b31a0 0x7f78d40cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:59.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.952+0000 7f78d27fc640 1 -- 172.21.15.90:0/1047318376 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d40cb240 con 0x7f78d40d06f0 2024-09-10T23:16:59.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.953+0000 7f78d27fc640 1 --2- 172.21.15.90:0/1047318376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d06f0 0x7f78d40c7bc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00c450 tx=0x7f78bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:59.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.953+0000 7f78cbfff640 1 -- 172.21.15.90:0/1047318376 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc016020 con 0x7f78d40d06f0 2024-09-10T23:16:59.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.953+0000 7f78cbfff640 1 -- 172.21.15.90:0/1047318376 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78bc012940 con 0x7f78d40d06f0 2024-09-10T23:16:59.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.953+0000 7f78d99a3640 1 -- 172.21.15.90:0/1047318376 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d40cb520 con 0x7f78d40d06f0 2024-09-10T23:16:59.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.953+0000 7f78cbfff640 1 -- 172.21.15.90:0/1047318376 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc012d90 con 0x7f78d40d06f0 2024-09-10T23:16:59.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.953+0000 7f78d99a3640 1 -- 172.21.15.90:0/1047318376 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d40cbae0 con 0x7f78d40d06f0 2024-09-10T23:16:59.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.954+0000 7f78d99a3640 1 -- 172.21.15.90:0/1047318376 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d409fe20 con 0x7f78d40d06f0 2024-09-10T23:16:59.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.955+0000 7f78cbfff640 1 -- 172.21.15.90:0/1047318376 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f78bc01a3b0 con 0x7f78d40d06f0 2024-09-10T23:16:59.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.955+0000 7f78cbfff640 1 --2- 172.21.15.90:0/1047318376 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78b4077f70 0x7f78b407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:59.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.955+0000 7f78cbfff640 1 -- 172.21.15.90:0/1047318376 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4857+0+0 (secure 0 0 0) 0x7f78bc0998d0 con 0x7f78d40d06f0 2024-09-10T23:16:59.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.955+0000 7f78d2ffd640 1 --2- 172.21.15.90:0/1047318376 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78b4077f70 0x7f78b407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:59.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.956+0000 7f78d2ffd640 1 --2- 172.21.15.90:0/1047318376 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78b4077f70 0x7f78b407a430 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f78c4034000 tx=0x7f78c4004ab0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:59.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:16:59.959+0000 7f78cbfff640 1 -- 172.21.15.90:0/1047318376 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f78bc020030 con 0x7f78d40d06f0 2024-09-10T23:17:00.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.134+0000 7f78d99a3640 1 -- 172.21.15.90:0/1047318376 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f78d40b1600 con 0x7f78d40d06f0 2024-09-10T23:17:00.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.166+0000 7f78cbfff640 1 -- 172.21.15.90:0/1047318376 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) ==== 138+0+0 (secure 0 0 0) 0x7f78bc062190 con 0x7f78d40d06f0 2024-09-10T23:17:00.167 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' created 2024-09-10T23:17:00.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.168+0000 7f78d99a3640 1 -- 172.21.15.90:0/1047318376 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78b4077f70 msgr2=0x7f78b407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:00.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.168+0000 7f78d99a3640 1 --2- 172.21.15.90:0/1047318376 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78b4077f70 0x7f78b407a430 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f78c4034000 tx=0x7f78c4004ab0 comp rx=0 tx=0).stop 2024-09-10T23:17:00.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.168+0000 7f78d99a3640 1 -- 172.21.15.90:0/1047318376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d06f0 msgr2=0x7f78d40c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:00.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.168+0000 7f78d99a3640 1 --2- 172.21.15.90:0/1047318376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d06f0 0x7f78d40c7bc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00c450 tx=0x7f78bc00c910 comp rx=0 tx=0).stop 2024-09-10T23:17:00.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.168+0000 7f78d99a3640 1 -- 172.21.15.90:0/1047318376 shutdown_connections 2024-09-10T23:17:00.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.168+0000 7f78d99a3640 1 --2- 172.21.15.90:0/1047318376 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78b4077f70 0x7f78b407a430 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:00.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.168+0000 7f78d99a3640 1 --2- 172.21.15.90:0/1047318376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d40d0ad0 0x7f78d40c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:00.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.168+0000 7f78d99a3640 1 --2- 172.21.15.90:0/1047318376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d06f0 0x7f78d40c7bc0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:00.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.168+0000 7f78d99a3640 1 --2- 172.21.15.90:0/1047318376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d40b31a0 0x7f78d40cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:00.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.168+0000 7f78d99a3640 1 -- 172.21.15.90:0/1047318376 >> 172.21.15.90:0/1047318376 conn(0x7f78d40d1ec0 msgr2=0x7f78d40d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:00.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.169+0000 7f78d99a3640 1 -- 172.21.15.90:0/1047318376 shutdown_connections 2024-09-10T23:17:00.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.169+0000 7f78d99a3640 1 -- 172.21.15.90:0/1047318376 wait complete. 2024-09-10T23:17:00.183 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:17:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.290+0000 7f25c7cb6640 1 -- 172.21.15.90:0/3861856426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25c015a1d0 msgr2=0x7f25c00cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.290+0000 7f25c7cb6640 1 --2- 172.21.15.90:0/3861856426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25c015a1d0 0x7f25c00cdb90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f25c015dc50 tx=0x7f25bc02a4a0 comp rx=0 tx=0).stop 2024-09-10T23:17:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.290+0000 7f25c7cb6640 1 -- 172.21.15.90:0/3861856426 shutdown_connections 2024-09-10T23:17:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.290+0000 7f25c7cb6640 1 --2- 172.21.15.90:0/3861856426 >> v2:172.21.15.171:3300/0 conn(0x7f25c006f860 0x7f25c006fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.290+0000 7f25c7cb6640 1 --2- 172.21.15.90:0/3861856426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25c015a1d0 0x7f25c00cdb90 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.290+0000 7f25c7cb6640 1 -- 172.21.15.90:0/3861856426 >> 172.21.15.90:0/3861856426 conn(0x7f25c00b19c0 msgr2=0x7f25c00b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.290+0000 7f25c7cb6640 1 -- 172.21.15.90:0/3861856426 shutdown_connections 2024-09-10T23:17:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.290+0000 7f25c7cb6640 1 -- 172.21.15.90:0/3861856426 wait complete. 2024-09-10T23:17:00.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.291+0000 7f25c7cb6640 1 Processor -- start 2024-09-10T23:17:00.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.291+0000 7f25c7cb6640 1 -- start start 2024-09-10T23:17:00.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c7cb6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25c006e6f0 0x7f25c0149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:00.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c7cb6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25c006f860 0x7f25c009ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:00.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c7cb6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25c015a1d0 0x7f25c009cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:00.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c7cb6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f25c0070a30 con 0x7f25c006f860 2024-09-10T23:17:00.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c7cb6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f25c00708b0 con 0x7f25c015a1d0 2024-09-10T23:17:00.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c7cb6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f25c00b4c70 con 0x7f25c006e6f0 2024-09-10T23:17:00.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c5251640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25c006f860 0x7f25c009ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:00.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c5251640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25c006f860 0x7f25c009ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58936/0 (socket says 172.21.15.90:58936) 2024-09-10T23:17:00.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c5251640 1 -- 172.21.15.90:0/1513137734 learned_addr learned my addr 172.21.15.90:0/1513137734 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:00.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c6253640 1 --2- 172.21.15.90:0/1513137734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25c015a1d0 0x7f25c009cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:00.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c5a52640 1 --2- 172.21.15.90:0/1513137734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25c006e6f0 0x7f25c0149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:00.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c5251640 1 -- 172.21.15.90:0/1513137734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25c006e6f0 msgr2=0x7f25c0149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:00.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c5251640 1 --2- 172.21.15.90:0/1513137734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25c006e6f0 0x7f25c0149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:00.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c5251640 1 -- 172.21.15.90:0/1513137734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25c015a1d0 msgr2=0x7f25c009cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:00.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c5251640 1 --2- 172.21.15.90:0/1513137734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25c015a1d0 0x7f25c009cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:00.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c5251640 1 -- 172.21.15.90:0/1513137734 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c01f28d0 con 0x7f25c006f860 2024-09-10T23:17:00.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c6253640 1 --2- 172.21.15.90:0/1513137734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25c015a1d0 0x7f25c009cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:00.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c5251640 1 --2- 172.21.15.90:0/1513137734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25c006f860 0x7f25c009ca60 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f25b000c500 tx=0x7f25b000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:00.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25b67fc640 1 -- 172.21.15.90:0/1513137734 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0017070 con 0x7f25c006f860 2024-09-10T23:17:00.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25b67fc640 1 -- 172.21.15.90:0/1513137734 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25b00035f0 con 0x7f25c006f860 2024-09-10T23:17:00.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25b67fc640 1 -- 172.21.15.90:0/1513137734 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0003a40 con 0x7f25c006f860 2024-09-10T23:17:00.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c7cb6640 1 -- 172.21.15.90:0/1513137734 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c01f2bb0 con 0x7f25c006f860 2024-09-10T23:17:00.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.292+0000 7f25c7cb6640 1 -- 172.21.15.90:0/1513137734 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c01f3170 con 0x7f25c006f860 2024-09-10T23:17:00.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.293+0000 7f25c7cb6640 1 -- 172.21.15.90:0/1513137734 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c01f34a0 con 0x7f25c006f860 2024-09-10T23:17:00.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.294+0000 7f25b67fc640 1 -- 172.21.15.90:0/1513137734 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f25b0003be0 con 0x7f25c006f860 2024-09-10T23:17:00.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.294+0000 7f25b67fc640 1 --2- 172.21.15.90:0/1513137734 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f25a4077f70 0x7f25a407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:00.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.294+0000 7f25b67fc640 1 -- 172.21.15.90:0/1513137734 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5227+0+0 (secure 0 0 0) 0x7f25b0099340 con 0x7f25c006f860 2024-09-10T23:17:00.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.295+0000 7f25c5a52640 1 --2- 172.21.15.90:0/1513137734 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f25a4077f70 0x7f25a407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:00.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.295+0000 7f25c5a52640 1 --2- 172.21.15.90:0/1513137734 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f25a4077f70 0x7f25a407a430 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f25bc034000 tx=0x7f25bc004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:00.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.299+0000 7f25b67fc640 1 -- 172.21.15.90:0/1513137734 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f25b00620b0 con 0x7f25c006f860 2024-09-10T23:17:00.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:00.475+0000 7f25c7cb6640 1 -- 172.21.15.90:0/1513137734 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f25c006fcf0 con 0x7f25c006f860 2024-09-10T23:17:01.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.172+0000 7f25b67fc640 1 -- 172.21.15.90:0/1513137734 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) ==== 170+0+0 (secure 0 0 0) 0x7f25b00619b0 con 0x7f25c006f860 2024-09-10T23:17:01.173 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' created 2024-09-10T23:17:01.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.175+0000 7f25c7cb6640 1 -- 172.21.15.90:0/1513137734 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f25a4077f70 msgr2=0x7f25a407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:01.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.175+0000 7f25c7cb6640 1 --2- 172.21.15.90:0/1513137734 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f25a4077f70 0x7f25a407a430 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f25bc034000 tx=0x7f25bc004730 comp rx=0 tx=0).stop 2024-09-10T23:17:01.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.175+0000 7f25c7cb6640 1 -- 172.21.15.90:0/1513137734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25c006f860 msgr2=0x7f25c009ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:01.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.175+0000 7f25c7cb6640 1 --2- 172.21.15.90:0/1513137734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25c006f860 0x7f25c009ca60 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f25b000c500 tx=0x7f25b000c9c0 comp rx=0 tx=0).stop 2024-09-10T23:17:01.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.175+0000 7f25c7cb6640 1 -- 172.21.15.90:0/1513137734 shutdown_connections 2024-09-10T23:17:01.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.175+0000 7f25c7cb6640 1 --2- 172.21.15.90:0/1513137734 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f25a4077f70 0x7f25a407a430 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:01.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.175+0000 7f25c7cb6640 1 --2- 172.21.15.90:0/1513137734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25c015a1d0 0x7f25c009cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:01.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.175+0000 7f25c7cb6640 1 --2- 172.21.15.90:0/1513137734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25c006f860 0x7f25c009ca60 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:01.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.175+0000 7f25c7cb6640 1 --2- 172.21.15.90:0/1513137734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25c006e6f0 0x7f25c0149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:01.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.175+0000 7f25c7cb6640 1 -- 172.21.15.90:0/1513137734 >> 172.21.15.90:0/1513137734 conn(0x7f25c00b19c0 msgr2=0x7f25c00afc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:01.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.175+0000 7f25c7cb6640 1 -- 172.21.15.90:0/1513137734 shutdown_connections 2024-09-10T23:17:01.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.175+0000 7f25c7cb6640 1 -- 172.21.15.90:0/1513137734 wait complete. 2024-09-10T23:17:01.197 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:17:01.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.304+0000 7f4efcb52640 1 -- 172.21.15.90:0/2738929937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ef80cf860 msgr2=0x7f4ef815e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:01.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.304+0000 7f4efcb52640 1 --2- 172.21.15.90:0/2738929937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ef80cf860 0x7f4ef815e180 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80cbe30 tx=0x7f4ee002a560 comp rx=0 tx=0).stop 2024-09-10T23:17:01.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.304+0000 7f4efcb52640 1 -- 172.21.15.90:0/2738929937 shutdown_connections 2024-09-10T23:17:01.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.304+0000 7f4efcb52640 1 --2- 172.21.15.90:0/2738929937 >> v2:172.21.15.171:3300/0 conn(0x7f4ef80cd470 0x7f4ef815e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:01.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.304+0000 7f4efcb52640 1 --2- 172.21.15.90:0/2738929937 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ef80cf860 0x7f4ef815e180 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:01.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.304+0000 7f4efcb52640 1 --2- 172.21.15.90:0/2738929937 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ef80b44a0 0x7f4ef80b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:01.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.304+0000 7f4efcb52640 1 -- 172.21.15.90:0/2738929937 >> 172.21.15.90:0/2738929937 conn(0x7f4ef80b19c0 msgr2=0x7f4ef80b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:01.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.304+0000 7f4efcb52640 1 -- 172.21.15.90:0/2738929937 shutdown_connections 2024-09-10T23:17:01.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.304+0000 7f4efcb52640 1 -- 172.21.15.90:0/2738929937 wait complete. 2024-09-10T23:17:01.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.306+0000 7f4efcb52640 1 Processor -- start 2024-09-10T23:17:01.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.306+0000 7f4efcb52640 1 -- start start 2024-09-10T23:17:01.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4efcb52640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ef80b44a0 0x7f4ef80b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:01.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4efcb52640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef80cd470 0x7f4ef80b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:01.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4efcb52640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ef80cf860 0x7f4ef814e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:01.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4efcb52640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef815aa40 con 0x7f4ef80b44a0 2024-09-10T23:17:01.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4efcb52640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef815a8c0 con 0x7f4ef80cd470 2024-09-10T23:17:01.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4efcb52640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef815ec00 con 0x7f4ef80cf860 2024-09-10T23:17:01.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4ef659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ef80b44a0 0x7f4ef80b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:01.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4ef659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ef80b44a0 0x7f4ef80b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58950/0 (socket says 172.21.15.90:58950) 2024-09-10T23:17:01.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4ef659c640 1 -- 172.21.15.90:0/2014409571 learned_addr learned my addr 172.21.15.90:0/2014409571 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:01.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4eedd9b640 1 --2- 172.21.15.90:0/2014409571 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef80cd470 0x7f4ef80b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:01.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4ef6d9d640 1 --2- 172.21.15.90:0/2014409571 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ef80cf860 0x7f4ef814e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:01.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4ef659c640 1 -- 172.21.15.90:0/2014409571 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ef80cf860 msgr2=0x7f4ef814e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:01.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4ef659c640 1 --2- 172.21.15.90:0/2014409571 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ef80cf860 0x7f4ef814e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:01.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4ef659c640 1 -- 172.21.15.90:0/2014409571 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef80cd470 msgr2=0x7f4ef80b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:01.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4ef659c640 1 --2- 172.21.15.90:0/2014409571 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef80cd470 0x7f4ef80b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:01.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4ef659c640 1 -- 172.21.15.90:0/2014409571 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef8151c40 con 0x7f4ef80b44a0 2024-09-10T23:17:01.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4ef659c640 1 --2- 172.21.15.90:0/2014409571 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ef80b44a0 0x7f4ef80b0d10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800d770 tx=0x7f4ee800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:01.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4eef7fe640 1 -- 172.21.15.90:0/2014409571 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8017070 con 0x7f4ef80b44a0 2024-09-10T23:17:01.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4eef7fe640 1 -- 172.21.15.90:0/2014409571 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ee8009d20 con 0x7f4ef80b44a0 2024-09-10T23:17:01.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4efcb52640 1 -- 172.21.15.90:0/2014409571 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef81f84a0 con 0x7f4ef80b44a0 2024-09-10T23:17:01.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.307+0000 7f4eef7fe640 1 -- 172.21.15.90:0/2014409571 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee80106c0 con 0x7f4ef80b44a0 2024-09-10T23:17:01.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.308+0000 7f4efcb52640 1 -- 172.21.15.90:0/2014409571 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef81f8a60 con 0x7f4ef80b44a0 2024-09-10T23:17:01.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.308+0000 7f4efcb52640 1 -- 172.21.15.90:0/2014409571 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef80b4880 con 0x7f4ef80b44a0 2024-09-10T23:17:01.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.309+0000 7f4eef7fe640 1 -- 172.21.15.90:0/2014409571 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4ee8010860 con 0x7f4ef80b44a0 2024-09-10T23:17:01.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.310+0000 7f4eef7fe640 1 --2- 172.21.15.90:0/2014409571 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4ed8077f70 0x7f4ed807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:01.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.310+0000 7f4eef7fe640 1 -- 172.21.15.90:0/2014409571 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5609+0+0 (secure 0 0 0) 0x7f4ee809a060 con 0x7f4ef80b44a0 2024-09-10T23:17:01.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.310+0000 7f4eedd9b640 1 --2- 172.21.15.90:0/2014409571 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4ed8077f70 0x7f4ed807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:01.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.310+0000 7f4eedd9b640 1 --2- 172.21.15.90:0/2014409571 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4ed8077f70 0x7f4ed807a430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0033000 tx=0x7f4ee0004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:01.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.314+0000 7f4eef7fe640 1 -- 172.21.15.90:0/2014409571 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4ef8151c40 con 0x7f4ef80b44a0 2024-09-10T23:17:01.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:01.523+0000 7f4efcb52640 1 -- 172.21.15.90:0/2014409571 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4ef80afbd0 con 0x7f4ef80b44a0 2024-09-10T23:17:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.177+0000 7f4eef7fe640 1 -- 172.21.15.90:0/2014409571 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v36) ==== 174+0+0 (secure 0 0 0) 0x7f4ee8062600 con 0x7f4ef80b44a0 2024-09-10T23:17:02.179 INFO:teuthology.orchestra.run.smithi090.stderr:new fs with metadata pool 10 and data pool 11 2024-09-10T23:17:02.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.189+0000 7f4efcb52640 1 -- 172.21.15.90:0/2014409571 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4ed8077f70 msgr2=0x7f4ed807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:02.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.189+0000 7f4efcb52640 1 --2- 172.21.15.90:0/2014409571 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4ed8077f70 0x7f4ed807a430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0033000 tx=0x7f4ee0004730 comp rx=0 tx=0).stop 2024-09-10T23:17:02.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.189+0000 7f4efcb52640 1 -- 172.21.15.90:0/2014409571 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ef80b44a0 msgr2=0x7f4ef80b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:02.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.189+0000 7f4efcb52640 1 --2- 172.21.15.90:0/2014409571 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ef80b44a0 0x7f4ef80b0d10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800d770 tx=0x7f4ee800dc30 comp rx=0 tx=0).stop 2024-09-10T23:17:02.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.189+0000 7f4efcb52640 1 -- 172.21.15.90:0/2014409571 shutdown_connections 2024-09-10T23:17:02.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.189+0000 7f4efcb52640 1 --2- 172.21.15.90:0/2014409571 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4ed8077f70 0x7f4ed807a430 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.189+0000 7f4efcb52640 1 --2- 172.21.15.90:0/2014409571 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef80cd470 0x7f4ef80b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.189+0000 7f4efcb52640 1 --2- 172.21.15.90:0/2014409571 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ef80cf860 0x7f4ef814e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.189+0000 7f4efcb52640 1 --2- 172.21.15.90:0/2014409571 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ef80b44a0 0x7f4ef80b0d10 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.189+0000 7f4efcb52640 1 -- 172.21.15.90:0/2014409571 >> 172.21.15.90:0/2014409571 conn(0x7f4ef80b19c0 msgr2=0x7f4ef806fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:02.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.189+0000 7f4efcb52640 1 -- 172.21.15.90:0/2014409571 shutdown_connections 2024-09-10T23:17:02.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.189+0000 7f4efcb52640 1 -- 172.21.15.90:0/2014409571 wait complete. 2024-09-10T23:17:02.207 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:17:02.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.309+0000 7f9a880f7640 1 -- 172.21.15.90:0/273653024 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a800d16f0 msgr2=0x7f9a800d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:02.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.309+0000 7f9a880f7640 1 --2- 172.21.15.90:0/273653024 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a800d16f0 0x7f9a800d0fc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009830 tx=0x7f9a7402a480 comp rx=0 tx=0).stop 2024-09-10T23:17:02.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.309+0000 7f9a880f7640 1 -- 172.21.15.90:0/273653024 shutdown_connections 2024-09-10T23:17:02.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.309+0000 7f9a880f7640 1 --2- 172.21.15.90:0/273653024 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a800d16f0 0x7f9a800d0fc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.309+0000 7f9a880f7640 1 --2- 172.21.15.90:0/273653024 >> v2:172.21.15.171:3300/0 conn(0x7f9a8015e310 0x7f9a800d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.309+0000 7f9a880f7640 1 -- 172.21.15.90:0/273653024 >> 172.21.15.90:0/273653024 conn(0x7f9a800d4090 msgr2=0x7f9a800d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:02.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.309+0000 7f9a880f7640 1 -- 172.21.15.90:0/273653024 shutdown_connections 2024-09-10T23:17:02.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.309+0000 7f9a880f7640 1 -- 172.21.15.90:0/273653024 wait complete. 2024-09-10T23:17:02.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.310+0000 7f9a880f7640 1 Processor -- start 2024-09-10T23:17:02.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.310+0000 7f9a880f7640 1 -- start start 2024-09-10T23:17:02.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.311+0000 7f9a880f7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a800d16f0 0x7f9a800b9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:02.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.311+0000 7f9a880f7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a800d4b80 0x7f9a801575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:02.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.311+0000 7f9a880f7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a8015e310 0x7f9a801f7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:02.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.311+0000 7f9a880f7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8006de00 con 0x7f9a800d4b80 2024-09-10T23:17:02.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.311+0000 7f9a880f7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9a800d3ae0 con 0x7f9a8015e310 2024-09-10T23:17:02.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.311+0000 7f9a880f7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9a8006df80 con 0x7f9a800d16f0 2024-09-10T23:17:02.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.311+0000 7f9a85692640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a800d4b80 0x7f9a801575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:02.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.311+0000 7f9a85692640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a800d4b80 0x7f9a801575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58964/0 (socket says 172.21.15.90:58964) 2024-09-10T23:17:02.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.311+0000 7f9a85e93640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a800d16f0 0x7f9a800b9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:02.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.311+0000 7f9a85692640 1 -- 172.21.15.90:0/1697995243 learned_addr learned my addr 172.21.15.90:0/1697995243 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:02.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.311+0000 7f9a86694640 1 --2- 172.21.15.90:0/1697995243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a8015e310 0x7f9a801f7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:02.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.311+0000 7f9a85692640 1 -- 172.21.15.90:0/1697995243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a800d16f0 msgr2=0x7f9a800b9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:02.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.311+0000 7f9a85692640 1 --2- 172.21.15.90:0/1697995243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a800d16f0 0x7f9a800b9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.311+0000 7f9a85692640 1 -- 172.21.15.90:0/1697995243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a8015e310 msgr2=0x7f9a801f7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:02.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.311+0000 7f9a85692640 1 --2- 172.21.15.90:0/1697995243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a8015e310 0x7f9a801f7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.311+0000 7f9a85692640 1 -- 172.21.15.90:0/1697995243 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a80157b10 con 0x7f9a800d4b80 2024-09-10T23:17:02.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.311+0000 7f9a85692640 1 --2- 172.21.15.90:0/1697995243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a800d4b80 0x7f9a801575d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9a74000c00 tx=0x7f9a74032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:02.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.312+0000 7f9a7e7fc640 1 -- 172.21.15.90:0/1697995243 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a74040070 con 0x7f9a800d4b80 2024-09-10T23:17:02.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.312+0000 7f9a7e7fc640 1 -- 172.21.15.90:0/1697995243 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a740038e0 con 0x7f9a800d4b80 2024-09-10T23:17:02.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.312+0000 7f9a880f7640 1 -- 172.21.15.90:0/1697995243 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a800b8060 con 0x7f9a800d4b80 2024-09-10T23:17:02.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.312+0000 7f9a7e7fc640 1 -- 172.21.15.90:0/1697995243 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a74003d30 con 0x7f9a800d4b80 2024-09-10T23:17:02.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.312+0000 7f9a880f7640 1 -- 172.21.15.90:0/1697995243 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a801f5c60 con 0x7f9a800d4b80 2024-09-10T23:17:02.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.312+0000 7f9a880f7640 1 -- 172.21.15.90:0/1697995243 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a8006a2f0 con 0x7f9a800d4b80 2024-09-10T23:17:02.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.313+0000 7f9a7e7fc640 1 -- 172.21.15.90:0/1697995243 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9a7404d030 con 0x7f9a800d4b80 2024-09-10T23:17:02.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.314+0000 7f9a7e7fc640 1 --2- 172.21.15.90:0/1697995243 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9a6c077f70 0x7f9a6c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:02.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.314+0000 7f9a7e7fc640 1 -- 172.21.15.90:0/1697995243 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5709+0+0 (secure 0 0 0) 0x7f9a740bb2d0 con 0x7f9a800d4b80 2024-09-10T23:17:02.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.314+0000 7f9a85e93640 1 --2- 172.21.15.90:0/1697995243 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9a6c077f70 0x7f9a6c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:02.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.315+0000 7f9a85e93640 1 --2- 172.21.15.90:0/1697995243 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9a6c077f70 0x7f9a6c07a430 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009530 tx=0x7f9a78009260 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:02.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.318+0000 7f9a7e7fc640 1 -- 172.21.15.90:0/1697995243 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9a8006a2f0 con 0x7f9a800d4b80 2024-09-10T23:17:02.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.493+0000 7f9a880f7640 1 -- 172.21.15.90:0/1697995243 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a800b6760 con 0x7f9a800d4b80 2024-09-10T23:17:02.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.494+0000 7f9a7e7fc640 1 -- 172.21.15.90:0/1697995243 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+16741 (secure 0 0 0) 0x7f9a80157b10 con 0x7f9a800d4b80 2024-09-10T23:17:02.496 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:02.496 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":67,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:17:01.524888+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:17:00.138500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-10T23:17:00.479469+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:17:02.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.496+0000 7f9a880f7640 1 -- 172.21.15.90:0/1697995243 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9a6c077f70 msgr2=0x7f9a6c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:02.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.496+0000 7f9a880f7640 1 --2- 172.21.15.90:0/1697995243 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9a6c077f70 0x7f9a6c07a430 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009530 tx=0x7f9a78009260 comp rx=0 tx=0).stop 2024-09-10T23:17:02.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.496+0000 7f9a880f7640 1 -- 172.21.15.90:0/1697995243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a800d4b80 msgr2=0x7f9a801575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:02.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.496+0000 7f9a880f7640 1 --2- 172.21.15.90:0/1697995243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a800d4b80 0x7f9a801575d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9a74000c00 tx=0x7f9a74032c10 comp rx=0 tx=0).stop 2024-09-10T23:17:02.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.496+0000 7f9a880f7640 1 -- 172.21.15.90:0/1697995243 shutdown_connections 2024-09-10T23:17:02.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.496+0000 7f9a880f7640 1 --2- 172.21.15.90:0/1697995243 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9a6c077f70 0x7f9a6c07a430 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.497+0000 7f9a880f7640 1 --2- 172.21.15.90:0/1697995243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a8015e310 0x7f9a801f7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.497+0000 7f9a880f7640 1 --2- 172.21.15.90:0/1697995243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a800d4b80 0x7f9a801575d0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.497+0000 7f9a880f7640 1 --2- 172.21.15.90:0/1697995243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a800d16f0 0x7f9a800b9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.497+0000 7f9a880f7640 1 -- 172.21.15.90:0/1697995243 >> 172.21.15.90:0/1697995243 conn(0x7f9a800d4090 msgr2=0x7f9a8015c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:02.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.497+0000 7f9a880f7640 1 -- 172.21.15.90:0/1697995243 shutdown_connections 2024-09-10T23:17:02.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.497+0000 7f9a880f7640 1 -- 172.21.15.90:0/1697995243 wait complete. 2024-09-10T23:17:02.509 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:17:02.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.608+0000 7f3292260640 1 -- 172.21.15.90:0/1733860704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f328c15e970 msgr2=0x7f328c0727c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:02.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.608+0000 7f3292260640 1 --2- 172.21.15.90:0/1733860704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f328c15e970 0x7f328c0727c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f328c0cf930 tx=0x7f328002a4d0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.608+0000 7f3292260640 1 -- 172.21.15.90:0/1733860704 shutdown_connections 2024-09-10T23:17:02.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.608+0000 7f3292260640 1 --2- 172.21.15.90:0/1733860704 >> v2:172.21.15.171:3300/0 conn(0x7f328c0ceca0 0x7f328c0cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.608+0000 7f3292260640 1 --2- 172.21.15.90:0/1733860704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f328c15e970 0x7f328c0727c0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.608+0000 7f3292260640 1 --2- 172.21.15.90:0/1733860704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f328c0b3310 0x7f328c0b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.609+0000 7f3292260640 1 -- 172.21.15.90:0/1733860704 >> 172.21.15.90:0/1733860704 conn(0x7f328c0b19c0 msgr2=0x7f328c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:02.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.609+0000 7f3292260640 1 -- 172.21.15.90:0/1733860704 shutdown_connections 2024-09-10T23:17:02.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.609+0000 7f3292260640 1 -- 172.21.15.90:0/1733860704 wait complete. 2024-09-10T23:17:02.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.610+0000 7f3292260640 1 Processor -- start 2024-09-10T23:17:02.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.610+0000 7f3292260640 1 -- start start 2024-09-10T23:17:02.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f3292260640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f328c0b3310 0x7f328c158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:02.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f3292260640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f328c0ceca0 0x7f328c1f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:02.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f3292260640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f328c0cc720 0x7f328c06e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:02.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f3292260640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f328c15b7b0 con 0x7f328c0ceca0 2024-09-10T23:17:02.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f3292260640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f328c0af780 con 0x7f328c0b3310 2024-09-10T23:17:02.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f3292260640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f328c15b930 con 0x7f328c0cc720 2024-09-10T23:17:02.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f328affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f328c0ceca0 0x7f328c1f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:02.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f328affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f328c0ceca0 0x7f328c1f35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58990/0 (socket says 172.21.15.90:58990) 2024-09-10T23:17:02.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f328affd640 1 -- 172.21.15.90:0/2477843188 learned_addr learned my addr 172.21.15.90:0/2477843188 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:02.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f328b7fe640 1 --2- 172.21.15.90:0/2477843188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f328c0b3310 0x7f328c158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:02.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f328bfff640 1 --2- 172.21.15.90:0/2477843188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f328c0cc720 0x7f328c06e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:02.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f328affd640 1 -- 172.21.15.90:0/2477843188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f328c0cc720 msgr2=0x7f328c06e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:02.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f328affd640 1 --2- 172.21.15.90:0/2477843188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f328c0cc720 0x7f328c06e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f328affd640 1 -- 172.21.15.90:0/2477843188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f328c0b3310 msgr2=0x7f328c158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:02.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f328affd640 1 --2- 172.21.15.90:0/2477843188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f328c0b3310 0x7f328c158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f328affd640 1 -- 172.21.15.90:0/2477843188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328c1f3dc0 con 0x7f328c0ceca0 2024-09-10T23:17:02.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f328affd640 1 --2- 172.21.15.90:0/2477843188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f328c0ceca0 0x7f328c1f35b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3280000c00 tx=0x7f3280003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:02.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f3273fff640 1 -- 172.21.15.90:0/2477843188 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328003e030 con 0x7f328c0ceca0 2024-09-10T23:17:02.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f3273fff640 1 -- 172.21.15.90:0/2477843188 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3280003e00 con 0x7f328c0ceca0 2024-09-10T23:17:02.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f3292260640 1 -- 172.21.15.90:0/2477843188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328c1f3af0 con 0x7f328c0ceca0 2024-09-10T23:17:02.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.611+0000 7f3273fff640 1 -- 172.21.15.90:0/2477843188 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280035040 con 0x7f328c0ceca0 2024-09-10T23:17:02.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.612+0000 7f3292260640 1 -- 172.21.15.90:0/2477843188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f328c159570 con 0x7f328c0ceca0 2024-09-10T23:17:02.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.613+0000 7f3292260640 1 -- 172.21.15.90:0/2477843188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f328c0cf110 con 0x7f328c0ceca0 2024-09-10T23:17:02.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.613+0000 7f3273fff640 1 -- 172.21.15.90:0/2477843188 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f32800049c0 con 0x7f328c0ceca0 2024-09-10T23:17:02.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.614+0000 7f3273fff640 1 --2- 172.21.15.90:0/2477843188 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3278077f70 0x7f327807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:02.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.614+0000 7f3273fff640 1 -- 172.21.15.90:0/2477843188 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5709+0+0 (secure 0 0 0) 0x7f32800ba750 con 0x7f328c0ceca0 2024-09-10T23:17:02.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.614+0000 7f328b7fe640 1 --2- 172.21.15.90:0/2477843188 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3278077f70 0x7f327807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:02.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.614+0000 7f328b7fe640 1 --2- 172.21.15.90:0/2477843188 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3278077f70 0x7f327807a430 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f327c005fd0 tx=0x7f327c00b2e0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:02.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.618+0000 7f3273fff640 1 -- 172.21.15.90:0/2477843188 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3280082c00 con 0x7f328c0ceca0 2024-09-10T23:17:02.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.793+0000 7f3292260640 1 -- 172.21.15.90:0/2477843188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f328c0708d0 con 0x7f328c0ceca0 2024-09-10T23:17:02.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.794+0000 7f3273fff640 1 -- 172.21.15.90:0/2477843188 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+16741 (secure 0 0 0) 0x7f32800b1e20 con 0x7f328c0ceca0 2024-09-10T23:17:02.795 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:02.795 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":67,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:17:01.524888+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:17:00.138500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-10T23:17:00.479469+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:17:02.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.796+0000 7f3292260640 1 -- 172.21.15.90:0/2477843188 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3278077f70 msgr2=0x7f327807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:02.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.796+0000 7f3292260640 1 --2- 172.21.15.90:0/2477843188 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3278077f70 0x7f327807a430 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f327c005fd0 tx=0x7f327c00b2e0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.796+0000 7f3292260640 1 -- 172.21.15.90:0/2477843188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f328c0ceca0 msgr2=0x7f328c1f35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:02.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.796+0000 7f3292260640 1 --2- 172.21.15.90:0/2477843188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f328c0ceca0 0x7f328c1f35b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3280000c00 tx=0x7f3280003910 comp rx=0 tx=0).stop 2024-09-10T23:17:02.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.796+0000 7f3292260640 1 -- 172.21.15.90:0/2477843188 shutdown_connections 2024-09-10T23:17:02.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.796+0000 7f3292260640 1 --2- 172.21.15.90:0/2477843188 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3278077f70 0x7f327807a430 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.796+0000 7f3292260640 1 --2- 172.21.15.90:0/2477843188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f328c0cc720 0x7f328c06e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.796+0000 7f3292260640 1 --2- 172.21.15.90:0/2477843188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f328c0ceca0 0x7f328c1f35b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.796+0000 7f3292260640 1 --2- 172.21.15.90:0/2477843188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f328c0b3310 0x7f328c158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.796+0000 7f3292260640 1 -- 172.21.15.90:0/2477843188 >> 172.21.15.90:0/2477843188 conn(0x7f328c0b19c0 msgr2=0x7f328c0ae620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:02.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.796+0000 7f3292260640 1 -- 172.21.15.90:0/2477843188 shutdown_connections 2024-09-10T23:17:02.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.796+0000 7f3292260640 1 -- 172.21.15.90:0/2477843188 wait complete. 2024-09-10T23:17:02.808 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:17:02.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.911+0000 7f41371bc640 1 -- 172.21.15.90:0/450554850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4130071f20 msgr2=0x7f413006f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:02.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.911+0000 7f41371bc640 1 --2- 172.21.15.90:0/450554850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4130071f20 0x7f413006f530 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f411c009860 tx=0x7f411c02a510 comp rx=0 tx=0).stop 2024-09-10T23:17:02.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.912+0000 7f41371bc640 1 -- 172.21.15.90:0/450554850 shutdown_connections 2024-09-10T23:17:02.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.912+0000 7f41371bc640 1 --2- 172.21.15.90:0/450554850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4130071f20 0x7f413006f530 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.912+0000 7f41371bc640 1 -- 172.21.15.90:0/450554850 >> 172.21.15.90:0/450554850 conn(0x7f41300b2940 msgr2=0x7f41300b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:02.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.912+0000 7f41371bc640 1 -- 172.21.15.90:0/450554850 shutdown_connections 2024-09-10T23:17:02.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.912+0000 7f41371bc640 1 -- 172.21.15.90:0/450554850 wait complete. 2024-09-10T23:17:02.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.913+0000 7f41371bc640 1 Processor -- start 2024-09-10T23:17:02.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.913+0000 7f41371bc640 1 -- start start 2024-09-10T23:17:02.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f41371bc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f413006fa70 0x7f41301f5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:02.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f41371bc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f413015bd20 0x7f413014e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:02.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f41371bc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4130153190 0x7f4130154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:02.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f41371bc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f41300aeb50 con 0x7f413015bd20 2024-09-10T23:17:02.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f41371bc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f41300ae9d0 con 0x7f413006fa70 2024-09-10T23:17:02.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f41371bc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f41300aecd0 con 0x7f4130153190 2024-09-10T23:17:02.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f412ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f413015bd20 0x7f413014e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:02.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f412ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f413015bd20 0x7f413014e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59002/0 (socket says 172.21.15.90:59002) 2024-09-10T23:17:02.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f412ffff640 1 -- 172.21.15.90:0/2720228351 learned_addr learned my addr 172.21.15.90:0/2720228351 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:02.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f4134f58640 1 --2- 172.21.15.90:0/2720228351 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f413006fa70 0x7f41301f5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:02.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f4135759640 1 --2- 172.21.15.90:0/2720228351 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4130153190 0x7f4130154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:02.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f412ffff640 1 -- 172.21.15.90:0/2720228351 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4130153190 msgr2=0x7f4130154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:02.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f412ffff640 1 --2- 172.21.15.90:0/2720228351 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4130153190 0x7f4130154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f412ffff640 1 -- 172.21.15.90:0/2720228351 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f413006fa70 msgr2=0x7f41301f5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:02.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f412ffff640 1 --2- 172.21.15.90:0/2720228351 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f413006fa70 0x7f41301f5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:02.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f412ffff640 1 -- 172.21.15.90:0/2720228351 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4130152810 con 0x7f413015bd20 2024-09-10T23:17:02.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f4134f58640 1 --2- 172.21.15.90:0/2720228351 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f413006fa70 0x7f41301f5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:02.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f412ffff640 1 --2- 172.21.15.90:0/2720228351 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f413015bd20 0x7f413014e950 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f411c009980 tx=0x7f411c032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:02.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f412d7fa640 1 -- 172.21.15.90:0/2720228351 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c040070 con 0x7f413015bd20 2024-09-10T23:17:02.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f412d7fa640 1 -- 172.21.15.90:0/2720228351 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f411c0038e0 con 0x7f413015bd20 2024-09-10T23:17:02.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f41371bc640 1 -- 172.21.15.90:0/2720228351 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4130152ad0 con 0x7f413015bd20 2024-09-10T23:17:02.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f412d7fa640 1 -- 172.21.15.90:0/2720228351 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c003cf0 con 0x7f413015bd20 2024-09-10T23:17:02.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.914+0000 7f41371bc640 1 -- 172.21.15.90:0/2720228351 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41300b3de0 con 0x7f413015bd20 2024-09-10T23:17:02.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.915+0000 7f41371bc640 1 -- 172.21.15.90:0/2720228351 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f413006f530 con 0x7f413015bd20 2024-09-10T23:17:02.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.916+0000 7f412d7fa640 1 -- 172.21.15.90:0/2720228351 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f411c045460 con 0x7f413015bd20 2024-09-10T23:17:02.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.917+0000 7f412d7fa640 1 --2- 172.21.15.90:0/2720228351 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4114077f70 0x7f411407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:02.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.917+0000 7f412d7fa640 1 -- 172.21.15.90:0/2720228351 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5709+0+0 (secure 0 0 0) 0x7f411c0bb460 con 0x7f413015bd20 2024-09-10T23:17:02.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.917+0000 7f4134f58640 1 --2- 172.21.15.90:0/2720228351 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4114077f70 0x7f411407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:02.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.918+0000 7f4134f58640 1 --2- 172.21.15.90:0/2720228351 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4114077f70 0x7f411407a430 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f413006d720 tx=0x7f4124009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:02.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:02.921+0000 7f412d7fa640 1 -- 172.21.15.90:0/2720228351 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f411c083f70 con 0x7f413015bd20 2024-09-10T23:17:03.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.129+0000 7f41371bc640 1 -- 172.21.15.90:0/2720228351 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f413006cdc0 con 0x7f413015bd20 2024-09-10T23:17:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.183+0000 7f412d7fa640 1 -- 172.21.15.90:0/2720228351 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v37) ==== 118+0+0 (secure 0 0 0) 0x7f411c083870 con 0x7f413015bd20 2024-09-10T23:17:03.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.185+0000 7f41371bc640 1 -- 172.21.15.90:0/2720228351 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4114077f70 msgr2=0x7f411407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:03.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.185+0000 7f41371bc640 1 --2- 172.21.15.90:0/2720228351 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4114077f70 0x7f411407a430 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f413006d720 tx=0x7f4124009040 comp rx=0 tx=0).stop 2024-09-10T23:17:03.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.185+0000 7f41371bc640 1 -- 172.21.15.90:0/2720228351 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f413015bd20 msgr2=0x7f413014e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:03.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.185+0000 7f41371bc640 1 --2- 172.21.15.90:0/2720228351 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f413015bd20 0x7f413014e950 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f411c009980 tx=0x7f411c032b90 comp rx=0 tx=0).stop 2024-09-10T23:17:03.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.185+0000 7f41371bc640 1 -- 172.21.15.90:0/2720228351 shutdown_connections 2024-09-10T23:17:03.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.185+0000 7f41371bc640 1 --2- 172.21.15.90:0/2720228351 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4114077f70 0x7f411407a430 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:03.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.185+0000 7f41371bc640 1 --2- 172.21.15.90:0/2720228351 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4130153190 0x7f4130154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:03.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.185+0000 7f41371bc640 1 --2- 172.21.15.90:0/2720228351 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f413015bd20 0x7f413014e950 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:03.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.185+0000 7f41371bc640 1 --2- 172.21.15.90:0/2720228351 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f413006fa70 0x7f41301f5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:03.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.185+0000 7f41371bc640 1 -- 172.21.15.90:0/2720228351 >> 172.21.15.90:0/2720228351 conn(0x7f41300b2940 msgr2=0x7f41300b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:03.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.185+0000 7f41371bc640 1 -- 172.21.15.90:0/2720228351 shutdown_connections 2024-09-10T23:17:03.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.185+0000 7f41371bc640 1 -- 172.21.15.90:0/2720228351 wait complete. 2024-09-10T23:17:03.197 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:17:03.197 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:17:03.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.299+0000 7fb43019b640 1 -- 172.21.15.90:0/1885766858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4280d16f0 msgr2=0x7fb4280d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:03.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.299+0000 7fb43019b640 1 --2- 172.21.15.90:0/1885766858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4280d16f0 0x7fb4280d0fc0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb42808c880 tx=0x7fb41802a3b0 comp rx=0 tx=0).stop 2024-09-10T23:17:03.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.299+0000 7fb43019b640 1 -- 172.21.15.90:0/1885766858 shutdown_connections 2024-09-10T23:17:03.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.299+0000 7fb43019b640 1 --2- 172.21.15.90:0/1885766858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4280d16f0 0x7fb4280d0fc0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:03.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.299+0000 7fb43019b640 1 --2- 172.21.15.90:0/1885766858 >> v2:172.21.15.171:3300/0 conn(0x7fb42815e310 0x7fb4280d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:03.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.299+0000 7fb43019b640 1 -- 172.21.15.90:0/1885766858 >> 172.21.15.90:0/1885766858 conn(0x7fb4280d4090 msgr2=0x7fb4280d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:03.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.300+0000 7fb43019b640 1 -- 172.21.15.90:0/1885766858 shutdown_connections 2024-09-10T23:17:03.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.300+0000 7fb43019b640 1 -- 172.21.15.90:0/1885766858 wait complete. 2024-09-10T23:17:03.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.301+0000 7fb43019b640 1 Processor -- start 2024-09-10T23:17:03.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.301+0000 7fb43019b640 1 -- start start 2024-09-10T23:17:03.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.301+0000 7fb43019b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb4280d16f0 0x7fb4280cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:03.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.301+0000 7fb43019b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4280d4b80 0x7fb4280c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:03.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.301+0000 7fb43019b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb42815e310 0x7fb4281f8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:03.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.301+0000 7fb43019b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb42806de00 con 0x7fb42815e310 2024-09-10T23:17:03.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.301+0000 7fb43019b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb4280d3ae0 con 0x7fb4280d4b80 2024-09-10T23:17:03.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.301+0000 7fb43019b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb42806df80 con 0x7fb4280d16f0 2024-09-10T23:17:03.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.302+0000 7fb42e738640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb42815e310 0x7fb4281f8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:03.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.302+0000 7fb42e738640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb42815e310 0x7fb4281f8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59018/0 (socket says 172.21.15.90:59018) 2024-09-10T23:17:03.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.302+0000 7fb42e738640 1 -- 172.21.15.90:0/122384044 learned_addr learned my addr 172.21.15.90:0/122384044 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:03.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.302+0000 7fb42d736640 1 --2- 172.21.15.90:0/122384044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4280d4b80 0x7fb4280c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:03.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.302+0000 7fb42df37640 1 --2- 172.21.15.90:0/122384044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb4280d16f0 0x7fb4280cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:03.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.302+0000 7fb42e738640 1 -- 172.21.15.90:0/122384044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb4280d16f0 msgr2=0x7fb4280cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:03.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.302+0000 7fb42e738640 1 --2- 172.21.15.90:0/122384044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb4280d16f0 0x7fb4280cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:03.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.302+0000 7fb42e738640 1 -- 172.21.15.90:0/122384044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4280d4b80 msgr2=0x7fb4280c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:03.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.302+0000 7fb42e738640 1 --2- 172.21.15.90:0/122384044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4280d4b80 0x7fb4280c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:03.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.302+0000 7fb42e738640 1 -- 172.21.15.90:0/122384044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4281f92e0 con 0x7fb42815e310 2024-09-10T23:17:03.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.302+0000 7fb42e738640 1 --2- 172.21.15.90:0/122384044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb42815e310 0x7fb4281f8da0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb42000caa0 tx=0x7fb42000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:03.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.302+0000 7fb41e7fc640 1 -- 172.21.15.90:0/122384044 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb420017070 con 0x7fb42815e310 2024-09-10T23:17:03.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.302+0000 7fb41e7fc640 1 -- 172.21.15.90:0/122384044 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb420005070 con 0x7fb42815e310 2024-09-10T23:17:03.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.302+0000 7fb41e7fc640 1 -- 172.21.15.90:0/122384044 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4200054c0 con 0x7fb42815e310 2024-09-10T23:17:03.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.302+0000 7fb43019b640 1 -- 172.21.15.90:0/122384044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4280cdef0 con 0x7fb42815e310 2024-09-10T23:17:03.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.302+0000 7fb43019b640 1 -- 172.21.15.90:0/122384044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4280cb440 con 0x7fb42815e310 2024-09-10T23:17:03.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.303+0000 7fb43019b640 1 -- 172.21.15.90:0/122384044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb42806e4a0 con 0x7fb42815e310 2024-09-10T23:17:03.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.304+0000 7fb41e7fc640 1 -- 172.21.15.90:0/122384044 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb420005660 con 0x7fb42815e310 2024-09-10T23:17:03.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.304+0000 7fb41e7fc640 1 --2- 172.21.15.90:0/122384044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb40c077fa0 0x7fb40c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:03.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.304+0000 7fb41e7fc640 1 -- 172.21.15.90:0/122384044 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fb420099720 con 0x7fb42815e310 2024-09-10T23:17:03.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.305+0000 7fb42df37640 1 --2- 172.21.15.90:0/122384044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb40c077fa0 0x7fb40c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:03.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.305+0000 7fb42df37640 1 --2- 172.21.15.90:0/122384044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb40c077fa0 0x7fb40c07a460 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb42400bb50 tx=0x7fb42400b2e0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:03.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.309+0000 7fb41e7fc640 1 -- 172.21.15.90:0/122384044 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb4281f92e0 con 0x7fb42815e310 2024-09-10T23:17:03.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:03.518+0000 7fb43019b640 1 -- 172.21.15.90:0/122384044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb4280c7960 con 0x7fb42815e310 2024-09-10T23:17:04.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.186+0000 7fb41e7fc640 1 -- 172.21.15.90:0/122384044 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7fb420061bd0 con 0x7fb42815e310 2024-09-10T23:17:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.189+0000 7fb43019b640 1 -- 172.21.15.90:0/122384044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb40c077fa0 msgr2=0x7fb40c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.189+0000 7fb43019b640 1 --2- 172.21.15.90:0/122384044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb40c077fa0 0x7fb40c07a460 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb42400bb50 tx=0x7fb42400b2e0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.189+0000 7fb43019b640 1 -- 172.21.15.90:0/122384044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb42815e310 msgr2=0x7fb4281f8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.189+0000 7fb43019b640 1 --2- 172.21.15.90:0/122384044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb42815e310 0x7fb4281f8da0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb42000caa0 tx=0x7fb42000cf60 comp rx=0 tx=0).stop 2024-09-10T23:17:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.189+0000 7fb43019b640 1 -- 172.21.15.90:0/122384044 shutdown_connections 2024-09-10T23:17:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.189+0000 7fb43019b640 1 --2- 172.21.15.90:0/122384044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb40c077fa0 0x7fb40c07a460 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.189+0000 7fb43019b640 1 --2- 172.21.15.90:0/122384044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4280d4b80 0x7fb4280c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.189+0000 7fb43019b640 1 --2- 172.21.15.90:0/122384044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb42815e310 0x7fb4281f8da0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.189+0000 7fb43019b640 1 --2- 172.21.15.90:0/122384044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb4280d16f0 0x7fb4280cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.189+0000 7fb43019b640 1 -- 172.21.15.90:0/122384044 >> 172.21.15.90:0/122384044 conn(0x7fb4280d4090 msgr2=0x7fb42806d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:04.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.189+0000 7fb43019b640 1 -- 172.21.15.90:0/122384044 shutdown_connections 2024-09-10T23:17:04.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.189+0000 7fb43019b640 1 -- 172.21.15.90:0/122384044 wait complete. 2024-09-10T23:17:04.203 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:17:04.203 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:17:04.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.310+0000 7fe9a420c640 1 -- 172.21.15.90:0/3572127523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe988004d40 msgr2=0x7fe9880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:04.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.310+0000 7fe9a420c640 1 --2- 172.21.15.90:0/3572127523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe988004d40 0x7fe9880051c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe994002230 tx=0x7fe988005830 comp rx=0 tx=0).stop 2024-09-10T23:17:04.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.310+0000 7fe9a27a9640 1 -- 172.21.15.90:0/3572127523 reap_dead start 2024-09-10T23:17:04.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.310+0000 7fe9a420c640 1 -- 172.21.15.90:0/3572127523 shutdown_connections 2024-09-10T23:17:04.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.310+0000 7fe9a420c640 1 -- 172.21.15.90:0/3572127523 >> 172.21.15.90:0/3572127523 conn(0x7fe99c0b19c0 msgr2=0x7fe99c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:04.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.310+0000 7fe9a420c640 1 -- 172.21.15.90:0/3572127523 shutdown_connections 2024-09-10T23:17:04.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.310+0000 7fe9a420c640 1 -- 172.21.15.90:0/3572127523 wait complete. 2024-09-10T23:17:04.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.311+0000 7fe9a420c640 1 Processor -- start 2024-09-10T23:17:04.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.311+0000 7fe9a420c640 1 -- start start 2024-09-10T23:17:04.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a420c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe988004d40 0x7fe99c15db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:04.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a420c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe99c145080 0x7fe99c148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:04.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a420c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe99c15bc10 0x7fe99c15c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:04.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a420c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c0ce360 con 0x7fe99c145080 2024-09-10T23:17:04.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a420c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c0ce1e0 con 0x7fe99c15bc10 2024-09-10T23:17:04.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a420c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe99c0cc5b0 con 0x7fe988004d40 2024-09-10T23:17:04.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a17a7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe99c145080 0x7fe99c148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:04.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a17a7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe99c145080 0x7fe99c148200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59036/0 (socket says 172.21.15.90:59036) 2024-09-10T23:17:04.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a17a7640 1 -- 172.21.15.90:0/1393553069 learned_addr learned my addr 172.21.15.90:0/1393553069 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:04.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a1fa8640 1 --2- 172.21.15.90:0/1393553069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe988004d40 0x7fe99c15db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:04.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a27a9640 1 --2- 172.21.15.90:0/1393553069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe99c15bc10 0x7fe99c15c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:04.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a17a7640 1 -- 172.21.15.90:0/1393553069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe988004d40 msgr2=0x7fe99c15db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:04.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a17a7640 1 --2- 172.21.15.90:0/1393553069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe988004d40 0x7fe99c15db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a17a7640 1 -- 172.21.15.90:0/1393553069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe99c15bc10 msgr2=0x7fe99c15c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:04.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a17a7640 1 --2- 172.21.15.90:0/1393553069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe99c15bc10 0x7fe99c15c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a17a7640 1 -- 172.21.15.90:0/1393553069 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99c148740 con 0x7fe99c145080 2024-09-10T23:17:04.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a17a7640 1 --2- 172.21.15.90:0/1393553069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe99c145080 0x7fe99c148200 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe98c011b10 tx=0x7fe98c009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:04.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9927fc640 1 -- 172.21.15.90:0/1393553069 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c01e070 con 0x7fe99c145080 2024-09-10T23:17:04.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9927fc640 1 -- 172.21.15.90:0/1393553069 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe98c00fe40 con 0x7fe99c145080 2024-09-10T23:17:04.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a420c640 1 -- 172.21.15.90:0/1393553069 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99c15e150 con 0x7fe99c145080 2024-09-10T23:17:04.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9927fc640 1 -- 172.21.15.90:0/1393553069 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0042b0 con 0x7fe99c145080 2024-09-10T23:17:04.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.312+0000 7fe9a420c640 1 -- 172.21.15.90:0/1393553069 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe99c15e710 con 0x7fe99c145080 2024-09-10T23:17:04.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.313+0000 7fe9a420c640 1 -- 172.21.15.90:0/1393553069 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe99c09db80 con 0x7fe99c145080 2024-09-10T23:17:04.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.314+0000 7fe9927fc640 1 -- 172.21.15.90:0/1393553069 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe98c0035f0 con 0x7fe99c145080 2024-09-10T23:17:04.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.315+0000 7fe9927fc640 1 --2- 172.21.15.90:0/1393553069 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe980077fa0 0x7fe98007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:04.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.315+0000 7fe9927fc640 1 -- 172.21.15.90:0/1393553069 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fe98c09a970 con 0x7fe99c145080 2024-09-10T23:17:04.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.315+0000 7fe9a1fa8640 1 --2- 172.21.15.90:0/1393553069 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe980077fa0 0x7fe98007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:04.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.315+0000 7fe9a1fa8640 1 --2- 172.21.15.90:0/1393553069 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe980077fa0 0x7fe98007a460 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe998009c10 tx=0x7fe998005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:04.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.319+0000 7fe9927fc640 1 -- 172.21.15.90:0/1393553069 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe99c09db80 con 0x7fe99c145080 2024-09-10T23:17:04.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.527+0000 7fe9a420c640 1 -- 172.21.15.90:0/1393553069 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe99c073de0 con 0x7fe99c145080 2024-09-10T23:17:04.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.528+0000 7fe9927fc640 1 -- 172.21.15.90:0/1393553069 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5225 (secure 0 0 0) 0x7fe98c062f70 con 0x7fe99c145080 2024-09-10T23:17:04.529 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:04.529 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"btime":"2024-09-10T23:17:04:184091+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5554,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/946078081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":946078081},{"type":"v1","addr":"172.21.15.171:6836","nonce":946078081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1081121108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1081121108},{"type":"v1","addr":"172.21.15.171:6837","nonce":1081121108}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6003,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/2444726710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2444726710},{"type":"v1","addr":"172.21.15.90:6834","nonce":2444726710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:01.524854+0000","modified":"2024-09-10T23:17:03.520058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/696526367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":696526367},{"type":"v1","addr":"172.21.15.90:6835","nonce":696526367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6006,"qdb_cluster":[6006]},"id":5}]} 2024-09-10T23:17:04.529 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 38 2024-09-10T23:17:04.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.530+0000 7fe9a420c640 1 -- 172.21.15.90:0/1393553069 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe980077fa0 msgr2=0x7fe98007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:04.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.530+0000 7fe9a420c640 1 --2- 172.21.15.90:0/1393553069 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe980077fa0 0x7fe98007a460 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe998009c10 tx=0x7fe998005f90 comp rx=0 tx=0).stop 2024-09-10T23:17:04.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.530+0000 7fe9a420c640 1 -- 172.21.15.90:0/1393553069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe99c145080 msgr2=0x7fe99c148200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:04.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.530+0000 7fe9a420c640 1 --2- 172.21.15.90:0/1393553069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe99c145080 0x7fe99c148200 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe98c011b10 tx=0x7fe98c009e90 comp rx=0 tx=0).stop 2024-09-10T23:17:04.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.530+0000 7fe9a420c640 1 -- 172.21.15.90:0/1393553069 shutdown_connections 2024-09-10T23:17:04.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.530+0000 7fe9a420c640 1 --2- 172.21.15.90:0/1393553069 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe980077fa0 0x7fe98007a460 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.530+0000 7fe9a420c640 1 --2- 172.21.15.90:0/1393553069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe99c15bc10 0x7fe99c15c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.530+0000 7fe9a420c640 1 --2- 172.21.15.90:0/1393553069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe99c145080 0x7fe99c148200 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.530+0000 7fe9a420c640 1 --2- 172.21.15.90:0/1393553069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe988004d40 0x7fe99c15db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.530+0000 7fe9a420c640 1 -- 172.21.15.90:0/1393553069 >> 172.21.15.90:0/1393553069 conn(0x7fe99c0b19c0 msgr2=0x7fe99c15fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:04.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.530+0000 7fe9a420c640 1 -- 172.21.15.90:0/1393553069 shutdown_connections 2024-09-10T23:17:04.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.530+0000 7fe9a420c640 1 -- 172.21.15.90:0/1393553069 wait complete. 2024-09-10T23:17:04.542 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:17:04.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.643+0000 7fb3d8956640 1 -- 172.21.15.90:0/3439974785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3bc004d40 msgr2=0x7fb3bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:04.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.643+0000 7fb3d8956640 1 --2- 172.21.15.90:0/3439974785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3bc004d40 0x7fb3bc0051c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009ed0 tx=0x7fb3bc005830 comp rx=0 tx=0).stop 2024-09-10T23:17:04.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.643+0000 7fb3d2d9d640 1 -- 172.21.15.90:0/3439974785 reap_dead start 2024-09-10T23:17:04.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.643+0000 7fb3d8956640 1 -- 172.21.15.90:0/3439974785 shutdown_connections 2024-09-10T23:17:04.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.643+0000 7fb3d8956640 1 -- 172.21.15.90:0/3439974785 >> 172.21.15.90:0/3439974785 conn(0x7fb3d40b19c0 msgr2=0x7fb3d40b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:04.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.643+0000 7fb3d8956640 1 -- 172.21.15.90:0/3439974785 shutdown_connections 2024-09-10T23:17:04.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.643+0000 7fb3d8956640 1 -- 172.21.15.90:0/3439974785 wait complete. 2024-09-10T23:17:04.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.645+0000 7fb3d8956640 1 Processor -- start 2024-09-10T23:17:04.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.645+0000 7fb3d8956640 1 -- start start 2024-09-10T23:17:04.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.645+0000 7fb3d8956640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3bc004d40 0x7fb3d415cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:04.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.645+0000 7fb3d8956640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3d415d320 0x7fb3d409cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:04.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.645+0000 7fb3d8956640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d4150af0 0x7fb3d409d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:04.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.645+0000 7fb3d8956640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d415aa40 con 0x7fb3bc004d40 2024-09-10T23:17:04.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.645+0000 7fb3d8956640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d415a8c0 con 0x7fb3d4150af0 2024-09-10T23:17:04.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.645+0000 7fb3d8956640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d40cc710 con 0x7fb3d415d320 2024-09-10T23:17:04.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.645+0000 7fb3d259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3bc004d40 0x7fb3d415cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:04.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.645+0000 7fb3d259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3bc004d40 0x7fb3d415cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59058/0 (socket says 172.21.15.90:59058) 2024-09-10T23:17:04.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.645+0000 7fb3d259c640 1 -- 172.21.15.90:0/469272663 learned_addr learned my addr 172.21.15.90:0/469272663 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:04.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.646+0000 7fb3d259c640 1 -- 172.21.15.90:0/469272663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3d415d320 msgr2=0x7fb3d409cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:04.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.646+0000 7fb3d259c640 1 --2- 172.21.15.90:0/469272663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3d415d320 0x7fb3d409cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.646+0000 7fb3d259c640 1 -- 172.21.15.90:0/469272663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d4150af0 msgr2=0x7fb3d409d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:04.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.646+0000 7fb3d259c640 1 --2- 172.21.15.90:0/469272663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d4150af0 0x7fb3d409d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.646+0000 7fb3d259c640 1 -- 172.21.15.90:0/469272663 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d415d7c0 con 0x7fb3bc004d40 2024-09-10T23:17:04.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.646+0000 7fb3d259c640 1 --2- 172.21.15.90:0/469272663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3bc004d40 0x7fb3d415cde0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb3c400e820 tx=0x7fb3c400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:04.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.646+0000 7fb3c2ffd640 1 -- 172.21.15.90:0/469272663 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c40064e0 con 0x7fb3bc004d40 2024-09-10T23:17:04.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.646+0000 7fb3c2ffd640 1 -- 172.21.15.90:0/469272663 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3c400c8c0 con 0x7fb3bc004d40 2024-09-10T23:17:04.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.646+0000 7fb3d8956640 1 -- 172.21.15.90:0/469272663 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d41f4b70 con 0x7fb3bc004d40 2024-09-10T23:17:04.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.646+0000 7fb3c2ffd640 1 -- 172.21.15.90:0/469272663 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c400ccd0 con 0x7fb3bc004d40 2024-09-10T23:17:04.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.646+0000 7fb3d8956640 1 -- 172.21.15.90:0/469272663 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d41f5630 con 0x7fb3bc004d40 2024-09-10T23:17:04.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.647+0000 7fb3d8956640 1 -- 172.21.15.90:0/469272663 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3d40ccc70 con 0x7fb3bc004d40 2024-09-10T23:17:04.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.648+0000 7fb3c2ffd640 1 -- 172.21.15.90:0/469272663 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb3c400c040 con 0x7fb3bc004d40 2024-09-10T23:17:04.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.648+0000 7fb3c2ffd640 1 --2- 172.21.15.90:0/469272663 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb3b4077f70 0x7fb3b407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:04.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.649+0000 7fb3c2ffd640 1 -- 172.21.15.90:0/469272663 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fb3c409a270 con 0x7fb3bc004d40 2024-09-10T23:17:04.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.649+0000 7fb3d1d9b640 1 --2- 172.21.15.90:0/469272663 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb3b4077f70 0x7fb3b407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:04.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.649+0000 7fb3d1d9b640 1 --2- 172.21.15.90:0/469272663 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb3b4077f70 0x7fb3b407a430 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8001240 tx=0x7fb3c8001110 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:04.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.653+0000 7fb3c2ffd640 1 -- 172.21.15.90:0/469272663 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb3c4062e00 con 0x7fb3bc004d40 2024-09-10T23:17:04.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.829+0000 7fb3d8956640 1 -- 172.21.15.90:0/469272663 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3d41f58c0 con 0x7fb3bc004d40 2024-09-10T23:17:04.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.830+0000 7fb3c2ffd640 1 -- 172.21.15.90:0/469272663 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16728 (secure 0 0 0) 0x7fb3c4062700 con 0x7fb3bc004d40 2024-09-10T23:17:04.831 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:04.831 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":68,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:17:03.163970+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:17:00.138500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-10T23:17:00.479469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:17:04.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.832+0000 7fb3d8956640 1 -- 172.21.15.90:0/469272663 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb3b4077f70 msgr2=0x7fb3b407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:04.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.832+0000 7fb3d8956640 1 --2- 172.21.15.90:0/469272663 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb3b4077f70 0x7fb3b407a430 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8001240 tx=0x7fb3c8001110 comp rx=0 tx=0).stop 2024-09-10T23:17:04.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.832+0000 7fb3d8956640 1 -- 172.21.15.90:0/469272663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3bc004d40 msgr2=0x7fb3d415cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:04.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.832+0000 7fb3d8956640 1 --2- 172.21.15.90:0/469272663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3bc004d40 0x7fb3d415cde0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb3c400e820 tx=0x7fb3c400ece0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.832+0000 7fb3d8956640 1 -- 172.21.15.90:0/469272663 shutdown_connections 2024-09-10T23:17:04.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.832+0000 7fb3d8956640 1 --2- 172.21.15.90:0/469272663 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb3b4077f70 0x7fb3b407a430 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.832+0000 7fb3d8956640 1 --2- 172.21.15.90:0/469272663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d4150af0 0x7fb3d409d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.832+0000 7fb3d8956640 1 --2- 172.21.15.90:0/469272663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3d415d320 0x7fb3d409cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.832+0000 7fb3d8956640 1 --2- 172.21.15.90:0/469272663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3bc004d40 0x7fb3d415cde0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.832+0000 7fb3d8956640 1 -- 172.21.15.90:0/469272663 >> 172.21.15.90:0/469272663 conn(0x7fb3d40b19c0 msgr2=0x7fb3d40b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:04.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.832+0000 7fb3d8956640 1 -- 172.21.15.90:0/469272663 shutdown_connections 2024-09-10T23:17:04.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.832+0000 7fb3d8956640 1 -- 172.21.15.90:0/469272663 wait complete. 2024-09-10T23:17:04.844 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:17:04.845 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:17:04.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.943+0000 7f4ed0abe640 1 -- 172.21.15.90:0/3344524175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ecc15e970 msgr2=0x7f4ecc0b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:04.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.943+0000 7f4ed0abe640 1 --2- 172.21.15.90:0/3344524175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ecc15e970 0x7f4ecc0b24e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009830 tx=0x7f4eb402a480 comp rx=0 tx=0).stop 2024-09-10T23:17:04.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.944+0000 7f4ed0abe640 1 -- 172.21.15.90:0/3344524175 shutdown_connections 2024-09-10T23:17:04.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.944+0000 7f4ed0abe640 1 --2- 172.21.15.90:0/3344524175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ecc15e970 0x7f4ecc0b24e0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.944+0000 7f4ed0abe640 1 -- 172.21.15.90:0/3344524175 >> 172.21.15.90:0/3344524175 conn(0x7f4ecc0b19c0 msgr2=0x7f4ecc0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:04.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.944+0000 7f4ed0abe640 1 -- 172.21.15.90:0/3344524175 shutdown_connections 2024-09-10T23:17:04.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.944+0000 7f4ed0abe640 1 -- 172.21.15.90:0/3344524175 wait complete. 2024-09-10T23:17:04.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.945+0000 7f4ed0abe640 1 Processor -- start 2024-09-10T23:17:04.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.945+0000 7f4ed0abe640 1 -- start start 2024-09-10T23:17:04.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4ed0abe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ecc0b3310 0x7f4ecc148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:04.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4ed0abe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ecc0ceca0 0x7f4ecc1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:04.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4ed0abe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ecc1555e0 0x7f4ecc0cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:04.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4ed0abe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc15bbc0 con 0x7f4ecc1555e0 2024-09-10T23:17:04.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4ed0abe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc15ba40 con 0x7f4ecc0ceca0 2024-09-10T23:17:04.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4ed0abe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4ecc15bd40 con 0x7f4ecc0b3310 2024-09-10T23:17:04.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4ecad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ecc1555e0 0x7f4ecc0cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:04.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4ecad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ecc1555e0 0x7f4ecc0cdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59076/0 (socket says 172.21.15.90:59076) 2024-09-10T23:17:04.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4ecad9d640 1 -- 172.21.15.90:0/705968185 learned_addr learned my addr 172.21.15.90:0/705968185 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:04.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4eca59c640 1 --2- 172.21.15.90:0/705968185 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ecc0b3310 0x7f4ecc148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:04.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4ec1d9b640 1 --2- 172.21.15.90:0/705968185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ecc0ceca0 0x7f4ecc1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:04.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4ecad9d640 1 -- 172.21.15.90:0/705968185 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ecc0b3310 msgr2=0x7f4ecc148730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:04.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4ecad9d640 1 --2- 172.21.15.90:0/705968185 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ecc0b3310 0x7f4ecc148730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4ecad9d640 1 -- 172.21.15.90:0/705968185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ecc0ceca0 msgr2=0x7f4ecc1550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:04.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4ecad9d640 1 --2- 172.21.15.90:0/705968185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ecc0ceca0 0x7f4ecc1550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:04.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4ecad9d640 1 -- 172.21.15.90:0/705968185 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ecc148c70 con 0x7f4ecc1555e0 2024-09-10T23:17:04.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4ec1d9b640 1 --2- 172.21.15.90:0/705968185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ecc0ceca0 0x7f4ecc1550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:04.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.946+0000 7f4ecad9d640 1 --2- 172.21.15.90:0/705968185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ecc1555e0 0x7f4ecc0cdb90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400cbc0 tx=0x7f4ec400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:04.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.947+0000 7f4ec37fe640 1 -- 172.21.15.90:0/705968185 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4016020 con 0x7f4ecc1555e0 2024-09-10T23:17:04.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.947+0000 7f4ec37fe640 1 -- 172.21.15.90:0/705968185 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ec400ae30 con 0x7f4ecc1555e0 2024-09-10T23:17:04.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.947+0000 7f4ed0abe640 1 -- 172.21.15.90:0/705968185 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ecc1f6940 con 0x7f4ecc1555e0 2024-09-10T23:17:04.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.947+0000 7f4ec37fe640 1 -- 172.21.15.90:0/705968185 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4012660 con 0x7f4ecc1555e0 2024-09-10T23:17:04.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.947+0000 7f4ed0abe640 1 -- 172.21.15.90:0/705968185 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ecc1f6f00 con 0x7f4ecc1555e0 2024-09-10T23:17:04.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.948+0000 7f4ed0abe640 1 -- 172.21.15.90:0/705968185 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ecc0b4cc0 con 0x7f4ecc1555e0 2024-09-10T23:17:04.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.948+0000 7f4ec37fe640 1 -- 172.21.15.90:0/705968185 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4ec4012800 con 0x7f4ecc1555e0 2024-09-10T23:17:04.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.949+0000 7f4ec37fe640 1 --2- 172.21.15.90:0/705968185 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4eac077fa0 0x7f4eac07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:04.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.949+0000 7f4ec37fe640 1 -- 172.21.15.90:0/705968185 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f4ec409a2a0 con 0x7f4ecc1555e0 2024-09-10T23:17:04.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.949+0000 7f4eca59c640 1 --2- 172.21.15.90:0/705968185 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4eac077fa0 0x7f4eac07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:04.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.949+0000 7f4eca59c640 1 --2- 172.21.15.90:0/705968185 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4eac077fa0 0x7f4eac07a460 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc0017f0 tx=0x7f4ebc009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:04.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:04.953+0000 7f4ec37fe640 1 -- 172.21.15.90:0/705968185 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4ecc0b4cc0 con 0x7f4ecc1555e0 2024-09-10T23:17:05.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.125+0000 7f4ed0abe640 1 -- 172.21.15.90:0/705968185 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ecc1f66f0 con 0x7f4eac077fa0 2024-09-10T23:17:05.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.129+0000 7f4ec37fe640 1 -- 172.21.15.90:0/705968185 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241333 (secure 0 0 0) 0x7f4ecc1f66f0 con 0x7f4eac077fa0 2024-09-10T23:17:05.132 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:05.133 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:17:05.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.132+0000 7f4ed0abe640 1 -- 172.21.15.90:0/705968185 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4eac077fa0 msgr2=0x7f4eac07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:05.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.132+0000 7f4ed0abe640 1 --2- 172.21.15.90:0/705968185 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4eac077fa0 0x7f4eac07a460 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc0017f0 tx=0x7f4ebc009040 comp rx=0 tx=0).stop 2024-09-10T23:17:05.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.132+0000 7f4ed0abe640 1 -- 172.21.15.90:0/705968185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ecc1555e0 msgr2=0x7f4ecc0cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:05.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.132+0000 7f4ed0abe640 1 --2- 172.21.15.90:0/705968185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ecc1555e0 0x7f4ecc0cdb90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400cbc0 tx=0x7f4ec400a430 comp rx=0 tx=0).stop 2024-09-10T23:17:05.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.132+0000 7f4ed0abe640 1 -- 172.21.15.90:0/705968185 shutdown_connections 2024-09-10T23:17:05.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.132+0000 7f4ed0abe640 1 --2- 172.21.15.90:0/705968185 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4eac077fa0 0x7f4eac07a460 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.132+0000 7f4ed0abe640 1 --2- 172.21.15.90:0/705968185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ecc0ceca0 0x7f4ecc1550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.132+0000 7f4ed0abe640 1 --2- 172.21.15.90:0/705968185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ecc1555e0 0x7f4ecc0cdb90 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.132+0000 7f4ed0abe640 1 --2- 172.21.15.90:0/705968185 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ecc0b3310 0x7f4ecc148730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.132+0000 7f4ed0abe640 1 -- 172.21.15.90:0/705968185 >> 172.21.15.90:0/705968185 conn(0x7f4ecc0b19c0 msgr2=0x7f4ecc0ae1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:05.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.132+0000 7f4ed0abe640 1 -- 172.21.15.90:0/705968185 shutdown_connections 2024-09-10T23:17:05.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.132+0000 7f4ed0abe640 1 -- 172.21.15.90:0/705968185 wait complete. 2024-09-10T23:17:05.144 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-09-10T23:17:04.469843+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236012,"kb_used_data":7272,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738708,"statfs":{"total":773094113280,"available":772852436992,"internally_reserved":0,"allocated":7446528,"data_stored":3745960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.301917"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.190152+0000","last_change":"2024-09-10T23:17:02.187898+0000","last_active":"2024-09-10T23:17:03.190152+0000","last_peered":"2024-09-10T23:17:03.190152+0000","last_clean":"2024-09-10T23:17:03.190152+0000","last_became_active":"2024-09-10T23:17:02.187650+0000","last_became_peered":"2024-09-10T23:17:02.187650+0000","last_unstale":"2024-09-10T23:17:03.190152+0000","last_undegraded":"2024-09-10T23:17:03.190152+0000","last_fullsized":"2024-09-10T23:17:03.190152+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:00.046030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189852+0000","last_change":"2024-09-10T23:17:02.186755+0000","last_active":"2024-09-10T23:17:03.189852+0000","last_peered":"2024-09-10T23:17:03.189852+0000","last_clean":"2024-09-10T23:17:03.189852+0000","last_became_active":"2024-09-10T23:17:02.186481+0000","last_became_peered":"2024-09-10T23:17:02.186481+0000","last_unstale":"2024-09-10T23:17:03.189852+0000","last_undegraded":"2024-09-10T23:17:03.189852+0000","last_fullsized":"2024-09-10T23:17:03.189852+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:20.939249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.190031+0000","last_change":"2024-09-10T23:17:02.183603+0000","last_active":"2024-09-10T23:17:03.190031+0000","last_peered":"2024-09-10T23:17:03.190031+0000","last_clean":"2024-09-10T23:17:03.190031+0000","last_became_active":"2024-09-10T23:17:02.183380+0000","last_became_peered":"2024-09-10T23:17:02.183380+0000","last_unstale":"2024-09-10T23:17:03.190031+0000","last_undegraded":"2024-09-10T23:17:03.190031+0000","last_fullsized":"2024-09-10T23:17:03.190031+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:59.511145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.172137+0000","last_change":"2024-09-10T23:17:00.172137+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.172137+0000","last_undegraded":"2024-09-10T23:17:00.172137+0000","last_fullsized":"2024-09-10T23:17:00.172137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.190010+0000","last_change":"2024-09-10T23:17:01.188635+0000","last_active":"2024-09-10T23:17:03.190010+0000","last_peered":"2024-09-10T23:17:03.190010+0000","last_clean":"2024-09-10T23:17:03.190010+0000","last_became_active":"2024-09-10T23:17:01.188298+0000","last_became_peered":"2024-09-10T23:17:01.188298+0000","last_unstale":"2024-09-10T23:17:03.190010+0000","last_undegraded":"2024-09-10T23:17:03.190010+0000","last_fullsized":"2024-09-10T23:17:03.190010+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:20.519330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.169903+0000","last_change":"2024-09-10T23:17:00.169903+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.169903+0000","last_undegraded":"2024-09-10T23:17:00.169903+0000","last_fullsized":"2024-09-10T23:17:00.169903+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.173181+0000","last_change":"2024-09-10T23:17:00.173181+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.173181+0000","last_undegraded":"2024-09-10T23:17:00.173181+0000","last_fullsized":"2024-09-10T23:17:00.173181+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171586+0000","last_change":"2024-09-10T23:17:00.171586+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171586+0000","last_undegraded":"2024-09-10T23:17:00.171586+0000","last_fullsized":"2024-09-10T23:17:00.171586+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.174746+0000","last_change":"2024-09-10T23:17:00.174746+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.174746+0000","last_undegraded":"2024-09-10T23:17:00.174746+0000","last_fullsized":"2024-09-10T23:17:00.174746+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.177008+0000","last_change":"2024-09-10T23:17:00.177008+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.177008+0000","last_undegraded":"2024-09-10T23:17:00.177008+0000","last_fullsized":"2024-09-10T23:17:00.177008+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189857+0000","last_change":"2024-09-10T23:17:02.182823+0000","last_active":"2024-09-10T23:17:03.189857+0000","last_peered":"2024-09-10T23:17:03.189857+0000","last_clean":"2024-09-10T23:17:03.189857+0000","last_became_active":"2024-09-10T23:17:02.182551+0000","last_became_peered":"2024-09-10T23:17:02.182551+0000","last_unstale":"2024-09-10T23:17:03.189857+0000","last_undegraded":"2024-09-10T23:17:03.189857+0000","last_fullsized":"2024-09-10T23:17:03.189857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:16.350578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.172066+0000","last_change":"2024-09-10T23:17:00.172066+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.172066+0000","last_undegraded":"2024-09-10T23:17:00.172066+0000","last_fullsized":"2024-09-10T23:17:00.172066+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.169940+0000","last_change":"2024-09-10T23:17:00.169940+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.169940+0000","last_undegraded":"2024-09-10T23:17:00.169940+0000","last_fullsized":"2024-09-10T23:17:00.169940+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.174074+0000","last_change":"2024-09-10T23:17:00.174074+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.174074+0000","last_undegraded":"2024-09-10T23:17:00.174074+0000","last_fullsized":"2024-09-10T23:17:00.174074+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171592+0000","last_change":"2024-09-10T23:17:00.171592+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171592+0000","last_undegraded":"2024-09-10T23:17:00.171592+0000","last_fullsized":"2024-09-10T23:17:00.171592+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.177049+0000","last_change":"2024-09-10T23:17:00.177049+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.177049+0000","last_undegraded":"2024-09-10T23:17:00.177049+0000","last_fullsized":"2024-09-10T23:17:00.177049+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.177120+0000","last_change":"2024-09-10T23:17:00.177120+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.177120+0000","last_undegraded":"2024-09-10T23:17:00.177120+0000","last_fullsized":"2024-09-10T23:17:00.177120+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.174254+0000","last_change":"2024-09-10T23:17:00.174254+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.174254+0000","last_undegraded":"2024-09-10T23:17:00.174254+0000","last_fullsized":"2024-09-10T23:17:00.174254+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189830+0000","last_change":"2024-09-10T23:17:02.188651+0000","last_active":"2024-09-10T23:17:03.189830+0000","last_peered":"2024-09-10T23:17:03.189830+0000","last_clean":"2024-09-10T23:17:03.189830+0000","last_became_active":"2024-09-10T23:17:02.188383+0000","last_became_peered":"2024-09-10T23:17:02.188383+0000","last_unstale":"2024-09-10T23:17:03.189830+0000","last_undegraded":"2024-09-10T23:17:03.189830+0000","last_fullsized":"2024-09-10T23:17:03.189830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:59.895108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171722+0000","last_change":"2024-09-10T23:17:00.171722+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171722+0000","last_undegraded":"2024-09-10T23:17:00.171722+0000","last_fullsized":"2024-09-10T23:17:00.171722+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.169901+0000","last_change":"2024-09-10T23:17:00.169901+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.169901+0000","last_undegraded":"2024-09-10T23:17:00.169901+0000","last_fullsized":"2024-09-10T23:17:00.169901+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.174461+0000","last_change":"2024-09-10T23:17:00.174461+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.174461+0000","last_undegraded":"2024-09-10T23:17:00.174461+0000","last_fullsized":"2024-09-10T23:17:00.174461+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.169910+0000","last_change":"2024-09-10T23:17:00.169910+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.169910+0000","last_undegraded":"2024-09-10T23:17:00.169910+0000","last_fullsized":"2024-09-10T23:17:00.169910+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.173414+0000","last_change":"2024-09-10T23:17:00.173414+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.173414+0000","last_undegraded":"2024-09-10T23:17:00.173414+0000","last_fullsized":"2024-09-10T23:17:00.173414+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.172111+0000","last_change":"2024-09-10T23:17:00.172111+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.172111+0000","last_undegraded":"2024-09-10T23:17:00.172111+0000","last_fullsized":"2024-09-10T23:17:00.172111+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.173150+0000","last_change":"2024-09-10T23:17:00.173150+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.173150+0000","last_undegraded":"2024-09-10T23:17:00.173150+0000","last_fullsized":"2024-09-10T23:17:00.173150+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171169+0000","last_change":"2024-09-10T23:17:00.171169+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171169+0000","last_undegraded":"2024-09-10T23:17:00.171169+0000","last_fullsized":"2024-09-10T23:17:00.171169+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189732+0000","last_change":"2024-09-10T23:17:01.187869+0000","last_active":"2024-09-10T23:17:03.189732+0000","last_peered":"2024-09-10T23:17:03.189732+0000","last_clean":"2024-09-10T23:17:03.189732+0000","last_became_active":"2024-09-10T23:17:01.187625+0000","last_became_peered":"2024-09-10T23:17:01.187625+0000","last_unstale":"2024-09-10T23:17:03.189732+0000","last_undegraded":"2024-09-10T23:17:03.189732+0000","last_fullsized":"2024-09-10T23:17:03.189732+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:55.975680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189964+0000","last_change":"2024-09-10T23:17:02.185910+0000","last_active":"2024-09-10T23:17:03.189964+0000","last_peered":"2024-09-10T23:17:03.189964+0000","last_clean":"2024-09-10T23:17:03.189964+0000","last_became_active":"2024-09-10T23:17:02.185560+0000","last_became_peered":"2024-09-10T23:17:02.185560+0000","last_unstale":"2024-09-10T23:17:03.189964+0000","last_undegraded":"2024-09-10T23:17:03.189964+0000","last_fullsized":"2024-09-10T23:17:03.189964+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:06.496984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.174005+0000","last_change":"2024-09-10T23:17:00.174005+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.174005+0000","last_undegraded":"2024-09-10T23:17:00.174005+0000","last_fullsized":"2024-09-10T23:17:00.174005+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171230+0000","last_change":"2024-09-10T23:17:00.171230+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171230+0000","last_undegraded":"2024-09-10T23:17:00.171230+0000","last_fullsized":"2024-09-10T23:17:00.171230+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171917+0000","last_change":"2024-09-10T23:17:00.171917+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171917+0000","last_undegraded":"2024-09-10T23:17:00.171917+0000","last_fullsized":"2024-09-10T23:17:00.171917+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189975+0000","last_change":"2024-09-10T23:17:01.186902+0000","last_active":"2024-09-10T23:17:03.189975+0000","last_peered":"2024-09-10T23:17:03.189975+0000","last_clean":"2024-09-10T23:17:03.189975+0000","last_became_active":"2024-09-10T23:17:01.186661+0000","last_became_peered":"2024-09-10T23:17:01.186661+0000","last_unstale":"2024-09-10T23:17:03.189975+0000","last_undegraded":"2024-09-10T23:17:03.189975+0000","last_fullsized":"2024-09-10T23:17:03.189975+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:27.761361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.172122+0000","last_change":"2024-09-10T23:17:00.172122+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.172122+0000","last_undegraded":"2024-09-10T23:17:00.172122+0000","last_fullsized":"2024-09-10T23:17:00.172122+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.177008+0000","last_change":"2024-09-10T23:17:00.177008+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.177008+0000","last_undegraded":"2024-09-10T23:17:00.177008+0000","last_fullsized":"2024-09-10T23:17:00.177008+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.170204+0000","last_change":"2024-09-10T23:17:00.170204+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.170204+0000","last_undegraded":"2024-09-10T23:17:00.170204+0000","last_fullsized":"2024-09-10T23:17:00.170204+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.173311+0000","last_change":"2024-09-10T23:17:00.173311+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.173311+0000","last_undegraded":"2024-09-10T23:17:00.173311+0000","last_fullsized":"2024-09-10T23:17:00.173311+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.173283+0000","last_change":"2024-09-10T23:17:00.173283+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.173283+0000","last_undegraded":"2024-09-10T23:17:00.173283+0000","last_fullsized":"2024-09-10T23:17:00.173283+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":184,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T23:17:00.172440+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:17:00.172440+0000","last_peered":"2024-09-10T23:17:00.172440+0000","last_clean":"2024-09-10T23:17:00.172440+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:17:00.172440+0000","last_undegraded":"2024-09-10T23:17:00.172440+0000","last_fullsized":"2024-09-10T23:17:00.172440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28376,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343464,"statfs":{"total":96636764160,"available":96607707136,"internally_reserved":0,"allocated":1376256,"data_stored":910844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":782336,"data_stored":320476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":770048,"data_stored":314659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":770048,"data_stored":314659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":782336,"data_stored":320476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":782336,"data_stored":320476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":320476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1400832,"data_stored":923894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:17:05.148 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:17:05.164 INFO:tasks.ceph.mds.a.smithi090.stderr:2024-09-10T23:17:05.163+0000 7ff725e43640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:17:05.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.264+0000 7f7ca3aa9640 1 -- 172.21.15.90:0/2307252310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c9c0b4450 msgr2=0x7f7c9c0ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:05.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.264+0000 7f7ca3aa9640 1 --2- 172.21.15.90:0/2307252310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c9c0b4450 0x7f7c9c0ce9b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0d11b0 tx=0x7f7c9002a4a0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.264+0000 7f7ca3aa9640 1 -- 172.21.15.90:0/2307252310 shutdown_connections 2024-09-10T23:17:05.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.264+0000 7f7ca3aa9640 1 --2- 172.21.15.90:0/2307252310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c9c0b4450 0x7f7c9c0ce9b0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.264+0000 7f7ca3aa9640 1 --2- 172.21.15.90:0/2307252310 >> v2:172.21.15.171:3300/0 conn(0x7f7c9c156530 0x7f7c9c15c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.264+0000 7f7ca3aa9640 1 -- 172.21.15.90:0/2307252310 >> 172.21.15.90:0/2307252310 conn(0x7f7c9c0697a0 msgr2=0x7f7c9c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:05.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.264+0000 7f7ca3aa9640 1 -- 172.21.15.90:0/2307252310 shutdown_connections 2024-09-10T23:17:05.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.264+0000 7f7ca3aa9640 1 -- 172.21.15.90:0/2307252310 wait complete. 2024-09-10T23:17:05.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.265+0000 7f7ca3aa9640 1 Processor -- start 2024-09-10T23:17:05.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.265+0000 7f7ca3aa9640 1 -- start start 2024-09-10T23:17:05.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.266+0000 7f7ca3aa9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c9c0b4450 0x7f7c9c06f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:05.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.266+0000 7f7ca3aa9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c9c0d04d0 0x7f7c9c1e8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:05.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.266+0000 7f7ca3aa9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c9c156530 0x7f7c9c1f8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:05.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.266+0000 7f7ca3aa9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c0d0d40 con 0x7f7c9c0d04d0 2024-09-10T23:17:05.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.266+0000 7f7ca3aa9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c0d0bc0 con 0x7f7c9c156530 2024-09-10T23:17:05.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.266+0000 7f7ca3aa9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7c9c073c00 con 0x7f7c9c0b4450 2024-09-10T23:17:05.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.266+0000 7f7ca1044640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c9c0d04d0 0x7f7c9c1e8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:05.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.266+0000 7f7ca1044640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c9c0d04d0 0x7f7c9c1e8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59082/0 (socket says 172.21.15.90:59082) 2024-09-10T23:17:05.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.266+0000 7f7ca1044640 1 -- 172.21.15.90:0/1082997860 learned_addr learned my addr 172.21.15.90:0/1082997860 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:05.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.266+0000 7f7ca1044640 1 -- 172.21.15.90:0/1082997860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c9c0b4450 msgr2=0x7f7c9c06f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:05.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.266+0000 7f7ca1044640 1 --2- 172.21.15.90:0/1082997860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c9c0b4450 0x7f7c9c06f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.266+0000 7f7ca1044640 1 -- 172.21.15.90:0/1082997860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c9c156530 msgr2=0x7f7c9c1f8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:05.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.266+0000 7f7ca1044640 1 --2- 172.21.15.90:0/1082997860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c9c156530 0x7f7c9c1f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.266+0000 7f7ca1044640 1 -- 172.21.15.90:0/1082997860 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9c1f8f90 con 0x7f7c9c0d04d0 2024-09-10T23:17:05.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.266+0000 7f7ca1044640 1 --2- 172.21.15.90:0/1082997860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c9c0d04d0 0x7f7c9c1e8c70 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009780 tx=0x7f7c90032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:05.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.267+0000 7f7c9a7fc640 1 -- 172.21.15.90:0/1082997860 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90040070 con 0x7f7c9c0d04d0 2024-09-10T23:17:05.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.267+0000 7f7c9a7fc640 1 -- 172.21.15.90:0/1082997860 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c90005310 con 0x7f7c9c0d04d0 2024-09-10T23:17:05.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.267+0000 7f7ca3aa9640 1 -- 172.21.15.90:0/1082997860 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9c1f9270 con 0x7f7c9c0d04d0 2024-09-10T23:17:05.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.267+0000 7f7c9a7fc640 1 -- 172.21.15.90:0/1082997860 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90003800 con 0x7f7c9c0d04d0 2024-09-10T23:17:05.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.267+0000 7f7ca3aa9640 1 -- 172.21.15.90:0/1082997860 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c9c06f130 con 0x7f7c9c0d04d0 2024-09-10T23:17:05.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.268+0000 7f7ca3aa9640 1 -- 172.21.15.90:0/1082997860 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c9c06a430 con 0x7f7c9c0d04d0 2024-09-10T23:17:05.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.268+0000 7f7c9a7fc640 1 -- 172.21.15.90:0/1082997860 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7c9004c030 con 0x7f7c9c0d04d0 2024-09-10T23:17:05.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.269+0000 7f7c9a7fc640 1 --2- 172.21.15.90:0/1082997860 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c88077f70 0x7f7c8807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:05.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.269+0000 7f7c9a7fc640 1 -- 172.21.15.90:0/1082997860 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f7c900baf60 con 0x7f7c9c0d04d0 2024-09-10T23:17:05.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.269+0000 7f7ca1845640 1 --2- 172.21.15.90:0/1082997860 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c88077f70 0x7f7c8807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:05.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.269+0000 7f7ca1845640 1 --2- 172.21.15.90:0/1082997860 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c88077f70 0x7f7c8807a430 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00ab90 tx=0x7f7c8c009250 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:05.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.273+0000 7f7c9a7fc640 1 -- 172.21.15.90:0/1082997860 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7c90083a60 con 0x7f7c9c0d04d0 2024-09-10T23:17:05.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.441+0000 7f7ca3aa9640 1 -- 172.21.15.90:0/1082997860 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7c9c06f300 con 0x7f7c88077f70 2024-09-10T23:17:05.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.446+0000 7f7c9a7fc640 1 -- 172.21.15.90:0/1082997860 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241333 (secure 0 0 0) 0x7f7c9c06f300 con 0x7f7c88077f70 2024-09-10T23:17:05.449 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:05.450 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:17:05.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.449+0000 7f7ca3aa9640 1 -- 172.21.15.90:0/1082997860 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c88077f70 msgr2=0x7f7c8807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:05.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.449+0000 7f7ca3aa9640 1 --2- 172.21.15.90:0/1082997860 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c88077f70 0x7f7c8807a430 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00ab90 tx=0x7f7c8c009250 comp rx=0 tx=0).stop 2024-09-10T23:17:05.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.449+0000 7f7ca3aa9640 1 -- 172.21.15.90:0/1082997860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c9c0d04d0 msgr2=0x7f7c9c1e8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:05.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.449+0000 7f7ca3aa9640 1 --2- 172.21.15.90:0/1082997860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c9c0d04d0 0x7f7c9c1e8c70 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009780 tx=0x7f7c90032d50 comp rx=0 tx=0).stop 2024-09-10T23:17:05.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.449+0000 7f7ca3aa9640 1 -- 172.21.15.90:0/1082997860 shutdown_connections 2024-09-10T23:17:05.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.449+0000 7f7ca3aa9640 1 --2- 172.21.15.90:0/1082997860 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7c88077f70 0x7f7c8807a430 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.449+0000 7f7ca3aa9640 1 --2- 172.21.15.90:0/1082997860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c9c156530 0x7f7c9c1f8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.449+0000 7f7ca3aa9640 1 --2- 172.21.15.90:0/1082997860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c9c0d04d0 0x7f7c9c1e8c70 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.449+0000 7f7ca3aa9640 1 --2- 172.21.15.90:0/1082997860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c9c0b4450 0x7f7c9c06f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.449+0000 7f7ca3aa9640 1 -- 172.21.15.90:0/1082997860 >> 172.21.15.90:0/1082997860 conn(0x7f7c9c0697a0 msgr2=0x7f7c9c155360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:05.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.449+0000 7f7ca3aa9640 1 -- 172.21.15.90:0/1082997860 shutdown_connections 2024-09-10T23:17:05.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.449+0000 7f7ca3aa9640 1 -- 172.21.15.90:0/1082997860 wait complete. 2024-09-10T23:17:05.460 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-09-10T23:17:04.469843+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236012,"kb_used_data":7272,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738708,"statfs":{"total":773094113280,"available":772852436992,"internally_reserved":0,"allocated":7446528,"data_stored":3745960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.301917"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.190152+0000","last_change":"2024-09-10T23:17:02.187898+0000","last_active":"2024-09-10T23:17:03.190152+0000","last_peered":"2024-09-10T23:17:03.190152+0000","last_clean":"2024-09-10T23:17:03.190152+0000","last_became_active":"2024-09-10T23:17:02.187650+0000","last_became_peered":"2024-09-10T23:17:02.187650+0000","last_unstale":"2024-09-10T23:17:03.190152+0000","last_undegraded":"2024-09-10T23:17:03.190152+0000","last_fullsized":"2024-09-10T23:17:03.190152+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:00.046030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189852+0000","last_change":"2024-09-10T23:17:02.186755+0000","last_active":"2024-09-10T23:17:03.189852+0000","last_peered":"2024-09-10T23:17:03.189852+0000","last_clean":"2024-09-10T23:17:03.189852+0000","last_became_active":"2024-09-10T23:17:02.186481+0000","last_became_peered":"2024-09-10T23:17:02.186481+0000","last_unstale":"2024-09-10T23:17:03.189852+0000","last_undegraded":"2024-09-10T23:17:03.189852+0000","last_fullsized":"2024-09-10T23:17:03.189852+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:20.939249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.190031+0000","last_change":"2024-09-10T23:17:02.183603+0000","last_active":"2024-09-10T23:17:03.190031+0000","last_peered":"2024-09-10T23:17:03.190031+0000","last_clean":"2024-09-10T23:17:03.190031+0000","last_became_active":"2024-09-10T23:17:02.183380+0000","last_became_peered":"2024-09-10T23:17:02.183380+0000","last_unstale":"2024-09-10T23:17:03.190031+0000","last_undegraded":"2024-09-10T23:17:03.190031+0000","last_fullsized":"2024-09-10T23:17:03.190031+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:59.511145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.172137+0000","last_change":"2024-09-10T23:17:00.172137+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.172137+0000","last_undegraded":"2024-09-10T23:17:00.172137+0000","last_fullsized":"2024-09-10T23:17:00.172137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.190010+0000","last_change":"2024-09-10T23:17:01.188635+0000","last_active":"2024-09-10T23:17:03.190010+0000","last_peered":"2024-09-10T23:17:03.190010+0000","last_clean":"2024-09-10T23:17:03.190010+0000","last_became_active":"2024-09-10T23:17:01.188298+0000","last_became_peered":"2024-09-10T23:17:01.188298+0000","last_unstale":"2024-09-10T23:17:03.190010+0000","last_undegraded":"2024-09-10T23:17:03.190010+0000","last_fullsized":"2024-09-10T23:17:03.190010+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:20.519330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.169903+0000","last_change":"2024-09-10T23:17:00.169903+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.169903+0000","last_undegraded":"2024-09-10T23:17:00.169903+0000","last_fullsized":"2024-09-10T23:17:00.169903+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.173181+0000","last_change":"2024-09-10T23:17:00.173181+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.173181+0000","last_undegraded":"2024-09-10T23:17:00.173181+0000","last_fullsized":"2024-09-10T23:17:00.173181+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171586+0000","last_change":"2024-09-10T23:17:00.171586+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171586+0000","last_undegraded":"2024-09-10T23:17:00.171586+0000","last_fullsized":"2024-09-10T23:17:00.171586+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.174746+0000","last_change":"2024-09-10T23:17:00.174746+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.174746+0000","last_undegraded":"2024-09-10T23:17:00.174746+0000","last_fullsized":"2024-09-10T23:17:00.174746+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.177008+0000","last_change":"2024-09-10T23:17:00.177008+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.177008+0000","last_undegraded":"2024-09-10T23:17:00.177008+0000","last_fullsized":"2024-09-10T23:17:00.177008+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189857+0000","last_change":"2024-09-10T23:17:02.182823+0000","last_active":"2024-09-10T23:17:03.189857+0000","last_peered":"2024-09-10T23:17:03.189857+0000","last_clean":"2024-09-10T23:17:03.189857+0000","last_became_active":"2024-09-10T23:17:02.182551+0000","last_became_peered":"2024-09-10T23:17:02.182551+0000","last_unstale":"2024-09-10T23:17:03.189857+0000","last_undegraded":"2024-09-10T23:17:03.189857+0000","last_fullsized":"2024-09-10T23:17:03.189857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:16.350578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.172066+0000","last_change":"2024-09-10T23:17:00.172066+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.172066+0000","last_undegraded":"2024-09-10T23:17:00.172066+0000","last_fullsized":"2024-09-10T23:17:00.172066+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.169940+0000","last_change":"2024-09-10T23:17:00.169940+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.169940+0000","last_undegraded":"2024-09-10T23:17:00.169940+0000","last_fullsized":"2024-09-10T23:17:00.169940+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.174074+0000","last_change":"2024-09-10T23:17:00.174074+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.174074+0000","last_undegraded":"2024-09-10T23:17:00.174074+0000","last_fullsized":"2024-09-10T23:17:00.174074+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171592+0000","last_change":"2024-09-10T23:17:00.171592+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171592+0000","last_undegraded":"2024-09-10T23:17:00.171592+0000","last_fullsized":"2024-09-10T23:17:00.171592+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.177049+0000","last_change":"2024-09-10T23:17:00.177049+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.177049+0000","last_undegraded":"2024-09-10T23:17:00.177049+0000","last_fullsized":"2024-09-10T23:17:00.177049+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.177120+0000","last_change":"2024-09-10T23:17:00.177120+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.177120+0000","last_undegraded":"2024-09-10T23:17:00.177120+0000","last_fullsized":"2024-09-10T23:17:00.177120+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.174254+0000","last_change":"2024-09-10T23:17:00.174254+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.174254+0000","last_undegraded":"2024-09-10T23:17:00.174254+0000","last_fullsized":"2024-09-10T23:17:00.174254+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189830+0000","last_change":"2024-09-10T23:17:02.188651+0000","last_active":"2024-09-10T23:17:03.189830+0000","last_peered":"2024-09-10T23:17:03.189830+0000","last_clean":"2024-09-10T23:17:03.189830+0000","last_became_active":"2024-09-10T23:17:02.188383+0000","last_became_peered":"2024-09-10T23:17:02.188383+0000","last_unstale":"2024-09-10T23:17:03.189830+0000","last_undegraded":"2024-09-10T23:17:03.189830+0000","last_fullsized":"2024-09-10T23:17:03.189830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:59.895108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171722+0000","last_change":"2024-09-10T23:17:00.171722+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171722+0000","last_undegraded":"2024-09-10T23:17:00.171722+0000","last_fullsized":"2024-09-10T23:17:00.171722+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.169901+0000","last_change":"2024-09-10T23:17:00.169901+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.169901+0000","last_undegraded":"2024-09-10T23:17:00.169901+0000","last_fullsized":"2024-09-10T23:17:00.169901+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.174461+0000","last_change":"2024-09-10T23:17:00.174461+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.174461+0000","last_undegraded":"2024-09-10T23:17:00.174461+0000","last_fullsized":"2024-09-10T23:17:00.174461+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.169910+0000","last_change":"2024-09-10T23:17:00.169910+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.169910+0000","last_undegraded":"2024-09-10T23:17:00.169910+0000","last_fullsized":"2024-09-10T23:17:00.169910+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.173414+0000","last_change":"2024-09-10T23:17:00.173414+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.173414+0000","last_undegraded":"2024-09-10T23:17:00.173414+0000","last_fullsized":"2024-09-10T23:17:00.173414+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.172111+0000","last_change":"2024-09-10T23:17:00.172111+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.172111+0000","last_undegraded":"2024-09-10T23:17:00.172111+0000","last_fullsized":"2024-09-10T23:17:00.172111+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.173150+0000","last_change":"2024-09-10T23:17:00.173150+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.173150+0000","last_undegraded":"2024-09-10T23:17:00.173150+0000","last_fullsized":"2024-09-10T23:17:00.173150+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171169+0000","last_change":"2024-09-10T23:17:00.171169+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171169+0000","last_undegraded":"2024-09-10T23:17:00.171169+0000","last_fullsized":"2024-09-10T23:17:00.171169+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189732+0000","last_change":"2024-09-10T23:17:01.187869+0000","last_active":"2024-09-10T23:17:03.189732+0000","last_peered":"2024-09-10T23:17:03.189732+0000","last_clean":"2024-09-10T23:17:03.189732+0000","last_became_active":"2024-09-10T23:17:01.187625+0000","last_became_peered":"2024-09-10T23:17:01.187625+0000","last_unstale":"2024-09-10T23:17:03.189732+0000","last_undegraded":"2024-09-10T23:17:03.189732+0000","last_fullsized":"2024-09-10T23:17:03.189732+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:55.975680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189964+0000","last_change":"2024-09-10T23:17:02.185910+0000","last_active":"2024-09-10T23:17:03.189964+0000","last_peered":"2024-09-10T23:17:03.189964+0000","last_clean":"2024-09-10T23:17:03.189964+0000","last_became_active":"2024-09-10T23:17:02.185560+0000","last_became_peered":"2024-09-10T23:17:02.185560+0000","last_unstale":"2024-09-10T23:17:03.189964+0000","last_undegraded":"2024-09-10T23:17:03.189964+0000","last_fullsized":"2024-09-10T23:17:03.189964+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:06.496984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.174005+0000","last_change":"2024-09-10T23:17:00.174005+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.174005+0000","last_undegraded":"2024-09-10T23:17:00.174005+0000","last_fullsized":"2024-09-10T23:17:00.174005+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171230+0000","last_change":"2024-09-10T23:17:00.171230+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171230+0000","last_undegraded":"2024-09-10T23:17:00.171230+0000","last_fullsized":"2024-09-10T23:17:00.171230+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171917+0000","last_change":"2024-09-10T23:17:00.171917+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171917+0000","last_undegraded":"2024-09-10T23:17:00.171917+0000","last_fullsized":"2024-09-10T23:17:00.171917+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189975+0000","last_change":"2024-09-10T23:17:01.186902+0000","last_active":"2024-09-10T23:17:03.189975+0000","last_peered":"2024-09-10T23:17:03.189975+0000","last_clean":"2024-09-10T23:17:03.189975+0000","last_became_active":"2024-09-10T23:17:01.186661+0000","last_became_peered":"2024-09-10T23:17:01.186661+0000","last_unstale":"2024-09-10T23:17:03.189975+0000","last_undegraded":"2024-09-10T23:17:03.189975+0000","last_fullsized":"2024-09-10T23:17:03.189975+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:27.761361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.172122+0000","last_change":"2024-09-10T23:17:00.172122+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.172122+0000","last_undegraded":"2024-09-10T23:17:00.172122+0000","last_fullsized":"2024-09-10T23:17:00.172122+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.177008+0000","last_change":"2024-09-10T23:17:00.177008+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.177008+0000","last_undegraded":"2024-09-10T23:17:00.177008+0000","last_fullsized":"2024-09-10T23:17:00.177008+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.170204+0000","last_change":"2024-09-10T23:17:00.170204+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.170204+0000","last_undegraded":"2024-09-10T23:17:00.170204+0000","last_fullsized":"2024-09-10T23:17:00.170204+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.173311+0000","last_change":"2024-09-10T23:17:00.173311+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.173311+0000","last_undegraded":"2024-09-10T23:17:00.173311+0000","last_fullsized":"2024-09-10T23:17:00.173311+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.173283+0000","last_change":"2024-09-10T23:17:00.173283+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.173283+0000","last_undegraded":"2024-09-10T23:17:00.173283+0000","last_fullsized":"2024-09-10T23:17:00.173283+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":184,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T23:17:00.172440+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:17:00.172440+0000","last_peered":"2024-09-10T23:17:00.172440+0000","last_clean":"2024-09-10T23:17:00.172440+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:17:00.172440+0000","last_undegraded":"2024-09-10T23:17:00.172440+0000","last_fullsized":"2024-09-10T23:17:00.172440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28376,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343464,"statfs":{"total":96636764160,"available":96607707136,"internally_reserved":0,"allocated":1376256,"data_stored":910844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":782336,"data_stored":320476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":770048,"data_stored":314659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":770048,"data_stored":314659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":782336,"data_stored":320476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":782336,"data_stored":320476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":320476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1400832,"data_stored":923894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:17:05.464 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:17:05.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.600+0000 7f2f41062640 1 -- 172.21.15.90:0/2437167444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f28003a30 msgr2=0x7f2f28003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:05.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.600+0000 7f2f41062640 1 --2- 172.21.15.90:0/2437167444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f28003a30 0x7f2f28003e50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c009ed0 tx=0x7f2f28005830 comp rx=0 tx=0).stop 2024-09-10T23:17:05.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.600+0000 7f2f3b59e640 1 -- 172.21.15.90:0/2437167444 reap_dead start 2024-09-10T23:17:05.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.601+0000 7f2f41062640 1 -- 172.21.15.90:0/2437167444 shutdown_connections 2024-09-10T23:17:05.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.601+0000 7f2f41062640 1 -- 172.21.15.90:0/2437167444 >> 172.21.15.90:0/2437167444 conn(0x7f2f3c0d4090 msgr2=0x7f2f3c0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:05.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.601+0000 7f2f41062640 1 -- 172.21.15.90:0/2437167444 shutdown_connections 2024-09-10T23:17:05.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.601+0000 7f2f41062640 1 -- 172.21.15.90:0/2437167444 wait complete. 2024-09-10T23:17:05.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.602+0000 7f2f41062640 1 Processor -- start 2024-09-10T23:17:05.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.602+0000 7f2f41062640 1 -- start start 2024-09-10T23:17:05.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.603+0000 7f2f41062640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f28003a30 0x7f2f3c0b9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:05.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.603+0000 7f2f41062640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f3c1f8d80 0x7f2f3c0ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:05.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.603+0000 7f2f41062640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f3c1f81a0 0x7f2f3c1f8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:05.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.603+0000 7f2f41062640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2f3c0cf820 con 0x7f2f3c1f81a0 2024-09-10T23:17:05.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.603+0000 7f2f41062640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2f3c0d4d90 con 0x7f2f28003a30 2024-09-10T23:17:05.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.603+0000 7f2f41062640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2f3c0d0a80 con 0x7f2f3c1f8d80 2024-09-10T23:17:05.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.603+0000 7f2f3b59e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f3c1f81a0 0x7f2f3c1f8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:05.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.603+0000 7f2f3b59e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f3c1f81a0 0x7f2f3c1f8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59100/0 (socket says 172.21.15.90:59100) 2024-09-10T23:17:05.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.603+0000 7f2f3b59e640 1 -- 172.21.15.90:0/2696498494 learned_addr learned my addr 172.21.15.90:0/2696498494 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:05.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.603+0000 7f2f3a59c640 1 --2- 172.21.15.90:0/2696498494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f3c1f8d80 0x7f2f3c0ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:05.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.603+0000 7f2f3ad9d640 1 --2- 172.21.15.90:0/2696498494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f28003a30 0x7f2f3c0b9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:05.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.603+0000 7f2f3b59e640 1 -- 172.21.15.90:0/2696498494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f3c1f8d80 msgr2=0x7f2f3c0ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:05.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.603+0000 7f2f3b59e640 1 --2- 172.21.15.90:0/2696498494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f3c1f8d80 0x7f2f3c0ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.603+0000 7f2f3b59e640 1 -- 172.21.15.90:0/2696498494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f28003a30 msgr2=0x7f2f3c0b9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:05.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.603+0000 7f2f3b59e640 1 --2- 172.21.15.90:0/2696498494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f28003a30 0x7f2f3c0b9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.603+0000 7f2f3b59e640 1 -- 172.21.15.90:0/2696498494 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f3c0b9560 con 0x7f2f3c1f81a0 2024-09-10T23:17:05.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.603+0000 7f2f3ad9d640 1 --2- 172.21.15.90:0/2696498494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f28003a30 0x7f2f3c0b9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:05.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.604+0000 7f2f3b59e640 1 --2- 172.21.15.90:0/2696498494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f3c1f81a0 0x7f2f3c1f8630 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2f34000fb0 tx=0x7f2f3400e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:05.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.604+0000 7f2f337fe640 1 -- 172.21.15.90:0/2696498494 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f34015020 con 0x7f2f3c1f81a0 2024-09-10T23:17:05.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.604+0000 7f2f337fe640 1 -- 172.21.15.90:0/2696498494 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f34011960 con 0x7f2f3c1f81a0 2024-09-10T23:17:05.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.604+0000 7f2f41062640 1 -- 172.21.15.90:0/2696498494 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f3c0b7a70 con 0x7f2f3c1f81a0 2024-09-10T23:17:05.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.604+0000 7f2f337fe640 1 -- 172.21.15.90:0/2696498494 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f34011db0 con 0x7f2f3c1f81a0 2024-09-10T23:17:05.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.604+0000 7f2f41062640 1 -- 172.21.15.90:0/2696498494 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f3c0b8030 con 0x7f2f3c1f81a0 2024-09-10T23:17:05.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.605+0000 7f2f41062640 1 -- 172.21.15.90:0/2696498494 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f3c0d0fc0 con 0x7f2f3c1f81a0 2024-09-10T23:17:05.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.605+0000 7f2f337fe640 1 -- 172.21.15.90:0/2696498494 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2f340103c0 con 0x7f2f3c1f81a0 2024-09-10T23:17:05.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.606+0000 7f2f337fe640 1 --2- 172.21.15.90:0/2696498494 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2f1c077f70 0x7f2f1c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:05.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.606+0000 7f2f337fe640 1 -- 172.21.15.90:0/2696498494 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f2f3409a210 con 0x7f2f3c1f81a0 2024-09-10T23:17:05.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.606+0000 7f2f3ad9d640 1 --2- 172.21.15.90:0/2696498494 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2f1c077f70 0x7f2f1c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:05.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.606+0000 7f2f3ad9d640 1 --2- 172.21.15.90:0/2696498494 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2f1c077f70 0x7f2f1c07a430 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c035000 tx=0x7f2f2c004a40 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:05.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.610+0000 7f2f337fe640 1 -- 172.21.15.90:0/2696498494 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2f3401f030 con 0x7f2f3c1f81a0 2024-09-10T23:17:05.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.779+0000 7f2f41062640 1 -- 172.21.15.90:0/2696498494 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f3c154e30 con 0x7f2f1c077f70 2024-09-10T23:17:05.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.783+0000 7f2f337fe640 1 -- 172.21.15.90:0/2696498494 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241333 (secure 0 0 0) 0x7f2f2c02bc30 con 0x7f2f1c077f70 2024-09-10T23:17:05.786 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:05.788 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:17:05.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.786+0000 7f2f41062640 1 -- 172.21.15.90:0/2696498494 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2f1c077f70 msgr2=0x7f2f1c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:05.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.786+0000 7f2f41062640 1 --2- 172.21.15.90:0/2696498494 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2f1c077f70 0x7f2f1c07a430 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c035000 tx=0x7f2f2c004a40 comp rx=0 tx=0).stop 2024-09-10T23:17:05.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.786+0000 7f2f41062640 1 -- 172.21.15.90:0/2696498494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f3c1f81a0 msgr2=0x7f2f3c1f8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:05.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.786+0000 7f2f41062640 1 --2- 172.21.15.90:0/2696498494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f3c1f81a0 0x7f2f3c1f8630 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2f34000fb0 tx=0x7f2f3400e9a0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.786+0000 7f2f41062640 1 -- 172.21.15.90:0/2696498494 shutdown_connections 2024-09-10T23:17:05.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.786+0000 7f2f41062640 1 --2- 172.21.15.90:0/2696498494 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2f1c077f70 0x7f2f1c07a430 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.786+0000 7f2f41062640 1 --2- 172.21.15.90:0/2696498494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f3c1f81a0 0x7f2f3c1f8630 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.786+0000 7f2f41062640 1 --2- 172.21.15.90:0/2696498494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f3c1f8d80 0x7f2f3c0ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.786+0000 7f2f41062640 1 --2- 172.21.15.90:0/2696498494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f28003a30 0x7f2f3c0b9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.786+0000 7f2f41062640 1 -- 172.21.15.90:0/2696498494 >> 172.21.15.90:0/2696498494 conn(0x7f2f3c0d4090 msgr2=0x7f2f3c0d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:05.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.786+0000 7f2f41062640 1 -- 172.21.15.90:0/2696498494 shutdown_connections 2024-09-10T23:17:05.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.786+0000 7f2f41062640 1 -- 172.21.15.90:0/2696498494 wait complete. 2024-09-10T23:17:05.797 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-09-10T23:17:04.469843+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236012,"kb_used_data":7272,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738708,"statfs":{"total":773094113280,"available":772852436992,"internally_reserved":0,"allocated":7446528,"data_stored":3745960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.301917"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.190152+0000","last_change":"2024-09-10T23:17:02.187898+0000","last_active":"2024-09-10T23:17:03.190152+0000","last_peered":"2024-09-10T23:17:03.190152+0000","last_clean":"2024-09-10T23:17:03.190152+0000","last_became_active":"2024-09-10T23:17:02.187650+0000","last_became_peered":"2024-09-10T23:17:02.187650+0000","last_unstale":"2024-09-10T23:17:03.190152+0000","last_undegraded":"2024-09-10T23:17:03.190152+0000","last_fullsized":"2024-09-10T23:17:03.190152+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:00.046030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189852+0000","last_change":"2024-09-10T23:17:02.186755+0000","last_active":"2024-09-10T23:17:03.189852+0000","last_peered":"2024-09-10T23:17:03.189852+0000","last_clean":"2024-09-10T23:17:03.189852+0000","last_became_active":"2024-09-10T23:17:02.186481+0000","last_became_peered":"2024-09-10T23:17:02.186481+0000","last_unstale":"2024-09-10T23:17:03.189852+0000","last_undegraded":"2024-09-10T23:17:03.189852+0000","last_fullsized":"2024-09-10T23:17:03.189852+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:20.939249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.190031+0000","last_change":"2024-09-10T23:17:02.183603+0000","last_active":"2024-09-10T23:17:03.190031+0000","last_peered":"2024-09-10T23:17:03.190031+0000","last_clean":"2024-09-10T23:17:03.190031+0000","last_became_active":"2024-09-10T23:17:02.183380+0000","last_became_peered":"2024-09-10T23:17:02.183380+0000","last_unstale":"2024-09-10T23:17:03.190031+0000","last_undegraded":"2024-09-10T23:17:03.190031+0000","last_fullsized":"2024-09-10T23:17:03.190031+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:59.511145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.172137+0000","last_change":"2024-09-10T23:17:00.172137+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.172137+0000","last_undegraded":"2024-09-10T23:17:00.172137+0000","last_fullsized":"2024-09-10T23:17:00.172137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.190010+0000","last_change":"2024-09-10T23:17:01.188635+0000","last_active":"2024-09-10T23:17:03.190010+0000","last_peered":"2024-09-10T23:17:03.190010+0000","last_clean":"2024-09-10T23:17:03.190010+0000","last_became_active":"2024-09-10T23:17:01.188298+0000","last_became_peered":"2024-09-10T23:17:01.188298+0000","last_unstale":"2024-09-10T23:17:03.190010+0000","last_undegraded":"2024-09-10T23:17:03.190010+0000","last_fullsized":"2024-09-10T23:17:03.190010+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:20.519330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.169903+0000","last_change":"2024-09-10T23:17:00.169903+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.169903+0000","last_undegraded":"2024-09-10T23:17:00.169903+0000","last_fullsized":"2024-09-10T23:17:00.169903+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.173181+0000","last_change":"2024-09-10T23:17:00.173181+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.173181+0000","last_undegraded":"2024-09-10T23:17:00.173181+0000","last_fullsized":"2024-09-10T23:17:00.173181+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171586+0000","last_change":"2024-09-10T23:17:00.171586+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171586+0000","last_undegraded":"2024-09-10T23:17:00.171586+0000","last_fullsized":"2024-09-10T23:17:00.171586+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.174746+0000","last_change":"2024-09-10T23:17:00.174746+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.174746+0000","last_undegraded":"2024-09-10T23:17:00.174746+0000","last_fullsized":"2024-09-10T23:17:00.174746+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.177008+0000","last_change":"2024-09-10T23:17:00.177008+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.177008+0000","last_undegraded":"2024-09-10T23:17:00.177008+0000","last_fullsized":"2024-09-10T23:17:00.177008+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189857+0000","last_change":"2024-09-10T23:17:02.182823+0000","last_active":"2024-09-10T23:17:03.189857+0000","last_peered":"2024-09-10T23:17:03.189857+0000","last_clean":"2024-09-10T23:17:03.189857+0000","last_became_active":"2024-09-10T23:17:02.182551+0000","last_became_peered":"2024-09-10T23:17:02.182551+0000","last_unstale":"2024-09-10T23:17:03.189857+0000","last_undegraded":"2024-09-10T23:17:03.189857+0000","last_fullsized":"2024-09-10T23:17:03.189857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:16.350578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.172066+0000","last_change":"2024-09-10T23:17:00.172066+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.172066+0000","last_undegraded":"2024-09-10T23:17:00.172066+0000","last_fullsized":"2024-09-10T23:17:00.172066+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.169940+0000","last_change":"2024-09-10T23:17:00.169940+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.169940+0000","last_undegraded":"2024-09-10T23:17:00.169940+0000","last_fullsized":"2024-09-10T23:17:00.169940+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.174074+0000","last_change":"2024-09-10T23:17:00.174074+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.174074+0000","last_undegraded":"2024-09-10T23:17:00.174074+0000","last_fullsized":"2024-09-10T23:17:00.174074+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171592+0000","last_change":"2024-09-10T23:17:00.171592+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171592+0000","last_undegraded":"2024-09-10T23:17:00.171592+0000","last_fullsized":"2024-09-10T23:17:00.171592+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.177049+0000","last_change":"2024-09-10T23:17:00.177049+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.177049+0000","last_undegraded":"2024-09-10T23:17:00.177049+0000","last_fullsized":"2024-09-10T23:17:00.177049+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.177120+0000","last_change":"2024-09-10T23:17:00.177120+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.177120+0000","last_undegraded":"2024-09-10T23:17:00.177120+0000","last_fullsized":"2024-09-10T23:17:00.177120+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.174254+0000","last_change":"2024-09-10T23:17:00.174254+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.174254+0000","last_undegraded":"2024-09-10T23:17:00.174254+0000","last_fullsized":"2024-09-10T23:17:00.174254+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189830+0000","last_change":"2024-09-10T23:17:02.188651+0000","last_active":"2024-09-10T23:17:03.189830+0000","last_peered":"2024-09-10T23:17:03.189830+0000","last_clean":"2024-09-10T23:17:03.189830+0000","last_became_active":"2024-09-10T23:17:02.188383+0000","last_became_peered":"2024-09-10T23:17:02.188383+0000","last_unstale":"2024-09-10T23:17:03.189830+0000","last_undegraded":"2024-09-10T23:17:03.189830+0000","last_fullsized":"2024-09-10T23:17:03.189830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:59.895108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171722+0000","last_change":"2024-09-10T23:17:00.171722+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171722+0000","last_undegraded":"2024-09-10T23:17:00.171722+0000","last_fullsized":"2024-09-10T23:17:00.171722+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.169901+0000","last_change":"2024-09-10T23:17:00.169901+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.169901+0000","last_undegraded":"2024-09-10T23:17:00.169901+0000","last_fullsized":"2024-09-10T23:17:00.169901+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.174461+0000","last_change":"2024-09-10T23:17:00.174461+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.174461+0000","last_undegraded":"2024-09-10T23:17:00.174461+0000","last_fullsized":"2024-09-10T23:17:00.174461+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.169910+0000","last_change":"2024-09-10T23:17:00.169910+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.169910+0000","last_undegraded":"2024-09-10T23:17:00.169910+0000","last_fullsized":"2024-09-10T23:17:00.169910+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.173414+0000","last_change":"2024-09-10T23:17:00.173414+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.173414+0000","last_undegraded":"2024-09-10T23:17:00.173414+0000","last_fullsized":"2024-09-10T23:17:00.173414+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.172111+0000","last_change":"2024-09-10T23:17:00.172111+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.172111+0000","last_undegraded":"2024-09-10T23:17:00.172111+0000","last_fullsized":"2024-09-10T23:17:00.172111+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.173150+0000","last_change":"2024-09-10T23:17:00.173150+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.173150+0000","last_undegraded":"2024-09-10T23:17:00.173150+0000","last_fullsized":"2024-09-10T23:17:00.173150+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171169+0000","last_change":"2024-09-10T23:17:00.171169+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171169+0000","last_undegraded":"2024-09-10T23:17:00.171169+0000","last_fullsized":"2024-09-10T23:17:00.171169+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189732+0000","last_change":"2024-09-10T23:17:01.187869+0000","last_active":"2024-09-10T23:17:03.189732+0000","last_peered":"2024-09-10T23:17:03.189732+0000","last_clean":"2024-09-10T23:17:03.189732+0000","last_became_active":"2024-09-10T23:17:01.187625+0000","last_became_peered":"2024-09-10T23:17:01.187625+0000","last_unstale":"2024-09-10T23:17:03.189732+0000","last_undegraded":"2024-09-10T23:17:03.189732+0000","last_fullsized":"2024-09-10T23:17:03.189732+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:55.975680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189964+0000","last_change":"2024-09-10T23:17:02.185910+0000","last_active":"2024-09-10T23:17:03.189964+0000","last_peered":"2024-09-10T23:17:03.189964+0000","last_clean":"2024-09-10T23:17:03.189964+0000","last_became_active":"2024-09-10T23:17:02.185560+0000","last_became_peered":"2024-09-10T23:17:02.185560+0000","last_unstale":"2024-09-10T23:17:03.189964+0000","last_undegraded":"2024-09-10T23:17:03.189964+0000","last_fullsized":"2024-09-10T23:17:03.189964+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:06.496984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.174005+0000","last_change":"2024-09-10T23:17:00.174005+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.174005+0000","last_undegraded":"2024-09-10T23:17:00.174005+0000","last_fullsized":"2024-09-10T23:17:00.174005+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171230+0000","last_change":"2024-09-10T23:17:00.171230+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171230+0000","last_undegraded":"2024-09-10T23:17:00.171230+0000","last_fullsized":"2024-09-10T23:17:00.171230+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.171917+0000","last_change":"2024-09-10T23:17:00.171917+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.171917+0000","last_undegraded":"2024-09-10T23:17:00.171917+0000","last_fullsized":"2024-09-10T23:17:00.171917+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189975+0000","last_change":"2024-09-10T23:17:01.186902+0000","last_active":"2024-09-10T23:17:03.189975+0000","last_peered":"2024-09-10T23:17:03.189975+0000","last_clean":"2024-09-10T23:17:03.189975+0000","last_became_active":"2024-09-10T23:17:01.186661+0000","last_became_peered":"2024-09-10T23:17:01.186661+0000","last_unstale":"2024-09-10T23:17:03.189975+0000","last_undegraded":"2024-09-10T23:17:03.189975+0000","last_fullsized":"2024-09-10T23:17:03.189975+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:27.761361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.172122+0000","last_change":"2024-09-10T23:17:00.172122+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.172122+0000","last_undegraded":"2024-09-10T23:17:00.172122+0000","last_fullsized":"2024-09-10T23:17:00.172122+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.177008+0000","last_change":"2024-09-10T23:17:00.177008+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.177008+0000","last_undegraded":"2024-09-10T23:17:00.177008+0000","last_fullsized":"2024-09-10T23:17:00.177008+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.170204+0000","last_change":"2024-09-10T23:17:00.170204+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.170204+0000","last_undegraded":"2024-09-10T23:17:00.170204+0000","last_fullsized":"2024-09-10T23:17:00.170204+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.173311+0000","last_change":"2024-09-10T23:17:00.173311+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.173311+0000","last_undegraded":"2024-09-10T23:17:00.173311+0000","last_fullsized":"2024-09-10T23:17:00.173311+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:01.167633+0000","last_change":"2024-09-10T23:17:01.167633+0000","last_active":"2024-09-10T23:17:01.167633+0000","last_peered":"2024-09-10T23:17:01.167633+0000","last_clean":"2024-09-10T23:17:01.167633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:01.167633+0000","last_undegraded":"2024-09-10T23:17:01.167633+0000","last_fullsized":"2024-09-10T23:17:01.167633+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T23:17:00.173283+0000","last_change":"2024-09-10T23:17:00.173283+0000","last_active":"2024-09-10T23:17:00.165534+0000","last_peered":"2024-09-10T23:17:00.165534+0000","last_clean":"2024-09-10T23:17:00.165534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:00.173283+0000","last_undegraded":"2024-09-10T23:17:00.173283+0000","last_fullsized":"2024-09-10T23:17:00.173283+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":184,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T23:17:00.172440+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:17:00.172440+0000","last_peered":"2024-09-10T23:17:00.172440+0000","last_clean":"2024-09-10T23:17:00.172440+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:17:00.172440+0000","last_undegraded":"2024-09-10T23:17:00.172440+0000","last_fullsized":"2024-09-10T23:17:00.172440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28376,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343464,"statfs":{"total":96636764160,"available":96607707136,"internally_reserved":0,"allocated":1376256,"data_stored":910844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":782336,"data_stored":320476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":770048,"data_stored":314659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":770048,"data_stored":314659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":782336,"data_stored":320476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":782336,"data_stored":320476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":320476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1400832,"data_stored":923894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:17:05.802 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3f is not active+clean 2024-09-10T23:17:05.802 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.802 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3e is not active+clean 2024-09-10T23:17:05.802 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.802 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3d is not active+clean 2024-09-10T23:17:05.802 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.803 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3c is not active+clean 2024-09-10T23:17:05.803 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.803 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3b is not active+clean 2024-09-10T23:17:05.803 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.803 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3a is not active+clean 2024-09-10T23:17:05.803 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.803 INFO:tasks.ceph.ceph_manager.ceph:PG 11.39 is not active+clean 2024-09-10T23:17:05.803 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.803 INFO:tasks.ceph.ceph_manager.ceph:PG 11.38 is not active+clean 2024-09-10T23:17:05.803 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.804 INFO:tasks.ceph.ceph_manager.ceph:PG 11.37 is not active+clean 2024-09-10T23:17:05.804 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.804 INFO:tasks.ceph.ceph_manager.ceph:PG 11.36 is not active+clean 2024-09-10T23:17:05.804 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.804 INFO:tasks.ceph.ceph_manager.ceph:PG 11.35 is not active+clean 2024-09-10T23:17:05.804 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.805 INFO:tasks.ceph.ceph_manager.ceph:PG 11.34 is not active+clean 2024-09-10T23:17:05.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.805 INFO:tasks.ceph.ceph_manager.ceph:PG 11.32 is not active+clean 2024-09-10T23:17:05.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.805 INFO:tasks.ceph.ceph_manager.ceph:PG 11.30 is not active+clean 2024-09-10T23:17:05.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.806 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2f is not active+clean 2024-09-10T23:17:05.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.806 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2e is not active+clean 2024-09-10T23:17:05.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.806 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2d is not active+clean 2024-09-10T23:17:05.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.806 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2b is not active+clean 2024-09-10T23:17:05.807 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.807 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2a is not active+clean 2024-09-10T23:17:05.807 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.807 INFO:tasks.ceph.ceph_manager.ceph:PG 11.29 is not active+clean 2024-09-10T23:17:05.807 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.807 INFO:tasks.ceph.ceph_manager.ceph:PG 11.28 is not active+clean 2024-09-10T23:17:05.807 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.808 INFO:tasks.ceph.ceph_manager.ceph:PG 11.27 is not active+clean 2024-09-10T23:17:05.808 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.808 INFO:tasks.ceph.ceph_manager.ceph:PG 11.26 is not active+clean 2024-09-10T23:17:05.808 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.808 INFO:tasks.ceph.ceph_manager.ceph:PG 11.25 is not active+clean 2024-09-10T23:17:05.809 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.809 INFO:tasks.ceph.ceph_manager.ceph:PG 11.24 is not active+clean 2024-09-10T23:17:05.809 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.809 INFO:tasks.ceph.ceph_manager.ceph:PG 11.23 is not active+clean 2024-09-10T23:17:05.809 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.810 INFO:tasks.ceph.ceph_manager.ceph:PG 11.22 is not active+clean 2024-09-10T23:17:05.810 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.810 INFO:tasks.ceph.ceph_manager.ceph:PG 11.21 is not active+clean 2024-09-10T23:17:05.810 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.810 INFO:tasks.ceph.ceph_manager.ceph:PG 11.20 is not active+clean 2024-09-10T23:17:05.810 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.810 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1e is not active+clean 2024-09-10T23:17:05.810 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.810 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1f is not active+clean 2024-09-10T23:17:05.811 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.172137+0000', 'last_change': '2024-09-10T23:17:00.172137+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.172137+0000', 'last_undegraded': '2024-09-10T23:17:00.172137+0000', 'last_fullsized': '2024-09-10T23:17:00.172137+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:17:05.811 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1f is not active+clean 2024-09-10T23:17:05.811 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.811 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1c is not active+clean 2024-09-10T23:17:05.811 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.811 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1d is not active+clean 2024-09-10T23:17:05.811 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.169903+0000', 'last_change': '2024-09-10T23:17:00.169903+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.169903+0000', 'last_undegraded': '2024-09-10T23:17:00.169903+0000', 'last_fullsized': '2024-09-10T23:17:00.169903+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:17:05.812 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1d is not active+clean 2024-09-10T23:17:05.812 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.812 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1c is not active+clean 2024-09-10T23:17:05.812 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.173181+0000', 'last_change': '2024-09-10T23:17:00.173181+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.173181+0000', 'last_undegraded': '2024-09-10T23:17:00.173181+0000', 'last_fullsized': '2024-09-10T23:17:00.173181+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:17:05.812 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1a is not active+clean 2024-09-10T23:17:05.812 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.812 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1b is not active+clean 2024-09-10T23:17:05.812 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.171586+0000', 'last_change': '2024-09-10T23:17:00.171586+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.171586+0000', 'last_undegraded': '2024-09-10T23:17:00.171586+0000', 'last_fullsized': '2024-09-10T23:17:00.171586+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:17:05.812 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1b is not active+clean 2024-09-10T23:17:05.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.813 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1a is not active+clean 2024-09-10T23:17:05.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.174746+0000', 'last_change': '2024-09-10T23:17:00.174746+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.174746+0000', 'last_undegraded': '2024-09-10T23:17:00.174746+0000', 'last_fullsized': '2024-09-10T23:17:00.174746+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:17:05.813 INFO:tasks.ceph.ceph_manager.ceph:PG 11.18 is not active+clean 2024-09-10T23:17:05.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.813 INFO:tasks.ceph.ceph_manager.ceph:PG 10.19 is not active+clean 2024-09-10T23:17:05.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.177008+0000', 'last_change': '2024-09-10T23:17:00.177008+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.177008+0000', 'last_undegraded': '2024-09-10T23:17:00.177008+0000', 'last_fullsized': '2024-09-10T23:17:00.177008+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T23:17:05.813 INFO:tasks.ceph.ceph_manager.ceph:PG 10.18 is not active+clean 2024-09-10T23:17:05.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.172066+0000', 'last_change': '2024-09-10T23:17:00.172066+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.172066+0000', 'last_undegraded': '2024-09-10T23:17:00.172066+0000', 'last_fullsized': '2024-09-10T23:17:00.172066+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T23:17:05.814 INFO:tasks.ceph.ceph_manager.ceph:PG 11.16 is not active+clean 2024-09-10T23:17:05.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.814 INFO:tasks.ceph.ceph_manager.ceph:PG 10.17 is not active+clean 2024-09-10T23:17:05.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.169940+0000', 'last_change': '2024-09-10T23:17:00.169940+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.169940+0000', 'last_undegraded': '2024-09-10T23:17:00.169940+0000', 'last_fullsized': '2024-09-10T23:17:00.169940+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:17:05.814 INFO:tasks.ceph.ceph_manager.ceph:PG 11.17 is not active+clean 2024-09-10T23:17:05.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.814 INFO:tasks.ceph.ceph_manager.ceph:PG 10.16 is not active+clean 2024-09-10T23:17:05.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.174074+0000', 'last_change': '2024-09-10T23:17:00.174074+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.174074+0000', 'last_undegraded': '2024-09-10T23:17:00.174074+0000', 'last_fullsized': '2024-09-10T23:17:00.174074+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:17:05.814 INFO:tasks.ceph.ceph_manager.ceph:PG 11.14 is not active+clean 2024-09-10T23:17:05.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.815 INFO:tasks.ceph.ceph_manager.ceph:PG 10.15 is not active+clean 2024-09-10T23:17:05.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.171592+0000', 'last_change': '2024-09-10T23:17:00.171592+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.171592+0000', 'last_undegraded': '2024-09-10T23:17:00.171592+0000', 'last_fullsized': '2024-09-10T23:17:00.171592+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:17:05.815 INFO:tasks.ceph.ceph_manager.ceph:PG 11.15 is not active+clean 2024-09-10T23:17:05.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.815 INFO:tasks.ceph.ceph_manager.ceph:PG 10.14 is not active+clean 2024-09-10T23:17:05.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.177049+0000', 'last_change': '2024-09-10T23:17:00.177049+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.177049+0000', 'last_undegraded': '2024-09-10T23:17:00.177049+0000', 'last_fullsized': '2024-09-10T23:17:00.177049+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T23:17:05.816 INFO:tasks.ceph.ceph_manager.ceph:PG 11.12 is not active+clean 2024-09-10T23:17:05.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.816 INFO:tasks.ceph.ceph_manager.ceph:PG 10.13 is not active+clean 2024-09-10T23:17:05.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.177120+0000', 'last_change': '2024-09-10T23:17:00.177120+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.177120+0000', 'last_undegraded': '2024-09-10T23:17:00.177120+0000', 'last_fullsized': '2024-09-10T23:17:00.177120+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T23:17:05.816 INFO:tasks.ceph.ceph_manager.ceph:PG 11.13 is not active+clean 2024-09-10T23:17:05.817 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.817 INFO:tasks.ceph.ceph_manager.ceph:PG 10.12 is not active+clean 2024-09-10T23:17:05.817 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.174254+0000', 'last_change': '2024-09-10T23:17:00.174254+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.174254+0000', 'last_undegraded': '2024-09-10T23:17:00.174254+0000', 'last_fullsized': '2024-09-10T23:17:00.174254+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:17:05.817 INFO:tasks.ceph.ceph_manager.ceph:PG 10.11 is not active+clean 2024-09-10T23:17:05.817 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.171722+0000', 'last_change': '2024-09-10T23:17:00.171722+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.171722+0000', 'last_undegraded': '2024-09-10T23:17:00.171722+0000', 'last_fullsized': '2024-09-10T23:17:00.171722+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:17:05.818 INFO:tasks.ceph.ceph_manager.ceph:PG 11.11 is not active+clean 2024-09-10T23:17:05.818 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.818 INFO:tasks.ceph.ceph_manager.ceph:PG 10.10 is not active+clean 2024-09-10T23:17:05.818 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.169901+0000', 'last_change': '2024-09-10T23:17:00.169901+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.169901+0000', 'last_undegraded': '2024-09-10T23:17:00.169901+0000', 'last_fullsized': '2024-09-10T23:17:00.169901+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:17:05.818 INFO:tasks.ceph.ceph_manager.ceph:PG 11.e is not active+clean 2024-09-10T23:17:05.818 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.819 INFO:tasks.ceph.ceph_manager.ceph:PG 10.f is not active+clean 2024-09-10T23:17:05.819 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.174461+0000', 'last_change': '2024-09-10T23:17:00.174461+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.174461+0000', 'last_undegraded': '2024-09-10T23:17:00.174461+0000', 'last_fullsized': '2024-09-10T23:17:00.174461+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:17:05.819 INFO:tasks.ceph.ceph_manager.ceph:PG 11.f is not active+clean 2024-09-10T23:17:05.819 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.819 INFO:tasks.ceph.ceph_manager.ceph:PG 10.e is not active+clean 2024-09-10T23:17:05.819 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.169910+0000', 'last_change': '2024-09-10T23:17:00.169910+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.169910+0000', 'last_undegraded': '2024-09-10T23:17:00.169910+0000', 'last_fullsized': '2024-09-10T23:17:00.169910+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:17:05.820 INFO:tasks.ceph.ceph_manager.ceph:PG 11.c is not active+clean 2024-09-10T23:17:05.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.820 INFO:tasks.ceph.ceph_manager.ceph:PG 10.d is not active+clean 2024-09-10T23:17:05.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.173414+0000', 'last_change': '2024-09-10T23:17:00.173414+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.173414+0000', 'last_undegraded': '2024-09-10T23:17:00.173414+0000', 'last_fullsized': '2024-09-10T23:17:00.173414+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:17:05.820 INFO:tasks.ceph.ceph_manager.ceph:PG 11.d is not active+clean 2024-09-10T23:17:05.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.820 INFO:tasks.ceph.ceph_manager.ceph:PG 10.c is not active+clean 2024-09-10T23:17:05.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.172111+0000', 'last_change': '2024-09-10T23:17:00.172111+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.172111+0000', 'last_undegraded': '2024-09-10T23:17:00.172111+0000', 'last_fullsized': '2024-09-10T23:17:00.172111+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:17:05.820 INFO:tasks.ceph.ceph_manager.ceph:PG 11.b is not active+clean 2024-09-10T23:17:05.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.821 INFO:tasks.ceph.ceph_manager.ceph:PG 10.a is not active+clean 2024-09-10T23:17:05.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.173150+0000', 'last_change': '2024-09-10T23:17:00.173150+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.173150+0000', 'last_undegraded': '2024-09-10T23:17:00.173150+0000', 'last_fullsized': '2024-09-10T23:17:00.173150+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:17:05.821 INFO:tasks.ceph.ceph_manager.ceph:PG 11.8 is not active+clean 2024-09-10T23:17:05.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.821 INFO:tasks.ceph.ceph_manager.ceph:PG 10.9 is not active+clean 2024-09-10T23:17:05.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.171169+0000', 'last_change': '2024-09-10T23:17:00.171169+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.171169+0000', 'last_undegraded': '2024-09-10T23:17:00.171169+0000', 'last_fullsized': '2024-09-10T23:17:00.171169+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:17:05.821 INFO:tasks.ceph.ceph_manager.ceph:PG 11.9 is not active+clean 2024-09-10T23:17:05.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.822 INFO:tasks.ceph.ceph_manager.ceph:PG 10.7 is not active+clean 2024-09-10T23:17:05.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.174005+0000', 'last_change': '2024-09-10T23:17:00.174005+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.174005+0000', 'last_undegraded': '2024-09-10T23:17:00.174005+0000', 'last_fullsized': '2024-09-10T23:17:00.174005+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:17:05.822 INFO:tasks.ceph.ceph_manager.ceph:PG 11.7 is not active+clean 2024-09-10T23:17:05.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.822 INFO:tasks.ceph.ceph_manager.ceph:PG 10.6 is not active+clean 2024-09-10T23:17:05.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.171230+0000', 'last_change': '2024-09-10T23:17:00.171230+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.171230+0000', 'last_undegraded': '2024-09-10T23:17:00.171230+0000', 'last_fullsized': '2024-09-10T23:17:00.171230+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:17:05.822 INFO:tasks.ceph.ceph_manager.ceph:PG 11.4 is not active+clean 2024-09-10T23:17:05.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.823 INFO:tasks.ceph.ceph_manager.ceph:PG 10.5 is not active+clean 2024-09-10T23:17:05.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.171917+0000', 'last_change': '2024-09-10T23:17:00.171917+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.171917+0000', 'last_undegraded': '2024-09-10T23:17:00.171917+0000', 'last_fullsized': '2024-09-10T23:17:00.171917+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T23:17:05.823 INFO:tasks.ceph.ceph_manager.ceph:PG 11.5 is not active+clean 2024-09-10T23:17:05.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.823 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2 is not active+clean 2024-09-10T23:17:05.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.823 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3 is not active+clean 2024-09-10T23:17:05.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.172122+0000', 'last_change': '2024-09-10T23:17:00.172122+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.172122+0000', 'last_undegraded': '2024-09-10T23:17:00.172122+0000', 'last_fullsized': '2024-09-10T23:17:00.172122+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T23:17:05.823 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3 is not active+clean 2024-09-10T23:17:05.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.824 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2 is not active+clean 2024-09-10T23:17:05.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.177008+0000', 'last_change': '2024-09-10T23:17:00.177008+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.177008+0000', 'last_undegraded': '2024-09-10T23:17:00.177008+0000', 'last_fullsized': '2024-09-10T23:17:00.177008+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T23:17:05.824 INFO:tasks.ceph.ceph_manager.ceph:PG 11.0 is not active+clean 2024-09-10T23:17:05.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.824 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1 is not active+clean 2024-09-10T23:17:05.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.170204+0000', 'last_change': '2024-09-10T23:17:00.170204+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.170204+0000', 'last_undegraded': '2024-09-10T23:17:00.170204+0000', 'last_fullsized': '2024-09-10T23:17:00.170204+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:17:05.825 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1 is not active+clean 2024-09-10T23:17:05.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.825 INFO:tasks.ceph.ceph_manager.ceph:PG 10.0 is not active+clean 2024-09-10T23:17:05.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.173311+0000', 'last_change': '2024-09-10T23:17:00.173311+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.173311+0000', 'last_undegraded': '2024-09-10T23:17:00.173311+0000', 'last_fullsized': '2024-09-10T23:17:00.173311+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:17:05.825 INFO:tasks.ceph.ceph_manager.ceph:PG 11.a is not active+clean 2024-09-10T23:17:05.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:01.167633+0000', 'last_change': '2024-09-10T23:17:01.167633+0000', 'last_active': '2024-09-10T23:17:01.167633+0000', 'last_peered': '2024-09-10T23:17:01.167633+0000', 'last_clean': '2024-09-10T23:17:01.167633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:01.167633+0000', 'last_undegraded': '2024-09-10T23:17:01.167633+0000', 'last_fullsized': '2024-09-10T23:17:01.167633+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:01.167633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:05.825 INFO:tasks.ceph.ceph_manager.ceph:PG 10.b is not active+clean 2024-09-10T23:17:05.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:00.173283+0000', 'last_change': '2024-09-10T23:17:00.173283+0000', 'last_active': '2024-09-10T23:17:00.165534+0000', 'last_peered': '2024-09-10T23:17:00.165534+0000', 'last_clean': '2024-09-10T23:17:00.165534+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:00.173283+0000', 'last_undegraded': '2024-09-10T23:17:00.173283+0000', 'last_fullsized': '2024-09-10T23:17:00.173283+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:00.165534+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:17:05.826 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:17:05.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.940+0000 7f61be0cd640 1 -- 172.21.15.90:0/3505176792 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b80d0940 msgr2=0x7f61b806d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:05.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.940+0000 7f61be0cd640 1 --2- 172.21.15.90:0/3505176792 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b80d0940 0x7f61b806d6f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f61b808e5f0 tx=0x7f61b002aa30 comp rx=0 tx=0).stop 2024-09-10T23:17:05.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.940+0000 7f61be0cd640 1 -- 172.21.15.90:0/3505176792 shutdown_connections 2024-09-10T23:17:05.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.940+0000 7f61be0cd640 1 --2- 172.21.15.90:0/3505176792 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b80d0940 0x7f61b806d6f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.940+0000 7f61be0cd640 1 --2- 172.21.15.90:0/3505176792 >> v2:172.21.15.171:3300/0 conn(0x7f61b80d3570 0x7f61b80d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.940+0000 7f61be0cd640 1 --2- 172.21.15.90:0/3505176792 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61b81617f0 0x7f61b80d2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.940+0000 7f61be0cd640 1 -- 172.21.15.90:0/3505176792 >> 172.21.15.90:0/3505176792 conn(0x7f61b80d4110 msgr2=0x7f61b80d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:05.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.940+0000 7f61be0cd640 1 -- 172.21.15.90:0/3505176792 shutdown_connections 2024-09-10T23:17:05.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.940+0000 7f61be0cd640 1 -- 172.21.15.90:0/3505176792 wait complete. 2024-09-10T23:17:05.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.941+0000 7f61be0cd640 1 Processor -- start 2024-09-10T23:17:05.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.941+0000 7f61be0cd640 1 -- start start 2024-09-10T23:17:05.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61be0cd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61b80d0940 0x7f61b80ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:05.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61be0cd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b80d3570 0x7f61b80cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:05.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61be0cd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61b81617f0 0x7f61b815b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:05.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61be0cd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f61b806e950 con 0x7f61b80d3570 2024-09-10T23:17:05.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61be0cd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f61b806dc30 con 0x7f61b81617f0 2024-09-10T23:17:05.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61be0cd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f61b806ddb0 con 0x7f61b80d0940 2024-09-10T23:17:05.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61affff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b80d3570 0x7f61b80cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:05.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61affff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b80d3570 0x7f61b80cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59118/0 (socket says 172.21.15.90:59118) 2024-09-10T23:17:05.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61affff640 1 -- 172.21.15.90:0/1532572643 learned_addr learned my addr 172.21.15.90:0/1532572643 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:05.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61b77fe640 1 --2- 172.21.15.90:0/1532572643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61b80d0940 0x7f61b80ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:05.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61b7fff640 1 --2- 172.21.15.90:0/1532572643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61b81617f0 0x7f61b815b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:05.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61affff640 1 -- 172.21.15.90:0/1532572643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61b80d0940 msgr2=0x7f61b80ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:05.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61affff640 1 --2- 172.21.15.90:0/1532572643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61b80d0940 0x7f61b80ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61affff640 1 -- 172.21.15.90:0/1532572643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61b81617f0 msgr2=0x7f61b815b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:05.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61affff640 1 --2- 172.21.15.90:0/1532572643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61b81617f0 0x7f61b815b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:05.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61affff640 1 -- 172.21.15.90:0/1532572643 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b80c7c00 con 0x7f61b80d3570 2024-09-10T23:17:05.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61b77fe640 1 --2- 172.21.15.90:0/1532572643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61b80d0940 0x7f61b80ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:05.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61b7fff640 1 --2- 172.21.15.90:0/1532572643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61b81617f0 0x7f61b815b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:05.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61affff640 1 --2- 172.21.15.90:0/1532572643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b80d3570 0x7f61b80cdf40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f61a0005940 tx=0x7f61a000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:05.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61b4ff9640 1 -- 172.21.15.90:0/1532572643 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a0007bb0 con 0x7f61b80d3570 2024-09-10T23:17:05.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61b4ff9640 1 -- 172.21.15.90:0/1532572643 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61a0007e40 con 0x7f61b80d3570 2024-09-10T23:17:05.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61b4ff9640 1 -- 172.21.15.90:0/1532572643 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a000f6b0 con 0x7f61b80d3570 2024-09-10T23:17:05.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61be0cd640 1 -- 172.21.15.90:0/1532572643 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b80ce480 con 0x7f61b80d3570 2024-09-10T23:17:05.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.942+0000 7f61be0cd640 1 -- 172.21.15.90:0/1532572643 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b80c8460 con 0x7f61b80d3570 2024-09-10T23:17:05.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.943+0000 7f61be0cd640 1 -- 172.21.15.90:0/1532572643 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b80d0400 con 0x7f61b80d3570 2024-09-10T23:17:05.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.944+0000 7f61b4ff9640 1 -- 172.21.15.90:0/1532572643 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f61a0020030 con 0x7f61b80d3570 2024-09-10T23:17:05.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.944+0000 7f61b4ff9640 1 --2- 172.21.15.90:0/1532572643 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6198077f70 0x7f619807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:05.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.944+0000 7f61b4ff9640 1 -- 172.21.15.90:0/1532572643 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f61a009a2c0 con 0x7f61b80d3570 2024-09-10T23:17:05.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.944+0000 7f61b77fe640 1 --2- 172.21.15.90:0/1532572643 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6198077f70 0x7f619807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:05.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.945+0000 7f61b77fe640 1 --2- 172.21.15.90:0/1532572643 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6198077f70 0x7f619807a430 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f61a800ba60 tx=0x7f61a8005cf0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:05.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:05.948+0000 7f61b4ff9640 1 -- 172.21.15.90:0/1532572643 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f61a0014030 con 0x7f61b80d3570 2024-09-10T23:17:06.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.188+0000 7f61be0cd640 1 -- 172.21.15.90:0/1532572643 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f61b80c79e0 con 0x7f61b80d3570 2024-09-10T23:17:06.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.189+0000 7f61b4ff9640 1 -- 172.21.15.90:0/1532572643 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1443 (secure 0 0 0) 0x7f61a0062d30 con 0x7f61b80d3570 2024-09-10T23:17:06.190 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:06.190 INFO:teuthology.orchestra.run.smithi090.stdout:{"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":174,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":68,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010065,"num_in_osds":8,"osd_in_since":1726010055,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":58},{"state_name":"creating+peering","count":29},{"state_name":"active+clean","count":10}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":241676288,"bytes_avail":772852436992,"bytes_total":773094113280,"unknown_pgs_ratio":0.59793812036514282,"inactive_pgs_ratio":0.29896906018257141},"fsmap":{"epoch":38,"btime":"2024-09-10T23:17:04:184091+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6006}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-10T23:16:52.467487+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:17:06.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.191+0000 7f61be0cd640 1 -- 172.21.15.90:0/1532572643 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6198077f70 msgr2=0x7f619807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:06.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.191+0000 7f61be0cd640 1 --2- 172.21.15.90:0/1532572643 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6198077f70 0x7f619807a430 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f61a800ba60 tx=0x7f61a8005cf0 comp rx=0 tx=0).stop 2024-09-10T23:17:06.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.191+0000 7f61be0cd640 1 -- 172.21.15.90:0/1532572643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b80d3570 msgr2=0x7f61b80cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:06.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.191+0000 7f61be0cd640 1 --2- 172.21.15.90:0/1532572643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b80d3570 0x7f61b80cdf40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f61a0005940 tx=0x7f61a000cd60 comp rx=0 tx=0).stop 2024-09-10T23:17:06.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.191+0000 7f61be0cd640 1 -- 172.21.15.90:0/1532572643 shutdown_connections 2024-09-10T23:17:06.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.191+0000 7f61be0cd640 1 --2- 172.21.15.90:0/1532572643 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6198077f70 0x7f619807a430 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:06.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.191+0000 7f61be0cd640 1 --2- 172.21.15.90:0/1532572643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61b81617f0 0x7f61b815b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:06.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.191+0000 7f61be0cd640 1 --2- 172.21.15.90:0/1532572643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61b80d3570 0x7f61b80cdf40 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:06.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.191+0000 7f61be0cd640 1 --2- 172.21.15.90:0/1532572643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61b80d0940 0x7f61b80ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:06.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.191+0000 7f61be0cd640 1 -- 172.21.15.90:0/1532572643 >> 172.21.15.90:0/1532572643 conn(0x7f61b80d4110 msgr2=0x7f61b80b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:06.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.191+0000 7f61be0cd640 1 -- 172.21.15.90:0/1532572643 shutdown_connections 2024-09-10T23:17:06.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.191+0000 7f61be0cd640 1 -- 172.21.15.90:0/1532572643 wait complete. 2024-09-10T23:17:06.203 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T23:17:06.204 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:17:06.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.303+0000 7f2614552640 1 -- 172.21.15.90:0/1948074754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f260c0d16f0 msgr2=0x7f260c0d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:06.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.303+0000 7f2614552640 1 --2- 172.21.15.90:0/1948074754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f260c0d16f0 0x7f260c0d0fc0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f260c08c880 tx=0x7f260002a980 comp rx=0 tx=0).stop 2024-09-10T23:17:06.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.303+0000 7f2614552640 1 -- 172.21.15.90:0/1948074754 shutdown_connections 2024-09-10T23:17:06.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.303+0000 7f2614552640 1 --2- 172.21.15.90:0/1948074754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f260c0d16f0 0x7f260c0d0fc0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:06.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.303+0000 7f2614552640 1 --2- 172.21.15.90:0/1948074754 >> v2:172.21.15.171:3300/0 conn(0x7f260c15e310 0x7f260c0d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:06.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.303+0000 7f2614552640 1 -- 172.21.15.90:0/1948074754 >> 172.21.15.90:0/1948074754 conn(0x7f260c0d4090 msgr2=0x7f260c0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:06.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.303+0000 7f2614552640 1 -- 172.21.15.90:0/1948074754 shutdown_connections 2024-09-10T23:17:06.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.303+0000 7f2614552640 1 -- 172.21.15.90:0/1948074754 wait complete. 2024-09-10T23:17:06.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.305+0000 7f2614552640 1 Processor -- start 2024-09-10T23:17:06.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.305+0000 7f2614552640 1 -- start start 2024-09-10T23:17:06.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.305+0000 7f2614552640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f260c0d16f0 0x7f260c1f8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:06.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.305+0000 7f2614552640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f260c0d4b80 0x7f260c0b8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:06.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.305+0000 7f2614552640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f260c15e310 0x7f260c160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:06.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.305+0000 7f2614552640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f260c0cf850 con 0x7f260c0d4b80 2024-09-10T23:17:06.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.305+0000 7f2614552640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f260c0d3ae0 con 0x7f260c15e310 2024-09-10T23:17:06.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.305+0000 7f2614552640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f260c06de00 con 0x7f260c0d16f0 2024-09-10T23:17:06.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.305+0000 7f2611aed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f260c0d4b80 0x7f260c0b8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:06.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.305+0000 7f2611aed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f260c0d4b80 0x7f260c0b8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59146/0 (socket says 172.21.15.90:59146) 2024-09-10T23:17:06.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.305+0000 7f2611aed640 1 -- 172.21.15.90:0/3961079877 learned_addr learned my addr 172.21.15.90:0/3961079877 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:06.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.306+0000 7f26122ee640 1 --2- 172.21.15.90:0/3961079877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f260c0d16f0 0x7f260c1f8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:06.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.306+0000 7f2612aef640 1 --2- 172.21.15.90:0/3961079877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f260c15e310 0x7f260c160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:06.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.306+0000 7f2611aed640 1 -- 172.21.15.90:0/3961079877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f260c0d16f0 msgr2=0x7f260c1f8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:06.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.306+0000 7f2611aed640 1 --2- 172.21.15.90:0/3961079877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f260c0d16f0 0x7f260c1f8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:06.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.306+0000 7f2611aed640 1 -- 172.21.15.90:0/3961079877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f260c15e310 msgr2=0x7f260c160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:06.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.306+0000 7f2611aed640 1 --2- 172.21.15.90:0/3961079877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f260c15e310 0x7f260c160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:06.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.306+0000 7f2611aed640 1 -- 172.21.15.90:0/3961079877 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260c0b93f0 con 0x7f260c0d4b80 2024-09-10T23:17:06.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.306+0000 7f2611aed640 1 --2- 172.21.15.90:0/3961079877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f260c0d4b80 0x7f260c0b8c70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2600009bf0 tx=0x7f2600003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:06.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.306+0000 7f260affd640 1 -- 172.21.15.90:0/3961079877 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600034050 con 0x7f260c0d4b80 2024-09-10T23:17:06.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.306+0000 7f260affd640 1 -- 172.21.15.90:0/3961079877 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26000044d0 con 0x7f260c0d4b80 2024-09-10T23:17:06.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.306+0000 7f260affd640 1 -- 172.21.15.90:0/3961079877 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600043440 con 0x7f260c0d4b80 2024-09-10T23:17:06.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.306+0000 7f2614552640 1 -- 172.21.15.90:0/3961079877 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f260c1f5110 con 0x7f260c0d4b80 2024-09-10T23:17:06.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.306+0000 7f2614552640 1 -- 172.21.15.90:0/3961079877 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f260c1f56d0 con 0x7f260c0d4b80 2024-09-10T23:17:06.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.307+0000 7f2614552640 1 -- 172.21.15.90:0/3961079877 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f260c06e320 con 0x7f260c0d4b80 2024-09-10T23:17:06.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.308+0000 7f260affd640 1 -- 172.21.15.90:0/3961079877 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2600041070 con 0x7f260c0d4b80 2024-09-10T23:17:06.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.308+0000 7f260affd640 1 --2- 172.21.15.90:0/3961079877 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f25f8077f70 0x7f25f807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:06.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.308+0000 7f260affd640 1 -- 172.21.15.90:0/3961079877 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f26000bb200 con 0x7f260c0d4b80 2024-09-10T23:17:06.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.308+0000 7f26122ee640 1 --2- 172.21.15.90:0/3961079877 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f25f8077f70 0x7f25f807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:06.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.309+0000 7f26122ee640 1 --2- 172.21.15.90:0/3961079877 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f25f8077f70 0x7f25f807a430 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2604005fd0 tx=0x7f2604005850 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:06.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.312+0000 7f260affd640 1 -- 172.21.15.90:0/3961079877 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2600083d10 con 0x7f260c0d4b80 2024-09-10T23:17:06.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.484+0000 7f2614552640 1 -- 172.21.15.90:0/3961079877 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f260c0b4e90 con 0x7f25f8077f70 2024-09-10T23:17:06.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.489+0000 7f260affd640 1 -- 172.21.15.90:0/3961079877 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252057 (secure 0 0 0) 0x7f260c0b4e90 con 0x7f25f8077f70 2024-09-10T23:17:06.491 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:06.493 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:17:06.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.491+0000 7f2614552640 1 -- 172.21.15.90:0/3961079877 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f25f8077f70 msgr2=0x7f25f807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:06.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.491+0000 7f2614552640 1 --2- 172.21.15.90:0/3961079877 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f25f8077f70 0x7f25f807a430 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2604005fd0 tx=0x7f2604005850 comp rx=0 tx=0).stop 2024-09-10T23:17:06.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.491+0000 7f2614552640 1 -- 172.21.15.90:0/3961079877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f260c0d4b80 msgr2=0x7f260c0b8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:06.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.491+0000 7f2614552640 1 --2- 172.21.15.90:0/3961079877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f260c0d4b80 0x7f260c0b8c70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2600009bf0 tx=0x7f2600003f90 comp rx=0 tx=0).stop 2024-09-10T23:17:06.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.491+0000 7f2614552640 1 -- 172.21.15.90:0/3961079877 shutdown_connections 2024-09-10T23:17:06.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.491+0000 7f2614552640 1 --2- 172.21.15.90:0/3961079877 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f25f8077f70 0x7f25f807a430 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:06.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.491+0000 7f2614552640 1 --2- 172.21.15.90:0/3961079877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f260c15e310 0x7f260c160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:06.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.491+0000 7f2614552640 1 --2- 172.21.15.90:0/3961079877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f260c0d4b80 0x7f260c0b8c70 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:06.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.491+0000 7f2614552640 1 --2- 172.21.15.90:0/3961079877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f260c0d16f0 0x7f260c1f8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:06.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.491+0000 7f2614552640 1 -- 172.21.15.90:0/3961079877 >> 172.21.15.90:0/3961079877 conn(0x7f260c0d4090 msgr2=0x7f260c0b53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:06.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.491+0000 7f2614552640 1 -- 172.21.15.90:0/3961079877 shutdown_connections 2024-09-10T23:17:06.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:06.491+0000 7f2614552640 1 -- 172.21.15.90:0/3961079877 wait complete. 2024-09-10T23:17:06.503 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-09-10T23:17:06.470314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236336,"kb_used_data":7612,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738384,"statfs":{"total":773094113280,"available":772852105216,"internally_reserved":0,"allocated":7794688,"data_stored":3897864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001298"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549743+0000","last_change":"2024-09-10T23:17:02.190617+0000","last_active":"2024-09-10T23:17:03.549743+0000","last_peered":"2024-09-10T23:17:03.549743+0000","last_clean":"2024-09-10T23:17:03.549743+0000","last_became_active":"2024-09-10T23:17:02.190368+0000","last_became_peered":"2024-09-10T23:17:02.190368+0000","last_unstale":"2024-09-10T23:17:03.549743+0000","last_undegraded":"2024-09-10T23:17:03.549743+0000","last_fullsized":"2024-09-10T23:17:03.549743+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:16.268902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550620+0000","last_change":"2024-09-10T23:17:02.190936+0000","last_active":"2024-09-10T23:17:03.550620+0000","last_peered":"2024-09-10T23:17:03.550620+0000","last_clean":"2024-09-10T23:17:03.550620+0000","last_became_active":"2024-09-10T23:17:02.190607+0000","last_became_peered":"2024-09-10T23:17:02.190607+0000","last_unstale":"2024-09-10T23:17:03.550620+0000","last_undegraded":"2024-09-10T23:17:03.550620+0000","last_fullsized":"2024-09-10T23:17:03.550620+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:15.990112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549497+0000","last_change":"2024-09-10T23:17:02.184584+0000","last_active":"2024-09-10T23:17:03.549497+0000","last_peered":"2024-09-10T23:17:03.549497+0000","last_clean":"2024-09-10T23:17:03.549497+0000","last_became_active":"2024-09-10T23:17:02.184233+0000","last_became_peered":"2024-09-10T23:17:02.184233+0000","last_unstale":"2024-09-10T23:17:03.549497+0000","last_undegraded":"2024-09-10T23:17:03.549497+0000","last_fullsized":"2024-09-10T23:17:03.549497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:03.018367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549230+0000","last_change":"2024-09-10T23:17:02.173515+0000","last_active":"2024-09-10T23:17:03.549230+0000","last_peered":"2024-09-10T23:17:03.549230+0000","last_clean":"2024-09-10T23:17:03.549230+0000","last_became_active":"2024-09-10T23:17:02.173273+0000","last_became_peered":"2024-09-10T23:17:02.173273+0000","last_unstale":"2024-09-10T23:17:03.549230+0000","last_undegraded":"2024-09-10T23:17:03.549230+0000","last_fullsized":"2024-09-10T23:17:03.549230+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:27.980015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168160+0000","last_change":"2024-09-10T23:17:02.181213+0000","last_active":"2024-09-10T23:17:03.168160+0000","last_peered":"2024-09-10T23:17:03.168160+0000","last_clean":"2024-09-10T23:17:03.168160+0000","last_became_active":"2024-09-10T23:17:02.180936+0000","last_became_peered":"2024-09-10T23:17:02.180936+0000","last_unstale":"2024-09-10T23:17:03.168160+0000","last_undegraded":"2024-09-10T23:17:03.168160+0000","last_fullsized":"2024-09-10T23:17:03.168160+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:25.721086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549789+0000","last_change":"2024-09-10T23:17:02.189630+0000","last_active":"2024-09-10T23:17:03.549789+0000","last_peered":"2024-09-10T23:17:03.549789+0000","last_clean":"2024-09-10T23:17:03.549789+0000","last_became_active":"2024-09-10T23:17:02.189356+0000","last_became_peered":"2024-09-10T23:17:02.189356+0000","last_unstale":"2024-09-10T23:17:03.549789+0000","last_undegraded":"2024-09-10T23:17:03.549789+0000","last_fullsized":"2024-09-10T23:17:03.549789+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:09.530956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171166+0000","last_change":"2024-09-10T23:17:02.171540+0000","last_active":"2024-09-10T23:17:03.171166+0000","last_peered":"2024-09-10T23:17:03.171166+0000","last_clean":"2024-09-10T23:17:03.171166+0000","last_became_active":"2024-09-10T23:17:02.171236+0000","last_became_peered":"2024-09-10T23:17:02.171236+0000","last_unstale":"2024-09-10T23:17:03.171166+0000","last_undegraded":"2024-09-10T23:17:03.171166+0000","last_fullsized":"2024-09-10T23:17:03.171166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:57.847525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550782+0000","last_change":"2024-09-10T23:17:02.179017+0000","last_active":"2024-09-10T23:17:03.550782+0000","last_peered":"2024-09-10T23:17:03.550782+0000","last_clean":"2024-09-10T23:17:03.550782+0000","last_became_active":"2024-09-10T23:17:02.178087+0000","last_became_peered":"2024-09-10T23:17:02.178087+0000","last_unstale":"2024-09-10T23:17:03.550782+0000","last_undegraded":"2024-09-10T23:17:03.550782+0000","last_fullsized":"2024-09-10T23:17:03.550782+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:31.859535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168538+0000","last_change":"2024-09-10T23:17:02.186432+0000","last_active":"2024-09-10T23:17:03.168538+0000","last_peered":"2024-09-10T23:17:03.168538+0000","last_clean":"2024-09-10T23:17:03.168538+0000","last_became_active":"2024-09-10T23:17:02.186180+0000","last_became_peered":"2024-09-10T23:17:02.186180+0000","last_unstale":"2024-09-10T23:17:03.168538+0000","last_undegraded":"2024-09-10T23:17:03.168538+0000","last_fullsized":"2024-09-10T23:17:03.168538+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:29.377633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172325+0000","last_change":"2024-09-10T23:17:02.190057+0000","last_active":"2024-09-10T23:17:03.172325+0000","last_peered":"2024-09-10T23:17:03.172325+0000","last_clean":"2024-09-10T23:17:03.172325+0000","last_became_active":"2024-09-10T23:17:02.189775+0000","last_became_peered":"2024-09-10T23:17:02.189775+0000","last_unstale":"2024-09-10T23:17:03.172325+0000","last_undegraded":"2024-09-10T23:17:03.172325+0000","last_fullsized":"2024-09-10T23:17:03.172325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:57.347706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550735+0000","last_change":"2024-09-10T23:17:02.184997+0000","last_active":"2024-09-10T23:17:03.550735+0000","last_peered":"2024-09-10T23:17:03.550735+0000","last_clean":"2024-09-10T23:17:03.550735+0000","last_became_active":"2024-09-10T23:17:02.184707+0000","last_became_peered":"2024-09-10T23:17:02.184707+0000","last_unstale":"2024-09-10T23:17:03.550735+0000","last_undegraded":"2024-09-10T23:17:03.550735+0000","last_fullsized":"2024-09-10T23:17:03.550735+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:06.105613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549418+0000","last_change":"2024-09-10T23:17:02.181983+0000","last_active":"2024-09-10T23:17:03.549418+0000","last_peered":"2024-09-10T23:17:03.549418+0000","last_clean":"2024-09-10T23:17:03.549418+0000","last_became_active":"2024-09-10T23:17:02.181486+0000","last_became_peered":"2024-09-10T23:17:02.181486+0000","last_unstale":"2024-09-10T23:17:03.549418+0000","last_undegraded":"2024-09-10T23:17:03.549418+0000","last_fullsized":"2024-09-10T23:17:03.549418+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:42.748721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.190152+0000","last_change":"2024-09-10T23:17:02.187898+0000","last_active":"2024-09-10T23:17:03.190152+0000","last_peered":"2024-09-10T23:17:03.190152+0000","last_clean":"2024-09-10T23:17:03.190152+0000","last_became_active":"2024-09-10T23:17:02.187650+0000","last_became_peered":"2024-09-10T23:17:02.187650+0000","last_unstale":"2024-09-10T23:17:03.190152+0000","last_undegraded":"2024-09-10T23:17:03.190152+0000","last_fullsized":"2024-09-10T23:17:03.190152+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:00.046030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.167986+0000","last_change":"2024-09-10T23:17:02.180451+0000","last_active":"2024-09-10T23:17:03.167986+0000","last_peered":"2024-09-10T23:17:03.167986+0000","last_clean":"2024-09-10T23:17:03.167986+0000","last_became_active":"2024-09-10T23:17:02.180172+0000","last_became_peered":"2024-09-10T23:17:02.180172+0000","last_unstale":"2024-09-10T23:17:03.167986+0000","last_undegraded":"2024-09-10T23:17:03.167986+0000","last_fullsized":"2024-09-10T23:17:03.167986+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:17.185957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189852+0000","last_change":"2024-09-10T23:17:02.186755+0000","last_active":"2024-09-10T23:17:03.189852+0000","last_peered":"2024-09-10T23:17:03.189852+0000","last_clean":"2024-09-10T23:17:03.189852+0000","last_became_active":"2024-09-10T23:17:02.186481+0000","last_became_peered":"2024-09-10T23:17:02.186481+0000","last_unstale":"2024-09-10T23:17:03.189852+0000","last_undegraded":"2024-09-10T23:17:03.189852+0000","last_fullsized":"2024-09-10T23:17:03.189852+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:20.939249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171553+0000","last_change":"2024-09-10T23:17:02.186515+0000","last_active":"2024-09-10T23:17:03.171553+0000","last_peered":"2024-09-10T23:17:03.171553+0000","last_clean":"2024-09-10T23:17:03.171553+0000","last_became_active":"2024-09-10T23:17:02.186189+0000","last_became_peered":"2024-09-10T23:17:02.186189+0000","last_unstale":"2024-09-10T23:17:03.171553+0000","last_undegraded":"2024-09-10T23:17:03.171553+0000","last_fullsized":"2024-09-10T23:17:03.171553+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:01.905184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168576+0000","last_change":"2024-09-10T23:17:02.185732+0000","last_active":"2024-09-10T23:17:03.168576+0000","last_peered":"2024-09-10T23:17:03.168576+0000","last_clean":"2024-09-10T23:17:03.168576+0000","last_became_active":"2024-09-10T23:17:02.185472+0000","last_became_peered":"2024-09-10T23:17:02.185472+0000","last_unstale":"2024-09-10T23:17:03.168576+0000","last_undegraded":"2024-09-10T23:17:03.168576+0000","last_fullsized":"2024-09-10T23:17:03.168576+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:17.502387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549620+0000","last_change":"2024-09-10T23:17:02.173588+0000","last_active":"2024-09-10T23:17:03.549620+0000","last_peered":"2024-09-10T23:17:03.549620+0000","last_clean":"2024-09-10T23:17:03.549620+0000","last_became_active":"2024-09-10T23:17:02.173357+0000","last_became_peered":"2024-09-10T23:17:02.173357+0000","last_unstale":"2024-09-10T23:17:03.549620+0000","last_undegraded":"2024-09-10T23:17:03.549620+0000","last_fullsized":"2024-09-10T23:17:03.549620+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:14.332250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549856+0000","last_change":"2024-09-10T23:17:02.177229+0000","last_active":"2024-09-10T23:17:03.549856+0000","last_peered":"2024-09-10T23:17:03.549856+0000","last_clean":"2024-09-10T23:17:03.549856+0000","last_became_active":"2024-09-10T23:17:02.176295+0000","last_became_peered":"2024-09-10T23:17:02.176295+0000","last_unstale":"2024-09-10T23:17:03.549856+0000","last_undegraded":"2024-09-10T23:17:03.549856+0000","last_fullsized":"2024-09-10T23:17:03.549856+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:13.179437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.190031+0000","last_change":"2024-09-10T23:17:02.183603+0000","last_active":"2024-09-10T23:17:03.190031+0000","last_peered":"2024-09-10T23:17:03.190031+0000","last_clean":"2024-09-10T23:17:03.190031+0000","last_became_active":"2024-09-10T23:17:02.183380+0000","last_became_peered":"2024-09-10T23:17:02.183380+0000","last_unstale":"2024-09-10T23:17:03.190031+0000","last_undegraded":"2024-09-10T23:17:03.190031+0000","last_fullsized":"2024-09-10T23:17:03.190031+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:59.511145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171392+0000","last_change":"2024-09-10T23:17:02.186842+0000","last_active":"2024-09-10T23:17:03.171392+0000","last_peered":"2024-09-10T23:17:03.171392+0000","last_clean":"2024-09-10T23:17:03.171392+0000","last_became_active":"2024-09-10T23:17:02.186549+0000","last_became_peered":"2024-09-10T23:17:02.186549+0000","last_unstale":"2024-09-10T23:17:03.171392+0000","last_undegraded":"2024-09-10T23:17:03.171392+0000","last_fullsized":"2024-09-10T23:17:03.171392+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:46.738934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171192+0000","last_change":"2024-09-10T23:17:02.189159+0000","last_active":"2024-09-10T23:17:03.171192+0000","last_peered":"2024-09-10T23:17:03.171192+0000","last_clean":"2024-09-10T23:17:03.171192+0000","last_became_active":"2024-09-10T23:17:02.188801+0000","last_became_peered":"2024-09-10T23:17:02.188801+0000","last_unstale":"2024-09-10T23:17:03.171192+0000","last_undegraded":"2024-09-10T23:17:03.171192+0000","last_fullsized":"2024-09-10T23:17:03.171192+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:34.490128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549319+0000","last_change":"2024-09-10T23:17:02.180886+0000","last_active":"2024-09-10T23:17:03.549319+0000","last_peered":"2024-09-10T23:17:03.549319+0000","last_clean":"2024-09-10T23:17:03.549319+0000","last_became_active":"2024-09-10T23:17:02.180579+0000","last_became_peered":"2024-09-10T23:17:02.180579+0000","last_unstale":"2024-09-10T23:17:03.549319+0000","last_undegraded":"2024-09-10T23:17:03.549319+0000","last_fullsized":"2024-09-10T23:17:03.549319+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:53.776767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549271+0000","last_change":"2024-09-10T23:17:02.189174+0000","last_active":"2024-09-10T23:17:03.549271+0000","last_peered":"2024-09-10T23:17:03.549271+0000","last_clean":"2024-09-10T23:17:03.549271+0000","last_became_active":"2024-09-10T23:17:02.188541+0000","last_became_peered":"2024-09-10T23:17:02.188541+0000","last_unstale":"2024-09-10T23:17:03.549271+0000","last_undegraded":"2024-09-10T23:17:03.549271+0000","last_fullsized":"2024-09-10T23:17:03.549271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:59.022484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171734+0000","last_change":"2024-09-10T23:17:02.186477+0000","last_active":"2024-09-10T23:17:03.171734+0000","last_peered":"2024-09-10T23:17:03.171734+0000","last_clean":"2024-09-10T23:17:03.171734+0000","last_became_active":"2024-09-10T23:17:02.186156+0000","last_became_peered":"2024-09-10T23:17:02.186156+0000","last_unstale":"2024-09-10T23:17:03.171734+0000","last_undegraded":"2024-09-10T23:17:03.171734+0000","last_fullsized":"2024-09-10T23:17:03.171734+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:16.595372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172032+0000","last_change":"2024-09-10T23:17:02.172653+0000","last_active":"2024-09-10T23:17:03.172032+0000","last_peered":"2024-09-10T23:17:03.172032+0000","last_clean":"2024-09-10T23:17:03.172032+0000","last_became_active":"2024-09-10T23:17:02.172366+0000","last_became_peered":"2024-09-10T23:17:02.172366+0000","last_unstale":"2024-09-10T23:17:03.172032+0000","last_undegraded":"2024-09-10T23:17:03.172032+0000","last_fullsized":"2024-09-10T23:17:03.172032+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:16.143101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549717+0000","last_change":"2024-09-10T23:17:02.180725+0000","last_active":"2024-09-10T23:17:03.549717+0000","last_peered":"2024-09-10T23:17:03.549717+0000","last_clean":"2024-09-10T23:17:03.549717+0000","last_became_active":"2024-09-10T23:17:02.180470+0000","last_became_peered":"2024-09-10T23:17:02.180470+0000","last_unstale":"2024-09-10T23:17:03.549717+0000","last_undegraded":"2024-09-10T23:17:03.549717+0000","last_fullsized":"2024-09-10T23:17:03.549717+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:53.043500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171383+0000","last_change":"2024-09-10T23:17:02.187233+0000","last_active":"2024-09-10T23:17:03.171383+0000","last_peered":"2024-09-10T23:17:03.171383+0000","last_clean":"2024-09-10T23:17:03.171383+0000","last_became_active":"2024-09-10T23:17:02.186968+0000","last_became_peered":"2024-09-10T23:17:02.186968+0000","last_unstale":"2024-09-10T23:17:03.171383+0000","last_undegraded":"2024-09-10T23:17:03.171383+0000","last_fullsized":"2024-09-10T23:17:03.171383+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:43.439335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549085+0000","last_change":"2024-09-10T23:17:02.183111+0000","last_active":"2024-09-10T23:17:03.549085+0000","last_peered":"2024-09-10T23:17:03.549085+0000","last_clean":"2024-09-10T23:17:03.549085+0000","last_became_active":"2024-09-10T23:17:02.182538+0000","last_became_peered":"2024-09-10T23:17:02.182538+0000","last_unstale":"2024-09-10T23:17:03.549085+0000","last_undegraded":"2024-09-10T23:17:03.549085+0000","last_fullsized":"2024-09-10T23:17:03.549085+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:42.177960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171544+0000","last_change":"2024-09-10T23:17:02.172772+0000","last_active":"2024-09-10T23:17:03.171544+0000","last_peered":"2024-09-10T23:17:03.171544+0000","last_clean":"2024-09-10T23:17:03.171544+0000","last_became_active":"2024-09-10T23:17:02.172518+0000","last_became_peered":"2024-09-10T23:17:02.172518+0000","last_unstale":"2024-09-10T23:17:03.171544+0000","last_undegraded":"2024-09-10T23:17:03.171544+0000","last_fullsized":"2024-09-10T23:17:03.171544+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:27.563534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172082+0000","last_change":"2024-09-10T23:17:02.180911+0000","last_active":"2024-09-10T23:17:03.172082+0000","last_peered":"2024-09-10T23:17:03.172082+0000","last_clean":"2024-09-10T23:17:03.172082+0000","last_became_active":"2024-09-10T23:17:02.180656+0000","last_became_peered":"2024-09-10T23:17:02.180656+0000","last_unstale":"2024-09-10T23:17:03.172082+0000","last_undegraded":"2024-09-10T23:17:03.172082+0000","last_fullsized":"2024-09-10T23:17:03.172082+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:25.510225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550779+0000","last_change":"2024-09-10T23:17:02.184529+0000","last_active":"2024-09-10T23:17:03.550779+0000","last_peered":"2024-09-10T23:17:03.550779+0000","last_clean":"2024-09-10T23:17:03.550779+0000","last_became_active":"2024-09-10T23:17:02.184249+0000","last_became_peered":"2024-09-10T23:17:02.184249+0000","last_unstale":"2024-09-10T23:17:03.550779+0000","last_undegraded":"2024-09-10T23:17:03.550779+0000","last_fullsized":"2024-09-10T23:17:03.550779+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:38.996355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549677+0000","last_change":"2024-09-10T23:17:02.188744+0000","last_active":"2024-09-10T23:17:03.549677+0000","last_peered":"2024-09-10T23:17:03.549677+0000","last_clean":"2024-09-10T23:17:03.549677+0000","last_became_active":"2024-09-10T23:17:02.188461+0000","last_became_peered":"2024-09-10T23:17:02.188461+0000","last_unstale":"2024-09-10T23:17:03.549677+0000","last_undegraded":"2024-09-10T23:17:03.549677+0000","last_fullsized":"2024-09-10T23:17:03.549677+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:40.954146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"67'4","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549981+0000","last_change":"2024-09-10T23:17:01.193669+0000","last_active":"2024-09-10T23:17:03.549981+0000","last_peered":"2024-09-10T23:17:03.549981+0000","last_clean":"2024-09-10T23:17:03.549981+0000","last_became_active":"2024-09-10T23:17:01.193401+0000","last_became_peered":"2024-09-10T23:17:01.193401+0000","last_unstale":"2024-09-10T23:17:03.549981+0000","last_undegraded":"2024-09-10T23:17:03.549981+0000","last_fullsized":"2024-09-10T23:17:03.549981+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:41.037930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168696+0000","last_change":"2024-09-10T23:17:02.187210+0000","last_active":"2024-09-10T23:17:03.168696+0000","last_peered":"2024-09-10T23:17:03.168696+0000","last_clean":"2024-09-10T23:17:03.168696+0000","last_became_active":"2024-09-10T23:17:02.184848+0000","last_became_peered":"2024-09-10T23:17:02.184848+0000","last_unstale":"2024-09-10T23:17:03.168696+0000","last_undegraded":"2024-09-10T23:17:03.168696+0000","last_fullsized":"2024-09-10T23:17:03.168696+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:33.710241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.190010+0000","last_change":"2024-09-10T23:17:01.188635+0000","last_active":"2024-09-10T23:17:03.190010+0000","last_peered":"2024-09-10T23:17:03.190010+0000","last_clean":"2024-09-10T23:17:03.190010+0000","last_became_active":"2024-09-10T23:17:01.188298+0000","last_became_peered":"2024-09-10T23:17:01.188298+0000","last_unstale":"2024-09-10T23:17:03.190010+0000","last_undegraded":"2024-09-10T23:17:03.190010+0000","last_fullsized":"2024-09-10T23:17:03.190010+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:20.519330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550323+0000","last_change":"2024-09-10T23:17:02.179122+0000","last_active":"2024-09-10T23:17:03.550323+0000","last_peered":"2024-09-10T23:17:03.550323+0000","last_clean":"2024-09-10T23:17:03.550323+0000","last_became_active":"2024-09-10T23:17:02.178870+0000","last_became_peered":"2024-09-10T23:17:02.178870+0000","last_unstale":"2024-09-10T23:17:03.550323+0000","last_undegraded":"2024-09-10T23:17:03.550323+0000","last_fullsized":"2024-09-10T23:17:03.550323+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:18.109091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171924+0000","last_change":"2024-09-10T23:17:01.191194+0000","last_active":"2024-09-10T23:17:03.171924+0000","last_peered":"2024-09-10T23:17:03.171924+0000","last_clean":"2024-09-10T23:17:03.171924+0000","last_became_active":"2024-09-10T23:17:01.190905+0000","last_became_peered":"2024-09-10T23:17:01.190905+0000","last_unstale":"2024-09-10T23:17:03.171924+0000","last_undegraded":"2024-09-10T23:17:03.171924+0000","last_fullsized":"2024-09-10T23:17:03.171924+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:10.845894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549901+0000","last_change":"2024-09-10T23:17:02.185239+0000","last_active":"2024-09-10T23:17:03.549901+0000","last_peered":"2024-09-10T23:17:03.549901+0000","last_clean":"2024-09-10T23:17:03.549901+0000","last_became_active":"2024-09-10T23:17:02.184988+0000","last_became_peered":"2024-09-10T23:17:02.184988+0000","last_unstale":"2024-09-10T23:17:03.549901+0000","last_undegraded":"2024-09-10T23:17:03.549901+0000","last_fullsized":"2024-09-10T23:17:03.549901+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:57.136333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550424+0000","last_change":"2024-09-10T23:17:01.191022+0000","last_active":"2024-09-10T23:17:03.550424+0000","last_peered":"2024-09-10T23:17:03.550424+0000","last_clean":"2024-09-10T23:17:03.550424+0000","last_became_active":"2024-09-10T23:17:01.190699+0000","last_became_peered":"2024-09-10T23:17:01.190699+0000","last_unstale":"2024-09-10T23:17:03.550424+0000","last_undegraded":"2024-09-10T23:17:03.550424+0000","last_fullsized":"2024-09-10T23:17:03.550424+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:32.708142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171766+0000","last_change":"2024-09-10T23:17:02.184117+0000","last_active":"2024-09-10T23:17:03.171766+0000","last_peered":"2024-09-10T23:17:03.171766+0000","last_clean":"2024-09-10T23:17:03.171766+0000","last_became_active":"2024-09-10T23:17:02.183849+0000","last_became_peered":"2024-09-10T23:17:02.183849+0000","last_unstale":"2024-09-10T23:17:03.171766+0000","last_undegraded":"2024-09-10T23:17:03.171766+0000","last_fullsized":"2024-09-10T23:17:03.171766+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:39.995863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549284+0000","last_change":"2024-09-10T23:17:01.190349+0000","last_active":"2024-09-10T23:17:03.549284+0000","last_peered":"2024-09-10T23:17:03.549284+0000","last_clean":"2024-09-10T23:17:03.549284+0000","last_became_active":"2024-09-10T23:17:01.188133+0000","last_became_peered":"2024-09-10T23:17:01.188133+0000","last_unstale":"2024-09-10T23:17:03.549284+0000","last_undegraded":"2024-09-10T23:17:03.549284+0000","last_fullsized":"2024-09-10T23:17:03.549284+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:15.785872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171432+0000","last_change":"2024-09-10T23:17:02.186654+0000","last_active":"2024-09-10T23:17:03.171432+0000","last_peered":"2024-09-10T23:17:03.171432+0000","last_clean":"2024-09-10T23:17:03.171432+0000","last_became_active":"2024-09-10T23:17:02.186114+0000","last_became_peered":"2024-09-10T23:17:02.186114+0000","last_unstale":"2024-09-10T23:17:03.171432+0000","last_undegraded":"2024-09-10T23:17:03.171432+0000","last_fullsized":"2024-09-10T23:17:03.171432+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:42.040028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549862+0000","last_change":"2024-09-10T23:17:01.192310+0000","last_active":"2024-09-10T23:17:03.549862+0000","last_peered":"2024-09-10T23:17:03.549862+0000","last_clean":"2024-09-10T23:17:03.549862+0000","last_became_active":"2024-09-10T23:17:01.192049+0000","last_became_peered":"2024-09-10T23:17:01.192049+0000","last_unstale":"2024-09-10T23:17:03.549862+0000","last_undegraded":"2024-09-10T23:17:03.549862+0000","last_fullsized":"2024-09-10T23:17:03.549862+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:47.029207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.167891+0000","last_change":"2024-09-10T23:17:02.187900+0000","last_active":"2024-09-10T23:17:03.167891+0000","last_peered":"2024-09-10T23:17:03.167891+0000","last_clean":"2024-09-10T23:17:03.167891+0000","last_became_active":"2024-09-10T23:17:02.187324+0000","last_became_peered":"2024-09-10T23:17:02.187324+0000","last_unstale":"2024-09-10T23:17:03.167891+0000","last_undegraded":"2024-09-10T23:17:03.167891+0000","last_fullsized":"2024-09-10T23:17:03.167891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:47.186252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549066+0000","last_change":"2024-09-10T23:17:01.190773+0000","last_active":"2024-09-10T23:17:03.549066+0000","last_peered":"2024-09-10T23:17:03.549066+0000","last_clean":"2024-09-10T23:17:03.549066+0000","last_became_active":"2024-09-10T23:17:01.190512+0000","last_became_peered":"2024-09-10T23:17:01.190512+0000","last_unstale":"2024-09-10T23:17:03.549066+0000","last_undegraded":"2024-09-10T23:17:03.549066+0000","last_fullsized":"2024-09-10T23:17:03.549066+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:03.121487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189857+0000","last_change":"2024-09-10T23:17:02.182823+0000","last_active":"2024-09-10T23:17:03.189857+0000","last_peered":"2024-09-10T23:17:03.189857+0000","last_clean":"2024-09-10T23:17:03.189857+0000","last_became_active":"2024-09-10T23:17:02.182551+0000","last_became_peered":"2024-09-10T23:17:02.182551+0000","last_unstale":"2024-09-10T23:17:03.189857+0000","last_undegraded":"2024-09-10T23:17:03.189857+0000","last_fullsized":"2024-09-10T23:17:03.189857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:16.350578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.167771+0000","last_change":"2024-09-10T23:17:01.191567+0000","last_active":"2024-09-10T23:17:03.167771+0000","last_peered":"2024-09-10T23:17:03.167771+0000","last_clean":"2024-09-10T23:17:03.167771+0000","last_became_active":"2024-09-10T23:17:01.191302+0000","last_became_peered":"2024-09-10T23:17:01.191302+0000","last_unstale":"2024-09-10T23:17:03.167771+0000","last_undegraded":"2024-09-10T23:17:03.167771+0000","last_fullsized":"2024-09-10T23:17:03.167771+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:52.664388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172240+0000","last_change":"2024-09-10T23:17:02.180558+0000","last_active":"2024-09-10T23:17:03.172240+0000","last_peered":"2024-09-10T23:17:03.172240+0000","last_clean":"2024-09-10T23:17:03.172240+0000","last_became_active":"2024-09-10T23:17:02.180251+0000","last_became_peered":"2024-09-10T23:17:02.180251+0000","last_unstale":"2024-09-10T23:17:03.172240+0000","last_undegraded":"2024-09-10T23:17:03.172240+0000","last_fullsized":"2024-09-10T23:17:03.172240+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:38.084698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171801+0000","last_change":"2024-09-10T23:17:01.184321+0000","last_active":"2024-09-10T23:17:03.171801+0000","last_peered":"2024-09-10T23:17:03.171801+0000","last_clean":"2024-09-10T23:17:03.171801+0000","last_became_active":"2024-09-10T23:17:01.184036+0000","last_became_peered":"2024-09-10T23:17:01.184036+0000","last_unstale":"2024-09-10T23:17:03.171801+0000","last_undegraded":"2024-09-10T23:17:03.171801+0000","last_fullsized":"2024-09-10T23:17:03.171801+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:04.144800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549910+0000","last_change":"2024-09-10T23:17:02.189878+0000","last_active":"2024-09-10T23:17:03.549910+0000","last_peered":"2024-09-10T23:17:03.549910+0000","last_clean":"2024-09-10T23:17:03.549910+0000","last_became_active":"2024-09-10T23:17:02.189582+0000","last_became_peered":"2024-09-10T23:17:02.189582+0000","last_unstale":"2024-09-10T23:17:03.549910+0000","last_undegraded":"2024-09-10T23:17:03.549910+0000","last_fullsized":"2024-09-10T23:17:03.549910+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:12.948794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550548+0000","last_change":"2024-09-10T23:17:01.193189+0000","last_active":"2024-09-10T23:17:03.550548+0000","last_peered":"2024-09-10T23:17:03.550548+0000","last_clean":"2024-09-10T23:17:03.550548+0000","last_became_active":"2024-09-10T23:17:01.192855+0000","last_became_peered":"2024-09-10T23:17:01.192855+0000","last_unstale":"2024-09-10T23:17:03.550548+0000","last_undegraded":"2024-09-10T23:17:03.550548+0000","last_fullsized":"2024-09-10T23:17:03.550548+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:56.372150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550584+0000","last_change":"2024-09-10T23:17:02.190530+0000","last_active":"2024-09-10T23:17:03.550584+0000","last_peered":"2024-09-10T23:17:03.550584+0000","last_clean":"2024-09-10T23:17:03.550584+0000","last_became_active":"2024-09-10T23:17:02.190197+0000","last_became_peered":"2024-09-10T23:17:02.190197+0000","last_unstale":"2024-09-10T23:17:03.550584+0000","last_undegraded":"2024-09-10T23:17:03.550584+0000","last_fullsized":"2024-09-10T23:17:03.550584+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:51.574469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"67'3","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549645+0000","last_change":"2024-09-10T23:17:01.182607+0000","last_active":"2024-09-10T23:17:03.549645+0000","last_peered":"2024-09-10T23:17:03.549645+0000","last_clean":"2024-09-10T23:17:03.549645+0000","last_became_active":"2024-09-10T23:17:01.182246+0000","last_became_peered":"2024-09-10T23:17:01.182246+0000","last_unstale":"2024-09-10T23:17:03.549645+0000","last_undegraded":"2024-09-10T23:17:03.549645+0000","last_fullsized":"2024-09-10T23:17:03.549645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:39.952048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168260+0000","last_change":"2024-09-10T23:17:02.187129+0000","last_active":"2024-09-10T23:17:03.168260+0000","last_peered":"2024-09-10T23:17:03.168260+0000","last_clean":"2024-09-10T23:17:03.168260+0000","last_became_active":"2024-09-10T23:17:02.186885+0000","last_became_peered":"2024-09-10T23:17:02.186885+0000","last_unstale":"2024-09-10T23:17:03.168260+0000","last_undegraded":"2024-09-10T23:17:03.168260+0000","last_fullsized":"2024-09-10T23:17:03.168260+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:21.027831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"67'6","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549531+0000","last_change":"2024-09-10T23:17:01.192130+0000","last_active":"2024-09-10T23:17:03.549531+0000","last_peered":"2024-09-10T23:17:03.549531+0000","last_clean":"2024-09-10T23:17:03.549531+0000","last_became_active":"2024-09-10T23:17:01.191685+0000","last_became_peered":"2024-09-10T23:17:01.191685+0000","last_unstale":"2024-09-10T23:17:03.549531+0000","last_undegraded":"2024-09-10T23:17:03.549531+0000","last_fullsized":"2024-09-10T23:17:03.549531+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:47.029207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549294+0000","last_change":"2024-09-10T23:17:02.190052+0000","last_active":"2024-09-10T23:17:03.549294+0000","last_peered":"2024-09-10T23:17:03.549294+0000","last_clean":"2024-09-10T23:17:03.549294+0000","last_became_active":"2024-09-10T23:17:02.189776+0000","last_became_peered":"2024-09-10T23:17:02.189776+0000","last_unstale":"2024-09-10T23:17:03.549294+0000","last_undegraded":"2024-09-10T23:17:03.549294+0000","last_fullsized":"2024-09-10T23:17:03.549294+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:12.143804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549167+0000","last_change":"2024-09-10T23:17:01.188630+0000","last_active":"2024-09-10T23:17:03.549167+0000","last_peered":"2024-09-10T23:17:03.549167+0000","last_clean":"2024-09-10T23:17:03.549167+0000","last_became_active":"2024-09-10T23:17:01.188364+0000","last_became_peered":"2024-09-10T23:17:01.188364+0000","last_unstale":"2024-09-10T23:17:03.549167+0000","last_undegraded":"2024-09-10T23:17:03.549167+0000","last_fullsized":"2024-09-10T23:17:03.549167+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:00.574165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172367+0000","last_change":"2024-09-10T23:17:02.187576+0000","last_active":"2024-09-10T23:17:03.172367+0000","last_peered":"2024-09-10T23:17:03.172367+0000","last_clean":"2024-09-10T23:17:03.172367+0000","last_became_active":"2024-09-10T23:17:02.187251+0000","last_became_peered":"2024-09-10T23:17:02.187251+0000","last_unstale":"2024-09-10T23:17:03.172367+0000","last_undegraded":"2024-09-10T23:17:03.172367+0000","last_fullsized":"2024-09-10T23:17:03.172367+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:45.441804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549971+0000","last_change":"2024-09-10T23:17:01.189716+0000","last_active":"2024-09-10T23:17:03.549971+0000","last_peered":"2024-09-10T23:17:03.549971+0000","last_clean":"2024-09-10T23:17:03.549971+0000","last_became_active":"2024-09-10T23:17:01.189432+0000","last_became_peered":"2024-09-10T23:17:01.189432+0000","last_unstale":"2024-09-10T23:17:03.549971+0000","last_undegraded":"2024-09-10T23:17:03.549971+0000","last_fullsized":"2024-09-10T23:17:03.549971+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:20.356543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189830+0000","last_change":"2024-09-10T23:17:02.188651+0000","last_active":"2024-09-10T23:17:03.189830+0000","last_peered":"2024-09-10T23:17:03.189830+0000","last_clean":"2024-09-10T23:17:03.189830+0000","last_became_active":"2024-09-10T23:17:02.188383+0000","last_became_peered":"2024-09-10T23:17:02.188383+0000","last_unstale":"2024-09-10T23:17:03.189830+0000","last_undegraded":"2024-09-10T23:17:03.189830+0000","last_fullsized":"2024-09-10T23:17:03.189830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:59.895108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171845+0000","last_change":"2024-09-10T23:17:01.187921+0000","last_active":"2024-09-10T23:17:03.171845+0000","last_peered":"2024-09-10T23:17:03.171845+0000","last_clean":"2024-09-10T23:17:03.171845+0000","last_became_active":"2024-09-10T23:17:01.187574+0000","last_became_peered":"2024-09-10T23:17:01.187574+0000","last_unstale":"2024-09-10T23:17:03.171845+0000","last_undegraded":"2024-09-10T23:17:03.171845+0000","last_fullsized":"2024-09-10T23:17:03.171845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:58.338264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.167929+0000","last_change":"2024-09-10T23:17:02.185654+0000","last_active":"2024-09-10T23:17:03.167929+0000","last_peered":"2024-09-10T23:17:03.167929+0000","last_clean":"2024-09-10T23:17:03.167929+0000","last_became_active":"2024-09-10T23:17:02.185413+0000","last_became_peered":"2024-09-10T23:17:02.185413+0000","last_unstale":"2024-09-10T23:17:03.167929+0000","last_undegraded":"2024-09-10T23:17:03.167929+0000","last_fullsized":"2024-09-10T23:17:03.167929+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:10.655764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"67'8","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171888+0000","last_change":"2024-09-10T23:17:01.185908+0000","last_active":"2024-09-10T23:17:03.171888+0000","last_peered":"2024-09-10T23:17:03.171888+0000","last_clean":"2024-09-10T23:17:03.171888+0000","last_became_active":"2024-09-10T23:17:01.185610+0000","last_became_peered":"2024-09-10T23:17:01.185610+0000","last_unstale":"2024-09-10T23:17:03.171888+0000","last_undegraded":"2024-09-10T23:17:03.171888+0000","last_fullsized":"2024-09-10T23:17:03.171888+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:08.528858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172376+0000","last_change":"2024-09-10T23:17:02.189822+0000","last_active":"2024-09-10T23:17:03.172376+0000","last_peered":"2024-09-10T23:17:03.172376+0000","last_clean":"2024-09-10T23:17:03.172376+0000","last_became_active":"2024-09-10T23:17:02.189491+0000","last_became_peered":"2024-09-10T23:17:02.189491+0000","last_unstale":"2024-09-10T23:17:03.172376+0000","last_undegraded":"2024-09-10T23:17:03.172376+0000","last_fullsized":"2024-09-10T23:17:03.172376+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:21.182628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550142+0000","last_change":"2024-09-10T23:17:01.196464+0000","last_active":"2024-09-10T23:17:03.550142+0000","last_peered":"2024-09-10T23:17:03.550142+0000","last_clean":"2024-09-10T23:17:03.550142+0000","last_became_active":"2024-09-10T23:17:01.196186+0000","last_became_peered":"2024-09-10T23:17:01.196186+0000","last_unstale":"2024-09-10T23:17:03.550142+0000","last_undegraded":"2024-09-10T23:17:03.550142+0000","last_fullsized":"2024-09-10T23:17:03.550142+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:03.121487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549976+0000","last_change":"2024-09-10T23:17:02.184953+0000","last_active":"2024-09-10T23:17:03.549976+0000","last_peered":"2024-09-10T23:17:03.549976+0000","last_clean":"2024-09-10T23:17:03.549976+0000","last_became_active":"2024-09-10T23:17:02.184694+0000","last_became_peered":"2024-09-10T23:17:02.184694+0000","last_unstale":"2024-09-10T23:17:03.549976+0000","last_undegraded":"2024-09-10T23:17:03.549976+0000","last_fullsized":"2024-09-10T23:17:03.549976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:26.570165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172411+0000","last_change":"2024-09-10T23:17:01.190406+0000","last_active":"2024-09-10T23:17:03.172411+0000","last_peered":"2024-09-10T23:17:03.172411+0000","last_clean":"2024-09-10T23:17:03.172411+0000","last_became_active":"2024-09-10T23:17:01.190145+0000","last_became_peered":"2024-09-10T23:17:01.190145+0000","last_unstale":"2024-09-10T23:17:03.172411+0000","last_undegraded":"2024-09-10T23:17:03.172411+0000","last_fullsized":"2024-09-10T23:17:03.172411+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:12.177339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549536+0000","last_change":"2024-09-10T23:17:02.181934+0000","last_active":"2024-09-10T23:17:03.549536+0000","last_peered":"2024-09-10T23:17:03.549536+0000","last_clean":"2024-09-10T23:17:03.549536+0000","last_became_active":"2024-09-10T23:17:02.181642+0000","last_became_peered":"2024-09-10T23:17:02.181642+0000","last_unstale":"2024-09-10T23:17:03.549536+0000","last_undegraded":"2024-09-10T23:17:03.549536+0000","last_fullsized":"2024-09-10T23:17:03.549536+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:17.862893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550004+0000","last_change":"2024-09-10T23:17:01.189654+0000","last_active":"2024-09-10T23:17:03.550004+0000","last_peered":"2024-09-10T23:17:03.550004+0000","last_clean":"2024-09-10T23:17:03.550004+0000","last_became_active":"2024-09-10T23:17:01.189368+0000","last_became_peered":"2024-09-10T23:17:01.189368+0000","last_unstale":"2024-09-10T23:17:03.550004+0000","last_undegraded":"2024-09-10T23:17:03.550004+0000","last_fullsized":"2024-09-10T23:17:03.550004+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:15.603001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168302+0000","last_change":"2024-09-10T23:17:02.188159+0000","last_active":"2024-09-10T23:17:03.168302+0000","last_peered":"2024-09-10T23:17:03.168302+0000","last_clean":"2024-09-10T23:17:03.168302+0000","last_became_active":"2024-09-10T23:17:02.187880+0000","last_became_peered":"2024-09-10T23:17:02.187880+0000","last_unstale":"2024-09-10T23:17:03.168302+0000","last_undegraded":"2024-09-10T23:17:03.168302+0000","last_fullsized":"2024-09-10T23:17:03.168302+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:30.977222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549589+0000","last_change":"2024-09-10T23:17:01.190754+0000","last_active":"2024-09-10T23:17:03.549589+0000","last_peered":"2024-09-10T23:17:03.549589+0000","last_clean":"2024-09-10T23:17:03.549589+0000","last_became_active":"2024-09-10T23:17:01.190488+0000","last_became_peered":"2024-09-10T23:17:01.190488+0000","last_unstale":"2024-09-10T23:17:03.549589+0000","last_undegraded":"2024-09-10T23:17:03.549589+0000","last_fullsized":"2024-09-10T23:17:03.549589+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:45.736836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549695+0000","last_change":"2024-09-10T23:17:02.183073+0000","last_active":"2024-09-10T23:17:03.549695+0000","last_peered":"2024-09-10T23:17:03.549695+0000","last_clean":"2024-09-10T23:17:03.549695+0000","last_became_active":"2024-09-10T23:17:02.182721+0000","last_became_peered":"2024-09-10T23:17:02.182721+0000","last_unstale":"2024-09-10T23:17:03.549695+0000","last_undegraded":"2024-09-10T23:17:03.549695+0000","last_fullsized":"2024-09-10T23:17:03.549695+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:27.726484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550132+0000","last_change":"2024-09-10T23:17:01.191700+0000","last_active":"2024-09-10T23:17:03.550132+0000","last_peered":"2024-09-10T23:17:03.550132+0000","last_clean":"2024-09-10T23:17:03.550132+0000","last_became_active":"2024-09-10T23:17:01.191421+0000","last_became_peered":"2024-09-10T23:17:01.191421+0000","last_unstale":"2024-09-10T23:17:03.550132+0000","last_undegraded":"2024-09-10T23:17:03.550132+0000","last_fullsized":"2024-09-10T23:17:03.550132+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:50:35.854820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549012+0000","last_change":"2024-09-10T23:17:02.178917+0000","last_active":"2024-09-10T23:17:03.549012+0000","last_peered":"2024-09-10T23:17:03.549012+0000","last_clean":"2024-09-10T23:17:03.549012+0000","last_became_active":"2024-09-10T23:17:02.178634+0000","last_became_peered":"2024-09-10T23:17:02.178634+0000","last_unstale":"2024-09-10T23:17:03.549012+0000","last_undegraded":"2024-09-10T23:17:03.549012+0000","last_fullsized":"2024-09-10T23:17:03.549012+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:50.039706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172146+0000","last_change":"2024-09-10T23:17:01.186635+0000","last_active":"2024-09-10T23:17:03.172146+0000","last_peered":"2024-09-10T23:17:03.172146+0000","last_clean":"2024-09-10T23:17:03.172146+0000","last_became_active":"2024-09-10T23:17:01.186371+0000","last_became_peered":"2024-09-10T23:17:01.186371+0000","last_unstale":"2024-09-10T23:17:03.172146+0000","last_undegraded":"2024-09-10T23:17:03.172146+0000","last_fullsized":"2024-09-10T23:17:03.172146+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:34.616208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549131+0000","last_change":"2024-09-10T23:17:02.177862+0000","last_active":"2024-09-10T23:17:03.549131+0000","last_peered":"2024-09-10T23:17:03.549131+0000","last_clean":"2024-09-10T23:17:03.549131+0000","last_became_active":"2024-09-10T23:17:02.177542+0000","last_became_peered":"2024-09-10T23:17:02.177542+0000","last_unstale":"2024-09-10T23:17:03.549131+0000","last_undegraded":"2024-09-10T23:17:03.549131+0000","last_fullsized":"2024-09-10T23:17:03.549131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:59:55.123710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189732+0000","last_change":"2024-09-10T23:17:01.187869+0000","last_active":"2024-09-10T23:17:03.189732+0000","last_peered":"2024-09-10T23:17:03.189732+0000","last_clean":"2024-09-10T23:17:03.189732+0000","last_became_active":"2024-09-10T23:17:01.187625+0000","last_became_peered":"2024-09-10T23:17:01.187625+0000","last_unstale":"2024-09-10T23:17:03.189732+0000","last_undegraded":"2024-09-10T23:17:03.189732+0000","last_fullsized":"2024-09-10T23:17:03.189732+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:55.975680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189964+0000","last_change":"2024-09-10T23:17:02.185910+0000","last_active":"2024-09-10T23:17:03.189964+0000","last_peered":"2024-09-10T23:17:03.189964+0000","last_clean":"2024-09-10T23:17:03.189964+0000","last_became_active":"2024-09-10T23:17:02.185560+0000","last_became_peered":"2024-09-10T23:17:02.185560+0000","last_unstale":"2024-09-10T23:17:03.189964+0000","last_undegraded":"2024-09-10T23:17:03.189964+0000","last_fullsized":"2024-09-10T23:17:03.189964+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:06.496984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550253+0000","last_change":"2024-09-10T23:17:01.196436+0000","last_active":"2024-09-10T23:17:03.550253+0000","last_peered":"2024-09-10T23:17:03.550253+0000","last_clean":"2024-09-10T23:17:03.550253+0000","last_became_active":"2024-09-10T23:17:01.196165+0000","last_became_peered":"2024-09-10T23:17:01.196165+0000","last_unstale":"2024-09-10T23:17:03.550253+0000","last_undegraded":"2024-09-10T23:17:03.550253+0000","last_fullsized":"2024-09-10T23:17:03.550253+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:00.574165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171795+0000","last_change":"2024-09-10T23:17:02.171489+0000","last_active":"2024-09-10T23:17:03.171795+0000","last_peered":"2024-09-10T23:17:03.171795+0000","last_clean":"2024-09-10T23:17:03.171795+0000","last_became_active":"2024-09-10T23:17:02.171190+0000","last_became_peered":"2024-09-10T23:17:02.171190+0000","last_unstale":"2024-09-10T23:17:03.171795+0000","last_undegraded":"2024-09-10T23:17:03.171795+0000","last_fullsized":"2024-09-10T23:17:03.171795+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:25.805323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"68'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172352+0000","last_change":"2024-09-10T23:17:01.188362+0000","last_active":"2024-09-10T23:17:03.172352+0000","last_peered":"2024-09-10T23:17:03.172352+0000","last_clean":"2024-09-10T23:17:03.172352+0000","last_became_active":"2024-09-10T23:17:01.187781+0000","last_became_peered":"2024-09-10T23:17:01.187781+0000","last_unstale":"2024-09-10T23:17:03.172352+0000","last_undegraded":"2024-09-10T23:17:03.172352+0000","last_fullsized":"2024-09-10T23:17:03.172352+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:30.857436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549640+0000","last_change":"2024-09-10T23:17:02.187405+0000","last_active":"2024-09-10T23:17:03.549640+0000","last_peered":"2024-09-10T23:17:03.549640+0000","last_clean":"2024-09-10T23:17:03.549640+0000","last_became_active":"2024-09-10T23:17:02.187132+0000","last_became_peered":"2024-09-10T23:17:02.187132+0000","last_unstale":"2024-09-10T23:17:03.549640+0000","last_undegraded":"2024-09-10T23:17:03.549640+0000","last_fullsized":"2024-09-10T23:17:03.549640+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:16.787970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168311+0000","last_change":"2024-09-10T23:17:01.192268+0000","last_active":"2024-09-10T23:17:03.168311+0000","last_peered":"2024-09-10T23:17:03.168311+0000","last_clean":"2024-09-10T23:17:03.168311+0000","last_became_active":"2024-09-10T23:17:01.192010+0000","last_became_peered":"2024-09-10T23:17:01.192010+0000","last_unstale":"2024-09-10T23:17:03.168311+0000","last_undegraded":"2024-09-10T23:17:03.168311+0000","last_fullsized":"2024-09-10T23:17:03.168311+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:08.700663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550124+0000","last_change":"2024-09-10T23:17:02.183034+0000","last_active":"2024-09-10T23:17:03.550124+0000","last_peered":"2024-09-10T23:17:03.550124+0000","last_clean":"2024-09-10T23:17:03.550124+0000","last_became_active":"2024-09-10T23:17:02.182752+0000","last_became_peered":"2024-09-10T23:17:02.182752+0000","last_unstale":"2024-09-10T23:17:03.550124+0000","last_undegraded":"2024-09-10T23:17:03.550124+0000","last_fullsized":"2024-09-10T23:17:03.550124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:40.334972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189975+0000","last_change":"2024-09-10T23:17:01.186902+0000","last_active":"2024-09-10T23:17:03.189975+0000","last_peered":"2024-09-10T23:17:03.189975+0000","last_clean":"2024-09-10T23:17:03.189975+0000","last_became_active":"2024-09-10T23:17:01.186661+0000","last_became_peered":"2024-09-10T23:17:01.186661+0000","last_unstale":"2024-09-10T23:17:03.189975+0000","last_undegraded":"2024-09-10T23:17:03.189975+0000","last_fullsized":"2024-09-10T23:17:03.189975+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:27.761361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168134+0000","last_change":"2024-09-10T23:17:02.185506+0000","last_active":"2024-09-10T23:17:03.168134+0000","last_peered":"2024-09-10T23:17:03.168134+0000","last_clean":"2024-09-10T23:17:03.168134+0000","last_became_active":"2024-09-10T23:17:02.185257+0000","last_became_peered":"2024-09-10T23:17:02.185257+0000","last_unstale":"2024-09-10T23:17:03.168134+0000","last_undegraded":"2024-09-10T23:17:03.168134+0000","last_fullsized":"2024-09-10T23:17:03.168134+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:19.553228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168007+0000","last_change":"2024-09-10T23:17:01.187404+0000","last_active":"2024-09-10T23:17:03.168007+0000","last_peered":"2024-09-10T23:17:03.168007+0000","last_clean":"2024-09-10T23:17:03.168007+0000","last_became_active":"2024-09-10T23:17:01.187153+0000","last_became_peered":"2024-09-10T23:17:01.187153+0000","last_unstale":"2024-09-10T23:17:03.168007+0000","last_undegraded":"2024-09-10T23:17:03.168007+0000","last_fullsized":"2024-09-10T23:17:03.168007+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:14.517439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550269+0000","last_change":"2024-09-10T23:17:02.181699+0000","last_active":"2024-09-10T23:17:03.550269+0000","last_peered":"2024-09-10T23:17:03.550269+0000","last_clean":"2024-09-10T23:17:03.550269+0000","last_became_active":"2024-09-10T23:17:02.181465+0000","last_became_peered":"2024-09-10T23:17:02.181465+0000","last_unstale":"2024-09-10T23:17:03.550269+0000","last_undegraded":"2024-09-10T23:17:03.550269+0000","last_fullsized":"2024-09-10T23:17:03.550269+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:48.525078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549000+0000","last_change":"2024-09-10T23:17:01.191410+0000","last_active":"2024-09-10T23:17:03.549000+0000","last_peered":"2024-09-10T23:17:03.549000+0000","last_clean":"2024-09-10T23:17:03.549000+0000","last_became_active":"2024-09-10T23:17:01.191164+0000","last_became_peered":"2024-09-10T23:17:01.191164+0000","last_unstale":"2024-09-10T23:17:03.549000+0000","last_undegraded":"2024-09-10T23:17:03.549000+0000","last_fullsized":"2024-09-10T23:17:03.549000+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:56.372150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.548932+0000","last_change":"2024-09-10T23:17:02.179163+0000","last_active":"2024-09-10T23:17:03.548932+0000","last_peered":"2024-09-10T23:17:03.548932+0000","last_clean":"2024-09-10T23:17:03.548932+0000","last_became_active":"2024-09-10T23:17:02.178770+0000","last_became_peered":"2024-09-10T23:17:02.178770+0000","last_unstale":"2024-09-10T23:17:03.548932+0000","last_undegraded":"2024-09-10T23:17:03.548932+0000","last_fullsized":"2024-09-10T23:17:03.548932+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:57.176877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.170926+0000","last_change":"2024-09-10T23:17:01.186831+0000","last_active":"2024-09-10T23:17:03.170926+0000","last_peered":"2024-09-10T23:17:03.170926+0000","last_clean":"2024-09-10T23:17:03.170926+0000","last_became_active":"2024-09-10T23:17:01.186481+0000","last_became_peered":"2024-09-10T23:17:01.186481+0000","last_unstale":"2024-09-10T23:17:03.170926+0000","last_undegraded":"2024-09-10T23:17:03.170926+0000","last_fullsized":"2024-09-10T23:17:03.170926+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:32.830295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549594+0000","last_change":"2024-09-10T23:17:02.183192+0000","last_active":"2024-09-10T23:17:03.549594+0000","last_peered":"2024-09-10T23:17:03.549594+0000","last_clean":"2024-09-10T23:17:03.549594+0000","last_became_active":"2024-09-10T23:17:02.182921+0000","last_became_peered":"2024-09-10T23:17:02.182921+0000","last_unstale":"2024-09-10T23:17:03.549594+0000","last_undegraded":"2024-09-10T23:17:03.549594+0000","last_fullsized":"2024-09-10T23:17:03.549594+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:33.832394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550845+0000","last_change":"2024-09-10T23:17:01.193565+0000","last_active":"2024-09-10T23:17:03.550845+0000","last_peered":"2024-09-10T23:17:03.550845+0000","last_clean":"2024-09-10T23:17:03.550845+0000","last_became_active":"2024-09-10T23:17:01.193276+0000","last_became_peered":"2024-09-10T23:17:01.193276+0000","last_unstale":"2024-09-10T23:17:03.550845+0000","last_undegraded":"2024-09-10T23:17:03.550845+0000","last_fullsized":"2024-09-10T23:17:03.550845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:47.035764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549630+0000","last_change":"2024-09-10T23:17:02.182964+0000","last_active":"2024-09-10T23:17:03.549630+0000","last_peered":"2024-09-10T23:17:03.549630+0000","last_clean":"2024-09-10T23:17:03.549630+0000","last_became_active":"2024-09-10T23:17:02.182646+0000","last_became_peered":"2024-09-10T23:17:02.182646+0000","last_unstale":"2024-09-10T23:17:03.549630+0000","last_undegraded":"2024-09-10T23:17:03.549630+0000","last_fullsized":"2024-09-10T23:17:03.549630+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:59:21.362705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550283+0000","last_change":"2024-09-10T23:17:01.196355+0000","last_active":"2024-09-10T23:17:03.550283+0000","last_peered":"2024-09-10T23:17:03.550283+0000","last_clean":"2024-09-10T23:17:03.550283+0000","last_became_active":"2024-09-10T23:17:01.196056+0000","last_became_peered":"2024-09-10T23:17:01.196056+0000","last_unstale":"2024-09-10T23:17:03.550283+0000","last_undegraded":"2024-09-10T23:17:03.550283+0000","last_fullsized":"2024-09-10T23:17:03.550283+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:08.881426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":190,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549116+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:17:03.549116+0000","last_peered":"2024-09-10T23:17:03.549116+0000","last_clean":"2024-09-10T23:17:03.549116+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:17:03.549116+0000","last_undegraded":"2024-09-10T23:17:03.549116+0000","last_fullsized":"2024-09-10T23:17:03.549116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509476,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28416,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343424,"statfs":{"total":96636764160,"available":96607666176,"internally_reserved":0,"allocated":1421312,"data_stored":930810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509475,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":827392,"data_stored":339918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509475,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":823296,"data_stored":339916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509475,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":823296,"data_stored":339896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":827392,"data_stored":339938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509476,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":831488,"data_stored":341438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":342054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1400832,"data_stored":923894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:17:09.509 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:17:09.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.622+0000 7fe430fc9640 1 -- 172.21.15.90:0/4086971279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c0b44a0 msgr2=0x7fe42c0b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:09.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.622+0000 7fe430fc9640 1 --2- 172.21.15.90:0/4086971279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c0b44a0 0x7fe42c0b4880 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0767f0 tx=0x7fe41c02b880 comp rx=0 tx=0).stop 2024-09-10T23:17:09.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.622+0000 7fe430fc9640 1 -- 172.21.15.90:0/4086971279 shutdown_connections 2024-09-10T23:17:09.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.622+0000 7fe430fc9640 1 --2- 172.21.15.90:0/4086971279 >> v2:172.21.15.171:3300/0 conn(0x7fe42c0cd470 0x7fe42c15e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:09.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.622+0000 7fe430fc9640 1 --2- 172.21.15.90:0/4086971279 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe42c0cf860 0x7fe42c15e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:09.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.622+0000 7fe430fc9640 1 --2- 172.21.15.90:0/4086971279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c0b44a0 0x7fe42c0b4880 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:09.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.622+0000 7fe430fc9640 1 -- 172.21.15.90:0/4086971279 >> 172.21.15.90:0/4086971279 conn(0x7fe42c0b19c0 msgr2=0x7fe42c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:09.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.622+0000 7fe430fc9640 1 -- 172.21.15.90:0/4086971279 shutdown_connections 2024-09-10T23:17:09.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.622+0000 7fe430fc9640 1 -- 172.21.15.90:0/4086971279 wait complete. 2024-09-10T23:17:09.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.624+0000 7fe430fc9640 1 Processor -- start 2024-09-10T23:17:09.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.624+0000 7fe430fc9640 1 -- start start 2024-09-10T23:17:09.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.624+0000 7fe430fc9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe42c0b44a0 0x7fe42c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:09.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe430fc9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe42c0cd470 0x7fe42c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:09.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe430fc9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c0cf860 0x7fe42c14fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:09.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe430fc9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c15aa40 con 0x7fe42c0cf860 2024-09-10T23:17:09.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe430fc9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c15a8c0 con 0x7fe42c0b44a0 2024-09-10T23:17:09.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe430fc9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe42c15ec00 con 0x7fe42c0cd470 2024-09-10T23:17:09.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe42ad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c0cf860 0x7fe42c14fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:09.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe42ad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c0cf860 0x7fe42c14fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52296/0 (socket says 172.21.15.90:52296) 2024-09-10T23:17:09.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe42ad9d640 1 -- 172.21.15.90:0/368151918 learned_addr learned my addr 172.21.15.90:0/368151918 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:09.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe429d9b640 1 --2- 172.21.15.90:0/368151918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe42c0cd470 0x7fe42c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:09.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe42a59c640 1 --2- 172.21.15.90:0/368151918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe42c0b44a0 0x7fe42c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:09.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe42ad9d640 1 -- 172.21.15.90:0/368151918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe42c0cd470 msgr2=0x7fe42c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:09.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe42ad9d640 1 --2- 172.21.15.90:0/368151918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe42c0cd470 0x7fe42c0c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:09.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe42ad9d640 1 -- 172.21.15.90:0/368151918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe42c0b44a0 msgr2=0x7fe42c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:09.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe42ad9d640 1 --2- 172.21.15.90:0/368151918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe42c0b44a0 0x7fe42c0ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:09.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe42ad9d640 1 -- 172.21.15.90:0/368151918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c0b0a10 con 0x7fe42c0cf860 2024-09-10T23:17:09.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe42ad9d640 1 --2- 172.21.15.90:0/368151918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c0cf860 0x7fe42c14fbc0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe42400e980 tx=0x7fe42400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:09.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe41affd640 1 -- 172.21.15.90:0/368151918 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424004d20 con 0x7fe42c0cf860 2024-09-10T23:17:09.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe41affd640 1 -- 172.21.15.90:0/368151918 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe42400cac0 con 0x7fe42c0cf860 2024-09-10T23:17:09.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe41affd640 1 -- 172.21.15.90:0/368151918 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424005020 con 0x7fe42c0cf860 2024-09-10T23:17:09.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe430fc9640 1 -- 172.21.15.90:0/368151918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42c0b0cf0 con 0x7fe42c0cf860 2024-09-10T23:17:09.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.625+0000 7fe430fc9640 1 -- 172.21.15.90:0/368151918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe42c0c9eb0 con 0x7fe42c0cf860 2024-09-10T23:17:09.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.626+0000 7fe430fc9640 1 -- 172.21.15.90:0/368151918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe42c0b4880 con 0x7fe42c0cf860 2024-09-10T23:17:09.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.627+0000 7fe41affd640 1 -- 172.21.15.90:0/368151918 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe42400f040 con 0x7fe42c0cf860 2024-09-10T23:17:09.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.628+0000 7fe41affd640 1 --2- 172.21.15.90:0/368151918 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe40c077f70 0x7fe40c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:09.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.628+0000 7fe41affd640 1 -- 172.21.15.90:0/368151918 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fe42409a370 con 0x7fe42c0cf860 2024-09-10T23:17:09.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.628+0000 7fe42a59c640 1 --2- 172.21.15.90:0/368151918 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe40c077f70 0x7fe40c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:09.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.629+0000 7fe42a59c640 1 --2- 172.21.15.90:0/368151918 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe40c077f70 0x7fe40c07a430 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe41c035000 tx=0x7fe41c004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:09.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.632+0000 7fe41affd640 1 -- 172.21.15.90:0/368151918 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe424016030 con 0x7fe42c0cf860 2024-09-10T23:17:09.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.804+0000 7fe430fc9640 1 -- 172.21.15.90:0/368151918 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe42c0cc480 con 0x7fe40c077f70 2024-09-10T23:17:09.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.809+0000 7fe41affd640 1 -- 172.21.15.90:0/368151918 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252046 (secure 0 0 0) 0x7fe42c0cc480 con 0x7fe40c077f70 2024-09-10T23:17:09.813 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:09.814 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:17:09.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.812+0000 7fe430fc9640 1 -- 172.21.15.90:0/368151918 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe40c077f70 msgr2=0x7fe40c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:09.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.812+0000 7fe430fc9640 1 --2- 172.21.15.90:0/368151918 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe40c077f70 0x7fe40c07a430 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe41c035000 tx=0x7fe41c004730 comp rx=0 tx=0).stop 2024-09-10T23:17:09.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.812+0000 7fe430fc9640 1 -- 172.21.15.90:0/368151918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c0cf860 msgr2=0x7fe42c14fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:09.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.812+0000 7fe430fc9640 1 --2- 172.21.15.90:0/368151918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c0cf860 0x7fe42c14fbc0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe42400e980 tx=0x7fe42400ee40 comp rx=0 tx=0).stop 2024-09-10T23:17:09.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.812+0000 7fe430fc9640 1 -- 172.21.15.90:0/368151918 shutdown_connections 2024-09-10T23:17:09.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.812+0000 7fe430fc9640 1 --2- 172.21.15.90:0/368151918 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe40c077f70 0x7fe40c07a430 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:09.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.812+0000 7fe430fc9640 1 --2- 172.21.15.90:0/368151918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe42c0cf860 0x7fe42c14fbc0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:09.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.812+0000 7fe430fc9640 1 --2- 172.21.15.90:0/368151918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe42c0cd470 0x7fe42c0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:09.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.812+0000 7fe430fc9640 1 --2- 172.21.15.90:0/368151918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe42c0b44a0 0x7fe42c0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:09.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.812+0000 7fe430fc9640 1 -- 172.21.15.90:0/368151918 >> 172.21.15.90:0/368151918 conn(0x7fe42c0b19c0 msgr2=0x7fe42c159510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:09.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.812+0000 7fe430fc9640 1 -- 172.21.15.90:0/368151918 shutdown_connections 2024-09-10T23:17:09.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.812+0000 7fe430fc9640 1 -- 172.21.15.90:0/368151918 wait complete. 2024-09-10T23:17:09.824 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-09-10T23:17:08.470886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236340,"kb_used_data":7624,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738380,"statfs":{"total":773094113280,"available":772852101120,"internally_reserved":0,"allocated":7806976,"data_stored":3904164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.296671"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549743+0000","last_change":"2024-09-10T23:17:02.190617+0000","last_active":"2024-09-10T23:17:03.549743+0000","last_peered":"2024-09-10T23:17:03.549743+0000","last_clean":"2024-09-10T23:17:03.549743+0000","last_became_active":"2024-09-10T23:17:02.190368+0000","last_became_peered":"2024-09-10T23:17:02.190368+0000","last_unstale":"2024-09-10T23:17:03.549743+0000","last_undegraded":"2024-09-10T23:17:03.549743+0000","last_fullsized":"2024-09-10T23:17:03.549743+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:16.268902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550620+0000","last_change":"2024-09-10T23:17:02.190936+0000","last_active":"2024-09-10T23:17:03.550620+0000","last_peered":"2024-09-10T23:17:03.550620+0000","last_clean":"2024-09-10T23:17:03.550620+0000","last_became_active":"2024-09-10T23:17:02.190607+0000","last_became_peered":"2024-09-10T23:17:02.190607+0000","last_unstale":"2024-09-10T23:17:03.550620+0000","last_undegraded":"2024-09-10T23:17:03.550620+0000","last_fullsized":"2024-09-10T23:17:03.550620+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:15.990112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549497+0000","last_change":"2024-09-10T23:17:02.184584+0000","last_active":"2024-09-10T23:17:03.549497+0000","last_peered":"2024-09-10T23:17:03.549497+0000","last_clean":"2024-09-10T23:17:03.549497+0000","last_became_active":"2024-09-10T23:17:02.184233+0000","last_became_peered":"2024-09-10T23:17:02.184233+0000","last_unstale":"2024-09-10T23:17:03.549497+0000","last_undegraded":"2024-09-10T23:17:03.549497+0000","last_fullsized":"2024-09-10T23:17:03.549497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:03.018367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549230+0000","last_change":"2024-09-10T23:17:02.173515+0000","last_active":"2024-09-10T23:17:03.549230+0000","last_peered":"2024-09-10T23:17:03.549230+0000","last_clean":"2024-09-10T23:17:03.549230+0000","last_became_active":"2024-09-10T23:17:02.173273+0000","last_became_peered":"2024-09-10T23:17:02.173273+0000","last_unstale":"2024-09-10T23:17:03.549230+0000","last_undegraded":"2024-09-10T23:17:03.549230+0000","last_fullsized":"2024-09-10T23:17:03.549230+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:27.980015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168160+0000","last_change":"2024-09-10T23:17:02.181213+0000","last_active":"2024-09-10T23:17:03.168160+0000","last_peered":"2024-09-10T23:17:03.168160+0000","last_clean":"2024-09-10T23:17:03.168160+0000","last_became_active":"2024-09-10T23:17:02.180936+0000","last_became_peered":"2024-09-10T23:17:02.180936+0000","last_unstale":"2024-09-10T23:17:03.168160+0000","last_undegraded":"2024-09-10T23:17:03.168160+0000","last_fullsized":"2024-09-10T23:17:03.168160+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:25.721086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549789+0000","last_change":"2024-09-10T23:17:02.189630+0000","last_active":"2024-09-10T23:17:03.549789+0000","last_peered":"2024-09-10T23:17:03.549789+0000","last_clean":"2024-09-10T23:17:03.549789+0000","last_became_active":"2024-09-10T23:17:02.189356+0000","last_became_peered":"2024-09-10T23:17:02.189356+0000","last_unstale":"2024-09-10T23:17:03.549789+0000","last_undegraded":"2024-09-10T23:17:03.549789+0000","last_fullsized":"2024-09-10T23:17:03.549789+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:09.530956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171166+0000","last_change":"2024-09-10T23:17:02.171540+0000","last_active":"2024-09-10T23:17:03.171166+0000","last_peered":"2024-09-10T23:17:03.171166+0000","last_clean":"2024-09-10T23:17:03.171166+0000","last_became_active":"2024-09-10T23:17:02.171236+0000","last_became_peered":"2024-09-10T23:17:02.171236+0000","last_unstale":"2024-09-10T23:17:03.171166+0000","last_undegraded":"2024-09-10T23:17:03.171166+0000","last_fullsized":"2024-09-10T23:17:03.171166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:57.847525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550782+0000","last_change":"2024-09-10T23:17:02.179017+0000","last_active":"2024-09-10T23:17:03.550782+0000","last_peered":"2024-09-10T23:17:03.550782+0000","last_clean":"2024-09-10T23:17:03.550782+0000","last_became_active":"2024-09-10T23:17:02.178087+0000","last_became_peered":"2024-09-10T23:17:02.178087+0000","last_unstale":"2024-09-10T23:17:03.550782+0000","last_undegraded":"2024-09-10T23:17:03.550782+0000","last_fullsized":"2024-09-10T23:17:03.550782+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:31.859535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168538+0000","last_change":"2024-09-10T23:17:02.186432+0000","last_active":"2024-09-10T23:17:03.168538+0000","last_peered":"2024-09-10T23:17:03.168538+0000","last_clean":"2024-09-10T23:17:03.168538+0000","last_became_active":"2024-09-10T23:17:02.186180+0000","last_became_peered":"2024-09-10T23:17:02.186180+0000","last_unstale":"2024-09-10T23:17:03.168538+0000","last_undegraded":"2024-09-10T23:17:03.168538+0000","last_fullsized":"2024-09-10T23:17:03.168538+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:29.377633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172325+0000","last_change":"2024-09-10T23:17:02.190057+0000","last_active":"2024-09-10T23:17:03.172325+0000","last_peered":"2024-09-10T23:17:03.172325+0000","last_clean":"2024-09-10T23:17:03.172325+0000","last_became_active":"2024-09-10T23:17:02.189775+0000","last_became_peered":"2024-09-10T23:17:02.189775+0000","last_unstale":"2024-09-10T23:17:03.172325+0000","last_undegraded":"2024-09-10T23:17:03.172325+0000","last_fullsized":"2024-09-10T23:17:03.172325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:57.347706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550735+0000","last_change":"2024-09-10T23:17:02.184997+0000","last_active":"2024-09-10T23:17:03.550735+0000","last_peered":"2024-09-10T23:17:03.550735+0000","last_clean":"2024-09-10T23:17:03.550735+0000","last_became_active":"2024-09-10T23:17:02.184707+0000","last_became_peered":"2024-09-10T23:17:02.184707+0000","last_unstale":"2024-09-10T23:17:03.550735+0000","last_undegraded":"2024-09-10T23:17:03.550735+0000","last_fullsized":"2024-09-10T23:17:03.550735+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:06.105613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549418+0000","last_change":"2024-09-10T23:17:02.181983+0000","last_active":"2024-09-10T23:17:03.549418+0000","last_peered":"2024-09-10T23:17:03.549418+0000","last_clean":"2024-09-10T23:17:03.549418+0000","last_became_active":"2024-09-10T23:17:02.181486+0000","last_became_peered":"2024-09-10T23:17:02.181486+0000","last_unstale":"2024-09-10T23:17:03.549418+0000","last_undegraded":"2024-09-10T23:17:03.549418+0000","last_fullsized":"2024-09-10T23:17:03.549418+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:42.748721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.190152+0000","last_change":"2024-09-10T23:17:02.187898+0000","last_active":"2024-09-10T23:17:03.190152+0000","last_peered":"2024-09-10T23:17:03.190152+0000","last_clean":"2024-09-10T23:17:03.190152+0000","last_became_active":"2024-09-10T23:17:02.187650+0000","last_became_peered":"2024-09-10T23:17:02.187650+0000","last_unstale":"2024-09-10T23:17:03.190152+0000","last_undegraded":"2024-09-10T23:17:03.190152+0000","last_fullsized":"2024-09-10T23:17:03.190152+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:00.046030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.167986+0000","last_change":"2024-09-10T23:17:02.180451+0000","last_active":"2024-09-10T23:17:03.167986+0000","last_peered":"2024-09-10T23:17:03.167986+0000","last_clean":"2024-09-10T23:17:03.167986+0000","last_became_active":"2024-09-10T23:17:02.180172+0000","last_became_peered":"2024-09-10T23:17:02.180172+0000","last_unstale":"2024-09-10T23:17:03.167986+0000","last_undegraded":"2024-09-10T23:17:03.167986+0000","last_fullsized":"2024-09-10T23:17:03.167986+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:17.185957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189852+0000","last_change":"2024-09-10T23:17:02.186755+0000","last_active":"2024-09-10T23:17:03.189852+0000","last_peered":"2024-09-10T23:17:03.189852+0000","last_clean":"2024-09-10T23:17:03.189852+0000","last_became_active":"2024-09-10T23:17:02.186481+0000","last_became_peered":"2024-09-10T23:17:02.186481+0000","last_unstale":"2024-09-10T23:17:03.189852+0000","last_undegraded":"2024-09-10T23:17:03.189852+0000","last_fullsized":"2024-09-10T23:17:03.189852+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:20.939249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171553+0000","last_change":"2024-09-10T23:17:02.186515+0000","last_active":"2024-09-10T23:17:03.171553+0000","last_peered":"2024-09-10T23:17:03.171553+0000","last_clean":"2024-09-10T23:17:03.171553+0000","last_became_active":"2024-09-10T23:17:02.186189+0000","last_became_peered":"2024-09-10T23:17:02.186189+0000","last_unstale":"2024-09-10T23:17:03.171553+0000","last_undegraded":"2024-09-10T23:17:03.171553+0000","last_fullsized":"2024-09-10T23:17:03.171553+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:01.905184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168576+0000","last_change":"2024-09-10T23:17:02.185732+0000","last_active":"2024-09-10T23:17:03.168576+0000","last_peered":"2024-09-10T23:17:03.168576+0000","last_clean":"2024-09-10T23:17:03.168576+0000","last_became_active":"2024-09-10T23:17:02.185472+0000","last_became_peered":"2024-09-10T23:17:02.185472+0000","last_unstale":"2024-09-10T23:17:03.168576+0000","last_undegraded":"2024-09-10T23:17:03.168576+0000","last_fullsized":"2024-09-10T23:17:03.168576+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:17.502387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549620+0000","last_change":"2024-09-10T23:17:02.173588+0000","last_active":"2024-09-10T23:17:03.549620+0000","last_peered":"2024-09-10T23:17:03.549620+0000","last_clean":"2024-09-10T23:17:03.549620+0000","last_became_active":"2024-09-10T23:17:02.173357+0000","last_became_peered":"2024-09-10T23:17:02.173357+0000","last_unstale":"2024-09-10T23:17:03.549620+0000","last_undegraded":"2024-09-10T23:17:03.549620+0000","last_fullsized":"2024-09-10T23:17:03.549620+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:14.332250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549856+0000","last_change":"2024-09-10T23:17:02.177229+0000","last_active":"2024-09-10T23:17:03.549856+0000","last_peered":"2024-09-10T23:17:03.549856+0000","last_clean":"2024-09-10T23:17:03.549856+0000","last_became_active":"2024-09-10T23:17:02.176295+0000","last_became_peered":"2024-09-10T23:17:02.176295+0000","last_unstale":"2024-09-10T23:17:03.549856+0000","last_undegraded":"2024-09-10T23:17:03.549856+0000","last_fullsized":"2024-09-10T23:17:03.549856+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:13.179437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.190031+0000","last_change":"2024-09-10T23:17:02.183603+0000","last_active":"2024-09-10T23:17:03.190031+0000","last_peered":"2024-09-10T23:17:03.190031+0000","last_clean":"2024-09-10T23:17:03.190031+0000","last_became_active":"2024-09-10T23:17:02.183380+0000","last_became_peered":"2024-09-10T23:17:02.183380+0000","last_unstale":"2024-09-10T23:17:03.190031+0000","last_undegraded":"2024-09-10T23:17:03.190031+0000","last_fullsized":"2024-09-10T23:17:03.190031+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:59.511145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171392+0000","last_change":"2024-09-10T23:17:02.186842+0000","last_active":"2024-09-10T23:17:03.171392+0000","last_peered":"2024-09-10T23:17:03.171392+0000","last_clean":"2024-09-10T23:17:03.171392+0000","last_became_active":"2024-09-10T23:17:02.186549+0000","last_became_peered":"2024-09-10T23:17:02.186549+0000","last_unstale":"2024-09-10T23:17:03.171392+0000","last_undegraded":"2024-09-10T23:17:03.171392+0000","last_fullsized":"2024-09-10T23:17:03.171392+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:46.738934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171192+0000","last_change":"2024-09-10T23:17:02.189159+0000","last_active":"2024-09-10T23:17:03.171192+0000","last_peered":"2024-09-10T23:17:03.171192+0000","last_clean":"2024-09-10T23:17:03.171192+0000","last_became_active":"2024-09-10T23:17:02.188801+0000","last_became_peered":"2024-09-10T23:17:02.188801+0000","last_unstale":"2024-09-10T23:17:03.171192+0000","last_undegraded":"2024-09-10T23:17:03.171192+0000","last_fullsized":"2024-09-10T23:17:03.171192+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:34.490128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549319+0000","last_change":"2024-09-10T23:17:02.180886+0000","last_active":"2024-09-10T23:17:03.549319+0000","last_peered":"2024-09-10T23:17:03.549319+0000","last_clean":"2024-09-10T23:17:03.549319+0000","last_became_active":"2024-09-10T23:17:02.180579+0000","last_became_peered":"2024-09-10T23:17:02.180579+0000","last_unstale":"2024-09-10T23:17:03.549319+0000","last_undegraded":"2024-09-10T23:17:03.549319+0000","last_fullsized":"2024-09-10T23:17:03.549319+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:53.776767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549271+0000","last_change":"2024-09-10T23:17:02.189174+0000","last_active":"2024-09-10T23:17:03.549271+0000","last_peered":"2024-09-10T23:17:03.549271+0000","last_clean":"2024-09-10T23:17:03.549271+0000","last_became_active":"2024-09-10T23:17:02.188541+0000","last_became_peered":"2024-09-10T23:17:02.188541+0000","last_unstale":"2024-09-10T23:17:03.549271+0000","last_undegraded":"2024-09-10T23:17:03.549271+0000","last_fullsized":"2024-09-10T23:17:03.549271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:59.022484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171734+0000","last_change":"2024-09-10T23:17:02.186477+0000","last_active":"2024-09-10T23:17:03.171734+0000","last_peered":"2024-09-10T23:17:03.171734+0000","last_clean":"2024-09-10T23:17:03.171734+0000","last_became_active":"2024-09-10T23:17:02.186156+0000","last_became_peered":"2024-09-10T23:17:02.186156+0000","last_unstale":"2024-09-10T23:17:03.171734+0000","last_undegraded":"2024-09-10T23:17:03.171734+0000","last_fullsized":"2024-09-10T23:17:03.171734+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:16.595372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172032+0000","last_change":"2024-09-10T23:17:02.172653+0000","last_active":"2024-09-10T23:17:03.172032+0000","last_peered":"2024-09-10T23:17:03.172032+0000","last_clean":"2024-09-10T23:17:03.172032+0000","last_became_active":"2024-09-10T23:17:02.172366+0000","last_became_peered":"2024-09-10T23:17:02.172366+0000","last_unstale":"2024-09-10T23:17:03.172032+0000","last_undegraded":"2024-09-10T23:17:03.172032+0000","last_fullsized":"2024-09-10T23:17:03.172032+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:16.143101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549717+0000","last_change":"2024-09-10T23:17:02.180725+0000","last_active":"2024-09-10T23:17:03.549717+0000","last_peered":"2024-09-10T23:17:03.549717+0000","last_clean":"2024-09-10T23:17:03.549717+0000","last_became_active":"2024-09-10T23:17:02.180470+0000","last_became_peered":"2024-09-10T23:17:02.180470+0000","last_unstale":"2024-09-10T23:17:03.549717+0000","last_undegraded":"2024-09-10T23:17:03.549717+0000","last_fullsized":"2024-09-10T23:17:03.549717+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:53.043500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171383+0000","last_change":"2024-09-10T23:17:02.187233+0000","last_active":"2024-09-10T23:17:03.171383+0000","last_peered":"2024-09-10T23:17:03.171383+0000","last_clean":"2024-09-10T23:17:03.171383+0000","last_became_active":"2024-09-10T23:17:02.186968+0000","last_became_peered":"2024-09-10T23:17:02.186968+0000","last_unstale":"2024-09-10T23:17:03.171383+0000","last_undegraded":"2024-09-10T23:17:03.171383+0000","last_fullsized":"2024-09-10T23:17:03.171383+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:43.439335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549085+0000","last_change":"2024-09-10T23:17:02.183111+0000","last_active":"2024-09-10T23:17:03.549085+0000","last_peered":"2024-09-10T23:17:03.549085+0000","last_clean":"2024-09-10T23:17:03.549085+0000","last_became_active":"2024-09-10T23:17:02.182538+0000","last_became_peered":"2024-09-10T23:17:02.182538+0000","last_unstale":"2024-09-10T23:17:03.549085+0000","last_undegraded":"2024-09-10T23:17:03.549085+0000","last_fullsized":"2024-09-10T23:17:03.549085+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:42.177960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171544+0000","last_change":"2024-09-10T23:17:02.172772+0000","last_active":"2024-09-10T23:17:03.171544+0000","last_peered":"2024-09-10T23:17:03.171544+0000","last_clean":"2024-09-10T23:17:03.171544+0000","last_became_active":"2024-09-10T23:17:02.172518+0000","last_became_peered":"2024-09-10T23:17:02.172518+0000","last_unstale":"2024-09-10T23:17:03.171544+0000","last_undegraded":"2024-09-10T23:17:03.171544+0000","last_fullsized":"2024-09-10T23:17:03.171544+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:27.563534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172082+0000","last_change":"2024-09-10T23:17:02.180911+0000","last_active":"2024-09-10T23:17:03.172082+0000","last_peered":"2024-09-10T23:17:03.172082+0000","last_clean":"2024-09-10T23:17:03.172082+0000","last_became_active":"2024-09-10T23:17:02.180656+0000","last_became_peered":"2024-09-10T23:17:02.180656+0000","last_unstale":"2024-09-10T23:17:03.172082+0000","last_undegraded":"2024-09-10T23:17:03.172082+0000","last_fullsized":"2024-09-10T23:17:03.172082+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:25.510225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550779+0000","last_change":"2024-09-10T23:17:02.184529+0000","last_active":"2024-09-10T23:17:03.550779+0000","last_peered":"2024-09-10T23:17:03.550779+0000","last_clean":"2024-09-10T23:17:03.550779+0000","last_became_active":"2024-09-10T23:17:02.184249+0000","last_became_peered":"2024-09-10T23:17:02.184249+0000","last_unstale":"2024-09-10T23:17:03.550779+0000","last_undegraded":"2024-09-10T23:17:03.550779+0000","last_fullsized":"2024-09-10T23:17:03.550779+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:38.996355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549677+0000","last_change":"2024-09-10T23:17:02.188744+0000","last_active":"2024-09-10T23:17:03.549677+0000","last_peered":"2024-09-10T23:17:03.549677+0000","last_clean":"2024-09-10T23:17:03.549677+0000","last_became_active":"2024-09-10T23:17:02.188461+0000","last_became_peered":"2024-09-10T23:17:02.188461+0000","last_unstale":"2024-09-10T23:17:03.549677+0000","last_undegraded":"2024-09-10T23:17:03.549677+0000","last_fullsized":"2024-09-10T23:17:03.549677+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:40.954146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"67'4","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549981+0000","last_change":"2024-09-10T23:17:01.193669+0000","last_active":"2024-09-10T23:17:03.549981+0000","last_peered":"2024-09-10T23:17:03.549981+0000","last_clean":"2024-09-10T23:17:03.549981+0000","last_became_active":"2024-09-10T23:17:01.193401+0000","last_became_peered":"2024-09-10T23:17:01.193401+0000","last_unstale":"2024-09-10T23:17:03.549981+0000","last_undegraded":"2024-09-10T23:17:03.549981+0000","last_fullsized":"2024-09-10T23:17:03.549981+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:41.037930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168696+0000","last_change":"2024-09-10T23:17:02.187210+0000","last_active":"2024-09-10T23:17:03.168696+0000","last_peered":"2024-09-10T23:17:03.168696+0000","last_clean":"2024-09-10T23:17:03.168696+0000","last_became_active":"2024-09-10T23:17:02.184848+0000","last_became_peered":"2024-09-10T23:17:02.184848+0000","last_unstale":"2024-09-10T23:17:03.168696+0000","last_undegraded":"2024-09-10T23:17:03.168696+0000","last_fullsized":"2024-09-10T23:17:03.168696+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:33.710241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.190010+0000","last_change":"2024-09-10T23:17:01.188635+0000","last_active":"2024-09-10T23:17:03.190010+0000","last_peered":"2024-09-10T23:17:03.190010+0000","last_clean":"2024-09-10T23:17:03.190010+0000","last_became_active":"2024-09-10T23:17:01.188298+0000","last_became_peered":"2024-09-10T23:17:01.188298+0000","last_unstale":"2024-09-10T23:17:03.190010+0000","last_undegraded":"2024-09-10T23:17:03.190010+0000","last_fullsized":"2024-09-10T23:17:03.190010+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:20.519330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550323+0000","last_change":"2024-09-10T23:17:02.179122+0000","last_active":"2024-09-10T23:17:03.550323+0000","last_peered":"2024-09-10T23:17:03.550323+0000","last_clean":"2024-09-10T23:17:03.550323+0000","last_became_active":"2024-09-10T23:17:02.178870+0000","last_became_peered":"2024-09-10T23:17:02.178870+0000","last_unstale":"2024-09-10T23:17:03.550323+0000","last_undegraded":"2024-09-10T23:17:03.550323+0000","last_fullsized":"2024-09-10T23:17:03.550323+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:18.109091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171924+0000","last_change":"2024-09-10T23:17:01.191194+0000","last_active":"2024-09-10T23:17:03.171924+0000","last_peered":"2024-09-10T23:17:03.171924+0000","last_clean":"2024-09-10T23:17:03.171924+0000","last_became_active":"2024-09-10T23:17:01.190905+0000","last_became_peered":"2024-09-10T23:17:01.190905+0000","last_unstale":"2024-09-10T23:17:03.171924+0000","last_undegraded":"2024-09-10T23:17:03.171924+0000","last_fullsized":"2024-09-10T23:17:03.171924+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:10.845894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549901+0000","last_change":"2024-09-10T23:17:02.185239+0000","last_active":"2024-09-10T23:17:03.549901+0000","last_peered":"2024-09-10T23:17:03.549901+0000","last_clean":"2024-09-10T23:17:03.549901+0000","last_became_active":"2024-09-10T23:17:02.184988+0000","last_became_peered":"2024-09-10T23:17:02.184988+0000","last_unstale":"2024-09-10T23:17:03.549901+0000","last_undegraded":"2024-09-10T23:17:03.549901+0000","last_fullsized":"2024-09-10T23:17:03.549901+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:57.136333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550424+0000","last_change":"2024-09-10T23:17:01.191022+0000","last_active":"2024-09-10T23:17:03.550424+0000","last_peered":"2024-09-10T23:17:03.550424+0000","last_clean":"2024-09-10T23:17:03.550424+0000","last_became_active":"2024-09-10T23:17:01.190699+0000","last_became_peered":"2024-09-10T23:17:01.190699+0000","last_unstale":"2024-09-10T23:17:03.550424+0000","last_undegraded":"2024-09-10T23:17:03.550424+0000","last_fullsized":"2024-09-10T23:17:03.550424+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:32.708142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171766+0000","last_change":"2024-09-10T23:17:02.184117+0000","last_active":"2024-09-10T23:17:03.171766+0000","last_peered":"2024-09-10T23:17:03.171766+0000","last_clean":"2024-09-10T23:17:03.171766+0000","last_became_active":"2024-09-10T23:17:02.183849+0000","last_became_peered":"2024-09-10T23:17:02.183849+0000","last_unstale":"2024-09-10T23:17:03.171766+0000","last_undegraded":"2024-09-10T23:17:03.171766+0000","last_fullsized":"2024-09-10T23:17:03.171766+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:39.995863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549284+0000","last_change":"2024-09-10T23:17:01.190349+0000","last_active":"2024-09-10T23:17:03.549284+0000","last_peered":"2024-09-10T23:17:03.549284+0000","last_clean":"2024-09-10T23:17:03.549284+0000","last_became_active":"2024-09-10T23:17:01.188133+0000","last_became_peered":"2024-09-10T23:17:01.188133+0000","last_unstale":"2024-09-10T23:17:03.549284+0000","last_undegraded":"2024-09-10T23:17:03.549284+0000","last_fullsized":"2024-09-10T23:17:03.549284+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:15.785872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171432+0000","last_change":"2024-09-10T23:17:02.186654+0000","last_active":"2024-09-10T23:17:03.171432+0000","last_peered":"2024-09-10T23:17:03.171432+0000","last_clean":"2024-09-10T23:17:03.171432+0000","last_became_active":"2024-09-10T23:17:02.186114+0000","last_became_peered":"2024-09-10T23:17:02.186114+0000","last_unstale":"2024-09-10T23:17:03.171432+0000","last_undegraded":"2024-09-10T23:17:03.171432+0000","last_fullsized":"2024-09-10T23:17:03.171432+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:42.040028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549862+0000","last_change":"2024-09-10T23:17:01.192310+0000","last_active":"2024-09-10T23:17:03.549862+0000","last_peered":"2024-09-10T23:17:03.549862+0000","last_clean":"2024-09-10T23:17:03.549862+0000","last_became_active":"2024-09-10T23:17:01.192049+0000","last_became_peered":"2024-09-10T23:17:01.192049+0000","last_unstale":"2024-09-10T23:17:03.549862+0000","last_undegraded":"2024-09-10T23:17:03.549862+0000","last_fullsized":"2024-09-10T23:17:03.549862+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:47.029207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.167891+0000","last_change":"2024-09-10T23:17:02.187900+0000","last_active":"2024-09-10T23:17:03.167891+0000","last_peered":"2024-09-10T23:17:03.167891+0000","last_clean":"2024-09-10T23:17:03.167891+0000","last_became_active":"2024-09-10T23:17:02.187324+0000","last_became_peered":"2024-09-10T23:17:02.187324+0000","last_unstale":"2024-09-10T23:17:03.167891+0000","last_undegraded":"2024-09-10T23:17:03.167891+0000","last_fullsized":"2024-09-10T23:17:03.167891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:47.186252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549066+0000","last_change":"2024-09-10T23:17:01.190773+0000","last_active":"2024-09-10T23:17:03.549066+0000","last_peered":"2024-09-10T23:17:03.549066+0000","last_clean":"2024-09-10T23:17:03.549066+0000","last_became_active":"2024-09-10T23:17:01.190512+0000","last_became_peered":"2024-09-10T23:17:01.190512+0000","last_unstale":"2024-09-10T23:17:03.549066+0000","last_undegraded":"2024-09-10T23:17:03.549066+0000","last_fullsized":"2024-09-10T23:17:03.549066+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:03.121487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189857+0000","last_change":"2024-09-10T23:17:02.182823+0000","last_active":"2024-09-10T23:17:03.189857+0000","last_peered":"2024-09-10T23:17:03.189857+0000","last_clean":"2024-09-10T23:17:03.189857+0000","last_became_active":"2024-09-10T23:17:02.182551+0000","last_became_peered":"2024-09-10T23:17:02.182551+0000","last_unstale":"2024-09-10T23:17:03.189857+0000","last_undegraded":"2024-09-10T23:17:03.189857+0000","last_fullsized":"2024-09-10T23:17:03.189857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:16.350578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.167771+0000","last_change":"2024-09-10T23:17:01.191567+0000","last_active":"2024-09-10T23:17:03.167771+0000","last_peered":"2024-09-10T23:17:03.167771+0000","last_clean":"2024-09-10T23:17:03.167771+0000","last_became_active":"2024-09-10T23:17:01.191302+0000","last_became_peered":"2024-09-10T23:17:01.191302+0000","last_unstale":"2024-09-10T23:17:03.167771+0000","last_undegraded":"2024-09-10T23:17:03.167771+0000","last_fullsized":"2024-09-10T23:17:03.167771+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:52.664388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172240+0000","last_change":"2024-09-10T23:17:02.180558+0000","last_active":"2024-09-10T23:17:03.172240+0000","last_peered":"2024-09-10T23:17:03.172240+0000","last_clean":"2024-09-10T23:17:03.172240+0000","last_became_active":"2024-09-10T23:17:02.180251+0000","last_became_peered":"2024-09-10T23:17:02.180251+0000","last_unstale":"2024-09-10T23:17:03.172240+0000","last_undegraded":"2024-09-10T23:17:03.172240+0000","last_fullsized":"2024-09-10T23:17:03.172240+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:38.084698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171801+0000","last_change":"2024-09-10T23:17:01.184321+0000","last_active":"2024-09-10T23:17:03.171801+0000","last_peered":"2024-09-10T23:17:03.171801+0000","last_clean":"2024-09-10T23:17:03.171801+0000","last_became_active":"2024-09-10T23:17:01.184036+0000","last_became_peered":"2024-09-10T23:17:01.184036+0000","last_unstale":"2024-09-10T23:17:03.171801+0000","last_undegraded":"2024-09-10T23:17:03.171801+0000","last_fullsized":"2024-09-10T23:17:03.171801+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:04.144800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549910+0000","last_change":"2024-09-10T23:17:02.189878+0000","last_active":"2024-09-10T23:17:03.549910+0000","last_peered":"2024-09-10T23:17:03.549910+0000","last_clean":"2024-09-10T23:17:03.549910+0000","last_became_active":"2024-09-10T23:17:02.189582+0000","last_became_peered":"2024-09-10T23:17:02.189582+0000","last_unstale":"2024-09-10T23:17:03.549910+0000","last_undegraded":"2024-09-10T23:17:03.549910+0000","last_fullsized":"2024-09-10T23:17:03.549910+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:12.948794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550548+0000","last_change":"2024-09-10T23:17:01.193189+0000","last_active":"2024-09-10T23:17:03.550548+0000","last_peered":"2024-09-10T23:17:03.550548+0000","last_clean":"2024-09-10T23:17:03.550548+0000","last_became_active":"2024-09-10T23:17:01.192855+0000","last_became_peered":"2024-09-10T23:17:01.192855+0000","last_unstale":"2024-09-10T23:17:03.550548+0000","last_undegraded":"2024-09-10T23:17:03.550548+0000","last_fullsized":"2024-09-10T23:17:03.550548+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:56.372150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550584+0000","last_change":"2024-09-10T23:17:02.190530+0000","last_active":"2024-09-10T23:17:03.550584+0000","last_peered":"2024-09-10T23:17:03.550584+0000","last_clean":"2024-09-10T23:17:03.550584+0000","last_became_active":"2024-09-10T23:17:02.190197+0000","last_became_peered":"2024-09-10T23:17:02.190197+0000","last_unstale":"2024-09-10T23:17:03.550584+0000","last_undegraded":"2024-09-10T23:17:03.550584+0000","last_fullsized":"2024-09-10T23:17:03.550584+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:51.574469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"67'3","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549645+0000","last_change":"2024-09-10T23:17:01.182607+0000","last_active":"2024-09-10T23:17:03.549645+0000","last_peered":"2024-09-10T23:17:03.549645+0000","last_clean":"2024-09-10T23:17:03.549645+0000","last_became_active":"2024-09-10T23:17:01.182246+0000","last_became_peered":"2024-09-10T23:17:01.182246+0000","last_unstale":"2024-09-10T23:17:03.549645+0000","last_undegraded":"2024-09-10T23:17:03.549645+0000","last_fullsized":"2024-09-10T23:17:03.549645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:39.952048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168260+0000","last_change":"2024-09-10T23:17:02.187129+0000","last_active":"2024-09-10T23:17:03.168260+0000","last_peered":"2024-09-10T23:17:03.168260+0000","last_clean":"2024-09-10T23:17:03.168260+0000","last_became_active":"2024-09-10T23:17:02.186885+0000","last_became_peered":"2024-09-10T23:17:02.186885+0000","last_unstale":"2024-09-10T23:17:03.168260+0000","last_undegraded":"2024-09-10T23:17:03.168260+0000","last_fullsized":"2024-09-10T23:17:03.168260+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:21.027831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"67'6","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549531+0000","last_change":"2024-09-10T23:17:01.192130+0000","last_active":"2024-09-10T23:17:03.549531+0000","last_peered":"2024-09-10T23:17:03.549531+0000","last_clean":"2024-09-10T23:17:03.549531+0000","last_became_active":"2024-09-10T23:17:01.191685+0000","last_became_peered":"2024-09-10T23:17:01.191685+0000","last_unstale":"2024-09-10T23:17:03.549531+0000","last_undegraded":"2024-09-10T23:17:03.549531+0000","last_fullsized":"2024-09-10T23:17:03.549531+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:47.029207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549294+0000","last_change":"2024-09-10T23:17:02.190052+0000","last_active":"2024-09-10T23:17:03.549294+0000","last_peered":"2024-09-10T23:17:03.549294+0000","last_clean":"2024-09-10T23:17:03.549294+0000","last_became_active":"2024-09-10T23:17:02.189776+0000","last_became_peered":"2024-09-10T23:17:02.189776+0000","last_unstale":"2024-09-10T23:17:03.549294+0000","last_undegraded":"2024-09-10T23:17:03.549294+0000","last_fullsized":"2024-09-10T23:17:03.549294+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:12.143804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549167+0000","last_change":"2024-09-10T23:17:01.188630+0000","last_active":"2024-09-10T23:17:03.549167+0000","last_peered":"2024-09-10T23:17:03.549167+0000","last_clean":"2024-09-10T23:17:03.549167+0000","last_became_active":"2024-09-10T23:17:01.188364+0000","last_became_peered":"2024-09-10T23:17:01.188364+0000","last_unstale":"2024-09-10T23:17:03.549167+0000","last_undegraded":"2024-09-10T23:17:03.549167+0000","last_fullsized":"2024-09-10T23:17:03.549167+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:00.574165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172367+0000","last_change":"2024-09-10T23:17:02.187576+0000","last_active":"2024-09-10T23:17:03.172367+0000","last_peered":"2024-09-10T23:17:03.172367+0000","last_clean":"2024-09-10T23:17:03.172367+0000","last_became_active":"2024-09-10T23:17:02.187251+0000","last_became_peered":"2024-09-10T23:17:02.187251+0000","last_unstale":"2024-09-10T23:17:03.172367+0000","last_undegraded":"2024-09-10T23:17:03.172367+0000","last_fullsized":"2024-09-10T23:17:03.172367+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:45.441804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549971+0000","last_change":"2024-09-10T23:17:01.189716+0000","last_active":"2024-09-10T23:17:03.549971+0000","last_peered":"2024-09-10T23:17:03.549971+0000","last_clean":"2024-09-10T23:17:03.549971+0000","last_became_active":"2024-09-10T23:17:01.189432+0000","last_became_peered":"2024-09-10T23:17:01.189432+0000","last_unstale":"2024-09-10T23:17:03.549971+0000","last_undegraded":"2024-09-10T23:17:03.549971+0000","last_fullsized":"2024-09-10T23:17:03.549971+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:20.356543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189830+0000","last_change":"2024-09-10T23:17:02.188651+0000","last_active":"2024-09-10T23:17:03.189830+0000","last_peered":"2024-09-10T23:17:03.189830+0000","last_clean":"2024-09-10T23:17:03.189830+0000","last_became_active":"2024-09-10T23:17:02.188383+0000","last_became_peered":"2024-09-10T23:17:02.188383+0000","last_unstale":"2024-09-10T23:17:03.189830+0000","last_undegraded":"2024-09-10T23:17:03.189830+0000","last_fullsized":"2024-09-10T23:17:03.189830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:59.895108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171845+0000","last_change":"2024-09-10T23:17:01.187921+0000","last_active":"2024-09-10T23:17:03.171845+0000","last_peered":"2024-09-10T23:17:03.171845+0000","last_clean":"2024-09-10T23:17:03.171845+0000","last_became_active":"2024-09-10T23:17:01.187574+0000","last_became_peered":"2024-09-10T23:17:01.187574+0000","last_unstale":"2024-09-10T23:17:03.171845+0000","last_undegraded":"2024-09-10T23:17:03.171845+0000","last_fullsized":"2024-09-10T23:17:03.171845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:58.338264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.167929+0000","last_change":"2024-09-10T23:17:02.185654+0000","last_active":"2024-09-10T23:17:03.167929+0000","last_peered":"2024-09-10T23:17:03.167929+0000","last_clean":"2024-09-10T23:17:03.167929+0000","last_became_active":"2024-09-10T23:17:02.185413+0000","last_became_peered":"2024-09-10T23:17:02.185413+0000","last_unstale":"2024-09-10T23:17:03.167929+0000","last_undegraded":"2024-09-10T23:17:03.167929+0000","last_fullsized":"2024-09-10T23:17:03.167929+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:10.655764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"67'8","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171888+0000","last_change":"2024-09-10T23:17:01.185908+0000","last_active":"2024-09-10T23:17:03.171888+0000","last_peered":"2024-09-10T23:17:03.171888+0000","last_clean":"2024-09-10T23:17:03.171888+0000","last_became_active":"2024-09-10T23:17:01.185610+0000","last_became_peered":"2024-09-10T23:17:01.185610+0000","last_unstale":"2024-09-10T23:17:03.171888+0000","last_undegraded":"2024-09-10T23:17:03.171888+0000","last_fullsized":"2024-09-10T23:17:03.171888+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:08.528858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172376+0000","last_change":"2024-09-10T23:17:02.189822+0000","last_active":"2024-09-10T23:17:03.172376+0000","last_peered":"2024-09-10T23:17:03.172376+0000","last_clean":"2024-09-10T23:17:03.172376+0000","last_became_active":"2024-09-10T23:17:02.189491+0000","last_became_peered":"2024-09-10T23:17:02.189491+0000","last_unstale":"2024-09-10T23:17:03.172376+0000","last_undegraded":"2024-09-10T23:17:03.172376+0000","last_fullsized":"2024-09-10T23:17:03.172376+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:21.182628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550142+0000","last_change":"2024-09-10T23:17:01.196464+0000","last_active":"2024-09-10T23:17:03.550142+0000","last_peered":"2024-09-10T23:17:03.550142+0000","last_clean":"2024-09-10T23:17:03.550142+0000","last_became_active":"2024-09-10T23:17:01.196186+0000","last_became_peered":"2024-09-10T23:17:01.196186+0000","last_unstale":"2024-09-10T23:17:03.550142+0000","last_undegraded":"2024-09-10T23:17:03.550142+0000","last_fullsized":"2024-09-10T23:17:03.550142+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:03.121487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549976+0000","last_change":"2024-09-10T23:17:02.184953+0000","last_active":"2024-09-10T23:17:03.549976+0000","last_peered":"2024-09-10T23:17:03.549976+0000","last_clean":"2024-09-10T23:17:03.549976+0000","last_became_active":"2024-09-10T23:17:02.184694+0000","last_became_peered":"2024-09-10T23:17:02.184694+0000","last_unstale":"2024-09-10T23:17:03.549976+0000","last_undegraded":"2024-09-10T23:17:03.549976+0000","last_fullsized":"2024-09-10T23:17:03.549976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:26.570165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172411+0000","last_change":"2024-09-10T23:17:01.190406+0000","last_active":"2024-09-10T23:17:03.172411+0000","last_peered":"2024-09-10T23:17:03.172411+0000","last_clean":"2024-09-10T23:17:03.172411+0000","last_became_active":"2024-09-10T23:17:01.190145+0000","last_became_peered":"2024-09-10T23:17:01.190145+0000","last_unstale":"2024-09-10T23:17:03.172411+0000","last_undegraded":"2024-09-10T23:17:03.172411+0000","last_fullsized":"2024-09-10T23:17:03.172411+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:12.177339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549536+0000","last_change":"2024-09-10T23:17:02.181934+0000","last_active":"2024-09-10T23:17:03.549536+0000","last_peered":"2024-09-10T23:17:03.549536+0000","last_clean":"2024-09-10T23:17:03.549536+0000","last_became_active":"2024-09-10T23:17:02.181642+0000","last_became_peered":"2024-09-10T23:17:02.181642+0000","last_unstale":"2024-09-10T23:17:03.549536+0000","last_undegraded":"2024-09-10T23:17:03.549536+0000","last_fullsized":"2024-09-10T23:17:03.549536+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:17.862893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550004+0000","last_change":"2024-09-10T23:17:01.189654+0000","last_active":"2024-09-10T23:17:03.550004+0000","last_peered":"2024-09-10T23:17:03.550004+0000","last_clean":"2024-09-10T23:17:03.550004+0000","last_became_active":"2024-09-10T23:17:01.189368+0000","last_became_peered":"2024-09-10T23:17:01.189368+0000","last_unstale":"2024-09-10T23:17:03.550004+0000","last_undegraded":"2024-09-10T23:17:03.550004+0000","last_fullsized":"2024-09-10T23:17:03.550004+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:15.603001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168302+0000","last_change":"2024-09-10T23:17:02.188159+0000","last_active":"2024-09-10T23:17:03.168302+0000","last_peered":"2024-09-10T23:17:03.168302+0000","last_clean":"2024-09-10T23:17:03.168302+0000","last_became_active":"2024-09-10T23:17:02.187880+0000","last_became_peered":"2024-09-10T23:17:02.187880+0000","last_unstale":"2024-09-10T23:17:03.168302+0000","last_undegraded":"2024-09-10T23:17:03.168302+0000","last_fullsized":"2024-09-10T23:17:03.168302+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:30.977222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549589+0000","last_change":"2024-09-10T23:17:01.190754+0000","last_active":"2024-09-10T23:17:03.549589+0000","last_peered":"2024-09-10T23:17:03.549589+0000","last_clean":"2024-09-10T23:17:03.549589+0000","last_became_active":"2024-09-10T23:17:01.190488+0000","last_became_peered":"2024-09-10T23:17:01.190488+0000","last_unstale":"2024-09-10T23:17:03.549589+0000","last_undegraded":"2024-09-10T23:17:03.549589+0000","last_fullsized":"2024-09-10T23:17:03.549589+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:45.736836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549695+0000","last_change":"2024-09-10T23:17:02.183073+0000","last_active":"2024-09-10T23:17:03.549695+0000","last_peered":"2024-09-10T23:17:03.549695+0000","last_clean":"2024-09-10T23:17:03.549695+0000","last_became_active":"2024-09-10T23:17:02.182721+0000","last_became_peered":"2024-09-10T23:17:02.182721+0000","last_unstale":"2024-09-10T23:17:03.549695+0000","last_undegraded":"2024-09-10T23:17:03.549695+0000","last_fullsized":"2024-09-10T23:17:03.549695+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:27.726484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550132+0000","last_change":"2024-09-10T23:17:01.191700+0000","last_active":"2024-09-10T23:17:03.550132+0000","last_peered":"2024-09-10T23:17:03.550132+0000","last_clean":"2024-09-10T23:17:03.550132+0000","last_became_active":"2024-09-10T23:17:01.191421+0000","last_became_peered":"2024-09-10T23:17:01.191421+0000","last_unstale":"2024-09-10T23:17:03.550132+0000","last_undegraded":"2024-09-10T23:17:03.550132+0000","last_fullsized":"2024-09-10T23:17:03.550132+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:50:35.854820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549012+0000","last_change":"2024-09-10T23:17:02.178917+0000","last_active":"2024-09-10T23:17:03.549012+0000","last_peered":"2024-09-10T23:17:03.549012+0000","last_clean":"2024-09-10T23:17:03.549012+0000","last_became_active":"2024-09-10T23:17:02.178634+0000","last_became_peered":"2024-09-10T23:17:02.178634+0000","last_unstale":"2024-09-10T23:17:03.549012+0000","last_undegraded":"2024-09-10T23:17:03.549012+0000","last_fullsized":"2024-09-10T23:17:03.549012+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:50.039706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172146+0000","last_change":"2024-09-10T23:17:01.186635+0000","last_active":"2024-09-10T23:17:03.172146+0000","last_peered":"2024-09-10T23:17:03.172146+0000","last_clean":"2024-09-10T23:17:03.172146+0000","last_became_active":"2024-09-10T23:17:01.186371+0000","last_became_peered":"2024-09-10T23:17:01.186371+0000","last_unstale":"2024-09-10T23:17:03.172146+0000","last_undegraded":"2024-09-10T23:17:03.172146+0000","last_fullsized":"2024-09-10T23:17:03.172146+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:34.616208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549131+0000","last_change":"2024-09-10T23:17:02.177862+0000","last_active":"2024-09-10T23:17:03.549131+0000","last_peered":"2024-09-10T23:17:03.549131+0000","last_clean":"2024-09-10T23:17:03.549131+0000","last_became_active":"2024-09-10T23:17:02.177542+0000","last_became_peered":"2024-09-10T23:17:02.177542+0000","last_unstale":"2024-09-10T23:17:03.549131+0000","last_undegraded":"2024-09-10T23:17:03.549131+0000","last_fullsized":"2024-09-10T23:17:03.549131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:59:55.123710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189732+0000","last_change":"2024-09-10T23:17:01.187869+0000","last_active":"2024-09-10T23:17:03.189732+0000","last_peered":"2024-09-10T23:17:03.189732+0000","last_clean":"2024-09-10T23:17:03.189732+0000","last_became_active":"2024-09-10T23:17:01.187625+0000","last_became_peered":"2024-09-10T23:17:01.187625+0000","last_unstale":"2024-09-10T23:17:03.189732+0000","last_undegraded":"2024-09-10T23:17:03.189732+0000","last_fullsized":"2024-09-10T23:17:03.189732+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:55.975680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189964+0000","last_change":"2024-09-10T23:17:02.185910+0000","last_active":"2024-09-10T23:17:03.189964+0000","last_peered":"2024-09-10T23:17:03.189964+0000","last_clean":"2024-09-10T23:17:03.189964+0000","last_became_active":"2024-09-10T23:17:02.185560+0000","last_became_peered":"2024-09-10T23:17:02.185560+0000","last_unstale":"2024-09-10T23:17:03.189964+0000","last_undegraded":"2024-09-10T23:17:03.189964+0000","last_fullsized":"2024-09-10T23:17:03.189964+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:06.496984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550253+0000","last_change":"2024-09-10T23:17:01.196436+0000","last_active":"2024-09-10T23:17:03.550253+0000","last_peered":"2024-09-10T23:17:03.550253+0000","last_clean":"2024-09-10T23:17:03.550253+0000","last_became_active":"2024-09-10T23:17:01.196165+0000","last_became_peered":"2024-09-10T23:17:01.196165+0000","last_unstale":"2024-09-10T23:17:03.550253+0000","last_undegraded":"2024-09-10T23:17:03.550253+0000","last_fullsized":"2024-09-10T23:17:03.550253+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:00.574165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.171795+0000","last_change":"2024-09-10T23:17:02.171489+0000","last_active":"2024-09-10T23:17:03.171795+0000","last_peered":"2024-09-10T23:17:03.171795+0000","last_clean":"2024-09-10T23:17:03.171795+0000","last_became_active":"2024-09-10T23:17:02.171190+0000","last_became_peered":"2024-09-10T23:17:02.171190+0000","last_unstale":"2024-09-10T23:17:03.171795+0000","last_undegraded":"2024-09-10T23:17:03.171795+0000","last_fullsized":"2024-09-10T23:17:03.171795+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:25.805323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"68'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.172352+0000","last_change":"2024-09-10T23:17:01.188362+0000","last_active":"2024-09-10T23:17:03.172352+0000","last_peered":"2024-09-10T23:17:03.172352+0000","last_clean":"2024-09-10T23:17:03.172352+0000","last_became_active":"2024-09-10T23:17:01.187781+0000","last_became_peered":"2024-09-10T23:17:01.187781+0000","last_unstale":"2024-09-10T23:17:03.172352+0000","last_undegraded":"2024-09-10T23:17:03.172352+0000","last_fullsized":"2024-09-10T23:17:03.172352+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:30.857436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549640+0000","last_change":"2024-09-10T23:17:02.187405+0000","last_active":"2024-09-10T23:17:03.549640+0000","last_peered":"2024-09-10T23:17:03.549640+0000","last_clean":"2024-09-10T23:17:03.549640+0000","last_became_active":"2024-09-10T23:17:02.187132+0000","last_became_peered":"2024-09-10T23:17:02.187132+0000","last_unstale":"2024-09-10T23:17:03.549640+0000","last_undegraded":"2024-09-10T23:17:03.549640+0000","last_fullsized":"2024-09-10T23:17:03.549640+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:16.787970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168311+0000","last_change":"2024-09-10T23:17:01.192268+0000","last_active":"2024-09-10T23:17:03.168311+0000","last_peered":"2024-09-10T23:17:03.168311+0000","last_clean":"2024-09-10T23:17:03.168311+0000","last_became_active":"2024-09-10T23:17:01.192010+0000","last_became_peered":"2024-09-10T23:17:01.192010+0000","last_unstale":"2024-09-10T23:17:03.168311+0000","last_undegraded":"2024-09-10T23:17:03.168311+0000","last_fullsized":"2024-09-10T23:17:03.168311+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:08.700663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550124+0000","last_change":"2024-09-10T23:17:02.183034+0000","last_active":"2024-09-10T23:17:03.550124+0000","last_peered":"2024-09-10T23:17:03.550124+0000","last_clean":"2024-09-10T23:17:03.550124+0000","last_became_active":"2024-09-10T23:17:02.182752+0000","last_became_peered":"2024-09-10T23:17:02.182752+0000","last_unstale":"2024-09-10T23:17:03.550124+0000","last_undegraded":"2024-09-10T23:17:03.550124+0000","last_fullsized":"2024-09-10T23:17:03.550124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:40.334972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.189975+0000","last_change":"2024-09-10T23:17:01.186902+0000","last_active":"2024-09-10T23:17:03.189975+0000","last_peered":"2024-09-10T23:17:03.189975+0000","last_clean":"2024-09-10T23:17:03.189975+0000","last_became_active":"2024-09-10T23:17:01.186661+0000","last_became_peered":"2024-09-10T23:17:01.186661+0000","last_unstale":"2024-09-10T23:17:03.189975+0000","last_undegraded":"2024-09-10T23:17:03.189975+0000","last_fullsized":"2024-09-10T23:17:03.189975+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:27.761361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168134+0000","last_change":"2024-09-10T23:17:02.185506+0000","last_active":"2024-09-10T23:17:03.168134+0000","last_peered":"2024-09-10T23:17:03.168134+0000","last_clean":"2024-09-10T23:17:03.168134+0000","last_became_active":"2024-09-10T23:17:02.185257+0000","last_became_peered":"2024-09-10T23:17:02.185257+0000","last_unstale":"2024-09-10T23:17:03.168134+0000","last_undegraded":"2024-09-10T23:17:03.168134+0000","last_fullsized":"2024-09-10T23:17:03.168134+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:19.553228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.168007+0000","last_change":"2024-09-10T23:17:01.187404+0000","last_active":"2024-09-10T23:17:03.168007+0000","last_peered":"2024-09-10T23:17:03.168007+0000","last_clean":"2024-09-10T23:17:03.168007+0000","last_became_active":"2024-09-10T23:17:01.187153+0000","last_became_peered":"2024-09-10T23:17:01.187153+0000","last_unstale":"2024-09-10T23:17:03.168007+0000","last_undegraded":"2024-09-10T23:17:03.168007+0000","last_fullsized":"2024-09-10T23:17:03.168007+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:14.517439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550269+0000","last_change":"2024-09-10T23:17:02.181699+0000","last_active":"2024-09-10T23:17:03.550269+0000","last_peered":"2024-09-10T23:17:03.550269+0000","last_clean":"2024-09-10T23:17:03.550269+0000","last_became_active":"2024-09-10T23:17:02.181465+0000","last_became_peered":"2024-09-10T23:17:02.181465+0000","last_unstale":"2024-09-10T23:17:03.550269+0000","last_undegraded":"2024-09-10T23:17:03.550269+0000","last_fullsized":"2024-09-10T23:17:03.550269+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:48.525078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549000+0000","last_change":"2024-09-10T23:17:01.191410+0000","last_active":"2024-09-10T23:17:03.549000+0000","last_peered":"2024-09-10T23:17:03.549000+0000","last_clean":"2024-09-10T23:17:03.549000+0000","last_became_active":"2024-09-10T23:17:01.191164+0000","last_became_peered":"2024-09-10T23:17:01.191164+0000","last_unstale":"2024-09-10T23:17:03.549000+0000","last_undegraded":"2024-09-10T23:17:03.549000+0000","last_fullsized":"2024-09-10T23:17:03.549000+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:56.372150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.548932+0000","last_change":"2024-09-10T23:17:02.179163+0000","last_active":"2024-09-10T23:17:03.548932+0000","last_peered":"2024-09-10T23:17:03.548932+0000","last_clean":"2024-09-10T23:17:03.548932+0000","last_became_active":"2024-09-10T23:17:02.178770+0000","last_became_peered":"2024-09-10T23:17:02.178770+0000","last_unstale":"2024-09-10T23:17:03.548932+0000","last_undegraded":"2024-09-10T23:17:03.548932+0000","last_fullsized":"2024-09-10T23:17:03.548932+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:57.176877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.170926+0000","last_change":"2024-09-10T23:17:01.186831+0000","last_active":"2024-09-10T23:17:03.170926+0000","last_peered":"2024-09-10T23:17:03.170926+0000","last_clean":"2024-09-10T23:17:03.170926+0000","last_became_active":"2024-09-10T23:17:01.186481+0000","last_became_peered":"2024-09-10T23:17:01.186481+0000","last_unstale":"2024-09-10T23:17:03.170926+0000","last_undegraded":"2024-09-10T23:17:03.170926+0000","last_fullsized":"2024-09-10T23:17:03.170926+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:32.830295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549594+0000","last_change":"2024-09-10T23:17:02.183192+0000","last_active":"2024-09-10T23:17:03.549594+0000","last_peered":"2024-09-10T23:17:03.549594+0000","last_clean":"2024-09-10T23:17:03.549594+0000","last_became_active":"2024-09-10T23:17:02.182921+0000","last_became_peered":"2024-09-10T23:17:02.182921+0000","last_unstale":"2024-09-10T23:17:03.549594+0000","last_undegraded":"2024-09-10T23:17:03.549594+0000","last_fullsized":"2024-09-10T23:17:03.549594+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:33.832394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550845+0000","last_change":"2024-09-10T23:17:01.193565+0000","last_active":"2024-09-10T23:17:03.550845+0000","last_peered":"2024-09-10T23:17:03.550845+0000","last_clean":"2024-09-10T23:17:03.550845+0000","last_became_active":"2024-09-10T23:17:01.193276+0000","last_became_peered":"2024-09-10T23:17:01.193276+0000","last_unstale":"2024-09-10T23:17:03.550845+0000","last_undegraded":"2024-09-10T23:17:03.550845+0000","last_fullsized":"2024-09-10T23:17:03.550845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:47.035764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549630+0000","last_change":"2024-09-10T23:17:02.182964+0000","last_active":"2024-09-10T23:17:03.549630+0000","last_peered":"2024-09-10T23:17:03.549630+0000","last_clean":"2024-09-10T23:17:03.549630+0000","last_became_active":"2024-09-10T23:17:02.182646+0000","last_became_peered":"2024-09-10T23:17:02.182646+0000","last_unstale":"2024-09-10T23:17:03.549630+0000","last_undegraded":"2024-09-10T23:17:03.549630+0000","last_fullsized":"2024-09-10T23:17:03.549630+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:01.167633+0000","last_clean_scrub_stamp":"2024-09-10T23:17:01.167633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:59:21.362705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.550283+0000","last_change":"2024-09-10T23:17:01.196355+0000","last_active":"2024-09-10T23:17:03.550283+0000","last_peered":"2024-09-10T23:17:03.550283+0000","last_clean":"2024-09-10T23:17:03.550283+0000","last_became_active":"2024-09-10T23:17:01.196056+0000","last_became_peered":"2024-09-10T23:17:01.196056+0000","last_unstale":"2024-09-10T23:17:03.550283+0000","last_undegraded":"2024-09-10T23:17:03.550283+0000","last_fullsized":"2024-09-10T23:17:03.550283+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:00.165534+0000","last_clean_scrub_stamp":"2024-09-10T23:17:00.165534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:08.881426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":190,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T23:17:03.549116+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:17:03.549116+0000","last_peered":"2024-09-10T23:17:03.549116+0000","last_clean":"2024-09-10T23:17:03.549116+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:17:03.549116+0000","last_undegraded":"2024-09-10T23:17:03.549116+0000","last_fullsized":"2024-09-10T23:17:03.549116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509476,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28416,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343424,"statfs":{"total":96636764160,"available":96607666176,"internally_reserved":0,"allocated":1421312,"data_stored":930810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509475,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":827392,"data_stored":339918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509475,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":823296,"data_stored":339916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509475,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":823296,"data_stored":339896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":827392,"data_stored":339938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509476,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":831488,"data_stored":341438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":342054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1413120,"data_stored":930194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:17:09.828 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:17:09.828 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:17:09.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.971+0000 7f1f970cf640 1 -- 172.21.15.90:0/661329617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f900d16f0 msgr2=0x7f1f900d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:09.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.971+0000 7f1f970cf640 1 --2- 172.21.15.90:0/661329617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f900d16f0 0x7f1f900d0fc0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c009830 tx=0x7f1f7c02a480 comp rx=0 tx=0).stop 2024-09-10T23:17:09.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.971+0000 7f1f970cf640 1 -- 172.21.15.90:0/661329617 shutdown_connections 2024-09-10T23:17:09.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.971+0000 7f1f970cf640 1 --2- 172.21.15.90:0/661329617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f900d16f0 0x7f1f900d0fc0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:09.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.971+0000 7f1f970cf640 1 --2- 172.21.15.90:0/661329617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1f9015e310 0x7f1f900d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:09.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.971+0000 7f1f970cf640 1 -- 172.21.15.90:0/661329617 >> 172.21.15.90:0/661329617 conn(0x7f1f900d4090 msgr2=0x7f1f900d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:09.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.971+0000 7f1f970cf640 1 -- 172.21.15.90:0/661329617 shutdown_connections 2024-09-10T23:17:09.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.972+0000 7f1f970cf640 1 -- 172.21.15.90:0/661329617 wait complete. 2024-09-10T23:17:09.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.973+0000 7f1f970cf640 1 Processor -- start 2024-09-10T23:17:09.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.973+0000 7f1f970cf640 1 -- start start 2024-09-10T23:17:09.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.973+0000 7f1f970cf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f900d16f0 0x7f1f900b99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:09.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f970cf640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1f900d4b80 0x7f1f9015a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:09.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f970cf640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1f9015e310 0x7f1f900c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:09.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f970cf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9006de00 con 0x7f1f900d16f0 2024-09-10T23:17:09.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f970cf640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1f900d3ae0 con 0x7f1f9015e310 2024-09-10T23:17:09.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f970cf640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9006df80 con 0x7f1f900d4b80 2024-09-10T23:17:09.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f94e6b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f900d16f0 0x7f1f900b99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:09.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f94e6b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f900d16f0 0x7f1f900b99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52318/0 (socket says 172.21.15.90:52318) 2024-09-10T23:17:09.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f94e6b640 1 -- 172.21.15.90:0/2930055635 learned_addr learned my addr 172.21.15.90:0/2930055635 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:09.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f8ffff640 1 --2- 172.21.15.90:0/2930055635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1f900d4b80 0x7f1f9015a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:09.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f9566c640 1 --2- 172.21.15.90:0/2930055635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1f9015e310 0x7f1f900c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:09.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f94e6b640 1 -- 172.21.15.90:0/2930055635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1f900d4b80 msgr2=0x7f1f9015a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:09.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f94e6b640 1 --2- 172.21.15.90:0/2930055635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1f900d4b80 0x7f1f9015a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:09.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f94e6b640 1 -- 172.21.15.90:0/2930055635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1f9015e310 msgr2=0x7f1f900c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:09.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f94e6b640 1 --2- 172.21.15.90:0/2930055635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1f9015e310 0x7f1f900c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:09.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f94e6b640 1 -- 172.21.15.90:0/2930055635 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f900c7bb0 con 0x7f1f900d16f0 2024-09-10T23:17:09.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f94e6b640 1 --2- 172.21.15.90:0/2930055635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f900d16f0 0x7f1f900b99f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400d750 tx=0x7f1f8400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:09.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f8d7fa640 1 -- 172.21.15.90:0/2930055635 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84017070 con 0x7f1f900d16f0 2024-09-10T23:17:09.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f8d7fa640 1 -- 172.21.15.90:0/2930055635 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f84004310 con 0x7f1f900d16f0 2024-09-10T23:17:09.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f8d7fa640 1 -- 172.21.15.90:0/2930055635 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8400de60 con 0x7f1f900d16f0 2024-09-10T23:17:09.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f970cf640 1 -- 172.21.15.90:0/2930055635 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f900c8330 con 0x7f1f900d16f0 2024-09-10T23:17:09.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.974+0000 7f1f970cf640 1 -- 172.21.15.90:0/2930055635 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f901f57f0 con 0x7f1f900d16f0 2024-09-10T23:17:09.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.975+0000 7f1f970cf640 1 -- 172.21.15.90:0/2930055635 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f9015e6f0 con 0x7f1f900d16f0 2024-09-10T23:17:09.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.976+0000 7f1f8d7fa640 1 -- 172.21.15.90:0/2930055635 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1f84009c30 con 0x7f1f900d16f0 2024-09-10T23:17:09.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.976+0000 7f1f8d7fa640 1 --2- 172.21.15.90:0/2930055635 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1f74077fa0 0x7f1f7407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:09.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.976+0000 7f1f8d7fa640 1 -- 172.21.15.90:0/2930055635 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f1f8409a0b0 con 0x7f1f900d16f0 2024-09-10T23:17:09.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.976+0000 7f1f8ffff640 1 --2- 172.21.15.90:0/2930055635 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1f74077fa0 0x7f1f7407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:09.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.977+0000 7f1f8ffff640 1 --2- 172.21.15.90:0/2930055635 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1f74077fa0 0x7f1f7407a460 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c034000 tx=0x7f1f7c004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:09.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:09.980+0000 7f1f8d7fa640 1 -- 172.21.15.90:0/2930055635 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1f84020020 con 0x7f1f900d16f0 2024-09-10T23:17:10.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.227+0000 7f1f970cf640 1 -- 172.21.15.90:0/2930055635 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f1f900b2060 con 0x7f1f900d16f0 2024-09-10T23:17:10.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.229+0000 7f1f8d7fa640 1 -- 172.21.15.90:0/2930055635 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v28) ==== 190+0+147 (secure 0 0 0) 0x7f1f84069030 con 0x7f1f900d16f0 2024-09-10T23:17:10.230 INFO:teuthology.orchestra.run.smithi090.stdout:[client.0] 2024-09-10T23:17:10.230 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCX0uBmiYBwBhAABMV9erpQ+KZlTmf0kDZ0gw== 2024-09-10T23:17:10.230 INFO:teuthology.orchestra.run.smithi090.stdout: caps mds = "allow" 2024-09-10T23:17:10.230 INFO:teuthology.orchestra.run.smithi090.stdout: caps mon = "allow r" 2024-09-10T23:17:10.230 INFO:teuthology.orchestra.run.smithi090.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:17:10.230 INFO:teuthology.orchestra.run.smithi090.stderr:updated caps for client.0 2024-09-10T23:17:10.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.231+0000 7f1f970cf640 1 -- 172.21.15.90:0/2930055635 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1f74077fa0 msgr2=0x7f1f7407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:10.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.231+0000 7f1f970cf640 1 --2- 172.21.15.90:0/2930055635 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1f74077fa0 0x7f1f7407a460 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c034000 tx=0x7f1f7c004730 comp rx=0 tx=0).stop 2024-09-10T23:17:10.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.231+0000 7f1f970cf640 1 -- 172.21.15.90:0/2930055635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f900d16f0 msgr2=0x7f1f900b99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:10.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.231+0000 7f1f970cf640 1 --2- 172.21.15.90:0/2930055635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f900d16f0 0x7f1f900b99f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400d750 tx=0x7f1f8400dc10 comp rx=0 tx=0).stop 2024-09-10T23:17:10.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.231+0000 7f1f970cf640 1 -- 172.21.15.90:0/2930055635 shutdown_connections 2024-09-10T23:17:10.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.231+0000 7f1f970cf640 1 --2- 172.21.15.90:0/2930055635 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1f74077fa0 0x7f1f7407a460 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:10.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.231+0000 7f1f970cf640 1 --2- 172.21.15.90:0/2930055635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1f9015e310 0x7f1f900c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:10.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.231+0000 7f1f970cf640 1 --2- 172.21.15.90:0/2930055635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1f900d4b80 0x7f1f9015a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:10.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.231+0000 7f1f970cf640 1 --2- 172.21.15.90:0/2930055635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f900d16f0 0x7f1f900b99f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:10.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.231+0000 7f1f970cf640 1 -- 172.21.15.90:0/2930055635 >> 172.21.15.90:0/2930055635 conn(0x7f1f900d4090 msgr2=0x7f1f900b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:10.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.231+0000 7f1f970cf640 1 -- 172.21.15.90:0/2930055635 shutdown_connections 2024-09-10T23:17:10.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.231+0000 7f1f970cf640 1 -- 172.21.15.90:0/2930055635 wait complete. 2024-09-10T23:17:10.243 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:17:10.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.343+0000 7f76cf994640 1 -- 172.21.15.90:0/1844696769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b4004d40 msgr2=0x7f76b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:10.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.343+0000 7f76cf994640 1 --2- 172.21.15.90:0/1844696769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b4004d40 0x7f76b40051c0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f76c0009ed0 tx=0x7f76b4005830 comp rx=0 tx=0).stop 2024-09-10T23:17:10.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.343+0000 7f76cdf31640 1 -- 172.21.15.90:0/1844696769 reap_dead start 2024-09-10T23:17:10.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.343+0000 7f76cf994640 1 -- 172.21.15.90:0/1844696769 shutdown_connections 2024-09-10T23:17:10.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.343+0000 7f76cf994640 1 -- 172.21.15.90:0/1844696769 >> 172.21.15.90:0/1844696769 conn(0x7f76c80b19c0 msgr2=0x7f76c80b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:10.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.343+0000 7f76cf994640 1 -- 172.21.15.90:0/1844696769 shutdown_connections 2024-09-10T23:17:10.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.343+0000 7f76cf994640 1 -- 172.21.15.90:0/1844696769 wait complete. 2024-09-10T23:17:10.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.345+0000 7f76cf994640 1 Processor -- start 2024-09-10T23:17:10.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.345+0000 7f76cf994640 1 -- start start 2024-09-10T23:17:10.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.345+0000 7f76cf994640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b4004d40 0x7f76c81573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:10.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.345+0000 7f76cf994640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76c8152800 0x7f76c809b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:10.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.345+0000 7f76cf994640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76c814a300 0x7f76c81f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:10.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.345+0000 7f76cf994640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f76c806e870 con 0x7f76b4004d40 2024-09-10T23:17:10.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.345+0000 7f76cf994640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f76c806e6f0 con 0x7f76c8152800 2024-09-10T23:17:10.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.345+0000 7f76cf994640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f76c80ceba0 con 0x7f76c814a300 2024-09-10T23:17:10.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.345+0000 7f76cd730640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b4004d40 0x7f76c81573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:10.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.345+0000 7f76cd730640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b4004d40 0x7f76c81573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52328/0 (socket says 172.21.15.90:52328) 2024-09-10T23:17:10.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.345+0000 7f76cd730640 1 -- 172.21.15.90:0/3203564402 learned_addr learned my addr 172.21.15.90:0/3203564402 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:10.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.346+0000 7f76cd730640 1 -- 172.21.15.90:0/3203564402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76c814a300 msgr2=0x7f76c81f5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:10.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.346+0000 7f76cdf31640 1 --2- 172.21.15.90:0/3203564402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76c814a300 0x7f76c81f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:10.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.346+0000 7f76ccf2f640 1 --2- 172.21.15.90:0/3203564402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76c8152800 0x7f76c809b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:10.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.346+0000 7f76cd730640 1 --2- 172.21.15.90:0/3203564402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76c814a300 0x7f76c81f5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:10.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.346+0000 7f76cd730640 1 -- 172.21.15.90:0/3203564402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76c8152800 msgr2=0x7f76c809b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:10.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.346+0000 7f76cd730640 1 --2- 172.21.15.90:0/3203564402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76c8152800 0x7f76c809b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:10.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.346+0000 7f76cd730640 1 -- 172.21.15.90:0/3203564402 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c809d0d0 con 0x7f76b4004d40 2024-09-10T23:17:10.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.346+0000 7f76ccf2f640 1 --2- 172.21.15.90:0/3203564402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76c8152800 0x7f76c809b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:10.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.346+0000 7f76cdf31640 1 --2- 172.21.15.90:0/3203564402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76c814a300 0x7f76c81f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:10.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.346+0000 7f76cd730640 1 --2- 172.21.15.90:0/3203564402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b4004d40 0x7f76c81573f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f76c400fa30 tx=0x7f76c400fef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:10.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.346+0000 7f76bdffb640 1 -- 172.21.15.90:0/3203564402 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c400bd70 con 0x7f76b4004d40 2024-09-10T23:17:10.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.346+0000 7f76bdffb640 1 -- 172.21.15.90:0/3203564402 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76c4004030 con 0x7f76b4004d40 2024-09-10T23:17:10.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.346+0000 7f76cf994640 1 -- 172.21.15.90:0/3203564402 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c809d350 con 0x7f76b4004d40 2024-09-10T23:17:10.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.346+0000 7f76bdffb640 1 -- 172.21.15.90:0/3203564402 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4004420 con 0x7f76b4004d40 2024-09-10T23:17:10.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.346+0000 7f76cf994640 1 -- 172.21.15.90:0/3203564402 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c8150a20 con 0x7f76b4004d40 2024-09-10T23:17:10.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.347+0000 7f76cf994640 1 -- 172.21.15.90:0/3203564402 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c80b4880 con 0x7f76b4004d40 2024-09-10T23:17:10.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.348+0000 7f76bdffb640 1 -- 172.21.15.90:0/3203564402 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f76c40035f0 con 0x7f76b4004d40 2024-09-10T23:17:10.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.348+0000 7f76bdffb640 1 --2- 172.21.15.90:0/3203564402 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f76ac077f70 0x7f76ac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:10.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.349+0000 7f76bdffb640 1 -- 172.21.15.90:0/3203564402 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f76c409a760 con 0x7f76b4004d40 2024-09-10T23:17:10.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.349+0000 7f76ccf2f640 1 --2- 172.21.15.90:0/3203564402 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f76ac077f70 0x7f76ac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:10.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.349+0000 7f76ccf2f640 1 --2- 172.21.15.90:0/3203564402 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f76ac077f70 0x7f76ac07a430 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f76c8159470 tx=0x7f76b8000f30 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:10.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.353+0000 7f76bdffb640 1 -- 172.21.15.90:0/3203564402 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f76c809d0d0 con 0x7f76b4004d40 2024-09-10T23:17:10.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.563+0000 7f76cf994640 1 -- 172.21.15.90:0/3203564402 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76c80cc480 con 0x7f76b4004d40 2024-09-10T23:17:10.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.564+0000 7f76bdffb640 1 -- 172.21.15.90:0/3203564402 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5225 (secure 0 0 0) 0x7f76c4062ca0 con 0x7f76b4004d40 2024-09-10T23:17:10.565 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:10.565 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"btime":"2024-09-10T23:17:04:184091+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5554,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/946078081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":946078081},{"type":"v1","addr":"172.21.15.171:6836","nonce":946078081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1081121108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1081121108},{"type":"v1","addr":"172.21.15.171:6837","nonce":1081121108}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6003,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/2444726710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2444726710},{"type":"v1","addr":"172.21.15.90:6834","nonce":2444726710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:01.524854+0000","modified":"2024-09-10T23:17:03.520058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/696526367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":696526367},{"type":"v1","addr":"172.21.15.90:6835","nonce":696526367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6006,"qdb_cluster":[6006]},"id":5}]} 2024-09-10T23:17:10.565 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 38 2024-09-10T23:17:10.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.566+0000 7f76cf994640 1 -- 172.21.15.90:0/3203564402 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f76ac077f70 msgr2=0x7f76ac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:10.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.566+0000 7f76cf994640 1 --2- 172.21.15.90:0/3203564402 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f76ac077f70 0x7f76ac07a430 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f76c8159470 tx=0x7f76b8000f30 comp rx=0 tx=0).stop 2024-09-10T23:17:10.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.566+0000 7f76cf994640 1 -- 172.21.15.90:0/3203564402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b4004d40 msgr2=0x7f76c81573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:10.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.566+0000 7f76cf994640 1 --2- 172.21.15.90:0/3203564402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b4004d40 0x7f76c81573f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f76c400fa30 tx=0x7f76c400fef0 comp rx=0 tx=0).stop 2024-09-10T23:17:10.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.566+0000 7f76cf994640 1 -- 172.21.15.90:0/3203564402 shutdown_connections 2024-09-10T23:17:10.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.566+0000 7f76cf994640 1 --2- 172.21.15.90:0/3203564402 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f76ac077f70 0x7f76ac07a430 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:10.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.566+0000 7f76cf994640 1 --2- 172.21.15.90:0/3203564402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76c8152800 0x7f76c809b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:10.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.566+0000 7f76cf994640 1 --2- 172.21.15.90:0/3203564402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76c814a300 0x7f76c81f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:10.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.566+0000 7f76cf994640 1 --2- 172.21.15.90:0/3203564402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76b4004d40 0x7f76c81573f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:10.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.566+0000 7f76cf994640 1 -- 172.21.15.90:0/3203564402 >> 172.21.15.90:0/3203564402 conn(0x7f76c80b19c0 msgr2=0x7f76c8159a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:10.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.566+0000 7f76cf994640 1 -- 172.21.15.90:0/3203564402 shutdown_connections 2024-09-10T23:17:10.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:10.566+0000 7f76cf994640 1 -- 172.21.15.90:0/3203564402 wait complete. 2024-09-10T23:17:10.981 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:17:01.524854+0000', 'modified': '2024-09-10T23:17:03.520058+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6006}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6006': {'gid': 6006, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.90:6835/696526367', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6833', 'nonce': 696526367}, {'type': 'v1', 'addr': '172.21.15.90:6835', 'nonce': 696526367}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6006, 'qdb_cluster': [6006]} 2024-09-10T23:17:10.981 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:17:10.981 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T23:17:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.086+0000 7f398f423640 1 -- 172.21.15.90:0/1839548628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39880cd470 msgr2=0x7f39880ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.086+0000 7f398f423640 1 --2- 172.21.15.90:0/1839548628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39880cd470 0x7f39880ce2a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3980005fd0 tx=0x7f398002a8b0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.086+0000 7f398f423640 1 -- 172.21.15.90:0/1839548628 shutdown_connections 2024-09-10T23:17:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.086+0000 7f398f423640 1 --2- 172.21.15.90:0/1839548628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39880cd470 0x7f39880ce2a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.086+0000 7f398f423640 1 -- 172.21.15.90:0/1839548628 >> 172.21.15.90:0/1839548628 conn(0x7f39880b19c0 msgr2=0x7f39880b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.086+0000 7f398f423640 1 -- 172.21.15.90:0/1839548628 shutdown_connections 2024-09-10T23:17:11.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.086+0000 7f398f423640 1 -- 172.21.15.90:0/1839548628 wait complete. 2024-09-10T23:17:11.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.087+0000 7f398f423640 1 Processor -- start 2024-09-10T23:17:11.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.087+0000 7f398f423640 1 -- start start 2024-09-10T23:17:11.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f398f423640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39880b44a0 0x7f3988151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f398f423640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39880cd470 0x7f39880b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f398f423640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39880cf860 0x7f39880b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f398f423640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f398806e800 con 0x7f39880cd470 2024-09-10T23:17:11.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f398f423640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f398815aad0 con 0x7f39880b44a0 2024-09-10T23:17:11.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f398f423640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f39880ce7e0 con 0x7f39880cf860 2024-09-10T23:17:11.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f398c9be640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39880cd470 0x7f39880b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f398c9be640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39880cd470 0x7f39880b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52344/0 (socket says 172.21.15.90:52344) 2024-09-10T23:17:11.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f398c9be640 1 -- 172.21.15.90:0/375588054 learned_addr learned my addr 172.21.15.90:0/375588054 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:11.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f398d9c0640 1 --2- 172.21.15.90:0/375588054 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39880cf860 0x7f39880b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f398d1bf640 1 --2- 172.21.15.90:0/375588054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39880b44a0 0x7f3988151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f398c9be640 1 -- 172.21.15.90:0/375588054 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39880cf860 msgr2=0x7f39880b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:11.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f398c9be640 1 --2- 172.21.15.90:0/375588054 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39880cf860 0x7f39880b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f398c9be640 1 -- 172.21.15.90:0/375588054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39880b44a0 msgr2=0x7f3988151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:11.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f398c9be640 1 --2- 172.21.15.90:0/375588054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39880b44a0 0x7f3988151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f398c9be640 1 -- 172.21.15.90:0/375588054 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39881f8af0 con 0x7f39880cd470 2024-09-10T23:17:11.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f398c9be640 1 --2- 172.21.15.90:0/375588054 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39880cd470 0x7f39880b0a00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f397800c3a0 tx=0x7f397800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:11.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f397dffb640 1 -- 172.21.15.90:0/375588054 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3978011790 con 0x7f39880cd470 2024-09-10T23:17:11.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.088+0000 7f397dffb640 1 -- 172.21.15.90:0/375588054 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3978017070 con 0x7f39880cd470 2024-09-10T23:17:11.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.089+0000 7f398f423640 1 -- 172.21.15.90:0/375588054 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39881f8dd0 con 0x7f39880cd470 2024-09-10T23:17:11.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.089+0000 7f397dffb640 1 -- 172.21.15.90:0/375588054 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3978011cc0 con 0x7f39880cd470 2024-09-10T23:17:11.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.089+0000 7f398f423640 1 -- 172.21.15.90:0/375588054 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39881f9390 con 0x7f39880cd470 2024-09-10T23:17:11.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.090+0000 7f397dffb640 1 -- 172.21.15.90:0/375588054 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f397801c460 con 0x7f39880cd470 2024-09-10T23:17:11.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.091+0000 7f397dffb640 1 --2- 172.21.15.90:0/375588054 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f396c077f70 0x7f396c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.091+0000 7f397dffb640 1 -- 172.21.15.90:0/375588054 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f3978099ba0 con 0x7f39880cd470 2024-09-10T23:17:11.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.091+0000 7f398d1bf640 1 --2- 172.21.15.90:0/375588054 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f396c077f70 0x7f396c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.092+0000 7f39921f1740 1 Processor -- start 2024-09-10T23:17:11.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.092+0000 7f39921f1740 1 -- start start 2024-09-10T23:17:11.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.092+0000 7f398d1bf640 1 --2- 172.21.15.90:0/375588054 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f396c077f70 0x7f396c07a430 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3984004ea0 tx=0x7f3984009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:11.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.092+0000 7f39921f1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1811b0 0x557a3f158b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.092+0000 7f39921f1740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f1a0df0 0x557a3f1a11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.092+0000 7f39921f1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1565f0 0x557a3f156a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.092+0000 7f39921f1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557a3f0cd820 con 0x557a3f1811b0 2024-09-10T23:17:11.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.092+0000 7f39921f1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x557a3f0bcc50 con 0x557a3f1565f0 2024-09-10T23:17:11.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.092+0000 7f39921f1740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x557a3f0c0a60 con 0x557a3f1a0df0 2024-09-10T23:17:11.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.092+0000 7f398d1bf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1811b0 0x557a3f158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.093+0000 7f398d1bf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1811b0 0x557a3f158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52358/0 (socket says 172.21.15.90:52358) 2024-09-10T23:17:11.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.093+0000 7f398d1bf640 1 -- 172.21.15.90:0/613342743 learned_addr learned my addr 172.21.15.90:0/613342743 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:11.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.093+0000 7f398c9be640 1 --2- 172.21.15.90:0/613342743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f1a0df0 0x557a3f1a11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.093+0000 7f398d9c0640 1 --2- 172.21.15.90:0/613342743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1565f0 0x557a3f156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.093+0000 7f398d1bf640 1 -- 172.21.15.90:0/613342743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f1a0df0 msgr2=0x557a3f1a11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:11.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.093+0000 7f398d1bf640 1 --2- 172.21.15.90:0/613342743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f1a0df0 0x557a3f1a11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.093+0000 7f398d1bf640 1 -- 172.21.15.90:0/613342743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1565f0 msgr2=0x557a3f156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:11.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.093+0000 7f398d1bf640 1 --2- 172.21.15.90:0/613342743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1565f0 0x557a3f156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.093+0000 7f398d1bf640 1 -- 172.21.15.90:0/613342743 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a3ee1e850 con 0x557a3f1811b0 2024-09-10T23:17:11.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.093+0000 7f398c9be640 1 --2- 172.21.15.90:0/613342743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f1a0df0 0x557a3f1a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:11.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.093+0000 7f398d1bf640 1 --2- 172.21.15.90:0/613342743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1811b0 0x557a3f158b20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f398400e7e0 tx=0x7f3984011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcff8472e2a6f7e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:11.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.093+0000 7f3972ffd640 1 -- 172.21.15.90:0/613342743 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3984025070 con 0x557a3f1811b0 2024-09-10T23:17:11.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.093+0000 7f3972ffd640 1 -- 172.21.15.90:0/613342743 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39840159b0 con 0x557a3f1811b0 2024-09-10T23:17:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.093+0000 7f3972ffd640 1 -- 172.21.15.90:0/613342743 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3984015da0 con 0x557a3f1811b0 2024-09-10T23:17:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.094+0000 7f39921f1740 1 -- 172.21.15.90:0/613342743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1811b0 msgr2=0x557a3f158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.094+0000 7f39921f1740 1 --2- 172.21.15.90:0/613342743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1811b0 0x557a3f158b20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f398400e7e0 tx=0x7f3984011000 comp rx=0 tx=0).stop 2024-09-10T23:17:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.094+0000 7f39921f1740 1 -- 172.21.15.90:0/613342743 shutdown_connections 2024-09-10T23:17:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.094+0000 7f39921f1740 1 --2- 172.21.15.90:0/613342743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1565f0 0x557a3f156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.094+0000 7f39921f1740 1 --2- 172.21.15.90:0/613342743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f1a0df0 0x557a3f1a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.094+0000 7f39921f1740 1 --2- 172.21.15.90:0/613342743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1811b0 0x557a3f158b20 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.094+0000 7f39921f1740 1 -- 172.21.15.90:0/613342743 >> 172.21.15.90:0/613342743 conn(0x557a3f1576a0 msgr2=0x557a3f15b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.094+0000 7f39921f1740 1 -- 172.21.15.90:0/613342743 shutdown_connections 2024-09-10T23:17:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.094+0000 7f39921f1740 1 -- 172.21.15.90:0/613342743 wait complete. 2024-09-10T23:17:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.094+0000 7f39921f1740 1 -- start start 2024-09-10T23:17:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.094+0000 7f39921f1740 1 Processor -- start 2024-09-10T23:17:11.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.095+0000 7f39921f1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1811b0 0x557a3f1962d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.095+0000 7f39921f1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1a0df0 0x557a3f17a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.095+0000 7f39921f1740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f199850 0x557a3f184030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.095+0000 7f39921f1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557a3ee2d620 con 0x557a3f1a0df0 2024-09-10T23:17:11.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.095+0000 7f39921f1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x557a3f0625f0 con 0x557a3f1811b0 2024-09-10T23:17:11.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.095+0000 7f39921f1740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x557a3f155b30 con 0x557a3f199850 2024-09-10T23:17:11.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.095+0000 7f39921f1740 10 client.0 _ll_register_callbacks cb 0x557a3f0660a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:17:11.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.095+0000 7f398c9be640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1a0df0 0x557a3f17a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.095+0000 7f398c9be640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1a0df0 0x557a3f17a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52362/0 (socket says 172.21.15.90:52362) 2024-09-10T23:17:11.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.095+0000 7f398c9be640 1 -- 172.21.15.90:0/873743515 learned_addr learned my addr 172.21.15.90:0/873743515 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:11.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f398d9c0640 1 --2- 172.21.15.90:0/873743515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f199850 0x557a3f184030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f398d1bf640 1 --2- 172.21.15.90:0/873743515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1811b0 0x557a3f1962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f398c9be640 1 -- 172.21.15.90:0/873743515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f199850 msgr2=0x557a3f184030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:11.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f398c9be640 1 --2- 172.21.15.90:0/873743515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f199850 0x557a3f184030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f398c9be640 1 -- 172.21.15.90:0/873743515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1811b0 msgr2=0x557a3f1962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:11.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f398c9be640 1 --2- 172.21.15.90:0/873743515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1811b0 0x557a3f1962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f398c9be640 1 -- 172.21.15.90:0/873743515 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a3ee956b0 con 0x557a3f1a0df0 2024-09-10T23:17:11.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f398c9be640 1 --2- 172.21.15.90:0/873743515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1a0df0 0x557a3f17a3f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3978062630 tx=0x7f3978061af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccd86119f077a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:11.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f3967fff640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:17:11.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f3967fff640 1 -- 172.21.15.90:0/873743515 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397806b380 con 0x557a3f1a0df0 2024-09-10T23:17:11.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f3967fff640 1 -- 172.21.15.90:0/873743515 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f39780610e0 con 0x557a3f1a0df0 2024-09-10T23:17:11.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f39921f1740 1 -- 172.21.15.90:0/873743515 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39840159b0 con 0x557a3f1a0df0 2024-09-10T23:17:11.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f3967fff640 1 -- 172.21.15.90:0/873743515 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f39780612e0 con 0x557a3f1a0df0 2024-09-10T23:17:11.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f39921f1740 10 client.6171 fetch_fsmap learned FSMap version 38 2024-09-10T23:17:11.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f39921f1740 1 -- 172.21.15.90:0/873743515 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x557a3f17a930 con 0x557a3f1a0df0 2024-09-10T23:17:11.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f3967fff640 1 -- 172.21.15.90:0/873743515 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39840159b0 con 0x557a3f1a0df0 2024-09-10T23:17:11.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f3967fff640 1 -- 172.21.15.90:0/873743515 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 38) ==== 3502+0+0 (secure 0 0 0) 0x7f3978067af0 con 0x557a3f1a0df0 2024-09-10T23:17:11.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f39921f1740 10 client.6171 fetch_fsmap finished waiting for FSMap version 38 2024-09-10T23:17:11.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f39921f1740 10 client.6171 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:17:11.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.096+0000 7f39921f1740 20 client.6171 populate_metadata read hostname 'smithi090' 2024-09-10T23:17:11.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.097+0000 7f39921f1740 1 --2- 172.21.15.90:0/873743515 >> [v2:172.21.15.90:6833/696526367,v1:172.21.15.90:6835/696526367] conn(0x557a3f1831b0 0x557a3f183590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.097+0000 7f39921f1740 4 client.6171 mds_command: new command op to 6006 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:17:11.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.097+0000 7f39921f1740 1 -- 172.21.15.90:0/873743515 --> [v2:172.21.15.90:6833/696526367,v1:172.21.15.90:6835/696526367] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a3f0cf770 con 0x557a3f1831b0 2024-09-10T23:17:11.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.097+0000 7f398d1bf640 1 --2- 172.21.15.90:0/873743515 >> [v2:172.21.15.90:6833/696526367,v1:172.21.15.90:6835/696526367] conn(0x557a3f1831b0 0x557a3f183590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.097+0000 7f3967fff640 10 client.6171 ms_handle_connect on v2:172.21.15.90:6833/696526367 2024-09-10T23:17:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.097+0000 7f398d1bf640 1 --2- 172.21.15.90:0/873743515 >> [v2:172.21.15.90:6833/696526367,v1:172.21.15.90:6835/696526367] conn(0x557a3f1831b0 0x557a3f183590 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7b88decebfd0d55 server_cookie=ffba94d5e61c604f in_seq=0 out_seq=0 2024-09-10T23:17:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.097+0000 7f3967fff640 1 -- 172.21.15.90:0/873743515 <== mds.0 v2:172.21.15.90:6833/696526367 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557a3f0cf770 con 0x557a3f1831b0 2024-09-10T23:17:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.097+0000 7f3967fff640 10 client.6171 handle_command_reply: tid=0 2024-09-10T23:17:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.098+0000 7f39921f1740 1 client.6171 shutdown 2024-09-10T23:17:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.098+0000 7f39921f1740 1 -- 172.21.15.90:0/873743515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1a0df0 msgr2=0x557a3f17a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.098+0000 7f39921f1740 1 --2- 172.21.15.90:0/873743515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1a0df0 0x557a3f17a3f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3978062630 tx=0x7f3978061af0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.098+0000 7f39921f1740 1 -- 172.21.15.90:0/873743515 shutdown_connections 2024-09-10T23:17:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.098+0000 7f39921f1740 1 --2- 172.21.15.90:0/873743515 >> [v2:172.21.15.90:6833/696526367,v1:172.21.15.90:6835/696526367] conn(0x557a3f1831b0 0x557a3f183590 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.098+0000 7f39921f1740 1 --2- 172.21.15.90:0/873743515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f199850 0x557a3f184030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.098+0000 7f39921f1740 1 --2- 172.21.15.90:0/873743515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1a0df0 0x557a3f17a3f0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.098+0000 7f3967fff640 0 client.6171 ms_handle_reset on v2:172.21.15.90:6833/696526367 2024-09-10T23:17:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.098+0000 7f39921f1740 1 --2- 172.21.15.90:0/873743515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1811b0 0x557a3f1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.098+0000 7f39921f1740 1 -- 172.21.15.90:0/873743515 >> 172.21.15.90:0/873743515 conn(0x557a3f1565f0 msgr2=0x557a3f181590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:11.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.098+0000 7f39921f1740 1 -- 172.21.15.90:0/873743515 shutdown_connections 2024-09-10T23:17:11.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.098+0000 7f39921f1740 1 -- 172.21.15.90:0/873743515 wait complete. 2024-09-10T23:17:11.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.098+0000 7f39921f1740 20 client.6171 trim_cache size 0 max 16384 2024-09-10T23:17:11.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.116+0000 7f39921f1740 1 Processor -- start 2024-09-10T23:17:11.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.116+0000 7f39921f1740 1 -- start start 2024-09-10T23:17:11.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f39921f1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1811b0 0x557a3f1a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f39921f1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f199850 0x557a3f195de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f39921f1740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f1a0df0 0x557a3f196320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f39921f1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3988200410 con 0x557a3f199850 2024-09-10T23:17:11.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f39921f1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f398815c870 con 0x557a3f1811b0 2024-09-10T23:17:11.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f39921f1740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f39881ffdf0 con 0x557a3f1a0df0 2024-09-10T23:17:11.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f398c9be640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f199850 0x557a3f195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f398c9be640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f199850 0x557a3f195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52368/0 (socket says 172.21.15.90:52368) 2024-09-10T23:17:11.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f398c9be640 1 -- 172.21.15.90:0/3508481292 learned_addr learned my addr 172.21.15.90:0/3508481292 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:11.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f398c9be640 1 -- 172.21.15.90:0/3508481292 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f1a0df0 msgr2=0x557a3f196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:11.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f398c9be640 1 --2- 172.21.15.90:0/3508481292 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f1a0df0 0x557a3f196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f398c9be640 1 -- 172.21.15.90:0/3508481292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1811b0 msgr2=0x557a3f1a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:11.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f398c9be640 1 --2- 172.21.15.90:0/3508481292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1811b0 0x557a3f1a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f398c9be640 1 -- 172.21.15.90:0/3508481292 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a3f1a2f80 con 0x557a3f199850 2024-09-10T23:17:11.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f398c9be640 1 --2- 172.21.15.90:0/3508481292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f199850 0x557a3f195de0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3978061dc0 tx=0x7f3978068fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e123fba87e31b148 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:11.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f39727fc640 1 -- 172.21.15.90:0/3508481292 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397806b380 con 0x557a3f199850 2024-09-10T23:17:11.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f39727fc640 1 -- 172.21.15.90:0/3508481292 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39780610e0 con 0x557a3f199850 2024-09-10T23:17:11.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.117+0000 7f39727fc640 1 -- 172.21.15.90:0/3508481292 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3978082360 con 0x557a3f199850 2024-09-10T23:17:11.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.118+0000 7f39921f1740 1 -- 172.21.15.90:0/3508481292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f199850 msgr2=0x557a3f195de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:11.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.118+0000 7f39921f1740 1 --2- 172.21.15.90:0/3508481292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f199850 0x557a3f195de0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3978061dc0 tx=0x7f3978068fb0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.118+0000 7f39921f1740 1 -- 172.21.15.90:0/3508481292 shutdown_connections 2024-09-10T23:17:11.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.118+0000 7f39921f1740 1 --2- 172.21.15.90:0/3508481292 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f1a0df0 0x557a3f196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.118+0000 7f39921f1740 1 --2- 172.21.15.90:0/3508481292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f199850 0x557a3f195de0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.118+0000 7f39921f1740 1 --2- 172.21.15.90:0/3508481292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1811b0 0x557a3f1a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.118+0000 7f39921f1740 1 -- 172.21.15.90:0/3508481292 >> 172.21.15.90:0/3508481292 conn(0x557a3f1565f0 msgr2=0x557a3f17c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:11.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.118+0000 7f39921f1740 1 -- 172.21.15.90:0/3508481292 shutdown_connections 2024-09-10T23:17:11.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.118+0000 7f39921f1740 1 -- 172.21.15.90:0/3508481292 wait complete. 2024-09-10T23:17:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.118+0000 7f39921f1740 1 -- start start 2024-09-10T23:17:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.119+0000 7f39921f1740 1 Processor -- start 2024-09-10T23:17:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.119+0000 7f39921f1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1811b0 0x557a3f195de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.119+0000 7f39921f1740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f199850 0x557a3f196320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.119+0000 7f39921f1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1a0df0 0x557a3f1b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.119+0000 7f39921f1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557a3f199e10 con 0x557a3f1811b0 2024-09-10T23:17:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.119+0000 7f39921f1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x557a3f17abb0 con 0x557a3f1a0df0 2024-09-10T23:17:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.119+0000 7f39921f1740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x557a3f17cd80 con 0x557a3f199850 2024-09-10T23:17:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.119+0000 7f39921f1740 10 client.0 _ll_register_callbacks cb 0x7f397805dd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:17:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.119+0000 7f398d1bf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1811b0 0x557a3f195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f398d1bf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1811b0 0x557a3f195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52378/0 (socket says 172.21.15.90:52378) 2024-09-10T23:17:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f398d1bf640 1 -- 172.21.15.90:0/1696706409 learned_addr learned my addr 172.21.15.90:0/1696706409 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f398c9be640 1 --2- 172.21.15.90:0/1696706409 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f199850 0x557a3f196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f398d9c0640 1 --2- 172.21.15.90:0/1696706409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1a0df0 0x557a3f1b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f398d1bf640 1 -- 172.21.15.90:0/1696706409 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f199850 msgr2=0x557a3f196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f398d1bf640 1 --2- 172.21.15.90:0/1696706409 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f199850 0x557a3f196320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f398d1bf640 1 -- 172.21.15.90:0/1696706409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1a0df0 msgr2=0x557a3f1b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f398d1bf640 1 --2- 172.21.15.90:0/1696706409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1a0df0 0x557a3f1b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f398d1bf640 1 -- 172.21.15.90:0/1696706409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a3f15a7d0 con 0x557a3f1811b0 2024-09-10T23:17:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f398d9c0640 1 --2- 172.21.15.90:0/1696706409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1a0df0 0x557a3f1b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f398d1bf640 1 --2- 172.21.15.90:0/1696706409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1811b0 0x557a3f195de0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3984005510 tx=0x7f3984015e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7b2e30ce42434f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f3967fff640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:17:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f3967fff640 1 -- 172.21.15.90:0/1696706409 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3984025040 con 0x557a3f1811b0 2024-09-10T23:17:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f3967fff640 1 -- 172.21.15.90:0/1696706409 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f3984003a00 con 0x557a3f1811b0 2024-09-10T23:17:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f39921f1740 1 -- 172.21.15.90:0/1696706409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39780610e0 con 0x557a3f1811b0 2024-09-10T23:17:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f3967fff640 1 -- 172.21.15.90:0/1696706409 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3984039050 con 0x557a3f1811b0 2024-09-10T23:17:11.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f39921f1740 10 client.6177 fetch_fsmap learned FSMap version 38 2024-09-10T23:17:11.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f39921f1740 1 -- 172.21.15.90:0/1696706409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x557a3f2211d0 con 0x557a3f1811b0 2024-09-10T23:17:11.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f3967fff640 1 -- 172.21.15.90:0/1696706409 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39780610e0 con 0x557a3f1811b0 2024-09-10T23:17:11.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f3967fff640 1 -- 172.21.15.90:0/1696706409 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 38) ==== 3502+0+0 (secure 0 0 0) 0x7f398403c020 con 0x557a3f1811b0 2024-09-10T23:17:11.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f39921f1740 10 client.6177 fetch_fsmap finished waiting for FSMap version 38 2024-09-10T23:17:11.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f39921f1740 10 client.6177 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:17:11.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f39921f1740 20 client.6177 populate_metadata read hostname 'smithi090' 2024-09-10T23:17:11.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.120+0000 7f39921f1740 1 --2- 172.21.15.90:0/1696706409 >> [v2:172.21.15.90:6833/696526367,v1:172.21.15.90:6835/696526367] conn(0x557a3f1b2920 0x557a3f21fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f39921f1740 4 client.6177 mds_command: new command op to 6006 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:17:11.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f39921f1740 1 -- 172.21.15.90:0/1696706409 --> [v2:172.21.15.90:6833/696526367,v1:172.21.15.90:6835/696526367] -- command(tid 0: {"prefix": "status"}) -- 0x557a3f0cb220 con 0x557a3f1b2920 2024-09-10T23:17:11.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f398c9be640 1 --2- 172.21.15.90:0/1696706409 >> [v2:172.21.15.90:6833/696526367,v1:172.21.15.90:6835/696526367] conn(0x557a3f1b2920 0x557a3f21fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f3967fff640 10 client.6177 ms_handle_connect on v2:172.21.15.90:6833/696526367 2024-09-10T23:17:11.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f398c9be640 1 --2- 172.21.15.90:0/1696706409 >> [v2:172.21.15.90:6833/696526367,v1:172.21.15.90:6835/696526367] conn(0x557a3f1b2920 0x557a3f21fd40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69286b8394b5129f server_cookie=5b4f0dc7d8e8b812 in_seq=0 out_seq=0 2024-09-10T23:17:11.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f3967fff640 1 -- 172.21.15.90:0/1696706409 <== mds.0 v2:172.21.15.90:6833/696526367 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x557a3f0cb220 con 0x557a3f1b2920 2024-09-10T23:17:11.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f3967fff640 10 client.6177 handle_command_reply: tid=0 2024-09-10T23:17:11.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f39921f1740 1 client.6177 shutdown 2024-09-10T23:17:11.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f39921f1740 1 -- 172.21.15.90:0/1696706409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1811b0 msgr2=0x557a3f195de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:11.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f39921f1740 1 --2- 172.21.15.90:0/1696706409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1811b0 0x557a3f195de0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3984005510 tx=0x7f3984015e50 comp rx=0 tx=0).stop 2024-09-10T23:17:11.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f39921f1740 1 -- 172.21.15.90:0/1696706409 shutdown_connections 2024-09-10T23:17:11.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f39921f1740 1 --2- 172.21.15.90:0/1696706409 >> [v2:172.21.15.90:6833/696526367,v1:172.21.15.90:6835/696526367] conn(0x557a3f1b2920 0x557a3f21fd40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f39921f1740 1 --2- 172.21.15.90:0/1696706409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a3f1a0df0 0x557a3f1b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f39921f1740 1 --2- 172.21.15.90:0/1696706409 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x557a3f199850 0x557a3f196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f3967fff640 0 client.6177 ms_handle_reset on v2:172.21.15.90:6833/696526367 2024-09-10T23:17:11.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f39921f1740 1 --2- 172.21.15.90:0/1696706409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557a3f1811b0 0x557a3f195de0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f39921f1740 1 -- 172.21.15.90:0/1696706409 >> 172.21.15.90:0/1696706409 conn(0x557a3f1565f0 msgr2=0x557a3f1978c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:11.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f39921f1740 1 -- 172.21.15.90:0/1696706409 shutdown_connections 2024-09-10T23:17:11.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f39921f1740 1 -- 172.21.15.90:0/1696706409 wait complete. 2024-09-10T23:17:11.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.121+0000 7f39921f1740 20 client.6177 trim_cache size 0 max 16384 2024-09-10T23:17:11.129 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:17:11.129 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd", 2024-09-10T23:17:11.129 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2024-09-10T23:17:11.129 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 6006, 2024-09-10T23:17:11.129 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-09-10T23:17:11.129 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-09-10T23:17:11.129 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2024-09-10T23:17:11.129 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 8.9441078360000006, 2024-09-10T23:17:11.130 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 38, 2024-09-10T23:17:11.130 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 68, 2024-09-10T23:17:11.130 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 68, 2024-09-10T23:17:11.130 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 12.697642269999999 2024-09-10T23:17:11.130 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:17:11.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.122+0000 7f398f423640 1 -- 172.21.15.90:0/375588054 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f396c077f70 msgr2=0x7f396c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:11.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.122+0000 7f398f423640 1 --2- 172.21.15.90:0/375588054 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f396c077f70 0x7f396c07a430 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3984004ea0 tx=0x7f3984009040 comp rx=0 tx=0).stop 2024-09-10T23:17:11.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.122+0000 7f398f423640 1 -- 172.21.15.90:0/375588054 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39880cd470 msgr2=0x7f39880b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:11.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.122+0000 7f398f423640 1 --2- 172.21.15.90:0/375588054 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39880cd470 0x7f39880b0a00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f397800c3a0 tx=0x7f397800c860 comp rx=0 tx=0).stop 2024-09-10T23:17:11.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.122+0000 7f398f423640 1 -- 172.21.15.90:0/375588054 shutdown_connections 2024-09-10T23:17:11.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.122+0000 7f398f423640 1 --2- 172.21.15.90:0/375588054 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f396c077f70 0x7f396c07a430 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.122+0000 7f398f423640 1 --2- 172.21.15.90:0/375588054 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39880cf860 0x7f39880b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.122+0000 7f398f423640 1 --2- 172.21.15.90:0/375588054 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39880cd470 0x7f39880b0a00 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.122+0000 7f398f423640 1 --2- 172.21.15.90:0/375588054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39880b44a0 0x7f3988151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.122+0000 7f398f423640 1 -- 172.21.15.90:0/375588054 >> 172.21.15.90:0/375588054 conn(0x7f39880b19c0 msgr2=0x7f39880afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:11.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.122+0000 7f398f423640 1 -- 172.21.15.90:0/375588054 shutdown_connections 2024-09-10T23:17:11.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.122+0000 7f398f423640 1 -- 172.21.15.90:0/375588054 wait complete. 2024-09-10T23:17:11.134 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:17:11.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.236+0000 7f6126d24640 1 -- 172.21.15.90:0/3099190634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61200cd740 msgr2=0x7f6120074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:11.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.236+0000 7f6126d24640 1 --2- 172.21.15.90:0/3099190634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61200cd740 0x7f6120074220 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f61200d0d50 tx=0x7f611002a8f0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.236+0000 7f6126d24640 1 -- 172.21.15.90:0/3099190634 shutdown_connections 2024-09-10T23:17:11.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.236+0000 7f6126d24640 1 --2- 172.21.15.90:0/3099190634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61200cd0f0 0x7f612006cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.236+0000 7f6126d24640 1 --2- 172.21.15.90:0/3099190634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61200cd740 0x7f6120074220 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.236+0000 7f6126d24640 1 --2- 172.21.15.90:0/3099190634 >> v2:172.21.15.171:3300/0 conn(0x7f61200cdf10 0x7f61200ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.236+0000 7f6126d24640 1 -- 172.21.15.90:0/3099190634 >> 172.21.15.90:0/3099190634 conn(0x7f61200b2a40 msgr2=0x7f61200b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:11.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.236+0000 7f6126d24640 1 -- 172.21.15.90:0/3099190634 shutdown_connections 2024-09-10T23:17:11.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.236+0000 7f6126d24640 1 -- 172.21.15.90:0/3099190634 wait complete. 2024-09-10T23:17:11.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.237+0000 7f6126d24640 1 Processor -- start 2024-09-10T23:17:11.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.237+0000 7f6126d24640 1 -- start start 2024-09-10T23:17:11.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.238+0000 7f6126d24640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61200cd0f0 0x7f612009e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.238+0000 7f6126d24640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61200cd740 0x7f6120159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.238+0000 7f6126d24640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61200cdf10 0x7f61200b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.238+0000 7f6126d24640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f61200c5e30 con 0x7f61200cd0f0 2024-09-10T23:17:11.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.238+0000 7f6126d24640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f61200c5cb0 con 0x7f61200cdf10 2024-09-10T23:17:11.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.238+0000 7f6126d24640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f61200c5fb0 con 0x7f61200cd740 2024-09-10T23:17:11.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.238+0000 7f6124ac0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61200cd0f0 0x7f612009e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.238+0000 7f6124ac0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61200cd0f0 0x7f612009e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52396/0 (socket says 172.21.15.90:52396) 2024-09-10T23:17:11.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.238+0000 7f6124ac0640 1 -- 172.21.15.90:0/340978104 learned_addr learned my addr 172.21.15.90:0/340978104 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:11.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.238+0000 7f61252c1640 1 --2- 172.21.15.90:0/340978104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61200cdf10 0x7f61200b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.238+0000 7f611ffff640 1 --2- 172.21.15.90:0/340978104 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61200cd740 0x7f6120159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.239+0000 7f6124ac0640 1 -- 172.21.15.90:0/340978104 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61200cd740 msgr2=0x7f6120159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:11.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.239+0000 7f6124ac0640 1 --2- 172.21.15.90:0/340978104 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61200cd740 0x7f6120159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.239+0000 7f6124ac0640 1 -- 172.21.15.90:0/340978104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61200cdf10 msgr2=0x7f61200b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:11.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.239+0000 7f6124ac0640 1 --2- 172.21.15.90:0/340978104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61200cdf10 0x7f61200b6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.239+0000 7f6124ac0640 1 -- 172.21.15.90:0/340978104 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612009e680 con 0x7f61200cd0f0 2024-09-10T23:17:11.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.239+0000 7f6124ac0640 1 --2- 172.21.15.90:0/340978104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61200cd0f0 0x7f612009e140 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f611800d770 tx=0x7f611800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:11.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.239+0000 7f611d7fa640 1 -- 172.21.15.90:0/340978104 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6118017070 con 0x7f61200cd0f0 2024-09-10T23:17:11.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.239+0000 7f611d7fa640 1 -- 172.21.15.90:0/340978104 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6118009d20 con 0x7f61200cd0f0 2024-09-10T23:17:11.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.239+0000 7f6126d24640 1 -- 172.21.15.90:0/340978104 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61200b4c70 con 0x7f61200cd0f0 2024-09-10T23:17:11.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.239+0000 7f611d7fa640 1 -- 172.21.15.90:0/340978104 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6118004280 con 0x7f61200cd0f0 2024-09-10T23:17:11.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.239+0000 7f6126d24640 1 -- 172.21.15.90:0/340978104 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61200b5960 con 0x7f61200cd0f0 2024-09-10T23:17:11.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.240+0000 7f6126d24640 1 -- 172.21.15.90:0/340978104 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6120074220 con 0x7f61200cd0f0 2024-09-10T23:17:11.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.241+0000 7f611d7fa640 1 -- 172.21.15.90:0/340978104 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6118005020 con 0x7f61200cd0f0 2024-09-10T23:17:11.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.241+0000 7f611d7fa640 1 --2- 172.21.15.90:0/340978104 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6100077fa0 0x7f610007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:11.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.242+0000 7f611d7fa640 1 -- 172.21.15.90:0/340978104 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f6118099f80 con 0x7f61200cd0f0 2024-09-10T23:17:11.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.242+0000 7f611ffff640 1 --2- 172.21.15.90:0/340978104 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6100077fa0 0x7f610007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:11.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.242+0000 7f611ffff640 1 --2- 172.21.15.90:0/340978104 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6100077fa0 0x7f610007a460 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6110035000 tx=0x7f6110004ab0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:11.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.246+0000 7f611d7fa640 1 -- 172.21.15.90:0/340978104 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6118020020 con 0x7f61200cd0f0 2024-09-10T23:17:11.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.453+0000 7f6126d24640 1 -- 172.21.15.90:0/340978104 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6120069a80 con 0x7f61200cd0f0 2024-09-10T23:17:11.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.453+0000 7f611d7fa640 1 -- 172.21.15.90:0/340978104 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) ==== 53+0+73 (secure 0 0 0) 0x7f611806b1a0 con 0x7f61200cd0f0 2024-09-10T23:17:11.454 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:17:11.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.455+0000 7f6126d24640 1 -- 172.21.15.90:0/340978104 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6100077fa0 msgr2=0x7f610007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:11.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.455+0000 7f6126d24640 1 --2- 172.21.15.90:0/340978104 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6100077fa0 0x7f610007a460 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6110035000 tx=0x7f6110004ab0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.455+0000 7f6126d24640 1 -- 172.21.15.90:0/340978104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61200cd0f0 msgr2=0x7f612009e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:11.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.455+0000 7f6126d24640 1 --2- 172.21.15.90:0/340978104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61200cd0f0 0x7f612009e140 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f611800d770 tx=0x7f611800dc30 comp rx=0 tx=0).stop 2024-09-10T23:17:11.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.455+0000 7f6126d24640 1 -- 172.21.15.90:0/340978104 shutdown_connections 2024-09-10T23:17:11.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.455+0000 7f6126d24640 1 --2- 172.21.15.90:0/340978104 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6100077fa0 0x7f610007a460 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.455+0000 7f6126d24640 1 --2- 172.21.15.90:0/340978104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61200cdf10 0x7f61200b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.455+0000 7f6126d24640 1 --2- 172.21.15.90:0/340978104 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61200cd740 0x7f6120159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.455+0000 7f6126d24640 1 --2- 172.21.15.90:0/340978104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61200cd0f0 0x7f612009e140 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:11.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.455+0000 7f6126d24640 1 -- 172.21.15.90:0/340978104 >> 172.21.15.90:0/340978104 conn(0x7f61200b2a40 msgr2=0x7f61200add90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:11.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.455+0000 7f6126d24640 1 -- 172.21.15.90:0/340978104 shutdown_connections 2024-09-10T23:17:11.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11.455+0000 7f6126d24640 1 -- 172.21.15.90:0/340978104 wait complete. 2024-09-10T23:17:11.466 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:17:11.467 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:17:11.467 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2024-09-10T23:17:11.467 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:17:11.467 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:17:11.467 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:17:11.467 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:17:11.467 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:17:11.467 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:17:11.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:11.467 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2024-09-10T23:17:11.483 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:17:11.484 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:17:11.484 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:17:11.484 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:11.484 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-10T23:17:11.484 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:11.484 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:17:11.484 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:11.484 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2024-09-10T23:17:11.484 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:17:11.484 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:11.484 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2024-09-10T23:17:11.485 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:17:11.485 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:11.485 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:17:11.485 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:11.485 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:17:11.485 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42616sec preferred_lft 42616sec 2024-09-10T23:17:11.485 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link noprefixroute 2024-09-10T23:17:11.485 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:11.485 INFO:teuthology.orchestra.run.smithi090.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:17:11.485 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:11.485 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:17:11.485 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:11.485 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::882a:a9ff:fefc:893f/64 scope link 2024-09-10T23:17:11.486 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:11.486 INFO:teuthology.orchestra.run.smithi090.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:17:11.486 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 76:ad:51:1a:2a:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:17:11.486 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::74ad:51ff:fe1a:2a60/64 scope link 2024-09-10T23:17:11.486 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:11.486 INFO:teuthology.orchestra.run.smithi090.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:17:11.486 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:17:11.486 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::3414:abff:fe49:366c/64 scope link 2024-09-10T23:17:11.486 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:11.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:11.487 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:17:11.548 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-09-10T23:17:11.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:11.549 DEBUG:teuthology.orchestra.run.smithi090:> route 2024-09-10T23:17:11.607 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2024-09-10T23:17:11.607 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:17:11.607 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:17:11.607 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:17:11.607 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:17:11.608 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:17:11.608 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:17:11.608 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:17:11.608 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:17:11.608 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:17:11.609 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:17:11.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:17:11.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:17:11.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:11.733 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-10T23:17:11.749 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:17:11.749 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:17:11.749 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:17:11.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:11.749 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2024-09-10T23:17:11.814 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:17:11.814 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:17:11.869 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:17:11.869 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:17:11.870 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:17:11.925 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:17:11.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:11.926 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:17:12.009 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:17:12.009 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:17:12.009 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:17:12.018 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:17:12.018 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:17:12.018 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:17:12.018 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:17:12.018 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:17:12.024 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:17:12.024 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:17:12.024 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:17:12.024 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:17:12.024 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:17:12.024 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:17:12.024 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:17:12.024 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:17:12.025 INFO:teuthology.orchestra.run.smithi090.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T23:17:12.025 INFO:teuthology.orchestra.run.smithi090.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:17:12.025 INFO:teuthology.orchestra.run.smithi090.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:17:12.025 INFO:teuthology.orchestra.run.smithi090.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:17:12.025 INFO:teuthology.orchestra.run.smithi090.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:17:12.026 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:17:12.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:12.026 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:17:12.091 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:17:12.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:17:12.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:17:12.192 INFO:teuthology.orchestra.run.smithi090.stdout:client5659 2024-09-10T23:17:12.192 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:17:12.192 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:12.208 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:17:12.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.347+0000 7f9920cb1640 1 -- 172.21.15.90:0/1653327924 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9904003a50 msgr2=0x7f9904003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:12.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.347+0000 7f9920cb1640 1 --2- 172.21.15.90:0/1653327924 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9904003a50 0x7f9904003e70 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f990c00bbe0 tx=0x7f9904005830 comp rx=0 tx=0).stop 2024-09-10T23:17:12.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.347+0000 7f991ad9d640 1 -- 172.21.15.90:0/1653327924 reap_dead start 2024-09-10T23:17:12.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.348+0000 7f9920cb1640 1 -- 172.21.15.90:0/1653327924 shutdown_connections 2024-09-10T23:17:12.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.348+0000 7f9920cb1640 1 -- 172.21.15.90:0/1653327924 >> 172.21.15.90:0/1653327924 conn(0x7f991c0d1ee0 msgr2=0x7f991c0d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:12.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.348+0000 7f9920cb1640 1 -- 172.21.15.90:0/1653327924 shutdown_connections 2024-09-10T23:17:12.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.348+0000 7f9920cb1640 1 -- 172.21.15.90:0/1653327924 wait complete. 2024-09-10T23:17:12.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.349+0000 7f9920cb1640 1 Processor -- start 2024-09-10T23:17:12.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.349+0000 7f9920cb1640 1 -- start start 2024-09-10T23:17:12.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f9920cb1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9904003a50 0x7f991c1595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:12.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f9920cb1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f991c157ab0 0x7f991c0c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:12.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f9920cb1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f991c0b3d70 0x7f991c0b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:12.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f9920cb1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f991c0ce220 con 0x7f991c157ab0 2024-09-10T23:17:12.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f9920cb1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f991c0ce0a0 con 0x7f991c0b3d70 2024-09-10T23:17:12.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f9920cb1640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f991c0ce5f0 con 0x7f9904003a50 2024-09-10T23:17:12.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f9919d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f991c157ab0 0x7f991c0c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:12.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f9919d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f991c157ab0 0x7f991c0c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52412/0 (socket says 172.21.15.90:52412) 2024-09-10T23:17:12.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f9919d9b640 1 -- 172.21.15.90:0/4192876114 learned_addr learned my addr 172.21.15.90:0/4192876114 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:12.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f991a59c640 1 --2- 172.21.15.90:0/4192876114 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9904003a50 0x7f991c1595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:12.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f9919d9b640 1 -- 172.21.15.90:0/4192876114 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9904003a50 msgr2=0x7f991c1595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:12.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f9919d9b640 1 --2- 172.21.15.90:0/4192876114 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9904003a50 0x7f991c1595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:12.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f991ad9d640 1 --2- 172.21.15.90:0/4192876114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f991c0b3d70 0x7f991c0b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:12.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f9919d9b640 1 -- 172.21.15.90:0/4192876114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f991c0b3d70 msgr2=0x7f991c0b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:12.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f9919d9b640 1 --2- 172.21.15.90:0/4192876114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f991c0b3d70 0x7f991c0b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:12.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f9919d9b640 1 -- 172.21.15.90:0/4192876114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f991c158540 con 0x7f991c157ab0 2024-09-10T23:17:12.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f991a59c640 1 --2- 172.21.15.90:0/4192876114 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9904003a50 0x7f991c1595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:12.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f991ad9d640 1 --2- 172.21.15.90:0/4192876114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f991c0b3d70 0x7f991c0b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:12.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f9919d9b640 1 --2- 172.21.15.90:0/4192876114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f991c157ab0 0x7f991c0c8280 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f991000e630 tx=0x7f991000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:12.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f990affd640 1 -- 172.21.15.90:0/4192876114 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9910015020 con 0x7f991c157ab0 2024-09-10T23:17:12.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f990affd640 1 -- 172.21.15.90:0/4192876114 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f991000ca90 con 0x7f991c157ab0 2024-09-10T23:17:12.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.350+0000 7f9920cb1640 1 -- 172.21.15.90:0/4192876114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f991c158820 con 0x7f991c157ab0 2024-09-10T23:17:12.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.351+0000 7f990affd640 1 -- 172.21.15.90:0/4192876114 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9910011460 con 0x7f991c157ab0 2024-09-10T23:17:12.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.351+0000 7f9920cb1640 1 -- 172.21.15.90:0/4192876114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f991c158de0 con 0x7f991c157ab0 2024-09-10T23:17:12.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.351+0000 7f9920cb1640 1 -- 172.21.15.90:0/4192876114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f991c0ceac0 con 0x7f991c157ab0 2024-09-10T23:17:12.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.352+0000 7f990affd640 1 -- 172.21.15.90:0/4192876114 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9910011600 con 0x7f991c157ab0 2024-09-10T23:17:12.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.352+0000 7f990affd640 1 --2- 172.21.15.90:0/4192876114 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f98fc077fa0 0x7f98fc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:12.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.353+0000 7f990affd640 1 -- 172.21.15.90:0/4192876114 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f991009a6c0 con 0x7f991c157ab0 2024-09-10T23:17:12.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.353+0000 7f991a59c640 1 --2- 172.21.15.90:0/4192876114 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f98fc077fa0 0x7f98fc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:12.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.353+0000 7f991a59c640 1 --2- 172.21.15.90:0/4192876114 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f98fc077fa0 0x7f98fc07a460 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f990c035000 tx=0x7f990c0046c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:12.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.357+0000 7f990affd640 1 -- 172.21.15.90:0/4192876114 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f991001f020 con 0x7f991c157ab0 2024-09-10T23:17:12.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.570+0000 7f9920cb1640 1 -- 172.21.15.90:0/4192876114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f991c15ea20 con 0x7f991c157ab0 2024-09-10T23:17:12.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.570+0000 7f990affd640 1 -- 172.21.15.90:0/4192876114 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) ==== 53+0+73 (secure 0 0 0) 0x7f99100631c0 con 0x7f991c157ab0 2024-09-10T23:17:12.571 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:17:12.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.572+0000 7f9920cb1640 1 -- 172.21.15.90:0/4192876114 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f98fc077fa0 msgr2=0x7f98fc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:12.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.572+0000 7f9920cb1640 1 --2- 172.21.15.90:0/4192876114 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f98fc077fa0 0x7f98fc07a460 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f990c035000 tx=0x7f990c0046c0 comp rx=0 tx=0).stop 2024-09-10T23:17:12.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.572+0000 7f9920cb1640 1 -- 172.21.15.90:0/4192876114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f991c157ab0 msgr2=0x7f991c0c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:12.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.572+0000 7f9920cb1640 1 --2- 172.21.15.90:0/4192876114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f991c157ab0 0x7f991c0c8280 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f991000e630 tx=0x7f991000eaf0 comp rx=0 tx=0).stop 2024-09-10T23:17:12.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.572+0000 7f9920cb1640 1 -- 172.21.15.90:0/4192876114 shutdown_connections 2024-09-10T23:17:12.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.572+0000 7f9920cb1640 1 --2- 172.21.15.90:0/4192876114 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f98fc077fa0 0x7f98fc07a460 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:12.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.572+0000 7f9920cb1640 1 --2- 172.21.15.90:0/4192876114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f991c0b3d70 0x7f991c0b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:12.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.572+0000 7f9920cb1640 1 --2- 172.21.15.90:0/4192876114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f991c157ab0 0x7f991c0c8280 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:12.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.572+0000 7f9920cb1640 1 --2- 172.21.15.90:0/4192876114 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9904003a50 0x7f991c1595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:12.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.573+0000 7f9920cb1640 1 -- 172.21.15.90:0/4192876114 >> 172.21.15.90:0/4192876114 conn(0x7f991c0d1ee0 msgr2=0x7f991c0d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:12.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.573+0000 7f9920cb1640 1 -- 172.21.15.90:0/4192876114 shutdown_connections 2024-09-10T23:17:12.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:12.573+0000 7f9920cb1640 1 -- 172.21.15.90:0/4192876114 wait complete. 2024-09-10T23:17:12.584 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:17:12.585 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:17:12.585 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-09-10T23:17:12.585 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T23:17:12.585 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T23:17:12.585 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:17:12.585 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:17:12.585 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:17:12.585 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:17:12.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:12.585 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-09-10T23:17:12.605 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:17:12.605 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:17:12.605 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:17:12.605 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:12.605 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-09-10T23:17:12.605 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:12.605 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:17:12.606 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:12.606 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-09-10T23:17:12.606 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:17:12.606 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:12.606 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-09-10T23:17:12.606 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:17:12.606 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:12.606 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:17:12.606 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:12.606 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:17:12.606 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42598sec preferred_lft 42598sec 2024-09-10T23:17:12.606 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link noprefixroute 2024-09-10T23:17:12.606 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:12.606 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:17:12.607 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:12.607 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:17:12.607 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:12.607 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::c18:12ff:fe41:788b/64 scope link 2024-09-10T23:17:12.607 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:12.607 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:17:12.607 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:17:12.607 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a0e4:c6ff:fe48:8d44/64 scope link 2024-09-10T23:17:12.607 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:12.607 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:17:12.607 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a6:c9:8b:0f:78:86 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:17:12.607 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a4c9:8bff:fe0f:7886/64 scope link 2024-09-10T23:17:12.607 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:12.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:12.608 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:17:12.674 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-09-10T23:17:12.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:12.676 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-09-10T23:17:12.736 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-09-10T23:17:12.736 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:17:12.737 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:17:12.737 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:17:12.737 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:17:12.737 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:17:12.737 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:17:12.737 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:17:12.738 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:17:12.738 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:17:12.738 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:17:12.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:17:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:17:12.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:17:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:17:12.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:12.873 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-09-10T23:17:12.888 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T23:17:12.889 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T23:17:12.889 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:17:12.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:12.889 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-09-10T23:17:12.954 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:17:12.954 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T23:17:13.011 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:17:13.011 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:17:13.011 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:17:13.067 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:17:13.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:13.067 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:17:13.151 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:17:13.151 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:17:13.151 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:17:13.160 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:17:13.160 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:17:13.160 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:17:13.160 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:17:13.160 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:17:13.177 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:17:13.177 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:17:13.178 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:17:13.178 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:17:13.178 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:17:13.178 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:17:13.178 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:17:13.178 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:17:13.178 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T23:17:13.179 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:17:13.179 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:17:13.179 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:17:13.179 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:17:13.180 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:17:13.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:13.180 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:17:13.246 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:17:13.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:17:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:17:13.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:17:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:17:13.344 INFO:teuthology.orchestra.run.smithi171.stdout:client5420 2024-09-10T23:17:13.345 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:17:13.345 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:13.361 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:17:13.362 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:17:13.413 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:17:13.452 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:17:13.452 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:17:13.452 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:17:13.453 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:13.471 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:17:13.472 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:13.531 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:17:13.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.678+0000 7ff674f53640 1 -- 172.21.15.90:0/3642725769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6700ceca0 msgr2=0x7ff6700cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:13.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.678+0000 7ff674f53640 1 --2- 172.21.15.90:0/3642725769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6700ceca0 0x7ff6700cf110 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff668005fd0 tx=0x7ff66802a840 comp rx=0 tx=0).stop 2024-09-10T23:17:13.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.678+0000 7ff674f53640 1 -- 172.21.15.90:0/3642725769 shutdown_connections 2024-09-10T23:17:13.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.678+0000 7ff674f53640 1 --2- 172.21.15.90:0/3642725769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6700ceca0 0x7ff6700cf110 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:13.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.678+0000 7ff674f53640 1 --2- 172.21.15.90:0/3642725769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6700b3310 0x7ff6700b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:13.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.678+0000 7ff674f53640 1 -- 172.21.15.90:0/3642725769 >> 172.21.15.90:0/3642725769 conn(0x7ff6700b19c0 msgr2=0x7ff6700b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:13.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.678+0000 7ff674f53640 1 -- 172.21.15.90:0/3642725769 shutdown_connections 2024-09-10T23:17:13.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.678+0000 7ff674f53640 1 -- 172.21.15.90:0/3642725769 wait complete. 2024-09-10T23:17:13.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.679+0000 7ff674f53640 1 Processor -- start 2024-09-10T23:17:13.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.679+0000 7ff674f53640 1 -- start start 2024-09-10T23:17:13.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff674f53640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6700b3310 0x7ff6701480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:13.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff674f53640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6700ceca0 0x7ff6700b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:13.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff674f53640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff67015d520 0x7ff67015d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:13.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff674f53640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff67015bb40 con 0x7ff6700ceca0 2024-09-10T23:17:13.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff674f53640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff67015b9c0 con 0x7ff67015d520 2024-09-10T23:17:13.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff674f53640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff67015bcc0 con 0x7ff6700b3310 2024-09-10T23:17:13.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff66dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6700ceca0 0x7ff6700b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:13.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff66dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6700ceca0 0x7ff6700b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52426/0 (socket says 172.21.15.90:52426) 2024-09-10T23:17:13.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff66dd9b640 1 -- 172.21.15.90:0/1307261634 learned_addr learned my addr 172.21.15.90:0/1307261634 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:13.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff66ed9d640 1 --2- 172.21.15.90:0/1307261634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff67015d520 0x7ff67015d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:13.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff66e59c640 1 --2- 172.21.15.90:0/1307261634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6700b3310 0x7ff6701480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:13.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff66dd9b640 1 -- 172.21.15.90:0/1307261634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6700b3310 msgr2=0x7ff6701480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:13.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff66dd9b640 1 --2- 172.21.15.90:0/1307261634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6700b3310 0x7ff6701480b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:13.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff66dd9b640 1 -- 172.21.15.90:0/1307261634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff67015d520 msgr2=0x7ff67015d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:13.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff66dd9b640 1 --2- 172.21.15.90:0/1307261634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff67015d520 0x7ff67015d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:13.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff66dd9b640 1 -- 172.21.15.90:0/1307261634 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67009d160 con 0x7ff6700ceca0 2024-09-10T23:17:13.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff66e59c640 1 --2- 172.21.15.90:0/1307261634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6700b3310 0x7ff6701480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:13.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.680+0000 7ff66dd9b640 1 --2- 172.21.15.90:0/1307261634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6700ceca0 0x7ff6700b00d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff66400c340 tx=0x7ff66400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:13.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.681+0000 7ff65effd640 1 -- 172.21.15.90:0/1307261634 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff664017070 con 0x7ff6700ceca0 2024-09-10T23:17:13.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.681+0000 7ff65effd640 1 -- 172.21.15.90:0/1307261634 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6640035f0 con 0x7ff6700ceca0 2024-09-10T23:17:13.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.681+0000 7ff674f53640 1 -- 172.21.15.90:0/1307261634 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67009c0c0 con 0x7ff6700ceca0 2024-09-10T23:17:13.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.681+0000 7ff65effd640 1 -- 172.21.15.90:0/1307261634 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff664003a80 con 0x7ff6700ceca0 2024-09-10T23:17:13.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.681+0000 7ff674f53640 1 -- 172.21.15.90:0/1307261634 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67009c680 con 0x7ff6700ceca0 2024-09-10T23:17:13.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.682+0000 7ff674f53640 1 -- 172.21.15.90:0/1307261634 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff67014e5f0 con 0x7ff6700ceca0 2024-09-10T23:17:13.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.682+0000 7ff65effd640 1 -- 172.21.15.90:0/1307261634 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff664003c20 con 0x7ff6700ceca0 2024-09-10T23:17:13.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.683+0000 7ff65effd640 1 --2- 172.21.15.90:0/1307261634 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff650077fa0 0x7ff65007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:13.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.683+0000 7ff65effd640 1 -- 172.21.15.90:0/1307261634 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7ff664099250 con 0x7ff6700ceca0 2024-09-10T23:17:13.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.683+0000 7ff66e59c640 1 --2- 172.21.15.90:0/1307261634 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff650077fa0 0x7ff65007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:13.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.684+0000 7ff66e59c640 1 --2- 172.21.15.90:0/1307261634 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff650077fa0 0x7ff65007a460 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff660009b40 tx=0x7ff660005e50 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:13.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.687+0000 7ff65effd640 1 -- 172.21.15.90:0/1307261634 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff67009d160 con 0x7ff6700ceca0 2024-09-10T23:17:13.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.872+0000 7ff674f53640 1 -- 172.21.15.90:0/1307261634 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff6700b41a0 con 0x7ff6700ceca0 2024-09-10T23:17:13.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.872+0000 7ff65effd640 1 -- 172.21.15.90:0/1307261634 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v68) ==== 80+0+0 (secure 0 0 0) 0x7ff664061d60 con 0x7ff6700ceca0 2024-09-10T23:17:13.875 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:17:13.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.874+0000 7ff674f53640 1 -- 172.21.15.90:0/1307261634 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff650077fa0 msgr2=0x7ff65007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:13.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.874+0000 7ff674f53640 1 --2- 172.21.15.90:0/1307261634 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff650077fa0 0x7ff65007a460 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff660009b40 tx=0x7ff660005e50 comp rx=0 tx=0).stop 2024-09-10T23:17:13.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.874+0000 7ff674f53640 1 -- 172.21.15.90:0/1307261634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6700ceca0 msgr2=0x7ff6700b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:13.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.874+0000 7ff674f53640 1 --2- 172.21.15.90:0/1307261634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6700ceca0 0x7ff6700b00d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff66400c340 tx=0x7ff66400c800 comp rx=0 tx=0).stop 2024-09-10T23:17:13.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.874+0000 7ff674f53640 1 -- 172.21.15.90:0/1307261634 shutdown_connections 2024-09-10T23:17:13.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.874+0000 7ff674f53640 1 --2- 172.21.15.90:0/1307261634 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff650077fa0 0x7ff65007a460 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:13.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.874+0000 7ff674f53640 1 --2- 172.21.15.90:0/1307261634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff67015d520 0x7ff67015d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:13.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.874+0000 7ff674f53640 1 --2- 172.21.15.90:0/1307261634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6700ceca0 0x7ff6700b00d0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:13.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.874+0000 7ff674f53640 1 --2- 172.21.15.90:0/1307261634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6700b3310 0x7ff6701480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:13.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.874+0000 7ff674f53640 1 -- 172.21.15.90:0/1307261634 >> 172.21.15.90:0/1307261634 conn(0x7ff6700b19c0 msgr2=0x7ff6700ccf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:13.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.875+0000 7ff674f53640 1 -- 172.21.15.90:0/1307261634 shutdown_connections 2024-09-10T23:17:13.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:13.875+0000 7ff674f53640 1 -- 172.21.15.90:0/1307261634 wait complete. 2024-09-10T23:17:13.887 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T23:17:13.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:13.888 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T23:17:13.915 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:17:13.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:13.916 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:17:13.972 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:17:13.972 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:17:13.972 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:13.988 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:17:13.988 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:14.045 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:17:14.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.146+0000 7f52fd66a640 1 -- 172.21.15.90:0/195666347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52e0003c10 msgr2=0x7f52e0004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:14.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.146+0000 7f52fd66a640 1 --2- 172.21.15.90:0/195666347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52e0003c10 0x7f52e0004010 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009b50 tx=0x7f52e0005830 comp rx=0 tx=0).stop 2024-09-10T23:17:14.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.146+0000 7f52f77fe640 1 -- 172.21.15.90:0/195666347 reap_dead start 2024-09-10T23:17:14.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.146+0000 7f52fd66a640 1 -- 172.21.15.90:0/195666347 shutdown_connections 2024-09-10T23:17:14.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.146+0000 7f52fd66a640 1 -- 172.21.15.90:0/195666347 >> 172.21.15.90:0/195666347 conn(0x7f52f80d4090 msgr2=0x7f52f80d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:14.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.146+0000 7f52fd66a640 1 -- 172.21.15.90:0/195666347 shutdown_connections 2024-09-10T23:17:14.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.146+0000 7f52fd66a640 1 -- 172.21.15.90:0/195666347 wait complete. 2024-09-10T23:17:14.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.147+0000 7f52fd66a640 1 Processor -- start 2024-09-10T23:17:14.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.147+0000 7f52fd66a640 1 -- start start 2024-09-10T23:17:14.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.148+0000 7f52fd66a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52e0003c10 0x7f52f80c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:14.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.148+0000 7f52fd66a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f80c8360 0x7f52f80b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:14.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.148+0000 7f52fd66a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52f80b92d0 0x7f52f80b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:14.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.148+0000 7f52fd66a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f52f80cf820 con 0x7f52f80c8360 2024-09-10T23:17:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.148+0000 7f52fd66a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f52f80d4d90 con 0x7f52f80b92d0 2024-09-10T23:17:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.148+0000 7f52fd66a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f52f80d0a80 con 0x7f52e0003c10 2024-09-10T23:17:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.148+0000 7f52f67fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f80c8360 0x7f52f80b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.148+0000 7f52f67fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f80c8360 0x7f52f80b82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52442/0 (socket says 172.21.15.90:52442) 2024-09-10T23:17:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.148+0000 7f52f67fc640 1 -- 172.21.15.90:0/2936066002 learned_addr learned my addr 172.21.15.90:0/2936066002 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.148+0000 7f52f77fe640 1 --2- 172.21.15.90:0/2936066002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52f80b92d0 0x7f52f80b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.148+0000 7f52f6ffd640 1 --2- 172.21.15.90:0/2936066002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52e0003c10 0x7f52f80c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.148+0000 7f52f67fc640 1 -- 172.21.15.90:0/2936066002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52e0003c10 msgr2=0x7f52f80c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.148+0000 7f52f67fc640 1 --2- 172.21.15.90:0/2936066002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52e0003c10 0x7f52f80c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.148+0000 7f52f67fc640 1 -- 172.21.15.90:0/2936066002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52f80b92d0 msgr2=0x7f52f80b87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.148+0000 7f52f67fc640 1 --2- 172.21.15.90:0/2936066002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52f80b92d0 0x7f52f80b87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.148+0000 7f52f67fc640 1 -- 172.21.15.90:0/2936066002 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f81f4c10 con 0x7f52f80c8360 2024-09-10T23:17:14.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.148+0000 7f52f67fc640 1 --2- 172.21.15.90:0/2936066002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f80c8360 0x7f52f80b82a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f52ec001a90 tx=0x7f52ec001f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:14.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.149+0000 7f52df7fe640 1 -- 172.21.15.90:0/2936066002 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec015070 con 0x7f52f80c8360 2024-09-10T23:17:14.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.149+0000 7f52df7fe640 1 -- 172.21.15.90:0/2936066002 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52ec00ead0 con 0x7f52f80c8360 2024-09-10T23:17:14.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.149+0000 7f52df7fe640 1 -- 172.21.15.90:0/2936066002 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec011460 con 0x7f52f80c8360 2024-09-10T23:17:14.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.149+0000 7f52fd66a640 1 -- 172.21.15.90:0/2936066002 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f81f8fd0 con 0x7f52f80c8360 2024-09-10T23:17:14.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.149+0000 7f52fd66a640 1 -- 172.21.15.90:0/2936066002 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f81f51b0 con 0x7f52f80c8360 2024-09-10T23:17:14.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.150+0000 7f52fd66a640 1 -- 172.21.15.90:0/2936066002 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f815e6f0 con 0x7f52f80c8360 2024-09-10T23:17:14.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.150+0000 7f52df7fe640 1 -- 172.21.15.90:0/2936066002 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f52ec011600 con 0x7f52f80c8360 2024-09-10T23:17:14.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.151+0000 7f52df7fe640 1 --2- 172.21.15.90:0/2936066002 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f52e4077fa0 0x7f52e407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:14.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.151+0000 7f52df7fe640 1 -- 172.21.15.90:0/2936066002 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f52ec09a950 con 0x7f52f80c8360 2024-09-10T23:17:14.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.151+0000 7f52f6ffd640 1 --2- 172.21.15.90:0/2936066002 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f52e4077fa0 0x7f52e407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:14.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.151+0000 7f52f6ffd640 1 --2- 172.21.15.90:0/2936066002 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f52e4077fa0 0x7f52e407a460 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f52f0035000 tx=0x7f52f002d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:14.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.155+0000 7f52df7fe640 1 -- 172.21.15.90:0/2936066002 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f52ec062e00 con 0x7f52f80c8360 2024-09-10T23:17:14.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.341+0000 7f52fd66a640 1 -- 172.21.15.90:0/2936066002 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f52f80b3fa0 con 0x7f52f80c8360 2024-09-10T23:17:14.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.342+0000 7f52df7fe640 1 -- 172.21.15.90:0/2936066002 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v68) ==== 80+0+0 (secure 0 0 0) 0x7f52ec067830 con 0x7f52f80c8360 2024-09-10T23:17:14.344 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:17:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.344+0000 7f52fd66a640 1 -- 172.21.15.90:0/2936066002 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f52e4077fa0 msgr2=0x7f52e407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.344+0000 7f52fd66a640 1 --2- 172.21.15.90:0/2936066002 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f52e4077fa0 0x7f52e407a460 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f52f0035000 tx=0x7f52f002d040 comp rx=0 tx=0).stop 2024-09-10T23:17:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.344+0000 7f52fd66a640 1 -- 172.21.15.90:0/2936066002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f80c8360 msgr2=0x7f52f80b82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.344+0000 7f52fd66a640 1 --2- 172.21.15.90:0/2936066002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f80c8360 0x7f52f80b82a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f52ec001a90 tx=0x7f52ec001f50 comp rx=0 tx=0).stop 2024-09-10T23:17:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.344+0000 7f52fd66a640 1 -- 172.21.15.90:0/2936066002 shutdown_connections 2024-09-10T23:17:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.344+0000 7f52fd66a640 1 --2- 172.21.15.90:0/2936066002 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f52e4077fa0 0x7f52e407a460 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.344+0000 7f52fd66a640 1 --2- 172.21.15.90:0/2936066002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52f80b92d0 0x7f52f80b87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.344+0000 7f52fd66a640 1 --2- 172.21.15.90:0/2936066002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f80c8360 0x7f52f80b82a0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.344+0000 7f52fd66a640 1 --2- 172.21.15.90:0/2936066002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52e0003c10 0x7f52f80c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.344+0000 7f52fd66a640 1 -- 172.21.15.90:0/2936066002 >> 172.21.15.90:0/2936066002 conn(0x7f52f80d4090 msgr2=0x7f52f806d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.344+0000 7f52fd66a640 1 -- 172.21.15.90:0/2936066002 shutdown_connections 2024-09-10T23:17:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.344+0000 7f52fd66a640 1 -- 172.21.15.90:0/2936066002 wait complete. 2024-09-10T23:17:14.356 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T23:17:14.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:14.357 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T23:17:14.385 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:17:14.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:14.385 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T23:17:14.441 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:17:14.442 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:17:14.442 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:14.457 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:17:14.457 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:17:14.458 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:17:14.458 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:14.497 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:17:14.498 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:17:14.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.597+0000 7fcb34984640 1 -- 172.21.15.90:0/1017623450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb3015f570 msgr2=0x7fcb300ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:14.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.597+0000 7fcb34984640 1 --2- 172.21.15.90:0/1017623450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb3015f570 0x7fcb300ce5f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fcb300697f0 tx=0x7fcb2002a4a0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.597+0000 7fcb34984640 1 -- 172.21.15.90:0/1017623450 shutdown_connections 2024-09-10T23:17:14.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.597+0000 7fcb34984640 1 --2- 172.21.15.90:0/1017623450 >> v2:172.21.15.171:3300/0 conn(0x7fcb300d2a00 0x7fcb300ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.597+0000 7fcb34984640 1 --2- 172.21.15.90:0/1017623450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb3015f570 0x7fcb300ce5f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.597+0000 7fcb34984640 1 -- 172.21.15.90:0/1017623450 >> 172.21.15.90:0/1017623450 conn(0x7fcb300d1ee0 msgr2=0x7fcb300d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:14.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.597+0000 7fcb34984640 1 -- 172.21.15.90:0/1017623450 shutdown_connections 2024-09-10T23:17:14.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.597+0000 7fcb34984640 1 -- 172.21.15.90:0/1017623450 wait complete. 2024-09-10T23:17:14.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.598+0000 7fcb34984640 1 Processor -- start 2024-09-10T23:17:14.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.598+0000 7fcb34984640 1 -- start start 2024-09-10T23:17:14.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.599+0000 7fcb34984640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb300cfd50 0x7fcb3015b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:14.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.599+0000 7fcb34984640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb300d2a00 0x7fcb300cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:14.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.599+0000 7fcb34984640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb3015f570 0x7fcb300cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:14.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.599+0000 7fcb34984640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcb300ce0a0 con 0x7fcb300d2a00 2024-09-10T23:17:14.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.599+0000 7fcb34984640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcb300ce220 con 0x7fcb3015f570 2024-09-10T23:17:14.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.599+0000 7fcb34984640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcb300d08d0 con 0x7fcb300cfd50 2024-09-10T23:17:14.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.599+0000 7fcb2dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb300d2a00 0x7fcb300cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:14.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.599+0000 7fcb2dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb300d2a00 0x7fcb300cb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52460/0 (socket says 172.21.15.90:52460) 2024-09-10T23:17:14.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.599+0000 7fcb2dd9b640 1 -- 172.21.15.90:0/117823760 learned_addr learned my addr 172.21.15.90:0/117823760 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:14.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.599+0000 7fcb2e59c640 1 --2- 172.21.15.90:0/117823760 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb300cfd50 0x7fcb3015b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:14.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.599+0000 7fcb2ed9d640 1 --2- 172.21.15.90:0/117823760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb3015f570 0x7fcb300cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:14.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.599+0000 7fcb2dd9b640 1 -- 172.21.15.90:0/117823760 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb300cfd50 msgr2=0x7fcb3015b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:14.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.599+0000 7fcb2dd9b640 1 --2- 172.21.15.90:0/117823760 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb300cfd50 0x7fcb3015b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.599+0000 7fcb2dd9b640 1 -- 172.21.15.90:0/117823760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb3015f570 msgr2=0x7fcb300cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:14.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.599+0000 7fcb2dd9b640 1 --2- 172.21.15.90:0/117823760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb3015f570 0x7fcb300cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.599+0000 7fcb2dd9b640 1 -- 172.21.15.90:0/117823760 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb3015bc70 con 0x7fcb300d2a00 2024-09-10T23:17:14.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.599+0000 7fcb2ed9d640 1 --2- 172.21.15.90:0/117823760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb3015f570 0x7fcb300cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:14.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.600+0000 7fcb2dd9b640 1 --2- 172.21.15.90:0/117823760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb300d2a00 0x7fcb300cb3d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400c920 tx=0x7fcb2400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:14.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.600+0000 7fcb1effd640 1 -- 172.21.15.90:0/117823760 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb24007c70 con 0x7fcb300d2a00 2024-09-10T23:17:14.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.600+0000 7fcb1effd640 1 -- 172.21.15.90:0/117823760 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb2400f450 con 0x7fcb300d2a00 2024-09-10T23:17:14.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.600+0000 7fcb1effd640 1 -- 172.21.15.90:0/117823760 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2400f8a0 con 0x7fcb300d2a00 2024-09-10T23:17:14.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.600+0000 7fcb34984640 1 -- 172.21.15.90:0/117823760 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb300c9130 con 0x7fcb300d2a00 2024-09-10T23:17:14.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.600+0000 7fcb34984640 1 -- 172.21.15.90:0/117823760 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb300af360 con 0x7fcb300d2a00 2024-09-10T23:17:14.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.601+0000 7fcb34984640 1 -- 172.21.15.90:0/117823760 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb300c9650 con 0x7fcb300d2a00 2024-09-10T23:17:14.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.601+0000 7fcb1effd640 1 -- 172.21.15.90:0/117823760 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcb24020030 con 0x7fcb300d2a00 2024-09-10T23:17:14.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.602+0000 7fcb1effd640 1 --2- 172.21.15.90:0/117823760 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcb10077f70 0x7fcb1007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:14.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.602+0000 7fcb1effd640 1 -- 172.21.15.90:0/117823760 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fcb2409a200 con 0x7fcb300d2a00 2024-09-10T23:17:14.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.602+0000 7fcb2e59c640 1 --2- 172.21.15.90:0/117823760 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcb10077f70 0x7fcb1007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:14.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.603+0000 7fcb2e59c640 1 --2- 172.21.15.90:0/117823760 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcb10077f70 0x7fcb1007a430 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcb20034000 tx=0x7fcb20004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:14.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.606+0000 7fcb1effd640 1 -- 172.21.15.90:0/117823760 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcb24014030 con 0x7fcb300d2a00 2024-09-10T23:17:14.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.816+0000 7fcb34984640 1 -- 172.21.15.90:0/117823760 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb300d01c0 con 0x7fcb300d2a00 2024-09-10T23:17:14.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.816+0000 7fcb1effd640 1 -- 172.21.15.90:0/117823760 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5225 (secure 0 0 0) 0x7fcb24062d00 con 0x7fcb300d2a00 2024-09-10T23:17:14.818 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:14.818 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"btime":"2024-09-10T23:17:04:184091+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5554,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/946078081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":946078081},{"type":"v1","addr":"172.21.15.171:6836","nonce":946078081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1081121108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1081121108},{"type":"v1","addr":"172.21.15.171:6837","nonce":1081121108}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6003,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/2444726710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2444726710},{"type":"v1","addr":"172.21.15.90:6834","nonce":2444726710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:01.524854+0000","modified":"2024-09-10T23:17:03.520058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/696526367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":696526367},{"type":"v1","addr":"172.21.15.90:6835","nonce":696526367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6006,"qdb_cluster":[6006]},"id":5}]} 2024-09-10T23:17:14.819 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 38 2024-09-10T23:17:14.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.818+0000 7fcb34984640 1 -- 172.21.15.90:0/117823760 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcb10077f70 msgr2=0x7fcb1007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:14.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.818+0000 7fcb34984640 1 --2- 172.21.15.90:0/117823760 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcb10077f70 0x7fcb1007a430 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcb20034000 tx=0x7fcb20004730 comp rx=0 tx=0).stop 2024-09-10T23:17:14.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.818+0000 7fcb34984640 1 -- 172.21.15.90:0/117823760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb300d2a00 msgr2=0x7fcb300cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:14.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.818+0000 7fcb34984640 1 --2- 172.21.15.90:0/117823760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb300d2a00 0x7fcb300cb3d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400c920 tx=0x7fcb2400cde0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.818+0000 7fcb34984640 1 -- 172.21.15.90:0/117823760 shutdown_connections 2024-09-10T23:17:14.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.818+0000 7fcb34984640 1 --2- 172.21.15.90:0/117823760 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcb10077f70 0x7fcb1007a430 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.818+0000 7fcb34984640 1 --2- 172.21.15.90:0/117823760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb3015f570 0x7fcb300cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.818+0000 7fcb34984640 1 --2- 172.21.15.90:0/117823760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb300d2a00 0x7fcb300cb3d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.818+0000 7fcb34984640 1 --2- 172.21.15.90:0/117823760 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb300cfd50 0x7fcb3015b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.818+0000 7fcb34984640 1 -- 172.21.15.90:0/117823760 >> 172.21.15.90:0/117823760 conn(0x7fcb300d1ee0 msgr2=0x7fcb300b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:14.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.818+0000 7fcb34984640 1 -- 172.21.15.90:0/117823760 shutdown_connections 2024-09-10T23:17:14.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.818+0000 7fcb34984640 1 -- 172.21.15.90:0/117823760 wait complete. 2024-09-10T23:17:14.832 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:17:14.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.930+0000 7f6516517640 1 -- 172.21.15.90:0/730056334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65100d38d0 msgr2=0x7f65100d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:14.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.930+0000 7f6516517640 1 --2- 172.21.15.90:0/730056334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65100d38d0 0x7f65100d0fc0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f651008c880 tx=0x7f650802a980 comp rx=0 tx=0).stop 2024-09-10T23:17:14.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.930+0000 7f6516517640 1 -- 172.21.15.90:0/730056334 shutdown_connections 2024-09-10T23:17:14.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.930+0000 7f6516517640 1 --2- 172.21.15.90:0/730056334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65100d38d0 0x7f65100d0fc0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.930+0000 7f6516517640 1 --2- 172.21.15.90:0/730056334 >> v2:172.21.15.171:3300/0 conn(0x7f651015e310 0x7f65100d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.930+0000 7f6516517640 1 -- 172.21.15.90:0/730056334 >> 172.21.15.90:0/730056334 conn(0x7f65100d4090 msgr2=0x7f65100d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:14.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.930+0000 7f6516517640 1 -- 172.21.15.90:0/730056334 shutdown_connections 2024-09-10T23:17:14.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.930+0000 7f6516517640 1 -- 172.21.15.90:0/730056334 wait complete. 2024-09-10T23:17:14.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.932+0000 7f6516517640 1 Processor -- start 2024-09-10T23:17:14.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.932+0000 7f6516517640 1 -- start start 2024-09-10T23:17:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f6516517640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65100d16f0 0x7f65100ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f6516517640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f65100d38d0 0x7f65100b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f6516517640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f651015e310 0x7f65100b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f6516517640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f65100cf800 con 0x7f651015e310 2024-09-10T23:17:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f6516517640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f65100d4d90 con 0x7f65100d16f0 2024-09-10T23:17:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f6516517640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f651006de00 con 0x7f65100d38d0 2024-09-10T23:17:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f6514ab4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f651015e310 0x7f65100b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f6514ab4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f651015e310 0x7f65100b2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52480/0 (socket says 172.21.15.90:52480) 2024-09-10T23:17:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f6514ab4640 1 -- 172.21.15.90:0/3542758757 learned_addr learned my addr 172.21.15.90:0/3542758757 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f650ffff640 1 --2- 172.21.15.90:0/3542758757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65100d16f0 0x7f65100ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f650f7fe640 1 --2- 172.21.15.90:0/3542758757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f65100d38d0 0x7f65100b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f6514ab4640 1 -- 172.21.15.90:0/3542758757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f65100d38d0 msgr2=0x7f65100b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f6514ab4640 1 --2- 172.21.15.90:0/3542758757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f65100d38d0 0x7f65100b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f6514ab4640 1 -- 172.21.15.90:0/3542758757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65100d16f0 msgr2=0x7f65100ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f6514ab4640 1 --2- 172.21.15.90:0/3542758757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65100d16f0 0x7f65100ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f6514ab4640 1 -- 172.21.15.90:0/3542758757 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65101f57c0 con 0x7f651015e310 2024-09-10T23:17:14.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f6514ab4640 1 --2- 172.21.15.90:0/3542758757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f651015e310 0x7f65100b2070 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f6508009d60 tx=0x7f6508003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:14.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f650cff9640 1 -- 172.21.15.90:0/3542758757 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508034050 con 0x7f651015e310 2024-09-10T23:17:14.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f650cff9640 1 -- 172.21.15.90:0/3542758757 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6508004450 con 0x7f651015e310 2024-09-10T23:17:14.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f6516517640 1 -- 172.21.15.90:0/3542758757 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65100b7110 con 0x7f651015e310 2024-09-10T23:17:14.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f650cff9640 1 -- 172.21.15.90:0/3542758757 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508043440 con 0x7f651015e310 2024-09-10T23:17:14.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.933+0000 7f6516517640 1 -- 172.21.15.90:0/3542758757 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65100b76d0 con 0x7f651015e310 2024-09-10T23:17:14.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.934+0000 7f6516517640 1 -- 172.21.15.90:0/3542758757 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f651006e2b0 con 0x7f651015e310 2024-09-10T23:17:14.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.935+0000 7f650cff9640 1 -- 172.21.15.90:0/3542758757 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6508041070 con 0x7f651015e310 2024-09-10T23:17:14.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.935+0000 7f650cff9640 1 --2- 172.21.15.90:0/3542758757 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64fc077f70 0x7f64fc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:14.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.936+0000 7f650cff9640 1 -- 172.21.15.90:0/3542758757 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f65080bb010 con 0x7f651015e310 2024-09-10T23:17:14.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.936+0000 7f650ffff640 1 --2- 172.21.15.90:0/3542758757 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64fc077f70 0x7f64fc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:14.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.936+0000 7f650ffff640 1 --2- 172.21.15.90:0/3542758757 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64fc077f70 0x7f64fc07a430 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6500004630 tx=0x7f650000b2e0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:14.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:14.940+0000 7f650cff9640 1 -- 172.21.15.90:0/3542758757 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f65080834d0 con 0x7f651015e310 2024-09-10T23:17:15.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.153+0000 7f6516517640 1 -- 172.21.15.90:0/3542758757 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65100b78a0 con 0x7f651015e310 2024-09-10T23:17:15.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.153+0000 7f650cff9640 1 -- 172.21.15.90:0/3542758757 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5225 (secure 0 0 0) 0x7f6508087f00 con 0x7f651015e310 2024-09-10T23:17:15.156 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:15.156 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"btime":"2024-09-10T23:17:04:184091+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5554,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/946078081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":946078081},{"type":"v1","addr":"172.21.15.171:6836","nonce":946078081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1081121108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1081121108},{"type":"v1","addr":"172.21.15.171:6837","nonce":1081121108}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6003,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/2444726710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2444726710},{"type":"v1","addr":"172.21.15.90:6834","nonce":2444726710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:01.524854+0000","modified":"2024-09-10T23:17:03.520058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/696526367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":696526367},{"type":"v1","addr":"172.21.15.90:6835","nonce":696526367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6006,"qdb_cluster":[6006]},"id":5}]} 2024-09-10T23:17:15.156 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 38 2024-09-10T23:17:15.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.155+0000 7f6516517640 1 -- 172.21.15.90:0/3542758757 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64fc077f70 msgr2=0x7f64fc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:15.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.155+0000 7f6516517640 1 --2- 172.21.15.90:0/3542758757 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64fc077f70 0x7f64fc07a430 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6500004630 tx=0x7f650000b2e0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.155+0000 7f6516517640 1 -- 172.21.15.90:0/3542758757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f651015e310 msgr2=0x7f65100b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:15.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.155+0000 7f6516517640 1 --2- 172.21.15.90:0/3542758757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f651015e310 0x7f65100b2070 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f6508009d60 tx=0x7f6508003f10 comp rx=0 tx=0).stop 2024-09-10T23:17:15.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.156+0000 7f6516517640 1 -- 172.21.15.90:0/3542758757 shutdown_connections 2024-09-10T23:17:15.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.156+0000 7f6516517640 1 --2- 172.21.15.90:0/3542758757 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64fc077f70 0x7f64fc07a430 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.156+0000 7f6516517640 1 --2- 172.21.15.90:0/3542758757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f651015e310 0x7f65100b2070 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.156+0000 7f6516517640 1 --2- 172.21.15.90:0/3542758757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f65100d38d0 0x7f65100b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.156+0000 7f6516517640 1 --2- 172.21.15.90:0/3542758757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65100d16f0 0x7f65100ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.156+0000 7f6516517640 1 -- 172.21.15.90:0/3542758757 >> 172.21.15.90:0/3542758757 conn(0x7f65100d4090 msgr2=0x7f65100b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:15.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.156+0000 7f6516517640 1 -- 172.21.15.90:0/3542758757 shutdown_connections 2024-09-10T23:17:15.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.156+0000 7f6516517640 1 -- 172.21.15.90:0/3542758757 wait complete. 2024-09-10T23:17:15.169 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:17:15.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.268+0000 7fa3bb59e640 1 -- 172.21.15.90:0/762818197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3bc15f430 msgr2=0x7fa3bc0cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:15.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.268+0000 7fa3bb59e640 1 --2- 172.21.15.90:0/762818197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3bc15f430 0x7fa3bc0cfda0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009830 tx=0x7fa3ac02a480 comp rx=0 tx=0).stop 2024-09-10T23:17:15.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.268+0000 7fa3bb59e640 1 -- 172.21.15.90:0/762818197 shutdown_connections 2024-09-10T23:17:15.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.268+0000 7fa3bb59e640 1 --2- 172.21.15.90:0/762818197 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3bc0d2850 0x7fa3bc0d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.268+0000 7fa3bb59e640 1 --2- 172.21.15.90:0/762818197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3bc15f430 0x7fa3bc0cfda0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.268+0000 7fa3bb59e640 1 -- 172.21.15.90:0/762818197 >> 172.21.15.90:0/762818197 conn(0x7fa3bc0d1d30 msgr2=0x7fa3bc0d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:15.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.268+0000 7fa3bb59e640 1 -- 172.21.15.90:0/762818197 shutdown_connections 2024-09-10T23:17:15.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.268+0000 7fa3bb59e640 1 -- 172.21.15.90:0/762818197 wait complete. 2024-09-10T23:17:15.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.269+0000 7fa3bb59e640 1 Processor -- start 2024-09-10T23:17:15.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.269+0000 7fa3bb59e640 1 -- start start 2024-09-10T23:17:15.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.270+0000 7fa3bb59e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3bc0d0820 0x7fa3bc1550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:15.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.270+0000 7fa3bb59e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3bc0d2850 0x7fa3bc1e52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:15.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.270+0000 7fa3bb59e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3bc15f430 0x7fa3bc0af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:15.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.270+0000 7fa3bb59e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc15f990 con 0x7fa3bc15f430 2024-09-10T23:17:15.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.270+0000 7fa3bb59e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc15f810 con 0x7fa3bc0d0820 2024-09-10T23:17:15.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.270+0000 7fa3bb59e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa3bc0b1c30 con 0x7fa3bc0d2850 2024-09-10T23:17:15.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.270+0000 7fa3bad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3bc15f430 0x7fa3bc0af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:15.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.270+0000 7fa3bad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3bc15f430 0x7fa3bc0af830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52496/0 (socket says 172.21.15.90:52496) 2024-09-10T23:17:15.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.270+0000 7fa3bad9d640 1 -- 172.21.15.90:0/448310385 learned_addr learned my addr 172.21.15.90:0/448310385 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:15.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.270+0000 7fa3ba59c640 1 --2- 172.21.15.90:0/448310385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3bc0d0820 0x7fa3bc1550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:15.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.270+0000 7fa3b9d9b640 1 --2- 172.21.15.90:0/448310385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3bc0d2850 0x7fa3bc1e52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:15.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.271+0000 7fa3bad9d640 1 -- 172.21.15.90:0/448310385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3bc0d2850 msgr2=0x7fa3bc1e52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:15.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.271+0000 7fa3bad9d640 1 --2- 172.21.15.90:0/448310385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3bc0d2850 0x7fa3bc1e52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.271+0000 7fa3bad9d640 1 -- 172.21.15.90:0/448310385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3bc0d0820 msgr2=0x7fa3bc1550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:15.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.271+0000 7fa3bad9d640 1 --2- 172.21.15.90:0/448310385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3bc0d0820 0x7fa3bc1550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.271+0000 7fa3bad9d640 1 -- 172.21.15.90:0/448310385 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3bc155ac0 con 0x7fa3bc15f430 2024-09-10T23:17:15.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.271+0000 7fa3ba59c640 1 --2- 172.21.15.90:0/448310385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3bc0d0820 0x7fa3bc1550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:15.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.271+0000 7fa3b9d9b640 1 --2- 172.21.15.90:0/448310385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3bc0d2850 0x7fa3bc1e52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:15.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.271+0000 7fa3bad9d640 1 --2- 172.21.15.90:0/448310385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3bc15f430 0x7fa3bc0af830 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400cbc0 tx=0x7fa3b400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:15.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.271+0000 7fa3aaffd640 1 -- 172.21.15.90:0/448310385 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4016020 con 0x7fa3bc15f430 2024-09-10T23:17:15.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.271+0000 7fa3aaffd640 1 -- 172.21.15.90:0/448310385 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3b400add0 con 0x7fa3bc15f430 2024-09-10T23:17:15.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.271+0000 7fa3aaffd640 1 -- 172.21.15.90:0/448310385 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4012680 con 0x7fa3bc15f430 2024-09-10T23:17:15.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.271+0000 7fa3bb59e640 1 -- 172.21.15.90:0/448310385 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3bc1e57e0 con 0x7fa3bc15f430 2024-09-10T23:17:15.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.271+0000 7fa3bb59e640 1 -- 172.21.15.90:0/448310385 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3bc0c66a0 con 0x7fa3bc15f430 2024-09-10T23:17:15.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.272+0000 7fa3bb59e640 1 -- 172.21.15.90:0/448310385 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3bc0b21c0 con 0x7fa3bc15f430 2024-09-10T23:17:15.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.273+0000 7fa3aaffd640 1 -- 172.21.15.90:0/448310385 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa3b4012820 con 0x7fa3bc15f430 2024-09-10T23:17:15.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.273+0000 7fa3aaffd640 1 --2- 172.21.15.90:0/448310385 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa39c077f70 0x7fa39c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:15.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.273+0000 7fa3aaffd640 1 -- 172.21.15.90:0/448310385 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fa3b409a320 con 0x7fa3bc15f430 2024-09-10T23:17:15.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.273+0000 7fa3ba59c640 1 --2- 172.21.15.90:0/448310385 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa39c077f70 0x7fa39c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:15.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.274+0000 7fa3ba59c640 1 --2- 172.21.15.90:0/448310385 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa39c077f70 0x7fa39c07a430 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac034000 tx=0x7fa3ac004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:15.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.277+0000 7fa3aaffd640 1 -- 172.21.15.90:0/448310385 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa3b4020030 con 0x7fa3bc15f430 2024-09-10T23:17:15.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.452+0000 7fa3bb59e640 1 -- 172.21.15.90:0/448310385 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3bc0af030 con 0x7fa3bc15f430 2024-09-10T23:17:15.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.453+0000 7fa3aaffd640 1 -- 172.21.15.90:0/448310385 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16728 (secure 0 0 0) 0x7fa3bc155ac0 con 0x7fa3bc15f430 2024-09-10T23:17:15.455 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:15.455 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":68,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:17:03.163970+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:17:00.138500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-10T23:17:00.479469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:17:15.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.455+0000 7fa3bb59e640 1 -- 172.21.15.90:0/448310385 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa39c077f70 msgr2=0x7fa39c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:15.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.455+0000 7fa3bb59e640 1 --2- 172.21.15.90:0/448310385 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa39c077f70 0x7fa39c07a430 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac034000 tx=0x7fa3ac004730 comp rx=0 tx=0).stop 2024-09-10T23:17:15.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.455+0000 7fa3bb59e640 1 -- 172.21.15.90:0/448310385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3bc15f430 msgr2=0x7fa3bc0af830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:15.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.455+0000 7fa3bb59e640 1 --2- 172.21.15.90:0/448310385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3bc15f430 0x7fa3bc0af830 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400cbc0 tx=0x7fa3b400a430 comp rx=0 tx=0).stop 2024-09-10T23:17:15.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.455+0000 7fa3bb59e640 1 -- 172.21.15.90:0/448310385 shutdown_connections 2024-09-10T23:17:15.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.455+0000 7fa3bb59e640 1 --2- 172.21.15.90:0/448310385 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa39c077f70 0x7fa39c07a430 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.455+0000 7fa3bb59e640 1 --2- 172.21.15.90:0/448310385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3bc15f430 0x7fa3bc0af830 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.455+0000 7fa3bb59e640 1 --2- 172.21.15.90:0/448310385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3bc0d2850 0x7fa3bc1e52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.455+0000 7fa3bb59e640 1 --2- 172.21.15.90:0/448310385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3bc0d0820 0x7fa3bc1550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.455+0000 7fa3bb59e640 1 -- 172.21.15.90:0/448310385 >> 172.21.15.90:0/448310385 conn(0x7fa3bc0d1d30 msgr2=0x7fa3bc0d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:15.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.455+0000 7fa3bb59e640 1 -- 172.21.15.90:0/448310385 shutdown_connections 2024-09-10T23:17:15.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.455+0000 7fa3bb59e640 1 -- 172.21.15.90:0/448310385 wait complete. 2024-09-10T23:17:15.469 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:17:15.469 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:17:15.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.568+0000 7f5856cbe640 1 -- 172.21.15.90:0/343380645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5838004d40 msgr2=0x7f58380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:15.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.568+0000 7f5856cbe640 1 --2- 172.21.15.90:0/343380645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5838004d40 0x7f58380051c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5848001d60 tx=0x7f5838005830 comp rx=0 tx=0).stop 2024-09-10T23:17:15.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.568+0000 7f585525b640 1 -- 172.21.15.90:0/343380645 reap_dead start 2024-09-10T23:17:15.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.568+0000 7f5856cbe640 1 -- 172.21.15.90:0/343380645 shutdown_connections 2024-09-10T23:17:15.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.568+0000 7f5856cbe640 1 -- 172.21.15.90:0/343380645 >> 172.21.15.90:0/343380645 conn(0x7f58500b19c0 msgr2=0x7f58500b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:15.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.568+0000 7f5856cbe640 1 -- 172.21.15.90:0/343380645 shutdown_connections 2024-09-10T23:17:15.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.568+0000 7f5856cbe640 1 -- 172.21.15.90:0/343380645 wait complete. 2024-09-10T23:17:15.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.570+0000 7f5856cbe640 1 Processor -- start 2024-09-10T23:17:15.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.570+0000 7f5856cbe640 1 -- start start 2024-09-10T23:17:15.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.570+0000 7f5856cbe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5838004d40 0x7f585009aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:15.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.570+0000 7f5856cbe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f585009dac0 0x7f585014b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:15.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f5856cbe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58500ca090 0x7f58500ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f5856cbe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f585015aad0 con 0x7f58500ca090 2024-09-10T23:17:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f5856cbe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f58500cdb90 con 0x7f585009dac0 2024-09-10T23:17:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f5856cbe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f58501e9b20 con 0x7f5838004d40 2024-09-10T23:17:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f585525b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58500ca090 0x7f58500ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f585525b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58500ca090 0x7f58500ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52508/0 (socket says 172.21.15.90:52508) 2024-09-10T23:17:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f585525b640 1 -- 172.21.15.90:0/2984041662 learned_addr learned my addr 172.21.15.90:0/2984041662 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f5854a5a640 1 --2- 172.21.15.90:0/2984041662 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5838004d40 0x7f585009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f584ffff640 1 --2- 172.21.15.90:0/2984041662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f585009dac0 0x7f585014b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f585525b640 1 -- 172.21.15.90:0/2984041662 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5838004d40 msgr2=0x7f585009aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f585525b640 1 --2- 172.21.15.90:0/2984041662 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5838004d40 0x7f585009aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f585525b640 1 -- 172.21.15.90:0/2984041662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f585009dac0 msgr2=0x7f585014b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f585525b640 1 --2- 172.21.15.90:0/2984041662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f585009dac0 0x7f585014b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f585525b640 1 -- 172.21.15.90:0/2984041662 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585009df00 con 0x7f58500ca090 2024-09-10T23:17:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f585525b640 1 --2- 172.21.15.90:0/2984041662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58500ca090 0x7f58500ca510 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f584802aca0 tx=0x7f5848001a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f584d7fa640 1 -- 172.21.15.90:0/2984041662 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58480060b0 con 0x7f58500ca090 2024-09-10T23:17:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f584d7fa640 1 -- 172.21.15.90:0/2984041662 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5848006250 con 0x7f58500ca090 2024-09-10T23:17:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f5856cbe640 1 -- 172.21.15.90:0/2984041662 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58501f8650 con 0x7f58500ca090 2024-09-10T23:17:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f584d7fa640 1 -- 172.21.15.90:0/2984041662 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848006660 con 0x7f58500ca090 2024-09-10T23:17:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.571+0000 7f5856cbe640 1 -- 172.21.15.90:0/2984041662 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58501f8c10 con 0x7f58500ca090 2024-09-10T23:17:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.572+0000 7f5856cbe640 1 -- 172.21.15.90:0/2984041662 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58500ce830 con 0x7f58500ca090 2024-09-10T23:17:15.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.573+0000 7f584d7fa640 1 -- 172.21.15.90:0/2984041662 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5848047030 con 0x7f58500ca090 2024-09-10T23:17:15.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.573+0000 7f584d7fa640 1 --2- 172.21.15.90:0/2984041662 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f583c077f70 0x7f583c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:15.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.573+0000 7f584d7fa640 1 -- 172.21.15.90:0/2984041662 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f58480b9490 con 0x7f58500ca090 2024-09-10T23:17:15.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.573+0000 7f5854a5a640 1 --2- 172.21.15.90:0/2984041662 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f583c077f70 0x7f583c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:15.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.574+0000 7f5854a5a640 1 --2- 172.21.15.90:0/2984041662 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f583c077f70 0x7f583c07a430 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5840006cd0 tx=0x7f58400067a0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:15.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.577+0000 7f584d7fa640 1 -- 172.21.15.90:0/2984041662 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5848082020 con 0x7f58500ca090 2024-09-10T23:17:15.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.789+0000 7f5856cbe640 1 -- 172.21.15.90:0/2984041662 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58500ccc40 con 0x7f58500ca090 2024-09-10T23:17:15.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.790+0000 7f584d7fa640 1 -- 172.21.15.90:0/2984041662 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5225 (secure 0 0 0) 0x7f5848081920 con 0x7f58500ca090 2024-09-10T23:17:15.792 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:15.792 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"btime":"2024-09-10T23:17:04:184091+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5554,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/946078081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":946078081},{"type":"v1","addr":"172.21.15.171:6836","nonce":946078081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1081121108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1081121108},{"type":"v1","addr":"172.21.15.171:6837","nonce":1081121108}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6003,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/2444726710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2444726710},{"type":"v1","addr":"172.21.15.90:6834","nonce":2444726710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:01.524854+0000","modified":"2024-09-10T23:17:03.520058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/696526367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":696526367},{"type":"v1","addr":"172.21.15.90:6835","nonce":696526367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6006,"qdb_cluster":[6006]},"id":5}]} 2024-09-10T23:17:15.792 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 38 2024-09-10T23:17:15.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.792+0000 7f5856cbe640 1 -- 172.21.15.90:0/2984041662 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f583c077f70 msgr2=0x7f583c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:15.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.792+0000 7f5856cbe640 1 --2- 172.21.15.90:0/2984041662 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f583c077f70 0x7f583c07a430 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5840006cd0 tx=0x7f58400067a0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.792+0000 7f5856cbe640 1 -- 172.21.15.90:0/2984041662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58500ca090 msgr2=0x7f58500ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.792+0000 7f5856cbe640 1 --2- 172.21.15.90:0/2984041662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58500ca090 0x7f58500ca510 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f584802aca0 tx=0x7f5848001a90 comp rx=0 tx=0).stop 2024-09-10T23:17:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.792+0000 7f5856cbe640 1 -- 172.21.15.90:0/2984041662 shutdown_connections 2024-09-10T23:17:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.792+0000 7f5856cbe640 1 --2- 172.21.15.90:0/2984041662 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f583c077f70 0x7f583c07a430 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.792+0000 7f5856cbe640 1 --2- 172.21.15.90:0/2984041662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f585009dac0 0x7f585014b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.792+0000 7f5856cbe640 1 --2- 172.21.15.90:0/2984041662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58500ca090 0x7f58500ca510 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.792+0000 7f5856cbe640 1 --2- 172.21.15.90:0/2984041662 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5838004d40 0x7f585009aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.792+0000 7f5856cbe640 1 -- 172.21.15.90:0/2984041662 >> 172.21.15.90:0/2984041662 conn(0x7f58500b19c0 msgr2=0x7f58500736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.792+0000 7f5856cbe640 1 -- 172.21.15.90:0/2984041662 shutdown_connections 2024-09-10T23:17:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.792+0000 7f5856cbe640 1 -- 172.21.15.90:0/2984041662 wait complete. 2024-09-10T23:17:15.806 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:17:15.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.904+0000 7feb1d17d640 1 -- 172.21.15.90:0/471689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb180cd470 msgr2=0x7feb1815e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:15.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.904+0000 7feb1d17d640 1 --2- 172.21.15.90:0/471689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb180cd470 0x7feb1815e890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb10005fd0 tx=0x7feb1002aa10 comp rx=0 tx=0).stop 2024-09-10T23:17:15.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.904+0000 7feb1d17d640 1 -- 172.21.15.90:0/471689 shutdown_connections 2024-09-10T23:17:15.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.905+0000 7feb1d17d640 1 --2- 172.21.15.90:0/471689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb180cd470 0x7feb1815e890 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.905+0000 7feb1d17d640 1 --2- 172.21.15.90:0/471689 >> v2:172.21.15.171:3300/0 conn(0x7feb180b44a0 0x7feb180b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.905+0000 7feb1d17d640 1 -- 172.21.15.90:0/471689 >> 172.21.15.90:0/471689 conn(0x7feb180b19c0 msgr2=0x7feb180b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:15.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.905+0000 7feb1d17d640 1 -- 172.21.15.90:0/471689 shutdown_connections 2024-09-10T23:17:15.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.905+0000 7feb1d17d640 1 -- 172.21.15.90:0/471689 wait complete. 2024-09-10T23:17:15.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.906+0000 7feb1d17d640 1 Processor -- start 2024-09-10T23:17:15.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.906+0000 7feb1d17d640 1 -- start start 2024-09-10T23:17:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.907+0000 7feb1d17d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb180b44a0 0x7feb18149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.907+0000 7feb1d17d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb180cd470 0x7feb18156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.907+0000 7feb1d17d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb180cf860 0x7feb181581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.907+0000 7feb1d17d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feb180ceba0 con 0x7feb180b44a0 2024-09-10T23:17:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.907+0000 7feb1d17d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feb1806f6d0 con 0x7feb180cf860 2024-09-10T23:17:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.907+0000 7feb1d17d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7feb180ced20 con 0x7feb180cd470 2024-09-10T23:17:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.907+0000 7feb16d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb180b44a0 0x7feb18149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.907+0000 7feb16d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb180b44a0 0x7feb18149ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52510/0 (socket says 172.21.15.90:52510) 2024-09-10T23:17:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.907+0000 7feb16d9d640 1 -- 172.21.15.90:0/4071525211 learned_addr learned my addr 172.21.15.90:0/4071525211 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:15.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.907+0000 7feb1659c640 1 --2- 172.21.15.90:0/4071525211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb180cd470 0x7feb18156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:15.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.907+0000 7feb1759e640 1 --2- 172.21.15.90:0/4071525211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb180cf860 0x7feb181581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:15.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.907+0000 7feb16d9d640 1 -- 172.21.15.90:0/4071525211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb180cd470 msgr2=0x7feb18156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:15.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.907+0000 7feb16d9d640 1 --2- 172.21.15.90:0/4071525211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb180cd470 0x7feb18156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.907+0000 7feb16d9d640 1 -- 172.21.15.90:0/4071525211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb180cf860 msgr2=0x7feb181581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:15.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.907+0000 7feb16d9d640 1 --2- 172.21.15.90:0/4071525211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb180cf860 0x7feb181581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:15.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.907+0000 7feb16d9d640 1 -- 172.21.15.90:0/4071525211 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb18158a30 con 0x7feb180b44a0 2024-09-10T23:17:15.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.907+0000 7feb16d9d640 1 --2- 172.21.15.90:0/4071525211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb180b44a0 0x7feb18149ad0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7feb0800ea20 tx=0x7feb0800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:15.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.908+0000 7feb0f7fe640 1 -- 172.21.15.90:0/4071525211 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0800cd80 con 0x7feb180b44a0 2024-09-10T23:17:15.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.908+0000 7feb0f7fe640 1 -- 172.21.15.90:0/4071525211 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb08010430 con 0x7feb180b44a0 2024-09-10T23:17:15.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.908+0000 7feb1d17d640 1 -- 172.21.15.90:0/4071525211 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb18156480 con 0x7feb180b44a0 2024-09-10T23:17:15.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.908+0000 7feb0f7fe640 1 -- 172.21.15.90:0/4071525211 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb08010840 con 0x7feb180b44a0 2024-09-10T23:17:15.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.908+0000 7feb1d17d640 1 -- 172.21.15.90:0/4071525211 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb18156a40 con 0x7feb180b44a0 2024-09-10T23:17:15.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.909+0000 7feb1d17d640 1 -- 172.21.15.90:0/4071525211 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb180b4880 con 0x7feb180b44a0 2024-09-10T23:17:15.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.909+0000 7feb0f7fe640 1 -- 172.21.15.90:0/4071525211 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7feb080109e0 con 0x7feb180b44a0 2024-09-10T23:17:15.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.910+0000 7feb0f7fe640 1 --2- 172.21.15.90:0/4071525211 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feaf8077f70 0x7feaf807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:15.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.910+0000 7feb0f7fe640 1 -- 172.21.15.90:0/4071525211 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7feb0809a870 con 0x7feb180b44a0 2024-09-10T23:17:15.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.910+0000 7feb1659c640 1 --2- 172.21.15.90:0/4071525211 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feaf8077f70 0x7feaf807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:15.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.910+0000 7feb1659c640 1 --2- 172.21.15.90:0/4071525211 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feaf8077f70 0x7feaf807a430 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feb180b1530 tx=0x7feb00009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:15.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:15.914+0000 7feb0f7fe640 1 -- 172.21.15.90:0/4071525211 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7feb08062d30 con 0x7feb180b44a0 2024-09-10T23:17:16.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.121+0000 7feb1d17d640 1 -- 172.21.15.90:0/4071525211 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb180ccfb0 con 0x7feb180b44a0 2024-09-10T23:17:16.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.122+0000 7feb0f7fe640 1 -- 172.21.15.90:0/4071525211 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5225 (secure 0 0 0) 0x7feb08067760 con 0x7feb180b44a0 2024-09-10T23:17:16.124 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:16.124 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"btime":"2024-09-10T23:17:04:184091+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5554,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/946078081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":946078081},{"type":"v1","addr":"172.21.15.171:6836","nonce":946078081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1081121108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1081121108},{"type":"v1","addr":"172.21.15.171:6837","nonce":1081121108}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6003,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/2444726710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2444726710},{"type":"v1","addr":"172.21.15.90:6834","nonce":2444726710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:01.524854+0000","modified":"2024-09-10T23:17:03.520058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6006":{"gid":6006,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/696526367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":696526367},{"type":"v1","addr":"172.21.15.90:6835","nonce":696526367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6006,"qdb_cluster":[6006]},"id":5}]} 2024-09-10T23:17:16.124 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 38 2024-09-10T23:17:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.124+0000 7feb1d17d640 1 -- 172.21.15.90:0/4071525211 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feaf8077f70 msgr2=0x7feaf807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.124+0000 7feb1d17d640 1 --2- 172.21.15.90:0/4071525211 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feaf8077f70 0x7feaf807a430 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feb180b1530 tx=0x7feb00009040 comp rx=0 tx=0).stop 2024-09-10T23:17:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.124+0000 7feb1d17d640 1 -- 172.21.15.90:0/4071525211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb180b44a0 msgr2=0x7feb18149ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.124+0000 7feb1d17d640 1 --2- 172.21.15.90:0/4071525211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb180b44a0 0x7feb18149ad0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7feb0800ea20 tx=0x7feb0800eee0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.124+0000 7feb1d17d640 1 -- 172.21.15.90:0/4071525211 shutdown_connections 2024-09-10T23:17:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.124+0000 7feb1d17d640 1 --2- 172.21.15.90:0/4071525211 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feaf8077f70 0x7feaf807a430 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.124+0000 7feb1d17d640 1 --2- 172.21.15.90:0/4071525211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb180cf860 0x7feb181581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.124+0000 7feb1d17d640 1 --2- 172.21.15.90:0/4071525211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb180cd470 0x7feb18156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.124+0000 7feb1d17d640 1 --2- 172.21.15.90:0/4071525211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb180b44a0 0x7feb18149ad0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.124+0000 7feb1d17d640 1 -- 172.21.15.90:0/4071525211 >> 172.21.15.90:0/4071525211 conn(0x7feb180b19c0 msgr2=0x7feb18152540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:16.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.124+0000 7feb1d17d640 1 -- 172.21.15.90:0/4071525211 shutdown_connections 2024-09-10T23:17:16.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.124+0000 7feb1d17d640 1 -- 172.21.15.90:0/4071525211 wait complete. 2024-09-10T23:17:16.137 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:17:16.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.237+0000 7f2f0393d640 1 -- 172.21.15.90:0/2942007909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ee4004800 msgr2=0x7f2ee4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:16.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.237+0000 7f2f0393d640 1 --2- 172.21.15.90:0/2942007909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ee4004800 0x7f2ee4004c80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009b50 tx=0x7f2ee4005830 comp rx=0 tx=0).stop 2024-09-10T23:17:16.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.237+0000 7f2f01eda640 1 -- 172.21.15.90:0/2942007909 reap_dead start 2024-09-10T23:17:16.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.237+0000 7f2f0393d640 1 -- 172.21.15.90:0/2942007909 shutdown_connections 2024-09-10T23:17:16.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.237+0000 7f2f0393d640 1 -- 172.21.15.90:0/2942007909 >> 172.21.15.90:0/2942007909 conn(0x7f2efc0d4090 msgr2=0x7f2efc0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:16.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.237+0000 7f2f0393d640 1 -- 172.21.15.90:0/2942007909 shutdown_connections 2024-09-10T23:17:16.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.237+0000 7f2f0393d640 1 -- 172.21.15.90:0/2942007909 wait complete. 2024-09-10T23:17:16.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.238+0000 7f2f0393d640 1 Processor -- start 2024-09-10T23:17:16.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.238+0000 7f2f0393d640 1 -- start start 2024-09-10T23:17:16.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.239+0000 7f2f0393d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2efc153c90 0x7f2efc0b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:16.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.239+0000 7f2f0393d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2efc154070 0x7f2efc0b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:16.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.239+0000 7f2f0393d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2efc1f86c0 0x7f2efc1f8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:16.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.239+0000 7f2f0393d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc0d0fc0 con 0x7f2efc1f86c0 2024-09-10T23:17:16.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.239+0000 7f2f0393d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc0d3ae0 con 0x7f2efc154070 2024-09-10T23:17:16.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.239+0000 7f2f0393d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2efc0d1140 con 0x7f2efc153c90 2024-09-10T23:17:16.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.239+0000 7f2f01eda640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2efc1f86c0 0x7f2efc1f8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:16.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.239+0000 7f2f01eda640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2efc1f86c0 0x7f2efc1f8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52528/0 (socket says 172.21.15.90:52528) 2024-09-10T23:17:16.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.239+0000 7f2f01eda640 1 -- 172.21.15.90:0/4204471718 learned_addr learned my addr 172.21.15.90:0/4204471718 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:16.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.239+0000 7f2f016d9640 1 --2- 172.21.15.90:0/4204471718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2efc153c90 0x7f2efc0b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:16.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.239+0000 7f2f00ed8640 1 --2- 172.21.15.90:0/4204471718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2efc154070 0x7f2efc0b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:16.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.239+0000 7f2f01eda640 1 -- 172.21.15.90:0/4204471718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2efc153c90 msgr2=0x7f2efc0b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:16.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.239+0000 7f2f01eda640 1 --2- 172.21.15.90:0/4204471718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2efc153c90 0x7f2efc0b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.239+0000 7f2f01eda640 1 -- 172.21.15.90:0/4204471718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2efc154070 msgr2=0x7f2efc0b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:16.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.239+0000 7f2f01eda640 1 --2- 172.21.15.90:0/4204471718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2efc154070 0x7f2efc0b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.239+0000 7f2f01eda640 1 -- 172.21.15.90:0/4204471718 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc1f9050 con 0x7f2efc1f86c0 2024-09-10T23:17:16.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.239+0000 7f2f01eda640 1 --2- 172.21.15.90:0/4204471718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2efc1f86c0 0x7f2efc1f8b10 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f2efc08e420 tx=0x7f2ef400e8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:16.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.240+0000 7f2ef9ffb640 1 -- 172.21.15.90:0/4204471718 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4011870 con 0x7f2efc1f86c0 2024-09-10T23:17:16.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.240+0000 7f2ef9ffb640 1 -- 172.21.15.90:0/4204471718 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ef4017070 con 0x7f2efc1f86c0 2024-09-10T23:17:16.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.240+0000 7f2f0393d640 1 -- 172.21.15.90:0/4204471718 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2efc1f92d0 con 0x7f2efc1f86c0 2024-09-10T23:17:16.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.240+0000 7f2ef9ffb640 1 -- 172.21.15.90:0/4204471718 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4011dc0 con 0x7f2efc1f86c0 2024-09-10T23:17:16.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.240+0000 7f2f0393d640 1 -- 172.21.15.90:0/4204471718 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2efc0cb570 con 0x7f2efc1f86c0 2024-09-10T23:17:16.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.241+0000 7f2f0393d640 1 -- 172.21.15.90:0/4204471718 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2efc06e700 con 0x7f2efc1f86c0 2024-09-10T23:17:16.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.241+0000 7f2ef9ffb640 1 -- 172.21.15.90:0/4204471718 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2ef401c460 con 0x7f2efc1f86c0 2024-09-10T23:17:16.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.242+0000 7f2ef9ffb640 1 --2- 172.21.15.90:0/4204471718 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ee8077f70 0x7f2ee807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:16.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.242+0000 7f2ef9ffb640 1 -- 172.21.15.90:0/4204471718 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f2ef4099ed0 con 0x7f2efc1f86c0 2024-09-10T23:17:16.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.242+0000 7f2f016d9640 1 --2- 172.21.15.90:0/4204471718 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ee8077f70 0x7f2ee807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:16.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.243+0000 7f2f016d9640 1 --2- 172.21.15.90:0/4204471718 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ee8077f70 0x7f2ee807a430 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2eec005fd0 tx=0x7f2eec009500 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:16.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.246+0000 7f2ef9ffb640 1 -- 172.21.15.90:0/4204471718 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2efc06e700 con 0x7f2efc1f86c0 2024-09-10T23:17:16.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.422+0000 7f2f0393d640 1 -- 172.21.15.90:0/4204471718 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2efc06a2f0 con 0x7f2efc1f86c0 2024-09-10T23:17:16.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.423+0000 7f2ef9ffb640 1 -- 172.21.15.90:0/4204471718 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16728 (secure 0 0 0) 0x7f2efc06a2f0 con 0x7f2efc1f86c0 2024-09-10T23:17:16.440 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:16.440 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":68,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:17:03.163970+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:17:00.138500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-10T23:17:00.479469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:17:16.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.426+0000 7f2f0393d640 1 -- 172.21.15.90:0/4204471718 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ee8077f70 msgr2=0x7f2ee807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:16.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.426+0000 7f2f0393d640 1 --2- 172.21.15.90:0/4204471718 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ee8077f70 0x7f2ee807a430 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2eec005fd0 tx=0x7f2eec009500 comp rx=0 tx=0).stop 2024-09-10T23:17:16.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.426+0000 7f2f0393d640 1 -- 172.21.15.90:0/4204471718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2efc1f86c0 msgr2=0x7f2efc1f8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:16.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.426+0000 7f2f0393d640 1 --2- 172.21.15.90:0/4204471718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2efc1f86c0 0x7f2efc1f8b10 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f2efc08e420 tx=0x7f2ef400e8e0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.426+0000 7f2f0393d640 1 -- 172.21.15.90:0/4204471718 shutdown_connections 2024-09-10T23:17:16.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.426+0000 7f2f0393d640 1 --2- 172.21.15.90:0/4204471718 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2ee8077f70 0x7f2ee807a430 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.426+0000 7f2f0393d640 1 --2- 172.21.15.90:0/4204471718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2efc154070 0x7f2efc0b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.426+0000 7f2f0393d640 1 --2- 172.21.15.90:0/4204471718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2efc1f86c0 0x7f2efc1f8b10 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.426+0000 7f2f0393d640 1 --2- 172.21.15.90:0/4204471718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2efc153c90 0x7f2efc0b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.426+0000 7f2f0393d640 1 -- 172.21.15.90:0/4204471718 >> 172.21.15.90:0/4204471718 conn(0x7f2efc0d4090 msgr2=0x7f2efc0b6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:16.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.426+0000 7f2f0393d640 1 -- 172.21.15.90:0/4204471718 shutdown_connections 2024-09-10T23:17:16.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.426+0000 7f2f0393d640 1 -- 172.21.15.90:0/4204471718 wait complete. 2024-09-10T23:17:16.443 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:17:16.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.544+0000 7f2ddae16640 1 -- 172.21.15.90:0/1511939151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd40b3000 msgr2=0x7f2dd40b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:16.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.544+0000 7f2ddae16640 1 --2- 172.21.15.90:0/1511939151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd40b3000 0x7f2dd40b0c00 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0005fd0 tx=0x7f2dc002a5d0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.544+0000 7f2ddae16640 1 -- 172.21.15.90:0/1511939151 shutdown_connections 2024-09-10T23:17:16.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.544+0000 7f2ddae16640 1 --2- 172.21.15.90:0/1511939151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd40d24f0 0x7f2dd40d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.544+0000 7f2ddae16640 1 --2- 172.21.15.90:0/1511939151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd40b3000 0x7f2dd40b0c00 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.544+0000 7f2ddae16640 1 -- 172.21.15.90:0/1511939151 >> 172.21.15.90:0/1511939151 conn(0x7f2dd40d40b0 msgr2=0x7f2dd40d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:16.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.544+0000 7f2ddae16640 1 -- 172.21.15.90:0/1511939151 shutdown_connections 2024-09-10T23:17:16.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.545+0000 7f2ddae16640 1 -- 172.21.15.90:0/1511939151 wait complete. 2024-09-10T23:17:16.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.546+0000 7f2ddae16640 1 Processor -- start 2024-09-10T23:17:16.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.546+0000 7f2ddae16640 1 -- start start 2024-09-10T23:17:16.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.547+0000 7f2ddae16640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd40b3000 0x7f2dd415c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:16.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.547+0000 7f2ddae16640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd40d24f0 0x7f2dd4160af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:16.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.547+0000 7f2ddae16640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd415e1a0 0x7f2dd40b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:16.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.547+0000 7f2ddae16640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd40d1090 con 0x7f2dd40b3000 2024-09-10T23:17:16.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.547+0000 7f2ddae16640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd40d0f10 con 0x7f2dd415e1a0 2024-09-10T23:17:16.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.547+0000 7f2ddae16640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd40d1210 con 0x7f2dd40d24f0 2024-09-10T23:17:16.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.547+0000 7f2dd8bb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd40b3000 0x7f2dd415c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:16.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.547+0000 7f2dd8bb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd40b3000 0x7f2dd415c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52546/0 (socket says 172.21.15.90:52546) 2024-09-10T23:17:16.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.547+0000 7f2dd8bb2640 1 -- 172.21.15.90:0/1615263082 learned_addr learned my addr 172.21.15.90:0/1615263082 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:16.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.547+0000 7f2dd3fff640 1 --2- 172.21.15.90:0/1615263082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd40d24f0 0x7f2dd4160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:16.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.547+0000 7f2dd93b3640 1 --2- 172.21.15.90:0/1615263082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd415e1a0 0x7f2dd40b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:16.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.548+0000 7f2dd8bb2640 1 -- 172.21.15.90:0/1615263082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd40d24f0 msgr2=0x7f2dd4160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:16.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.548+0000 7f2dd8bb2640 1 --2- 172.21.15.90:0/1615263082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd40d24f0 0x7f2dd4160af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.548+0000 7f2dd8bb2640 1 -- 172.21.15.90:0/1615263082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd415e1a0 msgr2=0x7f2dd40b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:16.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.548+0000 7f2dd8bb2640 1 --2- 172.21.15.90:0/1615263082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd415e1a0 0x7f2dd40b1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.548+0000 7f2dd8bb2640 1 -- 172.21.15.90:0/1615263082 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd41615b0 con 0x7f2dd40b3000 2024-09-10T23:17:16.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.548+0000 7f2dd8bb2640 1 --2- 172.21.15.90:0/1615263082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd40b3000 0x7f2dd415c4a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800c3c0 tx=0x7f2dc800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:16.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.548+0000 7f2dd17fa640 1 -- 172.21.15.90:0/1615263082 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8017070 con 0x7f2dd40b3000 2024-09-10T23:17:16.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.548+0000 7f2dd17fa640 1 -- 172.21.15.90:0/1615263082 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2dc80035f0 con 0x7f2dd40b3000 2024-09-10T23:17:16.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.548+0000 7f2ddae16640 1 -- 172.21.15.90:0/1615263082 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd415f680 con 0x7f2dd40b3000 2024-09-10T23:17:16.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.548+0000 7f2dd17fa640 1 -- 172.21.15.90:0/1615263082 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8003a80 con 0x7f2dd40b3000 2024-09-10T23:17:16.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.548+0000 7f2ddae16640 1 -- 172.21.15.90:0/1615263082 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd415ff20 con 0x7f2dd40b3000 2024-09-10T23:17:16.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.549+0000 7f2ddae16640 1 -- 172.21.15.90:0/1615263082 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd40d16c0 con 0x7f2dd40b3000 2024-09-10T23:17:16.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.550+0000 7f2dd17fa640 1 -- 172.21.15.90:0/1615263082 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2dc8003c20 con 0x7f2dd40b3000 2024-09-10T23:17:16.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.550+0000 7f2dd17fa640 1 --2- 172.21.15.90:0/1615263082 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2db8077f70 0x7f2db807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:16.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.550+0000 7f2dd17fa640 1 -- 172.21.15.90:0/1615263082 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5767+0+0 (secure 0 0 0) 0x7f2dc8099300 con 0x7f2dd40b3000 2024-09-10T23:17:16.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.550+0000 7f2dd3fff640 1 --2- 172.21.15.90:0/1615263082 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2db8077f70 0x7f2db807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:16.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.551+0000 7f2dd3fff640 1 --2- 172.21.15.90:0/1615263082 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2db8077f70 0x7f2db807a430 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0033000 tx=0x7f2dc0004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:16.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.554+0000 7f2dd17fa640 1 -- 172.21.15.90:0/1615263082 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2dc8061770 con 0x7f2dd40b3000 2024-09-10T23:17:16.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.765+0000 7f2ddae16640 1 -- 172.21.15.90:0/1615263082 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2dd415f850 con 0x7f2dd40b3000 2024-09-10T23:17:16.768 INFO:tasks.ceph.mon.a.smithi090.stderr:2024-09-10T23:17:16.766+0000 7f1a0c84c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:17:16.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.768+0000 7f2dd17fa640 1 -- 172.21.15.90:0/1615263082 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) ==== 161+0+0 (secure 0 0 0) 0x7f2dc80661a0 con 0x7f2dd40b3000 2024-09-10T23:17:16.769 INFO:teuthology.orchestra.run.smithi090.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:17:16.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.771+0000 7f2ddae16640 1 -- 172.21.15.90:0/1615263082 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2db8077f70 msgr2=0x7f2db807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:16.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.771+0000 7f2ddae16640 1 --2- 172.21.15.90:0/1615263082 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2db8077f70 0x7f2db807a430 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0033000 tx=0x7f2dc0004730 comp rx=0 tx=0).stop 2024-09-10T23:17:16.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.771+0000 7f2ddae16640 1 -- 172.21.15.90:0/1615263082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd40b3000 msgr2=0x7f2dd415c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:16.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.771+0000 7f2ddae16640 1 --2- 172.21.15.90:0/1615263082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd40b3000 0x7f2dd415c4a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800c3c0 tx=0x7f2dc800c880 comp rx=0 tx=0).stop 2024-09-10T23:17:16.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.771+0000 7f2ddae16640 1 -- 172.21.15.90:0/1615263082 shutdown_connections 2024-09-10T23:17:16.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.771+0000 7f2ddae16640 1 --2- 172.21.15.90:0/1615263082 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2db8077f70 0x7f2db807a430 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.771+0000 7f2ddae16640 1 --2- 172.21.15.90:0/1615263082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd415e1a0 0x7f2dd40b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.771+0000 7f2ddae16640 1 --2- 172.21.15.90:0/1615263082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd40d24f0 0x7f2dd4160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.771+0000 7f2ddae16640 1 --2- 172.21.15.90:0/1615263082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd40b3000 0x7f2dd415c4a0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.771+0000 7f2ddae16640 1 -- 172.21.15.90:0/1615263082 >> 172.21.15.90:0/1615263082 conn(0x7f2dd40d40b0 msgr2=0x7f2dd40b7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:16.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.771+0000 7f2ddae16640 1 -- 172.21.15.90:0/1615263082 shutdown_connections 2024-09-10T23:17:16.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.771+0000 7f2ddae16640 1 -- 172.21.15.90:0/1615263082 wait complete. 2024-09-10T23:17:16.775 INFO:tasks.ceph.mds.a.smithi090.stderr: -2157> 2024-09-10T23:17:05.163+0000 7ff725e43640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:17:16.786 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:17:16.802 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-09-10T23:17:16.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.887+0000 7fbcb965a640 1 -- 172.21.15.90:0/2486507951 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbcb40d1190 msgr2=0x7fbcb40d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:16.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.887+0000 7fbcb965a640 1 --2- 172.21.15.90:0/2486507951 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbcb40d1190 0x7fbcb40d28c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbcb40ce670 tx=0x7fbc9c02a4a0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.888+0000 7fbcb965a640 1 -- 172.21.15.90:0/2486507951 shutdown_connections 2024-09-10T23:17:16.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.888+0000 7fbcb965a640 1 --2- 172.21.15.90:0/2486507951 >> v2:172.21.15.171:3300/0 conn(0x7fbcb40d16f0 0x7fbcb40d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.888+0000 7fbcb965a640 1 --2- 172.21.15.90:0/2486507951 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbcb40d1190 0x7fbcb40d28c0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.888+0000 7fbcb965a640 1 -- 172.21.15.90:0/2486507951 >> 172.21.15.90:0/2486507951 conn(0x7fbcb40d4090 msgr2=0x7fbcb40d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:16.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.888+0000 7fbcb965a640 1 -- 172.21.15.90:0/2486507951 shutdown_connections 2024-09-10T23:17:16.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.888+0000 7fbcb965a640 1 -- 172.21.15.90:0/2486507951 wait complete. 2024-09-10T23:17:16.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.889+0000 7fbcb965a640 1 Processor -- start 2024-09-10T23:17:16.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.889+0000 7fbcb965a640 1 -- start start 2024-09-10T23:17:16.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb965a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcb40d1190 0x7fbcb41583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:16.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb965a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcb40d16f0 0x7fbcb41f4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:16.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb965a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbcb415e310 0x7fbcb40b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:16.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb965a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb40d3340 con 0x7fbcb415e310 2024-09-10T23:17:16.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb965a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb40d4d90 con 0x7fbcb40d1190 2024-09-10T23:17:16.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb965a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb40d34c0 con 0x7fbcb40d16f0 2024-09-10T23:17:16.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbcb415e310 0x7fbcb40b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:16.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbcb415e310 0x7fbcb40b6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52584/0 (socket says 172.21.15.90:52584) 2024-09-10T23:17:16.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb37fe640 1 -- 172.21.15.90:0/4176117498 learned_addr learned my addr 172.21.15.90:0/4176117498 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:16.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb27fc640 1 --2- 172.21.15.90:0/4176117498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcb40d16f0 0x7fbcb41f4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:16.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb2ffd640 1 --2- 172.21.15.90:0/4176117498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcb40d1190 0x7fbcb41583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:16.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb37fe640 1 -- 172.21.15.90:0/4176117498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcb40d16f0 msgr2=0x7fbcb41f4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:16.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb37fe640 1 --2- 172.21.15.90:0/4176117498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcb40d16f0 0x7fbcb41f4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb37fe640 1 -- 172.21.15.90:0/4176117498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcb40d1190 msgr2=0x7fbcb41583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:16.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb37fe640 1 --2- 172.21.15.90:0/4176117498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcb40d1190 0x7fbcb41583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:16.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb37fe640 1 -- 172.21.15.90:0/4176117498 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb41f5140 con 0x7fbcb415e310 2024-09-10T23:17:16.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb37fe640 1 --2- 172.21.15.90:0/4176117498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbcb415e310 0x7fbcb40b6ec0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00cad0 tx=0x7fbcac00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:16.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcab7fe640 1 -- 172.21.15.90:0/4176117498 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac00adc0 con 0x7fbcb415e310 2024-09-10T23:17:16.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcab7fe640 1 -- 172.21.15.90:0/4176117498 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcac004b20 con 0x7fbcb415e310 2024-09-10T23:17:16.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb965a640 1 -- 172.21.15.90:0/4176117498 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb41f5420 con 0x7fbcb415e310 2024-09-10T23:17:16.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcab7fe640 1 -- 172.21.15.90:0/4176117498 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac005020 con 0x7fbcb415e310 2024-09-10T23:17:16.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.890+0000 7fbcb965a640 1 -- 172.21.15.90:0/4176117498 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb4160210 con 0x7fbcb415e310 2024-09-10T23:17:16.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.891+0000 7fbcb965a640 1 -- 172.21.15.90:0/4176117498 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb406ebf0 con 0x7fbcb415e310 2024-09-10T23:17:16.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.892+0000 7fbcab7fe640 1 -- 172.21.15.90:0/4176117498 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbcac0051c0 con 0x7fbcb415e310 2024-09-10T23:17:16.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.893+0000 7fbcab7fe640 1 --2- 172.21.15.90:0/4176117498 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbc94077f70 0x7fbc9407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:16.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.893+0000 7fbcab7fe640 1 -- 172.21.15.90:0/4176117498 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5853+0+0 (secure 0 0 0) 0x7fbcac09a500 con 0x7fbcb415e310 2024-09-10T23:17:16.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.893+0000 7fbcb2ffd640 1 --2- 172.21.15.90:0/4176117498 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbc94077f70 0x7fbc9407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:16.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.893+0000 7fbcb2ffd640 1 --2- 172.21.15.90:0/4176117498 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbc94077f70 0x7fbc9407a430 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbca4000f60 tx=0x7fbca4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:16.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:16.897+0000 7fbcab7fe640 1 -- 172.21.15.90:0/4176117498 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbcb406ebf0 con 0x7fbcb415e310 2024-09-10T23:17:17.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.107+0000 7fbcb965a640 1 -- 172.21.15.90:0/4176117498 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fbcb40d3970 con 0x7fbcb415e310 2024-09-10T23:17:17.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.772+0000 7fbcab7fe640 1 -- 172.21.15.90:0/4176117498 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) ==== 104+0+0 (secure 0 0 0) 0x7fbcac014030 con 0x7fbcb415e310 2024-09-10T23:17:17.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.774+0000 7fbcb965a640 1 -- 172.21.15.90:0/4176117498 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbc94077f70 msgr2=0x7fbc9407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:17.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.774+0000 7fbcb965a640 1 --2- 172.21.15.90:0/4176117498 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbc94077f70 0x7fbc9407a430 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbca4000f60 tx=0x7fbca4009040 comp rx=0 tx=0).stop 2024-09-10T23:17:17.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.774+0000 7fbcb965a640 1 -- 172.21.15.90:0/4176117498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbcb415e310 msgr2=0x7fbcb40b6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:17.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.774+0000 7fbcb965a640 1 --2- 172.21.15.90:0/4176117498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbcb415e310 0x7fbcb40b6ec0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00cad0 tx=0x7fbcac00cf90 comp rx=0 tx=0).stop 2024-09-10T23:17:17.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.774+0000 7fbcb965a640 1 -- 172.21.15.90:0/4176117498 shutdown_connections 2024-09-10T23:17:17.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.774+0000 7fbcb965a640 1 --2- 172.21.15.90:0/4176117498 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbc94077f70 0x7fbc9407a430 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:17.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.774+0000 7fbcb965a640 1 --2- 172.21.15.90:0/4176117498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbcb415e310 0x7fbcb40b6ec0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:17.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.774+0000 7fbcb965a640 1 --2- 172.21.15.90:0/4176117498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcb40d16f0 0x7fbcb41f4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:17.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.774+0000 7fbcb965a640 1 --2- 172.21.15.90:0/4176117498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcb40d1190 0x7fbcb41583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:17.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.774+0000 7fbcb965a640 1 -- 172.21.15.90:0/4176117498 >> 172.21.15.90:0/4176117498 conn(0x7fbcb40d4090 msgr2=0x7fbcb40b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:17.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.774+0000 7fbcb965a640 1 -- 172.21.15.90:0/4176117498 shutdown_connections 2024-09-10T23:17:17.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.774+0000 7fbcb965a640 1 -- 172.21.15.90:0/4176117498 wait complete. 2024-09-10T23:17:17.789 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:17:17.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.938+0000 7fdd22616640 1 -- 172.21.15.90:0/1637923831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd04004800 msgr2=0x7fdd04004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:17.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.938+0000 7fdd22616640 1 --2- 172.21.15.90:0/1637923831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd04004800 0x7fdd04004c80 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fdd10009b50 tx=0x7fdd04005830 comp rx=0 tx=0).stop 2024-09-10T23:17:17.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.938+0000 7fdd20bb3640 1 -- 172.21.15.90:0/1637923831 reap_dead start 2024-09-10T23:17:17.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.938+0000 7fdd22616640 1 -- 172.21.15.90:0/1637923831 shutdown_connections 2024-09-10T23:17:17.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.938+0000 7fdd22616640 1 -- 172.21.15.90:0/1637923831 >> 172.21.15.90:0/1637923831 conn(0x7fdd1c0b1aa0 msgr2=0x7fdd1c0b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:17.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.938+0000 7fdd22616640 1 -- 172.21.15.90:0/1637923831 shutdown_connections 2024-09-10T23:17:17.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.938+0000 7fdd22616640 1 -- 172.21.15.90:0/1637923831 wait complete. 2024-09-10T23:17:17.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.939+0000 7fdd22616640 1 Processor -- start 2024-09-10T23:17:17.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.939+0000 7fdd22616640 1 -- start start 2024-09-10T23:17:17.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd22616640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd04004800 0x7fdd1c151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:17.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd22616640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd1c0caa00 0x7fdd1c0caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:17.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd22616640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd1c0cb4d0 0x7fdd1c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:17.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd22616640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c0b3130 con 0x7fdd1c0caa00 2024-09-10T23:17:17.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd22616640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c0b2fb0 con 0x7fdd04004800 2024-09-10T23:17:17.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd22616640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdd1c0adf30 con 0x7fdd1c0cb4d0 2024-09-10T23:17:17.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd1b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd1c0caa00 0x7fdd1c0caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:17.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd1b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd1c0caa00 0x7fdd1c0caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52604/0 (socket says 172.21.15.90:52604) 2024-09-10T23:17:17.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd1b7fe640 1 -- 172.21.15.90:0/2870806215 learned_addr learned my addr 172.21.15.90:0/2870806215 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:17.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd1bfff640 1 --2- 172.21.15.90:0/2870806215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd04004800 0x7fdd1c151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:17.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd20bb3640 1 --2- 172.21.15.90:0/2870806215 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd1c0cb4d0 0x7fdd1c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:17.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd1b7fe640 1 -- 172.21.15.90:0/2870806215 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd1c0cb4d0 msgr2=0x7fdd1c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:17.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd1b7fe640 1 --2- 172.21.15.90:0/2870806215 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd1c0cb4d0 0x7fdd1c06eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:17.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd1b7fe640 1 -- 172.21.15.90:0/2870806215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd04004800 msgr2=0x7fdd1c151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:17.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd1b7fe640 1 --2- 172.21.15.90:0/2870806215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd04004800 0x7fdd1c151a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:17.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd1b7fe640 1 -- 172.21.15.90:0/2870806215 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c1f4c00 con 0x7fdd1c0caa00 2024-09-10T23:17:17.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd1bfff640 1 --2- 172.21.15.90:0/2870806215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd04004800 0x7fdd1c151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:17.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.940+0000 7fdd20bb3640 1 --2- 172.21.15.90:0/2870806215 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd1c0cb4d0 0x7fdd1c06eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:17.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.941+0000 7fdd1b7fe640 1 --2- 172.21.15.90:0/2870806215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd1c0caa00 0x7fdd1c0caf90 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fdd10036040 tx=0x7fdd10033650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:17.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.941+0000 7fdd18ff9640 1 -- 172.21.15.90:0/2870806215 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd10038040 con 0x7fdd1c0caa00 2024-09-10T23:17:17.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.941+0000 7fdd18ff9640 1 -- 172.21.15.90:0/2870806215 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd10005020 con 0x7fdd1c0caa00 2024-09-10T23:17:17.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.941+0000 7fdd22616640 1 -- 172.21.15.90:0/2870806215 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd1c1f4ea0 con 0x7fdd1c0caa00 2024-09-10T23:17:17.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.941+0000 7fdd18ff9640 1 -- 172.21.15.90:0/2870806215 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd10005470 con 0x7fdd1c0caa00 2024-09-10T23:17:17.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.941+0000 7fdd22616640 1 -- 172.21.15.90:0/2870806215 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd1c1f5460 con 0x7fdd1c0caa00 2024-09-10T23:17:17.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.942+0000 7fdd22616640 1 -- 172.21.15.90:0/2870806215 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd1c0ad800 con 0x7fdd1c0caa00 2024-09-10T23:17:17.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.942+0000 7fdd18ff9640 1 -- 172.21.15.90:0/2870806215 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdd1003b030 con 0x7fdd1c0caa00 2024-09-10T23:17:17.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.943+0000 7fdd18ff9640 1 --2- 172.21.15.90:0/2870806215 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdd08077fa0 0x7fdd0807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:17.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.943+0000 7fdd18ff9640 1 -- 172.21.15.90:0/2870806215 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5853+0+0 (secure 0 0 0) 0x7fdd100ba560 con 0x7fdd1c0caa00 2024-09-10T23:17:17.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.943+0000 7fdd1bfff640 1 --2- 172.21.15.90:0/2870806215 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdd08077fa0 0x7fdd0807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:17.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.944+0000 7fdd1bfff640 1 --2- 172.21.15.90:0/2870806215 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdd08077fa0 0x7fdd0807a460 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009a80 tx=0x7fdd0c005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:17.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:17.947+0000 7fdd18ff9640 1 -- 172.21.15.90:0/2870806215 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdd10082fd0 con 0x7fdd1c0caa00 2024-09-10T23:17:18.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.120+0000 7fdd22616640 1 -- 172.21.15.90:0/2870806215 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdd1c0aed10 con 0x7fdd1c0caa00 2024-09-10T23:17:18.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.781+0000 7fdd18ff9640 1 -- 172.21.15.90:0/2870806215 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v71) ==== 181+0+0 (secure 0 0 0) 0x7fdd100b8e20 con 0x7fdd1c0caa00 2024-09-10T23:17:18.782 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:17:18.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.783+0000 7fdd22616640 1 -- 172.21.15.90:0/2870806215 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdd08077fa0 msgr2=0x7fdd0807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:18.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.783+0000 7fdd22616640 1 --2- 172.21.15.90:0/2870806215 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdd08077fa0 0x7fdd0807a460 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009a80 tx=0x7fdd0c005f90 comp rx=0 tx=0).stop 2024-09-10T23:17:18.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.783+0000 7fdd22616640 1 -- 172.21.15.90:0/2870806215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd1c0caa00 msgr2=0x7fdd1c0caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:18.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.783+0000 7fdd22616640 1 --2- 172.21.15.90:0/2870806215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd1c0caa00 0x7fdd1c0caf90 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fdd10036040 tx=0x7fdd10033650 comp rx=0 tx=0).stop 2024-09-10T23:17:18.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.783+0000 7fdd22616640 1 -- 172.21.15.90:0/2870806215 shutdown_connections 2024-09-10T23:17:18.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.783+0000 7fdd22616640 1 --2- 172.21.15.90:0/2870806215 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdd08077fa0 0x7fdd0807a460 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:18.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.783+0000 7fdd22616640 1 --2- 172.21.15.90:0/2870806215 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd1c0cb4d0 0x7fdd1c06eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:18.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.783+0000 7fdd22616640 1 --2- 172.21.15.90:0/2870806215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd1c0caa00 0x7fdd1c0caf90 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:18.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.783+0000 7fdd22616640 1 --2- 172.21.15.90:0/2870806215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd04004800 0x7fdd1c151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:18.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.783+0000 7fdd22616640 1 -- 172.21.15.90:0/2870806215 >> 172.21.15.90:0/2870806215 conn(0x7fdd1c0b1aa0 msgr2=0x7fdd1c073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:18.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.784+0000 7fdd22616640 1 -- 172.21.15.90:0/2870806215 shutdown_connections 2024-09-10T23:17:18.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.784+0000 7fdd22616640 1 -- 172.21.15.90:0/2870806215 wait complete. 2024-09-10T23:17:18.799 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:17:18.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.905+0000 7fe5ed116640 1 -- 172.21.15.90:0/3969964511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5e80d06b0 msgr2=0x7fe5e80d2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:18.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.905+0000 7fe5ed116640 1 --2- 172.21.15.90:0/3969964511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5e80d06b0 0x7fe5e80d2d30 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fe5e808e5d0 tx=0x7fe5dc02a5d0 comp rx=0 tx=0).stop 2024-09-10T23:17:18.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.905+0000 7fe5ed116640 1 -- 172.21.15.90:0/3969964511 shutdown_connections 2024-09-10T23:17:18.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.905+0000 7fe5ed116640 1 --2- 172.21.15.90:0/3969964511 >> v2:172.21.15.171:3300/0 conn(0x7fe5e80d1270 0x7fe5e80cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:18.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.905+0000 7fe5ed116640 1 --2- 172.21.15.90:0/3969964511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5e80d06b0 0x7fe5e80d2d30 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:18.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.905+0000 7fe5ed116640 1 -- 172.21.15.90:0/3969964511 >> 172.21.15.90:0/3969964511 conn(0x7fe5e80d4150 msgr2=0x7fe5e80d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:18.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.905+0000 7fe5ed116640 1 -- 172.21.15.90:0/3969964511 shutdown_connections 2024-09-10T23:17:18.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.905+0000 7fe5ed116640 1 -- 172.21.15.90:0/3969964511 wait complete. 2024-09-10T23:17:18.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.906+0000 7fe5ed116640 1 Processor -- start 2024-09-10T23:17:18.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.906+0000 7fe5ed116640 1 -- start start 2024-09-10T23:17:18.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.907+0000 7fe5ed116640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5e80d06b0 0x7fe5e80cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:18.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.907+0000 7fe5ed116640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5e80d1270 0x7fe5e80cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:18.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.907+0000 7fe5ed116640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5e8162660 0x7fe5e815e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:18.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.907+0000 7fe5ed116640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e80b3bf0 con 0x7fe5e80d1270 2024-09-10T23:17:18.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.907+0000 7fe5ed116640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e80b3a70 con 0x7fe5e80d06b0 2024-09-10T23:17:18.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.907+0000 7fe5ed116640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe5e80b3d70 con 0x7fe5e8162660 2024-09-10T23:17:18.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.907+0000 7fe5e659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5e80d1270 0x7fe5e80cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:18.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.907+0000 7fe5e659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5e80d1270 0x7fe5e80cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43594/0 (socket says 172.21.15.90:43594) 2024-09-10T23:17:18.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.907+0000 7fe5e659c640 1 -- 172.21.15.90:0/3037790091 learned_addr learned my addr 172.21.15.90:0/3037790091 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:18.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.907+0000 7fe5e6d9d640 1 --2- 172.21.15.90:0/3037790091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5e80d06b0 0x7fe5e80cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:18.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.907+0000 7fe5e759e640 1 --2- 172.21.15.90:0/3037790091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5e8162660 0x7fe5e815e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:18.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.907+0000 7fe5e659c640 1 -- 172.21.15.90:0/3037790091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5e8162660 msgr2=0x7fe5e815e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:18.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.907+0000 7fe5e659c640 1 --2- 172.21.15.90:0/3037790091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5e8162660 0x7fe5e815e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:18.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.907+0000 7fe5e659c640 1 -- 172.21.15.90:0/3037790091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5e80d06b0 msgr2=0x7fe5e80cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:18.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.907+0000 7fe5e659c640 1 --2- 172.21.15.90:0/3037790091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5e80d06b0 0x7fe5e80cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:18.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.907+0000 7fe5e659c640 1 -- 172.21.15.90:0/3037790091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e80cc5c0 con 0x7fe5e80d1270 2024-09-10T23:17:18.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.908+0000 7fe5e659c640 1 --2- 172.21.15.90:0/3037790091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5e80d1270 0x7fe5e80cdc50 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc009920 tx=0x7fe5dc032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:18.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.908+0000 7fe5cf7fe640 1 -- 172.21.15.90:0/3037790091 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc040070 con 0x7fe5e80d1270 2024-09-10T23:17:18.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.908+0000 7fe5cf7fe640 1 -- 172.21.15.90:0/3037790091 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5dc005310 con 0x7fe5e80d1270 2024-09-10T23:17:18.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.908+0000 7fe5ed116640 1 -- 172.21.15.90:0/3037790091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e815f2e0 con 0x7fe5e80d1270 2024-09-10T23:17:18.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.908+0000 7fe5cf7fe640 1 -- 172.21.15.90:0/3037790091 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc0047a0 con 0x7fe5e80d1270 2024-09-10T23:17:18.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.908+0000 7fe5ed116640 1 -- 172.21.15.90:0/3037790091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e80cb880 con 0x7fe5e80d1270 2024-09-10T23:17:18.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.909+0000 7fe5ed116640 1 -- 172.21.15.90:0/3037790091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5e80cfb50 con 0x7fe5e80d1270 2024-09-10T23:17:18.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.909+0000 7fe5cf7fe640 1 -- 172.21.15.90:0/3037790091 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe5dc04c030 con 0x7fe5e80d1270 2024-09-10T23:17:18.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.910+0000 7fe5cf7fe640 1 --2- 172.21.15.90:0/3037790091 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe5d4077f70 0x7fe5d407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:18.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.910+0000 7fe5cf7fe640 1 -- 172.21.15.90:0/3037790091 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5415+0+0 (secure 0 0 0) 0x7fe5dc0babf0 con 0x7fe5e80d1270 2024-09-10T23:17:18.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.910+0000 7fe5e6d9d640 1 --2- 172.21.15.90:0/3037790091 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe5d4077f70 0x7fe5d407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:18.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.911+0000 7fe5e6d9d640 1 --2- 172.21.15.90:0/3037790091 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe5d4077f70 0x7fe5d407a430 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8000f60 tx=0x7fe5d8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:18.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:18.914+0000 7fe5cf7fe640 1 -- 172.21.15.90:0/3037790091 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe5dc0831c0 con 0x7fe5e80d1270 2024-09-10T23:17:19.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.091+0000 7fe5ed116640 1 -- 172.21.15.90:0/3037790091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe5e808e150 con 0x7fe5e80d1270 2024-09-10T23:17:19.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.782+0000 7fe5cf7fe640 1 -- 172.21.15.90:0/3037790091 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v72) ==== 169+0+0 (secure 0 0 0) 0x7fe5dc087bf0 con 0x7fe5e80d1270 2024-09-10T23:17:19.784 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' removed 2024-09-10T23:17:19.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.785+0000 7fe5ed116640 1 -- 172.21.15.90:0/3037790091 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe5d4077f70 msgr2=0x7fe5d407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:19.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.785+0000 7fe5ed116640 1 --2- 172.21.15.90:0/3037790091 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe5d4077f70 0x7fe5d407a430 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8000f60 tx=0x7fe5d8009040 comp rx=0 tx=0).stop 2024-09-10T23:17:19.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.785+0000 7fe5ed116640 1 -- 172.21.15.90:0/3037790091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5e80d1270 msgr2=0x7fe5e80cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:19.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.785+0000 7fe5ed116640 1 --2- 172.21.15.90:0/3037790091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5e80d1270 0x7fe5e80cdc50 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc009920 tx=0x7fe5dc032c10 comp rx=0 tx=0).stop 2024-09-10T23:17:19.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.785+0000 7fe5ed116640 1 -- 172.21.15.90:0/3037790091 shutdown_connections 2024-09-10T23:17:19.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.785+0000 7fe5ed116640 1 --2- 172.21.15.90:0/3037790091 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe5d4077f70 0x7fe5d407a430 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:19.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.785+0000 7fe5ed116640 1 --2- 172.21.15.90:0/3037790091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5e8162660 0x7fe5e815e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:19.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.785+0000 7fe5ed116640 1 --2- 172.21.15.90:0/3037790091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5e80d1270 0x7fe5e80cdc50 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:19.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.785+0000 7fe5ed116640 1 --2- 172.21.15.90:0/3037790091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5e80d06b0 0x7fe5e80cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:19.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.785+0000 7fe5ed116640 1 -- 172.21.15.90:0/3037790091 >> 172.21.15.90:0/3037790091 conn(0x7fe5e80d4150 msgr2=0x7fe5e80d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:19.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.785+0000 7fe5ed116640 1 -- 172.21.15.90:0/3037790091 shutdown_connections 2024-09-10T23:17:19.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.785+0000 7fe5ed116640 1 -- 172.21.15.90:0/3037790091 wait complete. 2024-09-10T23:17:19.801 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:17:19.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.905+0000 7fc865384640 1 -- 172.21.15.90:0/116226521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8480053c0 msgr2=0x7fc84800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:19.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.905+0000 7fc865384640 1 --2- 172.21.15.90:0/116226521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8480053c0 0x7fc84800b9c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc85800c260 tx=0x7fc848005830 comp rx=0 tx=0).stop 2024-09-10T23:17:19.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.905+0000 7fc865384640 1 -- 172.21.15.90:0/116226521 shutdown_connections 2024-09-10T23:17:19.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.905+0000 7fc865384640 1 --2- 172.21.15.90:0/116226521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8480053c0 0x7fc84800b9c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:19.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.905+0000 7fc865384640 1 -- 172.21.15.90:0/116226521 >> 172.21.15.90:0/116226521 conn(0x7fc8600d4090 msgr2=0x7fc8600d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:19.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.905+0000 7fc865384640 1 -- 172.21.15.90:0/116226521 shutdown_connections 2024-09-10T23:17:19.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.905+0000 7fc865384640 1 -- 172.21.15.90:0/116226521 wait complete. 2024-09-10T23:17:19.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.907+0000 7fc865384640 1 Processor -- start 2024-09-10T23:17:19.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.907+0000 7fc865384640 1 -- start start 2024-09-10T23:17:19.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.907+0000 7fc865384640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8480053c0 0x7fc8601f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:19.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.907+0000 7fc865384640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8600ce0a0 0x7fc8600c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:19.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.907+0000 7fc865384640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8601f7d50 0x7fc8601f81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:19.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.907+0000 7fc865384640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc8600d4d00 con 0x7fc8480053c0 2024-09-10T23:17:19.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc865384640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc8600d4b80 con 0x7fc8600ce0a0 2024-09-10T23:17:19.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc865384640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc8600d4e80 con 0x7fc8601f7d50 2024-09-10T23:17:19.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc85effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8480053c0 0x7fc8601f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:19.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc85effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8480053c0 0x7fc8601f4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43624/0 (socket says 172.21.15.90:43624) 2024-09-10T23:17:19.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc85effd640 1 -- 172.21.15.90:0/2822181917 learned_addr learned my addr 172.21.15.90:0/2822181917 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:19.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc85f7fe640 1 --2- 172.21.15.90:0/2822181917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8601f7d50 0x7fc8601f81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:19.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc85e7fc640 1 --2- 172.21.15.90:0/2822181917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8600ce0a0 0x7fc8600c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:19.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc85effd640 1 -- 172.21.15.90:0/2822181917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8601f7d50 msgr2=0x7fc8601f81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:19.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc85effd640 1 --2- 172.21.15.90:0/2822181917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8601f7d50 0x7fc8601f81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:19.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc85effd640 1 -- 172.21.15.90:0/2822181917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8600ce0a0 msgr2=0x7fc8600c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:19.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc85effd640 1 --2- 172.21.15.90:0/2822181917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8600ce0a0 0x7fc8600c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:19.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc85effd640 1 -- 172.21.15.90:0/2822181917 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8601f4d40 con 0x7fc8480053c0 2024-09-10T23:17:19.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc85f7fe640 1 --2- 172.21.15.90:0/2822181917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8601f7d50 0x7fc8601f81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:19.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc85e7fc640 1 --2- 172.21.15.90:0/2822181917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8600ce0a0 0x7fc8600c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:19.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc85effd640 1 --2- 172.21.15.90:0/2822181917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8480053c0 0x7fc8601f4710 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc8540097b0 tx=0x7fc854009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:19.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc8477fe640 1 -- 172.21.15.90:0/2822181917 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854004d20 con 0x7fc8480053c0 2024-09-10T23:17:19.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc8477fe640 1 -- 172.21.15.90:0/2822181917 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc85400faf0 con 0x7fc8480053c0 2024-09-10T23:17:19.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc8477fe640 1 -- 172.21.15.90:0/2822181917 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854005020 con 0x7fc8480053c0 2024-09-10T23:17:19.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc865384640 1 -- 172.21.15.90:0/2822181917 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8601f5020 con 0x7fc8480053c0 2024-09-10T23:17:19.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.908+0000 7fc865384640 1 -- 172.21.15.90:0/2822181917 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8601f55e0 con 0x7fc8480053c0 2024-09-10T23:17:19.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.909+0000 7fc865384640 1 -- 172.21.15.90:0/2822181917 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8600d0d20 con 0x7fc8480053c0 2024-09-10T23:17:19.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.910+0000 7fc8477fe640 1 -- 172.21.15.90:0/2822181917 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc8540051c0 con 0x7fc8480053c0 2024-09-10T23:17:19.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.910+0000 7fc8477fe640 1 --2- 172.21.15.90:0/2822181917 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc84c077f70 0x7fc84c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:19.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.910+0000 7fc8477fe640 1 -- 172.21.15.90:0/2822181917 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7fc85409a6b0 con 0x7fc8480053c0 2024-09-10T23:17:19.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.910+0000 7fc85e7fc640 1 --2- 172.21.15.90:0/2822181917 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc84c077f70 0x7fc84c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:19.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.911+0000 7fc85e7fc640 1 --2- 172.21.15.90:0/2822181917 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc84c077f70 0x7fc84c07a430 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc8601547d0 tx=0x7fc850006120 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:19.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:19.914+0000 7fc8477fe640 1 -- 172.21.15.90:0/2822181917 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc854063540 con 0x7fc8480053c0 2024-09-10T23:17:20.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.094+0000 7fc865384640 1 -- 172.21.15.90:0/2822181917 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7fc8600b2d60 con 0x7fc8480053c0 2024-09-10T23:17:20.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.097+0000 7fc8477fe640 1 -- 172.21.15.90:0/2822181917 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v37) ==== 71+0+0 (secure 0 0 0) 0x7fc854062e40 con 0x7fc8480053c0 2024-09-10T23:17:20.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.099+0000 7fc865384640 1 -- 172.21.15.90:0/2822181917 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc84c077f70 msgr2=0x7fc84c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:20.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.099+0000 7fc865384640 1 --2- 172.21.15.90:0/2822181917 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc84c077f70 0x7fc84c07a430 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc8601547d0 tx=0x7fc850006120 comp rx=0 tx=0).stop 2024-09-10T23:17:20.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.099+0000 7fc865384640 1 -- 172.21.15.90:0/2822181917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8480053c0 msgr2=0x7fc8601f4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:20.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.099+0000 7fc865384640 1 --2- 172.21.15.90:0/2822181917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8480053c0 0x7fc8601f4710 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc8540097b0 tx=0x7fc854009c70 comp rx=0 tx=0).stop 2024-09-10T23:17:20.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.099+0000 7fc865384640 1 -- 172.21.15.90:0/2822181917 shutdown_connections 2024-09-10T23:17:20.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.099+0000 7fc865384640 1 --2- 172.21.15.90:0/2822181917 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc84c077f70 0x7fc84c07a430 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.099+0000 7fc865384640 1 --2- 172.21.15.90:0/2822181917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8600ce0a0 0x7fc8600c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.099+0000 7fc865384640 1 --2- 172.21.15.90:0/2822181917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8601f7d50 0x7fc8601f81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.099+0000 7fc865384640 1 --2- 172.21.15.90:0/2822181917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8480053c0 0x7fc8601f4710 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.099+0000 7fc865384640 1 -- 172.21.15.90:0/2822181917 >> 172.21.15.90:0/2822181917 conn(0x7fc8600d4090 msgr2=0x7fc8600b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:20.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.100+0000 7fc865384640 1 -- 172.21.15.90:0/2822181917 shutdown_connections 2024-09-10T23:17:20.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.100+0000 7fc865384640 1 -- 172.21.15.90:0/2822181917 wait complete. 2024-09-10T23:17:20.111 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject' 2024-09-10T23:17:20.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.211+0000 7fbdffe7f640 1 -- 172.21.15.90:0/317825865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdf80ceca0 msgr2=0x7fbdf80cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.211+0000 7fbdffe7f640 1 --2- 172.21.15.90:0/317825865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdf80ceca0 0x7fbdf80cf110 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009830 tx=0x7fbdf002a480 comp rx=0 tx=0).stop 2024-09-10T23:17:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.211+0000 7fbdffe7f640 1 -- 172.21.15.90:0/317825865 shutdown_connections 2024-09-10T23:17:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.211+0000 7fbdffe7f640 1 --2- 172.21.15.90:0/317825865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdf80ceca0 0x7fbdf80cf110 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.211+0000 7fbdffe7f640 1 --2- 172.21.15.90:0/317825865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdf815e970 0x7fbdf80b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.211+0000 7fbdffe7f640 1 -- 172.21.15.90:0/317825865 >> 172.21.15.90:0/317825865 conn(0x7fbdf80b19c0 msgr2=0x7fbdf80b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.211+0000 7fbdffe7f640 1 -- 172.21.15.90:0/317825865 shutdown_connections 2024-09-10T23:17:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.211+0000 7fbdffe7f640 1 -- 172.21.15.90:0/317825865 wait complete. 2024-09-10T23:17:20.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.212+0000 7fbdffe7f640 1 Processor -- start 2024-09-10T23:17:20.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.212+0000 7fbdffe7f640 1 -- start start 2024-09-10T23:17:20.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.213+0000 7fbdffe7f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdf80b3310 0x7fbdf809bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:20.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.213+0000 7fbdffe7f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdf80ceca0 0x7fbdf81f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:20.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.213+0000 7fbdffe7f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdf809ca00 0x7fbdf815d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:20.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.213+0000 7fbdffe7f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf815bb40 con 0x7fbdf80ceca0 2024-09-10T23:17:20.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.213+0000 7fbdffe7f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf815b9c0 con 0x7fbdf809ca00 2024-09-10T23:17:20.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.213+0000 7fbdffe7f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbdf815bcc0 con 0x7fbdf80b3310 2024-09-10T23:17:20.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.213+0000 7fbdfd41a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdf80ceca0 0x7fbdf81f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:20.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.213+0000 7fbdfd41a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdf80ceca0 0x7fbdf81f5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43634/0 (socket says 172.21.15.90:43634) 2024-09-10T23:17:20.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.213+0000 7fbdfd41a640 1 -- 172.21.15.90:0/697486014 learned_addr learned my addr 172.21.15.90:0/697486014 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:20.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.213+0000 7fbdfd41a640 1 -- 172.21.15.90:0/697486014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdf80b3310 msgr2=0x7fbdf809bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:20.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.213+0000 7fbdfd41a640 1 --2- 172.21.15.90:0/697486014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdf80b3310 0x7fbdf809bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.213+0000 7fbdfd41a640 1 -- 172.21.15.90:0/697486014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdf809ca00 msgr2=0x7fbdf815d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:20.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.213+0000 7fbdfd41a640 1 --2- 172.21.15.90:0/697486014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdf809ca00 0x7fbdf815d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.213+0000 7fbdfd41a640 1 -- 172.21.15.90:0/697486014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf81f64d0 con 0x7fbdf80ceca0 2024-09-10T23:17:20.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.214+0000 7fbdfd41a640 1 --2- 172.21.15.90:0/697486014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdf80ceca0 0x7fbdf81f5f90 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00b440 tx=0x7fbdec00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:20.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.214+0000 7fbdf67fc640 1 -- 172.21.15.90:0/697486014 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec015020 con 0x7fbdf80ceca0 2024-09-10T23:17:20.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.214+0000 7fbdf67fc640 1 -- 172.21.15.90:0/697486014 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdec011980 con 0x7fbdf80ceca0 2024-09-10T23:17:20.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.214+0000 7fbdf67fc640 1 -- 172.21.15.90:0/697486014 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec011dd0 con 0x7fbdf80ceca0 2024-09-10T23:17:20.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.214+0000 7fbdffe7f640 1 -- 172.21.15.90:0/697486014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf81f6750 con 0x7fbdf80ceca0 2024-09-10T23:17:20.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.214+0000 7fbdffe7f640 1 -- 172.21.15.90:0/697486014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf81f6d10 con 0x7fbdf80ceca0 2024-09-10T23:17:20.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.215+0000 7fbdffe7f640 1 -- 172.21.15.90:0/697486014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf81f2e00 con 0x7fbdf80ceca0 2024-09-10T23:17:20.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.215+0000 7fbdf67fc640 1 -- 172.21.15.90:0/697486014 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbdec01a400 con 0x7fbdf80ceca0 2024-09-10T23:17:20.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.216+0000 7fbdf67fc640 1 --2- 172.21.15.90:0/697486014 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbde4077fa0 0x7fbde407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:20.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.216+0000 7fbdf67fc640 1 -- 172.21.15.90:0/697486014 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7fbdec099de0 con 0x7fbdf80ceca0 2024-09-10T23:17:20.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.216+0000 7fbdfdc1b640 1 --2- 172.21.15.90:0/697486014 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbde4077fa0 0x7fbde407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:20.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.217+0000 7fbdfdc1b640 1 --2- 172.21.15.90:0/697486014 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbde4077fa0 0x7fbde407a460 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbde8002080 tx=0x7fbde8001690 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:20.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.220+0000 7fbdf67fc640 1 -- 172.21.15.90:0/697486014 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbdec01f020 con 0x7fbdf80ceca0 2024-09-10T23:17:20.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.460+0000 7fbdffe7f640 1 -- 172.21.15.90:0/697486014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]} v 0) -- 0x7fbdf815c170 con 0x7fbdf80ceca0 2024-09-10T23:17:20.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.793+0000 7fbdf67fc640 1 -- 172.21.15.90:0/697486014 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]}]=0 v167) ==== 142+0+0 (secure 0 0 0) 0x7fbdf81f64d0 con 0x7fbdf80ceca0 2024-09-10T23:17:20.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.796+0000 7fbdffe7f640 1 -- 172.21.15.90:0/697486014 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbde4077fa0 msgr2=0x7fbde407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.796+0000 7fbdffe7f640 1 --2- 172.21.15.90:0/697486014 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbde4077fa0 0x7fbde407a460 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbde8002080 tx=0x7fbde8001690 comp rx=0 tx=0).stop 2024-09-10T23:17:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.796+0000 7fbdffe7f640 1 -- 172.21.15.90:0/697486014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdf80ceca0 msgr2=0x7fbdf81f5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.796+0000 7fbdffe7f640 1 --2- 172.21.15.90:0/697486014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdf80ceca0 0x7fbdf81f5f90 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00b440 tx=0x7fbdec00b900 comp rx=0 tx=0).stop 2024-09-10T23:17:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.796+0000 7fbdffe7f640 1 -- 172.21.15.90:0/697486014 shutdown_connections 2024-09-10T23:17:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.796+0000 7fbdffe7f640 1 --2- 172.21.15.90:0/697486014 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbde4077fa0 0x7fbde407a460 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.796+0000 7fbdffe7f640 1 --2- 172.21.15.90:0/697486014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdf809ca00 0x7fbdf815d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.796+0000 7fbdffe7f640 1 --2- 172.21.15.90:0/697486014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdf80ceca0 0x7fbdf81f5f90 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.796+0000 7fbdffe7f640 1 --2- 172.21.15.90:0/697486014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdf80b3310 0x7fbdf809bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.796+0000 7fbdffe7f640 1 -- 172.21.15.90:0/697486014 >> 172.21.15.90:0/697486014 conn(0x7fbdf80b19c0 msgr2=0x7fbdf80ae410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.797+0000 7fbdffe7f640 1 -- 172.21.15.90:0/697486014 shutdown_connections 2024-09-10T23:17:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.797+0000 7fbdffe7f640 1 -- 172.21.15.90:0/697486014 wait complete. 2024-09-10T23:17:20.809 INFO:tasks.cephfs_test_runner:test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) ... skipped 'Requires FUSE client to inject client metadata' 2024-09-10T23:17:20.809 INFO:tasks.cephfs_test_runner:Starting test: test_tell_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) That when a `tell` command is sent using the python CLI, 2024-09-10T23:17:20.809 INFO:tasks.cephfs_test_runner:test_tell_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-10T23:17:20.809 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:17:20.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.909+0000 7efddd848640 1 -- 172.21.15.90:0/3513238214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdd806d6d0 msgr2=0x7efdd806e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:20.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.909+0000 7efddd848640 1 --2- 172.21.15.90:0/3513238214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdd806d6d0 0x7efdd806e040 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7efdd808d9f0 tx=0x7efdcc02a5f0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.909+0000 7efddd848640 1 -- 172.21.15.90:0/3513238214 shutdown_connections 2024-09-10T23:17:20.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.909+0000 7efddd848640 1 --2- 172.21.15.90:0/3513238214 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efdd806e580 0x7efdd8161cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.909+0000 7efddd848640 1 --2- 172.21.15.90:0/3513238214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdd806d6d0 0x7efdd806e040 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.909+0000 7efddd848640 1 --2- 172.21.15.90:0/3513238214 >> v2:172.21.15.171:3300/0 conn(0x7efdd815e180 0x7efdd80d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.909+0000 7efddd848640 1 -- 172.21.15.90:0/3513238214 >> 172.21.15.90:0/3513238214 conn(0x7efdd80d4090 msgr2=0x7efdd80d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:20.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.909+0000 7efddd848640 1 -- 172.21.15.90:0/3513238214 shutdown_connections 2024-09-10T23:17:20.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.909+0000 7efddd848640 1 -- 172.21.15.90:0/3513238214 wait complete. 2024-09-10T23:17:20.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.910+0000 7efddd848640 1 Processor -- start 2024-09-10T23:17:20.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.910+0000 7efddd848640 1 -- start start 2024-09-10T23:17:20.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.911+0000 7efddd848640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdd806d6d0 0x7efdd81f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:20.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.911+0000 7efddd848640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efdd806e580 0x7efdd81f5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:20.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.911+0000 7efddd848640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdd815e180 0x7efdd81f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:20.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.911+0000 7efddd848640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efdd80d2110 con 0x7efdd806d6d0 2024-09-10T23:17:20.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.911+0000 7efddd848640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efdd80d1f90 con 0x7efdd815e180 2024-09-10T23:17:20.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.911+0000 7efddd848640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efdd8162230 con 0x7efdd806e580 2024-09-10T23:17:20.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.911+0000 7efdd6ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdd806d6d0 0x7efdd81f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:20.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.911+0000 7efdd6ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdd806d6d0 0x7efdd81f25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43650/0 (socket says 172.21.15.90:43650) 2024-09-10T23:17:20.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.911+0000 7efdd6ffd640 1 -- 172.21.15.90:0/2704639105 learned_addr learned my addr 172.21.15.90:0/2704639105 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:20.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.911+0000 7efdd67fc640 1 --2- 172.21.15.90:0/2704639105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efdd806e580 0x7efdd81f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:20.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.911+0000 7efdd77fe640 1 --2- 172.21.15.90:0/2704639105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdd815e180 0x7efdd81f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:20.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.911+0000 7efdd6ffd640 1 -- 172.21.15.90:0/2704639105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efdd806e580 msgr2=0x7efdd81f5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:20.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.911+0000 7efdd6ffd640 1 --2- 172.21.15.90:0/2704639105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efdd806e580 0x7efdd81f5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.911+0000 7efdd6ffd640 1 -- 172.21.15.90:0/2704639105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdd815e180 msgr2=0x7efdd81f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:20.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.911+0000 7efdd6ffd640 1 --2- 172.21.15.90:0/2704639105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdd815e180 0x7efdd81f55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:20.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.911+0000 7efdd6ffd640 1 -- 172.21.15.90:0/2704639105 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd80c96f0 con 0x7efdd806d6d0 2024-09-10T23:17:20.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.911+0000 7efdd6ffd640 1 --2- 172.21.15.90:0/2704639105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdd806d6d0 0x7efdd81f25e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7efdc800ba50 tx=0x7efdc800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:20.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.912+0000 7efdbffff640 1 -- 172.21.15.90:0/2704639105 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8019070 con 0x7efdd806d6d0 2024-09-10T23:17:20.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.912+0000 7efdbffff640 1 -- 172.21.15.90:0/2704639105 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdc800ccf0 con 0x7efdd806d6d0 2024-09-10T23:17:20.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.912+0000 7efddd848640 1 -- 172.21.15.90:0/2704639105 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd80c99d0 con 0x7efdd806d6d0 2024-09-10T23:17:20.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.912+0000 7efdbffff640 1 -- 172.21.15.90:0/2704639105 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc80146a0 con 0x7efdd806d6d0 2024-09-10T23:17:20.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.912+0000 7efddd848640 1 -- 172.21.15.90:0/2704639105 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd80c9f90 con 0x7efdd806d6d0 2024-09-10T23:17:20.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.913+0000 7efddd848640 1 -- 172.21.15.90:0/2704639105 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd81627e0 con 0x7efdd806d6d0 2024-09-10T23:17:20.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.913+0000 7efdbffff640 1 -- 172.21.15.90:0/2704639105 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7efdc801d3b0 con 0x7efdd806d6d0 2024-09-10T23:17:20.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.914+0000 7efdbffff640 1 --2- 172.21.15.90:0/2704639105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efdc4077f70 0x7efdc407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:20.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.914+0000 7efdbffff640 1 -- 172.21.15.90:0/2704639105 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7efdc8099b00 con 0x7efdd806d6d0 2024-09-10T23:17:20.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.914+0000 7efdd67fc640 1 --2- 172.21.15.90:0/2704639105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efdc4077f70 0x7efdc407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:20.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.915+0000 7efdd67fc640 1 --2- 172.21.15.90:0/2704639105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efdc4077f70 0x7efdc407a430 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efdcc033000 tx=0x7efdcc004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:20.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:20.918+0000 7efdbffff640 1 -- 172.21.15.90:0/2704639105 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7efdc8062900 con 0x7efdd806d6d0 2024-09-10T23:17:21.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.099+0000 7efddd848640 1 -- 172.21.15.90:0/2704639105 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efdd80d4ea0 con 0x7efdd806d6d0 2024-09-10T23:17:21.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.099+0000 7efdbffff640 1 -- 172.21.15.90:0/2704639105 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+13031 (secure 0 0 0) 0x7efdc8062200 con 0x7efdd806d6d0 2024-09-10T23:17:21.100 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:21.100 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":72,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:17:19.782279+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6835/696526367":"2024-09-11T23:17:16.768107+0000","172.21.15.90:6833/696526367":"2024-09-11T23:17:16.768107+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:17:21.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.101+0000 7efddd848640 1 -- 172.21.15.90:0/2704639105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efdc4077f70 msgr2=0x7efdc407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:21.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.101+0000 7efddd848640 1 --2- 172.21.15.90:0/2704639105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efdc4077f70 0x7efdc407a430 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efdcc033000 tx=0x7efdcc004730 comp rx=0 tx=0).stop 2024-09-10T23:17:21.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.101+0000 7efddd848640 1 -- 172.21.15.90:0/2704639105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdd806d6d0 msgr2=0x7efdd81f25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:21.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.101+0000 7efddd848640 1 --2- 172.21.15.90:0/2704639105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdd806d6d0 0x7efdd81f25e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7efdc800ba50 tx=0x7efdc800bf10 comp rx=0 tx=0).stop 2024-09-10T23:17:21.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.101+0000 7efddd848640 1 -- 172.21.15.90:0/2704639105 shutdown_connections 2024-09-10T23:17:21.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.101+0000 7efddd848640 1 --2- 172.21.15.90:0/2704639105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efdc4077f70 0x7efdc407a430 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.101+0000 7efddd848640 1 --2- 172.21.15.90:0/2704639105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdd815e180 0x7efdd81f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.101+0000 7efddd848640 1 --2- 172.21.15.90:0/2704639105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efdd806e580 0x7efdd81f5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.101+0000 7efddd848640 1 --2- 172.21.15.90:0/2704639105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdd806d6d0 0x7efdd81f25e0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.101+0000 7efddd848640 1 -- 172.21.15.90:0/2704639105 >> 172.21.15.90:0/2704639105 conn(0x7efdd80d4090 msgr2=0x7efdd81e7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:21.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.101+0000 7efddd848640 1 -- 172.21.15.90:0/2704639105 shutdown_connections 2024-09-10T23:17:21.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.101+0000 7efddd848640 1 -- 172.21.15.90:0/2704639105 wait complete. 2024-09-10T23:17:21.114 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:14:26.449950+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:17:21.114 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:17:21.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.216+0000 7fb7f1460640 1 -- 172.21.15.90:0/3958166083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7ec0737b0 msgr2=0x7fb7ec06cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:21.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.216+0000 7fb7f1460640 1 --2- 172.21.15.90:0/3958166083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7ec0737b0 0x7fb7ec06cb70 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4005fd0 tx=0x7fb7d402a530 comp rx=0 tx=0).stop 2024-09-10T23:17:21.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.216+0000 7fb7f1460640 1 -- 172.21.15.90:0/3958166083 shutdown_connections 2024-09-10T23:17:21.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.216+0000 7fb7f1460640 1 --2- 172.21.15.90:0/3958166083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7ec0737b0 0x7fb7ec06cb70 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.216+0000 7fb7f1460640 1 --2- 172.21.15.90:0/3958166083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7ec074580 0x7fb7ec141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.217+0000 7fb7f1460640 1 -- 172.21.15.90:0/3958166083 >> 172.21.15.90:0/3958166083 conn(0x7fb7ec0b2940 msgr2=0x7fb7ec0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:21.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.217+0000 7fb7f1460640 1 -- 172.21.15.90:0/3958166083 shutdown_connections 2024-09-10T23:17:21.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.217+0000 7fb7f1460640 1 -- 172.21.15.90:0/3958166083 wait complete. 2024-09-10T23:17:21.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.218+0000 7fb7f1460640 1 Processor -- start 2024-09-10T23:17:21.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.218+0000 7fb7f1460640 1 -- start start 2024-09-10T23:17:21.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7f1460640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7ec06d0b0 0x7fb7ec153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:21.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7f1460640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7ec0737b0 0x7fb7ec13cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:21.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7f1460640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7ec074580 0x7fb7ec09c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:21.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7f1460640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec15f950 con 0x7fb7ec0737b0 2024-09-10T23:17:21.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7f1460640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec06f750 con 0x7fb7ec074580 2024-09-10T23:17:21.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7f1460640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb7ec15fad0 con 0x7fb7ec06d0b0 2024-09-10T23:17:21.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7e27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7ec0737b0 0x7fb7ec13cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:21.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7e27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7ec0737b0 0x7fb7ec13cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43668/0 (socket says 172.21.15.90:43668) 2024-09-10T23:17:21.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7e27fc640 1 -- 172.21.15.90:0/241780465 learned_addr learned my addr 172.21.15.90:0/241780465 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:21.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7eaffd640 1 --2- 172.21.15.90:0/241780465 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7ec06d0b0 0x7fb7ec153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:21.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7eb7fe640 1 --2- 172.21.15.90:0/241780465 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7ec074580 0x7fb7ec09c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:21.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7e27fc640 1 -- 172.21.15.90:0/241780465 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7ec06d0b0 msgr2=0x7fb7ec153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:21.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7e27fc640 1 --2- 172.21.15.90:0/241780465 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7ec06d0b0 0x7fb7ec153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7e27fc640 1 -- 172.21.15.90:0/241780465 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7ec074580 msgr2=0x7fb7ec09c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:21.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7e27fc640 1 --2- 172.21.15.90:0/241780465 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7ec074580 0x7fb7ec09c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7e27fc640 1 -- 172.21.15.90:0/241780465 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ec09ced0 con 0x7fb7ec0737b0 2024-09-10T23:17:21.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7e27fc640 1 --2- 172.21.15.90:0/241780465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7ec0737b0 0x7fb7ec13cd40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009850 tx=0x7fb7d40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:21.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7e3fff640 1 -- 172.21.15.90:0/241780465 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d403f070 con 0x7fb7ec0737b0 2024-09-10T23:17:21.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7e3fff640 1 -- 172.21.15.90:0/241780465 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7d40047a0 con 0x7fb7ec0737b0 2024-09-10T23:17:21.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7f1460640 1 -- 172.21.15.90:0/241780465 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7ec153cb0 con 0x7fb7ec0737b0 2024-09-10T23:17:21.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7e3fff640 1 -- 172.21.15.90:0/241780465 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4035030 con 0x7fb7ec0737b0 2024-09-10T23:17:21.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.219+0000 7fb7f1460640 1 -- 172.21.15.90:0/241780465 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7ec154270 con 0x7fb7ec0737b0 2024-09-10T23:17:21.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.220+0000 7fb7f1460640 1 -- 172.21.15.90:0/241780465 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7ec15d080 con 0x7fb7ec0737b0 2024-09-10T23:17:21.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.221+0000 7fb7e3fff640 1 -- 172.21.15.90:0/241780465 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb7d4004b90 con 0x7fb7ec0737b0 2024-09-10T23:17:21.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.222+0000 7fb7e3fff640 1 --2- 172.21.15.90:0/241780465 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb7cc077f70 0x7fb7cc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:21.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.222+0000 7fb7e3fff640 1 -- 172.21.15.90:0/241780465 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7fb7d40baa60 con 0x7fb7ec0737b0 2024-09-10T23:17:21.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.222+0000 7fb7eaffd640 1 --2- 172.21.15.90:0/241780465 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb7cc077f70 0x7fb7cc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:21.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.223+0000 7fb7eaffd640 1 --2- 172.21.15.90:0/241780465 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb7cc077f70 0x7fb7cc07a430 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec15b7d0 tx=0x7fb7dc00b2e0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:21.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.226+0000 7fb7e3fff640 1 -- 172.21.15.90:0/241780465 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb7d40832a0 con 0x7fb7ec0737b0 2024-09-10T23:17:21.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.400+0000 7fb7f1460640 1 -- 172.21.15.90:0/241780465 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb7ec069a80 con 0x7fb7ec0737b0 2024-09-10T23:17:21.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.400+0000 7fb7e3fff640 1 -- 172.21.15.90:0/241780465 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7fb7d4087cd0 con 0x7fb7ec0737b0 2024-09-10T23:17:21.402 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-09-10T23:17:21.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.402+0000 7fb7f1460640 1 -- 172.21.15.90:0/241780465 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb7cc077f70 msgr2=0x7fb7cc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:21.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.402+0000 7fb7f1460640 1 --2- 172.21.15.90:0/241780465 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb7cc077f70 0x7fb7cc07a430 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec15b7d0 tx=0x7fb7dc00b2e0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.402+0000 7fb7f1460640 1 -- 172.21.15.90:0/241780465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7ec0737b0 msgr2=0x7fb7ec13cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:21.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.402+0000 7fb7f1460640 1 --2- 172.21.15.90:0/241780465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7ec0737b0 0x7fb7ec13cd40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009850 tx=0x7fb7d40038a0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.402+0000 7fb7f1460640 1 -- 172.21.15.90:0/241780465 shutdown_connections 2024-09-10T23:17:21.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.402+0000 7fb7f1460640 1 --2- 172.21.15.90:0/241780465 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb7cc077f70 0x7fb7cc07a430 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.402+0000 7fb7f1460640 1 --2- 172.21.15.90:0/241780465 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7ec074580 0x7fb7ec09c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.402+0000 7fb7f1460640 1 --2- 172.21.15.90:0/241780465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7ec0737b0 0x7fb7ec13cd40 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.402+0000 7fb7f1460640 1 --2- 172.21.15.90:0/241780465 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7ec06d0b0 0x7fb7ec153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.402+0000 7fb7f1460640 1 -- 172.21.15.90:0/241780465 >> 172.21.15.90:0/241780465 conn(0x7fb7ec0b2940 msgr2=0x7fb7ec0b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:21.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.403+0000 7fb7f1460640 1 -- 172.21.15.90:0/241780465 shutdown_connections 2024-09-10T23:17:21.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.403+0000 7fb7f1460640 1 -- 172.21.15.90:0/241780465 wait complete. 2024-09-10T23:17:21.415 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close' 2024-09-10T23:17:21.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.515+0000 7f548202a640 1 -- 172.21.15.90:0/4047199860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f547c0cf860 msgr2=0x7f547c0cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:21.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.515+0000 7f548202a640 1 --2- 172.21.15.90:0/4047199860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f547c0cf860 0x7f547c0cdb90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f547c072750 tx=0x7f547002b930 comp rx=0 tx=0).stop 2024-09-10T23:17:21.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.515+0000 7f548202a640 1 -- 172.21.15.90:0/4047199860 shutdown_connections 2024-09-10T23:17:21.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.515+0000 7f548202a640 1 --2- 172.21.15.90:0/4047199860 >> v2:172.21.15.171:3300/0 conn(0x7f547c0cd470 0x7f547c0ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.515+0000 7f548202a640 1 --2- 172.21.15.90:0/4047199860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f547c0cf860 0x7f547c0cdb90 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.515+0000 7f548202a640 1 -- 172.21.15.90:0/4047199860 >> 172.21.15.90:0/4047199860 conn(0x7f547c0b19c0 msgr2=0x7f547c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:21.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.515+0000 7f548202a640 1 -- 172.21.15.90:0/4047199860 shutdown_connections 2024-09-10T23:17:21.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.515+0000 7f548202a640 1 -- 172.21.15.90:0/4047199860 wait complete. 2024-09-10T23:17:21.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.516+0000 7f548202a640 1 Processor -- start 2024-09-10T23:17:21.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.516+0000 7f548202a640 1 -- start start 2024-09-10T23:17:21.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.517+0000 7f548202a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f547c0b44a0 0x7f547c0b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:21.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.517+0000 7f548202a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f547c0cd470 0x7f547c1559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:21.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.517+0000 7f548202a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f547c0cf860 0x7f547c140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:21.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.517+0000 7f548202a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f547c15aa40 con 0x7f547c0cf860 2024-09-10T23:17:21.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.517+0000 7f548202a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f547c15a8c0 con 0x7f547c0cd470 2024-09-10T23:17:21.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.517+0000 7f548202a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f547c0cc710 con 0x7f547c0b44a0 2024-09-10T23:17:21.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.517+0000 7f547bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f547c0cf860 0x7f547c140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:21.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.517+0000 7f547bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f547c0cf860 0x7f547c140dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43678/0 (socket says 172.21.15.90:43678) 2024-09-10T23:17:21.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.517+0000 7f547bfff640 1 -- 172.21.15.90:0/4061610625 learned_addr learned my addr 172.21.15.90:0/4061610625 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:21.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.517+0000 7f547b7fe640 1 --2- 172.21.15.90:0/4061610625 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f547c0b44a0 0x7f547c0b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:21.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.517+0000 7f547affd640 1 --2- 172.21.15.90:0/4061610625 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f547c0cd470 0x7f547c1559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:21.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.518+0000 7f547bfff640 1 -- 172.21.15.90:0/4061610625 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f547c0b44a0 msgr2=0x7f547c0b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:21.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.518+0000 7f547bfff640 1 --2- 172.21.15.90:0/4061610625 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f547c0b44a0 0x7f547c0b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.518+0000 7f547bfff640 1 -- 172.21.15.90:0/4061610625 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f547c0cd470 msgr2=0x7f547c1559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:21.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.518+0000 7f547bfff640 1 --2- 172.21.15.90:0/4061610625 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f547c0cd470 0x7f547c1559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.518+0000 7f547bfff640 1 -- 172.21.15.90:0/4061610625 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547c156460 con 0x7f547c0cf860 2024-09-10T23:17:21.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.518+0000 7f547bfff640 1 --2- 172.21.15.90:0/4061610625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f547c0cf860 0x7f547c140dd0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f547400e970 tx=0x7f547400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:21.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.518+0000 7f5463fff640 1 -- 172.21.15.90:0/4061610625 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547400ccc0 con 0x7f547c0cf860 2024-09-10T23:17:21.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.518+0000 7f5463fff640 1 -- 172.21.15.90:0/4061610625 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f547400ce60 con 0x7f547c0cf860 2024-09-10T23:17:21.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.518+0000 7f548202a640 1 -- 172.21.15.90:0/4061610625 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f547c157e80 con 0x7f547c0cf860 2024-09-10T23:17:21.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.518+0000 7f5463fff640 1 -- 172.21.15.90:0/4061610625 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474005280 con 0x7f547c0cf860 2024-09-10T23:17:21.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.518+0000 7f548202a640 1 -- 172.21.15.90:0/4061610625 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f547c1f3930 con 0x7f547c0cf860 2024-09-10T23:17:21.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.519+0000 7f548202a640 1 -- 172.21.15.90:0/4061610625 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f547c157ca0 con 0x7f547c0cf860 2024-09-10T23:17:21.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.520+0000 7f5463fff640 1 -- 172.21.15.90:0/4061610625 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5474005420 con 0x7f547c0cf860 2024-09-10T23:17:21.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.520+0000 7f5463fff640 1 --2- 172.21.15.90:0/4061610625 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5468077f70 0x7f546807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:21.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.520+0000 7f5463fff640 1 -- 172.21.15.90:0/4061610625 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7f547409a370 con 0x7f547c0cf860 2024-09-10T23:17:21.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.521+0000 7f547b7fe640 1 --2- 172.21.15.90:0/4061610625 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5468077f70 0x7f546807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:21.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.521+0000 7f547b7fe640 1 --2- 172.21.15.90:0/4061610625 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5468077f70 0x7f546807a430 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f546c001ec0 tx=0x7f546c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:21.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.525+0000 7f5463fff640 1 -- 172.21.15.90:0/4061610625 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f547c157ca0 con 0x7f547c0cf860 2024-09-10T23:17:21.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.767+0000 7f548202a640 1 -- 172.21.15.90:0/4061610625 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]} v 0) -- 0x7f547c0cc480 con 0x7f547c0cf860 2024-09-10T23:17:21.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.794+0000 7f5463fff640 1 -- 172.21.15.90:0/4061610625 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]}]=0 v168) ==== 146+0+0 (secure 0 0 0) 0x7f5474062bb0 con 0x7f547c0cf860 2024-09-10T23:17:21.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.797+0000 7f548202a640 1 -- 172.21.15.90:0/4061610625 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5468077f70 msgr2=0x7f546807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:21.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.797+0000 7f548202a640 1 --2- 172.21.15.90:0/4061610625 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5468077f70 0x7f546807a430 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f546c001ec0 tx=0x7f546c009040 comp rx=0 tx=0).stop 2024-09-10T23:17:21.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.797+0000 7f548202a640 1 -- 172.21.15.90:0/4061610625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f547c0cf860 msgr2=0x7f547c140dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:21.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.797+0000 7f548202a640 1 --2- 172.21.15.90:0/4061610625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f547c0cf860 0x7f547c140dd0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f547400e970 tx=0x7f547400ed70 comp rx=0 tx=0).stop 2024-09-10T23:17:21.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.797+0000 7f548202a640 1 -- 172.21.15.90:0/4061610625 shutdown_connections 2024-09-10T23:17:21.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.797+0000 7f548202a640 1 --2- 172.21.15.90:0/4061610625 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5468077f70 0x7f546807a430 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.797+0000 7f548202a640 1 --2- 172.21.15.90:0/4061610625 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f547c0cd470 0x7f547c1559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.797+0000 7f548202a640 1 --2- 172.21.15.90:0/4061610625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f547c0cf860 0x7f547c140dd0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.797+0000 7f548202a640 1 --2- 172.21.15.90:0/4061610625 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f547c0b44a0 0x7f547c0b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.797+0000 7f548202a640 1 -- 172.21.15.90:0/4061610625 >> 172.21.15.90:0/4061610625 conn(0x7f547c0b19c0 msgr2=0x7f547c0b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:21.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.797+0000 7f548202a640 1 -- 172.21.15.90:0/4061610625 shutdown_connections 2024-09-10T23:17:21.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.797+0000 7f548202a640 1 -- 172.21.15.90:0/4061610625 wait complete. 2024-09-10T23:17:21.808 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:17:21.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.909+0000 7f6eb948e640 1 -- 172.21.15.90:0/3394909380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6eb40d0ab0 msgr2=0x7f6eb40aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:21.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.909+0000 7f6eb948e640 1 --2- 172.21.15.90:0/3394909380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6eb40d0ab0 0x7f6eb40aef20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6eac009860 tx=0x7f6eac02a420 comp rx=0 tx=0).stop 2024-09-10T23:17:21.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.909+0000 7f6eb948e640 1 -- 172.21.15.90:0/3394909380 shutdown_connections 2024-09-10T23:17:21.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.909+0000 7f6eb948e640 1 --2- 172.21.15.90:0/3394909380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6eb40d0ab0 0x7f6eb40aef20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.909+0000 7f6eb948e640 1 --2- 172.21.15.90:0/3394909380 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6eb415f4d0 0x7f6eb40cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.909+0000 7f6eb948e640 1 -- 172.21.15.90:0/3394909380 >> 172.21.15.90:0/3394909380 conn(0x7f6eb40d1f60 msgr2=0x7f6eb40d2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:21.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.909+0000 7f6eb948e640 1 -- 172.21.15.90:0/3394909380 shutdown_connections 2024-09-10T23:17:21.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.909+0000 7f6eb948e640 1 -- 172.21.15.90:0/3394909380 wait complete. 2024-09-10T23:17:21.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.910+0000 7f6eb948e640 1 Processor -- start 2024-09-10T23:17:21.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.910+0000 7f6eb948e640 1 -- start start 2024-09-10T23:17:21.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb948e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6eb40b0f40 0x7f6eb41f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:21.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb948e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6eb40d0ab0 0x7f6eb409fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:21.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb948e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6eb415f4d0 0x7f6eb409d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:21.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb948e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb40af960 con 0x7f6eb415f4d0 2024-09-10T23:17:21.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb948e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb40af7e0 con 0x7f6eb40b0f40 2024-09-10T23:17:21.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb948e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6eb40afae0 con 0x7f6eb40d0ab0 2024-09-10T23:17:21.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6eb415f4d0 0x7f6eb409d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6eb415f4d0 0x7f6eb409d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43682/0 (socket says 172.21.15.90:43682) 2024-09-10T23:17:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb37fe640 1 -- 172.21.15.90:0/1831799086 learned_addr learned my addr 172.21.15.90:0/1831799086 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb2ffd640 1 --2- 172.21.15.90:0/1831799086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6eb40b0f40 0x7f6eb41f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb27fc640 1 --2- 172.21.15.90:0/1831799086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6eb40d0ab0 0x7f6eb409fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb37fe640 1 -- 172.21.15.90:0/1831799086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6eb40d0ab0 msgr2=0x7f6eb409fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb37fe640 1 --2- 172.21.15.90:0/1831799086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6eb40d0ab0 0x7f6eb409fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb37fe640 1 -- 172.21.15.90:0/1831799086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6eb40b0f40 msgr2=0x7f6eb41f59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb37fe640 1 --2- 172.21.15.90:0/1831799086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6eb40b0f40 0x7f6eb41f59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb37fe640 1 -- 172.21.15.90:0/1831799086 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb41f6040 con 0x7f6eb415f4d0 2024-09-10T23:17:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb2ffd640 1 --2- 172.21.15.90:0/1831799086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6eb40b0f40 0x7f6eb41f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:21.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb27fc640 1 --2- 172.21.15.90:0/1831799086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6eb40d0ab0 0x7f6eb409fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:21.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.911+0000 7f6eb37fe640 1 --2- 172.21.15.90:0/1831799086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6eb415f4d0 0x7f6eb409d4c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f6eac02aa10 tx=0x7f6eac032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:21.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.912+0000 7f6eab7fe640 1 -- 172.21.15.90:0/1831799086 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac040070 con 0x7f6eb415f4d0 2024-09-10T23:17:21.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.912+0000 7f6eab7fe640 1 -- 172.21.15.90:0/1831799086 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6eac005330 con 0x7f6eb415f4d0 2024-09-10T23:17:21.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.912+0000 7f6eb948e640 1 -- 172.21.15.90:0/1831799086 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb41f6320 con 0x7f6eb415f4d0 2024-09-10T23:17:21.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.912+0000 7f6eab7fe640 1 -- 172.21.15.90:0/1831799086 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0047a0 con 0x7f6eb415f4d0 2024-09-10T23:17:21.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.912+0000 7f6eb948e640 1 -- 172.21.15.90:0/1831799086 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb41f2560 con 0x7f6eb415f4d0 2024-09-10T23:17:21.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.913+0000 7f6eb948e640 1 -- 172.21.15.90:0/1831799086 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb40d1940 con 0x7f6eb415f4d0 2024-09-10T23:17:21.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.913+0000 7f6eab7fe640 1 -- 172.21.15.90:0/1831799086 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6eac04c030 con 0x7f6eb415f4d0 2024-09-10T23:17:21.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.914+0000 7f6eab7fe640 1 --2- 172.21.15.90:0/1831799086 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6e94077f70 0x7f6e9407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:21.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.914+0000 7f6eab7fe640 1 -- 172.21.15.90:0/1831799086 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7f6eac0baa40 con 0x7f6eb415f4d0 2024-09-10T23:17:21.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.914+0000 7f6eb2ffd640 1 --2- 172.21.15.90:0/1831799086 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6e94077f70 0x7f6e9407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:21.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.914+0000 7f6eb2ffd640 1 --2- 172.21.15.90:0/1831799086 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6e94077f70 0x7f6e9407a430 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40b4610 tx=0x7f6ea4009500 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:21.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:21.918+0000 7f6eab7fe640 1 -- 172.21.15.90:0/1831799086 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6eb40d1940 con 0x7f6eb415f4d0 2024-09-10T23:17:22.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.091+0000 7f6eb948e640 1 -- 172.21.15.90:0/1831799086 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f6eb40b0000 con 0x7f6eb415f4d0 2024-09-10T23:17:22.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.092+0000 7f6eab7fe640 1 -- 172.21.15.90:0/1831799086 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+1998 (secure 0 0 0) 0x7f6eac0bae20 con 0x7f6eb415f4d0 2024-09-10T23:17:22.093 INFO:teuthology.orchestra.run.smithi090.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:17:22.093 INFO:teuthology.orchestra.run.smithi090.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:17:22.093 INFO:teuthology.orchestra.run.smithi090.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:17:22.093 INFO:teuthology.orchestra.run.smithi090.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:17:22.093 INFO:teuthology.orchestra.run.smithi090.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8283.895139 2024-09-10T23:17:22.093 INFO:teuthology.orchestra.run.smithi090.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5684.288500 2024-09-10T23:17:22.093 INFO:teuthology.orchestra.run.smithi090.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5960.411649 2024-09-10T23:17:22.093 INFO:teuthology.orchestra.run.smithi090.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5499.929251 2024-09-10T23:17:22.093 INFO:teuthology.orchestra.run.smithi090.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5373.806301 2024-09-10T23:17:22.094 INFO:teuthology.orchestra.run.smithi090.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5138.908279 2024-09-10T23:17:22.094 INFO:teuthology.orchestra.run.smithi090.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5181.430205 2024-09-10T23:17:22.094 INFO:teuthology.orchestra.run.smithi090.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4880.265977 2024-09-10T23:17:22.094 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_mds 20/20 2024-09-10T23:17:22.094 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:17:22.094 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_ms 2/2 2024-09-10T23:17:22.094 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_debug_frag true 2024-09-10T23:17:22.094 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:17:22.094 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:17:22.094 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_verify_scatter true 2024-09-10T23:17:22.094 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:17:22.094 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:17:22.094 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:17:22.095 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced client_mount_timeout 600 2024-09-10T23:17:22.095 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced debug_client 20/20 2024-09-10T23:17:22.095 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced debug_ms 1/1 2024-09-10T23:17:22.095 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:17:22.095 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:17:22.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.094+0000 7f6eb948e640 1 -- 172.21.15.90:0/1831799086 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6e94077f70 msgr2=0x7f6e9407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:22.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.094+0000 7f6eb948e640 1 --2- 172.21.15.90:0/1831799086 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6e94077f70 0x7f6e9407a430 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40b4610 tx=0x7f6ea4009500 comp rx=0 tx=0).stop 2024-09-10T23:17:22.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.094+0000 7f6eb948e640 1 -- 172.21.15.90:0/1831799086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6eb415f4d0 msgr2=0x7f6eb409d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:22.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.094+0000 7f6eb948e640 1 --2- 172.21.15.90:0/1831799086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6eb415f4d0 0x7f6eb409d4c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f6eac02aa10 tx=0x7f6eac032b90 comp rx=0 tx=0).stop 2024-09-10T23:17:22.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.094+0000 7f6eb948e640 1 -- 172.21.15.90:0/1831799086 shutdown_connections 2024-09-10T23:17:22.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.094+0000 7f6eb948e640 1 --2- 172.21.15.90:0/1831799086 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6e94077f70 0x7f6e9407a430 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.094+0000 7f6eb948e640 1 --2- 172.21.15.90:0/1831799086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6eb415f4d0 0x7f6eb409d4c0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.094+0000 7f6eb948e640 1 --2- 172.21.15.90:0/1831799086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6eb40d0ab0 0x7f6eb409fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.094+0000 7f6eb948e640 1 --2- 172.21.15.90:0/1831799086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6eb40b0f40 0x7f6eb41f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.094+0000 7f6eb948e640 1 -- 172.21.15.90:0/1831799086 >> 172.21.15.90:0/1831799086 conn(0x7f6eb40d1f60 msgr2=0x7f6eb415d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:22.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.094+0000 7f6eb948e640 1 -- 172.21.15.90:0/1831799086 shutdown_connections 2024-09-10T23:17:22.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.094+0000 7f6eb948e640 1 -- 172.21.15.90:0/1831799086 wait complete. 2024-09-10T23:17:22.106 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:17:22.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.208+0000 7f603f7f3640 1 -- 172.21.15.90:0/2256493412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60380cf860 msgr2=0x7f60380cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:22.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.208+0000 7f603f7f3640 1 --2- 172.21.15.90:0/2256493412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60380cf860 0x7f60380cdb90 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f602800a940 tx=0x7f602802b850 comp rx=0 tx=0).stop 2024-09-10T23:17:22.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.209+0000 7f603f7f3640 1 -- 172.21.15.90:0/2256493412 shutdown_connections 2024-09-10T23:17:22.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.209+0000 7f603f7f3640 1 --2- 172.21.15.90:0/2256493412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60380cf860 0x7f60380cdb90 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.209+0000 7f603f7f3640 1 -- 172.21.15.90:0/2256493412 >> 172.21.15.90:0/2256493412 conn(0x7f60380b19c0 msgr2=0x7f60380b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:22.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.209+0000 7f603f7f3640 1 -- 172.21.15.90:0/2256493412 shutdown_connections 2024-09-10T23:17:22.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.209+0000 7f603f7f3640 1 -- 172.21.15.90:0/2256493412 wait complete. 2024-09-10T23:17:22.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.210+0000 7f603f7f3640 1 Processor -- start 2024-09-10T23:17:22.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.210+0000 7f603f7f3640 1 -- start start 2024-09-10T23:17:22.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.210+0000 7f603f7f3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60380b44a0 0x7f60381f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:22.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603f7f3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60380cd470 0x7f6038148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:22.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603f7f3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60380cf860 0x7f603815c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:22.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603f7f3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f603806e800 con 0x7f60380cd470 2024-09-10T23:17:22.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603f7f3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f603815aad0 con 0x7f60380b44a0 2024-09-10T23:17:22.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603f7f3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f60380ce7e0 con 0x7f60380cf860 2024-09-10T23:17:22.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603cd8e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60380cd470 0x7f6038148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:22.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603cd8e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60380cd470 0x7f6038148680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43700/0 (socket says 172.21.15.90:43700) 2024-09-10T23:17:22.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603cd8e640 1 -- 172.21.15.90:0/678588948 learned_addr learned my addr 172.21.15.90:0/678588948 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:22.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603d58f640 1 --2- 172.21.15.90:0/678588948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60380b44a0 0x7f60381f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:22.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603dd90640 1 --2- 172.21.15.90:0/678588948 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60380cf860 0x7f603815c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:22.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603cd8e640 1 -- 172.21.15.90:0/678588948 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60380cf860 msgr2=0x7f603815c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:22.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603cd8e640 1 --2- 172.21.15.90:0/678588948 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60380cf860 0x7f603815c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603cd8e640 1 -- 172.21.15.90:0/678588948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60380b44a0 msgr2=0x7f60381f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:22.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603cd8e640 1 --2- 172.21.15.90:0/678588948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60380b44a0 0x7f60381f3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603cd8e640 1 -- 172.21.15.90:0/678588948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f603815b020 con 0x7f60380cd470 2024-09-10T23:17:22.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603d58f640 1 --2- 172.21.15.90:0/678588948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60380b44a0 0x7f60381f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:22.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603dd90640 1 --2- 172.21.15.90:0/678588948 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60380cf860 0x7f603815c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:22.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603cd8e640 1 --2- 172.21.15.90:0/678588948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60380cd470 0x7f6038148680 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f602802be40 tx=0x7f6028003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:22.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f602dffb640 1 -- 172.21.15.90:0/678588948 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6028041070 con 0x7f60380cd470 2024-09-10T23:17:22.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f602dffb640 1 -- 172.21.15.90:0/678588948 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6028005110 con 0x7f60380cd470 2024-09-10T23:17:22.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603f7f3640 1 -- 172.21.15.90:0/678588948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f603815b300 con 0x7f60380cd470 2024-09-10T23:17:22.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f602dffb640 1 -- 172.21.15.90:0/678588948 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6028005560 con 0x7f60380cd470 2024-09-10T23:17:22.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.211+0000 7f603f7f3640 1 -- 172.21.15.90:0/678588948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f603815b8c0 con 0x7f60380cd470 2024-09-10T23:17:22.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.212+0000 7f603f7f3640 1 -- 172.21.15.90:0/678588948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60380cec60 con 0x7f60380cd470 2024-09-10T23:17:22.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.213+0000 7f602dffb640 1 -- 172.21.15.90:0/678588948 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f602804d060 con 0x7f60380cd470 2024-09-10T23:17:22.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.213+0000 7f602dffb640 1 --2- 172.21.15.90:0/678588948 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f601c077f70 0x7f601c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:22.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.214+0000 7f602dffb640 1 -- 172.21.15.90:0/678588948 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7f60280ba790 con 0x7f60380cd470 2024-09-10T23:17:22.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.214+0000 7f603d58f640 1 --2- 172.21.15.90:0/678588948 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f601c077f70 0x7f601c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:22.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.214+0000 7f603d58f640 1 --2- 172.21.15.90:0/678588948 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f601c077f70 0x7f601c07a430 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6034000f60 tx=0x7f6034009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:22.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.218+0000 7f602dffb640 1 -- 172.21.15.90:0/678588948 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6028083620 con 0x7f60380cd470 2024-09-10T23:17:22.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.393+0000 7f603f7f3640 1 -- 172.21.15.90:0/678588948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f60380cc480 con 0x7f60380cd470 2024-09-10T23:17:22.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.396+0000 7f602dffb640 1 -- 172.21.15.90:0/678588948 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f6028082f20 con 0x7f60380cd470 2024-09-10T23:17:22.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.398+0000 7f603f7f3640 1 -- 172.21.15.90:0/678588948 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f601c077f70 msgr2=0x7f601c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:22.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.398+0000 7f603f7f3640 1 --2- 172.21.15.90:0/678588948 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f601c077f70 0x7f601c07a430 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6034000f60 tx=0x7f6034009040 comp rx=0 tx=0).stop 2024-09-10T23:17:22.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.398+0000 7f603f7f3640 1 -- 172.21.15.90:0/678588948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60380cd470 msgr2=0x7f6038148680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:22.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.398+0000 7f603f7f3640 1 --2- 172.21.15.90:0/678588948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60380cd470 0x7f6038148680 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f602802be40 tx=0x7f6028003c10 comp rx=0 tx=0).stop 2024-09-10T23:17:22.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.398+0000 7f603f7f3640 1 -- 172.21.15.90:0/678588948 shutdown_connections 2024-09-10T23:17:22.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.398+0000 7f603f7f3640 1 --2- 172.21.15.90:0/678588948 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f601c077f70 0x7f601c07a430 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.398+0000 7f603f7f3640 1 --2- 172.21.15.90:0/678588948 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60380cf860 0x7f603815c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.398+0000 7f603f7f3640 1 --2- 172.21.15.90:0/678588948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60380cd470 0x7f6038148680 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.398+0000 7f603f7f3640 1 --2- 172.21.15.90:0/678588948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60380b44a0 0x7f60381f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.398+0000 7f603f7f3640 1 -- 172.21.15.90:0/678588948 >> 172.21.15.90:0/678588948 conn(0x7f60380b19c0 msgr2=0x7f60380727c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:22.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.398+0000 7f603f7f3640 1 -- 172.21.15.90:0/678588948 shutdown_connections 2024-09-10T23:17:22.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.399+0000 7f603f7f3640 1 -- 172.21.15.90:0/678588948 wait complete. 2024-09-10T23:17:22.410 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:17:22.410 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:17:22.454 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:17:22.497 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:17:22.497 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:17:22.498 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:22.515 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:17:22.515 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:17:22.515 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:22.556 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:17:22.556 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:17:22.556 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:22.571 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:17:22.571 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:17:22.571 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:22.614 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:17:22.614 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:17:22.614 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:17:22.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.714+0000 7f78dbb82640 1 -- 172.21.15.90:0/2539061688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d1190 msgr2=0x7f78d40d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:22.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.714+0000 7f78dbb82640 1 --2- 172.21.15.90:0/2539061688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d1190 0x7f78d40d28c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f78d40ce670 tx=0x7f78c402a560 comp rx=0 tx=0).stop 2024-09-10T23:17:22.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.714+0000 7f78dbb82640 1 -- 172.21.15.90:0/2539061688 shutdown_connections 2024-09-10T23:17:22.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.714+0000 7f78dbb82640 1 --2- 172.21.15.90:0/2539061688 >> v2:172.21.15.171:3300/0 conn(0x7f78d40d16f0 0x7f78d40d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.714+0000 7f78dbb82640 1 --2- 172.21.15.90:0/2539061688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d1190 0x7f78d40d28c0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.714+0000 7f78dbb82640 1 -- 172.21.15.90:0/2539061688 >> 172.21.15.90:0/2539061688 conn(0x7f78d40d4090 msgr2=0x7f78d40d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:22.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.714+0000 7f78dbb82640 1 -- 172.21.15.90:0/2539061688 shutdown_connections 2024-09-10T23:17:22.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.714+0000 7f78dbb82640 1 -- 172.21.15.90:0/2539061688 wait complete. 2024-09-10T23:17:22.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.715+0000 7f78dbb82640 1 Processor -- start 2024-09-10T23:17:22.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.715+0000 7f78dbb82640 1 -- start start 2024-09-10T23:17:22.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.716+0000 7f78dbb82640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d1190 0x7f78d4158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:22.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.716+0000 7f78dbb82640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d40d16f0 0x7f78d415bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:22.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.716+0000 7f78dbb82640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d415e310 0x7f78d41f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:22.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.716+0000 7f78dbb82640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f78d40d3340 con 0x7f78d40d1190 2024-09-10T23:17:22.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.716+0000 7f78dbb82640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f78d40d4d90 con 0x7f78d415e310 2024-09-10T23:17:22.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.716+0000 7f78dbb82640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f78d40d34c0 con 0x7f78d40d16f0 2024-09-10T23:17:22.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.716+0000 7f78d991e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d1190 0x7f78d4158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:22.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.716+0000 7f78d991e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d1190 0x7f78d4158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43714/0 (socket says 172.21.15.90:43714) 2024-09-10T23:17:22.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.716+0000 7f78d991e640 1 -- 172.21.15.90:0/1122374575 learned_addr learned my addr 172.21.15.90:0/1122374575 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:22.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.717+0000 7f78d911d640 1 --2- 172.21.15.90:0/1122374575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d40d16f0 0x7f78d415bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:22.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.717+0000 7f78d991e640 1 -- 172.21.15.90:0/1122374575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d40d16f0 msgr2=0x7f78d415bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:22.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.717+0000 7f78da11f640 1 --2- 172.21.15.90:0/1122374575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d415e310 0x7f78d41f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:22.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.717+0000 7f78d991e640 1 --2- 172.21.15.90:0/1122374575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d40d16f0 0x7f78d415bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.717+0000 7f78d991e640 1 -- 172.21.15.90:0/1122374575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d415e310 msgr2=0x7f78d41f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:22.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.717+0000 7f78d991e640 1 --2- 172.21.15.90:0/1122374575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d415e310 0x7f78d41f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.717+0000 7f78d991e640 1 -- 172.21.15.90:0/1122374575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d40cd240 con 0x7f78d40d1190 2024-09-10T23:17:22.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.717+0000 7f78da11f640 1 --2- 172.21.15.90:0/1122374575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d415e310 0x7f78d41f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:22.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.717+0000 7f78d991e640 1 --2- 172.21.15.90:0/1122374575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d1190 0x7f78d4158120 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f78d000c3f0 tx=0x7f78d000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:22.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.717+0000 7f78ca7fc640 1 -- 172.21.15.90:0/1122374575 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0017070 con 0x7f78d40d1190 2024-09-10T23:17:22.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.717+0000 7f78ca7fc640 1 -- 172.21.15.90:0/1122374575 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78d00035f0 con 0x7f78d40d1190 2024-09-10T23:17:22.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.717+0000 7f78dbb82640 1 -- 172.21.15.90:0/1122374575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d40cd520 con 0x7f78d40d1190 2024-09-10T23:17:22.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.717+0000 7f78ca7fc640 1 -- 172.21.15.90:0/1122374575 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0003a40 con 0x7f78d40d1190 2024-09-10T23:17:22.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.717+0000 7f78dbb82640 1 -- 172.21.15.90:0/1122374575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d40cbc10 con 0x7f78d40d1190 2024-09-10T23:17:22.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.718+0000 7f78dbb82640 1 -- 172.21.15.90:0/1122374575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d40d3990 con 0x7f78d40d1190 2024-09-10T23:17:22.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.719+0000 7f78ca7fc640 1 -- 172.21.15.90:0/1122374575 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f78d0003be0 con 0x7f78d40d1190 2024-09-10T23:17:22.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.719+0000 7f78ca7fc640 1 --2- 172.21.15.90:0/1122374575 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78b8077f70 0x7f78b807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:22.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.719+0000 7f78ca7fc640 1 -- 172.21.15.90:0/1122374575 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7f78d0099040 con 0x7f78d40d1190 2024-09-10T23:17:22.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.719+0000 7f78d911d640 1 --2- 172.21.15.90:0/1122374575 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78b8077f70 0x7f78b807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:22.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.720+0000 7f78d911d640 1 --2- 172.21.15.90:0/1122374575 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78b8077f70 0x7f78b807a430 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f78c4033000 tx=0x7f78c4004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:22.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.723+0000 7f78ca7fc640 1 -- 172.21.15.90:0/1122374575 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f78d0061e40 con 0x7f78d40d1190 2024-09-10T23:17:22.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.934+0000 7f78dbb82640 1 -- 172.21.15.90:0/1122374575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78d4076360 con 0x7f78d40d1190 2024-09-10T23:17:22.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.935+0000 7f78ca7fc640 1 -- 172.21.15.90:0/1122374575 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+3914 (secure 0 0 0) 0x7f78d0061740 con 0x7f78d40d1190 2024-09-10T23:17:22.936 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:22.936 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":40,"btime":"2024-09-10T23:17:17:769958+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5554,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/946078081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":946078081},{"type":"v1","addr":"172.21.15.171:6836","nonce":946078081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1081121108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1081121108},{"type":"v1","addr":"172.21.15.171:6837","nonce":1081121108}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6003,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/2444726710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2444726710},{"type":"v1","addr":"172.21.15.90:6834","nonce":2444726710}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2951694051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":2951694051},{"type":"v1","addr":"172.21.15.90:6835","nonce":2951694051}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[]} 2024-09-10T23:17:22.936 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 40 2024-09-10T23:17:22.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.937+0000 7f78dbb82640 1 -- 172.21.15.90:0/1122374575 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78b8077f70 msgr2=0x7f78b807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:22.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.937+0000 7f78dbb82640 1 --2- 172.21.15.90:0/1122374575 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78b8077f70 0x7f78b807a430 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f78c4033000 tx=0x7f78c4004730 comp rx=0 tx=0).stop 2024-09-10T23:17:22.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.937+0000 7f78dbb82640 1 -- 172.21.15.90:0/1122374575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d1190 msgr2=0x7f78d4158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:22.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.937+0000 7f78dbb82640 1 --2- 172.21.15.90:0/1122374575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d1190 0x7f78d4158120 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f78d000c3f0 tx=0x7f78d000c8b0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.937+0000 7f78dbb82640 1 -- 172.21.15.90:0/1122374575 shutdown_connections 2024-09-10T23:17:22.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.937+0000 7f78dbb82640 1 --2- 172.21.15.90:0/1122374575 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78b8077f70 0x7f78b807a430 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.937+0000 7f78dbb82640 1 --2- 172.21.15.90:0/1122374575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d415e310 0x7f78d41f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.937+0000 7f78dbb82640 1 --2- 172.21.15.90:0/1122374575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78d40d16f0 0x7f78d415bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.937+0000 7f78dbb82640 1 --2- 172.21.15.90:0/1122374575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78d40d1190 0x7f78d4158120 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:22.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.937+0000 7f78dbb82640 1 -- 172.21.15.90:0/1122374575 >> 172.21.15.90:0/1122374575 conn(0x7f78d40d4090 msgr2=0x7f78d406d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:22.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.937+0000 7f78dbb82640 1 -- 172.21.15.90:0/1122374575 shutdown_connections 2024-09-10T23:17:22.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:22.937+0000 7f78dbb82640 1 -- 172.21.15.90:0/1122374575 wait complete. 2024-09-10T23:17:22.948 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:17:22.949 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:17:22.949 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:17:22.951 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:17:22.952 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:17:22.952 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:17:22.952 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:17:22.953 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:17:22.953 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:17:22.953 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:17:22.953 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:17:22.953 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:17:22.953 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:17:22.953 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:17:22.954 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:17:22.954 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:17:22.959 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:17:22.959 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:17:22.962 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:17:22.962 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:17:22.965 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:17:22.965 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:17:22.966 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:17:22.966 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:17:23.003 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:17:23.004 DEBUG:teuthology.parallel:result is None 2024-09-10T23:17:23.005 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:17:23.005 DEBUG:teuthology.parallel:result is None 2024-09-10T23:17:23.008 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:17:23.008 DEBUG:teuthology.parallel:result is None 2024-09-10T23:17:23.009 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:17:23.009 DEBUG:teuthology.parallel:result is None 2024-09-10T23:17:23.009 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:17:23.079 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-09-10T23:17:23.079 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-09-10T23:17:23.089 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-09-10T23:17:23.089 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-09-10T23:17:23.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.115+0000 7fdf47c1f640 1 -- 172.21.15.90:0/1938129895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c003a30 msgr2=0x7fdf2c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:23.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.115+0000 7fdf47c1f640 1 --2- 172.21.15.90:0/1938129895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf2c003a30 0x7fdf2c003e50 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009b50 tx=0x7fdf2c005830 comp rx=0 tx=0).stop 2024-09-10T23:17:23.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.115+0000 7fdf461bc640 1 -- 172.21.15.90:0/1938129895 reap_dead start 2024-09-10T23:17:23.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.115+0000 7fdf47c1f640 1 -- 172.21.15.90:0/1938129895 shutdown_connections 2024-09-10T23:17:23.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.115+0000 7fdf47c1f640 1 -- 172.21.15.90:0/1938129895 >> 172.21.15.90:0/1938129895 conn(0x7fdf400697a0 msgr2=0x7fdf4006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:23.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.115+0000 7fdf47c1f640 1 -- 172.21.15.90:0/1938129895 shutdown_connections 2024-09-10T23:17:23.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.115+0000 7fdf47c1f640 1 -- 172.21.15.90:0/1938129895 wait complete. 2024-09-10T23:17:23.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.117+0000 7fdf47c1f640 1 Processor -- start 2024-09-10T23:17:23.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.117+0000 7fdf47c1f640 1 -- start start 2024-09-10T23:17:23.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.117+0000 7fdf47c1f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf2c003a30 0x7fdf400d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:23.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.117+0000 7fdf47c1f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf401f92c0 0x7fdf400cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:23.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.117+0000 7fdf47c1f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf400cc7f0 0x7fdf4014bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:23.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.117+0000 7fdf47c1f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdf400cf650 con 0x7fdf401f92c0 2024-09-10T23:17:23.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.117+0000 7fdf47c1f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdf400cf4d0 con 0x7fdf2c003a30 2024-09-10T23:17:23.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.117+0000 7fdf47c1f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdf400cf7d0 con 0x7fdf400cc7f0 2024-09-10T23:17:23.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf451ba640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf401f92c0 0x7fdf400cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:23.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf459bb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf2c003a30 0x7fdf400d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:23.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf451ba640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf401f92c0 0x7fdf400cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43754/0 (socket says 172.21.15.90:43754) 2024-09-10T23:17:23.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf451ba640 1 -- 172.21.15.90:0/3125968196 learned_addr learned my addr 172.21.15.90:0/3125968196 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:23.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf459bb640 1 --2- 172.21.15.90:0/3125968196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf2c003a30 0x7fdf400d07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.90:40880/0 (socket says 172.21.15.90:40880) 2024-09-10T23:17:23.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf461bc640 1 --2- 172.21.15.90:0/3125968196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf400cc7f0 0x7fdf4014bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:23.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf451ba640 1 -- 172.21.15.90:0/3125968196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf400cc7f0 msgr2=0x7fdf4014bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:23.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf451ba640 1 --2- 172.21.15.90:0/3125968196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf400cc7f0 0x7fdf4014bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:23.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf451ba640 1 -- 172.21.15.90:0/3125968196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf2c003a30 msgr2=0x7fdf400d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:23.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf451ba640 1 --2- 172.21.15.90:0/3125968196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf2c003a30 0x7fdf400d07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:23.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf451ba640 1 -- 172.21.15.90:0/3125968196 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf4014c8b0 con 0x7fdf401f92c0 2024-09-10T23:17:23.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf459bb640 1 --2- 172.21.15.90:0/3125968196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf2c003a30 0x7fdf400d07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:17:23.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf451ba640 1 --2- 172.21.15.90:0/3125968196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf401f92c0 0x7fdf400cc2b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fdf30004ed0 tx=0x7fdf30001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:23.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf367fc640 1 -- 172.21.15.90:0/3125968196 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf30015020 con 0x7fdf401f92c0 2024-09-10T23:17:23.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf367fc640 1 -- 172.21.15.90:0/3125968196 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf30011960 con 0x7fdf401f92c0 2024-09-10T23:17:23.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf367fc640 1 -- 172.21.15.90:0/3125968196 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf30011d70 con 0x7fdf401f92c0 2024-09-10T23:17:23.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf47c1f640 1 -- 172.21.15.90:0/3125968196 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf401f87e0 con 0x7fdf401f92c0 2024-09-10T23:17:23.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.118+0000 7fdf47c1f640 1 -- 172.21.15.90:0/3125968196 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf400ccc70 con 0x7fdf401f92c0 2024-09-10T23:17:23.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.119+0000 7fdf47c1f640 1 -- 172.21.15.90:0/3125968196 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf4006a430 con 0x7fdf401f92c0 2024-09-10T23:17:23.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.120+0000 7fdf367fc640 1 -- 172.21.15.90:0/3125968196 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdf3001a400 con 0x7fdf401f92c0 2024-09-10T23:17:23.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.120+0000 7fdf367fc640 1 --2- 172.21.15.90:0/3125968196 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdf24077fa0 0x7fdf2407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:23.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.121+0000 7fdf367fc640 1 -- 172.21.15.90:0/3125968196 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7fdf3009a6d0 con 0x7fdf401f92c0 2024-09-10T23:17:23.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.121+0000 7fdf459bb640 1 --2- 172.21.15.90:0/3125968196 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdf24077fa0 0x7fdf2407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:23.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.121+0000 7fdf459bb640 1 --2- 172.21.15.90:0/3125968196 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdf24077fa0 0x7fdf2407a460 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c035000 tx=0x7fdf3c02d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:23.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.125+0000 7fdf367fc640 1 -- 172.21.15.90:0/3125968196 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdf3001f020 con 0x7fdf401f92c0 2024-09-10T23:17:23.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:23.308+0000 7fdf47c1f640 1 -- 172.21.15.90:0/3125968196 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fdf400cfd00 con 0x7fdf401f92c0 2024-09-10T23:17:24.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.420+0000 7fdf367fc640 1 -- 172.21.15.90:0/3125968196 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v77) ==== 97+0+0 (secure 0 0 0) 0x7fdf30062f10 con 0x7fdf401f92c0 2024-09-10T23:17:24.421 INFO:teuthology.orchestra.run.smithi090.stderr: removed all blocklist entries 2024-09-10T23:17:24.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.422+0000 7fdf47c1f640 1 -- 172.21.15.90:0/3125968196 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdf24077fa0 msgr2=0x7fdf2407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:24.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.423+0000 7fdf47c1f640 1 --2- 172.21.15.90:0/3125968196 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdf24077fa0 0x7fdf2407a460 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c035000 tx=0x7fdf3c02d040 comp rx=0 tx=0).stop 2024-09-10T23:17:24.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.423+0000 7fdf47c1f640 1 -- 172.21.15.90:0/3125968196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf401f92c0 msgr2=0x7fdf400cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:24.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.423+0000 7fdf47c1f640 1 --2- 172.21.15.90:0/3125968196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf401f92c0 0x7fdf400cc2b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fdf30004ed0 tx=0x7fdf30001630 comp rx=0 tx=0).stop 2024-09-10T23:17:24.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.423+0000 7fdf47c1f640 1 -- 172.21.15.90:0/3125968196 shutdown_connections 2024-09-10T23:17:24.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.423+0000 7fdf47c1f640 1 --2- 172.21.15.90:0/3125968196 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdf24077fa0 0x7fdf2407a460 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.423+0000 7fdf47c1f640 1 --2- 172.21.15.90:0/3125968196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf400cc7f0 0x7fdf4014bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.423+0000 7fdf47c1f640 1 --2- 172.21.15.90:0/3125968196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf401f92c0 0x7fdf400cc2b0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.423+0000 7fdf47c1f640 1 --2- 172.21.15.90:0/3125968196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf2c003a30 0x7fdf400d07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.423+0000 7fdf47c1f640 1 -- 172.21.15.90:0/3125968196 >> 172.21.15.90:0/3125968196 conn(0x7fdf400697a0 msgr2=0x7fdf400b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:24.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.423+0000 7fdf47c1f640 1 -- 172.21.15.90:0/3125968196 shutdown_connections 2024-09-10T23:17:24.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.423+0000 7fdf47c1f640 1 -- 172.21.15.90:0/3125968196 wait complete. 2024-09-10T23:17:24.437 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:17:24.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.544+0000 7f7a38500640 1 -- 172.21.15.90:0/737084017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a300d1190 msgr2=0x7f7a300d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:24.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.544+0000 7f7a38500640 1 --2- 172.21.15.90:0/737084017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a300d1190 0x7f7a300d28c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009830 tx=0x7f7a2402a480 comp rx=0 tx=0).stop 2024-09-10T23:17:24.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.544+0000 7f7a38500640 1 -- 172.21.15.90:0/737084017 shutdown_connections 2024-09-10T23:17:24.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.544+0000 7f7a38500640 1 --2- 172.21.15.90:0/737084017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a300d16f0 0x7f7a300d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.544+0000 7f7a38500640 1 --2- 172.21.15.90:0/737084017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a300d1190 0x7f7a300d28c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.544+0000 7f7a38500640 1 -- 172.21.15.90:0/737084017 >> 172.21.15.90:0/737084017 conn(0x7f7a300d4090 msgr2=0x7f7a300d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:24.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.544+0000 7f7a38500640 1 -- 172.21.15.90:0/737084017 shutdown_connections 2024-09-10T23:17:24.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.544+0000 7f7a38500640 1 -- 172.21.15.90:0/737084017 wait complete. 2024-09-10T23:17:24.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.545+0000 7f7a38500640 1 Processor -- start 2024-09-10T23:17:24.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.545+0000 7f7a38500640 1 -- start start 2024-09-10T23:17:24.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a38500640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a300d1190 0x7f7a301f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:24.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a38500640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a300d16f0 0x7f7a30160380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:24.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a38500640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a3015e310 0x7f7a300b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:24.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a38500640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7a300d3340 con 0x7f7a300d1190 2024-09-10T23:17:24.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a38500640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7a300d4d90 con 0x7f7a300d16f0 2024-09-10T23:17:24.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a38500640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7a300d34c0 con 0x7f7a3015e310 2024-09-10T23:17:24.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a3629c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a300d1190 0x7f7a301f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:24.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a3629c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a300d1190 0x7f7a301f55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43770/0 (socket says 172.21.15.90:43770) 2024-09-10T23:17:24.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a3629c640 1 -- 172.21.15.90:0/3519475966 learned_addr learned my addr 172.21.15.90:0/3519475966 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:24.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a35a9b640 1 --2- 172.21.15.90:0/3519475966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a300d16f0 0x7f7a30160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:24.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a36a9d640 1 --2- 172.21.15.90:0/3519475966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a3015e310 0x7f7a300b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:24.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a3629c640 1 -- 172.21.15.90:0/3519475966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a3015e310 msgr2=0x7f7a300b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:24.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a3629c640 1 --2- 172.21.15.90:0/3519475966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a3015e310 0x7f7a300b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a3629c640 1 -- 172.21.15.90:0/3519475966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a300d16f0 msgr2=0x7f7a30160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:24.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a3629c640 1 --2- 172.21.15.90:0/3519475966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a300d16f0 0x7f7a30160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a3629c640 1 -- 172.21.15.90:0/3519475966 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a300b9ed0 con 0x7f7a300d1190 2024-09-10T23:17:24.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a3629c640 1 --2- 172.21.15.90:0/3519475966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a300d1190 0x7f7a301f55c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000cbc0 tx=0x7f7a2000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:24.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a2effd640 1 -- 172.21.15.90:0/3519475966 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a20016020 con 0x7f7a300d1190 2024-09-10T23:17:24.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a2effd640 1 -- 172.21.15.90:0/3519475966 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a2000ad90 con 0x7f7a300d1190 2024-09-10T23:17:24.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a38500640 1 -- 172.21.15.90:0/3519475966 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a300cd3c0 con 0x7f7a300d1190 2024-09-10T23:17:24.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.546+0000 7f7a2effd640 1 -- 172.21.15.90:0/3519475966 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a20012680 con 0x7f7a300d1190 2024-09-10T23:17:24.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.547+0000 7f7a38500640 1 -- 172.21.15.90:0/3519475966 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a300cd980 con 0x7f7a300d1190 2024-09-10T23:17:24.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.547+0000 7f7a38500640 1 -- 172.21.15.90:0/3519475966 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a300d3910 con 0x7f7a300d1190 2024-09-10T23:17:24.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.548+0000 7f7a2effd640 1 -- 172.21.15.90:0/3519475966 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7a2001b400 con 0x7f7a300d1190 2024-09-10T23:17:24.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.548+0000 7f7a2effd640 1 --2- 172.21.15.90:0/3519475966 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7a1c077f70 0x7f7a1c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:24.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.549+0000 7f7a2effd640 1 -- 172.21.15.90:0/3519475966 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 4857+0+0 (secure 0 0 0) 0x7f7a2009a300 con 0x7f7a300d1190 2024-09-10T23:17:24.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.549+0000 7f7a35a9b640 1 --2- 172.21.15.90:0/3519475966 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7a1c077f70 0x7f7a1c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:24.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.549+0000 7f7a35a9b640 1 --2- 172.21.15.90:0/3519475966 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7a1c077f70 0x7f7a1c07a430 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7a24034000 tx=0x7f7a24004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:24.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.553+0000 7f7a2effd640 1 -- 172.21.15.90:0/3519475966 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7a20020020 con 0x7f7a300d1190 2024-09-10T23:17:24.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.793+0000 7f7a38500640 1 -- 172.21.15.90:0/3519475966 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7a300d4470 con 0x7f7a300d1190 2024-09-10T23:17:24.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.793+0000 7f7a2effd640 1 -- 172.21.15.90:0/3519475966 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v28) ==== 80+0+5304 (secure 0 0 0) 0x7f7a20063160 con 0x7f7a300d1190 2024-09-10T23:17:24.795 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:24.795 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:17:24.795 INFO:teuthology.orchestra.run.smithi090.stdout: "auth_dump": [ 2024-09-10T23:17:24.795 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.795 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.a", 2024-09-10T23:17:24.795 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBm/QY6KxAAKT1mZg/6ZcszcNrPmouZfw==", 2024-09-10T23:17:24.795 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.795 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:17:24.795 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:17:24.796 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:17:24.796 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:24.796 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.796 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.796 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.796 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.b", 2024-09-10T23:17:24.796 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmSqPhNhAA3flpsOGFszFMeaPUoHAtJg==", 2024-09-10T23:17:24.796 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.796 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:17:24.796 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:17:24.796 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:17:24.797 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:24.797 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.797 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.797 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.797 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.c", 2024-09-10T23:17:24.797 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmDVE4MhAAHal/PtI10hL4nKdTUO5BiQ==", 2024-09-10T23:17:24.797 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.797 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:17:24.797 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:17:24.797 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:17:24.798 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:24.798 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.798 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.798 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.798 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.d", 2024-09-10T23:17:24.798 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmr3lfAhAAFdZ7zvJmGNFHRwCr+mdY7w==", 2024-09-10T23:17:24.798 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.798 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:17:24.798 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:17:24.798 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:17:24.798 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:24.799 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.799 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.799 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.799 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.0", 2024-09-10T23:17:24.799 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCa0uBmZKxTJRAAfEBB/vykopmDbmREyy227g==", 2024-09-10T23:17:24.799 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.799 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:17:24.799 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:17:24.799 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:24.799 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.799 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.799 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.800 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.1", 2024-09-10T23:17:24.800 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCd0uBmJHG8NRAAS8QD8Zgrxrxddq7kN4P9Ag==", 2024-09-10T23:17:24.800 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.800 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:17:24.800 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:17:24.800 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:24.800 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.800 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.800 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.800 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.2", 2024-09-10T23:17:24.800 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCh0uBmtUUmDBAAmYRv9P/wjX8HLVkLatoXuQ==", 2024-09-10T23:17:24.801 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.801 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:17:24.801 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:17:24.801 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:24.801 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.801 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.801 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.801 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.3", 2024-09-10T23:17:24.801 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCk0uBm4397HBAAGZK0ktD0ORY/0CPlMprYFg==", 2024-09-10T23:17:24.801 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.801 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:17:24.802 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:17:24.802 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:24.802 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.802 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.802 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.802 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.4", 2024-09-10T23:17:24.802 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCq0uBmBaMINBAAkuhNrc4YFAYQfcxMQenCBQ==", 2024-09-10T23:17:24.802 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.802 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:17:24.802 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:17:24.802 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:24.803 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.803 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.803 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.803 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.5", 2024-09-10T23:17:24.803 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCu0uBmLOrnCBAAwZTy+62ZN3g5jfH20jB4qw==", 2024-09-10T23:17:24.803 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.803 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:17:24.803 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:17:24.803 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:24.803 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.803 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.803 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.804 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.6", 2024-09-10T23:17:24.804 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCx0uBmr4bYChAAdWog9uHnYgiiXniefs25DA==", 2024-09-10T23:17:24.804 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.804 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:17:24.804 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:17:24.804 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:24.804 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.804 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.804 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.804 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.7", 2024-09-10T23:17:24.804 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQC00uBmhU7+DBAAEagAuXuCs1v/vDhIkapi+g==", 2024-09-10T23:17:24.805 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.805 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:17:24.805 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:17:24.805 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:24.805 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.805 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.805 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.805 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.0", 2024-09-10T23:17:24.805 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmiYBwBhAABMV9erpQ+KZlTmf0kDZ0gw==", 2024-09-10T23:17:24.806 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.806 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:17:24.806 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow r", 2024-09-10T23:17:24.806 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:17:24.806 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.806 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.806 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.806 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.1", 2024-09-10T23:17:24.806 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBm+TBDDxAA4o+iZ4PwpBRpY++ATzt+wg==", 2024-09-10T23:17:24.806 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.806 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:17:24.806 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:17:24.807 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:17:24.807 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:17:24.807 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.807 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.807 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.807 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.2", 2024-09-10T23:17:24.807 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmJYcKDBAArXISnuT+R9uzuQnL3V+wSg==", 2024-09-10T23:17:24.807 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.807 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:17:24.807 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:17:24.807 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:17:24.807 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:17:24.808 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.808 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.808 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.808 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.3", 2024-09-10T23:17:24.808 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmPQvkFBAAaCikPByOvk5xUzTWXdcFPA==", 2024-09-10T23:17:24.808 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.808 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:17:24.808 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:17:24.808 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:17:24.808 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:17:24.808 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.809 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.809 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.809 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.admin", 2024-09-10T23:17:24.809 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmVVIQEBAAY7yzFxxQCyV1YCM3xYC7Og==", 2024-09-10T23:17:24.809 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.809 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:17:24.809 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:17:24.809 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:17:24.809 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:24.809 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.809 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.809 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.810 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.x", 2024-09-10T23:17:24.810 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBm4r0EKBAAIZ4VjoTsUpdB6KFbi7EQLQ==", 2024-09-10T23:17:24.810 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.810 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:17:24.810 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2024-09-10T23:17:24.810 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:24.810 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.810 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:24.810 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:24.810 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.y", 2024-09-10T23:17:24.810 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmkRSfJBAAWPpV5e4zeX0Es78Xqh9pYw==", 2024-09-10T23:17:24.810 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:24.811 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:17:24.811 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2024-09-10T23:17:24.811 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:24.811 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.811 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:24.811 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-10T23:17:24.811 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:17:24.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.795+0000 7f7a38500640 1 -- 172.21.15.90:0/3519475966 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7a1c077f70 msgr2=0x7f7a1c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:24.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.796+0000 7f7a38500640 1 --2- 172.21.15.90:0/3519475966 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7a1c077f70 0x7f7a1c07a430 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7a24034000 tx=0x7f7a24004730 comp rx=0 tx=0).stop 2024-09-10T23:17:24.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.796+0000 7f7a38500640 1 -- 172.21.15.90:0/3519475966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a300d1190 msgr2=0x7f7a301f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:24.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.796+0000 7f7a38500640 1 --2- 172.21.15.90:0/3519475966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a300d1190 0x7f7a301f55c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000cbc0 tx=0x7f7a2000a060 comp rx=0 tx=0).stop 2024-09-10T23:17:24.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.796+0000 7f7a38500640 1 -- 172.21.15.90:0/3519475966 shutdown_connections 2024-09-10T23:17:24.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.796+0000 7f7a38500640 1 --2- 172.21.15.90:0/3519475966 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7a1c077f70 0x7f7a1c07a430 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.796+0000 7f7a38500640 1 --2- 172.21.15.90:0/3519475966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a300d16f0 0x7f7a30160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.796+0000 7f7a38500640 1 --2- 172.21.15.90:0/3519475966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a3015e310 0x7f7a300b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.796+0000 7f7a38500640 1 --2- 172.21.15.90:0/3519475966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a300d1190 0x7f7a301f55c0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.796+0000 7f7a38500640 1 -- 172.21.15.90:0/3519475966 >> 172.21.15.90:0/3519475966 conn(0x7f7a300d4090 msgr2=0x7f7a3006d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:24.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.796+0000 7f7a38500640 1 -- 172.21.15.90:0/3519475966 shutdown_connections 2024-09-10T23:17:24.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.796+0000 7f7a38500640 1 -- 172.21.15.90:0/3519475966 wait complete. 2024-09-10T23:17:24.814 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:17:24.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.914+0000 7f74bd717640 1 -- 172.21.15.90:0/3617580207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b80d3140 msgr2=0x7f74b80cfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:24.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.914+0000 7f74bd717640 1 --2- 172.21.15.90:0/3617580207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b80d3140 0x7f74b80cfbb0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f74b80b6c40 tx=0x7f74b002a8b0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.914+0000 7f74bd717640 1 -- 172.21.15.90:0/3617580207 shutdown_connections 2024-09-10T23:17:24.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.914+0000 7f74bd717640 1 --2- 172.21.15.90:0/3617580207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b80d3140 0x7f74b80cfbb0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.914+0000 7f74bd717640 1 --2- 172.21.15.90:0/3617580207 >> v2:172.21.15.171:3300/0 conn(0x7f74b8161820 0x7f74b80d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.914+0000 7f74bd717640 1 -- 172.21.15.90:0/3617580207 >> 172.21.15.90:0/3617580207 conn(0x7f74b80d4090 msgr2=0x7f74b80d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:24.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.914+0000 7f74bd717640 1 -- 172.21.15.90:0/3617580207 shutdown_connections 2024-09-10T23:17:24.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.914+0000 7f74bd717640 1 -- 172.21.15.90:0/3617580207 wait complete. 2024-09-10T23:17:24.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.916+0000 7f74bd717640 1 Processor -- start 2024-09-10T23:17:24.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.916+0000 7f74bd717640 1 -- start start 2024-09-10T23:17:24.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.916+0000 7f74bd717640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74b80d08c0 0x7f74b809fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:24.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.916+0000 7f74bd717640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74b80d3140 0x7f74b809e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:24.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74bd717640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b8161820 0x7f74b80b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:24.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74bd717640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f74b806d6d0 con 0x7f74b8161820 2024-09-10T23:17:24.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74bd717640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f74b80d4dc0 con 0x7f74b80d3140 2024-09-10T23:17:24.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74bd717640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f74b806d850 con 0x7f74b80d08c0 2024-09-10T23:17:24.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74b77fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b8161820 0x7f74b80b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:24.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74b77fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b8161820 0x7f74b80b1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43794/0 (socket says 172.21.15.90:43794) 2024-09-10T23:17:24.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74b77fe640 1 -- 172.21.15.90:0/3981839944 learned_addr learned my addr 172.21.15.90:0/3981839944 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:24.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74ae7fc640 1 --2- 172.21.15.90:0/3981839944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74b80d3140 0x7f74b809e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:24.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74b6ffd640 1 --2- 172.21.15.90:0/3981839944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74b80d08c0 0x7f74b809fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:24.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74b77fe640 1 -- 172.21.15.90:0/3981839944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74b80d08c0 msgr2=0x7f74b809fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:24.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74b77fe640 1 --2- 172.21.15.90:0/3981839944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74b80d08c0 0x7f74b809fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74b77fe640 1 -- 172.21.15.90:0/3981839944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74b80d3140 msgr2=0x7f74b809e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:24.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74b77fe640 1 --2- 172.21.15.90:0/3981839944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74b80d3140 0x7f74b809e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:24.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74b77fe640 1 -- 172.21.15.90:0/3981839944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b80a0310 con 0x7f74b8161820 2024-09-10T23:17:24.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74ae7fc640 1 --2- 172.21.15.90:0/3981839944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74b80d3140 0x7f74b809e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:24.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74b77fe640 1 --2- 172.21.15.90:0/3981839944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b8161820 0x7f74b80b1530 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f74b002aea0 tx=0x7f74b0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:24.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74affff640 1 -- 172.21.15.90:0/3981839944 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b0040070 con 0x7f74b8161820 2024-09-10T23:17:24.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74affff640 1 -- 172.21.15.90:0/3981839944 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74b0004330 con 0x7f74b8161820 2024-09-10T23:17:24.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74bd717640 1 -- 172.21.15.90:0/3981839944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b81f4ba0 con 0x7f74b8161820 2024-09-10T23:17:24.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74affff640 1 -- 172.21.15.90:0/3981839944 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b0004700 con 0x7f74b8161820 2024-09-10T23:17:24.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.917+0000 7f74bd717640 1 -- 172.21.15.90:0/3981839944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b81f5160 con 0x7f74b8161820 2024-09-10T23:17:24.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.918+0000 7f74bd717640 1 -- 172.21.15.90:0/3981839944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b806de40 con 0x7f74b8161820 2024-09-10T23:17:24.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.919+0000 7f74affff640 1 -- 172.21.15.90:0/3981839944 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f74b004d030 con 0x7f74b8161820 2024-09-10T23:17:24.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.919+0000 7f74affff640 1 --2- 172.21.15.90:0/3981839944 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7498077f70 0x7f749807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:24.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.920+0000 7f74affff640 1 -- 172.21.15.90:0/3981839944 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 4857+0+0 (secure 0 0 0) 0x7f74b00bb130 con 0x7f74b8161820 2024-09-10T23:17:24.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.920+0000 7f74b6ffd640 1 --2- 172.21.15.90:0/3981839944 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7498077f70 0x7f749807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:24.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.920+0000 7f74b6ffd640 1 --2- 172.21.15.90:0/3981839944 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7498077f70 0x7f749807a430 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f74b80a1e40 tx=0x7f74a8009060 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:24.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:24.924+0000 7f74affff640 1 -- 172.21.15.90:0/3981839944 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f74b0084010 con 0x7f74b8161820 2024-09-10T23:17:24.934 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:17:24.936 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:17:25.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.103+0000 7f74bd717640 1 -- 172.21.15.90:0/3981839944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f74b815f9a0 con 0x7f74b8161820 2024-09-10T23:17:25.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.103+0000 7f74affff640 1 -- 172.21.15.90:0/3981839944 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7f74b0083910 con 0x7f74b8161820 2024-09-10T23:17:25.104 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:25.104 INFO:teuthology.orchestra.run.smithi090.stdout:[ 2024-09-10T23:17:25.104 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:25.105 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 1, 2024-09-10T23:17:25.105 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": ".mgr" 2024-09-10T23:17:25.105 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:25.105 INFO:teuthology.orchestra.run.smithi090.stdout:] 2024-09-10T23:17:25.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.105+0000 7f74bd717640 1 -- 172.21.15.90:0/3981839944 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7498077f70 msgr2=0x7f749807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:25.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.105+0000 7f74bd717640 1 --2- 172.21.15.90:0/3981839944 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7498077f70 0x7f749807a430 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f74b80a1e40 tx=0x7f74a8009060 comp rx=0 tx=0).stop 2024-09-10T23:17:25.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.105+0000 7f74bd717640 1 -- 172.21.15.90:0/3981839944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b8161820 msgr2=0x7f74b80b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:25.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.105+0000 7f74bd717640 1 --2- 172.21.15.90:0/3981839944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b8161820 0x7f74b80b1530 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f74b002aea0 tx=0x7f74b0003ba0 comp rx=0 tx=0).stop 2024-09-10T23:17:25.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.105+0000 7f74bd717640 1 -- 172.21.15.90:0/3981839944 shutdown_connections 2024-09-10T23:17:25.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.105+0000 7f74bd717640 1 --2- 172.21.15.90:0/3981839944 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7498077f70 0x7f749807a430 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:25.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.105+0000 7f74bd717640 1 --2- 172.21.15.90:0/3981839944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74b80d3140 0x7f74b809e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:25.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.105+0000 7f74bd717640 1 --2- 172.21.15.90:0/3981839944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74b8161820 0x7f74b80b1530 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:25.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.105+0000 7f74bd717640 1 --2- 172.21.15.90:0/3981839944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74b80d08c0 0x7f74b809fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:25.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.105+0000 7f74bd717640 1 -- 172.21.15.90:0/3981839944 >> 172.21.15.90:0/3981839944 conn(0x7f74b80d4090 msgr2=0x7f74b80b60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:25.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.105+0000 7f74bd717640 1 -- 172.21.15.90:0/3981839944 shutdown_connections 2024-09-10T23:17:25.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.105+0000 7f74bd717640 1 -- 172.21.15.90:0/3981839944 wait complete. 2024-09-10T23:17:25.117 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:17:25.117 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:17:25.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.222+0000 7fb8154e6640 1 -- 172.21.15.90:0/561479429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f8003a00 msgr2=0x7fb7f8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:25.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.222+0000 7fb8154e6640 1 --2- 172.21.15.90:0/561479429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f8003a00 0x7fb7f8003e20 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fb81008e600 tx=0x7fb7f8005830 comp rx=0 tx=0).stop 2024-09-10T23:17:25.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.222+0000 7fb80f7fe640 1 -- 172.21.15.90:0/561479429 reap_dead start 2024-09-10T23:17:25.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.222+0000 7fb8154e6640 1 -- 172.21.15.90:0/561479429 shutdown_connections 2024-09-10T23:17:25.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.222+0000 7fb8154e6640 1 -- 172.21.15.90:0/561479429 >> 172.21.15.90:0/561479429 conn(0x7fb8100d4150 msgr2=0x7fb8100d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:25.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.222+0000 7fb8154e6640 1 -- 172.21.15.90:0/561479429 shutdown_connections 2024-09-10T23:17:25.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.222+0000 7fb8154e6640 1 -- 172.21.15.90:0/561479429 wait complete. 2024-09-10T23:17:25.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.224+0000 7fb8154e6640 1 Processor -- start 2024-09-10T23:17:25.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.224+0000 7fb8154e6640 1 -- start start 2024-09-10T23:17:25.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.224+0000 7fb8154e6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f8003a00 0x7fb8100cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:25.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.224+0000 7fb8154e6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8100b7de0 0x7fb8100b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:25.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.224+0000 7fb8154e6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8100b9020 0x7fb8101f4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:25.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.224+0000 7fb8154e6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb8100cfee0 con 0x7fb7f8003a00 2024-09-10T23:17:25.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.224+0000 7fb8154e6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb8100cfd60 con 0x7fb8100b9020 2024-09-10T23:17:25.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.224+0000 7fb8154e6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb810162c00 con 0x7fb8100b7de0 2024-09-10T23:17:25.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.224+0000 7fb80effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f8003a00 0x7fb8100cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:25.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.224+0000 7fb80effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f8003a00 0x7fb8100cc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43814/0 (socket says 172.21.15.90:43814) 2024-09-10T23:17:25.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.224+0000 7fb80effd640 1 -- 172.21.15.90:0/691052404 learned_addr learned my addr 172.21.15.90:0/691052404 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:25.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.225+0000 7fb80e7fc640 1 --2- 172.21.15.90:0/691052404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8100b7de0 0x7fb8100b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:25.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.225+0000 7fb80f7fe640 1 --2- 172.21.15.90:0/691052404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8100b9020 0x7fb8101f4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:25.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.225+0000 7fb80effd640 1 -- 172.21.15.90:0/691052404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8100b7de0 msgr2=0x7fb8100b8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:25.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.225+0000 7fb80effd640 1 --2- 172.21.15.90:0/691052404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8100b7de0 0x7fb8100b8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:25.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.225+0000 7fb80effd640 1 -- 172.21.15.90:0/691052404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8100b9020 msgr2=0x7fb8101f4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:25.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.225+0000 7fb80effd640 1 --2- 172.21.15.90:0/691052404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8100b9020 0x7fb8101f4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:25.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.225+0000 7fb80effd640 1 -- 172.21.15.90:0/691052404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8101f5b70 con 0x7fb7f8003a00 2024-09-10T23:17:25.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.225+0000 7fb80f7fe640 1 --2- 172.21.15.90:0/691052404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8100b9020 0x7fb8101f4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:25.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.225+0000 7fb80e7fc640 1 --2- 172.21.15.90:0/691052404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8100b7de0 0x7fb8100b8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:25.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.225+0000 7fb80effd640 1 --2- 172.21.15.90:0/691052404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f8003a00 0x7fb8100cc840 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb800000c00 tx=0x7fb800000f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:25.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.225+0000 7fb7f77fe640 1 -- 172.21.15.90:0/691052404 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb800031040 con 0x7fb7f8003a00 2024-09-10T23:17:25.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.225+0000 7fb7f77fe640 1 -- 172.21.15.90:0/691052404 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb800003610 con 0x7fb7f8003a00 2024-09-10T23:17:25.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.225+0000 7fb8154e6640 1 -- 172.21.15.90:0/691052404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8100b7020 con 0x7fb7f8003a00 2024-09-10T23:17:25.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.225+0000 7fb7f77fe640 1 -- 172.21.15.90:0/691052404 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb800003a60 con 0x7fb7f8003a00 2024-09-10T23:17:25.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.225+0000 7fb8154e6640 1 -- 172.21.15.90:0/691052404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8100b75e0 con 0x7fb7f8003a00 2024-09-10T23:17:25.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.226+0000 7fb8154e6640 1 -- 172.21.15.90:0/691052404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8100b9400 con 0x7fb7f8003a00 2024-09-10T23:17:25.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.227+0000 7fb7f77fe640 1 -- 172.21.15.90:0/691052404 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb800003c00 con 0x7fb7f8003a00 2024-09-10T23:17:25.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.227+0000 7fb7f77fe640 1 --2- 172.21.15.90:0/691052404 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb7fc077fa0 0x7fb7fc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:25.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.227+0000 7fb7f77fe640 1 -- 172.21.15.90:0/691052404 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 4857+0+0 (secure 0 0 0) 0x7fb8000b9d00 con 0x7fb7f8003a00 2024-09-10T23:17:25.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.227+0000 7fb80e7fc640 1 --2- 172.21.15.90:0/691052404 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb7fc077fa0 0x7fb7fc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:25.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.228+0000 7fb80e7fc640 1 --2- 172.21.15.90:0/691052404 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb7fc077fa0 0x7fb7fc07a460 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb804005fd0 tx=0x7fb80400df90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:25.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.231+0000 7fb7f77fe640 1 -- 172.21.15.90:0/691052404 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb8000bd030 con 0x7fb7f8003a00 2024-09-10T23:17:25.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.404+0000 7fb8154e6640 1 -- 172.21.15.90:0/691052404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb8100b5270 con 0x7fb7f8003a00 2024-09-10T23:17:25.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.812+0000 7fb7f77fe640 1 -- 172.21.15.90:0/691052404 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7fb800082c30 con 0x7fb7f8003a00 2024-09-10T23:17:25.814 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' created 2024-09-10T23:17:25.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.815+0000 7fb8154e6640 1 -- 172.21.15.90:0/691052404 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb7fc077fa0 msgr2=0x7fb7fc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:25.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.815+0000 7fb8154e6640 1 --2- 172.21.15.90:0/691052404 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb7fc077fa0 0x7fb7fc07a460 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb804005fd0 tx=0x7fb80400df90 comp rx=0 tx=0).stop 2024-09-10T23:17:25.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.815+0000 7fb8154e6640 1 -- 172.21.15.90:0/691052404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f8003a00 msgr2=0x7fb8100cc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:25.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.815+0000 7fb8154e6640 1 --2- 172.21.15.90:0/691052404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f8003a00 0x7fb8100cc840 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb800000c00 tx=0x7fb800000f60 comp rx=0 tx=0).stop 2024-09-10T23:17:25.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.815+0000 7fb8154e6640 1 -- 172.21.15.90:0/691052404 shutdown_connections 2024-09-10T23:17:25.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.815+0000 7fb8154e6640 1 --2- 172.21.15.90:0/691052404 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb7fc077fa0 0x7fb7fc07a460 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:25.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.815+0000 7fb8154e6640 1 --2- 172.21.15.90:0/691052404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8100b9020 0x7fb8101f4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:25.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.815+0000 7fb8154e6640 1 --2- 172.21.15.90:0/691052404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8100b7de0 0x7fb8100b8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:25.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.815+0000 7fb8154e6640 1 --2- 172.21.15.90:0/691052404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f8003a00 0x7fb8100cc840 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:25.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.815+0000 7fb8154e6640 1 -- 172.21.15.90:0/691052404 >> 172.21.15.90:0/691052404 conn(0x7fb8100d4150 msgr2=0x7fb8100d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:25.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.815+0000 7fb8154e6640 1 -- 172.21.15.90:0/691052404 shutdown_connections 2024-09-10T23:17:25.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.815+0000 7fb8154e6640 1 -- 172.21.15.90:0/691052404 wait complete. 2024-09-10T23:17:25.832 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:17:25.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.940+0000 7f9bd64bd640 1 -- 172.21.15.90:0/3919923685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bd00d1190 msgr2=0x7f9bd00d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:25.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.940+0000 7f9bd64bd640 1 --2- 172.21.15.90:0/3919923685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bd00d1190 0x7f9bd00d28c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009830 tx=0x7f9bc402a480 comp rx=0 tx=0).stop 2024-09-10T23:17:25.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.940+0000 7f9bd64bd640 1 -- 172.21.15.90:0/3919923685 shutdown_connections 2024-09-10T23:17:25.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.940+0000 7f9bd64bd640 1 --2- 172.21.15.90:0/3919923685 >> v2:172.21.15.171:3300/0 conn(0x7f9bd00d16f0 0x7f9bd00d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:25.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.940+0000 7f9bd64bd640 1 --2- 172.21.15.90:0/3919923685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bd00d1190 0x7f9bd00d28c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:25.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.940+0000 7f9bd64bd640 1 -- 172.21.15.90:0/3919923685 >> 172.21.15.90:0/3919923685 conn(0x7f9bd00d4090 msgr2=0x7f9bd00d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:25.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.940+0000 7f9bd64bd640 1 -- 172.21.15.90:0/3919923685 shutdown_connections 2024-09-10T23:17:25.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.940+0000 7f9bd64bd640 1 -- 172.21.15.90:0/3919923685 wait complete. 2024-09-10T23:17:25.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.942+0000 7f9bd64bd640 1 Processor -- start 2024-09-10T23:17:25.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.942+0000 7f9bd64bd640 1 -- start start 2024-09-10T23:17:25.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.942+0000 7f9bd64bd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bd00d1190 0x7f9bd00b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:25.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.942+0000 7f9bd64bd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bd00d16f0 0x7f9bd00b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:25.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bd64bd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bd015e310 0x7f9bd0161070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:25.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bd64bd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd00d3340 con 0x7f9bd015e310 2024-09-10T23:17:25.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bd64bd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd00d4d90 con 0x7f9bd00d16f0 2024-09-10T23:17:25.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bd64bd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd00d34c0 con 0x7f9bd00d1190 2024-09-10T23:17:25.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bd4a5a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bd015e310 0x7f9bd0161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:25.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bd4a5a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bd015e310 0x7f9bd0161070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43824/0 (socket says 172.21.15.90:43824) 2024-09-10T23:17:25.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bd4a5a640 1 -- 172.21.15.90:0/2428317358 learned_addr learned my addr 172.21.15.90:0/2428317358 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:25.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bcffff640 1 --2- 172.21.15.90:0/2428317358 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bd00d1190 0x7f9bd00b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:25.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bcf7fe640 1 --2- 172.21.15.90:0/2428317358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bd00d16f0 0x7f9bd00b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:25.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bd4a5a640 1 -- 172.21.15.90:0/2428317358 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bd00d1190 msgr2=0x7f9bd00b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:25.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bd4a5a640 1 --2- 172.21.15.90:0/2428317358 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bd00d1190 0x7f9bd00b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:25.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bd4a5a640 1 -- 172.21.15.90:0/2428317358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bd00d16f0 msgr2=0x7f9bd00b7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:25.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bd4a5a640 1 --2- 172.21.15.90:0/2428317358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bd00d16f0 0x7f9bd00b7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:25.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bd4a5a640 1 -- 172.21.15.90:0/2428317358 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd00b88b0 con 0x7f9bd015e310 2024-09-10T23:17:25.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bcf7fe640 1 --2- 172.21.15.90:0/2428317358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bd00d16f0 0x7f9bd00b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:25.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bd4a5a640 1 --2- 172.21.15.90:0/2428317358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bd015e310 0x7f9bd0161070 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800efc0 tx=0x7f9bc800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:25.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bccff9640 1 -- 172.21.15.90:0/2428317358 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8003970 con 0x7f9bd015e310 2024-09-10T23:17:25.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bccff9640 1 -- 172.21.15.90:0/2428317358 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bc8003c20 con 0x7f9bd015e310 2024-09-10T23:17:25.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bd64bd640 1 -- 172.21.15.90:0/2428317358 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd00b8e40 con 0x7f9bd015e310 2024-09-10T23:17:25.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bccff9640 1 -- 172.21.15.90:0/2428317358 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8004280 con 0x7f9bd015e310 2024-09-10T23:17:25.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.943+0000 7f9bd64bd640 1 -- 172.21.15.90:0/2428317358 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd0160b50 con 0x7f9bd015e310 2024-09-10T23:17:25.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.944+0000 7f9bd64bd640 1 -- 172.21.15.90:0/2428317358 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd00d39a0 con 0x7f9bd015e310 2024-09-10T23:17:25.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.945+0000 7f9bccff9640 1 -- 172.21.15.90:0/2428317358 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9bc800b040 con 0x7f9bd015e310 2024-09-10T23:17:25.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.946+0000 7f9bccff9640 1 --2- 172.21.15.90:0/2428317358 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9bbc077f70 0x7f9bbc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:25.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.946+0000 7f9bccff9640 1 -- 172.21.15.90:0/2428317358 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5227+0+0 (secure 0 0 0) 0x7f9bc809a6d0 con 0x7f9bd015e310 2024-09-10T23:17:25.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.946+0000 7f9bcffff640 1 --2- 172.21.15.90:0/2428317358 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9bbc077f70 0x7f9bbc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:25.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.947+0000 7f9bcffff640 1 --2- 172.21.15.90:0/2428317358 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9bbc077f70 0x7f9bbc07a430 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00b99f0 tx=0x7f9bc0009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:25.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:25.949+0000 7f9bccff9640 1 -- 172.21.15.90:0/2428317358 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9bc8063490 con 0x7f9bd015e310 2024-09-10T23:17:26.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.127+0000 7f9bd64bd640 1 -- 172.21.15.90:0/2428317358 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9bd00b3c00 con 0x7f9bd015e310 2024-09-10T23:17:26.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.819+0000 7f9bccff9640 1 -- 172.21.15.90:0/2428317358 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7f9bc8062d90 con 0x7f9bd015e310 2024-09-10T23:17:26.823 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' created 2024-09-10T23:17:26.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.822+0000 7f9bd64bd640 1 -- 172.21.15.90:0/2428317358 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9bbc077f70 msgr2=0x7f9bbc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:26.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.822+0000 7f9bd64bd640 1 --2- 172.21.15.90:0/2428317358 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9bbc077f70 0x7f9bbc07a430 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00b99f0 tx=0x7f9bc0009040 comp rx=0 tx=0).stop 2024-09-10T23:17:26.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.822+0000 7f9bd64bd640 1 -- 172.21.15.90:0/2428317358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bd015e310 msgr2=0x7f9bd0161070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:26.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.822+0000 7f9bd64bd640 1 --2- 172.21.15.90:0/2428317358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bd015e310 0x7f9bd0161070 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800efc0 tx=0x7f9bc800c800 comp rx=0 tx=0).stop 2024-09-10T23:17:26.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.822+0000 7f9bd64bd640 1 -- 172.21.15.90:0/2428317358 shutdown_connections 2024-09-10T23:17:26.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.822+0000 7f9bd64bd640 1 --2- 172.21.15.90:0/2428317358 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9bbc077f70 0x7f9bbc07a430 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:26.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.822+0000 7f9bd64bd640 1 --2- 172.21.15.90:0/2428317358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bd00d16f0 0x7f9bd00b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:26.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.822+0000 7f9bd64bd640 1 --2- 172.21.15.90:0/2428317358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bd015e310 0x7f9bd0161070 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:26.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.822+0000 7f9bd64bd640 1 --2- 172.21.15.90:0/2428317358 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bd00d1190 0x7f9bd00b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:26.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.822+0000 7f9bd64bd640 1 -- 172.21.15.90:0/2428317358 >> 172.21.15.90:0/2428317358 conn(0x7f9bd00d4090 msgr2=0x7f9bd00d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:26.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.822+0000 7f9bd64bd640 1 -- 172.21.15.90:0/2428317358 shutdown_connections 2024-09-10T23:17:26.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.823+0000 7f9bd64bd640 1 -- 172.21.15.90:0/2428317358 wait complete. 2024-09-10T23:17:26.844 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:17:26.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.949+0000 7f01481ad640 1 -- 172.21.15.90:0/2553079187 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f014015e310 msgr2=0x7f01400d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:26.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.949+0000 7f01481ad640 1 --2- 172.21.15.90:0/2553079187 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f014015e310 0x7f01400d0a80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0134009830 tx=0x7f013402a480 comp rx=0 tx=0).stop 2024-09-10T23:17:26.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.949+0000 7f01481ad640 1 -- 172.21.15.90:0/2553079187 shutdown_connections 2024-09-10T23:17:26.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.949+0000 7f01481ad640 1 --2- 172.21.15.90:0/2553079187 >> v2:172.21.15.171:3300/0 conn(0x7f01400d16f0 0x7f01400d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:26.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.949+0000 7f01481ad640 1 --2- 172.21.15.90:0/2553079187 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f014015e310 0x7f01400d0a80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:26.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.949+0000 7f01481ad640 1 -- 172.21.15.90:0/2553079187 >> 172.21.15.90:0/2553079187 conn(0x7f01400d4090 msgr2=0x7f01400d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:26.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.949+0000 7f01481ad640 1 -- 172.21.15.90:0/2553079187 shutdown_connections 2024-09-10T23:17:26.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.949+0000 7f01481ad640 1 -- 172.21.15.90:0/2553079187 wait complete. 2024-09-10T23:17:26.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.950+0000 7f01481ad640 1 Processor -- start 2024-09-10T23:17:26.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.950+0000 7f01481ad640 1 -- start start 2024-09-10T23:17:26.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.951+0000 7f01481ad640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01400d16f0 0x7f01400b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:26.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.951+0000 7f01481ad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01400d4b80 0x7f01400ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:26.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.951+0000 7f01481ad640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f014015e310 0x7f01401f4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:26.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.951+0000 7f01481ad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f014006de00 con 0x7f01400d4b80 2024-09-10T23:17:26.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.951+0000 7f01481ad640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f01400d3ae0 con 0x7f01400d16f0 2024-09-10T23:17:26.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.951+0000 7f01481ad640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f014006df80 con 0x7f014015e310 2024-09-10T23:17:26.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.951+0000 7f0145748640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01400d4b80 0x7f01400ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:26.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.951+0000 7f0145748640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01400d4b80 0x7f01400ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43826/0 (socket says 172.21.15.90:43826) 2024-09-10T23:17:26.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.951+0000 7f0145748640 1 -- 172.21.15.90:0/2895857336 learned_addr learned my addr 172.21.15.90:0/2895857336 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:26.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.951+0000 7f0145f49640 1 --2- 172.21.15.90:0/2895857336 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01400d16f0 0x7f01400b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:26.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.951+0000 7f014674a640 1 --2- 172.21.15.90:0/2895857336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f014015e310 0x7f01401f4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:26.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.951+0000 7f0145748640 1 -- 172.21.15.90:0/2895857336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f014015e310 msgr2=0x7f01401f4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:26.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.951+0000 7f0145748640 1 --2- 172.21.15.90:0/2895857336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f014015e310 0x7f01401f4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:26.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.951+0000 7f0145748640 1 -- 172.21.15.90:0/2895857336 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01400d16f0 msgr2=0x7f01400b91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:26.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.951+0000 7f0145748640 1 --2- 172.21.15.90:0/2895857336 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01400d16f0 0x7f01400b91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:26.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.951+0000 7f0145748640 1 -- 172.21.15.90:0/2895857336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01401f5180 con 0x7f01400d4b80 2024-09-10T23:17:26.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.951+0000 7f0145748640 1 --2- 172.21.15.90:0/2895857336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01400d4b80 0x7f01400ccae0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f013c00ea60 tx=0x7f013c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:26.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.952+0000 7f01327fc640 1 -- 172.21.15.90:0/2895857336 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c00cde0 con 0x7f01400d4b80 2024-09-10T23:17:26.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.952+0000 7f01327fc640 1 -- 172.21.15.90:0/2895857336 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f013c004020 con 0x7f01400d4b80 2024-09-10T23:17:26.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.952+0000 7f01481ad640 1 -- 172.21.15.90:0/2895857336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01401f5460 con 0x7f01400d4b80 2024-09-10T23:17:26.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.952+0000 7f01327fc640 1 -- 172.21.15.90:0/2895857336 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c004450 con 0x7f01400d4b80 2024-09-10T23:17:26.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.952+0000 7f01481ad640 1 -- 172.21.15.90:0/2895857336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01400cc5c0 con 0x7f01400d4b80 2024-09-10T23:17:26.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.953+0000 7f01481ad640 1 -- 172.21.15.90:0/2895857336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f014015e6f0 con 0x7f01400d4b80 2024-09-10T23:17:26.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.953+0000 7f01327fc640 1 -- 172.21.15.90:0/2895857336 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f013c0035f0 con 0x7f01400d4b80 2024-09-10T23:17:26.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.954+0000 7f01327fc640 1 --2- 172.21.15.90:0/2895857336 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0124077fa0 0x7f012407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:26.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.954+0000 7f01327fc640 1 -- 172.21.15.90:0/2895857336 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5609+0+0 (secure 0 0 0) 0x7f013c09a570 con 0x7f01400d4b80 2024-09-10T23:17:26.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.954+0000 7f0145f49640 1 --2- 172.21.15.90:0/2895857336 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0124077fa0 0x7f012407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:26.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.955+0000 7f0145f49640 1 --2- 172.21.15.90:0/2895857336 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0124077fa0 0x7f012407a460 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0134034000 tx=0x7f0134004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:26.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:26.959+0000 7f01327fc640 1 -- 172.21.15.90:0/2895857336 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f013c062a90 con 0x7f01400d4b80 2024-09-10T23:17:27.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.170+0000 7f01481ad640 1 -- 172.21.15.90:0/2895857336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f01400d4610 con 0x7f01400d4b80 2024-09-10T23:17:27.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.821+0000 7f01327fc640 1 -- 172.21.15.90:0/2895857336 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v42) ==== 174+0+0 (secure 0 0 0) 0x7f013c0674c0 con 0x7f01400d4b80 2024-09-10T23:17:27.822 INFO:teuthology.orchestra.run.smithi090.stderr:new fs with metadata pool 12 and data pool 13 2024-09-10T23:17:27.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.824+0000 7f01481ad640 1 -- 172.21.15.90:0/2895857336 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0124077fa0 msgr2=0x7f012407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:27.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.824+0000 7f01481ad640 1 --2- 172.21.15.90:0/2895857336 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0124077fa0 0x7f012407a460 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0134034000 tx=0x7f0134004730 comp rx=0 tx=0).stop 2024-09-10T23:17:27.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.824+0000 7f01481ad640 1 -- 172.21.15.90:0/2895857336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01400d4b80 msgr2=0x7f01400ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:27.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.824+0000 7f01481ad640 1 --2- 172.21.15.90:0/2895857336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01400d4b80 0x7f01400ccae0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f013c00ea60 tx=0x7f013c00ef20 comp rx=0 tx=0).stop 2024-09-10T23:17:27.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.825+0000 7f01481ad640 1 -- 172.21.15.90:0/2895857336 shutdown_connections 2024-09-10T23:17:27.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.825+0000 7f01481ad640 1 --2- 172.21.15.90:0/2895857336 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0124077fa0 0x7f012407a460 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:27.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.825+0000 7f01481ad640 1 --2- 172.21.15.90:0/2895857336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f014015e310 0x7f01401f4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:27.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.825+0000 7f01481ad640 1 --2- 172.21.15.90:0/2895857336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01400d4b80 0x7f01400ccae0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:27.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.825+0000 7f01481ad640 1 --2- 172.21.15.90:0/2895857336 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01400d16f0 0x7f01400b91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:27.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.825+0000 7f01481ad640 1 -- 172.21.15.90:0/2895857336 >> 172.21.15.90:0/2895857336 conn(0x7f01400d4090 msgr2=0x7f01400b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:27.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.825+0000 7f01481ad640 1 -- 172.21.15.90:0/2895857336 shutdown_connections 2024-09-10T23:17:27.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.825+0000 7f01481ad640 1 -- 172.21.15.90:0/2895857336 wait complete. 2024-09-10T23:17:27.858 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:17:27.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.962+0000 7f3b23f7c640 1 -- 172.21.15.90:0/2353075600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b080052e0 msgr2=0x7f3b0800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:27.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.962+0000 7f3b23f7c640 1 --2- 172.21.15.90:0/2353075600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b080052e0 0x7f3b0800b9c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400c610 tx=0x7f3b08005830 comp rx=0 tx=0).stop 2024-09-10T23:17:27.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.962+0000 7f3b23f7c640 1 -- 172.21.15.90:0/2353075600 shutdown_connections 2024-09-10T23:17:27.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.962+0000 7f3b23f7c640 1 --2- 172.21.15.90:0/2353075600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b080052e0 0x7f3b0800b9c0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:27.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.962+0000 7f3b23f7c640 1 -- 172.21.15.90:0/2353075600 >> 172.21.15.90:0/2353075600 conn(0x7f3b1c0b19c0 msgr2=0x7f3b1c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:27.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.962+0000 7f3b23f7c640 1 -- 172.21.15.90:0/2353075600 shutdown_connections 2024-09-10T23:17:27.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.962+0000 7f3b23f7c640 1 -- 172.21.15.90:0/2353075600 wait complete. 2024-09-10T23:17:27.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.963+0000 7f3b23f7c640 1 Processor -- start 2024-09-10T23:17:27.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.963+0000 7f3b23f7c640 1 -- start start 2024-09-10T23:17:27.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.964+0000 7f3b23f7c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b080052e0 0x7f3b1c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:27.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.964+0000 7f3b23f7c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b1c14ea20 0x7f3b1c158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:27.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.964+0000 7f3b23f7c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b1c159070 0x7f3b1c0ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:27.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.964+0000 7f3b23f7c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c15a560 con 0x7f3b080052e0 2024-09-10T23:17:27.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.964+0000 7f3b23f7c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c15a3e0 con 0x7f3b1c159070 2024-09-10T23:17:27.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.964+0000 7f3b23f7c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3b1c0cd0b0 con 0x7f3b1c14ea20 2024-09-10T23:17:27.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.964+0000 7f3b21d18640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b080052e0 0x7f3b1c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:27.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.964+0000 7f3b21d18640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b080052e0 0x7f3b1c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43840/0 (socket says 172.21.15.90:43840) 2024-09-10T23:17:27.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.964+0000 7f3b21d18640 1 -- 172.21.15.90:0/2810619335 learned_addr learned my addr 172.21.15.90:0/2810619335 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:27.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.964+0000 7f3b22519640 1 --2- 172.21.15.90:0/2810619335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b1c159070 0x7f3b1c0ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:27.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.964+0000 7f3b21517640 1 --2- 172.21.15.90:0/2810619335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b1c14ea20 0x7f3b1c158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:27.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.965+0000 7f3b21d18640 1 -- 172.21.15.90:0/2810619335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b1c14ea20 msgr2=0x7f3b1c158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:27.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.965+0000 7f3b21d18640 1 --2- 172.21.15.90:0/2810619335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b1c14ea20 0x7f3b1c158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:27.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.965+0000 7f3b21d18640 1 -- 172.21.15.90:0/2810619335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b1c159070 msgr2=0x7f3b1c0ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:27.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.965+0000 7f3b21d18640 1 --2- 172.21.15.90:0/2810619335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b1c159070 0x7f3b1c0ae280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:27.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.965+0000 7f3b21d18640 1 -- 172.21.15.90:0/2810619335 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1c14ee80 con 0x7f3b080052e0 2024-09-10T23:17:27.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.965+0000 7f3b21d18640 1 --2- 172.21.15.90:0/2810619335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b080052e0 0x7f3b1c09cc60 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3b18011820 tx=0x7f3b18011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:27.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.965+0000 7f3b127fc640 1 -- 172.21.15.90:0/2810619335 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1800fcf0 con 0x7f3b080052e0 2024-09-10T23:17:27.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.965+0000 7f3b127fc640 1 -- 172.21.15.90:0/2810619335 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b18016070 con 0x7f3b080052e0 2024-09-10T23:17:27.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.965+0000 7f3b127fc640 1 -- 172.21.15.90:0/2810619335 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b180126b0 con 0x7f3b080052e0 2024-09-10T23:17:27.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.965+0000 7f3b23f7c640 1 -- 172.21.15.90:0/2810619335 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1c1f2a30 con 0x7f3b080052e0 2024-09-10T23:17:27.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.965+0000 7f3b23f7c640 1 -- 172.21.15.90:0/2810619335 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b1c1f2fb0 con 0x7f3b080052e0 2024-09-10T23:17:27.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.966+0000 7f3b23f7c640 1 -- 172.21.15.90:0/2810619335 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b1c0cd5b0 con 0x7f3b080052e0 2024-09-10T23:17:27.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.966+0000 7f3b127fc640 1 -- 172.21.15.90:0/2810619335 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3b18012850 con 0x7f3b080052e0 2024-09-10T23:17:27.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.967+0000 7f3b127fc640 1 --2- 172.21.15.90:0/2810619335 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3b00077f70 0x7f3b0007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:27.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.967+0000 7f3b127fc640 1 -- 172.21.15.90:0/2810619335 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f3b1809a800 con 0x7f3b080052e0 2024-09-10T23:17:27.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.967+0000 7f3b21517640 1 --2- 172.21.15.90:0/2810619335 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3b00077f70 0x7f3b0007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:27.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.968+0000 7f3b21517640 1 --2- 172.21.15.90:0/2810619335 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3b00077f70 0x7f3b0007a430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c1535e0 tx=0x7f3b0c006b50 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:27.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:27.971+0000 7f3b127fc640 1 -- 172.21.15.90:0/2810619335 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3b18063300 con 0x7f3b080052e0 2024-09-10T23:17:28.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.146+0000 7f3b23f7c640 1 -- 172.21.15.90:0/2810619335 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b1c15eb50 con 0x7f3b080052e0 2024-09-10T23:17:28.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.147+0000 7f3b127fc640 1 -- 172.21.15.90:0/2810619335 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+16733 (secure 0 0 0) 0x7f3b18062c00 con 0x7f3b080052e0 2024-09-10T23:17:28.148 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:28.148 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":80,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:17:27.171262+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:17:25.408832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-10T23:17:26.131910+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:17:28.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.149+0000 7f3b23f7c640 1 -- 172.21.15.90:0/2810619335 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3b00077f70 msgr2=0x7f3b0007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:28.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.149+0000 7f3b23f7c640 1 --2- 172.21.15.90:0/2810619335 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3b00077f70 0x7f3b0007a430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c1535e0 tx=0x7f3b0c006b50 comp rx=0 tx=0).stop 2024-09-10T23:17:28.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.149+0000 7f3b23f7c640 1 -- 172.21.15.90:0/2810619335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b080052e0 msgr2=0x7f3b1c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:28.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.149+0000 7f3b23f7c640 1 --2- 172.21.15.90:0/2810619335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b080052e0 0x7f3b1c09cc60 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3b18011820 tx=0x7f3b18011ce0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.149+0000 7f3b23f7c640 1 -- 172.21.15.90:0/2810619335 shutdown_connections 2024-09-10T23:17:28.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.149+0000 7f3b23f7c640 1 --2- 172.21.15.90:0/2810619335 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3b00077f70 0x7f3b0007a430 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.149+0000 7f3b23f7c640 1 --2- 172.21.15.90:0/2810619335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b1c159070 0x7f3b1c0ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.149+0000 7f3b23f7c640 1 --2- 172.21.15.90:0/2810619335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b1c14ea20 0x7f3b1c158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.149+0000 7f3b23f7c640 1 --2- 172.21.15.90:0/2810619335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b080052e0 0x7f3b1c09cc60 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.149+0000 7f3b23f7c640 1 -- 172.21.15.90:0/2810619335 >> 172.21.15.90:0/2810619335 conn(0x7f3b1c0b19c0 msgr2=0x7f3b1c14f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:28.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.149+0000 7f3b23f7c640 1 -- 172.21.15.90:0/2810619335 shutdown_connections 2024-09-10T23:17:28.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.149+0000 7f3b23f7c640 1 -- 172.21.15.90:0/2810619335 wait complete. 2024-09-10T23:17:28.162 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:17:28.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.262+0000 7fd51820f640 1 -- 172.21.15.90:0/2376969332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd51015f750 msgr2=0x7fd510073de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:28.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.262+0000 7fd51820f640 1 --2- 172.21.15.90:0/2376969332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd51015f750 0x7fd510073de0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd50c005fd0 tx=0x7fd50c02a5d0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.262+0000 7fd51820f640 1 -- 172.21.15.90:0/2376969332 shutdown_connections 2024-09-10T23:17:28.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.262+0000 7fd51820f640 1 --2- 172.21.15.90:0/2376969332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd51006fc60 0x7fd5100cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.262+0000 7fd51820f640 1 --2- 172.21.15.90:0/2376969332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd51015f750 0x7fd510073de0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.262+0000 7fd51820f640 1 -- 172.21.15.90:0/2376969332 >> 172.21.15.90:0/2376969332 conn(0x7fd5100b19c0 msgr2=0x7fd5100b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:28.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.262+0000 7fd51820f640 1 -- 172.21.15.90:0/2376969332 shutdown_connections 2024-09-10T23:17:28.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.262+0000 7fd51820f640 1 -- 172.21.15.90:0/2376969332 wait complete. 2024-09-10T23:17:28.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.263+0000 7fd51820f640 1 Processor -- start 2024-09-10T23:17:28.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.263+0000 7fd51820f640 1 -- start start 2024-09-10T23:17:28.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd51820f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd51006fc60 0x7fd5101465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:28.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd51820f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5100cdb90 0x7fd51009c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:28.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd51820f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd51015f750 0x7fd51014ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:28.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd51820f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd5100cc940 con 0x7fd51015f750 2024-09-10T23:17:28.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd51820f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd5100cc7c0 con 0x7fd51006fc60 2024-09-10T23:17:28.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd51820f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd5100ccac0 con 0x7fd5100cdb90 2024-09-10T23:17:28.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd5167ac640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd51015f750 0x7fd51014ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:28.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd5167ac640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd51015f750 0x7fd51014ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36990/0 (socket says 172.21.15.90:36990) 2024-09-10T23:17:28.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd5167ac640 1 -- 172.21.15.90:0/1426649956 learned_addr learned my addr 172.21.15.90:0/1426649956 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:28.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd515fab640 1 --2- 172.21.15.90:0/1426649956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd51006fc60 0x7fd5101465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:28.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd5157aa640 1 --2- 172.21.15.90:0/1426649956 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5100cdb90 0x7fd51009c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:28.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd5167ac640 1 -- 172.21.15.90:0/1426649956 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5100cdb90 msgr2=0x7fd51009c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:28.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd5167ac640 1 --2- 172.21.15.90:0/1426649956 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5100cdb90 0x7fd51009c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd5167ac640 1 -- 172.21.15.90:0/1426649956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd51006fc60 msgr2=0x7fd5101465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:28.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd5167ac640 1 --2- 172.21.15.90:0/1426649956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd51006fc60 0x7fd5101465e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd5167ac640 1 -- 172.21.15.90:0/1426649956 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd510146b20 con 0x7fd51015f750 2024-09-10T23:17:28.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd515fab640 1 --2- 172.21.15.90:0/1426649956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd51006fc60 0x7fd5101465e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:28.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd5167ac640 1 --2- 172.21.15.90:0/1426649956 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd51015f750 0x7fd51014ffe0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd50800ba10 tx=0x7fd50800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:28.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd5067fc640 1 -- 172.21.15.90:0/1426649956 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508019070 con 0x7fd51015f750 2024-09-10T23:17:28.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd5067fc640 1 -- 172.21.15.90:0/1426649956 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd50800cc50 con 0x7fd51015f750 2024-09-10T23:17:28.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd51820f640 1 -- 172.21.15.90:0/1426649956 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd51009cc90 con 0x7fd51015f750 2024-09-10T23:17:28.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.264+0000 7fd5067fc640 1 -- 172.21.15.90:0/1426649956 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5080146a0 con 0x7fd51015f750 2024-09-10T23:17:28.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.265+0000 7fd51820f640 1 -- 172.21.15.90:0/1426649956 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd51009d250 con 0x7fd51015f750 2024-09-10T23:17:28.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.265+0000 7fd51820f640 1 -- 172.21.15.90:0/1426649956 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5100b17b0 con 0x7fd51015f750 2024-09-10T23:17:28.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.266+0000 7fd5067fc640 1 -- 172.21.15.90:0/1426649956 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd50801d3b0 con 0x7fd51015f750 2024-09-10T23:17:28.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.267+0000 7fd5067fc640 1 --2- 172.21.15.90:0/1426649956 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd4f4077f70 0x7fd4f407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:28.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.267+0000 7fd5067fc640 1 -- 172.21.15.90:0/1426649956 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fd508099d30 con 0x7fd51015f750 2024-09-10T23:17:28.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.267+0000 7fd515fab640 1 --2- 172.21.15.90:0/1426649956 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd4f4077f70 0x7fd4f407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:28.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.267+0000 7fd515fab640 1 --2- 172.21.15.90:0/1426649956 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd4f4077f70 0x7fd4f407a430 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd50c033000 tx=0x7fd50c004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:28.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.271+0000 7fd5067fc640 1 -- 172.21.15.90:0/1426649956 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd5100b17b0 con 0x7fd51015f750 2024-09-10T23:17:28.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.445+0000 7fd51820f640 1 -- 172.21.15.90:0/1426649956 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5100af160 con 0x7fd51015f750 2024-09-10T23:17:28.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.446+0000 7fd5067fc640 1 -- 172.21.15.90:0/1426649956 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+16733 (secure 0 0 0) 0x7fd508062830 con 0x7fd51015f750 2024-09-10T23:17:28.447 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:28.448 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":80,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:17:27.171262+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:17:25.408832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-10T23:17:26.131910+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:17:28.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.448+0000 7fd51820f640 1 -- 172.21.15.90:0/1426649956 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd4f4077f70 msgr2=0x7fd4f407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:28.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.448+0000 7fd51820f640 1 --2- 172.21.15.90:0/1426649956 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd4f4077f70 0x7fd4f407a430 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd50c033000 tx=0x7fd50c004730 comp rx=0 tx=0).stop 2024-09-10T23:17:28.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.448+0000 7fd51820f640 1 -- 172.21.15.90:0/1426649956 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd51015f750 msgr2=0x7fd51014ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:28.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.448+0000 7fd51820f640 1 --2- 172.21.15.90:0/1426649956 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd51015f750 0x7fd51014ffe0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd50800ba10 tx=0x7fd50800bed0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.448+0000 7fd51820f640 1 -- 172.21.15.90:0/1426649956 shutdown_connections 2024-09-10T23:17:28.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.448+0000 7fd51820f640 1 --2- 172.21.15.90:0/1426649956 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd4f4077f70 0x7fd4f407a430 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.448+0000 7fd51820f640 1 --2- 172.21.15.90:0/1426649956 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd51015f750 0x7fd51014ffe0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.448+0000 7fd51820f640 1 --2- 172.21.15.90:0/1426649956 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5100cdb90 0x7fd51009c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.449+0000 7fd51820f640 1 --2- 172.21.15.90:0/1426649956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd51006fc60 0x7fd5101465e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.449+0000 7fd51820f640 1 -- 172.21.15.90:0/1426649956 >> 172.21.15.90:0/1426649956 conn(0x7fd5100b19c0 msgr2=0x7fd5100cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:28.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.449+0000 7fd51820f640 1 -- 172.21.15.90:0/1426649956 shutdown_connections 2024-09-10T23:17:28.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.449+0000 7fd51820f640 1 -- 172.21.15.90:0/1426649956 wait complete. 2024-09-10T23:17:28.460 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:17:28.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.564+0000 7f8e4d9da640 1 -- 172.21.15.90:0/3547405716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e480d38d0 msgr2=0x7f8e480d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:28.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.564+0000 7f8e4d9da640 1 --2- 172.21.15.90:0/3547405716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e480d38d0 0x7f8e480d0fc0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f8e4808c880 tx=0x7f8e4002a4a0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.564+0000 7f8e4d9da640 1 -- 172.21.15.90:0/3547405716 shutdown_connections 2024-09-10T23:17:28.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.564+0000 7f8e4d9da640 1 --2- 172.21.15.90:0/3547405716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e480d38d0 0x7f8e480d0fc0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.564+0000 7f8e4d9da640 1 --2- 172.21.15.90:0/3547405716 >> v2:172.21.15.171:3300/0 conn(0x7f8e4815e310 0x7f8e480d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.564+0000 7f8e4d9da640 1 -- 172.21.15.90:0/3547405716 >> 172.21.15.90:0/3547405716 conn(0x7f8e480d4090 msgr2=0x7f8e480d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:28.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.564+0000 7f8e4d9da640 1 -- 172.21.15.90:0/3547405716 shutdown_connections 2024-09-10T23:17:28.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.564+0000 7f8e4d9da640 1 -- 172.21.15.90:0/3547405716 wait complete. 2024-09-10T23:17:28.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.565+0000 7f8e4d9da640 1 Processor -- start 2024-09-10T23:17:28.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.565+0000 7f8e4d9da640 1 -- start start 2024-09-10T23:17:28.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.566+0000 7f8e4d9da640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e480d16f0 0x7f8e480b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:28.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.566+0000 7f8e4d9da640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e480d38d0 0x7f8e480b9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:28.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.566+0000 7f8e4d9da640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e4815e310 0x7f8e48158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:28.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.566+0000 7f8e4d9da640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8e480cf800 con 0x7f8e480d38d0 2024-09-10T23:17:28.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.566+0000 7f8e4d9da640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8e480d4d90 con 0x7f8e480d16f0 2024-09-10T23:17:28.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.566+0000 7f8e4d9da640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8e4806de00 con 0x7f8e4815e310 2024-09-10T23:17:28.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.566+0000 7f8e467fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e480d38d0 0x7f8e480b9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:28.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.566+0000 7f8e467fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e480d38d0 0x7f8e480b9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37008/0 (socket says 172.21.15.90:37008) 2024-09-10T23:17:28.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.566+0000 7f8e467fc640 1 -- 172.21.15.90:0/1943467081 learned_addr learned my addr 172.21.15.90:0/1943467081 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:28.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.566+0000 7f8e477fe640 1 --2- 172.21.15.90:0/1943467081 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e4815e310 0x7f8e48158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:28.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.566+0000 7f8e46ffd640 1 --2- 172.21.15.90:0/1943467081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e480d16f0 0x7f8e480b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:28.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.566+0000 7f8e467fc640 1 -- 172.21.15.90:0/1943467081 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e4815e310 msgr2=0x7f8e48158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:28.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.566+0000 7f8e467fc640 1 --2- 172.21.15.90:0/1943467081 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e4815e310 0x7f8e48158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.566+0000 7f8e467fc640 1 -- 172.21.15.90:0/1943467081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e480d16f0 msgr2=0x7f8e480b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:28.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.566+0000 7f8e467fc640 1 --2- 172.21.15.90:0/1943467081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e480d16f0 0x7f8e480b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.566+0000 7f8e467fc640 1 -- 172.21.15.90:0/1943467081 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e481f46a0 con 0x7f8e480d38d0 2024-09-10T23:17:28.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.567+0000 7f8e467fc640 1 --2- 172.21.15.90:0/1943467081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e480d38d0 0x7f8e480b9710 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000c530 tx=0x7f8e3000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:28.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.567+0000 7f8e3ffff640 1 -- 172.21.15.90:0/1943467081 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e30017070 con 0x7f8e480d38d0 2024-09-10T23:17:28.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.567+0000 7f8e3ffff640 1 -- 172.21.15.90:0/1943467081 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e300035f0 con 0x7f8e480d38d0 2024-09-10T23:17:28.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.567+0000 7f8e4d9da640 1 -- 172.21.15.90:0/1943467081 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e481f49a0 con 0x7f8e480d38d0 2024-09-10T23:17:28.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.567+0000 7f8e3ffff640 1 -- 172.21.15.90:0/1943467081 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e30003a40 con 0x7f8e480d38d0 2024-09-10T23:17:28.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.567+0000 7f8e4d9da640 1 -- 172.21.15.90:0/1943467081 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e481f51e0 con 0x7f8e480d38d0 2024-09-10T23:17:28.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.568+0000 7f8e4d9da640 1 -- 172.21.15.90:0/1943467081 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e4806e2b0 con 0x7f8e480d38d0 2024-09-10T23:17:28.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.568+0000 7f8e3ffff640 1 -- 172.21.15.90:0/1943467081 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8e30003be0 con 0x7f8e480d38d0 2024-09-10T23:17:28.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.569+0000 7f8e3ffff640 1 --2- 172.21.15.90:0/1943467081 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8e28077f70 0x7f8e2807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:28.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.569+0000 7f8e3ffff640 1 -- 172.21.15.90:0/1943467081 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f8e30099440 con 0x7f8e480d38d0 2024-09-10T23:17:28.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.569+0000 7f8e46ffd640 1 --2- 172.21.15.90:0/1943467081 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8e28077f70 0x7f8e2807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:28.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.570+0000 7f8e46ffd640 1 --2- 172.21.15.90:0/1943467081 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8e28077f70 0x7f8e2807a430 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8e38005c40 tx=0x7f8e3800a370 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:28.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.573+0000 7f8e3ffff640 1 -- 172.21.15.90:0/1943467081 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8e481f49a0 con 0x7f8e480d38d0 2024-09-10T23:17:28.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.782+0000 7f8e4d9da640 1 -- 172.21.15.90:0/1943467081 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8e480b3ee0 con 0x7f8e480d38d0 2024-09-10T23:17:28.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.841+0000 7f8e3ffff640 1 -- 172.21.15.90:0/1943467081 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) ==== 118+0+0 (secure 0 0 0) 0x7f8e30061fd0 con 0x7f8e480d38d0 2024-09-10T23:17:28.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.843+0000 7f8e4d9da640 1 -- 172.21.15.90:0/1943467081 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8e28077f70 msgr2=0x7f8e2807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:28.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.844+0000 7f8e4d9da640 1 --2- 172.21.15.90:0/1943467081 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8e28077f70 0x7f8e2807a430 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8e38005c40 tx=0x7f8e3800a370 comp rx=0 tx=0).stop 2024-09-10T23:17:28.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.844+0000 7f8e4d9da640 1 -- 172.21.15.90:0/1943467081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e480d38d0 msgr2=0x7f8e480b9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:28.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.844+0000 7f8e4d9da640 1 --2- 172.21.15.90:0/1943467081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e480d38d0 0x7f8e480b9710 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000c530 tx=0x7f8e3000c9f0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.844+0000 7f8e4d9da640 1 -- 172.21.15.90:0/1943467081 shutdown_connections 2024-09-10T23:17:28.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.844+0000 7f8e4d9da640 1 --2- 172.21.15.90:0/1943467081 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8e28077f70 0x7f8e2807a430 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.844+0000 7f8e4d9da640 1 --2- 172.21.15.90:0/1943467081 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e4815e310 0x7f8e48158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.844+0000 7f8e4d9da640 1 --2- 172.21.15.90:0/1943467081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e480d38d0 0x7f8e480b9710 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.844+0000 7f8e4d9da640 1 --2- 172.21.15.90:0/1943467081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e480d16f0 0x7f8e480b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.844+0000 7f8e4d9da640 1 -- 172.21.15.90:0/1943467081 >> 172.21.15.90:0/1943467081 conn(0x7f8e480d4090 msgr2=0x7f8e480d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:28.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.844+0000 7f8e4d9da640 1 -- 172.21.15.90:0/1943467081 shutdown_connections 2024-09-10T23:17:28.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.844+0000 7f8e4d9da640 1 -- 172.21.15.90:0/1943467081 wait complete. 2024-09-10T23:17:28.857 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:17:28.857 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:17:28.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.960+0000 7ffb51d5d640 1 -- 172.21.15.90:0/130811589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb4c0cd470 msgr2=0x7ffb4c15e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:28.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.960+0000 7ffb51d5d640 1 --2- 172.21.15.90:0/130811589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb4c0cd470 0x7ffb4c15e6c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0cda60 tx=0x7ffb4402a560 comp rx=0 tx=0).stop 2024-09-10T23:17:28.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.960+0000 7ffb51d5d640 1 -- 172.21.15.90:0/130811589 shutdown_connections 2024-09-10T23:17:28.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.960+0000 7ffb51d5d640 1 --2- 172.21.15.90:0/130811589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb4c0cd470 0x7ffb4c15e6c0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.960+0000 7ffb51d5d640 1 --2- 172.21.15.90:0/130811589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb4c0cf860 0x7ffb4c15e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.960+0000 7ffb51d5d640 1 --2- 172.21.15.90:0/130811589 >> v2:172.21.15.171:3300/0 conn(0x7ffb4c0b44a0 0x7ffb4c0b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.960+0000 7ffb51d5d640 1 -- 172.21.15.90:0/130811589 >> 172.21.15.90:0/130811589 conn(0x7ffb4c0b19c0 msgr2=0x7ffb4c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:28.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.960+0000 7ffb51d5d640 1 -- 172.21.15.90:0/130811589 shutdown_connections 2024-09-10T23:17:28.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.960+0000 7ffb51d5d640 1 -- 172.21.15.90:0/130811589 wait complete. 2024-09-10T23:17:28.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.961+0000 7ffb51d5d640 1 Processor -- start 2024-09-10T23:17:28.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.961+0000 7ffb51d5d640 1 -- start start 2024-09-10T23:17:28.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb51d5d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb4c0b44a0 0x7ffb4c14d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:28.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb51d5d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb4c0cd470 0x7ffb4c09d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:28.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb51d5d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb4c0cf860 0x7ffb4c0727c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:28.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb51d5d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4c15aa40 con 0x7ffb4c0cd470 2024-09-10T23:17:28.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb51d5d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4c15a8c0 con 0x7ffb4c0cf860 2024-09-10T23:17:28.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb51d5d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffb4c15ec00 con 0x7ffb4c0b44a0 2024-09-10T23:17:28.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb4affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb4c0cd470 0x7ffb4c09d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:28.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb4affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb4c0cd470 0x7ffb4c09d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37032/0 (socket says 172.21.15.90:37032) 2024-09-10T23:17:28.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb4affd640 1 -- 172.21.15.90:0/734393507 learned_addr learned my addr 172.21.15.90:0/734393507 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:28.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb4b7fe640 1 --2- 172.21.15.90:0/734393507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb4c0b44a0 0x7ffb4c14d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:28.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb4bfff640 1 --2- 172.21.15.90:0/734393507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb4c0cf860 0x7ffb4c0727c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:28.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb4affd640 1 -- 172.21.15.90:0/734393507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb4c0b44a0 msgr2=0x7ffb4c14d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:28.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb4affd640 1 --2- 172.21.15.90:0/734393507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb4c0b44a0 0x7ffb4c14d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb4affd640 1 -- 172.21.15.90:0/734393507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb4c0cf860 msgr2=0x7ffb4c0727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:28.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb4affd640 1 --2- 172.21.15.90:0/734393507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb4c0cf860 0x7ffb4c0727c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:28.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb4affd640 1 -- 172.21.15.90:0/734393507 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb4c09d810 con 0x7ffb4c0cd470 2024-09-10T23:17:28.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb4bfff640 1 --2- 172.21.15.90:0/734393507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb4c0cf860 0x7ffb4c0727c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:28.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.962+0000 7ffb4affd640 1 --2- 172.21.15.90:0/734393507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb4c0cd470 0x7ffb4c09d2d0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000d6a0 tx=0x7ffb4000db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:28.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.963+0000 7ffb33fff640 1 -- 172.21.15.90:0/734393507 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40017070 con 0x7ffb4c0cd470 2024-09-10T23:17:28.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.963+0000 7ffb33fff640 1 -- 172.21.15.90:0/734393507 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb40005310 con 0x7ffb4c0cd470 2024-09-10T23:17:28.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.963+0000 7ffb51d5d640 1 -- 172.21.15.90:0/734393507 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb4c1f29d0 con 0x7ffb4c0cd470 2024-09-10T23:17:28.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.963+0000 7ffb33fff640 1 -- 172.21.15.90:0/734393507 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40009820 con 0x7ffb4c0cd470 2024-09-10T23:17:28.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.963+0000 7ffb51d5d640 1 -- 172.21.15.90:0/734393507 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb4c1f2f90 con 0x7ffb4c0cd470 2024-09-10T23:17:28.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.964+0000 7ffb51d5d640 1 -- 172.21.15.90:0/734393507 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb4c15a120 con 0x7ffb4c0cd470 2024-09-10T23:17:28.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.965+0000 7ffb33fff640 1 -- 172.21.15.90:0/734393507 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ffb400099c0 con 0x7ffb4c0cd470 2024-09-10T23:17:28.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.965+0000 7ffb33fff640 1 --2- 172.21.15.90:0/734393507 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb38077fd0 0x7ffb3807a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:28.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.966+0000 7ffb33fff640 1 -- 172.21.15.90:0/734393507 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7ffb40099d10 con 0x7ffb4c0cd470 2024-09-10T23:17:28.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.967+0000 7ffb4b7fe640 1 --2- 172.21.15.90:0/734393507 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb38077fd0 0x7ffb3807a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:28.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.968+0000 7ffb4b7fe640 1 --2- 172.21.15.90:0/734393507 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb38077fd0 0x7ffb3807a490 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c005fd0 tx=0x7ffb3c00a680 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:28.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:28.971+0000 7ffb33fff640 1 -- 172.21.15.90:0/734393507 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ffb4c15a120 con 0x7ffb4c0cd470 2024-09-10T23:17:29.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.181+0000 7ffb51d5d640 1 -- 172.21.15.90:0/734393507 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ffb4c0b4880 con 0x7ffb4c0cd470 2024-09-10T23:17:29.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.849+0000 7ffb33fff640 1 -- 172.21.15.90:0/734393507 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7ffb40062250 con 0x7ffb4c0cd470 2024-09-10T23:17:29.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.851+0000 7ffb51d5d640 1 -- 172.21.15.90:0/734393507 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb38077fd0 msgr2=0x7ffb3807a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:29.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.851+0000 7ffb51d5d640 1 --2- 172.21.15.90:0/734393507 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb38077fd0 0x7ffb3807a490 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c005fd0 tx=0x7ffb3c00a680 comp rx=0 tx=0).stop 2024-09-10T23:17:29.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.851+0000 7ffb51d5d640 1 -- 172.21.15.90:0/734393507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb4c0cd470 msgr2=0x7ffb4c09d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:29.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.851+0000 7ffb51d5d640 1 --2- 172.21.15.90:0/734393507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb4c0cd470 0x7ffb4c09d2d0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000d6a0 tx=0x7ffb4000db60 comp rx=0 tx=0).stop 2024-09-10T23:17:29.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.851+0000 7ffb51d5d640 1 -- 172.21.15.90:0/734393507 shutdown_connections 2024-09-10T23:17:29.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.851+0000 7ffb51d5d640 1 --2- 172.21.15.90:0/734393507 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb38077fd0 0x7ffb3807a490 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:29.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.851+0000 7ffb51d5d640 1 --2- 172.21.15.90:0/734393507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb4c0cf860 0x7ffb4c0727c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:29.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.851+0000 7ffb51d5d640 1 --2- 172.21.15.90:0/734393507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb4c0cd470 0x7ffb4c09d2d0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:29.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.852+0000 7ffb51d5d640 1 --2- 172.21.15.90:0/734393507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb4c0b44a0 0x7ffb4c14d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:29.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.852+0000 7ffb51d5d640 1 -- 172.21.15.90:0/734393507 >> 172.21.15.90:0/734393507 conn(0x7ffb4c0b19c0 msgr2=0x7ffb4c0737c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:29.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.852+0000 7ffb51d5d640 1 -- 172.21.15.90:0/734393507 shutdown_connections 2024-09-10T23:17:29.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.852+0000 7ffb51d5d640 1 -- 172.21.15.90:0/734393507 wait complete. 2024-09-10T23:17:29.865 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:17:29.865 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:17:29.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.969+0000 7fcf4132b640 1 -- 172.21.15.90:0/3772219921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3c0d16f0 msgr2=0x7fcf3c0d2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:29.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.969+0000 7fcf4132b640 1 --2- 172.21.15.90:0/3772219921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3c0d16f0 0x7fcf3c0d2fd0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fcf34005fd0 tx=0x7fcf3402a820 comp rx=0 tx=0).stop 2024-09-10T23:17:29.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.969+0000 7fcf4132b640 1 -- 172.21.15.90:0/3772219921 shutdown_connections 2024-09-10T23:17:29.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.969+0000 7fcf4132b640 1 --2- 172.21.15.90:0/3772219921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3c0d16f0 0x7fcf3c0d2fd0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:29.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.969+0000 7fcf4132b640 1 -- 172.21.15.90:0/3772219921 >> 172.21.15.90:0/3772219921 conn(0x7fcf3c0d4090 msgr2=0x7fcf3c0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:29.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.969+0000 7fcf4132b640 1 -- 172.21.15.90:0/3772219921 shutdown_connections 2024-09-10T23:17:29.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.969+0000 7fcf4132b640 1 -- 172.21.15.90:0/3772219921 wait complete. 2024-09-10T23:17:29.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.971+0000 7fcf4132b640 1 Processor -- start 2024-09-10T23:17:29.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.971+0000 7fcf4132b640 1 -- start start 2024-09-10T23:17:29.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.971+0000 7fcf4132b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf3c0d1190 0x7fcf3c0cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:29.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.971+0000 7fcf4132b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3c0d16f0 0x7fcf3c159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:29.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.971+0000 7fcf4132b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf3c15e310 0x7fcf3c15aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:29.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.971+0000 7fcf4132b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3c0d3510 con 0x7fcf3c0d16f0 2024-09-10T23:17:29.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.971+0000 7fcf4132b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3c0d4d90 con 0x7fcf3c15e310 2024-09-10T23:17:29.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.971+0000 7fcf4132b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcf3c0d3690 con 0x7fcf3c0d1190 2024-09-10T23:17:29.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.972+0000 7fcf327fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3c0d16f0 0x7fcf3c159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:29.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.972+0000 7fcf327fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3c0d16f0 0x7fcf3c159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37050/0 (socket says 172.21.15.90:37050) 2024-09-10T23:17:29.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.972+0000 7fcf327fc640 1 -- 172.21.15.90:0/1140124467 learned_addr learned my addr 172.21.15.90:0/1140124467 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:29.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.972+0000 7fcf3affd640 1 --2- 172.21.15.90:0/1140124467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf3c0d1190 0x7fcf3c0cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:29.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.972+0000 7fcf3b7fe640 1 --2- 172.21.15.90:0/1140124467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf3c15e310 0x7fcf3c15aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:29.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.972+0000 7fcf327fc640 1 -- 172.21.15.90:0/1140124467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf3c0d1190 msgr2=0x7fcf3c0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:29.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.972+0000 7fcf327fc640 1 --2- 172.21.15.90:0/1140124467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf3c0d1190 0x7fcf3c0cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:29.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.972+0000 7fcf327fc640 1 -- 172.21.15.90:0/1140124467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf3c15e310 msgr2=0x7fcf3c15aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:29.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.972+0000 7fcf327fc640 1 --2- 172.21.15.90:0/1140124467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf3c15e310 0x7fcf3c15aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:29.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.972+0000 7fcf327fc640 1 -- 172.21.15.90:0/1140124467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3c161480 con 0x7fcf3c0d16f0 2024-09-10T23:17:29.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.972+0000 7fcf3b7fe640 1 --2- 172.21.15.90:0/1140124467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf3c15e310 0x7fcf3c15aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:29.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.972+0000 7fcf327fc640 1 --2- 172.21.15.90:0/1140124467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3c0d16f0 0x7fcf3c159a80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400c410 tx=0x7fcf2400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:29.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.972+0000 7fcf33fff640 1 -- 172.21.15.90:0/1140124467 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf24017070 con 0x7fcf3c0d16f0 2024-09-10T23:17:29.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.972+0000 7fcf33fff640 1 -- 172.21.15.90:0/1140124467 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf240035f0 con 0x7fcf3c0d16f0 2024-09-10T23:17:29.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.972+0000 7fcf4132b640 1 -- 172.21.15.90:0/1140124467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf3c161760 con 0x7fcf3c0d16f0 2024-09-10T23:17:29.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.972+0000 7fcf33fff640 1 -- 172.21.15.90:0/1140124467 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf24003a80 con 0x7fcf3c0d16f0 2024-09-10T23:17:29.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.972+0000 7fcf4132b640 1 -- 172.21.15.90:0/1140124467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf3c15ebe0 con 0x7fcf3c0d16f0 2024-09-10T23:17:29.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.973+0000 7fcf4132b640 1 -- 172.21.15.90:0/1140124467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf3c0d3b20 con 0x7fcf3c0d16f0 2024-09-10T23:17:29.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.974+0000 7fcf33fff640 1 -- 172.21.15.90:0/1140124467 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcf24003c20 con 0x7fcf3c0d16f0 2024-09-10T23:17:29.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.975+0000 7fcf33fff640 1 --2- 172.21.15.90:0/1140124467 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcf1c077f70 0x7fcf1c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:29.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.975+0000 7fcf33fff640 1 -- 172.21.15.90:0/1140124467 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fcf24099440 con 0x7fcf3c0d16f0 2024-09-10T23:17:29.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.975+0000 7fcf3affd640 1 --2- 172.21.15.90:0/1140124467 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcf1c077f70 0x7fcf1c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:29.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.975+0000 7fcf3affd640 1 --2- 172.21.15.90:0/1140124467 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcf1c077f70 0x7fcf1c07a430 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c007fd0 tx=0x7fcf2c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:29.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:29.979+0000 7fcf33fff640 1 -- 172.21.15.90:0/1140124467 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcf24061f40 con 0x7fcf3c0d16f0 2024-09-10T23:17:30.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.188+0000 7fcf4132b640 1 -- 172.21.15.90:0/1140124467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf3c0d47f0 con 0x7fcf3c0d16f0 2024-09-10T23:17:30.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.188+0000 7fcf33fff640 1 -- 172.21.15.90:0/1140124467 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5228 (secure 0 0 0) 0x7fcf24061840 con 0x7fcf3c0d16f0 2024-09-10T23:17:30.190 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:30.190 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":44,"btime":"2024-09-10T23:17:29:843110+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/883446248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":883446248},{"type":"v1","addr":"172.21.15.90:6835","nonce":883446248}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5510,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1558215981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1558215981},{"type":"v1","addr":"172.21.15.171:6836","nonce":1558215981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2584382337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2584382337},{"type":"v1","addr":"172.21.15.171:6837","nonce":2584382337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:27.171227+0000","modified":"2024-09-10T23:17:29.182680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6351":{"gid":6351,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6834/1524104545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1524104545},{"type":"v1","addr":"172.21.15.90:6834","nonce":1524104545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6351,"qdb_cluster":[6351]},"id":6}]} 2024-09-10T23:17:30.190 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 44 2024-09-10T23:17:30.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.191+0000 7fcf4132b640 1 -- 172.21.15.90:0/1140124467 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcf1c077f70 msgr2=0x7fcf1c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:30.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.191+0000 7fcf4132b640 1 --2- 172.21.15.90:0/1140124467 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcf1c077f70 0x7fcf1c07a430 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c007fd0 tx=0x7fcf2c009040 comp rx=0 tx=0).stop 2024-09-10T23:17:30.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.191+0000 7fcf4132b640 1 -- 172.21.15.90:0/1140124467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3c0d16f0 msgr2=0x7fcf3c159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:30.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.191+0000 7fcf4132b640 1 --2- 172.21.15.90:0/1140124467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3c0d16f0 0x7fcf3c159a80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400c410 tx=0x7fcf2400c8d0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.191+0000 7fcf4132b640 1 -- 172.21.15.90:0/1140124467 shutdown_connections 2024-09-10T23:17:30.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.191+0000 7fcf4132b640 1 --2- 172.21.15.90:0/1140124467 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcf1c077f70 0x7fcf1c07a430 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.191+0000 7fcf4132b640 1 --2- 172.21.15.90:0/1140124467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf3c15e310 0x7fcf3c15aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.191+0000 7fcf4132b640 1 --2- 172.21.15.90:0/1140124467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcf3c0d16f0 0x7fcf3c159a80 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.191+0000 7fcf4132b640 1 --2- 172.21.15.90:0/1140124467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf3c0d1190 0x7fcf3c0cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.191+0000 7fcf4132b640 1 -- 172.21.15.90:0/1140124467 >> 172.21.15.90:0/1140124467 conn(0x7fcf3c0d4090 msgr2=0x7fcf3c15d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:30.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.191+0000 7fcf4132b640 1 -- 172.21.15.90:0/1140124467 shutdown_connections 2024-09-10T23:17:30.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.191+0000 7fcf4132b640 1 -- 172.21.15.90:0/1140124467 wait complete. 2024-09-10T23:17:30.202 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:17:30.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.301+0000 7f5dd88e6640 1 -- 172.21.15.90:0/3996260987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd415f750 msgr2=0x7f5dd4073de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:30.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.301+0000 7f5dd88e6640 1 --2- 172.21.15.90:0/3996260987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd415f750 0x7f5dd4073de0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f5dd415fb30 tx=0x7f5dc402a560 comp rx=0 tx=0).stop 2024-09-10T23:17:30.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.301+0000 7f5dd88e6640 1 -- 172.21.15.90:0/3996260987 shutdown_connections 2024-09-10T23:17:30.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.301+0000 7f5dd88e6640 1 --2- 172.21.15.90:0/3996260987 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dd406f550 0x7f5dd406f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.301+0000 7f5dd88e6640 1 --2- 172.21.15.90:0/3996260987 >> v2:172.21.15.171:3300/0 conn(0x7f5dd40cdb90 0x7f5dd40cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.301+0000 7f5dd88e6640 1 --2- 172.21.15.90:0/3996260987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd415f750 0x7f5dd4073de0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.301+0000 7f5dd88e6640 1 -- 172.21.15.90:0/3996260987 >> 172.21.15.90:0/3996260987 conn(0x7f5dd40b19c0 msgr2=0x7f5dd40b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:30.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.302+0000 7f5dd88e6640 1 -- 172.21.15.90:0/3996260987 shutdown_connections 2024-09-10T23:17:30.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.302+0000 7f5dd88e6640 1 -- 172.21.15.90:0/3996260987 wait complete. 2024-09-10T23:17:30.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.303+0000 7f5dd88e6640 1 Processor -- start 2024-09-10T23:17:30.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.303+0000 7f5dd88e6640 1 -- start start 2024-09-10T23:17:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd88e6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd406f550 0x7f5dd415bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd88e6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dd40cdb90 0x7f5dd415e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd88e6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dd415f750 0x7f5dd409d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd88e6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd415fd50 con 0x7f5dd406f550 2024-09-10T23:17:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd88e6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd415fbd0 con 0x7f5dd40cdb90 2024-09-10T23:17:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd88e6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd415fed0 con 0x7f5dd415f750 2024-09-10T23:17:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd406f550 0x7f5dd415bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd406f550 0x7f5dd415bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37058/0 (socket says 172.21.15.90:37058) 2024-09-10T23:17:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd259c640 1 -- 172.21.15.90:0/2842187440 learned_addr learned my addr 172.21.15.90:0/2842187440 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd2d9d640 1 --2- 172.21.15.90:0/2842187440 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dd415f750 0x7f5dd409d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:30.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dc9d9b640 1 --2- 172.21.15.90:0/2842187440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dd40cdb90 0x7f5dd415e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:30.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd259c640 1 -- 172.21.15.90:0/2842187440 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dd415f750 msgr2=0x7f5dd409d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:30.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd259c640 1 --2- 172.21.15.90:0/2842187440 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dd415f750 0x7f5dd409d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd259c640 1 -- 172.21.15.90:0/2842187440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dd40cdb90 msgr2=0x7f5dd415e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:30.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd259c640 1 --2- 172.21.15.90:0/2842187440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dd40cdb90 0x7f5dd415e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd259c640 1 -- 172.21.15.90:0/2842187440 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd409c0c0 con 0x7f5dd406f550 2024-09-10T23:17:30.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd2d9d640 1 --2- 172.21.15.90:0/2842187440 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dd415f750 0x7f5dd409d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:30.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd259c640 1 --2- 172.21.15.90:0/2842187440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd406f550 0x7f5dd415bf60 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4034040 tx=0x7f5dc4003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:30.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dcb7fe640 1 -- 172.21.15.90:0/2842187440 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc403e030 con 0x7f5dd406f550 2024-09-10T23:17:30.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dcb7fe640 1 -- 172.21.15.90:0/2842187440 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dc4003e00 con 0x7f5dd406f550 2024-09-10T23:17:30.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.304+0000 7f5dd88e6640 1 -- 172.21.15.90:0/2842187440 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd409c3a0 con 0x7f5dd406f550 2024-09-10T23:17:30.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.305+0000 7f5dcb7fe640 1 -- 172.21.15.90:0/2842187440 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4035040 con 0x7f5dd406f550 2024-09-10T23:17:30.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.305+0000 7f5dd88e6640 1 -- 172.21.15.90:0/2842187440 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd409c960 con 0x7f5dd406f550 2024-09-10T23:17:30.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.306+0000 7f5dd88e6640 1 -- 172.21.15.90:0/2842187440 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd40cdfd0 con 0x7f5dd406f550 2024-09-10T23:17:30.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.306+0000 7f5dcb7fe640 1 -- 172.21.15.90:0/2842187440 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5dc40049c0 con 0x7f5dd406f550 2024-09-10T23:17:30.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.307+0000 7f5dcb7fe640 1 --2- 172.21.15.90:0/2842187440 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5db4077f70 0x7f5db407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:30.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.307+0000 7f5dcb7fe640 1 -- 172.21.15.90:0/2842187440 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f5dc40ba7e0 con 0x7f5dd406f550 2024-09-10T23:17:30.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.307+0000 7f5dc9d9b640 1 --2- 172.21.15.90:0/2842187440 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5db4077f70 0x7f5db407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:30.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.307+0000 7f5dc9d9b640 1 --2- 172.21.15.90:0/2842187440 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5db4077f70 0x7f5db407a430 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc005e10 tx=0x7f5dbc005da0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:30.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.311+0000 7f5dcb7fe640 1 -- 172.21.15.90:0/2842187440 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5dc4083260 con 0x7f5dd406f550 2024-09-10T23:17:30.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.488+0000 7f5dd88e6640 1 -- 172.21.15.90:0/2842187440 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5dd40af160 con 0x7f5dd406f550 2024-09-10T23:17:30.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.489+0000 7f5dcb7fe640 1 -- 172.21.15.90:0/2842187440 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+16720 (secure 0 0 0) 0x7f5dc4082b60 con 0x7f5dd406f550 2024-09-10T23:17:30.490 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:30.490 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":81,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:17:28.836004+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:17:25.408832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-10T23:17:26.131910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:17:30.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.491+0000 7f5dd88e6640 1 -- 172.21.15.90:0/2842187440 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5db4077f70 msgr2=0x7f5db407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:30.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.491+0000 7f5dd88e6640 1 --2- 172.21.15.90:0/2842187440 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5db4077f70 0x7f5db407a430 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc005e10 tx=0x7f5dbc005da0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.491+0000 7f5dd88e6640 1 -- 172.21.15.90:0/2842187440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd406f550 msgr2=0x7f5dd415bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:30.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.491+0000 7f5dd88e6640 1 --2- 172.21.15.90:0/2842187440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd406f550 0x7f5dd415bf60 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4034040 tx=0x7f5dc4003910 comp rx=0 tx=0).stop 2024-09-10T23:17:30.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.491+0000 7f5dd88e6640 1 -- 172.21.15.90:0/2842187440 shutdown_connections 2024-09-10T23:17:30.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.491+0000 7f5dd88e6640 1 --2- 172.21.15.90:0/2842187440 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5db4077f70 0x7f5db407a430 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.491+0000 7f5dd88e6640 1 --2- 172.21.15.90:0/2842187440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dd40cdb90 0x7f5dd415e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.491+0000 7f5dd88e6640 1 --2- 172.21.15.90:0/2842187440 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dd415f750 0x7f5dd409d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.491+0000 7f5dd88e6640 1 --2- 172.21.15.90:0/2842187440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd406f550 0x7f5dd415bf60 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.491+0000 7f5dd88e6640 1 -- 172.21.15.90:0/2842187440 >> 172.21.15.90:0/2842187440 conn(0x7f5dd40b19c0 msgr2=0x7f5dd40cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:30.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.491+0000 7f5dd88e6640 1 -- 172.21.15.90:0/2842187440 shutdown_connections 2024-09-10T23:17:30.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.491+0000 7f5dd88e6640 1 -- 172.21.15.90:0/2842187440 wait complete. 2024-09-10T23:17:30.503 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:17:30.503 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:17:30.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.602+0000 7f39d30b0640 1 -- 172.21.15.90:0/4204771748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc0cdb90 msgr2=0x7f39cc0cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:30.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.602+0000 7f39d30b0640 1 --2- 172.21.15.90:0/4204771748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc0cdb90 0x7f39cc0cdfd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f39bc005fd0 tx=0x7f39bc02a8b0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.602+0000 7f39d30b0640 1 -- 172.21.15.90:0/4204771748 shutdown_connections 2024-09-10T23:17:30.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.602+0000 7f39d30b0640 1 --2- 172.21.15.90:0/4204771748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc0cdb90 0x7f39cc0cdfd0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.602+0000 7f39d30b0640 1 -- 172.21.15.90:0/4204771748 >> 172.21.15.90:0/4204771748 conn(0x7f39cc0b19c0 msgr2=0x7f39cc0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:30.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.602+0000 7f39d30b0640 1 -- 172.21.15.90:0/4204771748 shutdown_connections 2024-09-10T23:17:30.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.602+0000 7f39d30b0640 1 -- 172.21.15.90:0/4204771748 wait complete. 2024-09-10T23:17:30.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.603+0000 7f39d30b0640 1 Processor -- start 2024-09-10T23:17:30.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.604+0000 7f39d30b0640 1 -- start start 2024-09-10T23:17:30.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.604+0000 7f39d30b0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39cc06f550 0x7f39cc0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:30.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.604+0000 7f39d30b0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39cc0cdb90 0x7f39cc1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:30.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.604+0000 7f39d30b0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc15f750 0x7f39cc155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:30.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.604+0000 7f39d30b0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc1674d0 con 0x7f39cc15f750 2024-09-10T23:17:30.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.604+0000 7f39d30b0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc167350 con 0x7f39cc06f550 2024-09-10T23:17:30.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.604+0000 7f39d30b0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f39cc167650 con 0x7f39cc0cdb90 2024-09-10T23:17:30.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.605+0000 7f39d164d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc15f750 0x7f39cc155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:30.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.605+0000 7f39d164d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc15f750 0x7f39cc155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37074/0 (socket says 172.21.15.90:37074) 2024-09-10T23:17:30.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.605+0000 7f39d164d640 1 -- 172.21.15.90:0/2822712440 learned_addr learned my addr 172.21.15.90:0/2822712440 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:30.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.605+0000 7f39cbfff640 1 --2- 172.21.15.90:0/2822712440 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39cc0cdb90 0x7f39cc1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:30.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.605+0000 7f39d0e4c640 1 --2- 172.21.15.90:0/2822712440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39cc06f550 0x7f39cc0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:30.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.605+0000 7f39d164d640 1 -- 172.21.15.90:0/2822712440 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39cc0cdb90 msgr2=0x7f39cc1553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:30.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.605+0000 7f39d164d640 1 --2- 172.21.15.90:0/2822712440 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39cc0cdb90 0x7f39cc1553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.605+0000 7f39d164d640 1 -- 172.21.15.90:0/2822712440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39cc06f550 msgr2=0x7f39cc0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:30.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.605+0000 7f39d164d640 1 --2- 172.21.15.90:0/2822712440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39cc06f550 0x7f39cc0cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.605+0000 7f39d164d640 1 -- 172.21.15.90:0/2822712440 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39cc0cc230 con 0x7f39cc15f750 2024-09-10T23:17:30.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.605+0000 7f39d0e4c640 1 --2- 172.21.15.90:0/2822712440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39cc06f550 0x7f39cc0cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:30.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.605+0000 7f39d164d640 1 --2- 172.21.15.90:0/2822712440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc15f750 0x7f39cc155910 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c3c0 tx=0x7f39b400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:30.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.605+0000 7f39c97fa640 1 -- 172.21.15.90:0/2822712440 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4011790 con 0x7f39cc15f750 2024-09-10T23:17:30.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.605+0000 7f39c97fa640 1 -- 172.21.15.90:0/2822712440 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39b4017070 con 0x7f39cc15f750 2024-09-10T23:17:30.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.605+0000 7f39d30b0640 1 -- 172.21.15.90:0/2822712440 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39cc0cbf50 con 0x7f39cc15f750 2024-09-10T23:17:30.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.605+0000 7f39c97fa640 1 -- 172.21.15.90:0/2822712440 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4011cc0 con 0x7f39cc15f750 2024-09-10T23:17:30.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.605+0000 7f39d30b0640 1 -- 172.21.15.90:0/2822712440 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39cc15b160 con 0x7f39cc15f750 2024-09-10T23:17:30.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.606+0000 7f39d30b0640 1 -- 172.21.15.90:0/2822712440 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39cc0cdfd0 con 0x7f39cc15f750 2024-09-10T23:17:30.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.607+0000 7f39c97fa640 1 -- 172.21.15.90:0/2822712440 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f39b401c460 con 0x7f39cc15f750 2024-09-10T23:17:30.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.607+0000 7f39c97fa640 1 --2- 172.21.15.90:0/2822712440 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f39ac077fa0 0x7f39ac07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:30.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.607+0000 7f39c97fa640 1 -- 172.21.15.90:0/2822712440 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f39b4099af0 con 0x7f39cc15f750 2024-09-10T23:17:30.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.607+0000 7f39d0e4c640 1 --2- 172.21.15.90:0/2822712440 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f39ac077fa0 0x7f39ac07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:30.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.608+0000 7f39d0e4c640 1 --2- 172.21.15.90:0/2822712440 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f39ac077fa0 0x7f39ac07a460 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0b14b0 tx=0x7f39c4008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:30.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.611+0000 7f39c97fa640 1 -- 172.21.15.90:0/2822712440 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f39b4062570 con 0x7f39cc15f750 2024-09-10T23:17:30.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.783+0000 7f39d30b0640 1 -- 172.21.15.90:0/2822712440 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39cc14c7b0 con 0x7f39ac077fa0 2024-09-10T23:17:30.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.787+0000 7f39c97fa640 1 -- 172.21.15.90:0/2822712440 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239003 (secure 0 0 0) 0x7f39cc14c7b0 con 0x7f39ac077fa0 2024-09-10T23:17:30.791 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:30.792 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:17:30.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.790+0000 7f39d30b0640 1 -- 172.21.15.90:0/2822712440 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f39ac077fa0 msgr2=0x7f39ac07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:30.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.790+0000 7f39d30b0640 1 --2- 172.21.15.90:0/2822712440 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f39ac077fa0 0x7f39ac07a460 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0b14b0 tx=0x7f39c4008040 comp rx=0 tx=0).stop 2024-09-10T23:17:30.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.790+0000 7f39d30b0640 1 -- 172.21.15.90:0/2822712440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc15f750 msgr2=0x7f39cc155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:30.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.790+0000 7f39d30b0640 1 --2- 172.21.15.90:0/2822712440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc15f750 0x7f39cc155910 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c3c0 tx=0x7f39b400c880 comp rx=0 tx=0).stop 2024-09-10T23:17:30.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.790+0000 7f39d30b0640 1 -- 172.21.15.90:0/2822712440 shutdown_connections 2024-09-10T23:17:30.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.790+0000 7f39d30b0640 1 --2- 172.21.15.90:0/2822712440 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f39ac077fa0 0x7f39ac07a460 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.790+0000 7f39d30b0640 1 --2- 172.21.15.90:0/2822712440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc15f750 0x7f39cc155910 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.790+0000 7f39d30b0640 1 --2- 172.21.15.90:0/2822712440 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39cc0cdb90 0x7f39cc1553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.790+0000 7f39d30b0640 1 --2- 172.21.15.90:0/2822712440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39cc06f550 0x7f39cc0cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.790+0000 7f39d30b0640 1 -- 172.21.15.90:0/2822712440 >> 172.21.15.90:0/2822712440 conn(0x7f39cc0b19c0 msgr2=0x7f39cc0b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:30.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.790+0000 7f39d30b0640 1 -- 172.21.15.90:0/2822712440 shutdown_connections 2024-09-10T23:17:30.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.790+0000 7f39d30b0640 1 -- 172.21.15.90:0/2822712440 wait complete. 2024-09-10T23:17:30.802 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-09-10T23:17:30.476057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":122,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":24,"acting":24,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":245572,"kb_used_data":8528,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754729148,"statfs":{"total":773094113280,"available":772842647552,"internally_reserved":0,"allocated":8732672,"data_stored":4314557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.661592"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.856587+0000","last_change":"2024-09-10T23:17:27.850363+0000","last_active":"2024-09-10T23:17:27.856587+0000","last_peered":"2024-09-10T23:17:27.856587+0000","last_clean":"2024-09-10T23:17:27.856587+0000","last_became_active":"2024-09-10T23:17:27.850063+0000","last_became_peered":"2024-09-10T23:17:27.850063+0000","last_unstale":"2024-09-10T23:17:27.856587+0000","last_undegraded":"2024-09-10T23:17:27.856587+0000","last_fullsized":"2024-09-10T23:17:27.856587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:14.890268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.859478+0000","last_change":"2024-09-10T23:17:26.839740+0000","last_active":"2024-09-10T23:17:27.859478+0000","last_peered":"2024-09-10T23:17:27.859478+0000","last_clean":"2024-09-10T23:17:27.859478+0000","last_became_active":"2024-09-10T23:17:26.839472+0000","last_became_peered":"2024-09-10T23:17:26.839472+0000","last_unstale":"2024-09-10T23:17:27.859478+0000","last_undegraded":"2024-09-10T23:17:27.859478+0000","last_fullsized":"2024-09-10T23:17:27.859478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:24.073627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.859500+0000","last_change":"2024-09-10T23:17:26.838774+0000","last_active":"2024-09-10T23:17:27.859500+0000","last_peered":"2024-09-10T23:17:27.859500+0000","last_clean":"2024-09-10T23:17:27.859500+0000","last_became_active":"2024-09-10T23:17:26.838524+0000","last_became_peered":"2024-09-10T23:17:26.838524+0000","last_unstale":"2024-09-10T23:17:27.859500+0000","last_undegraded":"2024-09-10T23:17:27.859500+0000","last_fullsized":"2024-09-10T23:17:27.859500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:21.687107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.838826+0000","last_change":"2024-09-10T23:17:26.832339+0000","last_active":"2024-09-10T23:17:27.838826+0000","last_peered":"2024-09-10T23:17:27.838826+0000","last_clean":"2024-09-10T23:17:27.838826+0000","last_became_active":"2024-09-10T23:17:26.832033+0000","last_became_peered":"2024-09-10T23:17:26.832033+0000","last_unstale":"2024-09-10T23:17:27.838826+0000","last_undegraded":"2024-09-10T23:17:27.838826+0000","last_fullsized":"2024-09-10T23:17:27.838826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:28.236154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.859019+0000","last_change":"2024-09-10T23:17:27.852673+0000","last_active":"2024-09-10T23:17:27.859019+0000","last_peered":"2024-09-10T23:17:27.859019+0000","last_clean":"2024-09-10T23:17:27.859019+0000","last_became_active":"2024-09-10T23:17:27.852430+0000","last_became_peered":"2024-09-10T23:17:27.852430+0000","last_unstale":"2024-09-10T23:17:27.859019+0000","last_undegraded":"2024-09-10T23:17:27.859019+0000","last_fullsized":"2024-09-10T23:17:27.859019+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:19.398570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.846139+0000","last_change":"2024-09-10T23:17:27.843383+0000","last_active":"2024-09-10T23:17:27.846139+0000","last_peered":"2024-09-10T23:17:27.846139+0000","last_clean":"2024-09-10T23:17:27.846139+0000","last_became_active":"2024-09-10T23:17:27.843106+0000","last_became_peered":"2024-09-10T23:17:27.843106+0000","last_unstale":"2024-09-10T23:17:27.846139+0000","last_undegraded":"2024-09-10T23:17:27.846139+0000","last_fullsized":"2024-09-10T23:17:27.846139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:44.885760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"80'8","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.861641+0000","last_change":"2024-09-10T23:17:26.840049+0000","last_active":"2024-09-10T23:17:27.861641+0000","last_peered":"2024-09-10T23:17:27.861641+0000","last_clean":"2024-09-10T23:17:27.861641+0000","last_became_active":"2024-09-10T23:17:26.839235+0000","last_became_peered":"2024-09-10T23:17:26.839235+0000","last_unstale":"2024-09-10T23:17:27.861641+0000","last_undegraded":"2024-09-10T23:17:27.861641+0000","last_fullsized":"2024-09-10T23:17:27.861641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:33.133739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.860992+0000","last_change":"2024-09-10T23:17:26.838810+0000","last_active":"2024-09-10T23:17:27.860992+0000","last_peered":"2024-09-10T23:17:27.860992+0000","last_clean":"2024-09-10T23:17:27.860992+0000","last_became_active":"2024-09-10T23:17:26.838541+0000","last_became_peered":"2024-09-10T23:17:26.838541+0000","last_unstale":"2024-09-10T23:17:27.860992+0000","last_undegraded":"2024-09-10T23:17:27.860992+0000","last_fullsized":"2024-09-10T23:17:27.860992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:48.297843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.838328+0000","last_change":"2024-09-10T23:17:26.839387+0000","last_active":"2024-09-10T23:17:27.838328+0000","last_peered":"2024-09-10T23:17:27.838328+0000","last_clean":"2024-09-10T23:17:27.838328+0000","last_became_active":"2024-09-10T23:17:26.839150+0000","last_became_peered":"2024-09-10T23:17:26.839150+0000","last_unstale":"2024-09-10T23:17:27.838328+0000","last_undegraded":"2024-09-10T23:17:27.838328+0000","last_fullsized":"2024-09-10T23:17:27.838328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:54.734740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.837070+0000","last_change":"2024-09-10T23:17:26.838293+0000","last_active":"2024-09-10T23:17:27.837070+0000","last_peered":"2024-09-10T23:17:27.837070+0000","last_clean":"2024-09-10T23:17:27.837070+0000","last_became_active":"2024-09-10T23:17:26.838036+0000","last_became_peered":"2024-09-10T23:17:26.838036+0000","last_unstale":"2024-09-10T23:17:27.837070+0000","last_undegraded":"2024-09-10T23:17:27.837070+0000","last_fullsized":"2024-09-10T23:17:27.837070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:36.624168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.846190+0000","last_change":"2024-09-10T23:17:27.842286+0000","last_active":"2024-09-10T23:17:27.846190+0000","last_peered":"2024-09-10T23:17:27.846190+0000","last_clean":"2024-09-10T23:17:27.846190+0000","last_became_active":"2024-09-10T23:17:27.842048+0000","last_became_peered":"2024-09-10T23:17:27.842048+0000","last_unstale":"2024-09-10T23:17:27.846190+0000","last_undegraded":"2024-09-10T23:17:27.846190+0000","last_fullsized":"2024-09-10T23:17:27.846190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:47.468405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":207,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:17:24.442509+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:17:24.442509+0000","last_peered":"2024-09-10T23:17:24.442509+0000","last_clean":"2024-09-10T23:17:24.442509+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:17:24.442509+0000","last_undegraded":"2024-09-10T23:17:24.442509+0000","last_fullsized":"2024-09-10T23:17:24.442509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":1},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":14,"acting":14,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28524,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343316,"statfs":{"total":96636764160,"available":96607555584,"internally_reserved":0,"allocated":1531904,"data_stored":979733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27952,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32112,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1572864,"data_stored":998634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:17:30.806 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:17:30.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.941+0000 7fd0e4c71640 1 -- 172.21.15.90:0/4206925918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0e015e180 msgr2=0x7fd0e00cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:30.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.941+0000 7fd0e4c71640 1 --2- 172.21.15.90:0/4206925918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0e015e180 0x7fd0e00cfc90 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fd0e006f920 tx=0x7fd0d802aac0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.941+0000 7fd0e4c71640 1 -- 172.21.15.90:0/4206925918 shutdown_connections 2024-09-10T23:17:30.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.941+0000 7fd0e4c71640 1 --2- 172.21.15.90:0/4206925918 >> v2:172.21.15.171:3300/0 conn(0x7fd0e00d0aa0 0x7fd0e00d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.941+0000 7fd0e4c71640 1 --2- 172.21.15.90:0/4206925918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0e00d4c20 0x7fd0e006d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.941+0000 7fd0e4c71640 1 --2- 172.21.15.90:0/4206925918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0e015e180 0x7fd0e00cfc90 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.941+0000 7fd0e4c71640 1 -- 172.21.15.90:0/4206925918 >> 172.21.15.90:0/4206925918 conn(0x7fd0e00d4090 msgr2=0x7fd0e00d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:30.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.941+0000 7fd0e4c71640 1 -- 172.21.15.90:0/4206925918 shutdown_connections 2024-09-10T23:17:30.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.941+0000 7fd0e4c71640 1 -- 172.21.15.90:0/4206925918 wait complete. 2024-09-10T23:17:30.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.943+0000 7fd0e4c71640 1 Processor -- start 2024-09-10T23:17:30.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.943+0000 7fd0e4c71640 1 -- start start 2024-09-10T23:17:30.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.943+0000 7fd0e4c71640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0e00d0aa0 0x7fd0e015c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:30.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.943+0000 7fd0e4c71640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0e00d4c20 0x7fd0e01f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:30.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.943+0000 7fd0e4c71640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e015e180 0x7fd0e00c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:30.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.943+0000 7fd0e4c71640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e00d2110 con 0x7fd0e00d4c20 2024-09-10T23:17:30.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.943+0000 7fd0e4c71640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e00d1f90 con 0x7fd0e015e180 2024-09-10T23:17:30.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.943+0000 7fd0e4c71640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e00d2290 con 0x7fd0e00d0aa0 2024-09-10T23:17:30.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.943+0000 7fd0ddd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0e00d4c20 0x7fd0e01f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:30.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.944+0000 7fd0ddd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0e00d4c20 0x7fd0e01f58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37092/0 (socket says 172.21.15.90:37092) 2024-09-10T23:17:30.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.944+0000 7fd0ddd9b640 1 -- 172.21.15.90:0/3503277661 learned_addr learned my addr 172.21.15.90:0/3503277661 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:30.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.944+0000 7fd0de59c640 1 --2- 172.21.15.90:0/3503277661 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0e00d0aa0 0x7fd0e015c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:30.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.944+0000 7fd0ded9d640 1 --2- 172.21.15.90:0/3503277661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e015e180 0x7fd0e00c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:30.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.944+0000 7fd0ddd9b640 1 -- 172.21.15.90:0/3503277661 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0e00d0aa0 msgr2=0x7fd0e015c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:30.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.944+0000 7fd0ddd9b640 1 --2- 172.21.15.90:0/3503277661 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0e00d0aa0 0x7fd0e015c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.944+0000 7fd0ddd9b640 1 -- 172.21.15.90:0/3503277661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e015e180 msgr2=0x7fd0e00c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:30.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.944+0000 7fd0ddd9b640 1 --2- 172.21.15.90:0/3503277661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e015e180 0x7fd0e00c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:30.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.944+0000 7fd0ddd9b640 1 -- 172.21.15.90:0/3503277661 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e015e820 con 0x7fd0e00d4c20 2024-09-10T23:17:30.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.944+0000 7fd0ded9d640 1 --2- 172.21.15.90:0/3503277661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e015e180 0x7fd0e00c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:30.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.944+0000 7fd0ddd9b640 1 --2- 172.21.15.90:0/3503277661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0e00d4c20 0x7fd0e01f58e0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800c970 tx=0x7fd0c800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:30.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.944+0000 7fd0d6ffd640 1 -- 172.21.15.90:0/3503277661 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8007bb0 con 0x7fd0e00d4c20 2024-09-10T23:17:30.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.944+0000 7fd0d6ffd640 1 -- 172.21.15.90:0/3503277661 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0c8005020 con 0x7fd0e00d4c20 2024-09-10T23:17:30.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.944+0000 7fd0e4c71640 1 -- 172.21.15.90:0/3503277661 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e00ca100 con 0x7fd0e00d4c20 2024-09-10T23:17:30.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.944+0000 7fd0d6ffd640 1 -- 172.21.15.90:0/3503277661 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8007e60 con 0x7fd0e00d4c20 2024-09-10T23:17:30.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.944+0000 7fd0e4c71640 1 -- 172.21.15.90:0/3503277661 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e015eac0 con 0x7fd0e00d4c20 2024-09-10T23:17:30.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.945+0000 7fd0e4c71640 1 -- 172.21.15.90:0/3503277661 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e0162c20 con 0x7fd0e00d4c20 2024-09-10T23:17:30.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.946+0000 7fd0d6ffd640 1 -- 172.21.15.90:0/3503277661 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd0c8005470 con 0x7fd0e00d4c20 2024-09-10T23:17:30.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.946+0000 7fd0d6ffd640 1 --2- 172.21.15.90:0/3503277661 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0c0077fa0 0x7fd0c007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:30.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.946+0000 7fd0d6ffd640 1 -- 172.21.15.90:0/3503277661 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fd0c809a1d0 con 0x7fd0e00d4c20 2024-09-10T23:17:30.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.946+0000 7fd0de59c640 1 --2- 172.21.15.90:0/3503277661 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0c0077fa0 0x7fd0c007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:30.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.947+0000 7fd0de59c640 1 --2- 172.21.15.90:0/3503277661 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0c0077fa0 0x7fd0c007a460 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8035000 tx=0x7fd0d8038040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:30.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:30.950+0000 7fd0d6ffd640 1 -- 172.21.15.90:0/3503277661 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd0e0162c20 con 0x7fd0e00d4c20 2024-09-10T23:17:31.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.122+0000 7fd0e4c71640 1 -- 172.21.15.90:0/3503277661 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0e01f5e20 con 0x7fd0c0077fa0 2024-09-10T23:17:31.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.127+0000 7fd0d6ffd640 1 -- 172.21.15.90:0/3503277661 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239003 (secure 0 0 0) 0x7fd0d8003bc0 con 0x7fd0c0077fa0 2024-09-10T23:17:31.130 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:31.131 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:17:31.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.130+0000 7fd0e4c71640 1 -- 172.21.15.90:0/3503277661 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0c0077fa0 msgr2=0x7fd0c007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:31.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.130+0000 7fd0e4c71640 1 --2- 172.21.15.90:0/3503277661 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0c0077fa0 0x7fd0c007a460 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8035000 tx=0x7fd0d8038040 comp rx=0 tx=0).stop 2024-09-10T23:17:31.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.130+0000 7fd0e4c71640 1 -- 172.21.15.90:0/3503277661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0e00d4c20 msgr2=0x7fd0e01f58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:31.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.130+0000 7fd0e4c71640 1 --2- 172.21.15.90:0/3503277661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0e00d4c20 0x7fd0e01f58e0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800c970 tx=0x7fd0c800ce30 comp rx=0 tx=0).stop 2024-09-10T23:17:31.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.130+0000 7fd0e4c71640 1 -- 172.21.15.90:0/3503277661 shutdown_connections 2024-09-10T23:17:31.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.130+0000 7fd0e4c71640 1 --2- 172.21.15.90:0/3503277661 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd0c0077fa0 0x7fd0c007a460 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.130+0000 7fd0e4c71640 1 --2- 172.21.15.90:0/3503277661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e015e180 0x7fd0e00c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.130+0000 7fd0e4c71640 1 --2- 172.21.15.90:0/3503277661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0e00d4c20 0x7fd0e01f58e0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.130+0000 7fd0e4c71640 1 --2- 172.21.15.90:0/3503277661 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0e00d0aa0 0x7fd0e015c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.130+0000 7fd0e4c71640 1 -- 172.21.15.90:0/3503277661 >> 172.21.15.90:0/3503277661 conn(0x7fd0e00d4090 msgr2=0x7fd0e00d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:31.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.130+0000 7fd0e4c71640 1 -- 172.21.15.90:0/3503277661 shutdown_connections 2024-09-10T23:17:31.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.130+0000 7fd0e4c71640 1 -- 172.21.15.90:0/3503277661 wait complete. 2024-09-10T23:17:31.141 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-09-10T23:17:30.476057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":122,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":24,"acting":24,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":245572,"kb_used_data":8528,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754729148,"statfs":{"total":773094113280,"available":772842647552,"internally_reserved":0,"allocated":8732672,"data_stored":4314557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.661592"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.856587+0000","last_change":"2024-09-10T23:17:27.850363+0000","last_active":"2024-09-10T23:17:27.856587+0000","last_peered":"2024-09-10T23:17:27.856587+0000","last_clean":"2024-09-10T23:17:27.856587+0000","last_became_active":"2024-09-10T23:17:27.850063+0000","last_became_peered":"2024-09-10T23:17:27.850063+0000","last_unstale":"2024-09-10T23:17:27.856587+0000","last_undegraded":"2024-09-10T23:17:27.856587+0000","last_fullsized":"2024-09-10T23:17:27.856587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:14.890268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.859478+0000","last_change":"2024-09-10T23:17:26.839740+0000","last_active":"2024-09-10T23:17:27.859478+0000","last_peered":"2024-09-10T23:17:27.859478+0000","last_clean":"2024-09-10T23:17:27.859478+0000","last_became_active":"2024-09-10T23:17:26.839472+0000","last_became_peered":"2024-09-10T23:17:26.839472+0000","last_unstale":"2024-09-10T23:17:27.859478+0000","last_undegraded":"2024-09-10T23:17:27.859478+0000","last_fullsized":"2024-09-10T23:17:27.859478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:24.073627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.859500+0000","last_change":"2024-09-10T23:17:26.838774+0000","last_active":"2024-09-10T23:17:27.859500+0000","last_peered":"2024-09-10T23:17:27.859500+0000","last_clean":"2024-09-10T23:17:27.859500+0000","last_became_active":"2024-09-10T23:17:26.838524+0000","last_became_peered":"2024-09-10T23:17:26.838524+0000","last_unstale":"2024-09-10T23:17:27.859500+0000","last_undegraded":"2024-09-10T23:17:27.859500+0000","last_fullsized":"2024-09-10T23:17:27.859500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:21.687107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.838826+0000","last_change":"2024-09-10T23:17:26.832339+0000","last_active":"2024-09-10T23:17:27.838826+0000","last_peered":"2024-09-10T23:17:27.838826+0000","last_clean":"2024-09-10T23:17:27.838826+0000","last_became_active":"2024-09-10T23:17:26.832033+0000","last_became_peered":"2024-09-10T23:17:26.832033+0000","last_unstale":"2024-09-10T23:17:27.838826+0000","last_undegraded":"2024-09-10T23:17:27.838826+0000","last_fullsized":"2024-09-10T23:17:27.838826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:28.236154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.859019+0000","last_change":"2024-09-10T23:17:27.852673+0000","last_active":"2024-09-10T23:17:27.859019+0000","last_peered":"2024-09-10T23:17:27.859019+0000","last_clean":"2024-09-10T23:17:27.859019+0000","last_became_active":"2024-09-10T23:17:27.852430+0000","last_became_peered":"2024-09-10T23:17:27.852430+0000","last_unstale":"2024-09-10T23:17:27.859019+0000","last_undegraded":"2024-09-10T23:17:27.859019+0000","last_fullsized":"2024-09-10T23:17:27.859019+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:19.398570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.846139+0000","last_change":"2024-09-10T23:17:27.843383+0000","last_active":"2024-09-10T23:17:27.846139+0000","last_peered":"2024-09-10T23:17:27.846139+0000","last_clean":"2024-09-10T23:17:27.846139+0000","last_became_active":"2024-09-10T23:17:27.843106+0000","last_became_peered":"2024-09-10T23:17:27.843106+0000","last_unstale":"2024-09-10T23:17:27.846139+0000","last_undegraded":"2024-09-10T23:17:27.846139+0000","last_fullsized":"2024-09-10T23:17:27.846139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:44.885760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"80'8","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.861641+0000","last_change":"2024-09-10T23:17:26.840049+0000","last_active":"2024-09-10T23:17:27.861641+0000","last_peered":"2024-09-10T23:17:27.861641+0000","last_clean":"2024-09-10T23:17:27.861641+0000","last_became_active":"2024-09-10T23:17:26.839235+0000","last_became_peered":"2024-09-10T23:17:26.839235+0000","last_unstale":"2024-09-10T23:17:27.861641+0000","last_undegraded":"2024-09-10T23:17:27.861641+0000","last_fullsized":"2024-09-10T23:17:27.861641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:33.133739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.860992+0000","last_change":"2024-09-10T23:17:26.838810+0000","last_active":"2024-09-10T23:17:27.860992+0000","last_peered":"2024-09-10T23:17:27.860992+0000","last_clean":"2024-09-10T23:17:27.860992+0000","last_became_active":"2024-09-10T23:17:26.838541+0000","last_became_peered":"2024-09-10T23:17:26.838541+0000","last_unstale":"2024-09-10T23:17:27.860992+0000","last_undegraded":"2024-09-10T23:17:27.860992+0000","last_fullsized":"2024-09-10T23:17:27.860992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:48.297843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.838328+0000","last_change":"2024-09-10T23:17:26.839387+0000","last_active":"2024-09-10T23:17:27.838328+0000","last_peered":"2024-09-10T23:17:27.838328+0000","last_clean":"2024-09-10T23:17:27.838328+0000","last_became_active":"2024-09-10T23:17:26.839150+0000","last_became_peered":"2024-09-10T23:17:26.839150+0000","last_unstale":"2024-09-10T23:17:27.838328+0000","last_undegraded":"2024-09-10T23:17:27.838328+0000","last_fullsized":"2024-09-10T23:17:27.838328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:54.734740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.837070+0000","last_change":"2024-09-10T23:17:26.838293+0000","last_active":"2024-09-10T23:17:27.837070+0000","last_peered":"2024-09-10T23:17:27.837070+0000","last_clean":"2024-09-10T23:17:27.837070+0000","last_became_active":"2024-09-10T23:17:26.838036+0000","last_became_peered":"2024-09-10T23:17:26.838036+0000","last_unstale":"2024-09-10T23:17:27.837070+0000","last_undegraded":"2024-09-10T23:17:27.837070+0000","last_fullsized":"2024-09-10T23:17:27.837070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:36.624168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.846190+0000","last_change":"2024-09-10T23:17:27.842286+0000","last_active":"2024-09-10T23:17:27.846190+0000","last_peered":"2024-09-10T23:17:27.846190+0000","last_clean":"2024-09-10T23:17:27.846190+0000","last_became_active":"2024-09-10T23:17:27.842048+0000","last_became_peered":"2024-09-10T23:17:27.842048+0000","last_unstale":"2024-09-10T23:17:27.846190+0000","last_undegraded":"2024-09-10T23:17:27.846190+0000","last_fullsized":"2024-09-10T23:17:27.846190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:47.468405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":207,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:17:24.442509+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:17:24.442509+0000","last_peered":"2024-09-10T23:17:24.442509+0000","last_clean":"2024-09-10T23:17:24.442509+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:17:24.442509+0000","last_undegraded":"2024-09-10T23:17:24.442509+0000","last_fullsized":"2024-09-10T23:17:24.442509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":1},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":14,"acting":14,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28524,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343316,"statfs":{"total":96636764160,"available":96607555584,"internally_reserved":0,"allocated":1531904,"data_stored":979733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27952,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32112,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1572864,"data_stored":998634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:17:31.145 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:17:31.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.283+0000 7f2a5a5f3640 1 -- 172.21.15.90:0/1645243613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a540b3310 msgr2=0x7f2a540b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:31.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.283+0000 7f2a5a5f3640 1 --2- 172.21.15.90:0/1645243613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a540b3310 0x7f2a540b24e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2a54076780 tx=0x7f2a4402a560 comp rx=0 tx=0).stop 2024-09-10T23:17:31.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.283+0000 7f2a5a5f3640 1 -- 172.21.15.90:0/1645243613 shutdown_connections 2024-09-10T23:17:31.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.283+0000 7f2a5a5f3640 1 --2- 172.21.15.90:0/1645243613 >> v2:172.21.15.171:3300/0 conn(0x7f2a540ceca0 0x7f2a540cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.283+0000 7f2a5a5f3640 1 --2- 172.21.15.90:0/1645243613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a540b3310 0x7f2a540b24e0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.283+0000 7f2a5a5f3640 1 -- 172.21.15.90:0/1645243613 >> 172.21.15.90:0/1645243613 conn(0x7f2a540b19c0 msgr2=0x7f2a540b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:31.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.283+0000 7f2a5a5f3640 1 -- 172.21.15.90:0/1645243613 shutdown_connections 2024-09-10T23:17:31.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.283+0000 7f2a5a5f3640 1 -- 172.21.15.90:0/1645243613 wait complete. 2024-09-10T23:17:31.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.284+0000 7f2a5a5f3640 1 Processor -- start 2024-09-10T23:17:31.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.284+0000 7f2a5a5f3640 1 -- start start 2024-09-10T23:17:31.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a5a5f3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a540b3310 0x7f2a5409ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:31.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a5a5f3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a540ceca0 0x7f2a54158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:31.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a5a5f3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a54158dd0 0x7f2a541f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:31.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a5a5f3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5415bb40 con 0x7f2a540b3310 2024-09-10T23:17:31.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a5a5f3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5415b9c0 con 0x7f2a54158dd0 2024-09-10T23:17:31.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a5a5f3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2a5415bcc0 con 0x7f2a540ceca0 2024-09-10T23:17:31.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a53fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a540b3310 0x7f2a5409ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:31.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a53fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a540b3310 0x7f2a5409ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37114/0 (socket says 172.21.15.90:37114) 2024-09-10T23:17:31.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a53fff640 1 -- 172.21.15.90:0/3724020835 learned_addr learned my addr 172.21.15.90:0/3724020835 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:31.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a58b90640 1 --2- 172.21.15.90:0/3724020835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a54158dd0 0x7f2a541f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:31.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a53fff640 1 -- 172.21.15.90:0/3724020835 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a540ceca0 msgr2=0x7f2a54158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:31.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a537fe640 1 --2- 172.21.15.90:0/3724020835 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a540ceca0 0x7f2a54158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:31.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a53fff640 1 --2- 172.21.15.90:0/3724020835 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a540ceca0 0x7f2a54158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a53fff640 1 -- 172.21.15.90:0/3724020835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a54158dd0 msgr2=0x7f2a541f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:31.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a53fff640 1 --2- 172.21.15.90:0/3724020835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a54158dd0 0x7f2a541f60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a53fff640 1 -- 172.21.15.90:0/3724020835 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a54159260 con 0x7f2a540b3310 2024-09-10T23:17:31.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a537fe640 1 --2- 172.21.15.90:0/3724020835 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a540ceca0 0x7f2a54158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:31.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.285+0000 7f2a58b90640 1 --2- 172.21.15.90:0/3724020835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a54158dd0 0x7f2a541f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:31.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.286+0000 7f2a53fff640 1 --2- 172.21.15.90:0/3724020835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a540b3310 0x7f2a5409ced0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009850 tx=0x7f2a440039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:31.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.286+0000 7f2a50ff9640 1 -- 172.21.15.90:0/3724020835 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4403f070 con 0x7f2a540b3310 2024-09-10T23:17:31.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.286+0000 7f2a50ff9640 1 -- 172.21.15.90:0/3724020835 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a44004890 con 0x7f2a540b3310 2024-09-10T23:17:31.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.286+0000 7f2a5a5f3640 1 -- 172.21.15.90:0/3724020835 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a541f6e10 con 0x7f2a540b3310 2024-09-10T23:17:31.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.286+0000 7f2a50ff9640 1 -- 172.21.15.90:0/3724020835 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a44035030 con 0x7f2a540b3310 2024-09-10T23:17:31.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.286+0000 7f2a5a5f3640 1 -- 172.21.15.90:0/3724020835 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a541488c0 con 0x7f2a540b3310 2024-09-10T23:17:31.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.287+0000 7f2a5a5f3640 1 -- 172.21.15.90:0/3724020835 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a5415c1e0 con 0x7f2a540b3310 2024-09-10T23:17:31.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.287+0000 7f2a50ff9640 1 -- 172.21.15.90:0/3724020835 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2a44004ca0 con 0x7f2a540b3310 2024-09-10T23:17:31.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.288+0000 7f2a50ff9640 1 --2- 172.21.15.90:0/3724020835 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a40077f70 0x7f2a4007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:31.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.288+0000 7f2a50ff9640 1 -- 172.21.15.90:0/3724020835 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f2a440baf70 con 0x7f2a540b3310 2024-09-10T23:17:31.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.288+0000 7f2a537fe640 1 --2- 172.21.15.90:0/3724020835 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a40077f70 0x7f2a4007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:31.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.289+0000 7f2a537fe640 1 --2- 172.21.15.90:0/3724020835 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a40077f70 0x7f2a4007a430 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2a48007fd0 tx=0x7f2a48009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:31.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.292+0000 7f2a50ff9640 1 -- 172.21.15.90:0/3724020835 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2a44083b00 con 0x7f2a540b3310 2024-09-10T23:17:31.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.465+0000 7f2a5a5f3640 1 -- 172.21.15.90:0/3724020835 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a540708d0 con 0x7f2a40077f70 2024-09-10T23:17:31.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.469+0000 7f2a50ff9640 1 -- 172.21.15.90:0/3724020835 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239003 (secure 0 0 0) 0x7f2a540708d0 con 0x7f2a40077f70 2024-09-10T23:17:31.472 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:31.473 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:17:31.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.473+0000 7f2a5a5f3640 1 -- 172.21.15.90:0/3724020835 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a40077f70 msgr2=0x7f2a4007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:31.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.473+0000 7f2a5a5f3640 1 --2- 172.21.15.90:0/3724020835 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a40077f70 0x7f2a4007a430 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2a48007fd0 tx=0x7f2a48009040 comp rx=0 tx=0).stop 2024-09-10T23:17:31.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.473+0000 7f2a5a5f3640 1 -- 172.21.15.90:0/3724020835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a540b3310 msgr2=0x7f2a5409ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:31.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.473+0000 7f2a5a5f3640 1 --2- 172.21.15.90:0/3724020835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a540b3310 0x7f2a5409ced0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009850 tx=0x7f2a440039e0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.473+0000 7f2a5a5f3640 1 -- 172.21.15.90:0/3724020835 shutdown_connections 2024-09-10T23:17:31.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.473+0000 7f2a5a5f3640 1 --2- 172.21.15.90:0/3724020835 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2a40077f70 0x7f2a4007a430 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.473+0000 7f2a5a5f3640 1 --2- 172.21.15.90:0/3724020835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a54158dd0 0x7f2a541f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.473+0000 7f2a5a5f3640 1 --2- 172.21.15.90:0/3724020835 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a540ceca0 0x7f2a54158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.473+0000 7f2a5a5f3640 1 --2- 172.21.15.90:0/3724020835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a540b3310 0x7f2a5409ced0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.473+0000 7f2a5a5f3640 1 -- 172.21.15.90:0/3724020835 >> 172.21.15.90:0/3724020835 conn(0x7f2a540b19c0 msgr2=0x7f2a54073950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:31.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.473+0000 7f2a5a5f3640 1 -- 172.21.15.90:0/3724020835 shutdown_connections 2024-09-10T23:17:31.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.473+0000 7f2a5a5f3640 1 -- 172.21.15.90:0/3724020835 wait complete. 2024-09-10T23:17:31.485 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-09-10T23:17:30.476057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":122,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":24,"acting":24,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":245572,"kb_used_data":8528,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754729148,"statfs":{"total":773094113280,"available":772842647552,"internally_reserved":0,"allocated":8732672,"data_stored":4314557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.661592"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.856587+0000","last_change":"2024-09-10T23:17:27.850363+0000","last_active":"2024-09-10T23:17:27.856587+0000","last_peered":"2024-09-10T23:17:27.856587+0000","last_clean":"2024-09-10T23:17:27.856587+0000","last_became_active":"2024-09-10T23:17:27.850063+0000","last_became_peered":"2024-09-10T23:17:27.850063+0000","last_unstale":"2024-09-10T23:17:27.856587+0000","last_undegraded":"2024-09-10T23:17:27.856587+0000","last_fullsized":"2024-09-10T23:17:27.856587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:14.890268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.859478+0000","last_change":"2024-09-10T23:17:26.839740+0000","last_active":"2024-09-10T23:17:27.859478+0000","last_peered":"2024-09-10T23:17:27.859478+0000","last_clean":"2024-09-10T23:17:27.859478+0000","last_became_active":"2024-09-10T23:17:26.839472+0000","last_became_peered":"2024-09-10T23:17:26.839472+0000","last_unstale":"2024-09-10T23:17:27.859478+0000","last_undegraded":"2024-09-10T23:17:27.859478+0000","last_fullsized":"2024-09-10T23:17:27.859478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:24.073627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.859500+0000","last_change":"2024-09-10T23:17:26.838774+0000","last_active":"2024-09-10T23:17:27.859500+0000","last_peered":"2024-09-10T23:17:27.859500+0000","last_clean":"2024-09-10T23:17:27.859500+0000","last_became_active":"2024-09-10T23:17:26.838524+0000","last_became_peered":"2024-09-10T23:17:26.838524+0000","last_unstale":"2024-09-10T23:17:27.859500+0000","last_undegraded":"2024-09-10T23:17:27.859500+0000","last_fullsized":"2024-09-10T23:17:27.859500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:21.687107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.838826+0000","last_change":"2024-09-10T23:17:26.832339+0000","last_active":"2024-09-10T23:17:27.838826+0000","last_peered":"2024-09-10T23:17:27.838826+0000","last_clean":"2024-09-10T23:17:27.838826+0000","last_became_active":"2024-09-10T23:17:26.832033+0000","last_became_peered":"2024-09-10T23:17:26.832033+0000","last_unstale":"2024-09-10T23:17:27.838826+0000","last_undegraded":"2024-09-10T23:17:27.838826+0000","last_fullsized":"2024-09-10T23:17:27.838826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:28.236154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.859019+0000","last_change":"2024-09-10T23:17:27.852673+0000","last_active":"2024-09-10T23:17:27.859019+0000","last_peered":"2024-09-10T23:17:27.859019+0000","last_clean":"2024-09-10T23:17:27.859019+0000","last_became_active":"2024-09-10T23:17:27.852430+0000","last_became_peered":"2024-09-10T23:17:27.852430+0000","last_unstale":"2024-09-10T23:17:27.859019+0000","last_undegraded":"2024-09-10T23:17:27.859019+0000","last_fullsized":"2024-09-10T23:17:27.859019+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:19.398570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.846139+0000","last_change":"2024-09-10T23:17:27.843383+0000","last_active":"2024-09-10T23:17:27.846139+0000","last_peered":"2024-09-10T23:17:27.846139+0000","last_clean":"2024-09-10T23:17:27.846139+0000","last_became_active":"2024-09-10T23:17:27.843106+0000","last_became_peered":"2024-09-10T23:17:27.843106+0000","last_unstale":"2024-09-10T23:17:27.846139+0000","last_undegraded":"2024-09-10T23:17:27.846139+0000","last_fullsized":"2024-09-10T23:17:27.846139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:44.885760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"80'8","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.861641+0000","last_change":"2024-09-10T23:17:26.840049+0000","last_active":"2024-09-10T23:17:27.861641+0000","last_peered":"2024-09-10T23:17:27.861641+0000","last_clean":"2024-09-10T23:17:27.861641+0000","last_became_active":"2024-09-10T23:17:26.839235+0000","last_became_peered":"2024-09-10T23:17:26.839235+0000","last_unstale":"2024-09-10T23:17:27.861641+0000","last_undegraded":"2024-09-10T23:17:27.861641+0000","last_fullsized":"2024-09-10T23:17:27.861641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:33.133739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.860992+0000","last_change":"2024-09-10T23:17:26.838810+0000","last_active":"2024-09-10T23:17:27.860992+0000","last_peered":"2024-09-10T23:17:27.860992+0000","last_clean":"2024-09-10T23:17:27.860992+0000","last_became_active":"2024-09-10T23:17:26.838541+0000","last_became_peered":"2024-09-10T23:17:26.838541+0000","last_unstale":"2024-09-10T23:17:27.860992+0000","last_undegraded":"2024-09-10T23:17:27.860992+0000","last_fullsized":"2024-09-10T23:17:27.860992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:48.297843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.838328+0000","last_change":"2024-09-10T23:17:26.839387+0000","last_active":"2024-09-10T23:17:27.838328+0000","last_peered":"2024-09-10T23:17:27.838328+0000","last_clean":"2024-09-10T23:17:27.838328+0000","last_became_active":"2024-09-10T23:17:26.839150+0000","last_became_peered":"2024-09-10T23:17:26.839150+0000","last_unstale":"2024-09-10T23:17:27.838328+0000","last_undegraded":"2024-09-10T23:17:27.838328+0000","last_fullsized":"2024-09-10T23:17:27.838328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:54.734740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.837070+0000","last_change":"2024-09-10T23:17:26.838293+0000","last_active":"2024-09-10T23:17:27.837070+0000","last_peered":"2024-09-10T23:17:27.837070+0000","last_clean":"2024-09-10T23:17:27.837070+0000","last_became_active":"2024-09-10T23:17:26.838036+0000","last_became_peered":"2024-09-10T23:17:26.838036+0000","last_unstale":"2024-09-10T23:17:27.837070+0000","last_undegraded":"2024-09-10T23:17:27.837070+0000","last_fullsized":"2024-09-10T23:17:27.837070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:36.624168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.846190+0000","last_change":"2024-09-10T23:17:27.842286+0000","last_active":"2024-09-10T23:17:27.846190+0000","last_peered":"2024-09-10T23:17:27.846190+0000","last_clean":"2024-09-10T23:17:27.846190+0000","last_became_active":"2024-09-10T23:17:27.842048+0000","last_became_peered":"2024-09-10T23:17:27.842048+0000","last_unstale":"2024-09-10T23:17:27.846190+0000","last_undegraded":"2024-09-10T23:17:27.846190+0000","last_fullsized":"2024-09-10T23:17:27.846190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:47.468405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":207,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:17:24.442509+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:17:24.442509+0000","last_peered":"2024-09-10T23:17:24.442509+0000","last_clean":"2024-09-10T23:17:24.442509+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:17:24.442509+0000","last_undegraded":"2024-09-10T23:17:24.442509+0000","last_fullsized":"2024-09-10T23:17:24.442509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":1},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":14,"acting":14,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28524,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343316,"statfs":{"total":96636764160,"available":96607555584,"internally_reserved":0,"allocated":1531904,"data_stored":979733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27952,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32112,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1572864,"data_stored":998634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:17:31.491 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3f is not active+clean 2024-09-10T23:17:31.491 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.492 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3e is not active+clean 2024-09-10T23:17:31.492 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.492 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3d is not active+clean 2024-09-10T23:17:31.492 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.493 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3c is not active+clean 2024-09-10T23:17:31.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.493 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3b is not active+clean 2024-09-10T23:17:31.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.493 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3a is not active+clean 2024-09-10T23:17:31.494 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.494 INFO:tasks.ceph.ceph_manager.ceph:PG 13.39 is not active+clean 2024-09-10T23:17:31.494 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.494 INFO:tasks.ceph.ceph_manager.ceph:PG 13.38 is not active+clean 2024-09-10T23:17:31.494 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.495 INFO:tasks.ceph.ceph_manager.ceph:PG 13.37 is not active+clean 2024-09-10T23:17:31.495 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.495 INFO:tasks.ceph.ceph_manager.ceph:PG 13.36 is not active+clean 2024-09-10T23:17:31.495 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.495 INFO:tasks.ceph.ceph_manager.ceph:PG 13.35 is not active+clean 2024-09-10T23:17:31.496 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.496 INFO:tasks.ceph.ceph_manager.ceph:PG 13.34 is not active+clean 2024-09-10T23:17:31.496 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.496 INFO:tasks.ceph.ceph_manager.ceph:PG 13.33 is not active+clean 2024-09-10T23:17:31.496 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.497 INFO:tasks.ceph.ceph_manager.ceph:PG 13.32 is not active+clean 2024-09-10T23:17:31.497 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.497 INFO:tasks.ceph.ceph_manager.ceph:PG 13.31 is not active+clean 2024-09-10T23:17:31.497 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.498 INFO:tasks.ceph.ceph_manager.ceph:PG 13.30 is not active+clean 2024-09-10T23:17:31.498 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.498 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2f is not active+clean 2024-09-10T23:17:31.498 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.499 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2e is not active+clean 2024-09-10T23:17:31.499 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.499 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2c is not active+clean 2024-09-10T23:17:31.499 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.499 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2b is not active+clean 2024-09-10T23:17:31.499 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.500 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2a is not active+clean 2024-09-10T23:17:31.500 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.500 INFO:tasks.ceph.ceph_manager.ceph:PG 13.29 is not active+clean 2024-09-10T23:17:31.500 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.501 INFO:tasks.ceph.ceph_manager.ceph:PG 13.28 is not active+clean 2024-09-10T23:17:31.501 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.501 INFO:tasks.ceph.ceph_manager.ceph:PG 13.27 is not active+clean 2024-09-10T23:17:31.501 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.502 INFO:tasks.ceph.ceph_manager.ceph:PG 13.26 is not active+clean 2024-09-10T23:17:31.502 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.502 INFO:tasks.ceph.ceph_manager.ceph:PG 13.25 is not active+clean 2024-09-10T23:17:31.502 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.502 INFO:tasks.ceph.ceph_manager.ceph:PG 13.24 is not active+clean 2024-09-10T23:17:31.503 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.503 INFO:tasks.ceph.ceph_manager.ceph:PG 13.23 is not active+clean 2024-09-10T23:17:31.503 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.503 INFO:tasks.ceph.ceph_manager.ceph:PG 13.22 is not active+clean 2024-09-10T23:17:31.503 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.504 INFO:tasks.ceph.ceph_manager.ceph:PG 13.21 is not active+clean 2024-09-10T23:17:31.504 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.504 INFO:tasks.ceph.ceph_manager.ceph:PG 13.20 is not active+clean 2024-09-10T23:17:31.504 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.505 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1e is not active+clean 2024-09-10T23:17:31.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.505 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1f is not active+clean 2024-09-10T23:17:31.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.505 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1f is not active+clean 2024-09-10T23:17:31.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.506 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1e is not active+clean 2024-09-10T23:17:31.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.506 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1c is not active+clean 2024-09-10T23:17:31.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.507 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1d is not active+clean 2024-09-10T23:17:31.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.507 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1a is not active+clean 2024-09-10T23:17:31.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.508 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1b is not active+clean 2024-09-10T23:17:31.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.508 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1b is not active+clean 2024-09-10T23:17:31.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.508 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1a is not active+clean 2024-09-10T23:17:31.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.509 INFO:tasks.ceph.ceph_manager.ceph:PG 13.18 is not active+clean 2024-09-10T23:17:31.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.509 INFO:tasks.ceph.ceph_manager.ceph:PG 13.19 is not active+clean 2024-09-10T23:17:31.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.510 INFO:tasks.ceph.ceph_manager.ceph:PG 12.18 is not active+clean 2024-09-10T23:17:31.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.510 INFO:tasks.ceph.ceph_manager.ceph:PG 13.16 is not active+clean 2024-09-10T23:17:31.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.511 INFO:tasks.ceph.ceph_manager.ceph:PG 12.17 is not active+clean 2024-09-10T23:17:31.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.511 INFO:tasks.ceph.ceph_manager.ceph:PG 13.17 is not active+clean 2024-09-10T23:17:31.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.511 INFO:tasks.ceph.ceph_manager.ceph:PG 12.16 is not active+clean 2024-09-10T23:17:31.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.512 INFO:tasks.ceph.ceph_manager.ceph:PG 12.15 is not active+clean 2024-09-10T23:17:31.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.512 INFO:tasks.ceph.ceph_manager.ceph:PG 13.15 is not active+clean 2024-09-10T23:17:31.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.513 INFO:tasks.ceph.ceph_manager.ceph:PG 12.14 is not active+clean 2024-09-10T23:17:31.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.513 INFO:tasks.ceph.ceph_manager.ceph:PG 12.13 is not active+clean 2024-09-10T23:17:31.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.513 INFO:tasks.ceph.ceph_manager.ceph:PG 13.13 is not active+clean 2024-09-10T23:17:31.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.513 INFO:tasks.ceph.ceph_manager.ceph:PG 12.12 is not active+clean 2024-09-10T23:17:31.514 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.514 INFO:tasks.ceph.ceph_manager.ceph:PG 13.10 is not active+clean 2024-09-10T23:17:31.514 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.514 INFO:tasks.ceph.ceph_manager.ceph:PG 12.11 is not active+clean 2024-09-10T23:17:31.514 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.514 INFO:tasks.ceph.ceph_manager.ceph:PG 13.11 is not active+clean 2024-09-10T23:17:31.514 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.514 INFO:tasks.ceph.ceph_manager.ceph:PG 13.e is not active+clean 2024-09-10T23:17:31.514 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.515 INFO:tasks.ceph.ceph_manager.ceph:PG 12.f is not active+clean 2024-09-10T23:17:31.515 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.515 INFO:tasks.ceph.ceph_manager.ceph:PG 13.f is not active+clean 2024-09-10T23:17:31.515 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.515 INFO:tasks.ceph.ceph_manager.ceph:PG 13.d is not active+clean 2024-09-10T23:17:31.515 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.515 INFO:tasks.ceph.ceph_manager.ceph:PG 13.a is not active+clean 2024-09-10T23:17:31.515 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.515 INFO:tasks.ceph.ceph_manager.ceph:PG 12.b is not active+clean 2024-09-10T23:17:31.515 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.516 INFO:tasks.ceph.ceph_manager.ceph:PG 13.b is not active+clean 2024-09-10T23:17:31.516 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.516 INFO:tasks.ceph.ceph_manager.ceph:PG 12.a is not active+clean 2024-09-10T23:17:31.516 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.516 INFO:tasks.ceph.ceph_manager.ceph:PG 13.8 is not active+clean 2024-09-10T23:17:31.516 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.516 INFO:tasks.ceph.ceph_manager.ceph:PG 12.9 is not active+clean 2024-09-10T23:17:31.516 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.516 INFO:tasks.ceph.ceph_manager.ceph:PG 13.9 is not active+clean 2024-09-10T23:17:31.517 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.517 INFO:tasks.ceph.ceph_manager.ceph:PG 12.8 is not active+clean 2024-09-10T23:17:31.517 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.517 INFO:tasks.ceph.ceph_manager.ceph:PG 13.6 is not active+clean 2024-09-10T23:17:31.517 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.517 INFO:tasks.ceph.ceph_manager.ceph:PG 12.7 is not active+clean 2024-09-10T23:17:31.517 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.517 INFO:tasks.ceph.ceph_manager.ceph:PG 13.7 is not active+clean 2024-09-10T23:17:31.517 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.518 INFO:tasks.ceph.ceph_manager.ceph:PG 12.6 is not active+clean 2024-09-10T23:17:31.518 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.518 INFO:tasks.ceph.ceph_manager.ceph:PG 13.4 is not active+clean 2024-09-10T23:17:31.518 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.518 INFO:tasks.ceph.ceph_manager.ceph:PG 12.5 is not active+clean 2024-09-10T23:17:31.518 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.518 INFO:tasks.ceph.ceph_manager.ceph:PG 13.5 is not active+clean 2024-09-10T23:17:31.518 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.518 INFO:tasks.ceph.ceph_manager.ceph:PG 12.4 is not active+clean 2024-09-10T23:17:31.519 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.519 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2 is not active+clean 2024-09-10T23:17:31.519 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.519 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2 is not active+clean 2024-09-10T23:17:31.519 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.519 INFO:tasks.ceph.ceph_manager.ceph:PG 13.0 is not active+clean 2024-09-10T23:17:31.519 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.519 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1 is not active+clean 2024-09-10T23:17:31.519 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.520 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1 is not active+clean 2024-09-10T23:17:31.520 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.520 INFO:tasks.ceph.ceph_manager.ceph:PG 12.0 is not active+clean 2024-09-10T23:17:31.520 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.520 INFO:tasks.ceph.ceph_manager.ceph:PG 13.c is not active+clean 2024-09-10T23:17:31.520 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:26.814153+0000', 'last_change': '2024-09-10T23:17:26.814153+0000', 'last_active': '2024-09-10T23:17:26.814153+0000', 'last_peered': '2024-09-10T23:17:26.814153+0000', 'last_clean': '2024-09-10T23:17:26.814153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:26.814153+0000', 'last_undegraded': '2024-09-10T23:17:26.814153+0000', 'last_fullsized': '2024-09-10T23:17:26.814153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:26.814153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.520 INFO:tasks.ceph.ceph_manager.ceph:PG 12.d is not active+clean 2024-09-10T23:17:31.520 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:17:25.803514+0000', 'last_change': '2024-09-10T23:17:25.803514+0000', 'last_active': '2024-09-10T23:17:25.803514+0000', 'last_peered': '2024-09-10T23:17:25.803514+0000', 'last_clean': '2024-09-10T23:17:25.803514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:25.803514+0000', 'last_undegraded': '2024-09-10T23:17:25.803514+0000', 'last_fullsized': '2024-09-10T23:17:25.803514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:25.803514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:17:31.521 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:17:31.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.624+0000 7f3aaef2b640 1 -- 172.21.15.90:0/402809953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a90007780 msgr2=0x7f3a90009c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:31.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.624+0000 7f3aaef2b640 1 --2- 172.21.15.90:0/402809953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a90007780 0x7f3a90009c10 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800c2e0 tx=0x7f3a90003810 comp rx=0 tx=0).stop 2024-09-10T23:17:31.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.624+0000 7f3aad4c8640 1 -- 172.21.15.90:0/402809953 reap_dead start 2024-09-10T23:17:31.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.624+0000 7f3aaef2b640 1 -- 172.21.15.90:0/402809953 shutdown_connections 2024-09-10T23:17:31.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.624+0000 7f3aaef2b640 1 -- 172.21.15.90:0/402809953 >> 172.21.15.90:0/402809953 conn(0x7f3aa80688e0 msgr2=0x7f3aa8068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:31.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.624+0000 7f3aaef2b640 1 -- 172.21.15.90:0/402809953 shutdown_connections 2024-09-10T23:17:31.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.624+0000 7f3aaef2b640 1 -- 172.21.15.90:0/402809953 wait complete. 2024-09-10T23:17:31.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.625+0000 7f3aaef2b640 1 Processor -- start 2024-09-10T23:17:31.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.625+0000 7f3aaef2b640 1 -- start start 2024-09-10T23:17:31.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.626+0000 7f3aaef2b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a90007780 0x7f3aa8155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:31.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.626+0000 7f3aaef2b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3aa8150cc0 0x7f3aa81577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:31.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.626+0000 7f3aaef2b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3aa8143c60 0x7f3aa81ea570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:31.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.626+0000 7f3aaef2b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa815d850 con 0x7f3aa8150cc0 2024-09-10T23:17:31.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.626+0000 7f3aaef2b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa815d6d0 con 0x7f3a90007780 2024-09-10T23:17:31.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.626+0000 7f3aaef2b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa815a6a0 con 0x7f3aa8143c60 2024-09-10T23:17:31.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.626+0000 7f3a9ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3aa8150cc0 0x7f3aa81577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:31.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.626+0000 7f3a9ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3aa8150cc0 0x7f3aa81577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37138/0 (socket says 172.21.15.90:37138) 2024-09-10T23:17:31.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.626+0000 7f3a9ffff640 1 -- 172.21.15.90:0/1736714160 learned_addr learned my addr 172.21.15.90:0/1736714160 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:31.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.627+0000 7f3aad4c8640 1 --2- 172.21.15.90:0/1736714160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3aa8143c60 0x7f3aa81ea570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:31.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.627+0000 7f3aaccc7640 1 --2- 172.21.15.90:0/1736714160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a90007780 0x7f3aa8155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:31.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.627+0000 7f3a9ffff640 1 -- 172.21.15.90:0/1736714160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3aa8143c60 msgr2=0x7f3aa81ea570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:31.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.627+0000 7f3a9ffff640 1 --2- 172.21.15.90:0/1736714160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3aa8143c60 0x7f3aa81ea570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.627+0000 7f3a9ffff640 1 -- 172.21.15.90:0/1736714160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a90007780 msgr2=0x7f3aa8155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:31.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.627+0000 7f3a9ffff640 1 --2- 172.21.15.90:0/1736714160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a90007780 0x7f3aa8155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.627+0000 7f3a9ffff640 1 -- 172.21.15.90:0/1736714160 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa8074380 con 0x7f3aa8150cc0 2024-09-10T23:17:31.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.627+0000 7f3aaccc7640 1 --2- 172.21.15.90:0/1736714160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a90007780 0x7f3aa8155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:31.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.627+0000 7f3a9ffff640 1 --2- 172.21.15.90:0/1736714160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3aa8150cc0 0x7f3aa81577b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3a9802b130 tx=0x7f3a98006ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:31.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.627+0000 7f3a9d7fa640 1 -- 172.21.15.90:0/1736714160 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a98031040 con 0x7f3aa8150cc0 2024-09-10T23:17:31.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.627+0000 7f3a9d7fa640 1 -- 172.21.15.90:0/1736714160 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a980035f0 con 0x7f3aa8150cc0 2024-09-10T23:17:31.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.627+0000 7f3aaef2b640 1 -- 172.21.15.90:0/1736714160 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa8074660 con 0x7f3aa8150cc0 2024-09-10T23:17:31.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.627+0000 7f3a9d7fa640 1 -- 172.21.15.90:0/1736714160 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a98003a20 con 0x7f3aa8150cc0 2024-09-10T23:17:31.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.627+0000 7f3aaef2b640 1 -- 172.21.15.90:0/1736714160 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa81e5360 con 0x7f3aa8150cc0 2024-09-10T23:17:31.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.628+0000 7f3aaef2b640 1 -- 172.21.15.90:0/1736714160 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa8070a70 con 0x7f3aa8150cc0 2024-09-10T23:17:31.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.629+0000 7f3a9d7fa640 1 -- 172.21.15.90:0/1736714160 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3a98003bc0 con 0x7f3aa8150cc0 2024-09-10T23:17:31.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.629+0000 7f3a9d7fa640 1 --2- 172.21.15.90:0/1736714160 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3a94077fa0 0x7f3a9407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:31.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.629+0000 7f3a9d7fa640 1 -- 172.21.15.90:0/1736714160 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f3a980b9ef0 con 0x7f3aa8150cc0 2024-09-10T23:17:31.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.629+0000 7f3aaccc7640 1 --2- 172.21.15.90:0/1736714160 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3a94077fa0 0x7f3a9407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:31.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.630+0000 7f3aaccc7640 1 --2- 172.21.15.90:0/1736714160 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3a94077fa0 0x7f3a9407a460 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4009b60 tx=0x7f3aa4005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:31.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.633+0000 7f3a9d7fa640 1 -- 172.21.15.90:0/1736714160 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3a98082ad0 con 0x7f3aa8150cc0 2024-09-10T23:17:31.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.877+0000 7f3aaef2b640 1 -- 172.21.15.90:0/1736714160 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3aa80b3220 con 0x7f3aa8150cc0 2024-09-10T23:17:31.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.878+0000 7f3a9d7fa640 1 -- 172.21.15.90:0/1736714160 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1418 (secure 0 0 0) 0x7f3a980823d0 con 0x7f3aa8150cc0 2024-09-10T23:17:31.879 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:31.879 INFO:teuthology.orchestra.run.smithi090.stdout:{"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":199,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":81,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010065,"num_in_osds":8,"osd_in_since":1726010055,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":85},{"state_name":"active+clean","count":12}],"num_pgs":97,"num_pools":3,"num_objects":9,"data_bytes":590368,"bytes_used":251465728,"bytes_avail":772842647552,"bytes_total":773094113280,"unknown_pgs_ratio":0.87628865242004395,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":44,"btime":"2024-09-10T23:17:29:843110+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":6351}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-10T23:16:52.467487+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:17:31.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.880+0000 7f3aaef2b640 1 -- 172.21.15.90:0/1736714160 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3a94077fa0 msgr2=0x7f3a9407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:31.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.880+0000 7f3aaef2b640 1 --2- 172.21.15.90:0/1736714160 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3a94077fa0 0x7f3a9407a460 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4009b60 tx=0x7f3aa4005f90 comp rx=0 tx=0).stop 2024-09-10T23:17:31.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.880+0000 7f3aaef2b640 1 -- 172.21.15.90:0/1736714160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3aa8150cc0 msgr2=0x7f3aa81577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:31.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.880+0000 7f3aaef2b640 1 --2- 172.21.15.90:0/1736714160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3aa8150cc0 0x7f3aa81577b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3a9802b130 tx=0x7f3a98006ce0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.880+0000 7f3aaef2b640 1 -- 172.21.15.90:0/1736714160 shutdown_connections 2024-09-10T23:17:31.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.880+0000 7f3aaef2b640 1 --2- 172.21.15.90:0/1736714160 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3a94077fa0 0x7f3a9407a460 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.880+0000 7f3aaef2b640 1 --2- 172.21.15.90:0/1736714160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3aa8143c60 0x7f3aa81ea570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.880+0000 7f3aaef2b640 1 --2- 172.21.15.90:0/1736714160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3aa8150cc0 0x7f3aa81577b0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.880+0000 7f3aaef2b640 1 --2- 172.21.15.90:0/1736714160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a90007780 0x7f3aa8155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.880+0000 7f3aaef2b640 1 -- 172.21.15.90:0/1736714160 >> 172.21.15.90:0/1736714160 conn(0x7f3aa80688e0 msgr2=0x7f3aa81e6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:31.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.880+0000 7f3aaef2b640 1 -- 172.21.15.90:0/1736714160 shutdown_connections 2024-09-10T23:17:31.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.880+0000 7f3aaef2b640 1 -- 172.21.15.90:0/1736714160 wait complete. 2024-09-10T23:17:31.891 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T23:17:31.892 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:17:31.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.992+0000 7fa5257bb640 1 -- 172.21.15.90:0/3071768918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa50c005180 msgr2=0x7fa50c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:31.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.992+0000 7fa5257bb640 1 --2- 172.21.15.90:0/3071768918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa50c005180 0x7fa50c00b9c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fa51800c340 tx=0x7fa50c005830 comp rx=0 tx=0).stop 2024-09-10T23:17:31.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.992+0000 7fa51f7fe640 1 -- 172.21.15.90:0/3071768918 reap_dead start 2024-09-10T23:17:31.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.992+0000 7fa5257bb640 1 -- 172.21.15.90:0/3071768918 shutdown_connections 2024-09-10T23:17:31.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.992+0000 7fa5257bb640 1 -- 172.21.15.90:0/3071768918 >> 172.21.15.90:0/3071768918 conn(0x7fa5200b19c0 msgr2=0x7fa5200b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:31.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.992+0000 7fa5257bb640 1 -- 172.21.15.90:0/3071768918 shutdown_connections 2024-09-10T23:17:31.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.992+0000 7fa5257bb640 1 -- 172.21.15.90:0/3071768918 wait complete. 2024-09-10T23:17:31.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.993+0000 7fa5257bb640 1 Processor -- start 2024-09-10T23:17:31.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.993+0000 7fa5257bb640 1 -- start start 2024-09-10T23:17:31.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa5257bb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa50c005180 0x7fa52015d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:31.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa5257bb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa52014a5b0 0x7fa52014ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:31.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa5257bb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5200c7a50 0x7fa5200c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:31.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa5257bb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5200b2870 con 0x7fa50c005180 2024-09-10T23:17:31.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa5257bb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa5200b26f0 con 0x7fa52014a5b0 2024-09-10T23:17:31.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa5257bb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa52015bec0 con 0x7fa5200c7a50 2024-09-10T23:17:31.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa51effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa50c005180 0x7fa52015d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:31.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa51effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa50c005180 0x7fa52015d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37154/0 (socket says 172.21.15.90:37154) 2024-09-10T23:17:31.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa51effd640 1 -- 172.21.15.90:0/1465485928 learned_addr learned my addr 172.21.15.90:0/1465485928 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:31.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa51e7fc640 1 --2- 172.21.15.90:0/1465485928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa52014a5b0 0x7fa52014ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:31.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa51f7fe640 1 --2- 172.21.15.90:0/1465485928 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5200c7a50 0x7fa5200c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:31.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa51effd640 1 -- 172.21.15.90:0/1465485928 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5200c7a50 msgr2=0x7fa5200c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:31.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa51effd640 1 --2- 172.21.15.90:0/1465485928 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5200c7a50 0x7fa5200c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa51effd640 1 -- 172.21.15.90:0/1465485928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa52014a5b0 msgr2=0x7fa52014ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:31.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa51effd640 1 --2- 172.21.15.90:0/1465485928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa52014a5b0 0x7fa52014ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:31.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa51effd640 1 -- 172.21.15.90:0/1465485928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5200c8410 con 0x7fa50c005180 2024-09-10T23:17:31.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa51e7fc640 1 --2- 172.21.15.90:0/1465485928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa52014a5b0 0x7fa52014ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:31.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa51effd640 1 --2- 172.21.15.90:0/1465485928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa50c005180 0x7fa52015d200 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa510006090 tx=0x7fa510006550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:31.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.994+0000 7fa5177fe640 1 -- 172.21.15.90:0/1465485928 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa510015070 con 0x7fa50c005180 2024-09-10T23:17:31.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.995+0000 7fa5177fe640 1 -- 172.21.15.90:0/1465485928 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa51000fa90 con 0x7fa50c005180 2024-09-10T23:17:31.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.995+0000 7fa5257bb640 1 -- 172.21.15.90:0/1465485928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5201f28e0 con 0x7fa50c005180 2024-09-10T23:17:31.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.995+0000 7fa5177fe640 1 -- 172.21.15.90:0/1465485928 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa510011430 con 0x7fa50c005180 2024-09-10T23:17:31.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.995+0000 7fa5257bb640 1 -- 172.21.15.90:0/1465485928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5201f2ea0 con 0x7fa50c005180 2024-09-10T23:17:31.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.996+0000 7fa5257bb640 1 -- 172.21.15.90:0/1465485928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa52015e970 con 0x7fa50c005180 2024-09-10T23:17:31.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.996+0000 7fa5177fe640 1 -- 172.21.15.90:0/1465485928 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa5100115d0 con 0x7fa50c005180 2024-09-10T23:17:31.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.997+0000 7fa5177fe640 1 --2- 172.21.15.90:0/1465485928 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa500077fa0 0x7fa50007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:31.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.997+0000 7fa5177fe640 1 -- 172.21.15.90:0/1465485928 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fa51009ab20 con 0x7fa50c005180 2024-09-10T23:17:31.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.997+0000 7fa51e7fc640 1 --2- 172.21.15.90:0/1465485928 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa500077fa0 0x7fa50007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:31.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:31.997+0000 7fa51e7fc640 1 --2- 172.21.15.90:0/1465485928 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa500077fa0 0x7fa50007a460 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa5200cd120 tx=0x7fa508005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:32.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:32.001+0000 7fa5177fe640 1 -- 172.21.15.90:0/1465485928 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa5100636b0 con 0x7fa50c005180 2024-09-10T23:17:32.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:32.172+0000 7fa5257bb640 1 -- 172.21.15.90:0/1465485928 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa52014ce70 con 0x7fa500077fa0 2024-09-10T23:17:32.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:32.176+0000 7fa5177fe640 1 -- 172.21.15.90:0/1465485928 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239003 (secure 0 0 0) 0x7fa52014ce70 con 0x7fa500077fa0 2024-09-10T23:17:32.179 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:32.180 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:17:32.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:32.179+0000 7fa5257bb640 1 -- 172.21.15.90:0/1465485928 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa500077fa0 msgr2=0x7fa50007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:32.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:32.179+0000 7fa5257bb640 1 --2- 172.21.15.90:0/1465485928 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa500077fa0 0x7fa50007a460 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa5200cd120 tx=0x7fa508005f90 comp rx=0 tx=0).stop 2024-09-10T23:17:32.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:32.179+0000 7fa5257bb640 1 -- 172.21.15.90:0/1465485928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa50c005180 msgr2=0x7fa52015d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:32.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:32.179+0000 7fa5257bb640 1 --2- 172.21.15.90:0/1465485928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa50c005180 0x7fa52015d200 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa510006090 tx=0x7fa510006550 comp rx=0 tx=0).stop 2024-09-10T23:17:32.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:32.179+0000 7fa5257bb640 1 -- 172.21.15.90:0/1465485928 shutdown_connections 2024-09-10T23:17:32.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:32.179+0000 7fa5257bb640 1 --2- 172.21.15.90:0/1465485928 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa500077fa0 0x7fa50007a460 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:32.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:32.179+0000 7fa5257bb640 1 --2- 172.21.15.90:0/1465485928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa52014a5b0 0x7fa52014ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:32.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:32.179+0000 7fa5257bb640 1 --2- 172.21.15.90:0/1465485928 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5200c7a50 0x7fa5200c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:32.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:32.179+0000 7fa5257bb640 1 --2- 172.21.15.90:0/1465485928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa50c005180 0x7fa52015d200 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:32.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:32.179+0000 7fa5257bb640 1 -- 172.21.15.90:0/1465485928 >> 172.21.15.90:0/1465485928 conn(0x7fa5200b19c0 msgr2=0x7fa5200b0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:32.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:32.179+0000 7fa5257bb640 1 -- 172.21.15.90:0/1465485928 shutdown_connections 2024-09-10T23:17:32.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:32.179+0000 7fa5257bb640 1 -- 172.21.15.90:0/1465485928 wait complete. 2024-09-10T23:17:32.191 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-09-10T23:17:30.476057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":122,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":24,"acting":24,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":245572,"kb_used_data":8528,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754729148,"statfs":{"total":773094113280,"available":772842647552,"internally_reserved":0,"allocated":8732672,"data_stored":4314557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.661592"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.856587+0000","last_change":"2024-09-10T23:17:27.850363+0000","last_active":"2024-09-10T23:17:27.856587+0000","last_peered":"2024-09-10T23:17:27.856587+0000","last_clean":"2024-09-10T23:17:27.856587+0000","last_became_active":"2024-09-10T23:17:27.850063+0000","last_became_peered":"2024-09-10T23:17:27.850063+0000","last_unstale":"2024-09-10T23:17:27.856587+0000","last_undegraded":"2024-09-10T23:17:27.856587+0000","last_fullsized":"2024-09-10T23:17:27.856587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:14.890268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.859478+0000","last_change":"2024-09-10T23:17:26.839740+0000","last_active":"2024-09-10T23:17:27.859478+0000","last_peered":"2024-09-10T23:17:27.859478+0000","last_clean":"2024-09-10T23:17:27.859478+0000","last_became_active":"2024-09-10T23:17:26.839472+0000","last_became_peered":"2024-09-10T23:17:26.839472+0000","last_unstale":"2024-09-10T23:17:27.859478+0000","last_undegraded":"2024-09-10T23:17:27.859478+0000","last_fullsized":"2024-09-10T23:17:27.859478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:24.073627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.859500+0000","last_change":"2024-09-10T23:17:26.838774+0000","last_active":"2024-09-10T23:17:27.859500+0000","last_peered":"2024-09-10T23:17:27.859500+0000","last_clean":"2024-09-10T23:17:27.859500+0000","last_became_active":"2024-09-10T23:17:26.838524+0000","last_became_peered":"2024-09-10T23:17:26.838524+0000","last_unstale":"2024-09-10T23:17:27.859500+0000","last_undegraded":"2024-09-10T23:17:27.859500+0000","last_fullsized":"2024-09-10T23:17:27.859500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:21.687107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.838826+0000","last_change":"2024-09-10T23:17:26.832339+0000","last_active":"2024-09-10T23:17:27.838826+0000","last_peered":"2024-09-10T23:17:27.838826+0000","last_clean":"2024-09-10T23:17:27.838826+0000","last_became_active":"2024-09-10T23:17:26.832033+0000","last_became_peered":"2024-09-10T23:17:26.832033+0000","last_unstale":"2024-09-10T23:17:27.838826+0000","last_undegraded":"2024-09-10T23:17:27.838826+0000","last_fullsized":"2024-09-10T23:17:27.838826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:28.236154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.859019+0000","last_change":"2024-09-10T23:17:27.852673+0000","last_active":"2024-09-10T23:17:27.859019+0000","last_peered":"2024-09-10T23:17:27.859019+0000","last_clean":"2024-09-10T23:17:27.859019+0000","last_became_active":"2024-09-10T23:17:27.852430+0000","last_became_peered":"2024-09-10T23:17:27.852430+0000","last_unstale":"2024-09-10T23:17:27.859019+0000","last_undegraded":"2024-09-10T23:17:27.859019+0000","last_fullsized":"2024-09-10T23:17:27.859019+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:19.398570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.846139+0000","last_change":"2024-09-10T23:17:27.843383+0000","last_active":"2024-09-10T23:17:27.846139+0000","last_peered":"2024-09-10T23:17:27.846139+0000","last_clean":"2024-09-10T23:17:27.846139+0000","last_became_active":"2024-09-10T23:17:27.843106+0000","last_became_peered":"2024-09-10T23:17:27.843106+0000","last_unstale":"2024-09-10T23:17:27.846139+0000","last_undegraded":"2024-09-10T23:17:27.846139+0000","last_fullsized":"2024-09-10T23:17:27.846139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:44.885760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"80'8","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.861641+0000","last_change":"2024-09-10T23:17:26.840049+0000","last_active":"2024-09-10T23:17:27.861641+0000","last_peered":"2024-09-10T23:17:27.861641+0000","last_clean":"2024-09-10T23:17:27.861641+0000","last_became_active":"2024-09-10T23:17:26.839235+0000","last_became_peered":"2024-09-10T23:17:26.839235+0000","last_unstale":"2024-09-10T23:17:27.861641+0000","last_undegraded":"2024-09-10T23:17:27.861641+0000","last_fullsized":"2024-09-10T23:17:27.861641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:33.133739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.860992+0000","last_change":"2024-09-10T23:17:26.838810+0000","last_active":"2024-09-10T23:17:27.860992+0000","last_peered":"2024-09-10T23:17:27.860992+0000","last_clean":"2024-09-10T23:17:27.860992+0000","last_became_active":"2024-09-10T23:17:26.838541+0000","last_became_peered":"2024-09-10T23:17:26.838541+0000","last_unstale":"2024-09-10T23:17:27.860992+0000","last_undegraded":"2024-09-10T23:17:27.860992+0000","last_fullsized":"2024-09-10T23:17:27.860992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:48.297843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.838328+0000","last_change":"2024-09-10T23:17:26.839387+0000","last_active":"2024-09-10T23:17:27.838328+0000","last_peered":"2024-09-10T23:17:27.838328+0000","last_clean":"2024-09-10T23:17:27.838328+0000","last_became_active":"2024-09-10T23:17:26.839150+0000","last_became_peered":"2024-09-10T23:17:26.839150+0000","last_unstale":"2024-09-10T23:17:27.838328+0000","last_undegraded":"2024-09-10T23:17:27.838328+0000","last_fullsized":"2024-09-10T23:17:27.838328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:54.734740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.837070+0000","last_change":"2024-09-10T23:17:26.838293+0000","last_active":"2024-09-10T23:17:27.837070+0000","last_peered":"2024-09-10T23:17:27.837070+0000","last_clean":"2024-09-10T23:17:27.837070+0000","last_became_active":"2024-09-10T23:17:26.838036+0000","last_became_peered":"2024-09-10T23:17:26.838036+0000","last_unstale":"2024-09-10T23:17:27.837070+0000","last_undegraded":"2024-09-10T23:17:27.837070+0000","last_fullsized":"2024-09-10T23:17:27.837070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:36.624168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-10T23:17:27.846190+0000","last_change":"2024-09-10T23:17:27.842286+0000","last_active":"2024-09-10T23:17:27.846190+0000","last_peered":"2024-09-10T23:17:27.846190+0000","last_clean":"2024-09-10T23:17:27.846190+0000","last_became_active":"2024-09-10T23:17:27.842048+0000","last_became_peered":"2024-09-10T23:17:27.842048+0000","last_unstale":"2024-09-10T23:17:27.846190+0000","last_undegraded":"2024-09-10T23:17:27.846190+0000","last_fullsized":"2024-09-10T23:17:27.846190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:47.468405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:26.814153+0000","last_change":"2024-09-10T23:17:26.814153+0000","last_active":"2024-09-10T23:17:26.814153+0000","last_peered":"2024-09-10T23:17:26.814153+0000","last_clean":"2024-09-10T23:17:26.814153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:26.814153+0000","last_undegraded":"2024-09-10T23:17:26.814153+0000","last_fullsized":"2024-09-10T23:17:26.814153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:17:25.803514+0000","last_change":"2024-09-10T23:17:25.803514+0000","last_active":"2024-09-10T23:17:25.803514+0000","last_peered":"2024-09-10T23:17:25.803514+0000","last_clean":"2024-09-10T23:17:25.803514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:25.803514+0000","last_undegraded":"2024-09-10T23:17:25.803514+0000","last_fullsized":"2024-09-10T23:17:25.803514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":207,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:17:24.442509+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:17:24.442509+0000","last_peered":"2024-09-10T23:17:24.442509+0000","last_clean":"2024-09-10T23:17:24.442509+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:17:24.442509+0000","last_undegraded":"2024-09-10T23:17:24.442509+0000","last_fullsized":"2024-09-10T23:17:24.442509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":1},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":14,"acting":14,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28524,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343316,"statfs":{"total":96636764160,"available":96607555584,"internally_reserved":0,"allocated":1531904,"data_stored":979733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27952,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32112,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":937984,"data_stored":389365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1572864,"data_stored":998634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:17:33.804 INFO:tasks.ceph.mds.a.smithi090.stderr:2024-09-10T23:17:33.803+0000 7f406a88c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:17:35.196 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:17:35.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.309+0000 7f9d6592b640 1 -- 172.21.15.90:0/3469228592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d4c004d40 msgr2=0x7f9d4c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:35.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.309+0000 7f9d6592b640 1 --2- 172.21.15.90:0/3469228592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d4c004d40 0x7f9d4c0051c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800c290 tx=0x7f9d4c005830 comp rx=0 tx=0).stop 2024-09-10T23:17:35.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.309+0000 7f9d5f7fe640 1 -- 172.21.15.90:0/3469228592 reap_dead start 2024-09-10T23:17:35.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.309+0000 7f9d6592b640 1 -- 172.21.15.90:0/3469228592 shutdown_connections 2024-09-10T23:17:35.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.309+0000 7f9d6592b640 1 -- 172.21.15.90:0/3469228592 >> 172.21.15.90:0/3469228592 conn(0x7f9d600d4090 msgr2=0x7f9d600d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:35.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.309+0000 7f9d6592b640 1 -- 172.21.15.90:0/3469228592 shutdown_connections 2024-09-10T23:17:35.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.309+0000 7f9d6592b640 1 -- 172.21.15.90:0/3469228592 wait complete. 2024-09-10T23:17:35.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.310+0000 7f9d6592b640 1 Processor -- start 2024-09-10T23:17:35.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.310+0000 7f9d6592b640 1 -- start start 2024-09-10T23:17:35.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.311+0000 7f9d6592b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d4c004d40 0x7f9d601f8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:35.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.311+0000 7f9d6592b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d600b9680 0x7f9d600b8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:35.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.311+0000 7f9d6592b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d6015e900 0x7f9d6015ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:35.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.311+0000 7f9d6592b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9d600cf820 con 0x7f9d6015e900 2024-09-10T23:17:35.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.311+0000 7f9d6592b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9d600d3ae0 con 0x7f9d4c004d40 2024-09-10T23:17:35.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.311+0000 7f9d6592b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9d600d0a80 con 0x7f9d600b9680 2024-09-10T23:17:35.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.311+0000 7f9d5f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d6015e900 0x7f9d6015ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:35.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.311+0000 7f9d5f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d6015e900 0x7f9d6015ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37170/0 (socket says 172.21.15.90:37170) 2024-09-10T23:17:35.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.311+0000 7f9d5f7fe640 1 -- 172.21.15.90:0/2978288701 learned_addr learned my addr 172.21.15.90:0/2978288701 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:35.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.312+0000 7f9d5e7fc640 1 --2- 172.21.15.90:0/2978288701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d600b9680 0x7f9d600b8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:35.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.312+0000 7f9d5f7fe640 1 -- 172.21.15.90:0/2978288701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d600b9680 msgr2=0x7f9d600b8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:35.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.312+0000 7f9d5f7fe640 1 --2- 172.21.15.90:0/2978288701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d600b9680 0x7f9d600b8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:35.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.312+0000 7f9d5f7fe640 1 -- 172.21.15.90:0/2978288701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d4c004d40 msgr2=0x7f9d601f8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:35.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.312+0000 7f9d5effd640 1 --2- 172.21.15.90:0/2978288701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d4c004d40 0x7f9d601f8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:35.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.312+0000 7f9d5f7fe640 1 --2- 172.21.15.90:0/2978288701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d4c004d40 0x7f9d601f8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:35.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.312+0000 7f9d5f7fe640 1 -- 172.21.15.90:0/2978288701 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d601f4ca0 con 0x7f9d6015e900 2024-09-10T23:17:35.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.312+0000 7f9d5effd640 1 --2- 172.21.15.90:0/2978288701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d4c004d40 0x7f9d601f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:35.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.312+0000 7f9d5f7fe640 1 --2- 172.21.15.90:0/2978288701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d6015e900 0x7f9d6015ed80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9d5802b130 tx=0x7f9d58006650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:35.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.312+0000 7f9d57fff640 1 -- 172.21.15.90:0/2978288701 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58031050 con 0x7f9d6015e900 2024-09-10T23:17:35.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.312+0000 7f9d6592b640 1 -- 172.21.15.90:0/2978288701 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d601f4f80 con 0x7f9d6015e900 2024-09-10T23:17:35.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.312+0000 7f9d57fff640 1 -- 172.21.15.90:0/2978288701 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d5802c6a0 con 0x7f9d6015e900 2024-09-10T23:17:35.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.312+0000 7f9d57fff640 1 -- 172.21.15.90:0/2978288701 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58006c50 con 0x7f9d6015e900 2024-09-10T23:17:35.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.312+0000 7f9d6592b640 1 -- 172.21.15.90:0/2978288701 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d601f5540 con 0x7f9d6015e900 2024-09-10T23:17:35.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.313+0000 7f9d6592b640 1 -- 172.21.15.90:0/2978288701 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d601f5740 con 0x7f9d6015e900 2024-09-10T23:17:35.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.314+0000 7f9d57fff640 1 -- 172.21.15.90:0/2978288701 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9d5802caf0 con 0x7f9d6015e900 2024-09-10T23:17:35.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.314+0000 7f9d57fff640 1 --2- 172.21.15.90:0/2978288701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9d40077f70 0x7f9d4007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:35.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.314+0000 7f9d57fff640 1 -- 172.21.15.90:0/2978288701 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f9d580b9d80 con 0x7f9d6015e900 2024-09-10T23:17:35.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.314+0000 7f9d5effd640 1 --2- 172.21.15.90:0/2978288701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9d40077f70 0x7f9d4007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:35.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.315+0000 7f9d5effd640 1 --2- 172.21.15.90:0/2978288701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9d40077f70 0x7f9d4007a430 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9d50005fd0 tx=0x7f9d50009500 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:35.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.318+0000 7f9d57fff640 1 -- 172.21.15.90:0/2978288701 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9d601f5740 con 0x7f9d6015e900 2024-09-10T23:17:35.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.490+0000 7f9d6592b640 1 -- 172.21.15.90:0/2978288701 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9d6015e6f0 con 0x7f9d40077f70 2024-09-10T23:17:35.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.495+0000 7f9d57fff640 1 -- 172.21.15.90:0/2978288701 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252051 (secure 0 0 0) 0x7f9d6015e6f0 con 0x7f9d40077f70 2024-09-10T23:17:35.499 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:35.500 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:17:35.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.498+0000 7f9d6592b640 1 -- 172.21.15.90:0/2978288701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9d40077f70 msgr2=0x7f9d4007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:35.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.498+0000 7f9d6592b640 1 --2- 172.21.15.90:0/2978288701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9d40077f70 0x7f9d4007a430 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9d50005fd0 tx=0x7f9d50009500 comp rx=0 tx=0).stop 2024-09-10T23:17:35.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.498+0000 7f9d6592b640 1 -- 172.21.15.90:0/2978288701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d6015e900 msgr2=0x7f9d6015ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:35.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.498+0000 7f9d6592b640 1 --2- 172.21.15.90:0/2978288701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d6015e900 0x7f9d6015ed80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9d5802b130 tx=0x7f9d58006650 comp rx=0 tx=0).stop 2024-09-10T23:17:35.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.499+0000 7f9d6592b640 1 -- 172.21.15.90:0/2978288701 shutdown_connections 2024-09-10T23:17:35.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.499+0000 7f9d6592b640 1 --2- 172.21.15.90:0/2978288701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9d40077f70 0x7f9d4007a430 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:35.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.499+0000 7f9d6592b640 1 --2- 172.21.15.90:0/2978288701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d6015e900 0x7f9d6015ed80 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:35.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.499+0000 7f9d6592b640 1 --2- 172.21.15.90:0/2978288701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d600b9680 0x7f9d600b8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:35.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.499+0000 7f9d6592b640 1 --2- 172.21.15.90:0/2978288701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d4c004d40 0x7f9d601f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:35.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.499+0000 7f9d6592b640 1 -- 172.21.15.90:0/2978288701 >> 172.21.15.90:0/2978288701 conn(0x7f9d600d4090 msgr2=0x7f9d600b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:35.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.499+0000 7f9d6592b640 1 -- 172.21.15.90:0/2978288701 shutdown_connections 2024-09-10T23:17:35.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.499+0000 7f9d6592b640 1 -- 172.21.15.90:0/2978288701 wait complete. 2024-09-10T23:17:35.511 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-09-10T23:17:34.477013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246012,"kb_used_data":8936,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754728708,"statfs":{"total":773094113280,"available":772842196992,"internally_reserved":0,"allocated":9150464,"data_stored":4501812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.655151"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968053+0000","last_change":"2024-09-10T23:17:27.850688+0000","last_active":"2024-09-10T23:17:28.968053+0000","last_peered":"2024-09-10T23:17:28.968053+0000","last_clean":"2024-09-10T23:17:28.968053+0000","last_became_active":"2024-09-10T23:17:27.850258+0000","last_became_peered":"2024-09-10T23:17:27.850258+0000","last_unstale":"2024-09-10T23:17:28.968053+0000","last_undegraded":"2024-09-10T23:17:28.968053+0000","last_fullsized":"2024-09-10T23:17:28.968053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:39.971392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.847115+0000","last_change":"2024-09-10T23:17:27.855286+0000","last_active":"2024-09-10T23:17:28.847115+0000","last_peered":"2024-09-10T23:17:28.847115+0000","last_clean":"2024-09-10T23:17:28.847115+0000","last_became_active":"2024-09-10T23:17:27.852806+0000","last_became_peered":"2024-09-10T23:17:27.852806+0000","last_unstale":"2024-09-10T23:17:28.847115+0000","last_undegraded":"2024-09-10T23:17:28.847115+0000","last_fullsized":"2024-09-10T23:17:28.847115+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:55.518642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967789+0000","last_change":"2024-09-10T23:17:27.849851+0000","last_active":"2024-09-10T23:17:28.967789+0000","last_peered":"2024-09-10T23:17:28.967789+0000","last_clean":"2024-09-10T23:17:28.967789+0000","last_became_active":"2024-09-10T23:17:27.849545+0000","last_became_peered":"2024-09-10T23:17:27.849545+0000","last_unstale":"2024-09-10T23:17:28.967789+0000","last_undegraded":"2024-09-10T23:17:28.967789+0000","last_fullsized":"2024-09-10T23:17:28.967789+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:23.052984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968063+0000","last_change":"2024-09-10T23:17:27.843586+0000","last_active":"2024-09-10T23:17:28.968063+0000","last_peered":"2024-09-10T23:17:28.968063+0000","last_clean":"2024-09-10T23:17:28.968063+0000","last_became_active":"2024-09-10T23:17:27.843312+0000","last_became_peered":"2024-09-10T23:17:27.843312+0000","last_unstale":"2024-09-10T23:17:28.968063+0000","last_undegraded":"2024-09-10T23:17:28.968063+0000","last_fullsized":"2024-09-10T23:17:28.968063+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:43.755611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.849315+0000","last_change":"2024-09-10T23:17:27.837529+0000","last_active":"2024-09-10T23:17:28.849315+0000","last_peered":"2024-09-10T23:17:28.849315+0000","last_clean":"2024-09-10T23:17:28.849315+0000","last_became_active":"2024-09-10T23:17:27.835787+0000","last_became_peered":"2024-09-10T23:17:27.835787+0000","last_unstale":"2024-09-10T23:17:28.849315+0000","last_undegraded":"2024-09-10T23:17:28.849315+0000","last_fullsized":"2024-09-10T23:17:28.849315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:54.666905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.848389+0000","last_change":"2024-09-10T23:17:27.852311+0000","last_active":"2024-09-10T23:17:28.848389+0000","last_peered":"2024-09-10T23:17:28.848389+0000","last_clean":"2024-09-10T23:17:28.848389+0000","last_became_active":"2024-09-10T23:17:27.852013+0000","last_became_peered":"2024-09-10T23:17:27.852013+0000","last_unstale":"2024-09-10T23:17:28.848389+0000","last_undegraded":"2024-09-10T23:17:28.848389+0000","last_fullsized":"2024-09-10T23:17:28.848389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:39.971392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968378+0000","last_change":"2024-09-10T23:17:27.843652+0000","last_active":"2024-09-10T23:17:28.968378+0000","last_peered":"2024-09-10T23:17:28.968378+0000","last_clean":"2024-09-10T23:17:28.968378+0000","last_became_active":"2024-09-10T23:17:27.843401+0000","last_became_peered":"2024-09-10T23:17:27.843401+0000","last_unstale":"2024-09-10T23:17:28.968378+0000","last_undegraded":"2024-09-10T23:17:28.968378+0000","last_fullsized":"2024-09-10T23:17:28.968378+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:41.636632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.848127+0000","last_change":"2024-09-10T23:17:27.834384+0000","last_active":"2024-09-10T23:17:28.848127+0000","last_peered":"2024-09-10T23:17:28.848127+0000","last_clean":"2024-09-10T23:17:28.848127+0000","last_became_active":"2024-09-10T23:17:27.834090+0000","last_became_peered":"2024-09-10T23:17:27.834090+0000","last_unstale":"2024-09-10T23:17:28.848127+0000","last_undegraded":"2024-09-10T23:17:28.848127+0000","last_fullsized":"2024-09-10T23:17:28.848127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:59.960398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.848541+0000","last_change":"2024-09-10T23:17:27.838176+0000","last_active":"2024-09-10T23:17:28.848541+0000","last_peered":"2024-09-10T23:17:28.848541+0000","last_clean":"2024-09-10T23:17:28.848541+0000","last_became_active":"2024-09-10T23:17:27.837860+0000","last_became_peered":"2024-09-10T23:17:27.837860+0000","last_unstale":"2024-09-10T23:17:28.848541+0000","last_undegraded":"2024-09-10T23:17:28.848541+0000","last_fullsized":"2024-09-10T23:17:28.848541+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:39.641058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968934+0000","last_change":"2024-09-10T23:17:27.847427+0000","last_active":"2024-09-10T23:17:28.968934+0000","last_peered":"2024-09-10T23:17:28.968934+0000","last_clean":"2024-09-10T23:17:28.968934+0000","last_became_active":"2024-09-10T23:17:27.847120+0000","last_became_peered":"2024-09-10T23:17:27.847120+0000","last_unstale":"2024-09-10T23:17:28.968934+0000","last_undegraded":"2024-09-10T23:17:28.968934+0000","last_fullsized":"2024-09-10T23:17:28.968934+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:04.750628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.847027+0000","last_change":"2024-09-10T23:17:27.842158+0000","last_active":"2024-09-10T23:17:28.847027+0000","last_peered":"2024-09-10T23:17:28.847027+0000","last_clean":"2024-09-10T23:17:28.847027+0000","last_became_active":"2024-09-10T23:17:27.841893+0000","last_became_peered":"2024-09-10T23:17:27.841893+0000","last_unstale":"2024-09-10T23:17:28.847027+0000","last_undegraded":"2024-09-10T23:17:28.847027+0000","last_fullsized":"2024-09-10T23:17:28.847027+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:38.543908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968536+0000","last_change":"2024-09-10T23:17:27.851317+0000","last_active":"2024-09-10T23:17:28.968536+0000","last_peered":"2024-09-10T23:17:28.968536+0000","last_clean":"2024-09-10T23:17:28.968536+0000","last_became_active":"2024-09-10T23:17:27.851049+0000","last_became_peered":"2024-09-10T23:17:27.851049+0000","last_unstale":"2024-09-10T23:17:28.968536+0000","last_undegraded":"2024-09-10T23:17:28.968536+0000","last_fullsized":"2024-09-10T23:17:28.968536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:08.993342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967680+0000","last_change":"2024-09-10T23:17:27.844711+0000","last_active":"2024-09-10T23:17:28.967680+0000","last_peered":"2024-09-10T23:17:28.967680+0000","last_clean":"2024-09-10T23:17:28.967680+0000","last_became_active":"2024-09-10T23:17:27.844435+0000","last_became_peered":"2024-09-10T23:17:27.844435+0000","last_unstale":"2024-09-10T23:17:28.967680+0000","last_undegraded":"2024-09-10T23:17:28.967680+0000","last_fullsized":"2024-09-10T23:17:28.967680+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:43.547414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968610+0000","last_change":"2024-09-10T23:17:27.851055+0000","last_active":"2024-09-10T23:17:28.968610+0000","last_peered":"2024-09-10T23:17:28.968610+0000","last_clean":"2024-09-10T23:17:28.968610+0000","last_became_active":"2024-09-10T23:17:27.850773+0000","last_became_peered":"2024-09-10T23:17:27.850773+0000","last_unstale":"2024-09-10T23:17:28.968610+0000","last_undegraded":"2024-09-10T23:17:28.968610+0000","last_fullsized":"2024-09-10T23:17:28.968610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:04.642875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967510+0000","last_change":"2024-09-10T23:17:27.840978+0000","last_active":"2024-09-10T23:17:28.967510+0000","last_peered":"2024-09-10T23:17:28.967510+0000","last_clean":"2024-09-10T23:17:28.967510+0000","last_became_active":"2024-09-10T23:17:27.840322+0000","last_became_peered":"2024-09-10T23:17:27.840322+0000","last_unstale":"2024-09-10T23:17:28.967510+0000","last_undegraded":"2024-09-10T23:17:28.967510+0000","last_fullsized":"2024-09-10T23:17:28.967510+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:55.873212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.848989+0000","last_change":"2024-09-10T23:17:27.850978+0000","last_active":"2024-09-10T23:17:28.848989+0000","last_peered":"2024-09-10T23:17:28.848989+0000","last_clean":"2024-09-10T23:17:28.848989+0000","last_became_active":"2024-09-10T23:17:27.850603+0000","last_became_peered":"2024-09-10T23:17:27.850603+0000","last_unstale":"2024-09-10T23:17:28.848989+0000","last_undegraded":"2024-09-10T23:17:28.848989+0000","last_fullsized":"2024-09-10T23:17:28.848989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:54.393140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.848357+0000","last_change":"2024-09-10T23:17:27.852627+0000","last_active":"2024-09-10T23:17:28.848357+0000","last_peered":"2024-09-10T23:17:28.848357+0000","last_clean":"2024-09-10T23:17:28.848357+0000","last_became_active":"2024-09-10T23:17:27.852358+0000","last_became_peered":"2024-09-10T23:17:27.852358+0000","last_unstale":"2024-09-10T23:17:28.848357+0000","last_undegraded":"2024-09-10T23:17:28.848357+0000","last_fullsized":"2024-09-10T23:17:28.848357+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:18.690020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967520+0000","last_change":"2024-09-10T23:17:27.851634+0000","last_active":"2024-09-10T23:17:28.967520+0000","last_peered":"2024-09-10T23:17:28.967520+0000","last_clean":"2024-09-10T23:17:28.967520+0000","last_became_active":"2024-09-10T23:17:27.851389+0000","last_became_peered":"2024-09-10T23:17:27.851389+0000","last_unstale":"2024-09-10T23:17:28.967520+0000","last_undegraded":"2024-09-10T23:17:28.967520+0000","last_fullsized":"2024-09-10T23:17:28.967520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:59.478914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967922+0000","last_change":"2024-09-10T23:17:27.850363+0000","last_active":"2024-09-10T23:17:28.967922+0000","last_peered":"2024-09-10T23:17:28.967922+0000","last_clean":"2024-09-10T23:17:28.967922+0000","last_became_active":"2024-09-10T23:17:27.850063+0000","last_became_peered":"2024-09-10T23:17:27.850063+0000","last_unstale":"2024-09-10T23:17:28.967922+0000","last_undegraded":"2024-09-10T23:17:28.967922+0000","last_fullsized":"2024-09-10T23:17:28.967922+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:04.906922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968155+0000","last_change":"2024-09-10T23:17:27.848410+0000","last_active":"2024-09-10T23:17:28.968155+0000","last_peered":"2024-09-10T23:17:28.968155+0000","last_clean":"2024-09-10T23:17:28.968155+0000","last_became_active":"2024-09-10T23:17:27.847679+0000","last_became_peered":"2024-09-10T23:17:27.847679+0000","last_unstale":"2024-09-10T23:17:28.968155+0000","last_undegraded":"2024-09-10T23:17:28.968155+0000","last_fullsized":"2024-09-10T23:17:28.968155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:17.220990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967879+0000","last_change":"2024-09-10T23:17:27.846090+0000","last_active":"2024-09-10T23:17:28.967879+0000","last_peered":"2024-09-10T23:17:28.967879+0000","last_clean":"2024-09-10T23:17:28.967879+0000","last_became_active":"2024-09-10T23:17:27.845790+0000","last_became_peered":"2024-09-10T23:17:27.845790+0000","last_unstale":"2024-09-10T23:17:28.967879+0000","last_undegraded":"2024-09-10T23:17:28.967879+0000","last_fullsized":"2024-09-10T23:17:28.967879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:14.171598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.846678+0000","last_change":"2024-09-10T23:17:27.838874+0000","last_active":"2024-09-10T23:17:28.846678+0000","last_peered":"2024-09-10T23:17:28.846678+0000","last_clean":"2024-09-10T23:17:28.846678+0000","last_became_active":"2024-09-10T23:17:27.838214+0000","last_became_peered":"2024-09-10T23:17:27.838214+0000","last_unstale":"2024-09-10T23:17:28.846678+0000","last_undegraded":"2024-09-10T23:17:28.846678+0000","last_fullsized":"2024-09-10T23:17:28.846678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:19:43.616891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968323+0000","last_change":"2024-09-10T23:17:27.849938+0000","last_active":"2024-09-10T23:17:28.968323+0000","last_peered":"2024-09-10T23:17:28.968323+0000","last_clean":"2024-09-10T23:17:28.968323+0000","last_became_active":"2024-09-10T23:17:27.849200+0000","last_became_peered":"2024-09-10T23:17:27.849200+0000","last_unstale":"2024-09-10T23:17:28.968323+0000","last_undegraded":"2024-09-10T23:17:28.968323+0000","last_fullsized":"2024-09-10T23:17:28.968323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:39.641058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967625+0000","last_change":"2024-09-10T23:17:27.845341+0000","last_active":"2024-09-10T23:17:28.967625+0000","last_peered":"2024-09-10T23:17:28.967625+0000","last_clean":"2024-09-10T23:17:28.967625+0000","last_became_active":"2024-09-10T23:17:27.844509+0000","last_became_peered":"2024-09-10T23:17:27.844509+0000","last_unstale":"2024-09-10T23:17:28.967625+0000","last_undegraded":"2024-09-10T23:17:28.967625+0000","last_fullsized":"2024-09-10T23:17:28.967625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:35.177476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.847057+0000","last_change":"2024-09-10T23:17:27.850297+0000","last_active":"2024-09-10T23:17:28.847057+0000","last_peered":"2024-09-10T23:17:28.847057+0000","last_clean":"2024-09-10T23:17:28.847057+0000","last_became_active":"2024-09-10T23:17:27.850010+0000","last_became_peered":"2024-09-10T23:17:27.850010+0000","last_unstale":"2024-09-10T23:17:28.847057+0000","last_undegraded":"2024-09-10T23:17:28.847057+0000","last_fullsized":"2024-09-10T23:17:28.847057+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:51.346509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968355+0000","last_change":"2024-09-10T23:17:27.847244+0000","last_active":"2024-09-10T23:17:28.968355+0000","last_peered":"2024-09-10T23:17:28.968355+0000","last_clean":"2024-09-10T23:17:28.968355+0000","last_became_active":"2024-09-10T23:17:27.846958+0000","last_became_peered":"2024-09-10T23:17:27.846958+0000","last_unstale":"2024-09-10T23:17:28.968355+0000","last_undegraded":"2024-09-10T23:17:28.968355+0000","last_fullsized":"2024-09-10T23:17:28.968355+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:37.121317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.848919+0000","last_change":"2024-09-10T23:17:27.835592+0000","last_active":"2024-09-10T23:17:28.848919+0000","last_peered":"2024-09-10T23:17:28.848919+0000","last_clean":"2024-09-10T23:17:28.848919+0000","last_became_active":"2024-09-10T23:17:27.835229+0000","last_became_peered":"2024-09-10T23:17:27.835229+0000","last_unstale":"2024-09-10T23:17:28.848919+0000","last_undegraded":"2024-09-10T23:17:28.848919+0000","last_fullsized":"2024-09-10T23:17:28.848919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:39.291870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968956+0000","last_change":"2024-09-10T23:17:27.851864+0000","last_active":"2024-09-10T23:17:28.968956+0000","last_peered":"2024-09-10T23:17:28.968956+0000","last_clean":"2024-09-10T23:17:28.968956+0000","last_became_active":"2024-09-10T23:17:27.850685+0000","last_became_peered":"2024-09-10T23:17:27.850685+0000","last_unstale":"2024-09-10T23:17:28.968956+0000","last_undegraded":"2024-09-10T23:17:28.968956+0000","last_fullsized":"2024-09-10T23:17:28.968956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:43.379615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.846676+0000","last_change":"2024-09-10T23:17:27.838469+0000","last_active":"2024-09-10T23:17:28.846676+0000","last_peered":"2024-09-10T23:17:28.846676+0000","last_clean":"2024-09-10T23:17:28.846676+0000","last_became_active":"2024-09-10T23:17:27.837937+0000","last_became_peered":"2024-09-10T23:17:27.837937+0000","last_unstale":"2024-09-10T23:17:28.846676+0000","last_undegraded":"2024-09-10T23:17:28.846676+0000","last_fullsized":"2024-09-10T23:17:28.846676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:40.435503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.846703+0000","last_change":"2024-09-10T23:17:27.853000+0000","last_active":"2024-09-10T23:17:28.846703+0000","last_peered":"2024-09-10T23:17:28.846703+0000","last_clean":"2024-09-10T23:17:28.846703+0000","last_became_active":"2024-09-10T23:17:27.852769+0000","last_became_peered":"2024-09-10T23:17:27.852769+0000","last_unstale":"2024-09-10T23:17:28.846703+0000","last_undegraded":"2024-09-10T23:17:28.846703+0000","last_fullsized":"2024-09-10T23:17:28.846703+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:29.280565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.848191+0000","last_change":"2024-09-10T23:17:27.837173+0000","last_active":"2024-09-10T23:17:28.848191+0000","last_peered":"2024-09-10T23:17:28.848191+0000","last_clean":"2024-09-10T23:17:28.848191+0000","last_became_active":"2024-09-10T23:17:27.836548+0000","last_became_peered":"2024-09-10T23:17:27.836548+0000","last_unstale":"2024-09-10T23:17:28.848191+0000","last_undegraded":"2024-09-10T23:17:28.848191+0000","last_fullsized":"2024-09-10T23:17:28.848191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:53.373004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967797+0000","last_change":"2024-09-10T23:17:27.847926+0000","last_active":"2024-09-10T23:17:28.967797+0000","last_peered":"2024-09-10T23:17:28.967797+0000","last_clean":"2024-09-10T23:17:28.967797+0000","last_became_active":"2024-09-10T23:17:27.847639+0000","last_became_peered":"2024-09-10T23:17:27.847639+0000","last_unstale":"2024-09-10T23:17:28.967797+0000","last_undegraded":"2024-09-10T23:17:28.967797+0000","last_fullsized":"2024-09-10T23:17:28.967797+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:59.960398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.849004+0000","last_change":"2024-09-10T23:17:27.851819+0000","last_active":"2024-09-10T23:17:28.849004+0000","last_peered":"2024-09-10T23:17:28.849004+0000","last_clean":"2024-09-10T23:17:28.849004+0000","last_became_active":"2024-09-10T23:17:27.851525+0000","last_became_peered":"2024-09-10T23:17:27.851525+0000","last_unstale":"2024-09-10T23:17:28.849004+0000","last_undegraded":"2024-09-10T23:17:28.849004+0000","last_fullsized":"2024-09-10T23:17:28.849004+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:04.750628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"80'4","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968583+0000","last_change":"2024-09-10T23:17:26.841929+0000","last_active":"2024-09-10T23:17:28.968583+0000","last_peered":"2024-09-10T23:17:28.968583+0000","last_clean":"2024-09-10T23:17:28.968583+0000","last_became_active":"2024-09-10T23:17:26.841613+0000","last_became_peered":"2024-09-10T23:17:26.841613+0000","last_unstale":"2024-09-10T23:17:28.968583+0000","last_undegraded":"2024-09-10T23:17:28.968583+0000","last_fullsized":"2024-09-10T23:17:28.968583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:46:00.551476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968232+0000","last_change":"2024-09-10T23:17:27.850413+0000","last_active":"2024-09-10T23:17:28.968232+0000","last_peered":"2024-09-10T23:17:28.968232+0000","last_clean":"2024-09-10T23:17:28.968232+0000","last_became_active":"2024-09-10T23:17:27.849953+0000","last_became_peered":"2024-09-10T23:17:27.849953+0000","last_unstale":"2024-09-10T23:17:28.968232+0000","last_undegraded":"2024-09-10T23:17:28.968232+0000","last_fullsized":"2024-09-10T23:17:28.968232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:18.625062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.849136+0000","last_change":"2024-09-10T23:17:26.831906+0000","last_active":"2024-09-10T23:17:28.849136+0000","last_peered":"2024-09-10T23:17:28.849136+0000","last_clean":"2024-09-10T23:17:28.849136+0000","last_became_active":"2024-09-10T23:17:26.831591+0000","last_became_peered":"2024-09-10T23:17:26.831591+0000","last_unstale":"2024-09-10T23:17:28.849136+0000","last_undegraded":"2024-09-10T23:17:28.849136+0000","last_fullsized":"2024-09-10T23:17:28.849136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:05.590027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968782+0000","last_change":"2024-09-10T23:17:27.849806+0000","last_active":"2024-09-10T23:17:28.968782+0000","last_peered":"2024-09-10T23:17:28.968782+0000","last_clean":"2024-09-10T23:17:28.968782+0000","last_became_active":"2024-09-10T23:17:27.849416+0000","last_became_peered":"2024-09-10T23:17:27.849416+0000","last_unstale":"2024-09-10T23:17:28.968782+0000","last_undegraded":"2024-09-10T23:17:28.968782+0000","last_fullsized":"2024-09-10T23:17:28.968782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:54.393140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968065+0000","last_change":"2024-09-10T23:17:26.839740+0000","last_active":"2024-09-10T23:17:28.968065+0000","last_peered":"2024-09-10T23:17:28.968065+0000","last_clean":"2024-09-10T23:17:28.968065+0000","last_became_active":"2024-09-10T23:17:26.839472+0000","last_became_peered":"2024-09-10T23:17:26.839472+0000","last_unstale":"2024-09-10T23:17:28.968065+0000","last_undegraded":"2024-09-10T23:17:28.968065+0000","last_fullsized":"2024-09-10T23:17:28.968065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:24.073627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967860+0000","last_change":"2024-09-10T23:17:27.850417+0000","last_active":"2024-09-10T23:17:28.967860+0000","last_peered":"2024-09-10T23:17:28.967860+0000","last_clean":"2024-09-10T23:17:28.967860+0000","last_became_active":"2024-09-10T23:17:27.850145+0000","last_became_peered":"2024-09-10T23:17:27.850145+0000","last_unstale":"2024-09-10T23:17:28.967860+0000","last_undegraded":"2024-09-10T23:17:28.967860+0000","last_fullsized":"2024-09-10T23:17:28.967860+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:29.314361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967793+0000","last_change":"2024-09-10T23:17:26.838774+0000","last_active":"2024-09-10T23:17:28.967793+0000","last_peered":"2024-09-10T23:17:28.967793+0000","last_clean":"2024-09-10T23:17:28.967793+0000","last_became_active":"2024-09-10T23:17:26.838524+0000","last_became_peered":"2024-09-10T23:17:26.838524+0000","last_unstale":"2024-09-10T23:17:28.967793+0000","last_undegraded":"2024-09-10T23:17:28.967793+0000","last_fullsized":"2024-09-10T23:17:28.967793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:21.687107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.846898+0000","last_change":"2024-09-10T23:17:27.852990+0000","last_active":"2024-09-10T23:17:28.846898+0000","last_peered":"2024-09-10T23:17:28.846898+0000","last_clean":"2024-09-10T23:17:28.846898+0000","last_became_active":"2024-09-10T23:17:27.852736+0000","last_became_peered":"2024-09-10T23:17:27.852736+0000","last_unstale":"2024-09-10T23:17:28.846898+0000","last_undegraded":"2024-09-10T23:17:28.846898+0000","last_fullsized":"2024-09-10T23:17:28.846898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:21.543438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.849480+0000","last_change":"2024-09-10T23:17:26.840626+0000","last_active":"2024-09-10T23:17:28.849480+0000","last_peered":"2024-09-10T23:17:28.849480+0000","last_clean":"2024-09-10T23:17:28.849480+0000","last_became_active":"2024-09-10T23:17:26.840402+0000","last_became_peered":"2024-09-10T23:17:26.840402+0000","last_unstale":"2024-09-10T23:17:28.849480+0000","last_undegraded":"2024-09-10T23:17:28.849480+0000","last_fullsized":"2024-09-10T23:17:28.849480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:41.423852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.849357+0000","last_change":"2024-09-10T23:17:27.852601+0000","last_active":"2024-09-10T23:17:28.849357+0000","last_peered":"2024-09-10T23:17:28.849357+0000","last_clean":"2024-09-10T23:17:28.849357+0000","last_became_active":"2024-09-10T23:17:27.852323+0000","last_became_peered":"2024-09-10T23:17:27.852323+0000","last_unstale":"2024-09-10T23:17:28.849357+0000","last_undegraded":"2024-09-10T23:17:28.849357+0000","last_fullsized":"2024-09-10T23:17:28.849357+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:21.617057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.848518+0000","last_change":"2024-09-10T23:17:26.832962+0000","last_active":"2024-09-10T23:17:28.848518+0000","last_peered":"2024-09-10T23:17:28.848518+0000","last_clean":"2024-09-10T23:17:28.848518+0000","last_became_active":"2024-09-10T23:17:26.832648+0000","last_became_peered":"2024-09-10T23:17:26.832648+0000","last_unstale":"2024-09-10T23:17:28.848518+0000","last_undegraded":"2024-09-10T23:17:28.848518+0000","last_fullsized":"2024-09-10T23:17:28.848518+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:36.779685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967528+0000","last_change":"2024-09-10T23:17:27.840862+0000","last_active":"2024-09-10T23:17:28.967528+0000","last_peered":"2024-09-10T23:17:28.967528+0000","last_clean":"2024-09-10T23:17:28.967528+0000","last_became_active":"2024-09-10T23:17:27.839911+0000","last_became_peered":"2024-09-10T23:17:27.839911+0000","last_unstale":"2024-09-10T23:17:28.967528+0000","last_undegraded":"2024-09-10T23:17:28.967528+0000","last_fullsized":"2024-09-10T23:17:28.967528+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:28.885437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967231+0000","last_change":"2024-09-10T23:17:26.832339+0000","last_active":"2024-09-10T23:17:28.967231+0000","last_peered":"2024-09-10T23:17:28.967231+0000","last_clean":"2024-09-10T23:17:28.967231+0000","last_became_active":"2024-09-10T23:17:26.832033+0000","last_became_peered":"2024-09-10T23:17:26.832033+0000","last_unstale":"2024-09-10T23:17:28.967231+0000","last_undegraded":"2024-09-10T23:17:28.967231+0000","last_fullsized":"2024-09-10T23:17:28.967231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:28.236154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967686+0000","last_change":"2024-09-10T23:17:27.840620+0000","last_active":"2024-09-10T23:17:28.967686+0000","last_peered":"2024-09-10T23:17:28.967686+0000","last_clean":"2024-09-10T23:17:28.967686+0000","last_became_active":"2024-09-10T23:17:27.839956+0000","last_became_peered":"2024-09-10T23:17:27.839956+0000","last_unstale":"2024-09-10T23:17:28.967686+0000","last_undegraded":"2024-09-10T23:17:28.967686+0000","last_fullsized":"2024-09-10T23:17:28.967686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:28.997184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.846534+0000","last_change":"2024-09-10T23:17:26.845819+0000","last_active":"2024-09-10T23:17:28.846534+0000","last_peered":"2024-09-10T23:17:28.846534+0000","last_clean":"2024-09-10T23:17:28.846534+0000","last_became_active":"2024-09-10T23:17:26.845548+0000","last_became_peered":"2024-09-10T23:17:26.845548+0000","last_unstale":"2024-09-10T23:17:28.846534+0000","last_undegraded":"2024-09-10T23:17:28.846534+0000","last_fullsized":"2024-09-10T23:17:28.846534+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:44.616749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968062+0000","last_change":"2024-09-10T23:17:27.842783+0000","last_active":"2024-09-10T23:17:28.968062+0000","last_peered":"2024-09-10T23:17:28.968062+0000","last_clean":"2024-09-10T23:17:28.968062+0000","last_became_active":"2024-09-10T23:17:27.842518+0000","last_became_peered":"2024-09-10T23:17:27.842518+0000","last_unstale":"2024-09-10T23:17:28.968062+0000","last_undegraded":"2024-09-10T23:17:28.968062+0000","last_fullsized":"2024-09-10T23:17:28.968062+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:08.529962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968644+0000","last_change":"2024-09-10T23:17:26.838287+0000","last_active":"2024-09-10T23:17:28.968644+0000","last_peered":"2024-09-10T23:17:28.968644+0000","last_clean":"2024-09-10T23:17:28.968644+0000","last_became_active":"2024-09-10T23:17:26.838009+0000","last_became_peered":"2024-09-10T23:17:26.838009+0000","last_unstale":"2024-09-10T23:17:28.968644+0000","last_undegraded":"2024-09-10T23:17:28.968644+0000","last_fullsized":"2024-09-10T23:17:28.968644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:50.335870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.848733+0000","last_change":"2024-09-10T23:17:27.844529+0000","last_active":"2024-09-10T23:17:28.848733+0000","last_peered":"2024-09-10T23:17:28.848733+0000","last_clean":"2024-09-10T23:17:28.848733+0000","last_became_active":"2024-09-10T23:17:27.843956+0000","last_became_peered":"2024-09-10T23:17:27.843956+0000","last_unstale":"2024-09-10T23:17:28.848733+0000","last_undegraded":"2024-09-10T23:17:28.848733+0000","last_fullsized":"2024-09-10T23:17:28.848733+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:08.993342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968238+0000","last_change":"2024-09-10T23:17:26.837738+0000","last_active":"2024-09-10T23:17:28.968238+0000","last_peered":"2024-09-10T23:17:28.968238+0000","last_clean":"2024-09-10T23:17:28.968238+0000","last_became_active":"2024-09-10T23:17:26.837440+0000","last_became_peered":"2024-09-10T23:17:26.837440+0000","last_unstale":"2024-09-10T23:17:28.968238+0000","last_undegraded":"2024-09-10T23:17:28.968238+0000","last_fullsized":"2024-09-10T23:17:28.968238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:37.533269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967718+0000","last_change":"2024-09-10T23:17:27.852673+0000","last_active":"2024-09-10T23:17:28.967718+0000","last_peered":"2024-09-10T23:17:28.967718+0000","last_clean":"2024-09-10T23:17:28.967718+0000","last_became_active":"2024-09-10T23:17:27.852430+0000","last_became_peered":"2024-09-10T23:17:27.852430+0000","last_unstale":"2024-09-10T23:17:28.967718+0000","last_undegraded":"2024-09-10T23:17:28.967718+0000","last_fullsized":"2024-09-10T23:17:28.967718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:58.280893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"80'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968042+0000","last_change":"2024-09-10T23:17:26.844434+0000","last_active":"2024-09-10T23:17:28.968042+0000","last_peered":"2024-09-10T23:17:28.968042+0000","last_clean":"2024-09-10T23:17:28.968042+0000","last_became_active":"2024-09-10T23:17:26.844214+0000","last_became_peered":"2024-09-10T23:17:26.844214+0000","last_unstale":"2024-09-10T23:17:28.968042+0000","last_undegraded":"2024-09-10T23:17:28.968042+0000","last_fullsized":"2024-09-10T23:17:28.968042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:28.269926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.849217+0000","last_change":"2024-09-10T23:17:27.845145+0000","last_active":"2024-09-10T23:17:28.849217+0000","last_peered":"2024-09-10T23:17:28.849217+0000","last_clean":"2024-09-10T23:17:28.849217+0000","last_became_active":"2024-09-10T23:17:27.844853+0000","last_became_peered":"2024-09-10T23:17:27.844853+0000","last_unstale":"2024-09-10T23:17:28.849217+0000","last_undegraded":"2024-09-10T23:17:28.849217+0000","last_fullsized":"2024-09-10T23:17:28.849217+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:27.115230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"80'6","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.848625+0000","last_change":"2024-09-10T23:17:26.835451+0000","last_active":"2024-09-10T23:17:28.848625+0000","last_peered":"2024-09-10T23:17:28.848625+0000","last_clean":"2024-09-10T23:17:28.848625+0000","last_became_active":"2024-09-10T23:17:26.835169+0000","last_became_peered":"2024-09-10T23:17:26.835169+0000","last_unstale":"2024-09-10T23:17:28.848625+0000","last_undegraded":"2024-09-10T23:17:28.848625+0000","last_fullsized":"2024-09-10T23:17:28.848625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:38.247577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967198+0000","last_change":"2024-09-10T23:17:27.843383+0000","last_active":"2024-09-10T23:17:28.967198+0000","last_peered":"2024-09-10T23:17:28.967198+0000","last_clean":"2024-09-10T23:17:28.967198+0000","last_became_active":"2024-09-10T23:17:27.843106+0000","last_became_peered":"2024-09-10T23:17:27.843106+0000","last_unstale":"2024-09-10T23:17:28.967198+0000","last_undegraded":"2024-09-10T23:17:28.967198+0000","last_fullsized":"2024-09-10T23:17:28.967198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:07.520834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.846863+0000","last_change":"2024-09-10T23:17:26.844499+0000","last_active":"2024-09-10T23:17:28.846863+0000","last_peered":"2024-09-10T23:17:28.846863+0000","last_clean":"2024-09-10T23:17:28.846863+0000","last_became_active":"2024-09-10T23:17:26.844224+0000","last_became_peered":"2024-09-10T23:17:26.844224+0000","last_unstale":"2024-09-10T23:17:28.846863+0000","last_undegraded":"2024-09-10T23:17:28.846863+0000","last_fullsized":"2024-09-10T23:17:28.846863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:16.210351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967713+0000","last_change":"2024-09-10T23:17:27.843168+0000","last_active":"2024-09-10T23:17:28.967713+0000","last_peered":"2024-09-10T23:17:28.967713+0000","last_clean":"2024-09-10T23:17:28.967713+0000","last_became_active":"2024-09-10T23:17:27.842854+0000","last_became_peered":"2024-09-10T23:17:27.842854+0000","last_unstale":"2024-09-10T23:17:28.967713+0000","last_undegraded":"2024-09-10T23:17:28.967713+0000","last_fullsized":"2024-09-10T23:17:28.967713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:22.443696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968494+0000","last_change":"2024-09-10T23:17:26.840432+0000","last_active":"2024-09-10T23:17:28.968494+0000","last_peered":"2024-09-10T23:17:28.968494+0000","last_clean":"2024-09-10T23:17:28.968494+0000","last_became_active":"2024-09-10T23:17:26.840134+0000","last_became_peered":"2024-09-10T23:17:26.840134+0000","last_unstale":"2024-09-10T23:17:28.968494+0000","last_undegraded":"2024-09-10T23:17:28.968494+0000","last_fullsized":"2024-09-10T23:17:28.968494+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:42.536775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.846604+0000","last_change":"2024-09-10T23:17:27.852658+0000","last_active":"2024-09-10T23:17:28.846604+0000","last_peered":"2024-09-10T23:17:28.846604+0000","last_clean":"2024-09-10T23:17:28.846604+0000","last_became_active":"2024-09-10T23:17:27.852384+0000","last_became_peered":"2024-09-10T23:17:27.852384+0000","last_unstale":"2024-09-10T23:17:28.846604+0000","last_undegraded":"2024-09-10T23:17:28.846604+0000","last_fullsized":"2024-09-10T23:17:28.846604+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:46.829148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.848318+0000","last_change":"2024-09-10T23:17:26.831199+0000","last_active":"2024-09-10T23:17:28.848318+0000","last_peered":"2024-09-10T23:17:28.848318+0000","last_clean":"2024-09-10T23:17:28.848318+0000","last_became_active":"2024-09-10T23:17:26.830906+0000","last_became_peered":"2024-09-10T23:17:26.830906+0000","last_unstale":"2024-09-10T23:17:28.848318+0000","last_undegraded":"2024-09-10T23:17:28.848318+0000","last_fullsized":"2024-09-10T23:17:28.848318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:25.592140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.846674+0000","last_change":"2024-09-10T23:17:27.854272+0000","last_active":"2024-09-10T23:17:28.846674+0000","last_peered":"2024-09-10T23:17:28.846674+0000","last_clean":"2024-09-10T23:17:28.846674+0000","last_became_active":"2024-09-10T23:17:27.854014+0000","last_became_peered":"2024-09-10T23:17:27.854014+0000","last_unstale":"2024-09-10T23:17:28.846674+0000","last_undegraded":"2024-09-10T23:17:28.846674+0000","last_fullsized":"2024-09-10T23:17:28.846674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:19:05.642383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"80'8","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968276+0000","last_change":"2024-09-10T23:17:26.840049+0000","last_active":"2024-09-10T23:17:28.968276+0000","last_peered":"2024-09-10T23:17:28.968276+0000","last_clean":"2024-09-10T23:17:28.968276+0000","last_became_active":"2024-09-10T23:17:26.839235+0000","last_became_peered":"2024-09-10T23:17:26.839235+0000","last_unstale":"2024-09-10T23:17:28.968276+0000","last_undegraded":"2024-09-10T23:17:28.968276+0000","last_fullsized":"2024-09-10T23:17:28.968276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:33.133739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968485+0000","last_change":"2024-09-10T23:17:27.839774+0000","last_active":"2024-09-10T23:17:28.968485+0000","last_peered":"2024-09-10T23:17:28.968485+0000","last_clean":"2024-09-10T23:17:28.968485+0000","last_became_active":"2024-09-10T23:17:27.839437+0000","last_became_peered":"2024-09-10T23:17:27.839437+0000","last_unstale":"2024-09-10T23:17:28.968485+0000","last_undegraded":"2024-09-10T23:17:28.968485+0000","last_fullsized":"2024-09-10T23:17:28.968485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:38.052381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968728+0000","last_change":"2024-09-10T23:17:26.837464+0000","last_active":"2024-09-10T23:17:28.968728+0000","last_peered":"2024-09-10T23:17:28.968728+0000","last_clean":"2024-09-10T23:17:28.968728+0000","last_became_active":"2024-09-10T23:17:26.837212+0000","last_became_peered":"2024-09-10T23:17:26.837212+0000","last_unstale":"2024-09-10T23:17:28.968728+0000","last_undegraded":"2024-09-10T23:17:28.968728+0000","last_fullsized":"2024-09-10T23:17:28.968728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:32.841367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968471+0000","last_change":"2024-09-10T23:17:27.850780+0000","last_active":"2024-09-10T23:17:28.968471+0000","last_peered":"2024-09-10T23:17:28.968471+0000","last_clean":"2024-09-10T23:17:28.968471+0000","last_became_active":"2024-09-10T23:17:27.850085+0000","last_became_peered":"2024-09-10T23:17:27.850085+0000","last_unstale":"2024-09-10T23:17:28.968471+0000","last_undegraded":"2024-09-10T23:17:28.968471+0000","last_fullsized":"2024-09-10T23:17:28.968471+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:39.618340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967268+0000","last_change":"2024-09-10T23:17:26.838810+0000","last_active":"2024-09-10T23:17:28.967268+0000","last_peered":"2024-09-10T23:17:28.967268+0000","last_clean":"2024-09-10T23:17:28.967268+0000","last_became_active":"2024-09-10T23:17:26.838541+0000","last_became_peered":"2024-09-10T23:17:26.838541+0000","last_unstale":"2024-09-10T23:17:28.967268+0000","last_undegraded":"2024-09-10T23:17:28.967268+0000","last_fullsized":"2024-09-10T23:17:28.967268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:48.297843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.849365+0000","last_change":"2024-09-10T23:17:27.835416+0000","last_active":"2024-09-10T23:17:28.849365+0000","last_peered":"2024-09-10T23:17:28.849365+0000","last_clean":"2024-09-10T23:17:28.849365+0000","last_became_active":"2024-09-10T23:17:27.835021+0000","last_became_peered":"2024-09-10T23:17:27.835021+0000","last_unstale":"2024-09-10T23:17:28.849365+0000","last_undegraded":"2024-09-10T23:17:28.849365+0000","last_fullsized":"2024-09-10T23:17:28.849365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:59.604865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967841+0000","last_change":"2024-09-10T23:17:26.839387+0000","last_active":"2024-09-10T23:17:28.967841+0000","last_peered":"2024-09-10T23:17:28.967841+0000","last_clean":"2024-09-10T23:17:28.967841+0000","last_became_active":"2024-09-10T23:17:26.839150+0000","last_became_peered":"2024-09-10T23:17:26.839150+0000","last_unstale":"2024-09-10T23:17:28.967841+0000","last_undegraded":"2024-09-10T23:17:28.967841+0000","last_fullsized":"2024-09-10T23:17:28.967841+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:54.734740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968769+0000","last_change":"2024-09-10T23:17:27.849046+0000","last_active":"2024-09-10T23:17:28.968769+0000","last_peered":"2024-09-10T23:17:28.968769+0000","last_clean":"2024-09-10T23:17:28.968769+0000","last_became_active":"2024-09-10T23:17:27.846119+0000","last_became_peered":"2024-09-10T23:17:27.846119+0000","last_unstale":"2024-09-10T23:17:28.968769+0000","last_undegraded":"2024-09-10T23:17:28.968769+0000","last_fullsized":"2024-09-10T23:17:28.968769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:06.567950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968490+0000","last_change":"2024-09-10T23:17:26.837155+0000","last_active":"2024-09-10T23:17:28.968490+0000","last_peered":"2024-09-10T23:17:28.968490+0000","last_clean":"2024-09-10T23:17:28.968490+0000","last_became_active":"2024-09-10T23:17:26.836867+0000","last_became_peered":"2024-09-10T23:17:26.836867+0000","last_unstale":"2024-09-10T23:17:28.968490+0000","last_undegraded":"2024-09-10T23:17:28.968490+0000","last_fullsized":"2024-09-10T23:17:28.968490+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:27.874798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.848317+0000","last_change":"2024-09-10T23:17:27.836791+0000","last_active":"2024-09-10T23:17:28.848317+0000","last_peered":"2024-09-10T23:17:28.848317+0000","last_clean":"2024-09-10T23:17:28.848317+0000","last_became_active":"2024-09-10T23:17:27.836311+0000","last_became_peered":"2024-09-10T23:17:27.836311+0000","last_unstale":"2024-09-10T23:17:28.848317+0000","last_undegraded":"2024-09-10T23:17:28.848317+0000","last_fullsized":"2024-09-10T23:17:28.848317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:28.664887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968709+0000","last_change":"2024-09-10T23:17:26.843211+0000","last_active":"2024-09-10T23:17:28.968709+0000","last_peered":"2024-09-10T23:17:28.968709+0000","last_clean":"2024-09-10T23:17:28.968709+0000","last_became_active":"2024-09-10T23:17:26.842974+0000","last_became_peered":"2024-09-10T23:17:26.842974+0000","last_unstale":"2024-09-10T23:17:28.968709+0000","last_undegraded":"2024-09-10T23:17:28.968709+0000","last_fullsized":"2024-09-10T23:17:28.968709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:45.994523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967713+0000","last_change":"2024-09-10T23:17:27.844997+0000","last_active":"2024-09-10T23:17:28.967713+0000","last_peered":"2024-09-10T23:17:28.967713+0000","last_clean":"2024-09-10T23:17:28.967713+0000","last_became_active":"2024-09-10T23:17:27.844214+0000","last_became_peered":"2024-09-10T23:17:27.844214+0000","last_unstale":"2024-09-10T23:17:28.967713+0000","last_undegraded":"2024-09-10T23:17:28.967713+0000","last_fullsized":"2024-09-10T23:17:28.967713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:38.825957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968279+0000","last_change":"2024-09-10T23:17:26.838196+0000","last_active":"2024-09-10T23:17:28.968279+0000","last_peered":"2024-09-10T23:17:28.968279+0000","last_clean":"2024-09-10T23:17:28.968279+0000","last_became_active":"2024-09-10T23:17:26.837932+0000","last_became_peered":"2024-09-10T23:17:26.837932+0000","last_unstale":"2024-09-10T23:17:28.968279+0000","last_undegraded":"2024-09-10T23:17:28.968279+0000","last_fullsized":"2024-09-10T23:17:28.968279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:01.492799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.848913+0000","last_change":"2024-09-10T23:17:27.838432+0000","last_active":"2024-09-10T23:17:28.848913+0000","last_peered":"2024-09-10T23:17:28.848913+0000","last_clean":"2024-09-10T23:17:28.848913+0000","last_became_active":"2024-09-10T23:17:27.837933+0000","last_became_peered":"2024-09-10T23:17:27.837933+0000","last_unstale":"2024-09-10T23:17:28.848913+0000","last_undegraded":"2024-09-10T23:17:28.848913+0000","last_fullsized":"2024-09-10T23:17:28.848913+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:58.476533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967296+0000","last_change":"2024-09-10T23:17:26.832060+0000","last_active":"2024-09-10T23:17:28.967296+0000","last_peered":"2024-09-10T23:17:28.967296+0000","last_clean":"2024-09-10T23:17:28.967296+0000","last_became_active":"2024-09-10T23:17:26.831333+0000","last_became_peered":"2024-09-10T23:17:26.831333+0000","last_unstale":"2024-09-10T23:17:28.967296+0000","last_undegraded":"2024-09-10T23:17:28.967296+0000","last_fullsized":"2024-09-10T23:17:28.967296+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:59.414739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.848978+0000","last_change":"2024-09-10T23:17:27.838042+0000","last_active":"2024-09-10T23:17:28.848978+0000","last_peered":"2024-09-10T23:17:28.848978+0000","last_clean":"2024-09-10T23:17:28.848978+0000","last_became_active":"2024-09-10T23:17:27.837742+0000","last_became_peered":"2024-09-10T23:17:27.837742+0000","last_unstale":"2024-09-10T23:17:28.848978+0000","last_undegraded":"2024-09-10T23:17:28.848978+0000","last_fullsized":"2024-09-10T23:17:28.848978+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:08.781948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.847012+0000","last_change":"2024-09-10T23:17:26.842663+0000","last_active":"2024-09-10T23:17:28.847012+0000","last_peered":"2024-09-10T23:17:28.847012+0000","last_clean":"2024-09-10T23:17:28.847012+0000","last_became_active":"2024-09-10T23:17:26.842418+0000","last_became_peered":"2024-09-10T23:17:26.842418+0000","last_unstale":"2024-09-10T23:17:28.847012+0000","last_undegraded":"2024-09-10T23:17:28.847012+0000","last_fullsized":"2024-09-10T23:17:28.847012+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:03.632236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968473+0000","last_change":"2024-09-10T23:17:27.853306+0000","last_active":"2024-09-10T23:17:28.968473+0000","last_peered":"2024-09-10T23:17:28.968473+0000","last_clean":"2024-09-10T23:17:28.968473+0000","last_became_active":"2024-09-10T23:17:27.852899+0000","last_became_peered":"2024-09-10T23:17:27.852899+0000","last_unstale":"2024-09-10T23:17:28.968473+0000","last_undegraded":"2024-09-10T23:17:28.968473+0000","last_fullsized":"2024-09-10T23:17:28.968473+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:56.052244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"81'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:29.826633+0000","last_change":"2024-09-10T23:17:26.844486+0000","last_active":"2024-09-10T23:17:29.826633+0000","last_peered":"2024-09-10T23:17:29.826633+0000","last_clean":"2024-09-10T23:17:29.826633+0000","last_became_active":"2024-09-10T23:17:26.844212+0000","last_became_peered":"2024-09-10T23:17:26.844212+0000","last_unstale":"2024-09-10T23:17:29.826633+0000","last_undegraded":"2024-09-10T23:17:29.826633+0000","last_fullsized":"2024-09-10T23:17:29.826633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:40.625994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968979+0000","last_change":"2024-09-10T23:17:27.854804+0000","last_active":"2024-09-10T23:17:28.968979+0000","last_peered":"2024-09-10T23:17:28.968979+0000","last_clean":"2024-09-10T23:17:28.968979+0000","last_became_active":"2024-09-10T23:17:27.854494+0000","last_became_peered":"2024-09-10T23:17:27.854494+0000","last_unstale":"2024-09-10T23:17:28.968979+0000","last_undegraded":"2024-09-10T23:17:28.968979+0000","last_fullsized":"2024-09-10T23:17:28.968979+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:31.576854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968196+0000","last_change":"2024-09-10T23:17:26.835224+0000","last_active":"2024-09-10T23:17:28.968196+0000","last_peered":"2024-09-10T23:17:28.968196+0000","last_clean":"2024-09-10T23:17:28.968196+0000","last_became_active":"2024-09-10T23:17:26.834959+0000","last_became_peered":"2024-09-10T23:17:26.834959+0000","last_unstale":"2024-09-10T23:17:28.968196+0000","last_undegraded":"2024-09-10T23:17:28.968196+0000","last_fullsized":"2024-09-10T23:17:28.968196+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:20.532800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.849501+0000","last_change":"2024-09-10T23:17:27.842071+0000","last_active":"2024-09-10T23:17:28.849501+0000","last_peered":"2024-09-10T23:17:28.849501+0000","last_clean":"2024-09-10T23:17:28.849501+0000","last_became_active":"2024-09-10T23:17:27.841258+0000","last_became_peered":"2024-09-10T23:17:27.841258+0000","last_unstale":"2024-09-10T23:17:28.849501+0000","last_undegraded":"2024-09-10T23:17:28.849501+0000","last_fullsized":"2024-09-10T23:17:28.849501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:28.885437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.969071+0000","last_change":"2024-09-10T23:17:26.836970+0000","last_active":"2024-09-10T23:17:28.969071+0000","last_peered":"2024-09-10T23:17:28.969071+0000","last_clean":"2024-09-10T23:17:28.969071+0000","last_became_active":"2024-09-10T23:17:26.836198+0000","last_became_peered":"2024-09-10T23:17:26.836198+0000","last_unstale":"2024-09-10T23:17:28.969071+0000","last_undegraded":"2024-09-10T23:17:28.969071+0000","last_fullsized":"2024-09-10T23:17:28.969071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:54.508003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.848598+0000","last_change":"2024-09-10T23:17:27.836602+0000","last_active":"2024-09-10T23:17:28.848598+0000","last_peered":"2024-09-10T23:17:28.848598+0000","last_clean":"2024-09-10T23:17:28.848598+0000","last_became_active":"2024-09-10T23:17:27.836266+0000","last_became_peered":"2024-09-10T23:17:27.836266+0000","last_unstale":"2024-09-10T23:17:28.848598+0000","last_undegraded":"2024-09-10T23:17:28.848598+0000","last_fullsized":"2024-09-10T23:17:28.848598+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:39.618340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967581+0000","last_change":"2024-09-10T23:17:26.838293+0000","last_active":"2024-09-10T23:17:28.967581+0000","last_peered":"2024-09-10T23:17:28.967581+0000","last_clean":"2024-09-10T23:17:28.967581+0000","last_became_active":"2024-09-10T23:17:26.838036+0000","last_became_peered":"2024-09-10T23:17:26.838036+0000","last_unstale":"2024-09-10T23:17:28.967581+0000","last_undegraded":"2024-09-10T23:17:28.967581+0000","last_fullsized":"2024-09-10T23:17:28.967581+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:36.624168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967505+0000","last_change":"2024-09-10T23:17:27.842286+0000","last_active":"2024-09-10T23:17:28.967505+0000","last_peered":"2024-09-10T23:17:28.967505+0000","last_clean":"2024-09-10T23:17:28.967505+0000","last_became_active":"2024-09-10T23:17:27.842048+0000","last_became_peered":"2024-09-10T23:17:27.842048+0000","last_unstale":"2024-09-10T23:17:28.967505+0000","last_undegraded":"2024-09-10T23:17:28.967505+0000","last_fullsized":"2024-09-10T23:17:28.967505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:12.804058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.848623+0000","last_change":"2024-09-10T23:17:26.831906+0000","last_active":"2024-09-10T23:17:28.848623+0000","last_peered":"2024-09-10T23:17:28.848623+0000","last_clean":"2024-09-10T23:17:28.848623+0000","last_became_active":"2024-09-10T23:17:26.831641+0000","last_became_peered":"2024-09-10T23:17:26.831641+0000","last_unstale":"2024-09-10T23:17:28.848623+0000","last_undegraded":"2024-09-10T23:17:28.848623+0000","last_fullsized":"2024-09-10T23:17:28.848623+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:18.412648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967502+0000","last_change":"2024-09-10T23:17:27.853048+0000","last_active":"2024-09-10T23:17:28.967502+0000","last_peered":"2024-09-10T23:17:28.967502+0000","last_clean":"2024-09-10T23:17:28.967502+0000","last_became_active":"2024-09-10T23:17:27.852781+0000","last_became_peered":"2024-09-10T23:17:27.852781+0000","last_unstale":"2024-09-10T23:17:28.967502+0000","last_undegraded":"2024-09-10T23:17:28.967502+0000","last_fullsized":"2024-09-10T23:17:28.967502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:00.425377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968518+0000","last_change":"2024-09-10T23:17:26.836635+0000","last_active":"2024-09-10T23:17:28.968518+0000","last_peered":"2024-09-10T23:17:28.968518+0000","last_clean":"2024-09-10T23:17:28.968518+0000","last_became_active":"2024-09-10T23:17:26.836317+0000","last_became_peered":"2024-09-10T23:17:26.836317+0000","last_unstale":"2024-09-10T23:17:28.968518+0000","last_undegraded":"2024-09-10T23:17:28.968518+0000","last_fullsized":"2024-09-10T23:17:28.968518+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:19.454224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968734+0000","last_change":"2024-09-10T23:17:27.855346+0000","last_active":"2024-09-10T23:17:28.968734+0000","last_peered":"2024-09-10T23:17:28.968734+0000","last_clean":"2024-09-10T23:17:28.968734+0000","last_became_active":"2024-09-10T23:17:27.854611+0000","last_became_peered":"2024-09-10T23:17:27.854611+0000","last_unstale":"2024-09-10T23:17:28.968734+0000","last_undegraded":"2024-09-10T23:17:28.968734+0000","last_fullsized":"2024-09-10T23:17:28.968734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:58.476533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.848728+0000","last_change":"2024-09-10T23:17:26.838994+0000","last_active":"2024-09-10T23:17:28.848728+0000","last_peered":"2024-09-10T23:17:28.848728+0000","last_clean":"2024-09-10T23:17:28.848728+0000","last_became_active":"2024-09-10T23:17:26.838726+0000","last_became_peered":"2024-09-10T23:17:26.838726+0000","last_unstale":"2024-09-10T23:17:28.848728+0000","last_undegraded":"2024-09-10T23:17:28.848728+0000","last_fullsized":"2024-09-10T23:17:28.848728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:40.904783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.847202+0000","last_change":"2024-09-10T23:17:27.841061+0000","last_active":"2024-09-10T23:17:28.847202+0000","last_peered":"2024-09-10T23:17:28.847202+0000","last_clean":"2024-09-10T23:17:28.847202+0000","last_became_active":"2024-09-10T23:17:27.840754+0000","last_became_peered":"2024-09-10T23:17:27.840754+0000","last_unstale":"2024-09-10T23:17:28.847202+0000","last_undegraded":"2024-09-10T23:17:28.847202+0000","last_fullsized":"2024-09-10T23:17:28.847202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:26.814153+0000","last_clean_scrub_stamp":"2024-09-10T23:17:26.814153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:33.852006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.968217+0000","last_change":"2024-09-10T23:17:26.845457+0000","last_active":"2024-09-10T23:17:28.968217+0000","last_peered":"2024-09-10T23:17:28.968217+0000","last_clean":"2024-09-10T23:17:28.968217+0000","last_became_active":"2024-09-10T23:17:26.845080+0000","last_became_peered":"2024-09-10T23:17:26.845080+0000","last_unstale":"2024-09-10T23:17:28.968217+0000","last_undegraded":"2024-09-10T23:17:28.968217+0000","last_fullsized":"2024-09-10T23:17:28.968217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:25.803514+0000","last_clean_scrub_stamp":"2024-09-10T23:17:25.803514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:59:45.998586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":215,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T23:17:28.967629+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:17:28.967629+0000","last_peered":"2024-09-10T23:17:28.967629+0000","last_clean":"2024-09-10T23:17:28.967629+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:17:28.967629+0000","last_undegraded":"2024-09-10T23:17:28.967629+0000","last_fullsized":"2024-09-10T23:17:28.967629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28580,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343260,"statfs":{"total":96636764160,"available":96607498240,"internally_reserved":0,"allocated":1585152,"data_stored":1004970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509480,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":999424,"data_stored":415226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1003520,"data_stored":416166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509480,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":987136,"data_stored":414532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509482,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":999424,"data_stored":416144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":991232,"data_stored":415114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":999424,"data_stored":414726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32744,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339096,"statfs":{"total":96636764160,"available":96603234304,"internally_reserved":0,"allocated":1585152,"data_stored":1004934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:17:35.515 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:17:35.516 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:17:35.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.659+0000 7f05f1057640 1 -- 172.21.15.90:0/2437011613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05ec0d16f0 msgr2=0x7f05ec0d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:35.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.659+0000 7f05f1057640 1 --2- 172.21.15.90:0/2437011613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05ec0d16f0 0x7f05ec0d0fc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009830 tx=0x7f05d402a480 comp rx=0 tx=0).stop 2024-09-10T23:17:35.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.659+0000 7f05f1057640 1 -- 172.21.15.90:0/2437011613 shutdown_connections 2024-09-10T23:17:35.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.659+0000 7f05f1057640 1 --2- 172.21.15.90:0/2437011613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05ec0d16f0 0x7f05ec0d0fc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:35.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.659+0000 7f05f1057640 1 --2- 172.21.15.90:0/2437011613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05ec15e310 0x7f05ec0d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:35.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.659+0000 7f05f1057640 1 -- 172.21.15.90:0/2437011613 >> 172.21.15.90:0/2437011613 conn(0x7f05ec0d4090 msgr2=0x7f05ec0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:35.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.659+0000 7f05f1057640 1 -- 172.21.15.90:0/2437011613 shutdown_connections 2024-09-10T23:17:35.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.659+0000 7f05f1057640 1 -- 172.21.15.90:0/2437011613 wait complete. 2024-09-10T23:17:35.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.660+0000 7f05f1057640 1 Processor -- start 2024-09-10T23:17:35.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.660+0000 7f05f1057640 1 -- start start 2024-09-10T23:17:35.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05f1057640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05ec0d16f0 0x7f05ec0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:35.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05f1057640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05ec0d4b80 0x7f05ec0cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:35.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05f1057640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05ec15e310 0x7f05ec1f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:35.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05f1057640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec06de00 con 0x7f05ec0d16f0 2024-09-10T23:17:35.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05f1057640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec0d3ae0 con 0x7f05ec15e310 2024-09-10T23:17:35.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05f1057640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f05ec06df80 con 0x7f05ec0d4b80 2024-09-10T23:17:35.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05ead9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05ec0d16f0 0x7f05ec0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:35.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05ead9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05ec0d16f0 0x7f05ec0b78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37182/0 (socket says 172.21.15.90:37182) 2024-09-10T23:17:35.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05ead9d640 1 -- 172.21.15.90:0/1868340415 learned_addr learned my addr 172.21.15.90:0/1868340415 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:35.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05e3fff640 1 --2- 172.21.15.90:0/1868340415 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05ec0d4b80 0x7f05ec0cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:35.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05eb59e640 1 --2- 172.21.15.90:0/1868340415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05ec15e310 0x7f05ec1f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:35.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05ead9d640 1 -- 172.21.15.90:0/1868340415 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05ec0d4b80 msgr2=0x7f05ec0cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:35.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05ead9d640 1 --2- 172.21.15.90:0/1868340415 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05ec0d4b80 0x7f05ec0cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:35.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05ead9d640 1 -- 172.21.15.90:0/1868340415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05ec15e310 msgr2=0x7f05ec1f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:35.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05ead9d640 1 --2- 172.21.15.90:0/1868340415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05ec15e310 0x7f05ec1f3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:35.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05ead9d640 1 -- 172.21.15.90:0/1868340415 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ec0b7e10 con 0x7f05ec0d16f0 2024-09-10T23:17:35.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05ead9d640 1 --2- 172.21.15.90:0/1868340415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05ec0d16f0 0x7f05ec0b78d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00e790 tx=0x7f05dc00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:35.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.661+0000 7f05e37fe640 1 -- 172.21.15.90:0/1868340415 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc00eea0 con 0x7f05ec0d16f0 2024-09-10T23:17:35.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.662+0000 7f05e37fe640 1 -- 172.21.15.90:0/1868340415 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05dc00cdb0 con 0x7f05ec0d16f0 2024-09-10T23:17:35.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.662+0000 7f05f1057640 1 -- 172.21.15.90:0/1868340415 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ec0b8af0 con 0x7f05ec0d16f0 2024-09-10T23:17:35.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.662+0000 7f05e37fe640 1 -- 172.21.15.90:0/1868340415 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc010690 con 0x7f05ec0d16f0 2024-09-10T23:17:35.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.662+0000 7f05f1057640 1 -- 172.21.15.90:0/1868340415 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ec0b90b0 con 0x7f05ec0d16f0 2024-09-10T23:17:35.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.662+0000 7f05f1057640 1 -- 172.21.15.90:0/1868340415 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05ec06ebf0 con 0x7f05ec0d16f0 2024-09-10T23:17:35.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.663+0000 7f05e37fe640 1 -- 172.21.15.90:0/1868340415 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f05dc010830 con 0x7f05ec0d16f0 2024-09-10T23:17:35.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.664+0000 7f05e37fe640 1 --2- 172.21.15.90:0/1868340415 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05cc077f70 0x7f05cc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:35.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.664+0000 7f05e37fe640 1 -- 172.21.15.90:0/1868340415 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f05dc09a790 con 0x7f05ec0d16f0 2024-09-10T23:17:35.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.664+0000 7f05e3fff640 1 --2- 172.21.15.90:0/1868340415 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05cc077f70 0x7f05cc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:35.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.665+0000 7f05e3fff640 1 --2- 172.21.15.90:0/1868340415 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05cc077f70 0x7f05cc07a430 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f05d4034000 tx=0x7f05d4004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:35.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.668+0000 7f05e37fe640 1 -- 172.21.15.90:0/1868340415 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f05ec06ebf0 con 0x7f05ec0d16f0 2024-09-10T23:17:35.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.916+0000 7f05f1057640 1 -- 172.21.15.90:0/1868340415 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f05ec06e4a0 con 0x7f05ec0d16f0 2024-09-10T23:17:35.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.918+0000 7f05e37fe640 1 -- 172.21.15.90:0/1868340415 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v29) ==== 190+0+147 (secure 0 0 0) 0x7f05dc063290 con 0x7f05ec0d16f0 2024-09-10T23:17:35.919 INFO:teuthology.orchestra.run.smithi090.stdout:[client.0] 2024-09-10T23:17:35.919 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCX0uBmiYBwBhAABMV9erpQ+KZlTmf0kDZ0gw== 2024-09-10T23:17:35.919 INFO:teuthology.orchestra.run.smithi090.stdout: caps mds = "allow" 2024-09-10T23:17:35.919 INFO:teuthology.orchestra.run.smithi090.stdout: caps mon = "allow r" 2024-09-10T23:17:35.919 INFO:teuthology.orchestra.run.smithi090.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:17:35.919 INFO:teuthology.orchestra.run.smithi090.stderr:updated caps for client.0 2024-09-10T23:17:35.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.920+0000 7f05f1057640 1 -- 172.21.15.90:0/1868340415 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05cc077f70 msgr2=0x7f05cc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:35.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.920+0000 7f05f1057640 1 --2- 172.21.15.90:0/1868340415 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05cc077f70 0x7f05cc07a430 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f05d4034000 tx=0x7f05d4004730 comp rx=0 tx=0).stop 2024-09-10T23:17:35.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.920+0000 7f05f1057640 1 -- 172.21.15.90:0/1868340415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05ec0d16f0 msgr2=0x7f05ec0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:35.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.920+0000 7f05f1057640 1 --2- 172.21.15.90:0/1868340415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05ec0d16f0 0x7f05ec0b78d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00e790 tx=0x7f05dc00ec50 comp rx=0 tx=0).stop 2024-09-10T23:17:35.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.920+0000 7f05f1057640 1 -- 172.21.15.90:0/1868340415 shutdown_connections 2024-09-10T23:17:35.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.920+0000 7f05f1057640 1 --2- 172.21.15.90:0/1868340415 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05cc077f70 0x7f05cc07a430 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:35.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.920+0000 7f05f1057640 1 --2- 172.21.15.90:0/1868340415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05ec15e310 0x7f05ec1f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:35.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.920+0000 7f05f1057640 1 --2- 172.21.15.90:0/1868340415 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05ec0d4b80 0x7f05ec0cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:35.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.920+0000 7f05f1057640 1 --2- 172.21.15.90:0/1868340415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05ec0d16f0 0x7f05ec0b78d0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:35.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.920+0000 7f05f1057640 1 -- 172.21.15.90:0/1868340415 >> 172.21.15.90:0/1868340415 conn(0x7f05ec0d4090 msgr2=0x7f05ec0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:35.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.920+0000 7f05f1057640 1 -- 172.21.15.90:0/1868340415 shutdown_connections 2024-09-10T23:17:35.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:35.920+0000 7f05f1057640 1 -- 172.21.15.90:0/1868340415 wait complete. 2024-09-10T23:17:35.932 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:17:36.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.032+0000 7f4585c62640 1 -- 172.21.15.90:0/3957044574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45800cdb90 msgr2=0x7f45800cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:36.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.032+0000 7f4585c62640 1 --2- 172.21.15.90:0/3957044574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45800cdb90 0x7f45800cdfd0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4580072750 tx=0x7f457402a560 comp rx=0 tx=0).stop 2024-09-10T23:17:36.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.032+0000 7f4585c62640 1 -- 172.21.15.90:0/3957044574 shutdown_connections 2024-09-10T23:17:36.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.032+0000 7f4585c62640 1 --2- 172.21.15.90:0/3957044574 >> v2:172.21.15.171:3300/0 conn(0x7f458006f550 0x7f458006fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.032+0000 7f4585c62640 1 --2- 172.21.15.90:0/3957044574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45800cdb90 0x7f45800cdfd0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.032+0000 7f4585c62640 1 --2- 172.21.15.90:0/3957044574 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f458015f750 0x7f4580073de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.032+0000 7f4585c62640 1 -- 172.21.15.90:0/3957044574 >> 172.21.15.90:0/3957044574 conn(0x7f45800b19c0 msgr2=0x7f45800b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:36.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.032+0000 7f4585c62640 1 -- 172.21.15.90:0/3957044574 shutdown_connections 2024-09-10T23:17:36.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.032+0000 7f4585c62640 1 -- 172.21.15.90:0/3957044574 wait complete. 2024-09-10T23:17:36.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.033+0000 7f4585c62640 1 Processor -- start 2024-09-10T23:17:36.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.033+0000 7f4585c62640 1 -- start start 2024-09-10T23:17:36.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.034+0000 7f4585c62640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f458006f550 0x7f458013d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.034+0000 7f4585c62640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45800cdb90 0x7f458013ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.034+0000 7f4585c62640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f458015f750 0x7f45800addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.034+0000 7f4585c62640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f458015ff60 con 0x7f458006f550 2024-09-10T23:17:36.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.034+0000 7f4585c62640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f458015fde0 con 0x7f458015f750 2024-09-10T23:17:36.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.034+0000 7f4585c62640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f45801600e0 con 0x7f45800cdb90 2024-09-10T23:17:36.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.034+0000 7f457f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f458006f550 0x7f458013d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.034+0000 7f457f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f458006f550 0x7f458013d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37212/0 (socket says 172.21.15.90:37212) 2024-09-10T23:17:36.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.034+0000 7f457f7fe640 1 -- 172.21.15.90:0/3183683632 learned_addr learned my addr 172.21.15.90:0/3183683632 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:36.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.034+0000 7f457effd640 1 --2- 172.21.15.90:0/3183683632 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45800cdb90 0x7f458013ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.034+0000 7f457ffff640 1 --2- 172.21.15.90:0/3183683632 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f458015f750 0x7f45800addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.035+0000 7f457f7fe640 1 -- 172.21.15.90:0/3183683632 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45800cdb90 msgr2=0x7f458013ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:36.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.035+0000 7f457f7fe640 1 --2- 172.21.15.90:0/3183683632 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45800cdb90 0x7f458013ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.035+0000 7f457f7fe640 1 -- 172.21.15.90:0/3183683632 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f458015f750 msgr2=0x7f45800addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:36.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.035+0000 7f457f7fe640 1 --2- 172.21.15.90:0/3183683632 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f458015f750 0x7f45800addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.035+0000 7f457f7fe640 1 -- 172.21.15.90:0/3183683632 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458014f040 con 0x7f458006f550 2024-09-10T23:17:36.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.035+0000 7f457f7fe640 1 --2- 172.21.15.90:0/3183683632 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f458006f550 0x7f458013d6f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f457000e9f0 tx=0x7f457000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:36.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.035+0000 7f4567fff640 1 -- 172.21.15.90:0/3183683632 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457000cd80 con 0x7f458006f550 2024-09-10T23:17:36.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.035+0000 7f4567fff640 1 -- 172.21.15.90:0/3183683632 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4570004c10 con 0x7f458006f550 2024-09-10T23:17:36.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.035+0000 7f4585c62640 1 -- 172.21.15.90:0/3183683632 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f458013de30 con 0x7f458006f550 2024-09-10T23:17:36.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.035+0000 7f4567fff640 1 -- 172.21.15.90:0/3183683632 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570005020 con 0x7f458006f550 2024-09-10T23:17:36.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.035+0000 7f4585c62640 1 -- 172.21.15.90:0/3183683632 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f458013e3f0 con 0x7f458006f550 2024-09-10T23:17:36.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.036+0000 7f4585c62640 1 -- 172.21.15.90:0/3183683632 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45800cdfd0 con 0x7f458006f550 2024-09-10T23:17:36.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.036+0000 7f4567fff640 1 -- 172.21.15.90:0/3183683632 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f457000f040 con 0x7f458006f550 2024-09-10T23:17:36.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.037+0000 7f4567fff640 1 --2- 172.21.15.90:0/3183683632 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f456c077f70 0x7f456c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.037+0000 7f4567fff640 1 -- 172.21.15.90:0/3183683632 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f457009a3d0 con 0x7f458006f550 2024-09-10T23:17:36.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.037+0000 7f457effd640 1 --2- 172.21.15.90:0/3183683632 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f456c077f70 0x7f456c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.038+0000 7f457effd640 1 --2- 172.21.15.90:0/3183683632 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f456c077f70 0x7f456c07a430 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4574033000 tx=0x7f4574004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:36.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.041+0000 7f4567fff640 1 -- 172.21.15.90:0/3183683632 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f458014f040 con 0x7f458006f550 2024-09-10T23:17:36.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.251+0000 7f4585c62640 1 -- 172.21.15.90:0/3183683632 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45800af160 con 0x7f458006f550 2024-09-10T23:17:36.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.251+0000 7f4567fff640 1 -- 172.21.15.90:0/3183683632 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5228 (secure 0 0 0) 0x7f4570016030 con 0x7f458006f550 2024-09-10T23:17:36.252 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:36.253 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":44,"btime":"2024-09-10T23:17:29:843110+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/883446248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":883446248},{"type":"v1","addr":"172.21.15.90:6835","nonce":883446248}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5510,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1558215981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1558215981},{"type":"v1","addr":"172.21.15.171:6836","nonce":1558215981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2584382337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2584382337},{"type":"v1","addr":"172.21.15.171:6837","nonce":2584382337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:27.171227+0000","modified":"2024-09-10T23:17:29.182680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6351":{"gid":6351,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6834/1524104545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1524104545},{"type":"v1","addr":"172.21.15.90:6834","nonce":1524104545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6351,"qdb_cluster":[6351]},"id":6}]} 2024-09-10T23:17:36.253 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 44 2024-09-10T23:17:36.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.253+0000 7f4585c62640 1 -- 172.21.15.90:0/3183683632 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f456c077f70 msgr2=0x7f456c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:36.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.253+0000 7f4585c62640 1 --2- 172.21.15.90:0/3183683632 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f456c077f70 0x7f456c07a430 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4574033000 tx=0x7f4574004730 comp rx=0 tx=0).stop 2024-09-10T23:17:36.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.253+0000 7f4585c62640 1 -- 172.21.15.90:0/3183683632 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f458006f550 msgr2=0x7f458013d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:36.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.253+0000 7f4585c62640 1 --2- 172.21.15.90:0/3183683632 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f458006f550 0x7f458013d6f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f457000e9f0 tx=0x7f457000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.253+0000 7f4585c62640 1 -- 172.21.15.90:0/3183683632 shutdown_connections 2024-09-10T23:17:36.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.253+0000 7f4585c62640 1 --2- 172.21.15.90:0/3183683632 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f456c077f70 0x7f456c07a430 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.253+0000 7f4585c62640 1 --2- 172.21.15.90:0/3183683632 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f458015f750 0x7f45800addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.253+0000 7f4585c62640 1 --2- 172.21.15.90:0/3183683632 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45800cdb90 0x7f458013ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.253+0000 7f4585c62640 1 --2- 172.21.15.90:0/3183683632 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f458006f550 0x7f458013d6f0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.253+0000 7f4585c62640 1 -- 172.21.15.90:0/3183683632 >> 172.21.15.90:0/3183683632 conn(0x7f45800b19c0 msgr2=0x7f458014f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:36.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.254+0000 7f4585c62640 1 -- 172.21.15.90:0/3183683632 shutdown_connections 2024-09-10T23:17:36.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.254+0000 7f4585c62640 1 -- 172.21.15.90:0/3183683632 wait complete. 2024-09-10T23:17:36.668 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:17:27.171227+0000', 'modified': '2024-09-10T23:17:29.182680+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6351}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6351': {'gid': 6351, 'name': 'a', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.90:6834/1524104545', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6832', 'nonce': 1524104545}, {'type': 'v1', 'addr': '172.21.15.90:6834', 'nonce': 1524104545}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6351, 'qdb_cluster': [6351]} 2024-09-10T23:17:36.668 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:17:36.668 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T23:17:36.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.770+0000 7f9353e52640 1 -- 172.21.15.90:0/90122579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c15e970 msgr2=0x7f934c0727c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:36.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.770+0000 7f9353e52640 1 --2- 172.21.15.90:0/90122579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c15e970 0x7f934c0727c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f934c075050 tx=0x7f933c02a4d0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.770+0000 7f9353e52640 1 -- 172.21.15.90:0/90122579 shutdown_connections 2024-09-10T23:17:36.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.770+0000 7f9353e52640 1 --2- 172.21.15.90:0/90122579 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f934c0ceca0 0x7f934c0cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.770+0000 7f9353e52640 1 --2- 172.21.15.90:0/90122579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c15e970 0x7f934c0727c0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.770+0000 7f9353e52640 1 --2- 172.21.15.90:0/90122579 >> v2:172.21.15.171:3300/0 conn(0x7f934c0b3310 0x7f934c0b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.770+0000 7f9353e52640 1 -- 172.21.15.90:0/90122579 >> 172.21.15.90:0/90122579 conn(0x7f934c0b19c0 msgr2=0x7f934c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:36.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.770+0000 7f9353e52640 1 -- 172.21.15.90:0/90122579 shutdown_connections 2024-09-10T23:17:36.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.770+0000 7f9353e52640 1 -- 172.21.15.90:0/90122579 wait complete. 2024-09-10T23:17:36.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.771+0000 7f9353e52640 1 Processor -- start 2024-09-10T23:17:36.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.771+0000 7f9353e52640 1 -- start start 2024-09-10T23:17:36.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f9353e52640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f934c0b3310 0x7f934c1f7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f9353e52640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f934c0ceca0 0x7f934c0cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f9353e52640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c1f5c00 0x7f934c0cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f9353e52640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f934c15b7b0 con 0x7f934c1f5c00 2024-09-10T23:17:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f9353e52640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f934c0af780 con 0x7f934c0ceca0 2024-09-10T23:17:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f9353e52640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f934c15b930 con 0x7f934c0b3310 2024-09-10T23:17:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f93523ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c1f5c00 0x7f934c0cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f93523ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c1f5c00 0x7f934c0cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37228/0 (socket says 172.21.15.90:37228) 2024-09-10T23:17:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f93523ef640 1 -- 172.21.15.90:0/3836026664 learned_addr learned my addr 172.21.15.90:0/3836026664 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f9351bee640 1 --2- 172.21.15.90:0/3836026664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f934c0b3310 0x7f934c1f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f93523ef640 1 -- 172.21.15.90:0/3836026664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f934c0b3310 msgr2=0x7f934c1f7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f93523ef640 1 --2- 172.21.15.90:0/3836026664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f934c0b3310 0x7f934c1f7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f93523ef640 1 -- 172.21.15.90:0/3836026664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f934c0ceca0 msgr2=0x7f934c0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f93513ed640 1 --2- 172.21.15.90:0/3836026664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f934c0ceca0 0x7f934c0cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f93523ef640 1 --2- 172.21.15.90:0/3836026664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f934c0ceca0 0x7f934c0cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f93523ef640 1 -- 172.21.15.90:0/3836026664 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c1f81b0 con 0x7f934c1f5c00 2024-09-10T23:17:36.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f9351bee640 1 --2- 172.21.15.90:0/3836026664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f934c0b3310 0x7f934c1f7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:36.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f93523ef640 1 --2- 172.21.15.90:0/3836026664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c1f5c00 0x7f934c0cca70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f934400eaa0 tx=0x7f934400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:36.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f93427fc640 1 -- 172.21.15.90:0/3836026664 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934400cdb0 con 0x7f934c1f5c00 2024-09-10T23:17:36.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.772+0000 7f93427fc640 1 -- 172.21.15.90:0/3836026664 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9344004c10 con 0x7f934c1f5c00 2024-09-10T23:17:36.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.773+0000 7f9353e52640 1 -- 172.21.15.90:0/3836026664 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934c1f8490 con 0x7f934c1f5c00 2024-09-10T23:17:36.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.773+0000 7f93427fc640 1 -- 172.21.15.90:0/3836026664 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344005020 con 0x7f934c1f5c00 2024-09-10T23:17:36.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.773+0000 7f9353e52640 1 -- 172.21.15.90:0/3836026664 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934c1f8a50 con 0x7f934c1f5c00 2024-09-10T23:17:36.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.774+0000 7f93427fc640 1 -- 172.21.15.90:0/3836026664 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f934400f040 con 0x7f934c1f5c00 2024-09-10T23:17:36.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.775+0000 7f93427fc640 1 --2- 172.21.15.90:0/3836026664 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9330077f70 0x7f933007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.775+0000 7f93427fc640 1 -- 172.21.15.90:0/3836026664 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f934409a470 con 0x7f934c1f5c00 2024-09-10T23:17:36.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.775+0000 7f9351bee640 1 --2- 172.21.15.90:0/3836026664 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9330077f70 0x7f933007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.776+0000 7f9351bee640 1 --2- 172.21.15.90:0/3836026664 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9330077f70 0x7f933007a430 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9348005fd0 tx=0x7f93480094d0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:36.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.776+0000 7f9356c1e740 1 Processor -- start 2024-09-10T23:17:36.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.776+0000 7f9356c1e740 1 -- start start 2024-09-10T23:17:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.776+0000 7f9356c1e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac922d1b0 0x556ac9204b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.776+0000 7f9356c1e740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac924cdf0 0x556ac924d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.776+0000 7f9356c1e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac92025f0 0x556ac9202a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.776+0000 7f9356c1e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556ac9179820 con 0x556ac922d1b0 2024-09-10T23:17:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.776+0000 7f9356c1e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556ac9168c50 con 0x556ac92025f0 2024-09-10T23:17:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.776+0000 7f9356c1e740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x556ac916ca60 con 0x556ac924cdf0 2024-09-10T23:17:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.777+0000 7f9351bee640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac922d1b0 0x556ac9204b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.777+0000 7f9351bee640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac922d1b0 0x556ac9204b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37242/0 (socket says 172.21.15.90:37242) 2024-09-10T23:17:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.777+0000 7f9351bee640 1 -- 172.21.15.90:0/1396898477 learned_addr learned my addr 172.21.15.90:0/1396898477 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.777+0000 7f93513ed640 1 --2- 172.21.15.90:0/1396898477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac924cdf0 0x556ac924d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.777+0000 7f93523ef640 1 --2- 172.21.15.90:0/1396898477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac92025f0 0x556ac9202a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.777+0000 7f9351bee640 1 -- 172.21.15.90:0/1396898477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac924cdf0 msgr2=0x556ac924d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:36.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.777+0000 7f9351bee640 1 --2- 172.21.15.90:0/1396898477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac924cdf0 0x556ac924d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.777+0000 7f9351bee640 1 -- 172.21.15.90:0/1396898477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac92025f0 msgr2=0x556ac9202a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.777+0000 7f9351bee640 1 --2- 172.21.15.90:0/1396898477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac92025f0 0x556ac9202a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.777+0000 7f9351bee640 1 -- 172.21.15.90:0/1396898477 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ac8eca850 con 0x556ac922d1b0 2024-09-10T23:17:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.777+0000 7f9351bee640 1 --2- 172.21.15.90:0/1396898477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac922d1b0 0x556ac9204b20 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f934800eed0 tx=0x7f9348011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb1d7edc2eb091c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.777+0000 7f932f7fe640 1 -- 172.21.15.90:0/1396898477 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348005020 con 0x556ac922d1b0 2024-09-10T23:17:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.777+0000 7f932f7fe640 1 -- 172.21.15.90:0/1396898477 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9348017030 con 0x556ac922d1b0 2024-09-10T23:17:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.777+0000 7f932f7fe640 1 -- 172.21.15.90:0/1396898477 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348005530 con 0x556ac922d1b0 2024-09-10T23:17:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.778+0000 7f9356c1e740 1 -- 172.21.15.90:0/1396898477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac922d1b0 msgr2=0x556ac9204b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.778+0000 7f9356c1e740 1 --2- 172.21.15.90:0/1396898477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac922d1b0 0x556ac9204b20 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f934800eed0 tx=0x7f9348011000 comp rx=0 tx=0).stop 2024-09-10T23:17:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.778+0000 7f9356c1e740 1 -- 172.21.15.90:0/1396898477 shutdown_connections 2024-09-10T23:17:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.778+0000 7f9356c1e740 1 --2- 172.21.15.90:0/1396898477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac92025f0 0x556ac9202a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.778+0000 7f9356c1e740 1 --2- 172.21.15.90:0/1396898477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac924cdf0 0x556ac924d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.778+0000 7f9356c1e740 1 --2- 172.21.15.90:0/1396898477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac922d1b0 0x556ac9204b20 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.778+0000 7f9356c1e740 1 -- 172.21.15.90:0/1396898477 >> 172.21.15.90:0/1396898477 conn(0x556ac92036a0 msgr2=0x556ac92070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:36.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.778+0000 7f9356c1e740 1 -- 172.21.15.90:0/1396898477 shutdown_connections 2024-09-10T23:17:36.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.778+0000 7f9356c1e740 1 -- 172.21.15.90:0/1396898477 wait complete. 2024-09-10T23:17:36.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.778+0000 7f9356c1e740 1 -- start start 2024-09-10T23:17:36.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.779+0000 7f9356c1e740 1 Processor -- start 2024-09-10T23:17:36.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.779+0000 7f9356c1e740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac922d1b0 0x556ac9230fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.779+0000 7f9356c1e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac924cdf0 0x556ac9231520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.779+0000 7f9356c1e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac924b1a0 0x556ac92461d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.779+0000 7f9356c1e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556ac8ed9620 con 0x556ac924b1a0 2024-09-10T23:17:36.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.779+0000 7f9356c1e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556ac910e5f0 con 0x556ac924cdf0 2024-09-10T23:17:36.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.779+0000 7f9356c1e740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x556ac9201890 con 0x556ac922d1b0 2024-09-10T23:17:36.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.779+0000 7f9356c1e740 10 client.0 _ll_register_callbacks cb 0x556ac91120a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:17:36.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f93523ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac924b1a0 0x556ac92461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f93523ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac924b1a0 0x556ac92461d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37250/0 (socket says 172.21.15.90:37250) 2024-09-10T23:17:36.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f93523ef640 1 -- 172.21.15.90:0/1117808725 learned_addr learned my addr 172.21.15.90:0/1117808725 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:36.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f93513ed640 1 --2- 172.21.15.90:0/1117808725 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac924cdf0 0x556ac9231520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f9351bee640 1 --2- 172.21.15.90:0/1117808725 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac922d1b0 0x556ac9230fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f93523ef640 1 -- 172.21.15.90:0/1117808725 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac922d1b0 msgr2=0x556ac9230fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:36.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f93523ef640 1 --2- 172.21.15.90:0/1117808725 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac922d1b0 0x556ac9230fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f93523ef640 1 -- 172.21.15.90:0/1117808725 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac924cdf0 msgr2=0x556ac9231520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:36.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f93523ef640 1 --2- 172.21.15.90:0/1117808725 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac924cdf0 0x556ac9231520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f93523ef640 1 -- 172.21.15.90:0/1117808725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ac8f416b0 con 0x556ac924b1a0 2024-09-10T23:17:36.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f9351bee640 1 --2- 172.21.15.90:0/1117808725 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac922d1b0 0x556ac9230fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:36.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f93513ed640 1 --2- 172.21.15.90:0/1117808725 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac924cdf0 0x556ac9231520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:36.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f93523ef640 1 --2- 172.21.15.90:0/1117808725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac924b1a0 0x556ac92461d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f934405fae0 tx=0x7f9344009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf81ff5c2169d1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f932cff9640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:17:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f932cff9640 1 -- 172.21.15.90:0/1117808725 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344088020 con 0x556ac924b1a0 2024-09-10T23:17:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f932cff9640 1 -- 172.21.15.90:0/1117808725 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f9344061cd0 con 0x556ac924b1a0 2024-09-10T23:17:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f9356c1e740 1 -- 172.21.15.90:0/1117808725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9348017030 con 0x556ac924b1a0 2024-09-10T23:17:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f932cff9640 1 -- 172.21.15.90:0/1117808725 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f934401f040 con 0x556ac924b1a0 2024-09-10T23:17:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f9356c1e740 10 client.6504 fetch_fsmap learned FSMap version 44 2024-09-10T23:17:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f9356c1e740 1 -- 172.21.15.90:0/1117808725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x556ac9246e30 con 0x556ac924b1a0 2024-09-10T23:17:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f932cff9640 1 -- 172.21.15.90:0/1117808725 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9348017030 con 0x556ac924b1a0 2024-09-10T23:17:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f932cff9640 1 -- 172.21.15.90:0/1117808725 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 44) ==== 3502+0+0 (secure 0 0 0) 0x7f9344091b40 con 0x556ac924b1a0 2024-09-10T23:17:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f9356c1e740 10 client.6504 fetch_fsmap finished waiting for FSMap version 44 2024-09-10T23:17:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.780+0000 7f9356c1e740 10 client.6504 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:17:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.781+0000 7f9356c1e740 20 client.6504 populate_metadata read hostname 'smithi090' 2024-09-10T23:17:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.781+0000 7f9356c1e740 1 --2- 172.21.15.90:0/1117808725 >> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] conn(0x556ac9247fa0 0x556ac925f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.781+0000 7f9356c1e740 4 client.6504 mds_command: new command op to 6351 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:17:36.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.781+0000 7f9356c1e740 1 -- 172.21.15.90:0/1117808725 --> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ac917b770 con 0x556ac9247fa0 2024-09-10T23:17:36.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.781+0000 7f9351bee640 1 --2- 172.21.15.90:0/1117808725 >> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] conn(0x556ac9247fa0 0x556ac925f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.781+0000 7f932cff9640 10 client.6504 ms_handle_connect on v2:172.21.15.90:6832/1524104545 2024-09-10T23:17:36.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.781+0000 7f9351bee640 1 --2- 172.21.15.90:0/1117808725 >> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] conn(0x556ac9247fa0 0x556ac925f4f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8416b57fcd730863 server_cookie=525c3d5a821066bd in_seq=0 out_seq=0 2024-09-10T23:17:36.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.782+0000 7f932cff9640 1 -- 172.21.15.90:0/1117808725 <== mds.0 v2:172.21.15.90:6832/1524104545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ac917b770 con 0x556ac9247fa0 2024-09-10T23:17:36.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.782+0000 7f932cff9640 10 client.6504 handle_command_reply: tid=0 2024-09-10T23:17:36.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.782+0000 7f9356c1e740 1 client.6504 shutdown 2024-09-10T23:17:36.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.782+0000 7f9356c1e740 1 -- 172.21.15.90:0/1117808725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac924b1a0 msgr2=0x556ac92461d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:36.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.782+0000 7f9356c1e740 1 --2- 172.21.15.90:0/1117808725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac924b1a0 0x556ac92461d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f934405fae0 tx=0x7f9344009750 comp rx=0 tx=0).stop 2024-09-10T23:17:36.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.782+0000 7f9356c1e740 1 -- 172.21.15.90:0/1117808725 shutdown_connections 2024-09-10T23:17:36.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.782+0000 7f9356c1e740 1 --2- 172.21.15.90:0/1117808725 >> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] conn(0x556ac9247fa0 0x556ac925f4f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.782+0000 7f9356c1e740 1 --2- 172.21.15.90:0/1117808725 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac924cdf0 0x556ac9231520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.782+0000 7f9356c1e740 1 --2- 172.21.15.90:0/1117808725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac924b1a0 0x556ac92461d0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.782+0000 7f932cff9640 0 client.6504 ms_handle_reset on v2:172.21.15.90:6832/1524104545 2024-09-10T23:17:36.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.782+0000 7f9356c1e740 1 --2- 172.21.15.90:0/1117808725 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac922d1b0 0x556ac9230fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.782+0000 7f9356c1e740 1 -- 172.21.15.90:0/1117808725 >> 172.21.15.90:0/1117808725 conn(0x556ac92025f0 msgr2=0x556ac9200b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:36.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.782+0000 7f9356c1e740 1 -- 172.21.15.90:0/1117808725 shutdown_connections 2024-09-10T23:17:36.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.782+0000 7f9356c1e740 1 -- 172.21.15.90:0/1117808725 wait complete. 2024-09-10T23:17:36.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.782+0000 7f9356c1e740 20 client.6504 trim_cache size 0 max 16384 2024-09-10T23:17:36.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.800+0000 7f9356c1e740 1 Processor -- start 2024-09-10T23:17:36.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.800+0000 7f9356c1e740 1 -- start start 2024-09-10T23:17:36.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f9356c1e740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac922d1b0 0x556ac9231560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f9356c1e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac9247fa0 0x556ac9206220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f9356c1e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac924b1a0 0x556ac91fd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f9356c1e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f934c0cdb90 con 0x556ac924b1a0 2024-09-10T23:17:36.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f9356c1e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f934c1f4f50 con 0x556ac9247fa0 2024-09-10T23:17:36.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f9356c1e740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f934c1f55a0 con 0x556ac922d1b0 2024-09-10T23:17:36.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f93523ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac924b1a0 0x556ac91fd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f93523ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac924b1a0 0x556ac91fd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37256/0 (socket says 172.21.15.90:37256) 2024-09-10T23:17:36.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f93523ef640 1 -- 172.21.15.90:0/536851738 learned_addr learned my addr 172.21.15.90:0/536851738 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:36.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f93523ef640 1 -- 172.21.15.90:0/536851738 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac922d1b0 msgr2=0x556ac9231560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:36.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f9351bee640 1 --2- 172.21.15.90:0/536851738 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac922d1b0 0x556ac9231560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f93523ef640 1 --2- 172.21.15.90:0/536851738 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac922d1b0 0x556ac9231560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f93523ef640 1 -- 172.21.15.90:0/536851738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac9247fa0 msgr2=0x556ac9206220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:36.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f93523ef640 1 --2- 172.21.15.90:0/536851738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac9247fa0 0x556ac9206220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f93523ef640 1 -- 172.21.15.90:0/536851738 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ac922e100 con 0x556ac924b1a0 2024-09-10T23:17:36.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f9351bee640 1 --2- 172.21.15.90:0/536851738 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac922d1b0 0x556ac9231560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:36.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f93523ef640 1 --2- 172.21.15.90:0/536851738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac924b1a0 0x556ac91fd010 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9344062330 tx=0x7f934409a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6990000133dcf15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:36.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f932effd640 1 -- 172.21.15.90:0/536851738 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344088030 con 0x556ac924b1a0 2024-09-10T23:17:36.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f932effd640 1 -- 172.21.15.90:0/536851738 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f934406bd70 con 0x556ac924b1a0 2024-09-10T23:17:36.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.801+0000 7f932effd640 1 -- 172.21.15.90:0/536851738 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344061d30 con 0x556ac924b1a0 2024-09-10T23:17:36.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.802+0000 7f9356c1e740 1 -- 172.21.15.90:0/536851738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac924b1a0 msgr2=0x556ac91fd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:36.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.802+0000 7f9356c1e740 1 --2- 172.21.15.90:0/536851738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac924b1a0 0x556ac91fd010 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9344062330 tx=0x7f934409a010 comp rx=0 tx=0).stop 2024-09-10T23:17:36.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.802+0000 7f9356c1e740 1 -- 172.21.15.90:0/536851738 shutdown_connections 2024-09-10T23:17:36.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.802+0000 7f9356c1e740 1 --2- 172.21.15.90:0/536851738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac9247fa0 0x556ac9206220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.802+0000 7f9356c1e740 1 --2- 172.21.15.90:0/536851738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac924b1a0 0x556ac91fd010 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.802+0000 7f9356c1e740 1 --2- 172.21.15.90:0/536851738 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac922d1b0 0x556ac9231560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.802+0000 7f9356c1e740 1 -- 172.21.15.90:0/536851738 >> 172.21.15.90:0/536851738 conn(0x556ac92025f0 msgr2=0x556ac9249620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:36.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.802+0000 7f9356c1e740 1 -- 172.21.15.90:0/536851738 shutdown_connections 2024-09-10T23:17:36.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.802+0000 7f9356c1e740 1 -- 172.21.15.90:0/536851738 wait complete. 2024-09-10T23:17:36.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.803+0000 7f9356c1e740 1 -- start start 2024-09-10T23:17:36.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.803+0000 7f9356c1e740 1 Processor -- start 2024-09-10T23:17:36.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f9356c1e740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac922d1b0 0x556ac922c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f9356c1e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac9247fa0 0x556ac9244720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f9356c1e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac924b1a0 0x556ac924c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f9356c1e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556ac9246c00 con 0x556ac9247fa0 2024-09-10T23:17:36.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f9356c1e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556ac9246760 con 0x556ac924b1a0 2024-09-10T23:17:36.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f9356c1e740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x556ac9248420 con 0x556ac922d1b0 2024-09-10T23:17:36.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f9356c1e740 10 client.0 _ll_register_callbacks cb 0x7f9344062730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:17:36.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f93513ed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac9247fa0 0x556ac9244720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f93513ed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac9247fa0 0x556ac9244720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37266/0 (socket says 172.21.15.90:37266) 2024-09-10T23:17:36.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f93513ed640 1 -- 172.21.15.90:0/1517945052 learned_addr learned my addr 172.21.15.90:0/1517945052 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:36.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f93523ef640 1 --2- 172.21.15.90:0/1517945052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac924b1a0 0x556ac924c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f9351bee640 1 --2- 172.21.15.90:0/1517945052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac922d1b0 0x556ac922c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f93513ed640 1 -- 172.21.15.90:0/1517945052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac922d1b0 msgr2=0x556ac922c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:36.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f93513ed640 1 --2- 172.21.15.90:0/1517945052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac922d1b0 0x556ac922c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f93513ed640 1 -- 172.21.15.90:0/1517945052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac924b1a0 msgr2=0x556ac924c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:36.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f93513ed640 1 --2- 172.21.15.90:0/1517945052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac924b1a0 0x556ac924c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f93513ed640 1 -- 172.21.15.90:0/1517945052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ac9245820 con 0x556ac9247fa0 2024-09-10T23:17:36.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f93513ed640 1 --2- 172.21.15.90:0/1517945052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac9247fa0 0x556ac9244720 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f933c005fd0 tx=0x7f933c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd60307cf6bbf95 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:36.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f932cff9640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:17:36.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f932cff9640 1 -- 172.21.15.90:0/1517945052 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c040030 con 0x556ac9247fa0 2024-09-10T23:17:36.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f932cff9640 1 -- 172.21.15.90:0/1517945052 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f933c005020 con 0x556ac9247fa0 2024-09-10T23:17:36.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.804+0000 7f9356c1e740 1 -- 172.21.15.90:0/1517945052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f934406bd70 con 0x556ac9247fa0 2024-09-10T23:17:36.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.805+0000 7f932cff9640 1 -- 172.21.15.90:0/1517945052 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f933c04b050 con 0x556ac9247fa0 2024-09-10T23:17:36.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.805+0000 7f9356c1e740 10 client.6510 fetch_fsmap learned FSMap version 44 2024-09-10T23:17:36.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.805+0000 7f9356c1e740 1 -- 172.21.15.90:0/1517945052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x556ac9244c60 con 0x556ac9247fa0 2024-09-10T23:17:36.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.805+0000 7f932cff9640 1 -- 172.21.15.90:0/1517945052 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f934406bd70 con 0x556ac9247fa0 2024-09-10T23:17:36.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.805+0000 7f932cff9640 1 -- 172.21.15.90:0/1517945052 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 44) ==== 3502+0+0 (secure 0 0 0) 0x7f933c04e020 con 0x556ac9247fa0 2024-09-10T23:17:36.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.805+0000 7f9356c1e740 10 client.6510 fetch_fsmap finished waiting for FSMap version 44 2024-09-10T23:17:36.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.805+0000 7f9356c1e740 10 client.6510 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:17:36.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.805+0000 7f9356c1e740 20 client.6510 populate_metadata read hostname 'smithi090' 2024-09-10T23:17:36.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.805+0000 7f9356c1e740 1 --2- 172.21.15.90:0/1517945052 >> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] conn(0x556ac924cdf0 0x556ac9224db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.805+0000 7f9356c1e740 4 client.6510 mds_command: new command op to 6351 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:17:36.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.805+0000 7f9356c1e740 1 -- 172.21.15.90:0/1517945052 --> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] -- command(tid 0: {"prefix": "status"}) -- 0x556ac9177220 con 0x556ac924cdf0 2024-09-10T23:17:36.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.805+0000 7f9351bee640 1 --2- 172.21.15.90:0/1517945052 >> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] conn(0x556ac924cdf0 0x556ac9224db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.805+0000 7f932cff9640 10 client.6510 ms_handle_connect on v2:172.21.15.90:6832/1524104545 2024-09-10T23:17:36.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.805+0000 7f9351bee640 1 --2- 172.21.15.90:0/1517945052 >> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] conn(0x556ac924cdf0 0x556ac9224db0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2424e258527d1dcf server_cookie=54c50682d34a486b in_seq=0 out_seq=0 2024-09-10T23:17:36.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.805+0000 7f932cff9640 1 -- 172.21.15.90:0/1517945052 <== mds.0 v2:172.21.15.90:6832/1524104545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x556ac9177220 con 0x556ac924cdf0 2024-09-10T23:17:36.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.805+0000 7f932cff9640 10 client.6510 handle_command_reply: tid=0 2024-09-10T23:17:36.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.805+0000 7f9356c1e740 1 client.6510 shutdown 2024-09-10T23:17:36.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9356c1e740 1 -- 172.21.15.90:0/1517945052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac9247fa0 msgr2=0x556ac9244720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:36.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9356c1e740 1 --2- 172.21.15.90:0/1517945052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac9247fa0 0x556ac9244720 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f933c005fd0 tx=0x7f933c0042e0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9356c1e740 1 -- 172.21.15.90:0/1517945052 shutdown_connections 2024-09-10T23:17:36.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9356c1e740 1 --2- 172.21.15.90:0/1517945052 >> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] conn(0x556ac924cdf0 0x556ac9224db0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9356c1e740 1 --2- 172.21.15.90:0/1517945052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556ac924b1a0 0x556ac924c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f932cff9640 0 client.6510 ms_handle_reset on v2:172.21.15.90:6832/1524104545 2024-09-10T23:17:36.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9356c1e740 1 --2- 172.21.15.90:0/1517945052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac9247fa0 0x556ac9244720 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9356c1e740 1 --2- 172.21.15.90:0/1517945052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556ac922d1b0 0x556ac922c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9356c1e740 1 -- 172.21.15.90:0/1517945052 >> 172.21.15.90:0/1517945052 conn(0x556ac92025f0 msgr2=0x556ac925b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:36.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9356c1e740 1 -- 172.21.15.90:0/1517945052 shutdown_connections 2024-09-10T23:17:36.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9356c1e740 1 -- 172.21.15.90:0/1517945052 wait complete. 2024-09-10T23:17:36.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9356c1e740 20 client.6510 trim_cache size 0 max 16384 2024-09-10T23:17:36.813 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:17:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd", 2024-09-10T23:17:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2024-09-10T23:17:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 6351, 2024-09-10T23:17:36.813 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-09-10T23:17:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-09-10T23:17:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2024-09-10T23:17:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 8.9837501960000008, 2024-09-10T23:17:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 44, 2024-09-10T23:17:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 81, 2024-09-10T23:17:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 81, 2024-09-10T23:17:36.814 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 13.726679581999999 2024-09-10T23:17:36.814 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:17:36.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9353e52640 1 -- 172.21.15.90:0/3836026664 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9330077f70 msgr2=0x7f933007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:36.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9353e52640 1 --2- 172.21.15.90:0/3836026664 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9330077f70 0x7f933007a430 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9348005fd0 tx=0x7f93480094d0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9353e52640 1 -- 172.21.15.90:0/3836026664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c1f5c00 msgr2=0x7f934c0cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:36.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9353e52640 1 --2- 172.21.15.90:0/3836026664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c1f5c00 0x7f934c0cca70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f934400eaa0 tx=0x7f934400ef60 comp rx=0 tx=0).stop 2024-09-10T23:17:36.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9353e52640 1 -- 172.21.15.90:0/3836026664 shutdown_connections 2024-09-10T23:17:36.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9353e52640 1 --2- 172.21.15.90:0/3836026664 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9330077f70 0x7f933007a430 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9353e52640 1 --2- 172.21.15.90:0/3836026664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f934c0ceca0 0x7f934c0cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9353e52640 1 --2- 172.21.15.90:0/3836026664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f934c1f5c00 0x7f934c0cca70 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9353e52640 1 --2- 172.21.15.90:0/3836026664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f934c0b3310 0x7f934c1f7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9353e52640 1 -- 172.21.15.90:0/3836026664 >> 172.21.15.90:0/3836026664 conn(0x7f934c0b19c0 msgr2=0x7f934c15ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:36.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9353e52640 1 -- 172.21.15.90:0/3836026664 shutdown_connections 2024-09-10T23:17:36.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.806+0000 7f9353e52640 1 -- 172.21.15.90:0/3836026664 wait complete. 2024-09-10T23:17:36.818 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:17:36.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.919+0000 7f78c79f3640 1 -- 172.21.15.90:0/290996449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78a8005290 msgr2=0x7f78a800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:36.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.919+0000 7f78c79f3640 1 --2- 172.21.15.90:0/290996449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78a8005290 0x7f78a800b9c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009e20 tx=0x7f78a8005830 comp rx=0 tx=0).stop 2024-09-10T23:17:36.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.919+0000 7f78c79f3640 1 -- 172.21.15.90:0/290996449 shutdown_connections 2024-09-10T23:17:36.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.919+0000 7f78c79f3640 1 --2- 172.21.15.90:0/290996449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78a8005290 0x7f78a800b9c0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.919+0000 7f78c79f3640 1 -- 172.21.15.90:0/290996449 >> 172.21.15.90:0/290996449 conn(0x7f78c00d4090 msgr2=0x7f78c00d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:36.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.919+0000 7f78c79f3640 1 -- 172.21.15.90:0/290996449 shutdown_connections 2024-09-10T23:17:36.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.919+0000 7f78c79f3640 1 -- 172.21.15.90:0/290996449 wait complete. 2024-09-10T23:17:36.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.920+0000 7f78c79f3640 1 Processor -- start 2024-09-10T23:17:36.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.920+0000 7f78c79f3640 1 -- start start 2024-09-10T23:17:36.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.921+0000 7f78c79f3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78a8005290 0x7f78c015b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.921+0000 7f78c79f3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78c01f7ed0 0x7f78c01f8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.921+0000 7f78c79f3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78c0160bc0 0x7f78c0161040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.921+0000 7f78c79f3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f78c00d0a80 con 0x7f78c0160bc0 2024-09-10T23:17:36.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.921+0000 7f78c79f3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f78c00d4d90 con 0x7f78a8005290 2024-09-10T23:17:36.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.921+0000 7f78c79f3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f78c00d0c00 con 0x7f78c01f7ed0 2024-09-10T23:17:36.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.921+0000 7f78c5f90640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78c0160bc0 0x7f78c0161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.921+0000 7f78c5f90640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78c0160bc0 0x7f78c0161040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37286/0 (socket says 172.21.15.90:37286) 2024-09-10T23:17:36.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.921+0000 7f78c5f90640 1 -- 172.21.15.90:0/3969946146 learned_addr learned my addr 172.21.15.90:0/3969946146 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:36.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.921+0000 7f78c4f8e640 1 --2- 172.21.15.90:0/3969946146 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78c01f7ed0 0x7f78c01f8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.921+0000 7f78c578f640 1 --2- 172.21.15.90:0/3969946146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78a8005290 0x7f78c015b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.921+0000 7f78c5f90640 1 -- 172.21.15.90:0/3969946146 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78c01f7ed0 msgr2=0x7f78c01f8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:36.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.921+0000 7f78c5f90640 1 --2- 172.21.15.90:0/3969946146 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78c01f7ed0 0x7f78c01f8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.921+0000 7f78c5f90640 1 -- 172.21.15.90:0/3969946146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78a8005290 msgr2=0x7f78c015b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:36.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.921+0000 7f78c5f90640 1 --2- 172.21.15.90:0/3969946146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78a8005290 0x7f78c015b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:36.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.921+0000 7f78c5f90640 1 -- 172.21.15.90:0/3969946146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c015e870 con 0x7f78c0160bc0 2024-09-10T23:17:36.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.922+0000 7f78c5f90640 1 --2- 172.21.15.90:0/3969946146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78c0160bc0 0x7f78c0161040 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009e20 tx=0x7f78b002cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:36.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.922+0000 7f78bdffb640 1 -- 172.21.15.90:0/3969946146 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b0009a20 con 0x7f78c0160bc0 2024-09-10T23:17:36.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.922+0000 7f78bdffb640 1 -- 172.21.15.90:0/3969946146 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78b0044070 con 0x7f78c0160bc0 2024-09-10T23:17:36.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.922+0000 7f78c79f3640 1 -- 172.21.15.90:0/3969946146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c01f8920 con 0x7f78c0160bc0 2024-09-10T23:17:36.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.922+0000 7f78bdffb640 1 -- 172.21.15.90:0/3969946146 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b0005580 con 0x7f78c0160bc0 2024-09-10T23:17:36.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.922+0000 7f78c79f3640 1 -- 172.21.15.90:0/3969946146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c015eb30 con 0x7f78c0160bc0 2024-09-10T23:17:36.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.923+0000 7f78c79f3640 1 -- 172.21.15.90:0/3969946146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78c006d6f0 con 0x7f78c0160bc0 2024-09-10T23:17:36.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.924+0000 7f78bdffb640 1 -- 172.21.15.90:0/3969946146 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f78b000f040 con 0x7f78c0160bc0 2024-09-10T23:17:36.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.924+0000 7f78bdffb640 1 --2- 172.21.15.90:0/3969946146 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78ac077f70 0x7f78ac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:36.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.924+0000 7f78bdffb640 1 -- 172.21.15.90:0/3969946146 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f78b00bab00 con 0x7f78c0160bc0 2024-09-10T23:17:36.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.924+0000 7f78c578f640 1 --2- 172.21.15.90:0/3969946146 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78ac077f70 0x7f78ac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:36.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.925+0000 7f78c578f640 1 --2- 172.21.15.90:0/3969946146 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78ac077f70 0x7f78ac07a430 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f78b8006cd0 tx=0x7f78b80067a0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:36.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:36.928+0000 7f78bdffb640 1 -- 172.21.15.90:0/3969946146 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f78b0087a70 con 0x7f78c0160bc0 2024-09-10T23:17:37.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37.140+0000 7f78c79f3640 1 -- 172.21.15.90:0/3969946146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f78c015ed00 con 0x7f78c0160bc0 2024-09-10T23:17:37.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37.140+0000 7f78bdffb640 1 -- 172.21.15.90:0/3969946146 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) ==== 53+0+73 (secure 0 0 0) 0x7f78b008c490 con 0x7f78c0160bc0 2024-09-10T23:17:37.142 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:17:37.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37.143+0000 7f78c79f3640 1 -- 172.21.15.90:0/3969946146 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78ac077f70 msgr2=0x7f78ac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:37.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37.143+0000 7f78c79f3640 1 --2- 172.21.15.90:0/3969946146 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78ac077f70 0x7f78ac07a430 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f78b8006cd0 tx=0x7f78b80067a0 comp rx=0 tx=0).stop 2024-09-10T23:17:37.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37.143+0000 7f78c79f3640 1 -- 172.21.15.90:0/3969946146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78c0160bc0 msgr2=0x7f78c0161040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:37.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37.143+0000 7f78c79f3640 1 --2- 172.21.15.90:0/3969946146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78c0160bc0 0x7f78c0161040 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009e20 tx=0x7f78b002cea0 comp rx=0 tx=0).stop 2024-09-10T23:17:37.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37.143+0000 7f78c79f3640 1 -- 172.21.15.90:0/3969946146 shutdown_connections 2024-09-10T23:17:37.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37.143+0000 7f78c79f3640 1 --2- 172.21.15.90:0/3969946146 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f78ac077f70 0x7f78ac07a430 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:37.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37.143+0000 7f78c79f3640 1 --2- 172.21.15.90:0/3969946146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78c0160bc0 0x7f78c0161040 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:37.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37.143+0000 7f78c79f3640 1 --2- 172.21.15.90:0/3969946146 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78c01f7ed0 0x7f78c01f8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:37.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37.143+0000 7f78c79f3640 1 --2- 172.21.15.90:0/3969946146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78a8005290 0x7f78c015b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:37.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37.143+0000 7f78c79f3640 1 -- 172.21.15.90:0/3969946146 >> 172.21.15.90:0/3969946146 conn(0x7f78c00d4090 msgr2=0x7f78c006d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:37.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37.143+0000 7f78c79f3640 1 -- 172.21.15.90:0/3969946146 shutdown_connections 2024-09-10T23:17:37.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37.143+0000 7f78c79f3640 1 -- 172.21.15.90:0/3969946146 wait complete. 2024-09-10T23:17:37.155 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:17:37.155 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:17:37.155 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2024-09-10T23:17:37.155 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:17:37.155 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:17:37.155 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:17:37.155 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:17:37.156 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:17:37.156 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:17:37.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:37.156 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2024-09-10T23:17:37.172 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:17:37.172 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:17:37.172 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:17:37.172 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:37.172 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-10T23:17:37.172 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:37.173 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:17:37.173 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:37.173 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2024-09-10T23:17:37.173 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:17:37.173 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:37.173 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2024-09-10T23:17:37.173 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:17:37.173 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:37.173 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:17:37.173 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:37.173 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:17:37.173 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42591sec preferred_lft 42591sec 2024-09-10T23:17:37.174 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link noprefixroute 2024-09-10T23:17:37.174 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:37.174 INFO:teuthology.orchestra.run.smithi090.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:17:37.174 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:37.174 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:17:37.174 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:37.174 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::882a:a9ff:fefc:893f/64 scope link 2024-09-10T23:17:37.174 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:37.174 INFO:teuthology.orchestra.run.smithi090.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:17:37.174 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 76:ad:51:1a:2a:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:17:37.174 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::74ad:51ff:fe1a:2a60/64 scope link 2024-09-10T23:17:37.174 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:37.174 INFO:teuthology.orchestra.run.smithi090.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:17:37.175 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:17:37.175 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::3414:abff:fe49:366c/64 scope link 2024-09-10T23:17:37.175 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:37.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:37.175 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:17:37.235 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-09-10T23:17:37.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:37.237 DEBUG:teuthology.orchestra.run.smithi090:> route 2024-09-10T23:17:37.293 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2024-09-10T23:17:37.294 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:17:37.294 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:17:37.294 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:17:37.294 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:17:37.294 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:17:37.294 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:17:37.294 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:17:37.294 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:17:37.295 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:17:37.295 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:17:37.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:17:37.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:17:37.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:37.419 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-10T23:17:37.435 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:17:37.435 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:17:37.436 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:17:37.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:37.436 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2024-09-10T23:17:37.500 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:17:37.500 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:17:37.556 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:17:37.556 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:17:37.556 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:17:37.611 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:17:37.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:37.612 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:17:37.694 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:17:37.695 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:17:37.695 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:17:37.703 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:17:37.703 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:17:37.704 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:17:37.704 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:17:37.704 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:17:37.709 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:17:37.709 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:17:37.709 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:17:37.709 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:17:37.709 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:17:37.709 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:17:37.710 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:17:37.714 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:17:37.715 INFO:teuthology.orchestra.run.smithi090.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T23:17:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:17:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:17:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:17:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:17:37.715 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:17:37.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:37.715 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:17:37.780 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:17:37.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:17:37.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:17:37.880 INFO:teuthology.orchestra.run.smithi090.stdout:client6519 2024-09-10T23:17:37.880 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:17:37.881 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:37.897 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:17:38.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.038+0000 7ff32030e640 1 -- 172.21.15.90:0/308048032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3180d16f0 msgr2=0x7ff3180d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:38.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.038+0000 7ff32030e640 1 --2- 172.21.15.90:0/308048032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3180d16f0 0x7ff3180d0fc0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7ff31808c880 tx=0x7ff30c02a4a0 comp rx=0 tx=0).stop 2024-09-10T23:17:38.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.038+0000 7ff32030e640 1 -- 172.21.15.90:0/308048032 shutdown_connections 2024-09-10T23:17:38.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.038+0000 7ff32030e640 1 --2- 172.21.15.90:0/308048032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3180d16f0 0x7ff3180d0fc0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:38.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.038+0000 7ff32030e640 1 --2- 172.21.15.90:0/308048032 >> v2:172.21.15.171:3300/0 conn(0x7ff31815e310 0x7ff3180d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:38.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.038+0000 7ff32030e640 1 -- 172.21.15.90:0/308048032 >> 172.21.15.90:0/308048032 conn(0x7ff3180d4090 msgr2=0x7ff3180d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:38.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.038+0000 7ff32030e640 1 -- 172.21.15.90:0/308048032 shutdown_connections 2024-09-10T23:17:38.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.038+0000 7ff32030e640 1 -- 172.21.15.90:0/308048032 wait complete. 2024-09-10T23:17:38.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.039+0000 7ff32030e640 1 Processor -- start 2024-09-10T23:17:38.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.040+0000 7ff32030e640 1 -- start start 2024-09-10T23:17:38.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.040+0000 7ff32030e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3180d16f0 0x7ff3180cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:38.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.040+0000 7ff32030e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3180d4b80 0x7ff318158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:38.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.040+0000 7ff32030e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff31815e310 0x7ff3180cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:38.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.040+0000 7ff32030e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff3180cf7f0 con 0x7ff31815e310 2024-09-10T23:17:38.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.040+0000 7ff32030e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff3180d3ae0 con 0x7ff3180d4b80 2024-09-10T23:17:38.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.040+0000 7ff32030e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff31806de00 con 0x7ff3180d16f0 2024-09-10T23:17:38.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.040+0000 7ff31e8ab640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff31815e310 0x7ff3180cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:38.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.040+0000 7ff31e8ab640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff31815e310 0x7ff3180cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37306/0 (socket says 172.21.15.90:37306) 2024-09-10T23:17:38.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.040+0000 7ff31e8ab640 1 -- 172.21.15.90:0/1536096312 learned_addr learned my addr 172.21.15.90:0/1536096312 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:38.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.041+0000 7ff31d8a9640 1 --2- 172.21.15.90:0/1536096312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3180d4b80 0x7ff318158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:38.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.041+0000 7ff31e0aa640 1 --2- 172.21.15.90:0/1536096312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3180d16f0 0x7ff3180cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:38.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.041+0000 7ff31e8ab640 1 -- 172.21.15.90:0/1536096312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3180d16f0 msgr2=0x7ff3180cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:38.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.041+0000 7ff31e8ab640 1 --2- 172.21.15.90:0/1536096312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3180d16f0 0x7ff3180cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:38.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.041+0000 7ff31e8ab640 1 -- 172.21.15.90:0/1536096312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3180d4b80 msgr2=0x7ff318158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:38.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.041+0000 7ff31e8ab640 1 --2- 172.21.15.90:0/1536096312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3180d4b80 0x7ff318158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:38.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.041+0000 7ff31e8ab640 1 -- 172.21.15.90:0/1536096312 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3181f8230 con 0x7ff31815e310 2024-09-10T23:17:38.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.041+0000 7ff31e8ab640 1 --2- 172.21.15.90:0/1536096312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff31815e310 0x7ff3180cd750 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff31000c400 tx=0x7ff31000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:38.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.041+0000 7ff316ffd640 1 -- 172.21.15.90:0/1536096312 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff310017070 con 0x7ff31815e310 2024-09-10T23:17:38.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.041+0000 7ff316ffd640 1 -- 172.21.15.90:0/1536096312 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3100035f0 con 0x7ff31815e310 2024-09-10T23:17:38.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.041+0000 7ff316ffd640 1 -- 172.21.15.90:0/1536096312 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff310003a40 con 0x7ff31815e310 2024-09-10T23:17:38.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.041+0000 7ff32030e640 1 -- 172.21.15.90:0/1536096312 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3181f8510 con 0x7ff31815e310 2024-09-10T23:17:38.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.041+0000 7ff32030e640 1 -- 172.21.15.90:0/1536096312 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3181f8ad0 con 0x7ff31815e310 2024-09-10T23:17:38.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.042+0000 7ff32030e640 1 -- 172.21.15.90:0/1536096312 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff31806e320 con 0x7ff31815e310 2024-09-10T23:17:38.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.043+0000 7ff316ffd640 1 -- 172.21.15.90:0/1536096312 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff310003be0 con 0x7ff31815e310 2024-09-10T23:17:38.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.043+0000 7ff316ffd640 1 --2- 172.21.15.90:0/1536096312 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff304077fa0 0x7ff30407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:38.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.043+0000 7ff316ffd640 1 -- 172.21.15.90:0/1536096312 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7ff310099350 con 0x7ff31815e310 2024-09-10T23:17:38.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.043+0000 7ff31e0aa640 1 --2- 172.21.15.90:0/1536096312 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff304077fa0 0x7ff30407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:38.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.044+0000 7ff31e0aa640 1 --2- 172.21.15.90:0/1536096312 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff304077fa0 0x7ff30407a460 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff31806db20 tx=0x7ff3080094f0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:38.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.047+0000 7ff316ffd640 1 -- 172.21.15.90:0/1536096312 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff310061e50 con 0x7ff31815e310 2024-09-10T23:17:38.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.260+0000 7ff32030e640 1 -- 172.21.15.90:0/1536096312 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff3181f8e40 con 0x7ff31815e310 2024-09-10T23:17:38.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.260+0000 7ff316ffd640 1 -- 172.21.15.90:0/1536096312 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) ==== 53+0+73 (secure 0 0 0) 0x7ff310061750 con 0x7ff31815e310 2024-09-10T23:17:38.262 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:17:38.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.262+0000 7ff32030e640 1 -- 172.21.15.90:0/1536096312 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff304077fa0 msgr2=0x7ff30407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:38.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.262+0000 7ff32030e640 1 --2- 172.21.15.90:0/1536096312 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff304077fa0 0x7ff30407a460 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff31806db20 tx=0x7ff3080094f0 comp rx=0 tx=0).stop 2024-09-10T23:17:38.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.262+0000 7ff32030e640 1 -- 172.21.15.90:0/1536096312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff31815e310 msgr2=0x7ff3180cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:38.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.262+0000 7ff32030e640 1 --2- 172.21.15.90:0/1536096312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff31815e310 0x7ff3180cd750 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff31000c400 tx=0x7ff31000c8c0 comp rx=0 tx=0).stop 2024-09-10T23:17:38.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.263+0000 7ff32030e640 1 -- 172.21.15.90:0/1536096312 shutdown_connections 2024-09-10T23:17:38.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.263+0000 7ff32030e640 1 --2- 172.21.15.90:0/1536096312 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff304077fa0 0x7ff30407a460 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:38.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.263+0000 7ff32030e640 1 --2- 172.21.15.90:0/1536096312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3180d4b80 0x7ff318158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:38.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.263+0000 7ff32030e640 1 --2- 172.21.15.90:0/1536096312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff31815e310 0x7ff3180cd750 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:38.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.263+0000 7ff32030e640 1 --2- 172.21.15.90:0/1536096312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3180d16f0 0x7ff3180cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:38.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.263+0000 7ff32030e640 1 -- 172.21.15.90:0/1536096312 >> 172.21.15.90:0/1536096312 conn(0x7ff3180d4090 msgr2=0x7ff3180d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:38.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.263+0000 7ff32030e640 1 -- 172.21.15.90:0/1536096312 shutdown_connections 2024-09-10T23:17:38.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:38.263+0000 7ff32030e640 1 -- 172.21.15.90:0/1536096312 wait complete. 2024-09-10T23:17:38.274 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:17:38.274 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:17:38.274 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-09-10T23:17:38.274 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T23:17:38.274 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T23:17:38.275 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:17:38.275 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:17:38.275 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:17:38.275 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:17:38.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:38.275 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-09-10T23:17:38.294 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:17:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:17:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:17:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-09-10T23:17:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:38.295 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:17:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-09-10T23:17:38.295 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:17:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-09-10T23:17:38.295 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:17:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:38.296 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:17:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:17:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42572sec preferred_lft 42572sec 2024-09-10T23:17:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link noprefixroute 2024-09-10T23:17:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:38.296 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:17:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:17:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:17:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::c18:12ff:fe41:788b/64 scope link 2024-09-10T23:17:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:38.296 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:17:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:17:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a0e4:c6ff:fe48:8d44/64 scope link 2024-09-10T23:17:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:38.297 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:17:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a6:c9:8b:0f:78:86 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:17:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a4c9:8bff:fe0f:7886/64 scope link 2024-09-10T23:17:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:17:38.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:38.297 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:17:38.363 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-09-10T23:17:38.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:38.365 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-09-10T23:17:38.423 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-09-10T23:17:38.423 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:17:38.423 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:17:38.423 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:17:38.423 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:17:38.424 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:17:38.424 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:17:38.424 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:17:38.424 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:17:38.424 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:17:38.424 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:17:38.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:17:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:17:38.549 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:17:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:17:38.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:38.556 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-09-10T23:17:38.571 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T23:17:38.572 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T23:17:38.572 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:17:38.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:38.572 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-09-10T23:17:38.637 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:17:38.637 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T23:17:38.693 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:17:38.693 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:17:38.693 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:17:38.750 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:17:38.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:38.751 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:17:38.834 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:17:38.834 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:17:38.834 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:17:38.842 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:17:38.843 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:17:38.843 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:17:38.843 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:17:38.843 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:17:38.847 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:17:38.848 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:17:38.848 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:17:38.848 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:17:38.848 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:17:38.848 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:17:38.848 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:17:38.848 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:17:38.848 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T23:17:38.848 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:17:38.849 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:17:38.849 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:17:38.849 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:17:38.850 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:17:38.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:38.850 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:17:38.915 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:17:39.005 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:17:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:17:39.007 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:17:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:17:39.013 INFO:teuthology.orchestra.run.smithi171.stdout:client5890 2024-09-10T23:17:39.013 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:17:39.013 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:39.029 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds ms_async_reap_threshold 1 2024-09-10T23:17:39.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.139+0000 7f5d799f8640 1 -- 172.21.15.90:0/39617487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d740d2a00 msgr2=0x7f5d740b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:39.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.139+0000 7f5d799f8640 1 --2- 172.21.15.90:0/39617487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d740d2a00 0x7f5d740b1c20 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c005fd0 tx=0x7f5d6c02a540 comp rx=0 tx=0).stop 2024-09-10T23:17:39.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.139+0000 7f5d799f8640 1 -- 172.21.15.90:0/39617487 shutdown_connections 2024-09-10T23:17:39.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.139+0000 7f5d799f8640 1 --2- 172.21.15.90:0/39617487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d740d2a00 0x7f5d740b1c20 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:39.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.139+0000 7f5d799f8640 1 --2- 172.21.15.90:0/39617487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d740ced00 0x7f5d740b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:39.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.139+0000 7f5d799f8640 1 -- 172.21.15.90:0/39617487 >> 172.21.15.90:0/39617487 conn(0x7f5d740d1ee0 msgr2=0x7f5d740d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:39.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.139+0000 7f5d799f8640 1 -- 172.21.15.90:0/39617487 shutdown_connections 2024-09-10T23:17:39.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.139+0000 7f5d799f8640 1 -- 172.21.15.90:0/39617487 wait complete. 2024-09-10T23:17:39.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.140+0000 7f5d799f8640 1 Processor -- start 2024-09-10T23:17:39.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.140+0000 7f5d799f8640 1 -- start start 2024-09-10T23:17:39.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.141+0000 7f5d799f8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d740ced00 0x7f5d74153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:39.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.141+0000 7f5d799f8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d740d2a00 0x7f5d7415b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:39.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.141+0000 7f5d799f8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d7415f570 0x7f5d740c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:39.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.141+0000 7f5d799f8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5d740ce220 con 0x7f5d7415f570 2024-09-10T23:17:39.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.141+0000 7f5d799f8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5d740ce0a0 con 0x7f5d740d2a00 2024-09-10T23:17:39.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.141+0000 7f5d799f8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5d740b2160 con 0x7f5d740ced00 2024-09-10T23:17:39.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.141+0000 7f5d737fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d7415f570 0x7f5d740c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:39.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.141+0000 7f5d737fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d7415f570 0x7f5d740c6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42996/0 (socket says 172.21.15.90:42996) 2024-09-10T23:17:39.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.141+0000 7f5d737fe640 1 -- 172.21.15.90:0/539374735 learned_addr learned my addr 172.21.15.90:0/539374735 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:39.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.141+0000 7f5d72ffd640 1 --2- 172.21.15.90:0/539374735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d740ced00 0x7f5d74153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:39.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.141+0000 7f5d727fc640 1 --2- 172.21.15.90:0/539374735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d740d2a00 0x7f5d7415b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:39.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.141+0000 7f5d737fe640 1 -- 172.21.15.90:0/539374735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d740ced00 msgr2=0x7f5d74153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:39.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.141+0000 7f5d737fe640 1 --2- 172.21.15.90:0/539374735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d740ced00 0x7f5d74153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:39.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.141+0000 7f5d737fe640 1 -- 172.21.15.90:0/539374735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d740d2a00 msgr2=0x7f5d7415b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:39.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.141+0000 7f5d737fe640 1 --2- 172.21.15.90:0/539374735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d740d2a00 0x7f5d7415b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:39.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.141+0000 7f5d737fe640 1 -- 172.21.15.90:0/539374735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d741f3f80 con 0x7f5d7415f570 2024-09-10T23:17:39.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.142+0000 7f5d737fe640 1 --2- 172.21.15.90:0/539374735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d7415f570 0x7f5d740c6180 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c006010 tx=0x7f5d6c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:39.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.142+0000 7f5d6bfff640 1 -- 172.21.15.90:0/539374735 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c03f070 con 0x7f5d7415f570 2024-09-10T23:17:39.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.142+0000 7f5d6bfff640 1 -- 172.21.15.90:0/539374735 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d6c004890 con 0x7f5d7415f570 2024-09-10T23:17:39.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.142+0000 7f5d6bfff640 1 -- 172.21.15.90:0/539374735 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c035030 con 0x7f5d7415f570 2024-09-10T23:17:39.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.142+0000 7f5d799f8640 1 -- 172.21.15.90:0/539374735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d741f4260 con 0x7f5d7415f570 2024-09-10T23:17:39.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.142+0000 7f5d799f8640 1 -- 172.21.15.90:0/539374735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d741f4820 con 0x7f5d7415f570 2024-09-10T23:17:39.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.143+0000 7f5d799f8640 1 -- 172.21.15.90:0/539374735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d740b2660 con 0x7f5d7415f570 2024-09-10T23:17:39.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.143+0000 7f5d6bfff640 1 -- 172.21.15.90:0/539374735 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5d6c004ce0 con 0x7f5d7415f570 2024-09-10T23:17:39.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.144+0000 7f5d6bfff640 1 --2- 172.21.15.90:0/539374735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5d54077f70 0x7f5d5407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:39.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.144+0000 7f5d6bfff640 1 -- 172.21.15.90:0/539374735 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f5d6c0bad90 con 0x7f5d7415f570 2024-09-10T23:17:39.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.144+0000 7f5d72ffd640 1 --2- 172.21.15.90:0/539374735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5d54077f70 0x7f5d5407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:39.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.145+0000 7f5d72ffd640 1 --2- 172.21.15.90:0/539374735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5d54077f70 0x7f5d5407a430 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5d740c5e20 tx=0x7f5d64009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:39.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.148+0000 7f5d6bfff640 1 -- 172.21.15.90:0/539374735 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5d6c0832d0 con 0x7f5d7415f570 2024-09-10T23:17:39.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.323+0000 7f5d799f8640 1 -- 172.21.15.90:0/539374735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=ms_async_reap_threshold}] v 0) -- 0x7f5d740b0c00 con 0x7f5d7415f570 2024-09-10T23:17:39.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.326+0000 7f5d6bfff640 1 -- 172.21.15.90:0/539374735 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=ms_async_reap_threshold}]=0 v39)=0 v39) ==== 121+0+0 (secure 0 0 0) 0x7f5d6c087d00 con 0x7f5d7415f570 2024-09-10T23:17:39.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.328+0000 7f5d799f8640 1 -- 172.21.15.90:0/539374735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5d54077f70 msgr2=0x7f5d5407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:39.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.328+0000 7f5d799f8640 1 --2- 172.21.15.90:0/539374735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5d54077f70 0x7f5d5407a430 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5d740c5e20 tx=0x7f5d64009040 comp rx=0 tx=0).stop 2024-09-10T23:17:39.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.328+0000 7f5d799f8640 1 -- 172.21.15.90:0/539374735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d7415f570 msgr2=0x7f5d740c6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:39.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.328+0000 7f5d799f8640 1 --2- 172.21.15.90:0/539374735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d7415f570 0x7f5d740c6180 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c006010 tx=0x7f5d6c003960 comp rx=0 tx=0).stop 2024-09-10T23:17:39.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.329+0000 7f5d799f8640 1 -- 172.21.15.90:0/539374735 shutdown_connections 2024-09-10T23:17:39.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.329+0000 7f5d799f8640 1 --2- 172.21.15.90:0/539374735 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5d54077f70 0x7f5d5407a430 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:39.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.329+0000 7f5d799f8640 1 --2- 172.21.15.90:0/539374735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d740d2a00 0x7f5d7415b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:39.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.329+0000 7f5d799f8640 1 --2- 172.21.15.90:0/539374735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d7415f570 0x7f5d740c6180 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:39.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.329+0000 7f5d799f8640 1 --2- 172.21.15.90:0/539374735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d740ced00 0x7f5d74153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:39.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.329+0000 7f5d799f8640 1 -- 172.21.15.90:0/539374735 >> 172.21.15.90:0/539374735 conn(0x7f5d740d1ee0 msgr2=0x7f5d74071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:39.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.329+0000 7f5d799f8640 1 -- 172.21.15.90:0/539374735 shutdown_connections 2024-09-10T23:17:39.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.329+0000 7f5d799f8640 1 -- 172.21.15.90:0/539374735 wait complete. 2024-09-10T23:17:39.340 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:17:39.340 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:39.356 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:17:39.357 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:39.413 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:17:39.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.554+0000 7f05db0c6640 1 -- 172.21.15.90:0/2282751218 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05d4141120 msgr2=0x7f05d415b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:39.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.554+0000 7f05db0c6640 1 --2- 172.21.15.90:0/2282751218 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05d4141120 0x7f05d415b250 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f05c4009830 tx=0x7f05c402a510 comp rx=0 tx=0).stop 2024-09-10T23:17:39.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.554+0000 7f05db0c6640 1 -- 172.21.15.90:0/2282751218 shutdown_connections 2024-09-10T23:17:39.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.554+0000 7f05db0c6640 1 --2- 172.21.15.90:0/2282751218 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05d406f3c0 0x7f05d40ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:39.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.554+0000 7f05db0c6640 1 --2- 172.21.15.90:0/2282751218 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05d4141120 0x7f05d415b250 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:39.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.554+0000 7f05db0c6640 1 -- 172.21.15.90:0/2282751218 >> 172.21.15.90:0/2282751218 conn(0x7f05d40697a0 msgr2=0x7f05d406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:39.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.554+0000 7f05db0c6640 1 -- 172.21.15.90:0/2282751218 shutdown_connections 2024-09-10T23:17:39.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.554+0000 7f05db0c6640 1 -- 172.21.15.90:0/2282751218 wait complete. 2024-09-10T23:17:39.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.555+0000 7f05db0c6640 1 Processor -- start 2024-09-10T23:17:39.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.555+0000 7f05db0c6640 1 -- start start 2024-09-10T23:17:39.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.556+0000 7f05db0c6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05d406f3c0 0x7f05d4151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:39.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.556+0000 7f05db0c6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05d4141120 0x7f05d40ac510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:39.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.556+0000 7f05db0c6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05d415e870 0x7f05d40c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:39.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.556+0000 7f05db0c6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f05d40cf740 con 0x7f05d415e870 2024-09-10T23:17:39.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.556+0000 7f05db0c6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f05d40cf5c0 con 0x7f05d406f3c0 2024-09-10T23:17:39.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.556+0000 7f05db0c6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f05d40cf8c0 con 0x7f05d4141120 2024-09-10T23:17:39.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.556+0000 7f05d9663640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05d415e870 0x7f05d40c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.556+0000 7f05d9663640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05d415e870 0x7f05d40c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43024/0 (socket says 172.21.15.90:43024) 2024-09-10T23:17:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.556+0000 7f05d9663640 1 -- 172.21.15.90:0/2221276778 learned_addr learned my addr 172.21.15.90:0/2221276778 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.556+0000 7f05d8e62640 1 --2- 172.21.15.90:0/2221276778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05d406f3c0 0x7f05d4151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.556+0000 7f05d3fff640 1 --2- 172.21.15.90:0/2221276778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05d4141120 0x7f05d40ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.556+0000 7f05d9663640 1 -- 172.21.15.90:0/2221276778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05d4141120 msgr2=0x7f05d40ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.556+0000 7f05d9663640 1 --2- 172.21.15.90:0/2221276778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05d4141120 0x7f05d40ac510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.556+0000 7f05d9663640 1 -- 172.21.15.90:0/2221276778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05d406f3c0 msgr2=0x7f05d4151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.556+0000 7f05d9663640 1 --2- 172.21.15.90:0/2221276778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05d406f3c0 0x7f05d4151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.556+0000 7f05d9663640 1 -- 172.21.15.90:0/2221276778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d41f3650 con 0x7f05d415e870 2024-09-10T23:17:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.556+0000 7f05d9663640 1 --2- 172.21.15.90:0/2221276778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05d415e870 0x7f05d40c5f40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f05cc00d750 tx=0x7f05cc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.557+0000 7f05d17fa640 1 -- 172.21.15.90:0/2221276778 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc017070 con 0x7f05d415e870 2024-09-10T23:17:39.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.557+0000 7f05d17fa640 1 -- 172.21.15.90:0/2221276778 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05cc009cc0 con 0x7f05d415e870 2024-09-10T23:17:39.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.557+0000 7f05db0c6640 1 -- 172.21.15.90:0/2221276778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d41f3930 con 0x7f05d415e870 2024-09-10T23:17:39.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.557+0000 7f05d17fa640 1 -- 172.21.15.90:0/2221276778 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc00de60 con 0x7f05d415e870 2024-09-10T23:17:39.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.557+0000 7f05db0c6640 1 -- 172.21.15.90:0/2221276778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d40c5740 con 0x7f05d415e870 2024-09-10T23:17:39.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.558+0000 7f05db0c6640 1 -- 172.21.15.90:0/2221276778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05d406a430 con 0x7f05d415e870 2024-09-10T23:17:39.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.558+0000 7f05d17fa640 1 -- 172.21.15.90:0/2221276778 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f05cc005280 con 0x7f05d415e870 2024-09-10T23:17:39.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.559+0000 7f05d17fa640 1 --2- 172.21.15.90:0/2221276778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05c0077fa0 0x7f05c007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:39.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.559+0000 7f05d17fa640 1 -- 172.21.15.90:0/2221276778 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f05cc099df0 con 0x7f05d415e870 2024-09-10T23:17:39.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.559+0000 7f05d8e62640 1 --2- 172.21.15.90:0/2221276778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05c0077fa0 0x7f05c007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:39.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.560+0000 7f05d8e62640 1 --2- 172.21.15.90:0/2221276778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05c0077fa0 0x7f05c007a460 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f05c4034000 tx=0x7f05c4004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:39.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.563+0000 7f05d17fa640 1 -- 172.21.15.90:0/2221276778 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f05cc0622b0 con 0x7f05d415e870 2024-09-10T23:17:39.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.746+0000 7f05db0c6640 1 -- 172.21.15.90:0/2221276778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f05d415d6e0 con 0x7f05d415e870 2024-09-10T23:17:39.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.746+0000 7f05d17fa640 1 -- 172.21.15.90:0/2221276778 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v81) ==== 80+0+0 (secure 0 0 0) 0x7f05cc066ce0 con 0x7f05d415e870 2024-09-10T23:17:39.747 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:17:39.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.748+0000 7f05db0c6640 1 -- 172.21.15.90:0/2221276778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05c0077fa0 msgr2=0x7f05c007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:39.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.748+0000 7f05db0c6640 1 --2- 172.21.15.90:0/2221276778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05c0077fa0 0x7f05c007a460 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f05c4034000 tx=0x7f05c4004730 comp rx=0 tx=0).stop 2024-09-10T23:17:39.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.748+0000 7f05db0c6640 1 -- 172.21.15.90:0/2221276778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05d415e870 msgr2=0x7f05d40c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:39.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.748+0000 7f05db0c6640 1 --2- 172.21.15.90:0/2221276778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05d415e870 0x7f05d40c5f40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f05cc00d750 tx=0x7f05cc00dc10 comp rx=0 tx=0).stop 2024-09-10T23:17:39.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.748+0000 7f05db0c6640 1 -- 172.21.15.90:0/2221276778 shutdown_connections 2024-09-10T23:17:39.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.748+0000 7f05db0c6640 1 --2- 172.21.15.90:0/2221276778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05c0077fa0 0x7f05c007a460 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:39.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.748+0000 7f05db0c6640 1 --2- 172.21.15.90:0/2221276778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05d415e870 0x7f05d40c5f40 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:39.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.748+0000 7f05db0c6640 1 --2- 172.21.15.90:0/2221276778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05d4141120 0x7f05d40ac510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:39.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.748+0000 7f05db0c6640 1 --2- 172.21.15.90:0/2221276778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05d406f3c0 0x7f05d4151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:39.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.748+0000 7f05db0c6640 1 -- 172.21.15.90:0/2221276778 >> 172.21.15.90:0/2221276778 conn(0x7f05d40697a0 msgr2=0x7f05d406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:39.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.748+0000 7f05db0c6640 1 -- 172.21.15.90:0/2221276778 shutdown_connections 2024-09-10T23:17:39.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:39.748+0000 7f05db0c6640 1 -- 172.21.15.90:0/2221276778 wait complete. 2024-09-10T23:17:39.760 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T23:17:39.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:39.760 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T23:17:39.791 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:17:39.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:39.792 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:17:39.847 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:17:39.847 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:39.865 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:17:39.865 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:39.923 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:17:40.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.024+0000 7f96292c6640 1 -- 172.21.15.90:0/3655971823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f962406d6d0 msgr2=0x7f96240cf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.024+0000 7f96292c6640 1 --2- 172.21.15.90:0/3655971823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f962406d6d0 0x7f96240cf180 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f962408d4b0 tx=0x7f961c02ab40 comp rx=0 tx=0).stop 2024-09-10T23:17:40.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.024+0000 7f96292c6640 1 -- 172.21.15.90:0/3655971823 shutdown_connections 2024-09-10T23:17:40.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.024+0000 7f96292c6640 1 --2- 172.21.15.90:0/3655971823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f962406d6d0 0x7f96240cf180 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.024+0000 7f96292c6640 1 --2- 172.21.15.90:0/3655971823 >> v2:172.21.15.171:3300/0 conn(0x7f962406e750 0x7f96240d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.024+0000 7f96292c6640 1 -- 172.21.15.90:0/3655971823 >> 172.21.15.90:0/3655971823 conn(0x7f96240d4090 msgr2=0x7f96240d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:40.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.024+0000 7f96292c6640 1 -- 172.21.15.90:0/3655971823 shutdown_connections 2024-09-10T23:17:40.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.024+0000 7f96292c6640 1 -- 172.21.15.90:0/3655971823 wait complete. 2024-09-10T23:17:40.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.025+0000 7f96292c6640 1 Processor -- start 2024-09-10T23:17:40.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.025+0000 7f96292c6640 1 -- start start 2024-09-10T23:17:40.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f96292c6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f962406d6d0 0x7f9624158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f96292c6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f962406e750 0x7f96240b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f96292c6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f962415e180 0x7f9624155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f96292c6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f96240cf840 con 0x7f962406d6d0 2024-09-10T23:17:40.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f96292c6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f96240cf6c0 con 0x7f962406e750 2024-09-10T23:17:40.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f96292c6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f96240cf9c0 con 0x7f962415e180 2024-09-10T23:17:40.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f9622ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f962406d6d0 0x7f9624158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f9622ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f962406d6d0 0x7f9624158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43048/0 (socket says 172.21.15.90:43048) 2024-09-10T23:17:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f9622ffd640 1 -- 172.21.15.90:0/4170884499 learned_addr learned my addr 172.21.15.90:0/4170884499 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f96227fc640 1 --2- 172.21.15.90:0/4170884499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f962406e750 0x7f96240b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f96237fe640 1 --2- 172.21.15.90:0/4170884499 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f962415e180 0x7f9624155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f9622ffd640 1 -- 172.21.15.90:0/4170884499 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f962415e180 msgr2=0x7f9624155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f9622ffd640 1 --2- 172.21.15.90:0/4170884499 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f962415e180 0x7f9624155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f9622ffd640 1 -- 172.21.15.90:0/4170884499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f962406e750 msgr2=0x7f96240b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f9622ffd640 1 --2- 172.21.15.90:0/4170884499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f962406e750 0x7f96240b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f9622ffd640 1 -- 172.21.15.90:0/4170884499 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96240b60f0 con 0x7f962406d6d0 2024-09-10T23:17:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f96237fe640 1 --2- 172.21.15.90:0/4170884499 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f962415e180 0x7f9624155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f9622ffd640 1 --2- 172.21.15.90:0/4170884499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f962406d6d0 0x7f9624158ea0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f961400c3a0 tx=0x7f961400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.026+0000 7f960b7fe640 1 -- 172.21.15.90:0/4170884499 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9614017070 con 0x7f962406d6d0 2024-09-10T23:17:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.027+0000 7f960b7fe640 1 -- 172.21.15.90:0/4170884499 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96140053c0 con 0x7f962406d6d0 2024-09-10T23:17:40.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.027+0000 7f960b7fe640 1 -- 172.21.15.90:0/4170884499 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9614003850 con 0x7f962406d6d0 2024-09-10T23:17:40.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.027+0000 7f96292c6640 1 -- 172.21.15.90:0/4170884499 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9624157e00 con 0x7f962406d6d0 2024-09-10T23:17:40.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.027+0000 7f96292c6640 1 -- 172.21.15.90:0/4170884499 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96241583c0 con 0x7f962406d6d0 2024-09-10T23:17:40.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.028+0000 7f96292c6640 1 -- 172.21.15.90:0/4170884499 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9624074670 con 0x7f962406d6d0 2024-09-10T23:17:40.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.028+0000 7f960b7fe640 1 -- 172.21.15.90:0/4170884499 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f96140039f0 con 0x7f962406d6d0 2024-09-10T23:17:40.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.029+0000 7f960b7fe640 1 --2- 172.21.15.90:0/4170884499 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9610077f70 0x7f961007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.029+0000 7f960b7fe640 1 -- 172.21.15.90:0/4170884499 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f96140993a0 con 0x7f962406d6d0 2024-09-10T23:17:40.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.029+0000 7f96227fc640 1 --2- 172.21.15.90:0/4170884499 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9610077f70 0x7f961007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.029+0000 7f96227fc640 1 --2- 172.21.15.90:0/4170884499 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9610077f70 0x7f961007a430 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9624155ec0 tx=0x7f9618008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:40.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.033+0000 7f960b7fe640 1 -- 172.21.15.90:0/4170884499 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9624074670 con 0x7f962406d6d0 2024-09-10T23:17:40.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.220+0000 7f96292c6640 1 -- 172.21.15.90:0/4170884499 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f962408e130 con 0x7f962406d6d0 2024-09-10T23:17:40.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.220+0000 7f960b7fe640 1 -- 172.21.15.90:0/4170884499 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v81) ==== 80+0+0 (secure 0 0 0) 0x7f9614061f30 con 0x7f962406d6d0 2024-09-10T23:17:40.222 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:17:40.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.223+0000 7f96292c6640 1 -- 172.21.15.90:0/4170884499 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9610077f70 msgr2=0x7f961007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.223+0000 7f96292c6640 1 --2- 172.21.15.90:0/4170884499 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9610077f70 0x7f961007a430 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9624155ec0 tx=0x7f9618008040 comp rx=0 tx=0).stop 2024-09-10T23:17:40.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.223+0000 7f96292c6640 1 -- 172.21.15.90:0/4170884499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f962406d6d0 msgr2=0x7f9624158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.223+0000 7f96292c6640 1 --2- 172.21.15.90:0/4170884499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f962406d6d0 0x7f9624158ea0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f961400c3a0 tx=0x7f961400c860 comp rx=0 tx=0).stop 2024-09-10T23:17:40.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.223+0000 7f96292c6640 1 -- 172.21.15.90:0/4170884499 shutdown_connections 2024-09-10T23:17:40.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.223+0000 7f96292c6640 1 --2- 172.21.15.90:0/4170884499 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9610077f70 0x7f961007a430 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.223+0000 7f96292c6640 1 --2- 172.21.15.90:0/4170884499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f962406e750 0x7f96240b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.223+0000 7f96292c6640 1 --2- 172.21.15.90:0/4170884499 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f962415e180 0x7f9624155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.223+0000 7f96292c6640 1 --2- 172.21.15.90:0/4170884499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f962406d6d0 0x7f9624158ea0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.223+0000 7f96292c6640 1 -- 172.21.15.90:0/4170884499 >> 172.21.15.90:0/4170884499 conn(0x7f96240d4090 msgr2=0x7f96240b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:40.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.223+0000 7f96292c6640 1 -- 172.21.15.90:0/4170884499 shutdown_connections 2024-09-10T23:17:40.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.223+0000 7f96292c6640 1 -- 172.21.15.90:0/4170884499 wait complete. 2024-09-10T23:17:40.234 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T23:17:40.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:40.235 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T23:17:40.266 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:17:40.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:40.267 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T23:17:40.324 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:17:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.423+0000 7ff67ceef640 1 -- 172.21.15.90:0/630006961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6780cd470 msgr2=0x7ff67815e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.423+0000 7ff67ceef640 1 --2- 172.21.15.90:0/630006961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6780cd470 0x7ff67815e890 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff670005fd0 tx=0x7ff67002b8e0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.423+0000 7ff67ceef640 1 -- 172.21.15.90:0/630006961 shutdown_connections 2024-09-10T23:17:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.423+0000 7ff67ceef640 1 --2- 172.21.15.90:0/630006961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6780cd470 0x7ff67815e890 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.423+0000 7ff67ceef640 1 --2- 172.21.15.90:0/630006961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6780b44a0 0x7ff6780b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.423+0000 7ff67ceef640 1 -- 172.21.15.90:0/630006961 >> 172.21.15.90:0/630006961 conn(0x7ff6780b19c0 msgr2=0x7ff6780b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:40.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.424+0000 7ff67ceef640 1 -- 172.21.15.90:0/630006961 shutdown_connections 2024-09-10T23:17:40.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.424+0000 7ff67ceef640 1 -- 172.21.15.90:0/630006961 wait complete. 2024-09-10T23:17:40.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.425+0000 7ff67ceef640 1 Processor -- start 2024-09-10T23:17:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.425+0000 7ff67ceef640 1 -- start start 2024-09-10T23:17:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff67ceef640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6780b44a0 0x7ff67815d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff67ceef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6780cd470 0x7ff67809aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff67ceef640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6780cf860 0x7ff67815ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff67ceef640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff6780ced20 con 0x7ff6780cd470 2024-09-10T23:17:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff67ceef640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff6780ceba0 con 0x7ff6780cf860 2024-09-10T23:17:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff67ceef640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff67815a8c0 con 0x7ff6780b44a0 2024-09-10T23:17:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff66dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6780cd470 0x7ff67809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff66dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6780cd470 0x7ff67809aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43076/0 (socket says 172.21.15.90:43076) 2024-09-10T23:17:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff66dd9b640 1 -- 172.21.15.90:0/2042409071 learned_addr learned my addr 172.21.15.90:0/2042409071 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff67659c640 1 --2- 172.21.15.90:0/2042409071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6780b44a0 0x7ff67815d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff676d9d640 1 --2- 172.21.15.90:0/2042409071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6780cf860 0x7ff67815ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff66dd9b640 1 -- 172.21.15.90:0/2042409071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6780b44a0 msgr2=0x7ff67815d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff66dd9b640 1 --2- 172.21.15.90:0/2042409071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6780b44a0 0x7ff67815d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff66dd9b640 1 -- 172.21.15.90:0/2042409071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6780cf860 msgr2=0x7ff67815ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff66dd9b640 1 --2- 172.21.15.90:0/2042409071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6780cf860 0x7ff67815ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff66dd9b640 1 -- 172.21.15.90:0/2042409071 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67815b340 con 0x7ff6780cd470 2024-09-10T23:17:40.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff66dd9b640 1 --2- 172.21.15.90:0/2042409071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6780cd470 0x7ff67809aa50 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff66000b410 tx=0x7ff66000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:40.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff66f7fe640 1 -- 172.21.15.90:0/2042409071 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660015020 con 0x7ff6780cd470 2024-09-10T23:17:40.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff66f7fe640 1 -- 172.21.15.90:0/2042409071 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff660011920 con 0x7ff6780cd470 2024-09-10T23:17:40.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.426+0000 7ff66f7fe640 1 -- 172.21.15.90:0/2042409071 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660011d70 con 0x7ff6780cd470 2024-09-10T23:17:40.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.427+0000 7ff67ceef640 1 -- 172.21.15.90:0/2042409071 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6781f7230 con 0x7ff6780cd470 2024-09-10T23:17:40.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.427+0000 7ff67ceef640 1 -- 172.21.15.90:0/2042409071 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6781e43d0 con 0x7ff6780cd470 2024-09-10T23:17:40.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.428+0000 7ff67ceef640 1 -- 172.21.15.90:0/2042409071 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff67815eeb0 con 0x7ff6780cd470 2024-09-10T23:17:40.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.428+0000 7ff66f7fe640 1 -- 172.21.15.90:0/2042409071 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff66001a400 con 0x7ff6780cd470 2024-09-10T23:17:40.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.429+0000 7ff66f7fe640 1 --2- 172.21.15.90:0/2042409071 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff658077fa0 0x7ff65807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.429+0000 7ff66f7fe640 1 -- 172.21.15.90:0/2042409071 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7ff660099df0 con 0x7ff6780cd470 2024-09-10T23:17:40.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.429+0000 7ff67659c640 1 --2- 172.21.15.90:0/2042409071 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff658077fa0 0x7ff65807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.429+0000 7ff67659c640 1 --2- 172.21.15.90:0/2042409071 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff658077fa0 0x7ff65807a460 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff668005fd0 tx=0x7ff66800b390 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:40.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.433+0000 7ff66f7fe640 1 -- 172.21.15.90:0/2042409071 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff66001f020 con 0x7ff6780cd470 2024-09-10T23:17:40.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.643+0000 7ff67ceef640 1 -- 172.21.15.90:0/2042409071 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6780cc480 con 0x7ff6780cd470 2024-09-10T23:17:40.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.643+0000 7ff66f7fe640 1 -- 172.21.15.90:0/2042409071 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5228 (secure 0 0 0) 0x7ff6600622a0 con 0x7ff6780cd470 2024-09-10T23:17:40.644 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:40.644 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":44,"btime":"2024-09-10T23:17:29:843110+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/883446248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":883446248},{"type":"v1","addr":"172.21.15.90:6835","nonce":883446248}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5510,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1558215981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1558215981},{"type":"v1","addr":"172.21.15.171:6836","nonce":1558215981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2584382337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2584382337},{"type":"v1","addr":"172.21.15.171:6837","nonce":2584382337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:27.171227+0000","modified":"2024-09-10T23:17:29.182680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6351":{"gid":6351,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6834/1524104545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1524104545},{"type":"v1","addr":"172.21.15.90:6834","nonce":1524104545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6351,"qdb_cluster":[6351]},"id":6}]} 2024-09-10T23:17:40.645 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 44 2024-09-10T23:17:40.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.645+0000 7ff67ceef640 1 -- 172.21.15.90:0/2042409071 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff658077fa0 msgr2=0x7ff65807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.645+0000 7ff67ceef640 1 --2- 172.21.15.90:0/2042409071 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff658077fa0 0x7ff65807a460 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff668005fd0 tx=0x7ff66800b390 comp rx=0 tx=0).stop 2024-09-10T23:17:40.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.645+0000 7ff67ceef640 1 -- 172.21.15.90:0/2042409071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6780cd470 msgr2=0x7ff67809aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.645+0000 7ff67ceef640 1 --2- 172.21.15.90:0/2042409071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6780cd470 0x7ff67809aa50 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff66000b410 tx=0x7ff66000b8d0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.646+0000 7ff67ceef640 1 -- 172.21.15.90:0/2042409071 shutdown_connections 2024-09-10T23:17:40.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.646+0000 7ff67ceef640 1 --2- 172.21.15.90:0/2042409071 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff658077fa0 0x7ff65807a460 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.646+0000 7ff67ceef640 1 --2- 172.21.15.90:0/2042409071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6780cf860 0x7ff67815ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.646+0000 7ff67ceef640 1 --2- 172.21.15.90:0/2042409071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6780cd470 0x7ff67809aa50 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.646+0000 7ff67ceef640 1 --2- 172.21.15.90:0/2042409071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6780b44a0 0x7ff67815d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.646+0000 7ff67ceef640 1 -- 172.21.15.90:0/2042409071 >> 172.21.15.90:0/2042409071 conn(0x7ff6780b19c0 msgr2=0x7ff6781e6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:40.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.646+0000 7ff67ceef640 1 -- 172.21.15.90:0/2042409071 shutdown_connections 2024-09-10T23:17:40.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.646+0000 7ff67ceef640 1 -- 172.21.15.90:0/2042409071 wait complete. 2024-09-10T23:17:40.658 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-10T23:17:40.771 INFO:teuthology.orchestra.run.smithi090.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":64,"msgr_send_messages":60,"msgr_recv_bytes":124877,"msgr_send_bytes":20335,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.021831508,"msgr_running_send_time":0.004165592,"msgr_running_recv_time":0.020082513,"msgr_running_fast_dispatch_time":0.000374155,"msgr_send_messages_queue_lat":{"avgcount":59,"sum":0.037103083,"avgtime":0.000628865},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":122736,"msgr_send_encrypted_bytes":11712},"AsyncMessenger::Worker-1":{"msgr_recv_messages":46,"msgr_send_messages":49,"msgr_recv_bytes":12124,"msgr_send_bytes":138465,"msgr_created_connections":8,"msgr_active_connections":3,"msgr_running_total_time":0.007712070,"msgr_running_send_time":0.001747106,"msgr_running_recv_time":0.005739995,"msgr_running_fast_dispatch_time":0.000276859,"msgr_send_messages_queue_lat":{"avgcount":48,"sum":0.046160085,"avgtime":0.000961668},"msgr_handle_ack_lat":{"avgcount":29,"sum":0.000008853,"avgtime":0.000000305},"msgr_recv_encrypted_bytes":2032,"msgr_send_encrypted_bytes":96240},"AsyncMessenger::Worker-2":{"msgr_recv_messages":34,"msgr_send_messages":34,"msgr_recv_bytes":8916,"msgr_send_bytes":17766,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.014794228,"msgr_running_send_time":0.001535629,"msgr_running_recv_time":0.012465823,"msgr_running_fast_dispatch_time":0.000780054,"msgr_send_messages_queue_lat":{"avgcount":33,"sum":0.236859713,"avgtime":0.007177567},"msgr_handle_ack_lat":{"avgcount":5,"sum":0.000002692,"avgtime":0.000000538},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":57,"sum":0.001561050,"avgtime":0.000027386}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000011800,"avgtime":0.000005900}},"mds":{"request":29,"reply":29,"reply_latency":{"avgcount":29,"sum":0.004196470,"avgtime":0.000144705},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":2,"subtrees":2,"traverse":55,"traverse_hit":53,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":8,"evex":0,"evtrm":0,"ev":8,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197025,"rdpos":0,"jlat":{"avgcount":6,"sum":0.011199325,"avgtime":0.001866554},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":42456,"heap":264044544},"mds_server":{"dispatch_client_request":29,"dispatch_server_request":0,"handle_client_request":29,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":26,"sum":0.003550669,"avgtime":0.000136564},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":2,"sum":0.000374544,"avgtime":0.000187272},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000271257,"avgtime":0.000271257},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":28,"average_load":14,"avg_session_uptime":0,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":249045,"buffer_anon_items":91,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5312,"osdmap_items":75,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":54408,"mds_co_items":216,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":44,"op_send_bytes":13841,"op_resend":37,"op_reply":44,"op_latency":{"avgcount":44,"sum":0.812987143,"avgtime":0.018476980},"op_inflight":0,"oplen_avg":{"avgcount":44,"sum":68},"op":44,"op_r":0,"op_w":44,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":6,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":81,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":140,"get_sum":129388,"get_or_fail_fail":0,"get_or_fail_success":140,"take":0,"take_sum":0,"put":140,"put_sum":129388,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":13841,"put":44,"put_sum":13841,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":44,"put":44,"put_sum":44,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d65bb58960":{"val":0,"max":3758096384,"get_started":0,"get":8,"get_sum":2721,"get_or_fail_fail":0,"get_or_fail_success":8,"take":0,"take_sum":0,"put":6,"put_sum":2721,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":0}} 2024-09-10T23:17:40.773 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 124877, "msgr_recv_encrypted_bytes": 122736, "msgr_recv_messages": 64, "msgr_running_fast_dispatch_time": 0.000374155, "msgr_running_recv_time": 0.020082513, "msgr_running_send_time": 0.004165592, "msgr_running_total_time": 0.021831508, "msgr_send_bytes": 20335, "msgr_send_encrypted_bytes": 11712, "msgr_send_messages": 60, "msgr_send_messages_queue_lat": { "avgcount": 59, "avgtime": 0.000628865, "sum": 0.037103083 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 29, "avgtime": 3.05e-07, "sum": 8.853e-06 }, "msgr_recv_bytes": 12124, "msgr_recv_encrypted_bytes": 2032, "msgr_recv_messages": 46, "msgr_running_fast_dispatch_time": 0.000276859, "msgr_running_recv_time": 0.005739995, "msgr_running_send_time": 0.001747106, "msgr_running_total_time": 0.00771207, "msgr_send_bytes": 138465, "msgr_send_encrypted_bytes": 96240, "msgr_send_messages": 49, "msgr_send_messages_queue_lat": { "avgcount": 48, "avgtime": 0.000961668, "sum": 0.046160085 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 5, "avgtime": 5.38e-07, "sum": 2.692e-06 }, "msgr_recv_bytes": 8916, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 34, "msgr_running_fast_dispatch_time": 0.000780054, "msgr_running_recv_time": 0.012465823, "msgr_running_send_time": 0.001535629, "msgr_running_total_time": 0.014794228, "msgr_send_bytes": 17766, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 34, "msgr_send_messages_queue_lat": { "avgcount": 33, "avgtime": 0.007177567, "sum": 0.236859713 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 57, "avgtime": 2.7386e-05, "sum": 0.00156105 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 5.9e-06, "sum": 1.18e-05 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 29, "reply_latency": { "avgcount": 29, "avgtime": 0.000144705, "sum": 0.00419647 }, "request": 29, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 55, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 53, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 8, "evadd": 8, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 6, "avgtime": 0.001866554, "sum": 0.011199325 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197025 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 264044544, "ino": 13, "ino+": 13, "ino-": 0, "rss": 42456 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 29, "dispatch_server_request": 0, "handle_client_request": 29, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 26, "avgtime": 0.000136564, "sum": 0.003550669 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 2, "avgtime": 0.000187272, "sum": 0.000374544 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000271257, "sum": 0.000271257 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 14, "avg_session_uptime": 0, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 28 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 249045, "buffer_anon_items": 91, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 54408, "mds_co_items": 216, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5312, "osdmap_items": 75, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 81, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 44, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 44, "avgtime": 0.01847698, "sum": 0.812987143 }, "op_pg": 0, "op_r": 0, "op_reply": 44, "op_resend": 37, "op_rmw": 0, "op_send": 44, "op_send_bytes": 13841, "op_w": 44, "oplen_avg": { "avgcount": 44, "sum": 68 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 6, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 140, "get_or_fail_fail": 0, "get_or_fail_success": 140, "get_started": 0, "get_sum": 129388, "max": 104857600, "put": 140, "put_sum": 129388, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 44, "put_sum": 13841, "take": 44, "take_sum": 13841, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 44, "put_sum": 44, "take": 44, "take_sum": 44, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d65bb58960": { "get": 8, "get_or_fail_fail": 0, "get_or_fail_success": 8, "get_started": 0, "get_sum": 2721, "max": 3758096384, "put": 6, "put_sum": 2721, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 0 } } 2024-09-10T23:17:40.773 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 session ls 2024-09-10T23:17:40.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.875+0000 7fb8a553a640 1 -- 172.21.15.90:0/2978139216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8a006e750 msgr2=0x7fb8a00d4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.875+0000 7fb8a553a640 1 --2- 172.21.15.90:0/2978139216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8a006e750 0x7fb8a00d4bb0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb894005fd0 tx=0x7fb89402a670 comp rx=0 tx=0).stop 2024-09-10T23:17:40.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.875+0000 7fb8a553a640 1 -- 172.21.15.90:0/2978139216 shutdown_connections 2024-09-10T23:17:40.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.875+0000 7fb8a553a640 1 --2- 172.21.15.90:0/2978139216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8a006d6d0 0x7fb8a00cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.875+0000 7fb8a553a640 1 --2- 172.21.15.90:0/2978139216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8a006e750 0x7fb8a00d4bb0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.875+0000 7fb8a553a640 1 -- 172.21.15.90:0/2978139216 >> 172.21.15.90:0/2978139216 conn(0x7fb8a00d4090 msgr2=0x7fb8a00d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:40.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.875+0000 7fb8a553a640 1 -- 172.21.15.90:0/2978139216 shutdown_connections 2024-09-10T23:17:40.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.875+0000 7fb8a553a640 1 -- 172.21.15.90:0/2978139216 wait complete. 2024-09-10T23:17:40.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.876+0000 7fb8a553a640 1 Processor -- start 2024-09-10T23:17:40.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.876+0000 7fb8a553a640 1 -- start start 2024-09-10T23:17:40.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb8a553a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8a006d6d0 0x7fb8a00cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb8a553a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8a006e750 0x7fb8a00b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb8a553a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8a015e180 0x7fb8a01f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb8a553a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a00cf840 con 0x7fb8a006e750 2024-09-10T23:17:40.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb8a553a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a00cf6c0 con 0x7fb8a015e180 2024-09-10T23:17:40.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb8a553a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a00cf9c0 con 0x7fb8a006d6d0 2024-09-10T23:17:40.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb89e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8a006e750 0x7fb8a00b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb89e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8a006e750 0x7fb8a00b55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43098/0 (socket says 172.21.15.90:43098) 2024-09-10T23:17:40.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb89e7fc640 1 -- 172.21.15.90:0/1198524375 learned_addr learned my addr 172.21.15.90:0/1198524375 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:40.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb89effd640 1 --2- 172.21.15.90:0/1198524375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8a006d6d0 0x7fb8a00cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb89f7fe640 1 --2- 172.21.15.90:0/1198524375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8a015e180 0x7fb8a01f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb89e7fc640 1 -- 172.21.15.90:0/1198524375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8a006d6d0 msgr2=0x7fb8a00cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb89e7fc640 1 --2- 172.21.15.90:0/1198524375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8a006d6d0 0x7fb8a00cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb89e7fc640 1 -- 172.21.15.90:0/1198524375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8a015e180 msgr2=0x7fb8a01f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb89e7fc640 1 --2- 172.21.15.90:0/1198524375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8a015e180 0x7fb8a01f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb89e7fc640 1 -- 172.21.15.90:0/1198524375 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a00b5dd0 con 0x7fb8a006e750 2024-09-10T23:17:40.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb89f7fe640 1 --2- 172.21.15.90:0/1198524375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8a015e180 0x7fb8a01f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:40.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb89effd640 1 --2- 172.21.15.90:0/1198524375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8a006d6d0 0x7fb8a00cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:40.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.877+0000 7fb89e7fc640 1 --2- 172.21.15.90:0/1198524375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8a006e750 0x7fb8a00b55a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb894006010 tx=0x7fb8940038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:40.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.878+0000 7fb8877fe640 1 -- 172.21.15.90:0/1198524375 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89403f070 con 0x7fb8a006e750 2024-09-10T23:17:40.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.878+0000 7fb8877fe640 1 -- 172.21.15.90:0/1198524375 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8940047a0 con 0x7fb8a006e750 2024-09-10T23:17:40.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.878+0000 7fb8877fe640 1 -- 172.21.15.90:0/1198524375 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb894035030 con 0x7fb8a006e750 2024-09-10T23:17:40.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.878+0000 7fb8a553a640 1 -- 172.21.15.90:0/1198524375 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a00b60b0 con 0x7fb8a006e750 2024-09-10T23:17:40.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.878+0000 7fb8a553a640 1 -- 172.21.15.90:0/1198524375 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a00b6950 con 0x7fb8a006e750 2024-09-10T23:17:40.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.879+0000 7fb8877fe640 1 -- 172.21.15.90:0/1198524375 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb894004b90 con 0x7fb8a006e750 2024-09-10T23:17:40.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.880+0000 7fb8877fe640 1 --2- 172.21.15.90:0/1198524375 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb88c077f70 0x7fb88c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.880+0000 7fb8877fe640 1 -- 172.21.15.90:0/1198524375 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fb8940bae60 con 0x7fb8a006e750 2024-09-10T23:17:40.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.880+0000 7fb89effd640 1 --2- 172.21.15.90:0/1198524375 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb88c077f70 0x7fb88c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.881+0000 7fb8a83e1740 1 Processor -- start 2024-09-10T23:17:40.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.881+0000 7fb89effd640 1 --2- 172.21.15.90:0/1198524375 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb88c077f70 0x7fb88c07a430 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00b8370 tx=0x7fb890009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:40.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.881+0000 7fb8a83e1740 1 -- start start 2024-09-10T23:17:40.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.881+0000 7fb8a83e1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f623c0 0x5638b3f39d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.881+0000 7fb8a83e1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f82000 0x5638b3f82400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.881+0000 7fb8a83e1740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f37800 0x5638b3f37c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.881+0000 7fb8a83e1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5638b3eae8e0 con 0x5638b3f623c0 2024-09-10T23:17:40.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.881+0000 7fb8a83e1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5638b3e9dd10 con 0x5638b3f82000 2024-09-10T23:17:40.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.881+0000 7fb8a83e1740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x5638b3ea1b20 con 0x5638b3f37800 2024-09-10T23:17:40.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.882+0000 7fb89effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f623c0 0x5638b3f39d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.882+0000 7fb89effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f623c0 0x5638b3f39d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43102/0 (socket says 172.21.15.90:43102) 2024-09-10T23:17:40.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.882+0000 7fb89effd640 1 -- 172.21.15.90:0/3191786751 learned_addr learned my addr 172.21.15.90:0/3191786751 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:40.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.882+0000 7fb89f7fe640 1 --2- 172.21.15.90:0/3191786751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f37800 0x5638b3f37c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.882+0000 7fb89e7fc640 1 --2- 172.21.15.90:0/3191786751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f82000 0x5638b3f82400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.882+0000 7fb89effd640 1 -- 172.21.15.90:0/3191786751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f37800 msgr2=0x5638b3f37c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:40.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.882+0000 7fb89effd640 1 --2- 172.21.15.90:0/3191786751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f37800 0x5638b3f37c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.882+0000 7fb89effd640 1 -- 172.21.15.90:0/3191786751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f82000 msgr2=0x5638b3f82400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:40.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.882+0000 7fb89effd640 1 --2- 172.21.15.90:0/3191786751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f82000 0x5638b3f82400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.882+0000 7fb89effd640 1 -- 172.21.15.90:0/3191786751 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638b3bff970 con 0x5638b3f623c0 2024-09-10T23:17:40.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.882+0000 7fb89e7fc640 1 --2- 172.21.15.90:0/3191786751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f82000 0x5638b3f82400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:40.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.882+0000 7fb89f7fe640 1 --2- 172.21.15.90:0/3191786751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f37800 0x5638b3f37c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:40.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.882+0000 7fb89effd640 1 --2- 172.21.15.90:0/3191786751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f623c0 0x5638b3f39d30 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb890001e10 tx=0x7fb890011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc29e79c55a4d6f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:40.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.882+0000 7fb884ff9640 1 -- 172.21.15.90:0/3191786751 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8900035f0 con 0x5638b3f623c0 2024-09-10T23:17:40.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.882+0000 7fb884ff9640 1 -- 172.21.15.90:0/3191786751 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb890003790 con 0x5638b3f623c0 2024-09-10T23:17:40.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.882+0000 7fb884ff9640 1 -- 172.21.15.90:0/3191786751 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890003ba0 con 0x5638b3f623c0 2024-09-10T23:17:40.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.883+0000 7fb8a83e1740 1 -- 172.21.15.90:0/3191786751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f623c0 msgr2=0x5638b3f39d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.883+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/3191786751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f623c0 0x5638b3f39d30 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb890001e10 tx=0x7fb890011000 comp rx=0 tx=0).stop 2024-09-10T23:17:40.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.883+0000 7fb8a83e1740 1 -- 172.21.15.90:0/3191786751 shutdown_connections 2024-09-10T23:17:40.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.883+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/3191786751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f82000 0x5638b3f82400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.883+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/3191786751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f37800 0x5638b3f37c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.883+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/3191786751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f623c0 0x5638b3f39d30 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.883+0000 7fb8a83e1740 1 -- 172.21.15.90:0/3191786751 >> 172.21.15.90:0/3191786751 conn(0x5638b3f388b0 msgr2=0x5638b3f3c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:40.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.883+0000 7fb8a83e1740 1 -- 172.21.15.90:0/3191786751 shutdown_connections 2024-09-10T23:17:40.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.883+0000 7fb8a83e1740 1 -- 172.21.15.90:0/3191786751 wait complete. 2024-09-10T23:17:40.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.883+0000 7fb8a83e1740 1 -- start start 2024-09-10T23:17:40.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.884+0000 7fb8a83e1740 1 Processor -- start 2024-09-10T23:17:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.884+0000 7fb8a83e1740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f623c0 0x5638b3f91990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.884+0000 7fb8a83e1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f82000 0x5638b3f64630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.884+0000 7fb8a83e1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f5b600 0x5638b3f65700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.884+0000 7fb8a83e1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5638b3c0e740 con 0x5638b3f82000 2024-09-10T23:17:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.884+0000 7fb8a83e1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5638b3e437f0 con 0x5638b3f5b600 2024-09-10T23:17:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.884+0000 7fb8a83e1740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x5638b3f36d40 con 0x5638b3f623c0 2024-09-10T23:17:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.884+0000 7fb8a83e1740 10 client.0 _ll_register_callbacks cb 0x5638b3e472a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:17:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.884+0000 7fb89e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f82000 0x5638b3f64630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.884+0000 7fb89e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f82000 0x5638b3f64630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43108/0 (socket says 172.21.15.90:43108) 2024-09-10T23:17:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.884+0000 7fb89e7fc640 1 -- 172.21.15.90:0/215558667 learned_addr learned my addr 172.21.15.90:0/215558667 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb89f7fe640 1 --2- 172.21.15.90:0/215558667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f5b600 0x5638b3f65700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb89effd640 1 --2- 172.21.15.90:0/215558667 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f623c0 0x5638b3f91990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb89e7fc640 1 -- 172.21.15.90:0/215558667 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f623c0 msgr2=0x5638b3f91990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb89e7fc640 1 --2- 172.21.15.90:0/215558667 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f623c0 0x5638b3f91990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb89e7fc640 1 -- 172.21.15.90:0/215558667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f5b600 msgr2=0x5638b3f65700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb89e7fc640 1 --2- 172.21.15.90:0/215558667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f5b600 0x5638b3f65700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb89e7fc640 1 -- 172.21.15.90:0/215558667 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638b3c767d0 con 0x5638b3f82000 2024-09-10T23:17:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb89e7fc640 1 --2- 172.21.15.90:0/215558667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f82000 0x5638b3f64630 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb89402ac60 tx=0x7fb894082bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfe1b96c9955fc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb87dffb640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:17:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb87dffb640 1 -- 172.21.15.90:0/215558667 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb894049040 con 0x5638b3f82000 2024-09-10T23:17:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb87dffb640 1 -- 172.21.15.90:0/215558667 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fb89408c2d0 con 0x5638b3f82000 2024-09-10T23:17:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb8a83e1740 1 -- 172.21.15.90:0/215558667 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb890003790 con 0x5638b3f82000 2024-09-10T23:17:40.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb87dffb640 1 -- 172.21.15.90:0/215558667 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fb894082d70 con 0x5638b3f82000 2024-09-10T23:17:40.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb8a83e1740 10 client.6573 fetch_fsmap learned FSMap version 44 2024-09-10T23:17:40.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb8a83e1740 1 -- 172.21.15.90:0/215558667 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x5638b3f64bd0 con 0x5638b3f82000 2024-09-10T23:17:40.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb87dffb640 1 -- 172.21.15.90:0/215558667 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb890003790 con 0x5638b3f82000 2024-09-10T23:17:40.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb87dffb640 1 -- 172.21.15.90:0/215558667 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 44) ==== 3502+0+0 (secure 0 0 0) 0x7fb89406aba0 con 0x5638b3f82000 2024-09-10T23:17:40.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb8a83e1740 10 client.6573 fetch_fsmap finished waiting for FSMap version 44 2024-09-10T23:17:40.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb8a83e1740 10 client.6573 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-10T23:17:40.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb8a83e1740 20 client.6573 populate_metadata read hostname 'smithi090' 2024-09-10T23:17:40.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/215558667 >> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] conn(0x5638b3f65c40 0x5638b3f5a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb8a83e1740 4 client.6573 mds_command: new command op to 6351 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:17:40.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.885+0000 7fb8a83e1740 1 -- 172.21.15.90:0/215558667 --> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638b3eb0830 con 0x5638b3f65c40 2024-09-10T23:17:40.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.886+0000 7fb89effd640 1 --2- 172.21.15.90:0/215558667 >> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] conn(0x5638b3f65c40 0x5638b3f5a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.886+0000 7fb89effd640 1 --2- 172.21.15.90:0/215558667 >> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] conn(0x5638b3f65c40 0x5638b3f5a150 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b90e1cc0b6cdddcd server_cookie=2454faf3fcfc0f19 in_seq=0 out_seq=0 2024-09-10T23:17:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.886+0000 7fb87dffb640 10 client.6573 ms_handle_connect on v2:172.21.15.90:6832/1524104545 2024-09-10T23:17:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.886+0000 7fb87dffb640 1 -- 172.21.15.90:0/215558667 <== mds.0 v2:172.21.15.90:6832/1524104545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5638b3eb0830 con 0x5638b3f65c40 2024-09-10T23:17:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.886+0000 7fb87dffb640 10 client.6573 handle_command_reply: tid=0 2024-09-10T23:17:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.886+0000 7fb8a83e1740 1 client.6573 shutdown 2024-09-10T23:17:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.886+0000 7fb8a83e1740 1 -- 172.21.15.90:0/215558667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f82000 msgr2=0x5638b3f64630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.886+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/215558667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f82000 0x5638b3f64630 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb89402ac60 tx=0x7fb894082bb0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.887+0000 7fb8a83e1740 1 -- 172.21.15.90:0/215558667 shutdown_connections 2024-09-10T23:17:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.887+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/215558667 >> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] conn(0x5638b3f65c40 0x5638b3f5a150 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.887+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/215558667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f5b600 0x5638b3f65700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.887+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/215558667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f82000 0x5638b3f64630 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.887+0000 7fb87dffb640 0 client.6573 ms_handle_reset on v2:172.21.15.90:6832/1524104545 2024-09-10T23:17:40.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.887+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/215558667 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f623c0 0x5638b3f91990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.887+0000 7fb8a83e1740 1 -- 172.21.15.90:0/215558667 >> 172.21.15.90:0/215558667 conn(0x5638b3f37800 msgr2=0x5638b3f627a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:40.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.887+0000 7fb8a83e1740 1 -- 172.21.15.90:0/215558667 shutdown_connections 2024-09-10T23:17:40.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.887+0000 7fb8a83e1740 1 -- 172.21.15.90:0/215558667 wait complete. 2024-09-10T23:17:40.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.887+0000 7fb8a83e1740 20 client.6573 trim_cache size 0 max 16384 2024-09-10T23:17:40.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.905+0000 7fb8a83e1740 1 Processor -- start 2024-09-10T23:17:40.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.905+0000 7fb8a83e1740 1 -- start start 2024-09-10T23:17:40.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.905+0000 7fb8a83e1740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f5b600 0x5638b3f914d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.905+0000 7fb8a83e1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f623c0 0x5638b3f91a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.905+0000 7fb8a83e1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f82000 0x5638b3f61880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.905+0000 7fb8a83e1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a0201310 con 0x5638b3f82000 2024-09-10T23:17:40.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.905+0000 7fb8a83e1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a0200370 con 0x5638b3f623c0 2024-09-10T23:17:40.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.905+0000 7fb8a83e1740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a01ff790 con 0x5638b3f5b600 2024-09-10T23:17:40.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.905+0000 7fb89f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f82000 0x5638b3f61880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.905+0000 7fb89f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f82000 0x5638b3f61880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43120/0 (socket says 172.21.15.90:43120) 2024-09-10T23:17:40.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.905+0000 7fb89f7fe640 1 -- 172.21.15.90:0/590260699 learned_addr learned my addr 172.21.15.90:0/590260699 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:40.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb89effd640 1 --2- 172.21.15.90:0/590260699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f5b600 0x5638b3f914d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb89e7fc640 1 --2- 172.21.15.90:0/590260699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f623c0 0x5638b3f91a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb89f7fe640 1 -- 172.21.15.90:0/590260699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f5b600 msgr2=0x5638b3f914d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:40.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb89f7fe640 1 --2- 172.21.15.90:0/590260699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f5b600 0x5638b3f914d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb89f7fe640 1 -- 172.21.15.90:0/590260699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f623c0 msgr2=0x5638b3f91a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:40.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb89f7fe640 1 --2- 172.21.15.90:0/590260699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f623c0 0x5638b3f91a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb89f7fe640 1 -- 172.21.15.90:0/590260699 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638b3f5a6e0 con 0x5638b3f82000 2024-09-10T23:17:40.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb89effd640 1 --2- 172.21.15.90:0/590260699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f5b600 0x5638b3f914d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:40.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb89f7fe640 1 --2- 172.21.15.90:0/590260699 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f82000 0x5638b3f61880 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb898009f10 tx=0x7fb8980127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1aaab52f13bcaa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb87ffff640 1 -- 172.21.15.90:0/590260699 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898020070 con 0x5638b3f82000 2024-09-10T23:17:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb87ffff640 1 -- 172.21.15.90:0/590260699 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb898010490 con 0x5638b3f82000 2024-09-10T23:17:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb87ffff640 1 -- 172.21.15.90:0/590260699 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8980108c0 con 0x5638b3f82000 2024-09-10T23:17:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb8a83e1740 1 -- 172.21.15.90:0/590260699 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f82000 msgr2=0x5638b3f61880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/590260699 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f82000 0x5638b3f61880 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb898009f10 tx=0x7fb8980127c0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb8a83e1740 1 -- 172.21.15.90:0/590260699 shutdown_connections 2024-09-10T23:17:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/590260699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f623c0 0x5638b3f91a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/590260699 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f82000 0x5638b3f61880 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/590260699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f5b600 0x5638b3f914d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.906+0000 7fb8a83e1740 1 -- 172.21.15.90:0/590260699 >> 172.21.15.90:0/590260699 conn(0x5638b3f37800 msgr2=0x5638b3f65510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.907+0000 7fb8a83e1740 1 -- 172.21.15.90:0/590260699 shutdown_connections 2024-09-10T23:17:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.907+0000 7fb8a83e1740 1 -- 172.21.15.90:0/590260699 wait complete. 2024-09-10T23:17:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.907+0000 7fb8a83e1740 1 -- start start 2024-09-10T23:17:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.907+0000 7fb8a83e1740 1 Processor -- start 2024-09-10T23:17:40.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb8a83e1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f5b600 0x5638b3f9e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb8a83e1740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f623c0 0x5638b3ff80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb8a83e1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f82000 0x5638b40020f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb8a83e1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5638b3f64710 con 0x5638b3f5b600 2024-09-10T23:17:40.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb8a83e1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a01ffd50 con 0x5638b3f82000 2024-09-10T23:17:40.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb8a83e1740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x5638b3f9f3a0 con 0x5638b3f623c0 2024-09-10T23:17:40.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb8a83e1740 10 client.0 _ll_register_callbacks cb 0x7fb894005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:17:40.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb89effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f5b600 0x5638b3f9e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb89effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f5b600 0x5638b3f9e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43122/0 (socket says 172.21.15.90:43122) 2024-09-10T23:17:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb89effd640 1 -- 172.21.15.90:0/3785160125 learned_addr learned my addr 172.21.15.90:0/3785160125 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb89e7fc640 1 --2- 172.21.15.90:0/3785160125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f623c0 0x5638b3ff80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb89f7fe640 1 --2- 172.21.15.90:0/3785160125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f82000 0x5638b40020f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb89effd640 1 -- 172.21.15.90:0/3785160125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f623c0 msgr2=0x5638b3ff80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb89effd640 1 --2- 172.21.15.90:0/3785160125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f623c0 0x5638b3ff80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb89effd640 1 -- 172.21.15.90:0/3785160125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f82000 msgr2=0x5638b40020f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:17:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb89effd640 1 --2- 172.21.15.90:0/3785160125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f82000 0x5638b40020f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb89effd640 1 -- 172.21.15.90:0/3785160125 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638b3f9eed0 con 0x5638b3f5b600 2024-09-10T23:17:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb89e7fc640 1 --2- 172.21.15.90:0/3785160125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f623c0 0x5638b3ff80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb89effd640 1 --2- 172.21.15.90:0/3785160125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f5b600 0x5638b3f9e990 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fb890005040 tx=0x7fb890001060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a93b287a3190a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb87dffb640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:17:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.908+0000 7fb87dffb640 1 -- 172.21.15.90:0/3785160125 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890007310 con 0x5638b3f5b600 2024-09-10T23:17:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb87dffb640 1 -- 172.21.15.90:0/3785160125 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fb8900074b0 con 0x5638b3f5b600 2024-09-10T23:17:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb8a83e1740 1 -- 172.21.15.90:0/3785160125 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb898010490 con 0x5638b3f5b600 2024-09-10T23:17:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb87dffb640 1 -- 172.21.15.90:0/3785160125 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fb890038050 con 0x5638b3f5b600 2024-09-10T23:17:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb8a83e1740 10 client.6579 fetch_fsmap learned FSMap version 44 2024-09-10T23:17:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb8a83e1740 1 -- 172.21.15.90:0/3785160125 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x5638b3f9f1a0 con 0x5638b3f5b600 2024-09-10T23:17:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb87dffb640 1 -- 172.21.15.90:0/3785160125 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb898010490 con 0x5638b3f5b600 2024-09-10T23:17:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb87dffb640 1 -- 172.21.15.90:0/3785160125 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 44) ==== 3502+0+0 (secure 0 0 0) 0x7fb89003b020 con 0x5638b3f5b600 2024-09-10T23:17:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb8a83e1740 10 client.6579 fetch_fsmap finished waiting for FSMap version 44 2024-09-10T23:17:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb8a83e1740 10 client.6579 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-10T23:17:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb8a83e1740 20 client.6579 populate_metadata read hostname 'smithi090' 2024-09-10T23:17:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/3785160125 >> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] conn(0x5638b4002630 0x5638b3f7a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb8a83e1740 4 client.6579 mds_command: new command op to 6351 tid=0 multi_id=0 [{"prefix": "session ls"}] 2024-09-10T23:17:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb8a83e1740 1 -- 172.21.15.90:0/3785160125 --> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] -- command(tid 0: {"prefix": "session ls"}) -- 0x5638b3f83530 con 0x5638b4002630 2024-09-10T23:17:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb89e7fc640 1 --2- 172.21.15.90:0/3785160125 >> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] conn(0x5638b4002630 0x5638b3f7a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb87dffb640 10 client.6579 ms_handle_connect on v2:172.21.15.90:6832/1524104545 2024-09-10T23:17:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb89e7fc640 1 --2- 172.21.15.90:0/3785160125 >> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] conn(0x5638b4002630 0x5638b3f7a050 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2c04b46321dec7d server_cookie=453c3471523e4947 in_seq=0 out_seq=0 2024-09-10T23:17:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb87dffb640 1 -- 172.21.15.90:0/3785160125 <== mds.0 v2:172.21.15.90:6832/1524104545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5638b3f83530 con 0x5638b4002630 2024-09-10T23:17:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb87dffb640 10 client.6579 handle_command_reply: tid=0 2024-09-10T23:17:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.909+0000 7fb8a83e1740 1 client.6579 shutdown 2024-09-10T23:17:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a83e1740 1 -- 172.21.15.90:0/3785160125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f5b600 msgr2=0x5638b3f9e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/3785160125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f5b600 0x5638b3f9e990 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fb890005040 tx=0x7fb890001060 comp rx=0 tx=0).stop 2024-09-10T23:17:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a83e1740 1 -- 172.21.15.90:0/3785160125 shutdown_connections 2024-09-10T23:17:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/3785160125 >> [v2:172.21.15.90:6832/1524104545,v1:172.21.15.90:6834/1524104545] conn(0x5638b4002630 0x5638b3f7a050 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/3785160125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638b3f82000 0x5638b40020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/3785160125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5638b3f623c0 0x5638b3ff80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb87dffb640 0 client.6579 ms_handle_reset on v2:172.21.15.90:6832/1524104545 2024-09-10T23:17:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a83e1740 1 --2- 172.21.15.90:0/3785160125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638b3f5b600 0x5638b3f9e990 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a83e1740 1 -- 172.21.15.90:0/3785160125 >> 172.21.15.90:0/3785160125 conn(0x5638b3f37800 msgr2=0x5638b3f65460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:40.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a83e1740 1 -- 172.21.15.90:0/3785160125 shutdown_connections 2024-09-10T23:17:40.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a83e1740 1 -- 172.21.15.90:0/3785160125 wait complete. 2024-09-10T23:17:40.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a83e1740 20 client.6579 trim_cache size 0 max 16384 2024-09-10T23:17:40.919 INFO:teuthology.orchestra.run.smithi090.stdout:[] 2024-09-10T23:17:40.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a553a640 1 -- 172.21.15.90:0/1198524375 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb88c077f70 msgr2=0x7fb88c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a553a640 1 --2- 172.21.15.90:0/1198524375 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb88c077f70 0x7fb88c07a430 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00b8370 tx=0x7fb890009040 comp rx=0 tx=0).stop 2024-09-10T23:17:40.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a553a640 1 -- 172.21.15.90:0/1198524375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8a006e750 msgr2=0x7fb8a00b55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:40.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a553a640 1 --2- 172.21.15.90:0/1198524375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8a006e750 0x7fb8a00b55a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb894006010 tx=0x7fb8940038a0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a553a640 1 -- 172.21.15.90:0/1198524375 shutdown_connections 2024-09-10T23:17:40.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a553a640 1 --2- 172.21.15.90:0/1198524375 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb88c077f70 0x7fb88c07a430 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a553a640 1 --2- 172.21.15.90:0/1198524375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8a015e180 0x7fb8a01f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a553a640 1 --2- 172.21.15.90:0/1198524375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8a006e750 0x7fb8a00b55a0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a553a640 1 --2- 172.21.15.90:0/1198524375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8a006d6d0 0x7fb8a00cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:40.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a553a640 1 -- 172.21.15.90:0/1198524375 >> 172.21.15.90:0/1198524375 conn(0x7fb8a00d4090 msgr2=0x7fb8a0158260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:40.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a553a640 1 -- 172.21.15.90:0/1198524375 shutdown_connections 2024-09-10T23:17:40.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:40.910+0000 7fb8a553a640 1 -- 172.21.15.90:0/1198524375 wait complete. 2024-09-10T23:17:40.922 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-10T23:17:41.035 INFO:teuthology.orchestra.run.smithi090.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":64,"msgr_send_messages":60,"msgr_recv_bytes":124877,"msgr_send_bytes":20335,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.021926728,"msgr_running_send_time":0.004165592,"msgr_running_recv_time":0.020082513,"msgr_running_fast_dispatch_time":0.000374155,"msgr_send_messages_queue_lat":{"avgcount":59,"sum":0.037103083,"avgtime":0.000628865},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":122736,"msgr_send_encrypted_bytes":11712},"AsyncMessenger::Worker-1":{"msgr_recv_messages":48,"msgr_send_messages":51,"msgr_recv_bytes":12414,"msgr_send_bytes":163108,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.008383305,"msgr_running_send_time":0.001823350,"msgr_running_recv_time":0.006273837,"msgr_running_fast_dispatch_time":0.000276859,"msgr_send_messages_queue_lat":{"avgcount":50,"sum":0.046176380,"avgtime":0.000923527},"msgr_handle_ack_lat":{"avgcount":31,"sum":0.000009046,"avgtime":0.000000291},"msgr_recv_encrypted_bytes":2032,"msgr_send_encrypted_bytes":96240},"AsyncMessenger::Worker-2":{"msgr_recv_messages":34,"msgr_send_messages":34,"msgr_recv_bytes":8916,"msgr_send_bytes":17766,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.014794228,"msgr_running_send_time":0.001535629,"msgr_running_recv_time":0.012465823,"msgr_running_fast_dispatch_time":0.000780054,"msgr_send_messages_queue_lat":{"avgcount":33,"sum":0.236859713,"avgtime":0.007177567},"msgr_handle_ack_lat":{"avgcount":5,"sum":0.000002692,"avgtime":0.000000538},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":57,"sum":0.001561050,"avgtime":0.000027386}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000011800,"avgtime":0.000005900}},"mds":{"request":29,"reply":29,"reply_latency":{"avgcount":29,"sum":0.004196470,"avgtime":0.000144705},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":2,"subtrees":2,"traverse":55,"traverse_hit":53,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":8,"evex":0,"evtrm":0,"ev":8,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197025,"rdpos":0,"jlat":{"avgcount":6,"sum":0.011199325,"avgtime":0.001866554},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":0,"cap+":2,"cap-":2,"rss":42712,"heap":264044544},"mds_server":{"dispatch_client_request":29,"dispatch_server_request":0,"handle_client_request":29,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":26,"sum":0.003550669,"avgtime":0.000136564},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":2,"sum":0.000374544,"avgtime":0.000187272},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000271257,"avgtime":0.000271257},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":28,"average_load":14,"avg_session_uptime":0,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":249045,"buffer_anon_items":91,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5312,"osdmap_items":75,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":54408,"mds_co_items":216,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":44,"op_send_bytes":13841,"op_resend":37,"op_reply":44,"op_latency":{"avgcount":44,"sum":0.812987143,"avgtime":0.018476980},"op_inflight":0,"oplen_avg":{"avgcount":44,"sum":68},"op":44,"op_r":0,"op_w":44,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":6,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":81,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":142,"get_sum":129498,"get_or_fail_fail":0,"get_or_fail_success":142,"take":0,"take_sum":0,"put":142,"put_sum":129498,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":13841,"put":44,"put_sum":13841,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":44,"put":44,"put_sum":44,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d65bb58960":{"val":0,"max":3758096384,"get_started":0,"get":8,"get_sum":2721,"get_or_fail_fail":0,"get_or_fail_success":8,"take":0,"take_sum":0,"put":6,"put_sum":2721,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":0}} 2024-09-10T23:17:41.037 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 124877, "msgr_recv_encrypted_bytes": 122736, "msgr_recv_messages": 64, "msgr_running_fast_dispatch_time": 0.000374155, "msgr_running_recv_time": 0.020082513, "msgr_running_send_time": 0.004165592, "msgr_running_total_time": 0.021926728, "msgr_send_bytes": 20335, "msgr_send_encrypted_bytes": 11712, "msgr_send_messages": 60, "msgr_send_messages_queue_lat": { "avgcount": 59, "avgtime": 0.000628865, "sum": 0.037103083 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 31, "avgtime": 2.91e-07, "sum": 9.046e-06 }, "msgr_recv_bytes": 12414, "msgr_recv_encrypted_bytes": 2032, "msgr_recv_messages": 48, "msgr_running_fast_dispatch_time": 0.000276859, "msgr_running_recv_time": 0.006273837, "msgr_running_send_time": 0.00182335, "msgr_running_total_time": 0.008383305, "msgr_send_bytes": 163108, "msgr_send_encrypted_bytes": 96240, "msgr_send_messages": 51, "msgr_send_messages_queue_lat": { "avgcount": 50, "avgtime": 0.000923527, "sum": 0.04617638 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 5, "avgtime": 5.38e-07, "sum": 2.692e-06 }, "msgr_recv_bytes": 8916, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 34, "msgr_running_fast_dispatch_time": 0.000780054, "msgr_running_recv_time": 0.012465823, "msgr_running_send_time": 0.001535629, "msgr_running_total_time": 0.014794228, "msgr_send_bytes": 17766, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 34, "msgr_send_messages_queue_lat": { "avgcount": 33, "avgtime": 0.007177567, "sum": 0.236859713 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 57, "avgtime": 2.7386e-05, "sum": 0.00156105 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 5.9e-06, "sum": 1.18e-05 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 29, "reply_latency": { "avgcount": 29, "avgtime": 0.000144705, "sum": 0.00419647 }, "request": 29, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 55, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 53, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 8, "evadd": 8, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 6, "avgtime": 0.001866554, "sum": 0.011199325 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197025 }, "mds_mem": { "cap": 0, "cap+": 2, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 264044544, "ino": 13, "ino+": 13, "ino-": 0, "rss": 42712 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 29, "dispatch_server_request": 0, "handle_client_request": 29, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 26, "avgtime": 0.000136564, "sum": 0.003550669 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 2, "avgtime": 0.000187272, "sum": 0.000374544 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000271257, "sum": 0.000271257 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 14, "avg_session_uptime": 0, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 28 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 249045, "buffer_anon_items": 91, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 54408, "mds_co_items": 216, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5312, "osdmap_items": 75, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 81, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 44, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 44, "avgtime": 0.01847698, "sum": 0.812987143 }, "op_pg": 0, "op_r": 0, "op_reply": 44, "op_resend": 37, "op_rmw": 0, "op_send": 44, "op_send_bytes": 13841, "op_w": 44, "oplen_avg": { "avgcount": 44, "sum": 68 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 6, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 142, "get_or_fail_fail": 0, "get_or_fail_success": 142, "get_started": 0, "get_sum": 129498, "max": 104857600, "put": 142, "put_sum": 129498, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 44, "put_sum": 13841, "take": 44, "take_sum": 13841, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 44, "put_sum": 44, "take": 44, "take_sum": 44, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d65bb58960": { "get": 8, "get_or_fail_fail": 0, "get_or_fail_success": 8, "get_started": 0, "get_sum": 2721, "max": 3758096384, "put": 6, "put_sum": 2721, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 0 } } 2024-09-10T23:17:41.037 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-10T23:17:41.037 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:17:41.037 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:17:41.081 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:17:41.123 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:17:41.123 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:17:41.124 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:17:41.124 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:41.140 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:17:41.140 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:17:41.140 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:17:41.140 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:41.182 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:17:41.182 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:17:41.182 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:17:41.182 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:41.198 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:17:41.198 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:17:41.198 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:17:41.198 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:41.240 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:17:41.241 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:17:41.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.341+0000 7f0ba967f640 1 -- 172.21.15.90:0/2000930020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ba415e310 msgr2=0x7f0ba40d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:41.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.341+0000 7f0ba967f640 1 --2- 172.21.15.90:0/2000930020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ba415e310 0x7f0ba40d0a80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0b94009830 tx=0x7f0b9402a480 comp rx=0 tx=0).stop 2024-09-10T23:17:41.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.341+0000 7f0ba967f640 1 -- 172.21.15.90:0/2000930020 shutdown_connections 2024-09-10T23:17:41.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.341+0000 7f0ba967f640 1 --2- 172.21.15.90:0/2000930020 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ba40d38d0 0x7f0ba40d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:41.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.341+0000 7f0ba967f640 1 --2- 172.21.15.90:0/2000930020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ba415e310 0x7f0ba40d0a80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:41.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.341+0000 7f0ba967f640 1 -- 172.21.15.90:0/2000930020 >> 172.21.15.90:0/2000930020 conn(0x7f0ba40d4090 msgr2=0x7f0ba40d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:41.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.341+0000 7f0ba967f640 1 -- 172.21.15.90:0/2000930020 shutdown_connections 2024-09-10T23:17:41.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.341+0000 7f0ba967f640 1 -- 172.21.15.90:0/2000930020 wait complete. 2024-09-10T23:17:41.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.343+0000 7f0ba967f640 1 Processor -- start 2024-09-10T23:17:41.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.343+0000 7f0ba967f640 1 -- start start 2024-09-10T23:17:41.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.343+0000 7f0ba967f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ba40d16f0 0x7f0ba40cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:41.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.343+0000 7f0ba967f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ba40d38d0 0x7f0ba40b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:41.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.343+0000 7f0ba967f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ba415e310 0x7f0ba40b94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:41.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.343+0000 7f0ba967f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba406de00 con 0x7f0ba415e310 2024-09-10T23:17:41.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.343+0000 7f0ba967f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba40d4d90 con 0x7f0ba40d16f0 2024-09-10T23:17:41.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.343+0000 7f0ba967f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0ba406df80 con 0x7f0ba40d38d0 2024-09-10T23:17:41.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.344+0000 7f0ba37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ba415e310 0x7f0ba40b94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:41.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.344+0000 7f0ba37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ba415e310 0x7f0ba40b94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43136/0 (socket says 172.21.15.90:43136) 2024-09-10T23:17:41.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.344+0000 7f0ba2ffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ba40d16f0 0x7f0ba40cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:41.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.344+0000 7f0ba37fe640 1 -- 172.21.15.90:0/3798586805 learned_addr learned my addr 172.21.15.90:0/3798586805 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:41.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.344+0000 7f0ba27fc640 1 --2- 172.21.15.90:0/3798586805 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ba40d38d0 0x7f0ba40b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:41.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.344+0000 7f0ba37fe640 1 -- 172.21.15.90:0/3798586805 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ba40d38d0 msgr2=0x7f0ba40b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:41.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.344+0000 7f0ba37fe640 1 --2- 172.21.15.90:0/3798586805 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ba40d38d0 0x7f0ba40b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:41.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.344+0000 7f0ba37fe640 1 -- 172.21.15.90:0/3798586805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ba40d16f0 msgr2=0x7f0ba40cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:41.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.344+0000 7f0ba37fe640 1 --2- 172.21.15.90:0/3798586805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ba40d16f0 0x7f0ba40cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:41.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.344+0000 7f0ba37fe640 1 -- 172.21.15.90:0/3798586805 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba40b8020 con 0x7f0ba415e310 2024-09-10T23:17:41.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.344+0000 7f0ba37fe640 1 --2- 172.21.15.90:0/3798586805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ba415e310 0x7f0ba40b94c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00efd0 tx=0x7f0b9c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:41.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.344+0000 7f0b8b7fe640 1 -- 172.21.15.90:0/3798586805 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c003b70 con 0x7f0ba415e310 2024-09-10T23:17:41.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.344+0000 7f0b8b7fe640 1 -- 172.21.15.90:0/3798586805 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b9c003e00 con 0x7f0ba415e310 2024-09-10T23:17:41.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.344+0000 7f0b8b7fe640 1 -- 172.21.15.90:0/3798586805 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c004280 con 0x7f0ba415e310 2024-09-10T23:17:41.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.344+0000 7f0ba967f640 1 -- 172.21.15.90:0/3798586805 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba40b7d40 con 0x7f0ba415e310 2024-09-10T23:17:41.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.344+0000 7f0ba967f640 1 -- 172.21.15.90:0/3798586805 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ba40b8cc0 con 0x7f0ba415e310 2024-09-10T23:17:41.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.345+0000 7f0ba967f640 1 -- 172.21.15.90:0/3798586805 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ba406e430 con 0x7f0ba415e310 2024-09-10T23:17:41.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.346+0000 7f0b8b7fe640 1 -- 172.21.15.90:0/3798586805 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0b9c004420 con 0x7f0ba415e310 2024-09-10T23:17:41.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.346+0000 7f0b8b7fe640 1 --2- 172.21.15.90:0/3798586805 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b90077f70 0x7f0b9007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:41.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.346+0000 7f0b8b7fe640 1 -- 172.21.15.90:0/3798586805 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f0b9c09aae0 con 0x7f0ba415e310 2024-09-10T23:17:41.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.346+0000 7f0ba2ffd640 1 --2- 172.21.15.90:0/3798586805 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b90077f70 0x7f0b9007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:41.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.347+0000 7f0ba2ffd640 1 --2- 172.21.15.90:0/3798586805 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b90077f70 0x7f0b9007a430 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0b94034000 tx=0x7f0b94004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:41.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.350+0000 7f0b8b7fe640 1 -- 172.21.15.90:0/3798586805 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0b9c063020 con 0x7f0ba415e310 2024-09-10T23:17:41.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.559+0000 7f0ba967f640 1 -- 172.21.15.90:0/3798586805 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ba4076360 con 0x7f0ba415e310 2024-09-10T23:17:41.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.560+0000 7f0b8b7fe640 1 -- 172.21.15.90:0/3798586805 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5228 (secure 0 0 0) 0x7f0b9c067a50 con 0x7f0ba415e310 2024-09-10T23:17:41.561 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:41.561 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":44,"btime":"2024-09-10T23:17:29:843110+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/883446248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":883446248},{"type":"v1","addr":"172.21.15.90:6835","nonce":883446248}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5510,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1558215981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1558215981},{"type":"v1","addr":"172.21.15.171:6836","nonce":1558215981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2584382337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2584382337},{"type":"v1","addr":"172.21.15.171:6837","nonce":2584382337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:27.171227+0000","modified":"2024-09-10T23:17:29.182680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6351":{"gid":6351,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6834/1524104545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1524104545},{"type":"v1","addr":"172.21.15.90:6834","nonce":1524104545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6351,"qdb_cluster":[6351]},"id":6}]} 2024-09-10T23:17:41.562 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 44 2024-09-10T23:17:41.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.562+0000 7f0ba967f640 1 -- 172.21.15.90:0/3798586805 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b90077f70 msgr2=0x7f0b9007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:41.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.562+0000 7f0ba967f640 1 --2- 172.21.15.90:0/3798586805 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b90077f70 0x7f0b9007a430 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0b94034000 tx=0x7f0b94004730 comp rx=0 tx=0).stop 2024-09-10T23:17:41.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.562+0000 7f0ba967f640 1 -- 172.21.15.90:0/3798586805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ba415e310 msgr2=0x7f0ba40b94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:41.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.562+0000 7f0ba967f640 1 --2- 172.21.15.90:0/3798586805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ba415e310 0x7f0ba40b94c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00efd0 tx=0x7f0b9c00c6a0 comp rx=0 tx=0).stop 2024-09-10T23:17:41.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.562+0000 7f0ba967f640 1 -- 172.21.15.90:0/3798586805 shutdown_connections 2024-09-10T23:17:41.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.562+0000 7f0ba967f640 1 --2- 172.21.15.90:0/3798586805 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0b90077f70 0x7f0b9007a430 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:41.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.562+0000 7f0ba967f640 1 --2- 172.21.15.90:0/3798586805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ba415e310 0x7f0ba40b94c0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:41.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.562+0000 7f0ba967f640 1 --2- 172.21.15.90:0/3798586805 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ba40d38d0 0x7f0ba40b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:41.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.562+0000 7f0ba967f640 1 --2- 172.21.15.90:0/3798586805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ba40d16f0 0x7f0ba40cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:41.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.562+0000 7f0ba967f640 1 -- 172.21.15.90:0/3798586805 >> 172.21.15.90:0/3798586805 conn(0x7f0ba40d4090 msgr2=0x7f0ba415bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:41.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.562+0000 7f0ba967f640 1 -- 172.21.15.90:0/3798586805 shutdown_connections 2024-09-10T23:17:41.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.562+0000 7f0ba967f640 1 -- 172.21.15.90:0/3798586805 wait complete. 2024-09-10T23:17:41.574 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:17:41.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.674+0000 7fe517b3d640 1 -- 172.21.15.90:0/2441919273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5100b3310 msgr2=0x7fe5100b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:41.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.674+0000 7fe517b3d640 1 --2- 172.21.15.90:0/2441919273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5100b3310 0x7fe5100b24e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe504009830 tx=0x7fe50402a480 comp rx=0 tx=0).stop 2024-09-10T23:17:41.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.674+0000 7fe517b3d640 1 -- 172.21.15.90:0/2441919273 shutdown_connections 2024-09-10T23:17:41.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.674+0000 7fe517b3d640 1 --2- 172.21.15.90:0/2441919273 >> v2:172.21.15.171:3300/0 conn(0x7fe5100ceca0 0x7fe5100cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:41.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.674+0000 7fe517b3d640 1 --2- 172.21.15.90:0/2441919273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5100b3310 0x7fe5100b24e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:41.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.674+0000 7fe517b3d640 1 -- 172.21.15.90:0/2441919273 >> 172.21.15.90:0/2441919273 conn(0x7fe5100b19c0 msgr2=0x7fe5100b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:41.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.674+0000 7fe517b3d640 1 -- 172.21.15.90:0/2441919273 shutdown_connections 2024-09-10T23:17:41.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.674+0000 7fe517b3d640 1 -- 172.21.15.90:0/2441919273 wait complete. 2024-09-10T23:17:41.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.675+0000 7fe517b3d640 1 Processor -- start 2024-09-10T23:17:41.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.675+0000 7fe517b3d640 1 -- start start 2024-09-10T23:17:41.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe517b3d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5100b3310 0x7fe5101f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:41.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe517b3d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5100ceca0 0x7fe510148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:41.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe517b3d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5101f6620 0x7fe5101f6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:41.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe517b3d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe51015bb40 con 0x7fe5100ceca0 2024-09-10T23:17:41.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe517b3d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe51015b9c0 con 0x7fe5100b3310 2024-09-10T23:17:41.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe517b3d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe51015bcc0 con 0x7fe5101f6620 2024-09-10T23:17:41.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe5150d8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5100ceca0 0x7fe510148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:41.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe5150d8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5100ceca0 0x7fe510148210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43146/0 (socket says 172.21.15.90:43146) 2024-09-10T23:17:41.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe5150d8640 1 -- 172.21.15.90:0/3683678503 learned_addr learned my addr 172.21.15.90:0/3683678503 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:41.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe5160da640 1 --2- 172.21.15.90:0/3683678503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5101f6620 0x7fe5101f6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:41.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe5158d9640 1 --2- 172.21.15.90:0/3683678503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5100b3310 0x7fe5101f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:41.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe5150d8640 1 -- 172.21.15.90:0/3683678503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5101f6620 msgr2=0x7fe5101f6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:41.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe5150d8640 1 --2- 172.21.15.90:0/3683678503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5101f6620 0x7fe5101f6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:41.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe5150d8640 1 -- 172.21.15.90:0/3683678503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5100b3310 msgr2=0x7fe5101f3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:41.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe5150d8640 1 --2- 172.21.15.90:0/3683678503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5100b3310 0x7fe5101f3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:41.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe5150d8640 1 -- 172.21.15.90:0/3683678503 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe510149180 con 0x7fe5100ceca0 2024-09-10T23:17:41.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe5160da640 1 --2- 172.21.15.90:0/3683678503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5101f6620 0x7fe5101f6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:41.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe5158d9640 1 --2- 172.21.15.90:0/3683678503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5100b3310 0x7fe5101f3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:41.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe5150d8640 1 --2- 172.21.15.90:0/3683678503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5100ceca0 0x7fe510148210 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fe50c007fd0 tx=0x7fe50c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:41.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe5027fc640 1 -- 172.21.15.90:0/3683678503 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50c011790 con 0x7fe5100ceca0 2024-09-10T23:17:41.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe5027fc640 1 -- 172.21.15.90:0/3683678503 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe50c017070 con 0x7fe5100ceca0 2024-09-10T23:17:41.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe5027fc640 1 -- 172.21.15.90:0/3683678503 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50c011d40 con 0x7fe5100ceca0 2024-09-10T23:17:41.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.676+0000 7fe517b3d640 1 -- 172.21.15.90:0/3683678503 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe510148bc0 con 0x7fe5100ceca0 2024-09-10T23:17:41.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.677+0000 7fe517b3d640 1 -- 172.21.15.90:0/3683678503 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5101f2a70 con 0x7fe5100ceca0 2024-09-10T23:17:41.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.677+0000 7fe517b3d640 1 -- 172.21.15.90:0/3683678503 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe51015c170 con 0x7fe5100ceca0 2024-09-10T23:17:41.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.678+0000 7fe5027fc640 1 -- 172.21.15.90:0/3683678503 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe50c01c460 con 0x7fe5100ceca0 2024-09-10T23:17:41.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.678+0000 7fe5027fc640 1 --2- 172.21.15.90:0/3683678503 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe4f4077f70 0x7fe4f407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:41.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.679+0000 7fe5027fc640 1 -- 172.21.15.90:0/3683678503 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fe50c099b10 con 0x7fe5100ceca0 2024-09-10T23:17:41.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.679+0000 7fe5158d9640 1 --2- 172.21.15.90:0/3683678503 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe4f4077f70 0x7fe4f407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:41.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.679+0000 7fe5158d9640 1 --2- 172.21.15.90:0/3683678503 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe4f4077f70 0x7fe4f407a430 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe504034000 tx=0x7fe504004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:41.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.682+0000 7fe5027fc640 1 -- 172.21.15.90:0/3683678503 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe50c062590 con 0x7fe5100ceca0 2024-09-10T23:17:41.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.891+0000 7fe517b3d640 1 -- 172.21.15.90:0/3683678503 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5100b4f50 con 0x7fe5100ceca0 2024-09-10T23:17:41.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.891+0000 7fe5027fc640 1 -- 172.21.15.90:0/3683678503 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5228 (secure 0 0 0) 0x7fe50c061e90 con 0x7fe5100ceca0 2024-09-10T23:17:41.892 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:41.892 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":44,"btime":"2024-09-10T23:17:29:843110+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/883446248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":883446248},{"type":"v1","addr":"172.21.15.90:6835","nonce":883446248}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5510,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1558215981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1558215981},{"type":"v1","addr":"172.21.15.171:6836","nonce":1558215981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2584382337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2584382337},{"type":"v1","addr":"172.21.15.171:6837","nonce":2584382337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:27.171227+0000","modified":"2024-09-10T23:17:29.182680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6351":{"gid":6351,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6834/1524104545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1524104545},{"type":"v1","addr":"172.21.15.90:6834","nonce":1524104545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6351,"qdb_cluster":[6351]},"id":6}]} 2024-09-10T23:17:41.893 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 44 2024-09-10T23:17:41.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.893+0000 7fe517b3d640 1 -- 172.21.15.90:0/3683678503 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe4f4077f70 msgr2=0x7fe4f407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:41.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.893+0000 7fe517b3d640 1 --2- 172.21.15.90:0/3683678503 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe4f4077f70 0x7fe4f407a430 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe504034000 tx=0x7fe504004730 comp rx=0 tx=0).stop 2024-09-10T23:17:41.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.893+0000 7fe517b3d640 1 -- 172.21.15.90:0/3683678503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5100ceca0 msgr2=0x7fe510148210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:41.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.893+0000 7fe517b3d640 1 --2- 172.21.15.90:0/3683678503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5100ceca0 0x7fe510148210 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fe50c007fd0 tx=0x7fe50c00c820 comp rx=0 tx=0).stop 2024-09-10T23:17:41.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.893+0000 7fe517b3d640 1 -- 172.21.15.90:0/3683678503 shutdown_connections 2024-09-10T23:17:41.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.893+0000 7fe517b3d640 1 --2- 172.21.15.90:0/3683678503 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe4f4077f70 0x7fe4f407a430 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:41.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.893+0000 7fe517b3d640 1 --2- 172.21.15.90:0/3683678503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5101f6620 0x7fe5101f6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:41.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.893+0000 7fe517b3d640 1 --2- 172.21.15.90:0/3683678503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5100ceca0 0x7fe510148210 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:41.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.893+0000 7fe517b3d640 1 --2- 172.21.15.90:0/3683678503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5100b3310 0x7fe5101f3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:41.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.893+0000 7fe517b3d640 1 -- 172.21.15.90:0/3683678503 >> 172.21.15.90:0/3683678503 conn(0x7fe5100b19c0 msgr2=0x7fe51015c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:41.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.894+0000 7fe517b3d640 1 -- 172.21.15.90:0/3683678503 shutdown_connections 2024-09-10T23:17:41.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:41.894+0000 7fe517b3d640 1 -- 172.21.15.90:0/3683678503 wait complete. 2024-09-10T23:17:41.905 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:17:42.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.006+0000 7f9b89c52640 1 -- 172.21.15.90:0/1707590309 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b840cf860 msgr2=0x7f9b8415e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.006+0000 7f9b89c52640 1 --2- 172.21.15.90:0/1707590309 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b840cf860 0x7f9b8415e180 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f9b840cda60 tx=0x7f9b7802a4d0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.006+0000 7f9b89c52640 1 -- 172.21.15.90:0/1707590309 shutdown_connections 2024-09-10T23:17:42.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.006+0000 7f9b89c52640 1 --2- 172.21.15.90:0/1707590309 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b840cd470 0x7f9b8415e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.006+0000 7f9b89c52640 1 --2- 172.21.15.90:0/1707590309 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b840cf860 0x7f9b8415e180 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.006+0000 7f9b89c52640 1 --2- 172.21.15.90:0/1707590309 >> v2:172.21.15.171:3300/0 conn(0x7f9b840b44a0 0x7f9b840b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.006+0000 7f9b89c52640 1 -- 172.21.15.90:0/1707590309 >> 172.21.15.90:0/1707590309 conn(0x7f9b840b19c0 msgr2=0x7f9b840b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:42.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.006+0000 7f9b89c52640 1 -- 172.21.15.90:0/1707590309 shutdown_connections 2024-09-10T23:17:42.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.006+0000 7f9b89c52640 1 -- 172.21.15.90:0/1707590309 wait complete. 2024-09-10T23:17:42.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.007+0000 7f9b89c52640 1 Processor -- start 2024-09-10T23:17:42.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.007+0000 7f9b89c52640 1 -- start start 2024-09-10T23:17:42.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b89c52640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b840b44a0 0x7f9b841f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:42.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b89c52640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b840cd470 0x7f9b840c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:42.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b89c52640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b840cf860 0x7f9b84073040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:42.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b89c52640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8406e870 con 0x7f9b840cf860 2024-09-10T23:17:42.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b89c52640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8406e6f0 con 0x7f9b840b44a0 2024-09-10T23:17:42.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b89c52640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9b8415a8c0 con 0x7f9b840cd470 2024-09-10T23:17:42.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b83fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b840cf860 0x7f9b84073040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:42.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b83fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b840cf860 0x7f9b84073040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43158/0 (socket says 172.21.15.90:43158) 2024-09-10T23:17:42.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b83fff640 1 -- 172.21.15.90:0/3785621260 learned_addr learned my addr 172.21.15.90:0/3785621260 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:42.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b837fe640 1 --2- 172.21.15.90:0/3785621260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b840b44a0 0x7f9b841f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:42.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b82ffd640 1 --2- 172.21.15.90:0/3785621260 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b840cd470 0x7f9b840c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:42.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b83fff640 1 -- 172.21.15.90:0/3785621260 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b840cd470 msgr2=0x7f9b840c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b83fff640 1 --2- 172.21.15.90:0/3785621260 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b840cd470 0x7f9b840c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b83fff640 1 -- 172.21.15.90:0/3785621260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b840b44a0 msgr2=0x7f9b841f6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b83fff640 1 --2- 172.21.15.90:0/3785621260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b840b44a0 0x7f9b841f6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b83fff640 1 -- 172.21.15.90:0/3785621260 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b8415dea0 con 0x7f9b840cf860 2024-09-10T23:17:42.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b83fff640 1 --2- 172.21.15.90:0/3785621260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b840cf860 0x7f9b84073040 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00dd70 tx=0x7f9b7c00b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:42.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.008+0000 7f9b6bfff640 1 -- 172.21.15.90:0/3785621260 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c004d20 con 0x7f9b840cf860 2024-09-10T23:17:42.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.009+0000 7f9b6bfff640 1 -- 172.21.15.90:0/3785621260 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b7c00be40 con 0x7f9b840cf860 2024-09-10T23:17:42.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.009+0000 7f9b6bfff640 1 -- 172.21.15.90:0/3785621260 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00e8a0 con 0x7f9b840cf860 2024-09-10T23:17:42.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.009+0000 7f9b89c52640 1 -- 172.21.15.90:0/3785621260 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b8415dbc0 con 0x7f9b840cf860 2024-09-10T23:17:42.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.009+0000 7f9b89c52640 1 -- 172.21.15.90:0/3785621260 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b841f6420 con 0x7f9b840cf860 2024-09-10T23:17:42.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.010+0000 7f9b89c52640 1 -- 172.21.15.90:0/3785621260 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b8415edc0 con 0x7f9b840cf860 2024-09-10T23:17:42.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.010+0000 7f9b6bfff640 1 -- 172.21.15.90:0/3785621260 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9b7c00b040 con 0x7f9b840cf860 2024-09-10T23:17:42.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.011+0000 7f9b6bfff640 1 --2- 172.21.15.90:0/3785621260 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9b70077f70 0x7f9b7007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:42.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.011+0000 7f9b6bfff640 1 -- 172.21.15.90:0/3785621260 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f9b7c09a470 con 0x7f9b840cf860 2024-09-10T23:17:42.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.011+0000 7f9b837fe640 1 --2- 172.21.15.90:0/3785621260 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9b70077f70 0x7f9b7007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:42.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.012+0000 7f9b837fe640 1 --2- 172.21.15.90:0/3785621260 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9b70077f70 0x7f9b7007a430 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400bb70 tx=0x7f9b7400b2e0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:42.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.015+0000 7f9b6bfff640 1 -- 172.21.15.90:0/3785621260 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9b7c062920 con 0x7f9b840cf860 2024-09-10T23:17:42.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.191+0000 7f9b89c52640 1 -- 172.21.15.90:0/3785621260 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b840cc480 con 0x7f9b840cf860 2024-09-10T23:17:42.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.192+0000 7f9b6bfff640 1 -- 172.21.15.90:0/3785621260 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+16720 (secure 0 0 0) 0x7f9b7c067350 con 0x7f9b840cf860 2024-09-10T23:17:42.193 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:42.194 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":81,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:17:28.836004+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:17:25.408832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-10T23:17:26.131910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:17:42.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.195+0000 7f9b89c52640 1 -- 172.21.15.90:0/3785621260 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9b70077f70 msgr2=0x7f9b7007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.195+0000 7f9b89c52640 1 --2- 172.21.15.90:0/3785621260 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9b70077f70 0x7f9b7007a430 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400bb70 tx=0x7f9b7400b2e0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.195+0000 7f9b89c52640 1 -- 172.21.15.90:0/3785621260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b840cf860 msgr2=0x7f9b84073040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.195+0000 7f9b89c52640 1 --2- 172.21.15.90:0/3785621260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b840cf860 0x7f9b84073040 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00dd70 tx=0x7f9b7c00b730 comp rx=0 tx=0).stop 2024-09-10T23:17:42.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.195+0000 7f9b89c52640 1 -- 172.21.15.90:0/3785621260 shutdown_connections 2024-09-10T23:17:42.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.195+0000 7f9b89c52640 1 --2- 172.21.15.90:0/3785621260 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9b70077f70 0x7f9b7007a430 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.195+0000 7f9b89c52640 1 --2- 172.21.15.90:0/3785621260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b840cf860 0x7f9b84073040 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.195+0000 7f9b89c52640 1 --2- 172.21.15.90:0/3785621260 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b840cd470 0x7f9b840c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.195+0000 7f9b89c52640 1 --2- 172.21.15.90:0/3785621260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b840b44a0 0x7f9b841f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.195+0000 7f9b89c52640 1 -- 172.21.15.90:0/3785621260 >> 172.21.15.90:0/3785621260 conn(0x7f9b840b19c0 msgr2=0x7f9b84159530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:42.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.195+0000 7f9b89c52640 1 -- 172.21.15.90:0/3785621260 shutdown_connections 2024-09-10T23:17:42.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.195+0000 7f9b89c52640 1 -- 172.21.15.90:0/3785621260 wait complete. 2024-09-10T23:17:42.207 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:17:42.207 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:17:42.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.306+0000 7fb608973640 1 -- 172.21.15.90:0/376981865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb60415f750 msgr2=0x7fb604073de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.306+0000 7fb608973640 1 --2- 172.21.15.90:0/376981865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb60415f750 0x7fb604073de0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4005fd0 tx=0x7fb5f402a530 comp rx=0 tx=0).stop 2024-09-10T23:17:42.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.306+0000 7fb608973640 1 -- 172.21.15.90:0/376981865 shutdown_connections 2024-09-10T23:17:42.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.306+0000 7fb608973640 1 --2- 172.21.15.90:0/376981865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb6040cdb90 0x7fb6040cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.306+0000 7fb608973640 1 --2- 172.21.15.90:0/376981865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb60415f750 0x7fb604073de0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.306+0000 7fb608973640 1 -- 172.21.15.90:0/376981865 >> 172.21.15.90:0/376981865 conn(0x7fb6040b19c0 msgr2=0x7fb6040b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:42.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.307+0000 7fb608973640 1 -- 172.21.15.90:0/376981865 shutdown_connections 2024-09-10T23:17:42.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.307+0000 7fb608973640 1 -- 172.21.15.90:0/376981865 wait complete. 2024-09-10T23:17:42.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.308+0000 7fb608973640 1 Processor -- start 2024-09-10T23:17:42.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.308+0000 7fb608973640 1 -- start start 2024-09-10T23:17:42.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb608973640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb60406f550 0x7fb60409c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:42.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb608973640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6040cdb90 0x7fb60415e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:42.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb608973640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb60415f750 0x7fb60415e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:42.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb608973640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb6040cc940 con 0x7fb6040cdb90 2024-09-10T23:17:42.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb608973640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb6040cc7c0 con 0x7fb60415f750 2024-09-10T23:17:42.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb608973640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb6040ccac0 con 0x7fb60406f550 2024-09-10T23:17:42.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb5f9d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6040cdb90 0x7fb60415e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:42.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb5f9d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6040cdb90 0x7fb60415e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43164/0 (socket says 172.21.15.90:43164) 2024-09-10T23:17:42.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb5f9d9b640 1 -- 172.21.15.90:0/1593734236 learned_addr learned my addr 172.21.15.90:0/1593734236 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:42.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb60259c640 1 --2- 172.21.15.90:0/1593734236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb60406f550 0x7fb60409c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:42.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb602d9d640 1 --2- 172.21.15.90:0/1593734236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb60415f750 0x7fb60415e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:42.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb5f9d9b640 1 -- 172.21.15.90:0/1593734236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb60406f550 msgr2=0x7fb60409c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb5f9d9b640 1 --2- 172.21.15.90:0/1593734236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb60406f550 0x7fb60409c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb5f9d9b640 1 -- 172.21.15.90:0/1593734236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb60415f750 msgr2=0x7fb60415e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb5f9d9b640 1 --2- 172.21.15.90:0/1593734236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb60415f750 0x7fb60415e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb5f9d9b640 1 -- 172.21.15.90:0/1593734236 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6041f6740 con 0x7fb6040cdb90 2024-09-10T23:17:42.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb5f9d9b640 1 --2- 172.21.15.90:0/1593734236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6040cdb90 0x7fb60415e450 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00c970 tx=0x7fb5ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:42.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb5fb7fe640 1 -- 172.21.15.90:0/1593734236 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec007bb0 con 0x7fb6040cdb90 2024-09-10T23:17:42.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb5fb7fe640 1 -- 172.21.15.90:0/1593734236 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5ec005020 con 0x7fb6040cdb90 2024-09-10T23:17:42.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb608973640 1 -- 172.21.15.90:0/1593734236 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6041f6a20 con 0x7fb6040cdb90 2024-09-10T23:17:42.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.309+0000 7fb5fb7fe640 1 -- 172.21.15.90:0/1593734236 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec007e60 con 0x7fb6040cdb90 2024-09-10T23:17:42.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.310+0000 7fb608973640 1 -- 172.21.15.90:0/1593734236 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6041f72c0 con 0x7fb6040cdb90 2024-09-10T23:17:42.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.310+0000 7fb608973640 1 -- 172.21.15.90:0/1593734236 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6040b24b0 con 0x7fb6040cdb90 2024-09-10T23:17:42.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.311+0000 7fb5fb7fe640 1 -- 172.21.15.90:0/1593734236 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb5ec005470 con 0x7fb6040cdb90 2024-09-10T23:17:42.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.311+0000 7fb5fb7fe640 1 --2- 172.21.15.90:0/1593734236 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5e4077f70 0x7fb5e407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:42.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.312+0000 7fb5fb7fe640 1 -- 172.21.15.90:0/1593734236 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fb5ec09a290 con 0x7fb6040cdb90 2024-09-10T23:17:42.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.312+0000 7fb60259c640 1 --2- 172.21.15.90:0/1593734236 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5e4077f70 0x7fb5e407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:42.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.312+0000 7fb60259c640 1 --2- 172.21.15.90:0/1593734236 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5e4077f70 0x7fb5e407a430 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4033000 tx=0x7fb5f4004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:42.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.316+0000 7fb5fb7fe640 1 -- 172.21.15.90:0/1593734236 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb6040b24b0 con 0x7fb6040cdb90 2024-09-10T23:17:42.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.525+0000 7fb608973640 1 -- 172.21.15.90:0/1593734236 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6041f6bf0 con 0x7fb6040cdb90 2024-09-10T23:17:42.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.525+0000 7fb5fb7fe640 1 -- 172.21.15.90:0/1593734236 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5228 (secure 0 0 0) 0x7fb5ec014030 con 0x7fb6040cdb90 2024-09-10T23:17:42.527 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:42.528 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":44,"btime":"2024-09-10T23:17:29:843110+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/883446248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":883446248},{"type":"v1","addr":"172.21.15.90:6835","nonce":883446248}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5510,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1558215981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1558215981},{"type":"v1","addr":"172.21.15.171:6836","nonce":1558215981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2584382337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2584382337},{"type":"v1","addr":"172.21.15.171:6837","nonce":2584382337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:27.171227+0000","modified":"2024-09-10T23:17:29.182680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6351":{"gid":6351,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6834/1524104545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1524104545},{"type":"v1","addr":"172.21.15.90:6834","nonce":1524104545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6351,"qdb_cluster":[6351]},"id":6}]} 2024-09-10T23:17:42.528 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 44 2024-09-10T23:17:42.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.528+0000 7fb608973640 1 -- 172.21.15.90:0/1593734236 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5e4077f70 msgr2=0x7fb5e407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.528+0000 7fb608973640 1 --2- 172.21.15.90:0/1593734236 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5e4077f70 0x7fb5e407a430 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4033000 tx=0x7fb5f4004730 comp rx=0 tx=0).stop 2024-09-10T23:17:42.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.528+0000 7fb608973640 1 -- 172.21.15.90:0/1593734236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6040cdb90 msgr2=0x7fb60415e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.528+0000 7fb608973640 1 --2- 172.21.15.90:0/1593734236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6040cdb90 0x7fb60415e450 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00c970 tx=0x7fb5ec00ce30 comp rx=0 tx=0).stop 2024-09-10T23:17:42.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.528+0000 7fb608973640 1 -- 172.21.15.90:0/1593734236 shutdown_connections 2024-09-10T23:17:42.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.528+0000 7fb608973640 1 --2- 172.21.15.90:0/1593734236 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb5e4077f70 0x7fb5e407a430 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.528+0000 7fb608973640 1 --2- 172.21.15.90:0/1593734236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb60415f750 0x7fb60415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.528+0000 7fb608973640 1 --2- 172.21.15.90:0/1593734236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6040cdb90 0x7fb60415e450 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.528+0000 7fb608973640 1 --2- 172.21.15.90:0/1593734236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb60406f550 0x7fb60409c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.528+0000 7fb608973640 1 -- 172.21.15.90:0/1593734236 >> 172.21.15.90:0/1593734236 conn(0x7fb6040b19c0 msgr2=0x7fb6040b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:42.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.528+0000 7fb608973640 1 -- 172.21.15.90:0/1593734236 shutdown_connections 2024-09-10T23:17:42.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.528+0000 7fb608973640 1 -- 172.21.15.90:0/1593734236 wait complete. 2024-09-10T23:17:42.540 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:17:42.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.641+0000 7f8c938cd640 1 -- 172.21.15.90:0/1164784922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c8c06e6f0 msgr2=0x7f8c8c0cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.641+0000 7f8c938cd640 1 --2- 172.21.15.90:0/1164784922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c8c06e6f0 0x7f8c8c0cdb90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c15dc50 tx=0x7f8c7c02a4a0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.641+0000 7f8c938cd640 1 -- 172.21.15.90:0/1164784922 shutdown_connections 2024-09-10T23:17:42.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.641+0000 7f8c938cd640 1 --2- 172.21.15.90:0/1164784922 >> v2:172.21.15.171:3300/0 conn(0x7f8c8c06f860 0x7f8c8c06fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.641+0000 7f8c938cd640 1 --2- 172.21.15.90:0/1164784922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c8c06e6f0 0x7f8c8c0cdb90 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.641+0000 7f8c938cd640 1 -- 172.21.15.90:0/1164784922 >> 172.21.15.90:0/1164784922 conn(0x7f8c8c0b19c0 msgr2=0x7f8c8c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:42.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.641+0000 7f8c938cd640 1 -- 172.21.15.90:0/1164784922 shutdown_connections 2024-09-10T23:17:42.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.641+0000 7f8c938cd640 1 -- 172.21.15.90:0/1164784922 wait complete. 2024-09-10T23:17:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.642+0000 7f8c938cd640 1 Processor -- start 2024-09-10T23:17:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.642+0000 7f8c938cd640 1 -- start start 2024-09-10T23:17:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c938cd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c8c06e6f0 0x7f8c8c1f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c938cd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c8c06f860 0x7f8c8c1f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c938cd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c8c15a1d0 0x7f8c8c153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c938cd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c070a30 con 0x7f8c8c06f860 2024-09-10T23:17:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c938cd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c0708b0 con 0x7f8c8c06e6f0 2024-09-10T23:17:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c938cd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8c8c0b43e0 con 0x7f8c8c15a1d0 2024-09-10T23:17:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c90e68640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c8c06f860 0x7f8c8c1f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c90e68640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c8c06f860 0x7f8c8c1f34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43180/0 (socket says 172.21.15.90:43180) 2024-09-10T23:17:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c90e68640 1 -- 172.21.15.90:0/3264435692 learned_addr learned my addr 172.21.15.90:0/3264435692 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c91669640 1 --2- 172.21.15.90:0/3264435692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c8c06e6f0 0x7f8c8c1f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c91e6a640 1 --2- 172.21.15.90:0/3264435692 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c8c15a1d0 0x7f8c8c153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c90e68640 1 -- 172.21.15.90:0/3264435692 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c8c15a1d0 msgr2=0x7f8c8c153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c90e68640 1 --2- 172.21.15.90:0/3264435692 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c8c15a1d0 0x7f8c8c153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c90e68640 1 -- 172.21.15.90:0/3264435692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c8c06e6f0 msgr2=0x7f8c8c1f53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c90e68640 1 --2- 172.21.15.90:0/3264435692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c8c06e6f0 0x7f8c8c1f53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c90e68640 1 -- 172.21.15.90:0/3264435692 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8c1f3a20 con 0x7f8c8c06f860 2024-09-10T23:17:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c91669640 1 --2- 172.21.15.90:0/3264435692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c8c06e6f0 0x7f8c8c1f53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:42.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c90e68640 1 --2- 172.21.15.90:0/3264435692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c8c06f860 0x7f8c8c1f34e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009920 tx=0x7f8c7c032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:42.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c81ffb640 1 -- 172.21.15.90:0/3264435692 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c040070 con 0x7f8c8c06f860 2024-09-10T23:17:42.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c81ffb640 1 -- 172.21.15.90:0/3264435692 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c7c005310 con 0x7f8c8c06f860 2024-09-10T23:17:42.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c938cd640 1 -- 172.21.15.90:0/3264435692 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8c1f3200 con 0x7f8c8c06f860 2024-09-10T23:17:42.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.643+0000 7f8c81ffb640 1 -- 172.21.15.90:0/3264435692 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c003800 con 0x7f8c8c06f860 2024-09-10T23:17:42.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.644+0000 7f8c938cd640 1 -- 172.21.15.90:0/3264435692 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c8c09c460 con 0x7f8c8c06f860 2024-09-10T23:17:42.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.645+0000 7f8c938cd640 1 -- 172.21.15.90:0/3264435692 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c8c0cdb90 con 0x7f8c8c06f860 2024-09-10T23:17:42.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.645+0000 7f8c81ffb640 1 -- 172.21.15.90:0/3264435692 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8c7c0039a0 con 0x7f8c8c06f860 2024-09-10T23:17:42.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.646+0000 7f8c81ffb640 1 --2- 172.21.15.90:0/3264435692 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8c70077f70 0x7f8c7007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:42.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.646+0000 7f8c81ffb640 1 -- 172.21.15.90:0/3264435692 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f8c7c0bb2c0 con 0x7f8c8c06f860 2024-09-10T23:17:42.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.646+0000 7f8c91669640 1 --2- 172.21.15.90:0/3264435692 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8c70077f70 0x7f8c7007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:42.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.647+0000 7f8c91669640 1 --2- 172.21.15.90:0/3264435692 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8c70077f70 0x7f8c7007a430 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8c88002170 tx=0x7f8c88009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:42.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.650+0000 7f8c81ffb640 1 -- 172.21.15.90:0/3264435692 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8c7c083dd0 con 0x7f8c8c06f860 2024-09-10T23:17:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.863+0000 7f8c938cd640 1 -- 172.21.15.90:0/3264435692 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c8c09bf20 con 0x7f8c8c06f860 2024-09-10T23:17:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.864+0000 7f8c81ffb640 1 -- 172.21.15.90:0/3264435692 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5228 (secure 0 0 0) 0x7f8c7c0bb0e0 con 0x7f8c8c06f860 2024-09-10T23:17:42.865 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:42.865 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":44,"btime":"2024-09-10T23:17:29:843110+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/883446248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":883446248},{"type":"v1","addr":"172.21.15.90:6835","nonce":883446248}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5510,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1558215981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1558215981},{"type":"v1","addr":"172.21.15.171:6836","nonce":1558215981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2584382337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2584382337},{"type":"v1","addr":"172.21.15.171:6837","nonce":2584382337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:27.171227+0000","modified":"2024-09-10T23:17:29.182680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6351":{"gid":6351,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6834/1524104545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1524104545},{"type":"v1","addr":"172.21.15.90:6834","nonce":1524104545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6351,"qdb_cluster":[6351]},"id":6}]} 2024-09-10T23:17:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 44 2024-09-10T23:17:42.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.866+0000 7f8c938cd640 1 -- 172.21.15.90:0/3264435692 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8c70077f70 msgr2=0x7f8c7007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.866+0000 7f8c938cd640 1 --2- 172.21.15.90:0/3264435692 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8c70077f70 0x7f8c7007a430 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8c88002170 tx=0x7f8c88009040 comp rx=0 tx=0).stop 2024-09-10T23:17:42.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.866+0000 7f8c938cd640 1 -- 172.21.15.90:0/3264435692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c8c06f860 msgr2=0x7f8c8c1f34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.866+0000 7f8c938cd640 1 --2- 172.21.15.90:0/3264435692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c8c06f860 0x7f8c8c1f34e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009920 tx=0x7f8c7c032d50 comp rx=0 tx=0).stop 2024-09-10T23:17:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.866+0000 7f8c938cd640 1 -- 172.21.15.90:0/3264435692 shutdown_connections 2024-09-10T23:17:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.866+0000 7f8c938cd640 1 --2- 172.21.15.90:0/3264435692 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8c70077f70 0x7f8c7007a430 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.866+0000 7f8c938cd640 1 --2- 172.21.15.90:0/3264435692 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c8c15a1d0 0x7f8c8c153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.866+0000 7f8c938cd640 1 --2- 172.21.15.90:0/3264435692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c8c06f860 0x7f8c8c1f34e0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.866+0000 7f8c938cd640 1 --2- 172.21.15.90:0/3264435692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c8c06e6f0 0x7f8c8c1f53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.866+0000 7f8c938cd640 1 -- 172.21.15.90:0/3264435692 >> 172.21.15.90:0/3264435692 conn(0x7f8c8c0b19c0 msgr2=0x7f8c8c0b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.866+0000 7f8c938cd640 1 -- 172.21.15.90:0/3264435692 shutdown_connections 2024-09-10T23:17:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.866+0000 7f8c938cd640 1 -- 172.21.15.90:0/3264435692 wait complete. 2024-09-10T23:17:42.878 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:17:42.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.979+0000 7ffb9e79f640 1 -- 172.21.15.90:0/1918546025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb9815f2c0 msgr2=0x7ffb980cfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.979+0000 7ffb9e79f640 1 --2- 172.21.15.90:0/1918546025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb9815f2c0 0x7ffb980cfc30 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ffb98069890 tx=0x7ffb8802aac0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.979+0000 7ffb9e79f640 1 -- 172.21.15.90:0/1918546025 shutdown_connections 2024-09-10T23:17:42.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.979+0000 7ffb9e79f640 1 --2- 172.21.15.90:0/1918546025 >> v2:172.21.15.171:3300/0 conn(0x7ffb98070880 0x7ffb98070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.979+0000 7ffb9e79f640 1 --2- 172.21.15.90:0/1918546025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb9815f2c0 0x7ffb980cfc30 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.979+0000 7ffb9e79f640 1 -- 172.21.15.90:0/1918546025 >> 172.21.15.90:0/1918546025 conn(0x7ffb980b37f0 msgr2=0x7ffb980b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:42.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.979+0000 7ffb9e79f640 1 -- 172.21.15.90:0/1918546025 shutdown_connections 2024-09-10T23:17:42.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.979+0000 7ffb9e79f640 1 -- 172.21.15.90:0/1918546025 wait complete. 2024-09-10T23:17:42.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.980+0000 7ffb9e79f640 1 Processor -- start 2024-09-10T23:17:42.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.980+0000 7ffb9e79f640 1 -- start start 2024-09-10T23:17:42.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.981+0000 7ffb9e79f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb98070880 0x7ffb981f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:42.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.981+0000 7ffb9e79f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb980b10d0 0x7ffb9815bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.981+0000 7ffb9e79f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb9815f2c0 0x7ffb980c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.981+0000 7ffb9e79f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffb98071f60 con 0x7ffb980b10d0 2024-09-10T23:17:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.981+0000 7ffb9e79f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffb98071de0 con 0x7ffb98070880 2024-09-10T23:17:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.981+0000 7ffb9e79f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffb980711e0 con 0x7ffb9815f2c0 2024-09-10T23:17:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.981+0000 7ffb9cf9c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb980b10d0 0x7ffb9815bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.981+0000 7ffb9cf9c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb980b10d0 0x7ffb9815bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43194/0 (socket says 172.21.15.90:43194) 2024-09-10T23:17:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.981+0000 7ffb9cf9c640 1 -- 172.21.15.90:0/557650331 learned_addr learned my addr 172.21.15.90:0/557650331 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.982+0000 7ffb9d79d640 1 --2- 172.21.15.90:0/557650331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb98070880 0x7ffb981f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.982+0000 7ffb9df9e640 1 --2- 172.21.15.90:0/557650331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb9815f2c0 0x7ffb980c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.982+0000 7ffb9cf9c640 1 -- 172.21.15.90:0/557650331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb9815f2c0 msgr2=0x7ffb980c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.982+0000 7ffb9cf9c640 1 --2- 172.21.15.90:0/557650331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb9815f2c0 0x7ffb980c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.982+0000 7ffb9cf9c640 1 -- 172.21.15.90:0/557650331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb98070880 msgr2=0x7ffb981f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:42.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.982+0000 7ffb9cf9c640 1 --2- 172.21.15.90:0/557650331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb98070880 0x7ffb981f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:42.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.982+0000 7ffb9cf9c640 1 -- 172.21.15.90:0/557650331 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb981f5270 con 0x7ffb980b10d0 2024-09-10T23:17:42.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.982+0000 7ffb9cf9c640 1 --2- 172.21.15.90:0/557650331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb980b10d0 0x7ffb9815bb60 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00c400 tx=0x7ffb8c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:42.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.982+0000 7ffb95ffb640 1 -- 172.21.15.90:0/557650331 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c017070 con 0x7ffb980b10d0 2024-09-10T23:17:42.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.982+0000 7ffb95ffb640 1 -- 172.21.15.90:0/557650331 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb8c005400 con 0x7ffb980b10d0 2024-09-10T23:17:42.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.982+0000 7ffb9e79f640 1 -- 172.21.15.90:0/557650331 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb981f55b0 con 0x7ffb980b10d0 2024-09-10T23:17:42.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.982+0000 7ffb95ffb640 1 -- 172.21.15.90:0/557650331 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c003870 con 0x7ffb980b10d0 2024-09-10T23:17:42.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.982+0000 7ffb9e79f640 1 -- 172.21.15.90:0/557650331 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb981f5b10 con 0x7ffb980b10d0 2024-09-10T23:17:42.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.983+0000 7ffb9e79f640 1 -- 172.21.15.90:0/557650331 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb980d1650 con 0x7ffb980b10d0 2024-09-10T23:17:42.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.984+0000 7ffb95ffb640 1 -- 172.21.15.90:0/557650331 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ffb8c003a10 con 0x7ffb980b10d0 2024-09-10T23:17:42.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.984+0000 7ffb95ffb640 1 --2- 172.21.15.90:0/557650331 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb84077fa0 0x7ffb8407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:42.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.984+0000 7ffb95ffb640 1 -- 172.21.15.90:0/557650331 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7ffb8c0992e0 con 0x7ffb980b10d0 2024-09-10T23:17:42.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.985+0000 7ffb9d79d640 1 --2- 172.21.15.90:0/557650331 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb84077fa0 0x7ffb8407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:42.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.985+0000 7ffb9d79d640 1 --2- 172.21.15.90:0/557650331 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb84077fa0 0x7ffb8407a460 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffb88035000 tx=0x7ffb88004ab0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:42.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:42.989+0000 7ffb95ffb640 1 -- 172.21.15.90:0/557650331 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ffb980d1650 con 0x7ffb980b10d0 2024-09-10T23:17:43.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.165+0000 7ffb9e79f640 1 -- 172.21.15.90:0/557650331 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb98070ca0 con 0x7ffb980b10d0 2024-09-10T23:17:43.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.166+0000 7ffb95ffb640 1 -- 172.21.15.90:0/557650331 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+16720 (secure 0 0 0) 0x7ffb981f55b0 con 0x7ffb980b10d0 2024-09-10T23:17:43.167 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:43.167 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":81,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:17:28.836004+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:17:25.408832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-10T23:17:26.131910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:17:43.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.168+0000 7ffb9e79f640 1 -- 172.21.15.90:0/557650331 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb84077fa0 msgr2=0x7ffb8407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:43.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.168+0000 7ffb9e79f640 1 --2- 172.21.15.90:0/557650331 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb84077fa0 0x7ffb8407a460 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffb88035000 tx=0x7ffb88004ab0 comp rx=0 tx=0).stop 2024-09-10T23:17:43.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.168+0000 7ffb9e79f640 1 -- 172.21.15.90:0/557650331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb980b10d0 msgr2=0x7ffb9815bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:43.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.168+0000 7ffb9e79f640 1 --2- 172.21.15.90:0/557650331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb980b10d0 0x7ffb9815bb60 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00c400 tx=0x7ffb8c00c8c0 comp rx=0 tx=0).stop 2024-09-10T23:17:43.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.168+0000 7ffb9e79f640 1 -- 172.21.15.90:0/557650331 shutdown_connections 2024-09-10T23:17:43.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.168+0000 7ffb9e79f640 1 --2- 172.21.15.90:0/557650331 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb84077fa0 0x7ffb8407a460 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:43.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.168+0000 7ffb9e79f640 1 --2- 172.21.15.90:0/557650331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb9815f2c0 0x7ffb980c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:43.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.168+0000 7ffb9e79f640 1 --2- 172.21.15.90:0/557650331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb980b10d0 0x7ffb9815bb60 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:43.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.168+0000 7ffb9e79f640 1 --2- 172.21.15.90:0/557650331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb98070880 0x7ffb981f4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:43.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.168+0000 7ffb9e79f640 1 -- 172.21.15.90:0/557650331 >> 172.21.15.90:0/557650331 conn(0x7ffb980b37f0 msgr2=0x7ffb9815d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:43.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.168+0000 7ffb9e79f640 1 -- 172.21.15.90:0/557650331 shutdown_connections 2024-09-10T23:17:43.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.168+0000 7ffb9e79f640 1 -- 172.21.15.90:0/557650331 wait complete. 2024-09-10T23:17:43.180 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:17:43.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.282+0000 7ffa1f36b640 1 -- 172.21.15.90:0/3960293092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa000053c0 msgr2=0x7ffa0000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:43.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.282+0000 7ffa1f36b640 1 --2- 172.21.15.90:0/3960293092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa000053c0 0x7ffa0000b9c0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7ffa100016c0 tx=0x7ffa00005830 comp rx=0 tx=0).stop 2024-09-10T23:17:43.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.282+0000 7ffa1f36b640 1 -- 172.21.15.90:0/3960293092 shutdown_connections 2024-09-10T23:17:43.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.282+0000 7ffa1f36b640 1 --2- 172.21.15.90:0/3960293092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa000053c0 0x7ffa0000b9c0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:43.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.282+0000 7ffa1f36b640 1 -- 172.21.15.90:0/3960293092 >> 172.21.15.90:0/3960293092 conn(0x7ffa180d4090 msgr2=0x7ffa180d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:43.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.282+0000 7ffa1f36b640 1 -- 172.21.15.90:0/3960293092 shutdown_connections 2024-09-10T23:17:43.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.282+0000 7ffa1f36b640 1 -- 172.21.15.90:0/3960293092 wait complete. 2024-09-10T23:17:43.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.283+0000 7ffa1f36b640 1 Processor -- start 2024-09-10T23:17:43.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.283+0000 7ffa1f36b640 1 -- start start 2024-09-10T23:17:43.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1f36b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa000053c0 0x7ffa181530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:43.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1f36b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa18153630 0x7ffa18160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:43.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1f36b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa18161510 0x7ffa180b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:43.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1f36b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffa180d4d00 con 0x7ffa000053c0 2024-09-10T23:17:43.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1f36b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffa180d4b80 con 0x7ffa18161510 2024-09-10T23:17:43.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1f36b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffa180d4e80 con 0x7ffa18153630 2024-09-10T23:17:43.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1d107640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa000053c0 0x7ffa181530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:43.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1d107640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa000053c0 0x7ffa181530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43212/0 (socket says 172.21.15.90:43212) 2024-09-10T23:17:43.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1d107640 1 -- 172.21.15.90:0/1514405095 learned_addr learned my addr 172.21.15.90:0/1514405095 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:43.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1d908640 1 --2- 172.21.15.90:0/1514405095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa18161510 0x7ffa180b7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:43.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1c906640 1 --2- 172.21.15.90:0/1514405095 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa18153630 0x7ffa18160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:43.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1d107640 1 -- 172.21.15.90:0/1514405095 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa18153630 msgr2=0x7ffa18160fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:43.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1d107640 1 --2- 172.21.15.90:0/1514405095 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa18153630 0x7ffa18160fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:43.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1d107640 1 -- 172.21.15.90:0/1514405095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa18161510 msgr2=0x7ffa180b7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:43.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1d107640 1 --2- 172.21.15.90:0/1514405095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa18161510 0x7ffa180b7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:43.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1d107640 1 -- 172.21.15.90:0/1514405095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa18161970 con 0x7ffa000053c0 2024-09-10T23:17:43.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1d908640 1 --2- 172.21.15.90:0/1514405095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa18161510 0x7ffa180b7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:43.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1d107640 1 --2- 172.21.15.90:0/1514405095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa000053c0 0x7ffa181530f0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7ffa08010aa0 tx=0x7ffa08010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:43.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa15ffb640 1 -- 172.21.15.90:0/1514405095 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0800ee90 con 0x7ffa000053c0 2024-09-10T23:17:43.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa15ffb640 1 -- 172.21.15.90:0/1514405095 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa08004b20 con 0x7ffa000053c0 2024-09-10T23:17:43.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa15ffb640 1 -- 172.21.15.90:0/1514405095 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08005020 con 0x7ffa000053c0 2024-09-10T23:17:43.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.284+0000 7ffa1f36b640 1 -- 172.21.15.90:0/1514405095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa180b8d40 con 0x7ffa000053c0 2024-09-10T23:17:43.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.285+0000 7ffa1f36b640 1 -- 172.21.15.90:0/1514405095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa1815e960 con 0x7ffa000053c0 2024-09-10T23:17:43.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.286+0000 7ffa1f36b640 1 -- 172.21.15.90:0/1514405095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa1806ebf0 con 0x7ffa000053c0 2024-09-10T23:17:43.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.286+0000 7ffa15ffb640 1 -- 172.21.15.90:0/1514405095 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ffa0800f040 con 0x7ffa000053c0 2024-09-10T23:17:43.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.287+0000 7ffa15ffb640 1 --2- 172.21.15.90:0/1514405095 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa04078110 0x7ffa0407a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:43.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.287+0000 7ffa15ffb640 1 -- 172.21.15.90:0/1514405095 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7ffa0809a7d0 con 0x7ffa000053c0 2024-09-10T23:17:43.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.287+0000 7ffa1c906640 1 --2- 172.21.15.90:0/1514405095 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa04078110 0x7ffa0407a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:43.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.288+0000 7ffa1c906640 1 --2- 172.21.15.90:0/1514405095 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa04078110 0x7ffa0407a5d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c001860 tx=0x7ffa0c001d90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:43.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.291+0000 7ffa15ffb640 1 -- 172.21.15.90:0/1514405095 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ffa1806ebf0 con 0x7ffa000053c0 2024-09-10T23:17:43.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.503+0000 7ffa1f36b640 1 -- 172.21.15.90:0/1514405095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ffa180d0d20 con 0x7ffa000053c0 2024-09-10T23:17:43.505 INFO:tasks.ceph.mon.a.smithi090.stderr:2024-09-10T23:17:43.504+0000 7f1a0c84c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:17:43.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.505+0000 7ffa15ffb640 1 -- 172.21.15.90:0/1514405095 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) ==== 161+0+0 (secure 0 0 0) 0x7ffa08062c80 con 0x7ffa000053c0 2024-09-10T23:17:43.506 INFO:teuthology.orchestra.run.smithi090.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:17:43.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.508+0000 7ffa1f36b640 1 -- 172.21.15.90:0/1514405095 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa04078110 msgr2=0x7ffa0407a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:43.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.508+0000 7ffa1f36b640 1 --2- 172.21.15.90:0/1514405095 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa04078110 0x7ffa0407a5d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c001860 tx=0x7ffa0c001d90 comp rx=0 tx=0).stop 2024-09-10T23:17:43.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.508+0000 7ffa1f36b640 1 -- 172.21.15.90:0/1514405095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa000053c0 msgr2=0x7ffa181530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:43.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.508+0000 7ffa1f36b640 1 --2- 172.21.15.90:0/1514405095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa000053c0 0x7ffa181530f0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7ffa08010aa0 tx=0x7ffa08010f60 comp rx=0 tx=0).stop 2024-09-10T23:17:43.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.508+0000 7ffa1f36b640 1 -- 172.21.15.90:0/1514405095 shutdown_connections 2024-09-10T23:17:43.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.508+0000 7ffa1f36b640 1 --2- 172.21.15.90:0/1514405095 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffa04078110 0x7ffa0407a5d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:43.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.508+0000 7ffa1f36b640 1 --2- 172.21.15.90:0/1514405095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa18161510 0x7ffa180b7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:43.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.508+0000 7ffa1f36b640 1 --2- 172.21.15.90:0/1514405095 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa18153630 0x7ffa18160fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:43.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.508+0000 7ffa1f36b640 1 --2- 172.21.15.90:0/1514405095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa000053c0 0x7ffa181530f0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:43.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.508+0000 7ffa1f36b640 1 -- 172.21.15.90:0/1514405095 >> 172.21.15.90:0/1514405095 conn(0x7ffa180d4090 msgr2=0x7ffa180b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:43.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.508+0000 7ffa1f36b640 1 -- 172.21.15.90:0/1514405095 shutdown_connections 2024-09-10T23:17:43.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.508+0000 7ffa1f36b640 1 -- 172.21.15.90:0/1514405095 wait complete. 2024-09-10T23:17:43.511 INFO:tasks.ceph.mds.a.smithi090.stderr: -2141> 2024-09-10T23:17:33.803+0000 7f406a88c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:17:43.522 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:17:43.538 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-09-10T23:17:43.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.623+0000 7f89e7e60640 1 -- 172.21.15.90:0/2646952333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e00ceca0 msgr2=0x7f89e00cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:43.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.623+0000 7f89e7e60640 1 --2- 172.21.15.90:0/2646952333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e00ceca0 0x7f89e00cf0b0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f89e0075050 tx=0x7f89d802aa30 comp rx=0 tx=0).stop 2024-09-10T23:17:43.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.623+0000 7f89e7e60640 1 -- 172.21.15.90:0/2646952333 shutdown_connections 2024-09-10T23:17:43.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.623+0000 7f89e7e60640 1 --2- 172.21.15.90:0/2646952333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e00ceca0 0x7f89e00cf0b0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:43.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.623+0000 7f89e7e60640 1 --2- 172.21.15.90:0/2646952333 >> v2:172.21.15.171:3300/0 conn(0x7f89e00b3310 0x7f89e00b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:43.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.623+0000 7f89e7e60640 1 -- 172.21.15.90:0/2646952333 >> 172.21.15.90:0/2646952333 conn(0x7f89e00b19c0 msgr2=0x7f89e00b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:43.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.623+0000 7f89e7e60640 1 -- 172.21.15.90:0/2646952333 shutdown_connections 2024-09-10T23:17:43.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.623+0000 7f89e7e60640 1 -- 172.21.15.90:0/2646952333 wait complete. 2024-09-10T23:17:43.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.624+0000 7f89e7e60640 1 Processor -- start 2024-09-10T23:17:43.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.625+0000 7f89e7e60640 1 -- start start 2024-09-10T23:17:43.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.625+0000 7f89e7e60640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89e00b3310 0x7f89e009d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:43.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.625+0000 7f89e7e60640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89e00ceca0 0x7f89e014cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:43.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.625+0000 7f89e7e60640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e014d590 0x7f89e01e8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:43.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.625+0000 7f89e7e60640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f89e015bb40 con 0x7f89e014d590 2024-09-10T23:17:43.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.625+0000 7f89e7e60640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f89e015b9c0 con 0x7f89e00b3310 2024-09-10T23:17:43.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.625+0000 7f89e7e60640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f89e015bcc0 con 0x7f89e00ceca0 2024-09-10T23:17:43.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.625+0000 7f89e63fd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e014d590 0x7f89e01e8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:43.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.625+0000 7f89e63fd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e014d590 0x7f89e01e8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43268/0 (socket says 172.21.15.90:43268) 2024-09-10T23:17:43.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.625+0000 7f89e63fd640 1 -- 172.21.15.90:0/787089918 learned_addr learned my addr 172.21.15.90:0/787089918 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:43.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.626+0000 7f89e5bfc640 1 --2- 172.21.15.90:0/787089918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89e00b3310 0x7f89e009d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:43.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.626+0000 7f89e53fb640 1 --2- 172.21.15.90:0/787089918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89e00ceca0 0x7f89e014cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:43.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.626+0000 7f89e63fd640 1 -- 172.21.15.90:0/787089918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89e00ceca0 msgr2=0x7f89e014cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:43.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.626+0000 7f89e63fd640 1 --2- 172.21.15.90:0/787089918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89e00ceca0 0x7f89e014cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:43.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.626+0000 7f89e63fd640 1 -- 172.21.15.90:0/787089918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89e00b3310 msgr2=0x7f89e009d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:43.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.626+0000 7f89e63fd640 1 --2- 172.21.15.90:0/787089918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89e00b3310 0x7f89e009d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:43.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.626+0000 7f89e63fd640 1 -- 172.21.15.90:0/787089918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e009c4b0 con 0x7f89e014d590 2024-09-10T23:17:43.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.626+0000 7f89e53fb640 1 --2- 172.21.15.90:0/787089918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89e00ceca0 0x7f89e014cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:43.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.626+0000 7f89e63fd640 1 --2- 172.21.15.90:0/787089918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e014d590 0x7f89e01e8bc0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f89d802b020 tx=0x7f89d8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:43.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.626+0000 7f89d67fc640 1 -- 172.21.15.90:0/787089918 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8047070 con 0x7f89e014d590 2024-09-10T23:17:43.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.626+0000 7f89d67fc640 1 -- 172.21.15.90:0/787089918 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89d8004250 con 0x7f89e014d590 2024-09-10T23:17:43.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.626+0000 7f89e7e60640 1 -- 172.21.15.90:0/787089918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e009c790 con 0x7f89e014d590 2024-09-10T23:17:43.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.626+0000 7f89d67fc640 1 -- 172.21.15.90:0/787089918 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8033050 con 0x7f89e014d590 2024-09-10T23:17:43.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.626+0000 7f89e7e60640 1 -- 172.21.15.90:0/787089918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e009cd50 con 0x7f89e014d590 2024-09-10T23:17:43.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.627+0000 7f89e7e60640 1 -- 172.21.15.90:0/787089918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e015d360 con 0x7f89e014d590 2024-09-10T23:17:43.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.628+0000 7f89d67fc640 1 -- 172.21.15.90:0/787089918 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f89d80046a0 con 0x7f89e014d590 2024-09-10T23:17:43.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.628+0000 7f89d67fc640 1 --2- 172.21.15.90:0/787089918 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f89c4077f70 0x7f89c407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:43.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.628+0000 7f89d67fc640 1 -- 172.21.15.90:0/787089918 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7f89d80bb3b0 con 0x7f89e014d590 2024-09-10T23:17:43.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.628+0000 7f89e5bfc640 1 --2- 172.21.15.90:0/787089918 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f89c4077f70 0x7f89c407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:43.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.629+0000 7f89e5bfc640 1 --2- 172.21.15.90:0/787089918 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f89c4077f70 0x7f89c407a430 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f89dc005fd0 tx=0x7f89dc005850 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:43.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.632+0000 7f89d67fc640 1 -- 172.21.15.90:0/787089918 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f89d8083e50 con 0x7f89e014d590 2024-09-10T23:17:43.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:43.844+0000 7f89e7e60640 1 -- 172.21.15.90:0/787089918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f89e00b4f50 con 0x7f89e014d590 2024-09-10T23:17:44.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.507+0000 7f89d67fc640 1 -- 172.21.15.90:0/787089918 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v46) ==== 104+0+0 (secure 0 0 0) 0x7f89d8083750 con 0x7f89e014d590 2024-09-10T23:17:44.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.509+0000 7f89e7e60640 1 -- 172.21.15.90:0/787089918 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f89c4077f70 msgr2=0x7f89c407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:44.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.509+0000 7f89e7e60640 1 --2- 172.21.15.90:0/787089918 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f89c4077f70 0x7f89c407a430 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f89dc005fd0 tx=0x7f89dc005850 comp rx=0 tx=0).stop 2024-09-10T23:17:44.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.509+0000 7f89e7e60640 1 -- 172.21.15.90:0/787089918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e014d590 msgr2=0x7f89e01e8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:44.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.509+0000 7f89e7e60640 1 --2- 172.21.15.90:0/787089918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e014d590 0x7f89e01e8bc0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f89d802b020 tx=0x7f89d8003f10 comp rx=0 tx=0).stop 2024-09-10T23:17:44.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.509+0000 7f89e7e60640 1 -- 172.21.15.90:0/787089918 shutdown_connections 2024-09-10T23:17:44.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.509+0000 7f89e7e60640 1 --2- 172.21.15.90:0/787089918 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f89c4077f70 0x7f89c407a430 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:44.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.509+0000 7f89e7e60640 1 --2- 172.21.15.90:0/787089918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e014d590 0x7f89e01e8bc0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:44.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.509+0000 7f89e7e60640 1 --2- 172.21.15.90:0/787089918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89e00ceca0 0x7f89e014cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:44.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.509+0000 7f89e7e60640 1 --2- 172.21.15.90:0/787089918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89e00b3310 0x7f89e009d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:44.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.509+0000 7f89e7e60640 1 -- 172.21.15.90:0/787089918 >> 172.21.15.90:0/787089918 conn(0x7f89e00b19c0 msgr2=0x7f89e00727c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:44.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.509+0000 7f89e7e60640 1 -- 172.21.15.90:0/787089918 shutdown_connections 2024-09-10T23:17:44.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.509+0000 7f89e7e60640 1 -- 172.21.15.90:0/787089918 wait complete. 2024-09-10T23:17:44.523 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:17:44.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.668+0000 7fcfdf6dd640 1 -- 172.21.15.90:0/4024565852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfd80b3380 msgr2=0x7fcfd80ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:44.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.668+0000 7fcfdf6dd640 1 --2- 172.21.15.90:0/4024565852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfd80b3380 0x7fcfd80ad800 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80cc2d0 tx=0x7fcfc802a560 comp rx=0 tx=0).stop 2024-09-10T23:17:44.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.668+0000 7fcfdf6dd640 1 -- 172.21.15.90:0/4024565852 shutdown_connections 2024-09-10T23:17:44.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.668+0000 7fcfdf6dd640 1 --2- 172.21.15.90:0/4024565852 >> v2:172.21.15.171:3300/0 conn(0x7fcfd815e9b0 0x7fcfd815ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:44.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.668+0000 7fcfdf6dd640 1 --2- 172.21.15.90:0/4024565852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfd80b3380 0x7fcfd80ad800 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:44.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.668+0000 7fcfdf6dd640 1 --2- 172.21.15.90:0/4024565852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfd815aef0 0x7fcfd80b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:44.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.668+0000 7fcfdf6dd640 1 -- 172.21.15.90:0/4024565852 >> 172.21.15.90:0/4024565852 conn(0x7fcfd80b1aa0 msgr2=0x7fcfd80b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:44.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.668+0000 7fcfdf6dd640 1 -- 172.21.15.90:0/4024565852 shutdown_connections 2024-09-10T23:17:44.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.668+0000 7fcfdf6dd640 1 -- 172.21.15.90:0/4024565852 wait complete. 2024-09-10T23:17:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.669+0000 7fcfdf6dd640 1 Processor -- start 2024-09-10T23:17:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.669+0000 7fcfdf6dd640 1 -- start start 2024-09-10T23:17:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.670+0000 7fcfdf6dd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfd80b3380 0x7fcfd815c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.670+0000 7fcfdf6dd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfd815aef0 0x7fcfd81f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.670+0000 7fcfdf6dd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfd815e9b0 0x7fcfd8152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.670+0000 7fcfdf6dd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd80736f0 con 0x7fcfd80b3380 2024-09-10T23:17:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.670+0000 7fcfdf6dd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd80adf50 con 0x7fcfd815e9b0 2024-09-10T23:17:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.670+0000 7fcfdf6dd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd8073870 con 0x7fcfd815aef0 2024-09-10T23:17:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.670+0000 7fcfdd479640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfd80b3380 0x7fcfd815c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.670+0000 7fcfdd479640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfd80b3380 0x7fcfd815c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43274/0 (socket says 172.21.15.90:43274) 2024-09-10T23:17:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.670+0000 7fcfdd479640 1 -- 172.21.15.90:0/492025649 learned_addr learned my addr 172.21.15.90:0/492025649 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:44.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.670+0000 7fcfdcc78640 1 --2- 172.21.15.90:0/492025649 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfd815aef0 0x7fcfd81f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:44.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.670+0000 7fcfddc7a640 1 --2- 172.21.15.90:0/492025649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfd815e9b0 0x7fcfd8152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:44.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.670+0000 7fcfdd479640 1 -- 172.21.15.90:0/492025649 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfd815aef0 msgr2=0x7fcfd81f2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:44.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.670+0000 7fcfdd479640 1 --2- 172.21.15.90:0/492025649 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfd815aef0 0x7fcfd81f2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:44.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.670+0000 7fcfdd479640 1 -- 172.21.15.90:0/492025649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfd815e9b0 msgr2=0x7fcfd8152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:44.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.670+0000 7fcfdd479640 1 --2- 172.21.15.90:0/492025649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfd815e9b0 0x7fcfd8152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:44.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.670+0000 7fcfdd479640 1 -- 172.21.15.90:0/492025649 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd80cf680 con 0x7fcfd80b3380 2024-09-10T23:17:44.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.671+0000 7fcfdd479640 1 --2- 172.21.15.90:0/492025649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfd80b3380 0x7fcfd815c1e0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400b4a0 tx=0x7fcfd400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:44.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.671+0000 7fcfcdffb640 1 -- 172.21.15.90:0/492025649 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4014070 con 0x7fcfd80b3380 2024-09-10T23:17:44.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.671+0000 7fcfcdffb640 1 -- 172.21.15.90:0/492025649 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfd4010700 con 0x7fcfd80b3380 2024-09-10T23:17:44.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.671+0000 7fcfdf6dd640 1 -- 172.21.15.90:0/492025649 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd815b700 con 0x7fcfd80b3380 2024-09-10T23:17:44.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.671+0000 7fcfcdffb640 1 -- 172.21.15.90:0/492025649 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4010b50 con 0x7fcfd80b3380 2024-09-10T23:17:44.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.671+0000 7fcfdf6dd640 1 -- 172.21.15.90:0/492025649 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd815bcc0 con 0x7fcfd80b3380 2024-09-10T23:17:44.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.672+0000 7fcfdf6dd640 1 -- 172.21.15.90:0/492025649 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfd80b2da0 con 0x7fcfd80b3380 2024-09-10T23:17:44.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.672+0000 7fcfcdffb640 1 -- 172.21.15.90:0/492025649 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcfd4017360 con 0x7fcfd80b3380 2024-09-10T23:17:44.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.673+0000 7fcfcdffb640 1 --2- 172.21.15.90:0/492025649 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcfbc077f70 0x7fcfbc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:44.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.673+0000 7fcfcdffb640 1 -- 172.21.15.90:0/492025649 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7fcfd4099ad0 con 0x7fcfd80b3380 2024-09-10T23:17:44.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.673+0000 7fcfdcc78640 1 --2- 172.21.15.90:0/492025649 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcfbc077f70 0x7fcfbc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:44.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.674+0000 7fcfdcc78640 1 --2- 172.21.15.90:0/492025649 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcfbc077f70 0x7fcfbc07a430 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8033000 tx=0x7fcfc8004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:44.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.677+0000 7fcfcdffb640 1 -- 172.21.15.90:0/492025649 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcfd4062570 con 0x7fcfd80b3380 2024-09-10T23:17:44.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:44.854+0000 7fcfdf6dd640 1 -- 172.21.15.90:0/492025649 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcfd80d08b0 con 0x7fcfd80b3380 2024-09-10T23:17:45.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.508+0000 7fcfcdffb640 1 -- 172.21.15.90:0/492025649 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) ==== 181+0+0 (secure 0 0 0) 0x7fcfd4061e70 con 0x7fcfd80b3380 2024-09-10T23:17:45.510 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:17:45.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.511+0000 7fcfdf6dd640 1 -- 172.21.15.90:0/492025649 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcfbc077f70 msgr2=0x7fcfbc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:45.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.511+0000 7fcfdf6dd640 1 --2- 172.21.15.90:0/492025649 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcfbc077f70 0x7fcfbc07a430 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8033000 tx=0x7fcfc8004730 comp rx=0 tx=0).stop 2024-09-10T23:17:45.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.511+0000 7fcfdf6dd640 1 -- 172.21.15.90:0/492025649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfd80b3380 msgr2=0x7fcfd815c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:45.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.511+0000 7fcfdf6dd640 1 --2- 172.21.15.90:0/492025649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfd80b3380 0x7fcfd815c1e0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400b4a0 tx=0x7fcfd400b960 comp rx=0 tx=0).stop 2024-09-10T23:17:45.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.511+0000 7fcfdf6dd640 1 -- 172.21.15.90:0/492025649 shutdown_connections 2024-09-10T23:17:45.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.511+0000 7fcfdf6dd640 1 --2- 172.21.15.90:0/492025649 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcfbc077f70 0x7fcfbc07a430 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:45.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.511+0000 7fcfdf6dd640 1 --2- 172.21.15.90:0/492025649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfd815e9b0 0x7fcfd8152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:45.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.511+0000 7fcfdf6dd640 1 --2- 172.21.15.90:0/492025649 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfd815aef0 0x7fcfd81f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:45.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.511+0000 7fcfdf6dd640 1 --2- 172.21.15.90:0/492025649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfd80b3380 0x7fcfd815c1e0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:45.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.511+0000 7fcfdf6dd640 1 -- 172.21.15.90:0/492025649 >> 172.21.15.90:0/492025649 conn(0x7fcfd80b1aa0 msgr2=0x7fcfd8156bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:45.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.511+0000 7fcfdf6dd640 1 -- 172.21.15.90:0/492025649 shutdown_connections 2024-09-10T23:17:45.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.511+0000 7fcfdf6dd640 1 -- 172.21.15.90:0/492025649 wait complete. 2024-09-10T23:17:45.525 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:17:45.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.630+0000 7f42aab4b640 1 -- 172.21.15.90:0/3484161907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f428c004b60 msgr2=0x7f428c004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:45.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.630+0000 7f42aab4b640 1 --2- 172.21.15.90:0/3484161907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f428c004b60 0x7f428c004f80 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f42940016c0 tx=0x7f428c006940 comp rx=0 tx=0).stop 2024-09-10T23:17:45.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.630+0000 7f42aab4b640 1 -- 172.21.15.90:0/3484161907 shutdown_connections 2024-09-10T23:17:45.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.630+0000 7f42aab4b640 1 --2- 172.21.15.90:0/3484161907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f428c004b60 0x7f428c004f80 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:45.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.630+0000 7f42aab4b640 1 -- 172.21.15.90:0/3484161907 >> 172.21.15.90:0/3484161907 conn(0x7f42a40b1aa0 msgr2=0x7f42a40b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:45.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.630+0000 7f42aab4b640 1 -- 172.21.15.90:0/3484161907 shutdown_connections 2024-09-10T23:17:45.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.630+0000 7f42aab4b640 1 -- 172.21.15.90:0/3484161907 wait complete. 2024-09-10T23:17:45.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.631+0000 7f42aab4b640 1 Processor -- start 2024-09-10T23:17:45.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.631+0000 7f42aab4b640 1 -- start start 2024-09-10T23:17:45.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.632+0000 7f42aab4b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f428c004b60 0x7f42a41f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:45.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.632+0000 7f42aab4b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42a4156cc0 0x7f42a40ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:45.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.632+0000 7f42aab4b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42a41e1940 0x7f42a4148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:45.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.632+0000 7f42aab4b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f42a406e660 con 0x7f42a41e1940 2024-09-10T23:17:45.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.632+0000 7f42aab4b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f42a415b960 con 0x7f428c004b60 2024-09-10T23:17:45.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.632+0000 7f42aab4b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f42a406e7e0 con 0x7f42a4156cc0 2024-09-10T23:17:45.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.632+0000 7f42a90e8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42a41e1940 0x7f42a4148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:45.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.632+0000 7f42a90e8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42a41e1940 0x7f42a4148370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43302/0 (socket says 172.21.15.90:43302) 2024-09-10T23:17:45.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.632+0000 7f42a90e8640 1 -- 172.21.15.90:0/2638637297 learned_addr learned my addr 172.21.15.90:0/2638637297 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:45.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.632+0000 7f42a3fff640 1 --2- 172.21.15.90:0/2638637297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42a4156cc0 0x7f42a40ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:45.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.632+0000 7f42a88e7640 1 --2- 172.21.15.90:0/2638637297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f428c004b60 0x7f42a41f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:45.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.633+0000 7f42a90e8640 1 -- 172.21.15.90:0/2638637297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42a4156cc0 msgr2=0x7f42a40ae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:45.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.633+0000 7f42a90e8640 1 --2- 172.21.15.90:0/2638637297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42a4156cc0 0x7f42a40ae5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:45.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.633+0000 7f42a90e8640 1 -- 172.21.15.90:0/2638637297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f428c004b60 msgr2=0x7f42a41f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:45.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.633+0000 7f42a90e8640 1 --2- 172.21.15.90:0/2638637297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f428c004b60 0x7f42a41f5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:45.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.633+0000 7f42a90e8640 1 -- 172.21.15.90:0/2638637297 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a41e21c0 con 0x7f42a41e1940 2024-09-10T23:17:45.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.633+0000 7f42a90e8640 1 --2- 172.21.15.90:0/2638637297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42a41e1940 0x7f42a4148370 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f429c000c00 tx=0x7f429c00e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:45.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.633+0000 7f42a17fa640 1 -- 172.21.15.90:0/2638637297 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c011870 con 0x7f42a41e1940 2024-09-10T23:17:45.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.633+0000 7f42a17fa640 1 -- 172.21.15.90:0/2638637297 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f429c017070 con 0x7f42a41e1940 2024-09-10T23:17:45.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.633+0000 7f42aab4b640 1 -- 172.21.15.90:0/2638637297 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a41f5750 con 0x7f42a41e1940 2024-09-10T23:17:45.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.633+0000 7f42a17fa640 1 -- 172.21.15.90:0/2638637297 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c011da0 con 0x7f42a41e1940 2024-09-10T23:17:45.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.633+0000 7f42aab4b640 1 -- 172.21.15.90:0/2638637297 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a41561e0 con 0x7f42a41e1940 2024-09-10T23:17:45.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.634+0000 7f42aab4b640 1 -- 172.21.15.90:0/2638637297 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a406ed40 con 0x7f42a41e1940 2024-09-10T23:17:45.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.635+0000 7f42a17fa640 1 -- 172.21.15.90:0/2638637297 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f429c01c460 con 0x7f42a41e1940 2024-09-10T23:17:45.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.635+0000 7f42a17fa640 1 --2- 172.21.15.90:0/2638637297 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4290077f70 0x7f429007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:45.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.635+0000 7f42a17fa640 1 -- 172.21.15.90:0/2638637297 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5357+0+0 (secure 0 0 0) 0x7f429c099e30 con 0x7f42a41e1940 2024-09-10T23:17:45.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.635+0000 7f42a88e7640 1 --2- 172.21.15.90:0/2638637297 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4290077f70 0x7f429007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:45.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.636+0000 7f42a88e7640 1 --2- 172.21.15.90:0/2638637297 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4290077f70 0x7f429007a430 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4294032000 tx=0x7f429402c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:45.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.640+0000 7f42a17fa640 1 -- 172.21.15.90:0/2638637297 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f42a41f5750 con 0x7f42a41e1940 2024-09-10T23:17:45.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:45.815+0000 7f42aab4b640 1 -- 172.21.15.90:0/2638637297 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f42a415afc0 con 0x7f42a41e1940 2024-09-10T23:17:46.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.510+0000 7f42a17fa640 1 -- 172.21.15.90:0/2638637297 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) ==== 169+0+0 (secure 0 0 0) 0x7f42a41e21c0 con 0x7f42a41e1940 2024-09-10T23:17:46.511 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' removed 2024-09-10T23:17:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.513+0000 7f42aab4b640 1 -- 172.21.15.90:0/2638637297 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4290077f70 msgr2=0x7f429007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.513+0000 7f42aab4b640 1 --2- 172.21.15.90:0/2638637297 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4290077f70 0x7f429007a430 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4294032000 tx=0x7f429402c040 comp rx=0 tx=0).stop 2024-09-10T23:17:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.513+0000 7f42aab4b640 1 -- 172.21.15.90:0/2638637297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42a41e1940 msgr2=0x7f42a4148370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.513+0000 7f42aab4b640 1 --2- 172.21.15.90:0/2638637297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42a41e1940 0x7f42a4148370 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f429c000c00 tx=0x7f429c00e730 comp rx=0 tx=0).stop 2024-09-10T23:17:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.513+0000 7f42aab4b640 1 -- 172.21.15.90:0/2638637297 shutdown_connections 2024-09-10T23:17:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.513+0000 7f42aab4b640 1 --2- 172.21.15.90:0/2638637297 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4290077f70 0x7f429007a430 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.513+0000 7f42aab4b640 1 --2- 172.21.15.90:0/2638637297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42a41e1940 0x7f42a4148370 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.513+0000 7f42aab4b640 1 --2- 172.21.15.90:0/2638637297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42a4156cc0 0x7f42a40ae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.513+0000 7f42aab4b640 1 --2- 172.21.15.90:0/2638637297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f428c004b60 0x7f42a41f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.513+0000 7f42aab4b640 1 -- 172.21.15.90:0/2638637297 >> 172.21.15.90:0/2638637297 conn(0x7f42a40b1aa0 msgr2=0x7f42a4073240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:46.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.514+0000 7f42aab4b640 1 -- 172.21.15.90:0/2638637297 shutdown_connections 2024-09-10T23:17:46.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.514+0000 7f42aab4b640 1 -- 172.21.15.90:0/2638637297 wait complete. 2024-09-10T23:17:46.527 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:17:46.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.628+0000 7f3663fdb640 1 -- 172.21.15.90:0/1625468161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f365c06f550 msgr2=0x7f365c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:46.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.628+0000 7f3663fdb640 1 --2- 172.21.15.90:0/1625468161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f365c06f550 0x7f365c06f9e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3654009830 tx=0x7f365402a510 comp rx=0 tx=0).stop 2024-09-10T23:17:46.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.629+0000 7f3663fdb640 1 -- 172.21.15.90:0/1625468161 shutdown_connections 2024-09-10T23:17:46.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.629+0000 7f3663fdb640 1 --2- 172.21.15.90:0/1625468161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f365c06f550 0x7f365c06f9e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:46.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.629+0000 7f3663fdb640 1 --2- 172.21.15.90:0/1625468161 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f365c0cdb90 0x7f365c0cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:46.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.629+0000 7f3663fdb640 1 -- 172.21.15.90:0/1625468161 >> 172.21.15.90:0/1625468161 conn(0x7f365c0b19c0 msgr2=0x7f365c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:46.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.629+0000 7f3663fdb640 1 -- 172.21.15.90:0/1625468161 shutdown_connections 2024-09-10T23:17:46.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.629+0000 7f3663fdb640 1 -- 172.21.15.90:0/1625468161 wait complete. 2024-09-10T23:17:46.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.630+0000 7f3663fdb640 1 Processor -- start 2024-09-10T23:17:46.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.630+0000 7f3663fdb640 1 -- start start 2024-09-10T23:17:46.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.630+0000 7f3663fdb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f365c06f550 0x7f365c152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:46.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3663fdb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f365c0cdb90 0x7f365c09c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:46.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3663fdb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f365c15f750 0x7f365c142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:46.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3663fdb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f365c0cc940 con 0x7f365c0cdb90 2024-09-10T23:17:46.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3663fdb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f365c0cc7c0 con 0x7f365c06f550 2024-09-10T23:17:46.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3663fdb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f365c0ccac0 con 0x7f365c15f750 2024-09-10T23:17:46.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3661576640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f365c0cdb90 0x7f365c09c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:46.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3661576640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f365c0cdb90 0x7f365c09c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43306/0 (socket says 172.21.15.90:43306) 2024-09-10T23:17:46.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3661576640 1 -- 172.21.15.90:0/522605566 learned_addr learned my addr 172.21.15.90:0/522605566 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:46.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3661d77640 1 --2- 172.21.15.90:0/522605566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f365c06f550 0x7f365c152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:46.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3662578640 1 --2- 172.21.15.90:0/522605566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f365c15f750 0x7f365c142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:46.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3661576640 1 -- 172.21.15.90:0/522605566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f365c15f750 msgr2=0x7f365c142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:46.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3661576640 1 --2- 172.21.15.90:0/522605566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f365c15f750 0x7f365c142580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:46.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3661576640 1 -- 172.21.15.90:0/522605566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f365c06f550 msgr2=0x7f365c152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:46.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3661576640 1 --2- 172.21.15.90:0/522605566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f365c06f550 0x7f365c152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:46.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3661576640 1 -- 172.21.15.90:0/522605566 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c09cd20 con 0x7f365c0cdb90 2024-09-10T23:17:46.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3662578640 1 --2- 172.21.15.90:0/522605566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f365c15f750 0x7f365c142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:46.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3661576640 1 --2- 172.21.15.90:0/522605566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f365c0cdb90 0x7f365c09c7e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f365000ea20 tx=0x7f365000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:46.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f365a7fc640 1 -- 172.21.15.90:0/522605566 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365000cd80 con 0x7f365c0cdb90 2024-09-10T23:17:46.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3663fdb640 1 -- 172.21.15.90:0/522605566 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f365c09cfc0 con 0x7f365c0cdb90 2024-09-10T23:17:46.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f365a7fc640 1 -- 172.21.15.90:0/522605566 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3650010430 con 0x7f365c0cdb90 2024-09-10T23:17:46.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f365a7fc640 1 -- 172.21.15.90:0/522605566 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3650010840 con 0x7f365c0cdb90 2024-09-10T23:17:46.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.631+0000 7f3663fdb640 1 -- 172.21.15.90:0/522605566 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f365c09d580 con 0x7f365c0cdb90 2024-09-10T23:17:46.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.632+0000 7f3663fdb640 1 -- 172.21.15.90:0/522605566 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f365c06a3a0 con 0x7f365c0cdb90 2024-09-10T23:17:46.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.633+0000 7f365a7fc640 1 -- 172.21.15.90:0/522605566 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f36500109e0 con 0x7f365c0cdb90 2024-09-10T23:17:46.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.633+0000 7f365a7fc640 1 --2- 172.21.15.90:0/522605566 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3648077fa0 0x7f364807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:46.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.633+0000 7f365a7fc640 1 -- 172.21.15.90:0/522605566 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4943+0+0 (secure 0 0 0) 0x7f365009a560 con 0x7f365c0cdb90 2024-09-10T23:17:46.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.634+0000 7f3661d77640 1 --2- 172.21.15.90:0/522605566 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3648077fa0 0x7f364807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:46.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.634+0000 7f3661d77640 1 --2- 172.21.15.90:0/522605566 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3648077fa0 0x7f364807a460 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f364c002200 tx=0x7f364c0019f0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:46.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.637+0000 7f365a7fc640 1 -- 172.21.15.90:0/522605566 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f365c06a3a0 con 0x7f365c0cdb90 2024-09-10T23:17:46.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.819+0000 7f3663fdb640 1 -- 172.21.15.90:0/522605566 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f365c06f9e0 con 0x7f365c0cdb90 2024-09-10T23:17:46.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.823+0000 7f365a7fc640 1 -- 172.21.15.90:0/522605566 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v40) ==== 71+0+0 (secure 0 0 0) 0x7f365009a070 con 0x7f365c0cdb90 2024-09-10T23:17:46.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.825+0000 7f3663fdb640 1 -- 172.21.15.90:0/522605566 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3648077fa0 msgr2=0x7f364807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:46.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.825+0000 7f3663fdb640 1 --2- 172.21.15.90:0/522605566 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3648077fa0 0x7f364807a460 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f364c002200 tx=0x7f364c0019f0 comp rx=0 tx=0).stop 2024-09-10T23:17:46.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.825+0000 7f3663fdb640 1 -- 172.21.15.90:0/522605566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f365c0cdb90 msgr2=0x7f365c09c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:46.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.825+0000 7f3663fdb640 1 --2- 172.21.15.90:0/522605566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f365c0cdb90 0x7f365c09c7e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f365000ea20 tx=0x7f365000eee0 comp rx=0 tx=0).stop 2024-09-10T23:17:46.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.825+0000 7f3663fdb640 1 -- 172.21.15.90:0/522605566 shutdown_connections 2024-09-10T23:17:46.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.825+0000 7f3663fdb640 1 --2- 172.21.15.90:0/522605566 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3648077fa0 0x7f364807a460 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:46.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.825+0000 7f3663fdb640 1 --2- 172.21.15.90:0/522605566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f365c15f750 0x7f365c142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:46.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.825+0000 7f3663fdb640 1 --2- 172.21.15.90:0/522605566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f365c0cdb90 0x7f365c09c7e0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:46.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.825+0000 7f3663fdb640 1 --2- 172.21.15.90:0/522605566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f365c06f550 0x7f365c152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:46.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.825+0000 7f3663fdb640 1 -- 172.21.15.90:0/522605566 >> 172.21.15.90:0/522605566 conn(0x7f365c0b19c0 msgr2=0x7f365c0af930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:46.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.825+0000 7f3663fdb640 1 -- 172.21.15.90:0/522605566 shutdown_connections 2024-09-10T23:17:46.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.825+0000 7f3663fdb640 1 -- 172.21.15.90:0/522605566 wait complete. 2024-09-10T23:17:46.837 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close' 2024-09-10T23:17:46.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.938+0000 7fec26abe640 1 -- 172.21.15.90:0/2197484809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec08005e50 msgr2=0x7fec080062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:46.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.938+0000 7fec26abe640 1 --2- 172.21.15.90:0/2197484809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec08005e50 0x7fec080062d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fec1800c610 tx=0x7fec08006940 comp rx=0 tx=0).stop 2024-09-10T23:17:46.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.938+0000 7fec2505b640 1 -- 172.21.15.90:0/2197484809 reap_dead start 2024-09-10T23:17:46.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.938+0000 7fec26abe640 1 -- 172.21.15.90:0/2197484809 shutdown_connections 2024-09-10T23:17:46.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.938+0000 7fec26abe640 1 -- 172.21.15.90:0/2197484809 >> 172.21.15.90:0/2197484809 conn(0x7fec200b19c0 msgr2=0x7fec200b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:46.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.938+0000 7fec26abe640 1 -- 172.21.15.90:0/2197484809 shutdown_connections 2024-09-10T23:17:46.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.938+0000 7fec26abe640 1 -- 172.21.15.90:0/2197484809 wait complete. 2024-09-10T23:17:46.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.939+0000 7fec26abe640 1 Processor -- start 2024-09-10T23:17:46.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.939+0000 7fec26abe640 1 -- start start 2024-09-10T23:17:46.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.940+0000 7fec26abe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec08005e50 0x7fec20155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:46.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.940+0000 7fec26abe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec2015ae70 0x7fec200b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:46.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.940+0000 7fec26abe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec2014f4a0 0x7fec2014f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:46.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.940+0000 7fec26abe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fec200ced20 con 0x7fec2015ae70 2024-09-10T23:17:46.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.940+0000 7fec26abe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fec200ceba0 con 0x7fec2014f4a0 2024-09-10T23:17:46.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.940+0000 7fec26abe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fec2015a8c0 con 0x7fec08005e50 2024-09-10T23:17:46.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.940+0000 7fec1ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec2015ae70 0x7fec200b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:46.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.940+0000 7fec1ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec2015ae70 0x7fec200b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43322/0 (socket says 172.21.15.90:43322) 2024-09-10T23:17:46.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.940+0000 7fec1ffff640 1 -- 172.21.15.90:0/3413434105 learned_addr learned my addr 172.21.15.90:0/3413434105 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:46.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.941+0000 7fec2505b640 1 --2- 172.21.15.90:0/3413434105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec2014f4a0 0x7fec2014f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:46.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.941+0000 7fec2485a640 1 --2- 172.21.15.90:0/3413434105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec08005e50 0x7fec20155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:46.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.941+0000 7fec1ffff640 1 -- 172.21.15.90:0/3413434105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec08005e50 msgr2=0x7fec20155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:46.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.941+0000 7fec1ffff640 1 --2- 172.21.15.90:0/3413434105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec08005e50 0x7fec20155f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:46.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.941+0000 7fec1ffff640 1 -- 172.21.15.90:0/3413434105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec2014f4a0 msgr2=0x7fec2014f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:46.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.941+0000 7fec1ffff640 1 --2- 172.21.15.90:0/3413434105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec2014f4a0 0x7fec2014f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:46.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.941+0000 7fec1ffff640 1 -- 172.21.15.90:0/3413434105 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec200c9790 con 0x7fec2015ae70 2024-09-10T23:17:46.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.941+0000 7fec2505b640 1 --2- 172.21.15.90:0/3413434105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec2014f4a0 0x7fec2014f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:46.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.941+0000 7fec1ffff640 1 --2- 172.21.15.90:0/3413434105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec2015ae70 0x7fec200b0d20 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fec14011820 tx=0x7fec14011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:46.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.941+0000 7fec1d7fa640 1 -- 172.21.15.90:0/3413434105 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1401f070 con 0x7fec2015ae70 2024-09-10T23:17:46.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.941+0000 7fec1d7fa640 1 -- 172.21.15.90:0/3413434105 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec1400fe40 con 0x7fec2015ae70 2024-09-10T23:17:46.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.941+0000 7fec26abe640 1 -- 172.21.15.90:0/3413434105 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec2015b5e0 con 0x7fec2015ae70 2024-09-10T23:17:46.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.941+0000 7fec1d7fa640 1 -- 172.21.15.90:0/3413434105 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec140126b0 con 0x7fec2015ae70 2024-09-10T23:17:46.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.941+0000 7fec26abe640 1 -- 172.21.15.90:0/3413434105 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec2015b2d0 con 0x7fec2015ae70 2024-09-10T23:17:46.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.942+0000 7fec26abe640 1 -- 172.21.15.90:0/3413434105 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec2015ee60 con 0x7fec2015ae70 2024-09-10T23:17:46.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.943+0000 7fec1d7fa640 1 -- 172.21.15.90:0/3413434105 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fec14012850 con 0x7fec2015ae70 2024-09-10T23:17:46.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.943+0000 7fec1d7fa640 1 --2- 172.21.15.90:0/3413434105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fec0c077fa0 0x7fec0c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:46.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.943+0000 7fec1d7fa640 1 -- 172.21.15.90:0/3413434105 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4943+0+0 (secure 0 0 0) 0x7fec1409a740 con 0x7fec2015ae70 2024-09-10T23:17:46.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.943+0000 7fec2485a640 1 --2- 172.21.15.90:0/3413434105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fec0c077fa0 0x7fec0c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:46.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.944+0000 7fec2485a640 1 --2- 172.21.15.90:0/3413434105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fec0c077fa0 0x7fec0c07a460 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fec10009b10 tx=0x7fec10005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:46.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:46.947+0000 7fec1d7fa640 1 -- 172.21.15.90:0/3413434105 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fec14062e60 con 0x7fec2015ae70 2024-09-10T23:17:47.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.190+0000 7fec26abe640 1 -- 172.21.15.90:0/3413434105 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]} v 0) -- 0x7fec200cc480 con 0x7fec2015ae70 2024-09-10T23:17:47.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.511+0000 7fec1d7fa640 1 -- 172.21.15.90:0/3413434105 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]}]=0 v192) ==== 143+0+0 (secure 0 0 0) 0x7fec14067890 con 0x7fec2015ae70 2024-09-10T23:17:47.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.513+0000 7fec26abe640 1 -- 172.21.15.90:0/3413434105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fec0c077fa0 msgr2=0x7fec0c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:47.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.513+0000 7fec26abe640 1 --2- 172.21.15.90:0/3413434105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fec0c077fa0 0x7fec0c07a460 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fec10009b10 tx=0x7fec10005f90 comp rx=0 tx=0).stop 2024-09-10T23:17:47.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.514+0000 7fec26abe640 1 -- 172.21.15.90:0/3413434105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec2015ae70 msgr2=0x7fec200b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:47.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.514+0000 7fec26abe640 1 --2- 172.21.15.90:0/3413434105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec2015ae70 0x7fec200b0d20 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fec14011820 tx=0x7fec14011ce0 comp rx=0 tx=0).stop 2024-09-10T23:17:47.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.514+0000 7fec26abe640 1 -- 172.21.15.90:0/3413434105 shutdown_connections 2024-09-10T23:17:47.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.514+0000 7fec26abe640 1 --2- 172.21.15.90:0/3413434105 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fec0c077fa0 0x7fec0c07a460 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:47.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.514+0000 7fec26abe640 1 --2- 172.21.15.90:0/3413434105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec2014f4a0 0x7fec2014f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:47.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.514+0000 7fec26abe640 1 --2- 172.21.15.90:0/3413434105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec2015ae70 0x7fec200b0d20 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:47.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.514+0000 7fec26abe640 1 --2- 172.21.15.90:0/3413434105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec08005e50 0x7fec20155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:47.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.514+0000 7fec26abe640 1 -- 172.21.15.90:0/3413434105 >> 172.21.15.90:0/3413434105 conn(0x7fec200b19c0 msgr2=0x7fec200cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:47.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.514+0000 7fec26abe640 1 -- 172.21.15.90:0/3413434105 shutdown_connections 2024-09-10T23:17:47.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.514+0000 7fec26abe640 1 -- 172.21.15.90:0/3413434105 wait complete. 2024-09-10T23:17:47.526 INFO:tasks.cephfs_test_runner:That when a `tell` command is sent using the python CLI, ... ok 2024-09-10T23:17:47.526 INFO:tasks.cephfs_test_runner:Starting test: test_tell_session_drop (tasks.cephfs.test_sessionmap.TestSessionMap) That when a `tell` command is sent using the python CLI, 2024-09-10T23:17:47.526 INFO:tasks.cephfs_test_runner:test_tell_session_drop (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-10T23:17:47.527 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:17:47.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.627+0000 7f121046b640 1 -- 172.21.15.90:0/3624396884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12080cd470 msgr2=0x7f120815e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:47.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.627+0000 7f121046b640 1 --2- 172.21.15.90:0/3624396884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12080cd470 0x7f120815e890 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1200005fd0 tx=0x7f120002b980 comp rx=0 tx=0).stop 2024-09-10T23:17:47.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.627+0000 7f121046b640 1 -- 172.21.15.90:0/3624396884 shutdown_connections 2024-09-10T23:17:47.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.627+0000 7f121046b640 1 --2- 172.21.15.90:0/3624396884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12080cd470 0x7f120815e890 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:47.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.627+0000 7f121046b640 1 --2- 172.21.15.90:0/3624396884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12080b44a0 0x7f12080b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:47.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.627+0000 7f121046b640 1 -- 172.21.15.90:0/3624396884 >> 172.21.15.90:0/3624396884 conn(0x7f12080b19c0 msgr2=0x7f12080b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:47.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.627+0000 7f121046b640 1 -- 172.21.15.90:0/3624396884 shutdown_connections 2024-09-10T23:17:47.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.627+0000 7f121046b640 1 -- 172.21.15.90:0/3624396884 wait complete. 2024-09-10T23:17:47.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.629+0000 7f121046b640 1 Processor -- start 2024-09-10T23:17:47.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.629+0000 7f121046b640 1 -- start start 2024-09-10T23:17:47.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.629+0000 7f121046b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12080b44a0 0x7f12081f8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:47.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.629+0000 7f121046b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12080cd470 0x7f1208155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:47.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.629+0000 7f121046b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12080cf860 0x7f12080ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:47.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.629+0000 7f121046b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f12080ced20 con 0x7f12080b44a0 2024-09-10T23:17:47.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.629+0000 7f121046b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f12080ceba0 con 0x7f12080cf860 2024-09-10T23:17:47.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.629+0000 7f121046b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f120815a8c0 con 0x7f12080cd470 2024-09-10T23:17:47.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f120e207640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12080b44a0 0x7f12081f8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:47.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f120e207640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12080b44a0 0x7f12081f8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43338/0 (socket says 172.21.15.90:43338) 2024-09-10T23:17:47.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f120e207640 1 -- 172.21.15.90:0/1236204629 learned_addr learned my addr 172.21.15.90:0/1236204629 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:47.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f120da06640 1 --2- 172.21.15.90:0/1236204629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12080cd470 0x7f1208155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:47.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f120ea08640 1 --2- 172.21.15.90:0/1236204629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12080cf860 0x7f12080ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:47.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f120e207640 1 -- 172.21.15.90:0/1236204629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12080cd470 msgr2=0x7f1208155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:47.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f120e207640 1 --2- 172.21.15.90:0/1236204629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12080cd470 0x7f1208155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:47.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f120e207640 1 -- 172.21.15.90:0/1236204629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12080cf860 msgr2=0x7f12080ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:47.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f120e207640 1 --2- 172.21.15.90:0/1236204629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12080cf860 0x7f12080ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:47.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f120e207640 1 -- 172.21.15.90:0/1236204629 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1208155840 con 0x7f12080b44a0 2024-09-10T23:17:47.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f120da06640 1 --2- 172.21.15.90:0/1236204629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12080cd470 0x7f1208155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:47.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f120ea08640 1 --2- 172.21.15.90:0/1236204629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12080cf860 0x7f12080ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:47.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f120e207640 1 --2- 172.21.15.90:0/1236204629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12080b44a0 0x7f12081f8810 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f120400ea90 tx=0x7f120400ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:47.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f11feffd640 1 -- 172.21.15.90:0/1236204629 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120400ce40 con 0x7f12080b44a0 2024-09-10T23:17:47.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f11feffd640 1 -- 172.21.15.90:0/1236204629 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1204004020 con 0x7f12080b44a0 2024-09-10T23:17:47.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f121046b640 1 -- 172.21.15.90:0/1236204629 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12081f8ec0 con 0x7f12080b44a0 2024-09-10T23:17:47.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f11feffd640 1 -- 172.21.15.90:0/1236204629 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1204004470 con 0x7f12080b44a0 2024-09-10T23:17:47.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.630+0000 7f121046b640 1 -- 172.21.15.90:0/1236204629 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12081f9700 con 0x7f12080b44a0 2024-09-10T23:17:47.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.631+0000 7f121046b640 1 -- 172.21.15.90:0/1236204629 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f120815eeb0 con 0x7f12080b44a0 2024-09-10T23:17:47.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.632+0000 7f11feffd640 1 -- 172.21.15.90:0/1236204629 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f12040035f0 con 0x7f12080b44a0 2024-09-10T23:17:47.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.632+0000 7f11feffd640 1 --2- 172.21.15.90:0/1236204629 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f11ec077f70 0x7f11ec07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:47.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.632+0000 7f11feffd640 1 -- 172.21.15.90:0/1236204629 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4943+0+0 (secure 0 0 0) 0x7f120409a4e0 con 0x7f12080b44a0 2024-09-10T23:17:47.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.632+0000 7f120da06640 1 --2- 172.21.15.90:0/1236204629 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f11ec077f70 0x7f11ec07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:47.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.633+0000 7f120da06640 1 --2- 172.21.15.90:0/1236204629 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f11ec077f70 0x7f11ec07a430 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f11f8007fd0 tx=0x7f11f8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:47.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.636+0000 7f11feffd640 1 -- 172.21.15.90:0/1236204629 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f12081f8ec0 con 0x7f12080b44a0 2024-09-10T23:17:47.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.811+0000 7f121046b640 1 -- 172.21.15.90:0/1236204629 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12080cf5b0 con 0x7f12080b44a0 2024-09-10T23:17:47.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.812+0000 7f11feffd640 1 -- 172.21.15.90:0/1236204629 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+13033 (secure 0 0 0) 0x7f1208155840 con 0x7f12080b44a0 2024-09-10T23:17:47.814 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:47.814 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":84,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:17:46.509768+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6834/1524104545":"2024-09-11T23:17:43.504961+0000","172.21.15.90:6832/1524104545":"2024-09-11T23:17:43.504961+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:17:47.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.814+0000 7f121046b640 1 -- 172.21.15.90:0/1236204629 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f11ec077f70 msgr2=0x7f11ec07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:47.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.814+0000 7f121046b640 1 --2- 172.21.15.90:0/1236204629 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f11ec077f70 0x7f11ec07a430 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f11f8007fd0 tx=0x7f11f8009040 comp rx=0 tx=0).stop 2024-09-10T23:17:47.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.814+0000 7f121046b640 1 -- 172.21.15.90:0/1236204629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12080b44a0 msgr2=0x7f12081f8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:47.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.814+0000 7f121046b640 1 --2- 172.21.15.90:0/1236204629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12080b44a0 0x7f12081f8810 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f120400ea90 tx=0x7f120400ef50 comp rx=0 tx=0).stop 2024-09-10T23:17:47.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.814+0000 7f121046b640 1 -- 172.21.15.90:0/1236204629 shutdown_connections 2024-09-10T23:17:47.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.814+0000 7f121046b640 1 --2- 172.21.15.90:0/1236204629 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f11ec077f70 0x7f11ec07a430 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:47.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.814+0000 7f121046b640 1 --2- 172.21.15.90:0/1236204629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12080cf860 0x7f12080ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:47.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.814+0000 7f121046b640 1 --2- 172.21.15.90:0/1236204629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12080cd470 0x7f1208155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:47.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.814+0000 7f121046b640 1 --2- 172.21.15.90:0/1236204629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12080b44a0 0x7f12081f8810 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:47.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.814+0000 7f121046b640 1 -- 172.21.15.90:0/1236204629 >> 172.21.15.90:0/1236204629 conn(0x7f12080b19c0 msgr2=0x7f12080ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:47.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.814+0000 7f121046b640 1 -- 172.21.15.90:0/1236204629 shutdown_connections 2024-09-10T23:17:47.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.814+0000 7f121046b640 1 -- 172.21.15.90:0/1236204629 wait complete. 2024-09-10T23:17:47.827 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:14:26.449950+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:17:47.828 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:17:47.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.932+0000 7f9cc23b4640 1 -- 172.21.15.90:0/1654343765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cbc0b3310 msgr2=0x7f9cbc0b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:47.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.932+0000 7f9cc23b4640 1 --2- 172.21.15.90:0/1654343765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cbc0b3310 0x7f9cbc0b24e0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009830 tx=0x7f9cac02a480 comp rx=0 tx=0).stop 2024-09-10T23:17:47.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.932+0000 7f9cc23b4640 1 -- 172.21.15.90:0/1654343765 shutdown_connections 2024-09-10T23:17:47.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.932+0000 7f9cc23b4640 1 --2- 172.21.15.90:0/1654343765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cbc0b3310 0x7f9cbc0b24e0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:47.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.932+0000 7f9cc23b4640 1 -- 172.21.15.90:0/1654343765 >> 172.21.15.90:0/1654343765 conn(0x7f9cbc0b19c0 msgr2=0x7f9cbc0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:47.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.932+0000 7f9cc23b4640 1 -- 172.21.15.90:0/1654343765 shutdown_connections 2024-09-10T23:17:47.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.932+0000 7f9cc23b4640 1 -- 172.21.15.90:0/1654343765 wait complete. 2024-09-10T23:17:47.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.933+0000 7f9cc23b4640 1 Processor -- start 2024-09-10T23:17:47.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.933+0000 7f9cc23b4640 1 -- start start 2024-09-10T23:17:47.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.934+0000 7f9cc23b4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cbc0b3310 0x7f9cbc1487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:47.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.934+0000 7f9cc23b4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cbc0ceca0 0x7f9cbc1f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:47.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.934+0000 7f9cc23b4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc147e40 0x7f9cbc0cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:47.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.934+0000 7f9cc23b4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc15bbc0 con 0x7f9cbc0ceca0 2024-09-10T23:17:47.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.934+0000 7f9cc23b4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc15ba40 con 0x7f9cbc0b3310 2024-09-10T23:17:47.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.934+0000 7f9cc23b4640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9cbc15bd40 con 0x7f9cbc147e40 2024-09-10T23:17:47.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.934+0000 7f9cbb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cbc0ceca0 0x7f9cbc1f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:47.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.934+0000 7f9cbb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cbc0ceca0 0x7f9cbc1f59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43356/0 (socket says 172.21.15.90:43356) 2024-09-10T23:17:47.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.934+0000 7f9cbb7fe640 1 -- 172.21.15.90:0/2322341459 learned_addr learned my addr 172.21.15.90:0/2322341459 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:47.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.934+0000 7f9cbb7fe640 1 -- 172.21.15.90:0/2322341459 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc147e40 msgr2=0x7f9cbc0cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:47.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.934+0000 7f9cbb7fe640 1 --2- 172.21.15.90:0/2322341459 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc147e40 0x7f9cbc0cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:47.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.935+0000 7f9cbb7fe640 1 -- 172.21.15.90:0/2322341459 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cbc0b3310 msgr2=0x7f9cbc1487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:47.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.935+0000 7f9cbb7fe640 1 --2- 172.21.15.90:0/2322341459 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cbc0b3310 0x7f9cbc1487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.935+0000 7f9cbb7fe640 1 -- 172.21.15.90:0/2322341459 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cbc14b7d0 con 0x7f9cbc0ceca0 2024-09-10T23:17:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.935+0000 7f9cbb7fe640 1 --2- 172.21.15.90:0/2322341459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cbc0ceca0 0x7f9cbc1f59e0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000c3a0 tx=0x7f9cb000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.935+0000 7f9cb8ff9640 1 -- 172.21.15.90:0/2322341459 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0011790 con 0x7f9cbc0ceca0 2024-09-10T23:17:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.935+0000 7f9cb8ff9640 1 -- 172.21.15.90:0/2322341459 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cb0017070 con 0x7f9cbc0ceca0 2024-09-10T23:17:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.935+0000 7f9cc23b4640 1 -- 172.21.15.90:0/2322341459 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cbc1f5f20 con 0x7f9cbc0ceca0 2024-09-10T23:17:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.935+0000 7f9cb8ff9640 1 -- 172.21.15.90:0/2322341459 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0011cc0 con 0x7f9cbc0ceca0 2024-09-10T23:17:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.935+0000 7f9cc23b4640 1 -- 172.21.15.90:0/2322341459 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cbc14ae30 con 0x7f9cbc0ceca0 2024-09-10T23:17:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.936+0000 7f9cc23b4640 1 -- 172.21.15.90:0/2322341459 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cbc15d390 con 0x7f9cbc0ceca0 2024-09-10T23:17:47.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.936+0000 7f9cb8ff9640 1 -- 172.21.15.90:0/2322341459 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9cb001c460 con 0x7f9cbc0ceca0 2024-09-10T23:17:47.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.937+0000 7f9cb8ff9640 1 --2- 172.21.15.90:0/2322341459 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9ca8077fa0 0x7f9ca807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:47.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.937+0000 7f9cb8ff9640 1 -- 172.21.15.90:0/2322341459 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4943+0+0 (secure 0 0 0) 0x7f9cb0099780 con 0x7f9cbc0ceca0 2024-09-10T23:17:47.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.937+0000 7f9cbbfff640 1 --2- 172.21.15.90:0/2322341459 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9ca8077fa0 0x7f9ca807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:47.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.938+0000 7f9cbbfff640 1 --2- 172.21.15.90:0/2322341459 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9ca8077fa0 0x7f9ca807a460 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9cac034000 tx=0x7f9cac0046c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:47.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:47.941+0000 7f9cb8ff9640 1 -- 172.21.15.90:0/2322341459 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9cb0062610 con 0x7f9cbc0ceca0 2024-09-10T23:17:48.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.116+0000 7f9cc23b4640 1 -- 172.21.15.90:0/2322341459 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9cbc0b4f50 con 0x7f9cbc0ceca0 2024-09-10T23:17:48.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.116+0000 7f9cb8ff9640 1 -- 172.21.15.90:0/2322341459 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f9cb0061f10 con 0x7f9cbc0ceca0 2024-09-10T23:17:48.117 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-09-10T23:17:48.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.119+0000 7f9cc23b4640 1 -- 172.21.15.90:0/2322341459 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9ca8077fa0 msgr2=0x7f9ca807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:48.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.119+0000 7f9cc23b4640 1 --2- 172.21.15.90:0/2322341459 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9ca8077fa0 0x7f9ca807a460 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9cac034000 tx=0x7f9cac0046c0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.119+0000 7f9cc23b4640 1 -- 172.21.15.90:0/2322341459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cbc0ceca0 msgr2=0x7f9cbc1f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:48.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.119+0000 7f9cc23b4640 1 --2- 172.21.15.90:0/2322341459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cbc0ceca0 0x7f9cbc1f59e0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000c3a0 tx=0x7f9cb000c860 comp rx=0 tx=0).stop 2024-09-10T23:17:48.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.119+0000 7f9cc23b4640 1 -- 172.21.15.90:0/2322341459 shutdown_connections 2024-09-10T23:17:48.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.119+0000 7f9cc23b4640 1 --2- 172.21.15.90:0/2322341459 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9ca8077fa0 0x7f9ca807a460 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.119+0000 7f9cc23b4640 1 --2- 172.21.15.90:0/2322341459 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc147e40 0x7f9cbc0cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.119+0000 7f9cc23b4640 1 --2- 172.21.15.90:0/2322341459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cbc0ceca0 0x7f9cbc1f59e0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.119+0000 7f9cc23b4640 1 --2- 172.21.15.90:0/2322341459 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cbc0b3310 0x7f9cbc1487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.119+0000 7f9cc23b4640 1 -- 172.21.15.90:0/2322341459 >> 172.21.15.90:0/2322341459 conn(0x7f9cbc0b19c0 msgr2=0x7f9cbc0ae460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:48.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.119+0000 7f9cc23b4640 1 -- 172.21.15.90:0/2322341459 shutdown_connections 2024-09-10T23:17:48.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.119+0000 7f9cc23b4640 1 -- 172.21.15.90:0/2322341459 wait complete. 2024-09-10T23:17:48.131 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop' 2024-09-10T23:17:48.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.231+0000 7fb8619e8640 1 -- 172.21.15.90:0/3950917977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb848004800 msgr2=0x7fb848004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:48.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.231+0000 7fb8619e8640 1 --2- 172.21.15.90:0/3950917977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb848004800 0x7fb848004c80 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb844009b50 tx=0x7fb848005830 comp rx=0 tx=0).stop 2024-09-10T23:17:48.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.231+0000 7fb85b7fe640 1 -- 172.21.15.90:0/3950917977 reap_dead start 2024-09-10T23:17:48.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.231+0000 7fb8619e8640 1 -- 172.21.15.90:0/3950917977 shutdown_connections 2024-09-10T23:17:48.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.231+0000 7fb8619e8640 1 -- 172.21.15.90:0/3950917977 >> 172.21.15.90:0/3950917977 conn(0x7fb85c0b19c0 msgr2=0x7fb85c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:48.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.231+0000 7fb8619e8640 1 -- 172.21.15.90:0/3950917977 shutdown_connections 2024-09-10T23:17:48.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.231+0000 7fb8619e8640 1 -- 172.21.15.90:0/3950917977 wait complete. 2024-09-10T23:17:48.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.233+0000 7fb8619e8640 1 Processor -- start 2024-09-10T23:17:48.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.233+0000 7fb8619e8640 1 -- start start 2024-09-10T23:17:48.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb8619e8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb848004800 0x7fb85c0b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:48.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb8619e8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb85c15db10 0x7fb85c15df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:48.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb8619e8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb85c15a650 0x7fb85c15aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:48.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb8619e8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c06fd70 con 0x7fb85c15a650 2024-09-10T23:17:48.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb8619e8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c06fbf0 con 0x7fb85c15db10 2024-09-10T23:17:48.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb8619e8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb85c0cc5b0 con 0x7fb848004800 2024-09-10T23:17:48.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb85b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb85c15a650 0x7fb85c15aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:48.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb85b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb85c15a650 0x7fb85c15aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48088/0 (socket says 172.21.15.90:48088) 2024-09-10T23:17:48.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb85b7fe640 1 -- 172.21.15.90:0/1954145728 learned_addr learned my addr 172.21.15.90:0/1954145728 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:48.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb85affd640 1 --2- 172.21.15.90:0/1954145728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb848004800 0x7fb85c0b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:48.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb85a7fc640 1 --2- 172.21.15.90:0/1954145728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb85c15db10 0x7fb85c15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:48.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb85b7fe640 1 -- 172.21.15.90:0/1954145728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb848004800 msgr2=0x7fb85c0b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb85b7fe640 1 --2- 172.21.15.90:0/1954145728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb848004800 0x7fb85c0b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb85b7fe640 1 -- 172.21.15.90:0/1954145728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb85c15db10 msgr2=0x7fb85c15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb85b7fe640 1 --2- 172.21.15.90:0/1954145728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb85c15db10 0x7fb85c15df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb85b7fe640 1 -- 172.21.15.90:0/1954145728 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c14e010 con 0x7fb85c15a650 2024-09-10T23:17:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb85b7fe640 1 --2- 172.21.15.90:0/1954145728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb85c15a650 0x7fb85c15aad0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0767d0 tx=0x7fb854011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb853fff640 1 -- 172.21.15.90:0/1954145728 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85401f070 con 0x7fb85c15a650 2024-09-10T23:17:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb853fff640 1 -- 172.21.15.90:0/1954145728 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb854012af0 con 0x7fb85c15a650 2024-09-10T23:17:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb8619e8640 1 -- 172.21.15.90:0/1954145728 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb85c15e680 con 0x7fb85c15a650 2024-09-10T23:17:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb853fff640 1 -- 172.21.15.90:0/1954145728 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85401a440 con 0x7fb85c15a650 2024-09-10T23:17:48.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.234+0000 7fb8619e8640 1 -- 172.21.15.90:0/1954145728 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb85c0b3140 con 0x7fb85c15a650 2024-09-10T23:17:48.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.235+0000 7fb8619e8640 1 -- 172.21.15.90:0/1954145728 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb85c15b010 con 0x7fb85c15a650 2024-09-10T23:17:48.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.236+0000 7fb853fff640 1 -- 172.21.15.90:0/1954145728 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb8540233b0 con 0x7fb85c15a650 2024-09-10T23:17:48.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.236+0000 7fb853fff640 1 --2- 172.21.15.90:0/1954145728 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb83c077f70 0x7fb83c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:48.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.237+0000 7fb853fff640 1 -- 172.21.15.90:0/1954145728 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4943+0+0 (secure 0 0 0) 0x7fb85409a2e0 con 0x7fb85c15a650 2024-09-10T23:17:48.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.237+0000 7fb85affd640 1 --2- 172.21.15.90:0/1954145728 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb83c077f70 0x7fb83c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:48.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.237+0000 7fb85affd640 1 --2- 172.21.15.90:0/1954145728 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb83c077f70 0x7fb83c07a430 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb84c002230 tx=0x7fb84c005040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:48.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.241+0000 7fb853fff640 1 -- 172.21.15.90:0/1954145728 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb854062a90 con 0x7fb85c15a650 2024-09-10T23:17:48.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.482+0000 7fb8619e8640 1 -- 172.21.15.90:0/1954145728 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]} v 0) -- 0x7fb85c0cdfd0 con 0x7fb85c15a650 2024-09-10T23:17:48.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.517+0000 7fb853fff640 1 -- 172.21.15.90:0/1954145728 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]}]=0 v193) ==== 148+0+0 (secure 0 0 0) 0x7fb8540674c0 con 0x7fb85c15a650 2024-09-10T23:17:48.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.519+0000 7fb8619e8640 1 -- 172.21.15.90:0/1954145728 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb83c077f70 msgr2=0x7fb83c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:48.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.519+0000 7fb8619e8640 1 --2- 172.21.15.90:0/1954145728 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb83c077f70 0x7fb83c07a430 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb84c002230 tx=0x7fb84c005040 comp rx=0 tx=0).stop 2024-09-10T23:17:48.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.519+0000 7fb8619e8640 1 -- 172.21.15.90:0/1954145728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb85c15a650 msgr2=0x7fb85c15aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:48.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.519+0000 7fb8619e8640 1 --2- 172.21.15.90:0/1954145728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb85c15a650 0x7fb85c15aad0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0767d0 tx=0x7fb854011a50 comp rx=0 tx=0).stop 2024-09-10T23:17:48.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.519+0000 7fb8619e8640 1 -- 172.21.15.90:0/1954145728 shutdown_connections 2024-09-10T23:17:48.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.519+0000 7fb8619e8640 1 --2- 172.21.15.90:0/1954145728 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb83c077f70 0x7fb83c07a430 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.519+0000 7fb8619e8640 1 --2- 172.21.15.90:0/1954145728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb85c15db10 0x7fb85c15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.519+0000 7fb8619e8640 1 --2- 172.21.15.90:0/1954145728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb85c15a650 0x7fb85c15aad0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.519+0000 7fb8619e8640 1 --2- 172.21.15.90:0/1954145728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb848004800 0x7fb85c0b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.519+0000 7fb8619e8640 1 -- 172.21.15.90:0/1954145728 >> 172.21.15.90:0/1954145728 conn(0x7fb85c0b19c0 msgr2=0x7fb85c073bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:48.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.520+0000 7fb8619e8640 1 -- 172.21.15.90:0/1954145728 shutdown_connections 2024-09-10T23:17:48.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.520+0000 7fb8619e8640 1 -- 172.21.15.90:0/1954145728 wait complete. 2024-09-10T23:17:48.531 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:17:48.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.633+0000 7f36e773d640 1 -- 172.21.15.90:0/3134571522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36cc003a00 msgr2=0x7f36cc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:48.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.633+0000 7f36e773d640 1 --2- 172.21.15.90:0/3134571522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36cc003a00 0x7f36cc003e20 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009b50 tx=0x7f36cc005830 comp rx=0 tx=0).stop 2024-09-10T23:17:48.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.633+0000 7f36e5cda640 1 -- 172.21.15.90:0/3134571522 reap_dead start 2024-09-10T23:17:48.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.633+0000 7f36e773d640 1 -- 172.21.15.90:0/3134571522 shutdown_connections 2024-09-10T23:17:48.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.633+0000 7f36e773d640 1 -- 172.21.15.90:0/3134571522 >> 172.21.15.90:0/3134571522 conn(0x7f36e00d4090 msgr2=0x7f36e00d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:48.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.633+0000 7f36e773d640 1 -- 172.21.15.90:0/3134571522 shutdown_connections 2024-09-10T23:17:48.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.633+0000 7f36e773d640 1 -- 172.21.15.90:0/3134571522 wait complete. 2024-09-10T23:17:48.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.634+0000 7f36e773d640 1 Processor -- start 2024-09-10T23:17:48.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.634+0000 7f36e773d640 1 -- start start 2024-09-10T23:17:48.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e773d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36cc003a00 0x7f36e0153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:48.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e773d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36e015f600 0x7f36e00b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e773d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36e01f3da0 0x7f36e01f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e773d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f36e00d0a80 con 0x7f36cc003a00 2024-09-10T23:17:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e773d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f36e00d4d90 con 0x7f36e01f3da0 2024-09-10T23:17:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e773d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f36e00d0c00 con 0x7f36e015f600 2024-09-10T23:17:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e54d9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36cc003a00 0x7f36e0153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e54d9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36cc003a00 0x7f36e0153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48102/0 (socket says 172.21.15.90:48102) 2024-09-10T23:17:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e54d9640 1 -- 172.21.15.90:0/3248127313 learned_addr learned my addr 172.21.15.90:0/3248127313 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e4cd8640 1 --2- 172.21.15.90:0/3248127313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36e015f600 0x7f36e00b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e5cda640 1 --2- 172.21.15.90:0/3248127313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36e01f3da0 0x7f36e01f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e54d9640 1 -- 172.21.15.90:0/3248127313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36e015f600 msgr2=0x7f36e00b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e54d9640 1 --2- 172.21.15.90:0/3248127313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36e015f600 0x7f36e00b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e54d9640 1 -- 172.21.15.90:0/3248127313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36e01f3da0 msgr2=0x7f36e01f4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:48.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e54d9640 1 --2- 172.21.15.90:0/3248127313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36e01f3da0 0x7f36e01f4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e54d9640 1 -- 172.21.15.90:0/3248127313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e00c8ee0 con 0x7f36cc003a00 2024-09-10T23:17:48.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e4cd8640 1 --2- 172.21.15.90:0/3248127313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36e015f600 0x7f36e00b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:48.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e5cda640 1 --2- 172.21.15.90:0/3248127313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36e01f3da0 0x7f36e01f4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:48.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36e54d9640 1 --2- 172.21.15.90:0/3248127313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36cc003a00 0x7f36e0153640 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009a70 tx=0x7f36d4033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:48.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.635+0000 7f36d1ffb640 1 -- 172.21.15.90:0/3248127313 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d4043070 con 0x7f36cc003a00 2024-09-10T23:17:48.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.636+0000 7f36d1ffb640 1 -- 172.21.15.90:0/3248127313 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36d4004320 con 0x7f36cc003a00 2024-09-10T23:17:48.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.636+0000 7f36e773d640 1 -- 172.21.15.90:0/3248127313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e015fe50 con 0x7f36cc003a00 2024-09-10T23:17:48.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.636+0000 7f36d1ffb640 1 -- 172.21.15.90:0/3248127313 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d4038040 con 0x7f36cc003a00 2024-09-10T23:17:48.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.636+0000 7f36e773d640 1 -- 172.21.15.90:0/3248127313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e0160410 con 0x7f36cc003a00 2024-09-10T23:17:48.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.637+0000 7f36e773d640 1 -- 172.21.15.90:0/3248127313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36e015e6f0 con 0x7f36cc003a00 2024-09-10T23:17:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.637+0000 7f36d1ffb640 1 -- 172.21.15.90:0/3248127313 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f36d403b030 con 0x7f36cc003a00 2024-09-10T23:17:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.638+0000 7f36d1ffb640 1 --2- 172.21.15.90:0/3248127313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f36c4077f70 0x7f36c407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.638+0000 7f36d1ffb640 1 -- 172.21.15.90:0/3248127313 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4943+0+0 (secure 0 0 0) 0x7f36d40b9e20 con 0x7f36cc003a00 2024-09-10T23:17:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.638+0000 7f36e4cd8640 1 --2- 172.21.15.90:0/3248127313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f36c4077f70 0x7f36c407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:48.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.639+0000 7f36e4cd8640 1 --2- 172.21.15.90:0/3248127313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f36c4077f70 0x7f36c407a430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f36dc000c00 tx=0x7f36dc000ed0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:48.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.642+0000 7f36d1ffb640 1 -- 172.21.15.90:0/3248127313 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f36d40825d0 con 0x7f36cc003a00 2024-09-10T23:17:48.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.819+0000 7f36e773d640 1 -- 172.21.15.90:0/3248127313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f36e00b11a0 con 0x7f36cc003a00 2024-09-10T23:17:48.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.819+0000 7f36d1ffb640 1 -- 172.21.15.90:0/3248127313 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v40) ==== 59+0+1998 (secure 0 0 0) 0x7f36d408b340 con 0x7f36cc003a00 2024-09-10T23:17:48.820 INFO:teuthology.orchestra.run.smithi090.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:17:48.820 INFO:teuthology.orchestra.run.smithi090.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:17:48.820 INFO:teuthology.orchestra.run.smithi090.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:17:48.821 INFO:teuthology.orchestra.run.smithi090.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:17:48.821 INFO:teuthology.orchestra.run.smithi090.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8283.895139 2024-09-10T23:17:48.821 INFO:teuthology.orchestra.run.smithi090.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5684.288500 2024-09-10T23:17:48.821 INFO:teuthology.orchestra.run.smithi090.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5960.411649 2024-09-10T23:17:48.821 INFO:teuthology.orchestra.run.smithi090.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5499.929251 2024-09-10T23:17:48.821 INFO:teuthology.orchestra.run.smithi090.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5373.806301 2024-09-10T23:17:48.821 INFO:teuthology.orchestra.run.smithi090.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5138.908279 2024-09-10T23:17:48.821 INFO:teuthology.orchestra.run.smithi090.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5181.430205 2024-09-10T23:17:48.821 INFO:teuthology.orchestra.run.smithi090.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4880.265977 2024-09-10T23:17:48.821 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_mds 20/20 2024-09-10T23:17:48.821 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:17:48.821 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_ms 2/2 2024-09-10T23:17:48.822 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_debug_frag true 2024-09-10T23:17:48.822 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:17:48.822 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:17:48.822 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_verify_scatter true 2024-09-10T23:17:48.822 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:17:48.822 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:17:48.822 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:17:48.822 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced client_mount_timeout 600 2024-09-10T23:17:48.822 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced debug_client 20/20 2024-09-10T23:17:48.822 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced debug_ms 1/1 2024-09-10T23:17:48.822 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:17:48.822 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:17:48.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.821+0000 7f36e773d640 1 -- 172.21.15.90:0/3248127313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f36c4077f70 msgr2=0x7f36c407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:48.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.821+0000 7f36e773d640 1 --2- 172.21.15.90:0/3248127313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f36c4077f70 0x7f36c407a430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f36dc000c00 tx=0x7f36dc000ed0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.821+0000 7f36e773d640 1 -- 172.21.15.90:0/3248127313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36cc003a00 msgr2=0x7f36e0153640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:48.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.821+0000 7f36e773d640 1 --2- 172.21.15.90:0/3248127313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36cc003a00 0x7f36e0153640 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009a70 tx=0x7f36d4033670 comp rx=0 tx=0).stop 2024-09-10T23:17:48.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.821+0000 7f36e773d640 1 -- 172.21.15.90:0/3248127313 shutdown_connections 2024-09-10T23:17:48.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.821+0000 7f36e773d640 1 --2- 172.21.15.90:0/3248127313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f36c4077f70 0x7f36c407a430 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.821+0000 7f36e773d640 1 --2- 172.21.15.90:0/3248127313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36e01f3da0 0x7f36e01f4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.821+0000 7f36e773d640 1 --2- 172.21.15.90:0/3248127313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36e015f600 0x7f36e00b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.821+0000 7f36e773d640 1 --2- 172.21.15.90:0/3248127313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36cc003a00 0x7f36e0153640 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.821+0000 7f36e773d640 1 -- 172.21.15.90:0/3248127313 >> 172.21.15.90:0/3248127313 conn(0x7f36e00d4090 msgr2=0x7f36e00d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:48.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.821+0000 7f36e773d640 1 -- 172.21.15.90:0/3248127313 shutdown_connections 2024-09-10T23:17:48.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.821+0000 7f36e773d640 1 -- 172.21.15.90:0/3248127313 wait complete. 2024-09-10T23:17:48.833 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:17:48.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.936+0000 7f5cf7fff640 1 -- 172.21.15.90:0/3193984437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf80d4a10 msgr2=0x7f5cf80b7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:48.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.936+0000 7f5cf7fff640 1 --2- 172.21.15.90:0/3193984437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf80d4a10 0x7f5cf80b7290 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0005fd0 tx=0x7f5cf002aa10 comp rx=0 tx=0).stop 2024-09-10T23:17:48.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.936+0000 7f5cf7fff640 1 -- 172.21.15.90:0/3193984437 shutdown_connections 2024-09-10T23:17:48.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.936+0000 7f5cf7fff640 1 --2- 172.21.15.90:0/3193984437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf80d4a10 0x7f5cf80b7290 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.936+0000 7f5cf7fff640 1 --2- 172.21.15.90:0/3193984437 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cf815e270 0x7f5cf80d1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.936+0000 7f5cf7fff640 1 -- 172.21.15.90:0/3193984437 >> 172.21.15.90:0/3193984437 conn(0x7f5cf80d3ef0 msgr2=0x7f5cf80d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:48.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.936+0000 7f5cf7fff640 1 -- 172.21.15.90:0/3193984437 shutdown_connections 2024-09-10T23:17:48.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.936+0000 7f5cf7fff640 1 -- 172.21.15.90:0/3193984437 wait complete. 2024-09-10T23:17:48.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.937+0000 7f5cf7fff640 1 Processor -- start 2024-09-10T23:17:48.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.938+0000 7f5cf7fff640 1 -- start start 2024-09-10T23:17:48.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.938+0000 7f5cf7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf80d0630 0x7f5cf809f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.938+0000 7f5cf7fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cf80d4a10 0x7f5cf815b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.938+0000 7f5cf7fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf815e270 0x7f5cf8160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.938+0000 7f5cf7fff640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf80b7b90 con 0x7f5cf80d0630 2024-09-10T23:17:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.938+0000 7f5cf7fff640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf80b7a10 con 0x7f5cf815e270 2024-09-10T23:17:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.938+0000 7f5cf7fff640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf80b7d10 con 0x7f5cf80d4a10 2024-09-10T23:17:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.938+0000 7f5cf6ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf80d0630 0x7f5cf809f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.938+0000 7f5cf6ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf80d0630 0x7f5cf809f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48118/0 (socket says 172.21.15.90:48118) 2024-09-10T23:17:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.938+0000 7f5cf6ffd640 1 -- 172.21.15.90:0/582455496 learned_addr learned my addr 172.21.15.90:0/582455496 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.938+0000 7f5ceffff640 1 --2- 172.21.15.90:0/582455496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cf80d4a10 0x7f5cf815b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.939+0000 7f5cf77fe640 1 --2- 172.21.15.90:0/582455496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf815e270 0x7f5cf8160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:48.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.939+0000 7f5cf6ffd640 1 -- 172.21.15.90:0/582455496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cf80d4a10 msgr2=0x7f5cf815b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:48.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.939+0000 7f5cf6ffd640 1 --2- 172.21.15.90:0/582455496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cf80d4a10 0x7f5cf815b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.939+0000 7f5cf6ffd640 1 -- 172.21.15.90:0/582455496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf815e270 msgr2=0x7f5cf8160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:48.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.939+0000 7f5cf6ffd640 1 --2- 172.21.15.90:0/582455496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf815e270 0x7f5cf8160660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:48.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.939+0000 7f5cf6ffd640 1 -- 172.21.15.90:0/582455496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf815b9b0 con 0x7f5cf80d0630 2024-09-10T23:17:48.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.939+0000 7f5ceffff640 1 --2- 172.21.15.90:0/582455496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cf80d4a10 0x7f5cf815b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:48.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.939+0000 7f5cf6ffd640 1 --2- 172.21.15.90:0/582455496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf80d0630 0x7f5cf809f090 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800c500 tx=0x7f5ce800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:48.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.939+0000 7f5cf4ff9640 1 -- 172.21.15.90:0/582455496 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8017070 con 0x7f5cf80d0630 2024-09-10T23:17:48.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.939+0000 7f5cf4ff9640 1 -- 172.21.15.90:0/582455496 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ce80035f0 con 0x7f5cf80d0630 2024-09-10T23:17:48.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.939+0000 7f5cf4ff9640 1 -- 172.21.15.90:0/582455496 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8003a40 con 0x7f5cf80d0630 2024-09-10T23:17:48.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.939+0000 7f5cf7fff640 1 -- 172.21.15.90:0/582455496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf80cb160 con 0x7f5cf80d0630 2024-09-10T23:17:48.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.939+0000 7f5cf7fff640 1 -- 172.21.15.90:0/582455496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf8160e70 con 0x7f5cf80d0630 2024-09-10T23:17:48.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.940+0000 7f5cf7fff640 1 -- 172.21.15.90:0/582455496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf80b82a0 con 0x7f5cf80d0630 2024-09-10T23:17:48.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.941+0000 7f5cf4ff9640 1 -- 172.21.15.90:0/582455496 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5ce8003be0 con 0x7f5cf80d0630 2024-09-10T23:17:48.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.941+0000 7f5cf4ff9640 1 --2- 172.21.15.90:0/582455496 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5cd8077f70 0x7f5cd807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:48.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.941+0000 7f5cf4ff9640 1 -- 172.21.15.90:0/582455496 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4943+0+0 (secure 0 0 0) 0x7f5ce8099190 con 0x7f5cf80d0630 2024-09-10T23:17:48.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.941+0000 7f5ceffff640 1 --2- 172.21.15.90:0/582455496 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5cd8077f70 0x7f5cd807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:48.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.942+0000 7f5ceffff640 1 --2- 172.21.15.90:0/582455496 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5cd8077f70 0x7f5cd807a430 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0005fd0 tx=0x7f5ce0005e20 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:48.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:48.945+0000 7f5cf4ff9640 1 -- 172.21.15.90:0/582455496 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5cf815b9b0 con 0x7f5cf80d0630 2024-09-10T23:17:49.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.118+0000 7f5cf7fff640 1 -- 172.21.15.90:0/582455496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5cf80b56d0 con 0x7f5cf80d0630 2024-09-10T23:17:49.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.121+0000 7f5cf4ff9640 1 -- 172.21.15.90:0/582455496 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v41)=0 v41) ==== 122+0+0 (secure 0 0 0) 0x7f5ce8062020 con 0x7f5cf80d0630 2024-09-10T23:17:49.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.123+0000 7f5cf7fff640 1 -- 172.21.15.90:0/582455496 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5cd8077f70 msgr2=0x7f5cd807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:49.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.123+0000 7f5cf7fff640 1 --2- 172.21.15.90:0/582455496 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5cd8077f70 0x7f5cd807a430 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0005fd0 tx=0x7f5ce0005e20 comp rx=0 tx=0).stop 2024-09-10T23:17:49.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.123+0000 7f5cf7fff640 1 -- 172.21.15.90:0/582455496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf80d0630 msgr2=0x7f5cf809f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:49.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.123+0000 7f5cf7fff640 1 --2- 172.21.15.90:0/582455496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf80d0630 0x7f5cf809f090 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800c500 tx=0x7f5ce800c9c0 comp rx=0 tx=0).stop 2024-09-10T23:17:49.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.123+0000 7f5cf7fff640 1 -- 172.21.15.90:0/582455496 shutdown_connections 2024-09-10T23:17:49.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.123+0000 7f5cf7fff640 1 --2- 172.21.15.90:0/582455496 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5cd8077f70 0x7f5cd807a430 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:49.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.123+0000 7f5cf7fff640 1 --2- 172.21.15.90:0/582455496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf815e270 0x7f5cf8160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:49.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.123+0000 7f5cf7fff640 1 --2- 172.21.15.90:0/582455496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cf80d4a10 0x7f5cf815b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:49.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.123+0000 7f5cf7fff640 1 --2- 172.21.15.90:0/582455496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf80d0630 0x7f5cf809f090 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:49.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.123+0000 7f5cf7fff640 1 -- 172.21.15.90:0/582455496 >> 172.21.15.90:0/582455496 conn(0x7f5cf80d3ef0 msgr2=0x7f5cf806d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:49.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.123+0000 7f5cf7fff640 1 -- 172.21.15.90:0/582455496 shutdown_connections 2024-09-10T23:17:49.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.123+0000 7f5cf7fff640 1 -- 172.21.15.90:0/582455496 wait complete. 2024-09-10T23:17:49.135 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:17:49.135 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:17:49.181 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:17:49.226 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:17:49.226 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:17:49.226 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:49.242 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:17:49.242 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:17:49.242 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:49.284 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:17:49.285 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:17:49.285 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:49.301 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:17:49.301 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:17:49.301 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:17:49.341 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:17:49.341 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:17:49.342 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:17:49.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.441+0000 7f8d594fe640 1 -- 172.21.15.90:0/2267035055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d540d4c20 msgr2=0x7f8d540cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:49.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.441+0000 7f8d594fe640 1 --2- 172.21.15.90:0/2267035055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d540d4c20 0x7f8d540cfc90 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8d48009830 tx=0x7f8d4802a5a0 comp rx=0 tx=0).stop 2024-09-10T23:17:49.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.441+0000 7f8d594fe640 1 -- 172.21.15.90:0/2267035055 shutdown_connections 2024-09-10T23:17:49.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.441+0000 7f8d594fe640 1 --2- 172.21.15.90:0/2267035055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d540d4c20 0x7f8d540cfc90 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:49.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.441+0000 7f8d594fe640 1 -- 172.21.15.90:0/2267035055 >> 172.21.15.90:0/2267035055 conn(0x7f8d540d4090 msgr2=0x7f8d540d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:49.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.441+0000 7f8d594fe640 1 -- 172.21.15.90:0/2267035055 shutdown_connections 2024-09-10T23:17:49.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.441+0000 7f8d594fe640 1 -- 172.21.15.90:0/2267035055 wait complete. 2024-09-10T23:17:49.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.443+0000 7f8d594fe640 1 Processor -- start 2024-09-10T23:17:49.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.443+0000 7f8d594fe640 1 -- start start 2024-09-10T23:17:49.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.443+0000 7f8d594fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d540d0aa0 0x7f8d54150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:49.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.443+0000 7f8d594fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d540d4c20 0x7f8d5415e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:49.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.443+0000 7f8d594fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d5415e180 0x7f8d540cd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:49.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.443+0000 7f8d594fe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8d540d1310 con 0x7f8d540d0aa0 2024-09-10T23:17:49.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.443+0000 7f8d594fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8d540d1190 con 0x7f8d540d4c20 2024-09-10T23:17:49.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.443+0000 7f8d594fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8d540d26a0 con 0x7f8d5415e180 2024-09-10T23:17:49.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.444+0000 7f8d52ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d540d0aa0 0x7f8d54150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:49.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.444+0000 7f8d52ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d540d0aa0 0x7f8d54150480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48132/0 (socket says 172.21.15.90:48132) 2024-09-10T23:17:49.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.444+0000 7f8d52ffd640 1 -- 172.21.15.90:0/1775174507 learned_addr learned my addr 172.21.15.90:0/1775174507 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:49.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.444+0000 7f8d527fc640 1 --2- 172.21.15.90:0/1775174507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d540d4c20 0x7f8d5415e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:49.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.444+0000 7f8d537fe640 1 --2- 172.21.15.90:0/1775174507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d5415e180 0x7f8d540cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:49.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.444+0000 7f8d52ffd640 1 -- 172.21.15.90:0/1775174507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d5415e180 msgr2=0x7f8d540cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:49.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.444+0000 7f8d52ffd640 1 --2- 172.21.15.90:0/1775174507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d5415e180 0x7f8d540cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:49.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.444+0000 7f8d52ffd640 1 -- 172.21.15.90:0/1775174507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d540d4c20 msgr2=0x7f8d5415e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:49.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.444+0000 7f8d52ffd640 1 --2- 172.21.15.90:0/1775174507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d540d4c20 0x7f8d5415e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:49.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.444+0000 7f8d52ffd640 1 -- 172.21.15.90:0/1775174507 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5415f310 con 0x7f8d540d0aa0 2024-09-10T23:17:49.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.444+0000 7f8d527fc640 1 --2- 172.21.15.90:0/1775174507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d540d4c20 0x7f8d5415e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:49.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.444+0000 7f8d52ffd640 1 --2- 172.21.15.90:0/1775174507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d540d0aa0 0x7f8d54150480 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400c3a0 tx=0x7f8d4400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:49.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.444+0000 7f8d3b7fe640 1 -- 172.21.15.90:0/1775174507 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d44011790 con 0x7f8d540d0aa0 2024-09-10T23:17:49.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.444+0000 7f8d3b7fe640 1 -- 172.21.15.90:0/1775174507 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d44017070 con 0x7f8d540d0aa0 2024-09-10T23:17:49.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.444+0000 7f8d594fe640 1 -- 172.21.15.90:0/1775174507 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5415f5f0 con 0x7f8d540d0aa0 2024-09-10T23:17:49.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.444+0000 7f8d3b7fe640 1 -- 172.21.15.90:0/1775174507 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d44011cc0 con 0x7f8d540d0aa0 2024-09-10T23:17:49.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.444+0000 7f8d594fe640 1 -- 172.21.15.90:0/1775174507 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d5415fbb0 con 0x7f8d540d0aa0 2024-09-10T23:17:49.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.445+0000 7f8d594fe640 1 -- 172.21.15.90:0/1775174507 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d540d2b50 con 0x7f8d540d0aa0 2024-09-10T23:17:49.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.446+0000 7f8d3b7fe640 1 -- 172.21.15.90:0/1775174507 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8d4401c460 con 0x7f8d540d0aa0 2024-09-10T23:17:49.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.446+0000 7f8d3b7fe640 1 --2- 172.21.15.90:0/1775174507 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8d40077fa0 0x7f8d4007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:49.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.446+0000 7f8d3b7fe640 1 -- 172.21.15.90:0/1775174507 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4943+0+0 (secure 0 0 0) 0x7f8d44099720 con 0x7f8d540d0aa0 2024-09-10T23:17:49.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.446+0000 7f8d527fc640 1 --2- 172.21.15.90:0/1775174507 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8d40077fa0 0x7f8d4007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:49.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.447+0000 7f8d527fc640 1 --2- 172.21.15.90:0/1775174507 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8d40077fa0 0x7f8d4007a460 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8d48034000 tx=0x7f8d48004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:49.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.450+0000 7f8d3b7fe640 1 -- 172.21.15.90:0/1775174507 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8d440625b0 con 0x7f8d540d0aa0 2024-09-10T23:17:49.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.658+0000 7f8d594fe640 1 -- 172.21.15.90:0/1775174507 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d5406da70 con 0x7f8d540d0aa0 2024-09-10T23:17:49.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.658+0000 7f8d3b7fe640 1 -- 172.21.15.90:0/1775174507 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+3911 (secure 0 0 0) 0x7f8d44061eb0 con 0x7f8d540d0aa0 2024-09-10T23:17:49.659 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:49.659 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":46,"btime":"2024-09-10T23:17:44:506454+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/883446248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":883446248},{"type":"v1","addr":"172.21.15.90:6835","nonce":883446248}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5510,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1558215981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1558215981},{"type":"v1","addr":"172.21.15.171:6836","nonce":1558215981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2584382337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2584382337},{"type":"v1","addr":"172.21.15.171:6837","nonce":2584382337}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6630,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/679340762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":679340762},{"type":"v1","addr":"172.21.15.90:6834","nonce":679340762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[]} 2024-09-10T23:17:49.660 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 46 2024-09-10T23:17:49.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.660+0000 7f8d594fe640 1 -- 172.21.15.90:0/1775174507 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8d40077fa0 msgr2=0x7f8d4007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:49.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.660+0000 7f8d594fe640 1 --2- 172.21.15.90:0/1775174507 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8d40077fa0 0x7f8d4007a460 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8d48034000 tx=0x7f8d48004730 comp rx=0 tx=0).stop 2024-09-10T23:17:49.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.660+0000 7f8d594fe640 1 -- 172.21.15.90:0/1775174507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d540d0aa0 msgr2=0x7f8d54150480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:49.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.660+0000 7f8d594fe640 1 --2- 172.21.15.90:0/1775174507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d540d0aa0 0x7f8d54150480 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400c3a0 tx=0x7f8d4400c860 comp rx=0 tx=0).stop 2024-09-10T23:17:49.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.661+0000 7f8d594fe640 1 -- 172.21.15.90:0/1775174507 shutdown_connections 2024-09-10T23:17:49.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.661+0000 7f8d594fe640 1 --2- 172.21.15.90:0/1775174507 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8d40077fa0 0x7f8d4007a460 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:49.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.661+0000 7f8d594fe640 1 --2- 172.21.15.90:0/1775174507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d540d4c20 0x7f8d5415e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:49.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.661+0000 7f8d594fe640 1 --2- 172.21.15.90:0/1775174507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d5415e180 0x7f8d540cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:49.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.661+0000 7f8d594fe640 1 --2- 172.21.15.90:0/1775174507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d540d0aa0 0x7f8d54150480 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:49.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.661+0000 7f8d594fe640 1 -- 172.21.15.90:0/1775174507 >> 172.21.15.90:0/1775174507 conn(0x7f8d540d4090 msgr2=0x7f8d540b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:49.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.661+0000 7f8d594fe640 1 -- 172.21.15.90:0/1775174507 shutdown_connections 2024-09-10T23:17:49.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.661+0000 7f8d594fe640 1 -- 172.21.15.90:0/1775174507 wait complete. 2024-09-10T23:17:49.673 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:17:49.673 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:17:49.673 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:17:49.673 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:17:49.674 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:17:49.674 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:17:49.674 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:17:49.674 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:17:49.674 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:17:49.674 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:17:49.674 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:17:49.674 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:17:49.675 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:17:49.675 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:17:49.675 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:17:49.675 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:17:49.683 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:17:49.683 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:17:49.684 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:17:49.685 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:17:49.686 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:17:49.687 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:17:49.687 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:17:49.687 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:17:49.726 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:17:49.727 DEBUG:teuthology.parallel:result is None 2024-09-10T23:17:49.727 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:17:49.727 DEBUG:teuthology.parallel:result is None 2024-09-10T23:17:49.729 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:17:49.730 DEBUG:teuthology.parallel:result is None 2024-09-10T23:17:49.730 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:17:49.730 DEBUG:teuthology.parallel:result is None 2024-09-10T23:17:49.731 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:17:49.801 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-09-10T23:17:49.801 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-09-10T23:17:49.811 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-09-10T23:17:49.811 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-09-10T23:17:49.811 INFO:tasks.ceph.mds.b.smithi171.stderr:2024-09-10T23:17:49.811+0000 7f201f9b8640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-10T23:17:49.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.837+0000 7fae459ad640 1 -- 172.21.15.90:0/4090685560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae400d1190 msgr2=0x7fae400d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:49.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.837+0000 7fae459ad640 1 --2- 172.21.15.90:0/4090685560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae400d1190 0x7fae400d28c0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fae400ce670 tx=0x7fae3402a560 comp rx=0 tx=0).stop 2024-09-10T23:17:49.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.837+0000 7fae459ad640 1 -- 172.21.15.90:0/4090685560 shutdown_connections 2024-09-10T23:17:49.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.837+0000 7fae459ad640 1 --2- 172.21.15.90:0/4090685560 >> v2:172.21.15.171:3300/0 conn(0x7fae400d16f0 0x7fae400d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:49.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.837+0000 7fae459ad640 1 --2- 172.21.15.90:0/4090685560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae400d1190 0x7fae400d28c0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:49.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.837+0000 7fae459ad640 1 -- 172.21.15.90:0/4090685560 >> 172.21.15.90:0/4090685560 conn(0x7fae400d4090 msgr2=0x7fae400d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:49.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.837+0000 7fae459ad640 1 -- 172.21.15.90:0/4090685560 shutdown_connections 2024-09-10T23:17:49.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.837+0000 7fae459ad640 1 -- 172.21.15.90:0/4090685560 wait complete. 2024-09-10T23:17:49.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.838+0000 7fae459ad640 1 Processor -- start 2024-09-10T23:17:49.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.838+0000 7fae459ad640 1 -- start start 2024-09-10T23:17:49.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.839+0000 7fae459ad640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae400d1190 0x7fae40160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:49.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.839+0000 7fae459ad640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae400d16f0 0x7fae401f8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:49.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.839+0000 7fae459ad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae4015e310 0x7fae401574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:49.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.839+0000 7fae459ad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fae400d3340 con 0x7fae4015e310 2024-09-10T23:17:49.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.839+0000 7fae3f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae4015e310 0x7fae401574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:49.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.839+0000 7fae459ad640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fae400d4d90 con 0x7fae400d16f0 2024-09-10T23:17:49.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.839+0000 7fae459ad640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fae400d34c0 con 0x7fae400d1190 2024-09-10T23:17:49.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.839+0000 7fae3f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae4015e310 0x7fae401574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48172/0 (socket says 172.21.15.90:48172) 2024-09-10T23:17:49.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.839+0000 7fae3f7fe640 1 -- 172.21.15.90:0/2000475172 learned_addr learned my addr 172.21.15.90:0/2000475172 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:49.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.840+0000 7fae3e7fc640 1 --2- 172.21.15.90:0/2000475172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae400d16f0 0x7fae401f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:49.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.840+0000 7fae3effd640 1 --2- 172.21.15.90:0/2000475172 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae400d1190 0x7fae40160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:49.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.840+0000 7fae3f7fe640 1 -- 172.21.15.90:0/2000475172 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae400d1190 msgr2=0x7fae40160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:49.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.840+0000 7fae3f7fe640 1 --2- 172.21.15.90:0/2000475172 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae400d1190 0x7fae40160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:49.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.840+0000 7fae3f7fe640 1 -- 172.21.15.90:0/2000475172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae400d16f0 msgr2=0x7fae401f8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:49.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.840+0000 7fae3f7fe640 1 --2- 172.21.15.90:0/2000475172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae400d16f0 0x7fae401f8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:49.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.840+0000 7fae3f7fe640 1 -- 172.21.15.90:0/2000475172 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae401f4990 con 0x7fae4015e310 2024-09-10T23:17:49.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.840+0000 7fae3e7fc640 1 --2- 172.21.15.90:0/2000475172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae400d16f0 0x7fae401f8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:49.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.840+0000 7fae3f7fe640 1 --2- 172.21.15.90:0/2000475172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae4015e310 0x7fae401574d0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fae3800da70 tx=0x7fae3800df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:49.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.840+0000 7fae27fff640 1 -- 172.21.15.90:0/2000475172 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38017070 con 0x7fae4015e310 2024-09-10T23:17:49.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.840+0000 7fae27fff640 1 -- 172.21.15.90:0/2000475172 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae38003970 con 0x7fae4015e310 2024-09-10T23:17:49.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.840+0000 7fae27fff640 1 -- 172.21.15.90:0/2000475172 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38003dc0 con 0x7fae4015e310 2024-09-10T23:17:49.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.840+0000 7fae459ad640 1 -- 172.21.15.90:0/2000475172 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae401f4c50 con 0x7fae4015e310 2024-09-10T23:17:49.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.840+0000 7fae459ad640 1 -- 172.21.15.90:0/2000475172 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae401f5210 con 0x7fae4015e310 2024-09-10T23:17:49.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.841+0000 7fae459ad640 1 -- 172.21.15.90:0/2000475172 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae400d3970 con 0x7fae4015e310 2024-09-10T23:17:49.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.842+0000 7fae27fff640 1 -- 172.21.15.90:0/2000475172 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fae38003f60 con 0x7fae4015e310 2024-09-10T23:17:49.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.842+0000 7fae27fff640 1 --2- 172.21.15.90:0/2000475172 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fae2c077f70 0x7fae2c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:49.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.842+0000 7fae27fff640 1 -- 172.21.15.90:0/2000475172 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4943+0+0 (secure 0 0 0) 0x7fae38099f00 con 0x7fae4015e310 2024-09-10T23:17:49.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.842+0000 7fae3effd640 1 --2- 172.21.15.90:0/2000475172 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fae2c077f70 0x7fae2c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:49.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.843+0000 7fae3effd640 1 --2- 172.21.15.90:0/2000475172 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fae2c077f70 0x7fae2c07a430 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fae400b6940 tx=0x7fae30009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:49.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:49.846+0000 7fae27fff640 1 -- 172.21.15.90:0/2000475172 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fae38062d90 con 0x7fae4015e310 2024-09-10T23:17:50.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.032+0000 7fae459ad640 1 -- 172.21.15.90:0/2000475172 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fae400b2400 con 0x7fae4015e310 2024-09-10T23:17:50.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.530+0000 7fae27fff640 1 -- 172.21.15.90:0/2000475172 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v86) ==== 97+0+0 (secure 0 0 0) 0x7fae38062690 con 0x7fae4015e310 2024-09-10T23:17:50.531 INFO:teuthology.orchestra.run.smithi090.stderr: removed all blocklist entries 2024-09-10T23:17:50.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.533+0000 7fae459ad640 1 -- 172.21.15.90:0/2000475172 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fae2c077f70 msgr2=0x7fae2c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.533+0000 7fae459ad640 1 --2- 172.21.15.90:0/2000475172 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fae2c077f70 0x7fae2c07a430 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fae400b6940 tx=0x7fae30009040 comp rx=0 tx=0).stop 2024-09-10T23:17:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.533+0000 7fae459ad640 1 -- 172.21.15.90:0/2000475172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae4015e310 msgr2=0x7fae401574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.533+0000 7fae459ad640 1 --2- 172.21.15.90:0/2000475172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae4015e310 0x7fae401574d0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fae3800da70 tx=0x7fae3800df30 comp rx=0 tx=0).stop 2024-09-10T23:17:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.534+0000 7fae459ad640 1 -- 172.21.15.90:0/2000475172 shutdown_connections 2024-09-10T23:17:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.534+0000 7fae459ad640 1 --2- 172.21.15.90:0/2000475172 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fae2c077f70 0x7fae2c07a430 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.534+0000 7fae459ad640 1 --2- 172.21.15.90:0/2000475172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae400d16f0 0x7fae401f8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.534+0000 7fae459ad640 1 --2- 172.21.15.90:0/2000475172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae4015e310 0x7fae401574d0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.534+0000 7fae459ad640 1 --2- 172.21.15.90:0/2000475172 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae400d1190 0x7fae40160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.534+0000 7fae459ad640 1 -- 172.21.15.90:0/2000475172 >> 172.21.15.90:0/2000475172 conn(0x7fae400d4090 msgr2=0x7fae4006d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.534+0000 7fae459ad640 1 -- 172.21.15.90:0/2000475172 shutdown_connections 2024-09-10T23:17:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.534+0000 7fae459ad640 1 -- 172.21.15.90:0/2000475172 wait complete. 2024-09-10T23:17:50.548 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:17:50.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.649+0000 7fa4705ec640 1 -- 172.21.15.90:0/2742865197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa46815e310 msgr2=0x7fa4680d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:50.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.649+0000 7fa4705ec640 1 --2- 172.21.15.90:0/2742865197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa46815e310 0x7fa4680d0a80 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa46808e8c0 tx=0x7fa45802a980 comp rx=0 tx=0).stop 2024-09-10T23:17:50.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.649+0000 7fa4705ec640 1 -- 172.21.15.90:0/2742865197 shutdown_connections 2024-09-10T23:17:50.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.649+0000 7fa4705ec640 1 --2- 172.21.15.90:0/2742865197 >> v2:172.21.15.171:3300/0 conn(0x7fa4680d4b80 0x7fa46806d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:50.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.649+0000 7fa4705ec640 1 --2- 172.21.15.90:0/2742865197 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4680d16f0 0x7fa4680d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:50.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.649+0000 7fa4705ec640 1 --2- 172.21.15.90:0/2742865197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa46815e310 0x7fa4680d0a80 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:50.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.649+0000 7fa4705ec640 1 -- 172.21.15.90:0/2742865197 >> 172.21.15.90:0/2742865197 conn(0x7fa4680d4090 msgr2=0x7fa4680d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:50.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.649+0000 7fa4705ec640 1 -- 172.21.15.90:0/2742865197 shutdown_connections 2024-09-10T23:17:50.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.649+0000 7fa4705ec640 1 -- 172.21.15.90:0/2742865197 wait complete. 2024-09-10T23:17:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.650+0000 7fa4705ec640 1 Processor -- start 2024-09-10T23:17:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.650+0000 7fa4705ec640 1 -- start start 2024-09-10T23:17:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.651+0000 7fa4705ec640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4680d16f0 0x7fa46815e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.651+0000 7fa4705ec640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4680d4b80 0x7fa46814c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.651+0000 7fa4705ec640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa46815e310 0x7fa46814ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.651+0000 7fa4705ec640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa46806dfc0 con 0x7fa4680d16f0 2024-09-10T23:17:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.651+0000 7fa4705ec640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa46806de40 con 0x7fa46815e310 2024-09-10T23:17:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.651+0000 7fa4705ec640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa46806e140 con 0x7fa4680d4b80 2024-09-10T23:17:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.651+0000 7fa46e388640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4680d16f0 0x7fa46815e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.651+0000 7fa46e388640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4680d16f0 0x7fa46815e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48180/0 (socket says 172.21.15.90:48180) 2024-09-10T23:17:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.651+0000 7fa46e388640 1 -- 172.21.15.90:0/1920509663 learned_addr learned my addr 172.21.15.90:0/1920509663 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.652+0000 7fa46e388640 1 -- 172.21.15.90:0/1920509663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4680d4b80 msgr2=0x7fa46814c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.652+0000 7fa46e388640 1 --2- 172.21.15.90:0/1920509663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4680d4b80 0x7fa46814c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.652+0000 7fa46e388640 1 -- 172.21.15.90:0/1920509663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa46815e310 msgr2=0x7fa46814ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.652+0000 7fa46e388640 1 --2- 172.21.15.90:0/1920509663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa46815e310 0x7fa46814ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.652+0000 7fa46e388640 1 -- 172.21.15.90:0/1920509663 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46814c9d0 con 0x7fa4680d16f0 2024-09-10T23:17:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.652+0000 7fa46e388640 1 --2- 172.21.15.90:0/1920509663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4680d16f0 0x7fa46815e8c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fa458000f80 tx=0x7fa458003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.652+0000 7fa466ffd640 1 -- 172.21.15.90:0/1920509663 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458034040 con 0x7fa4680d16f0 2024-09-10T23:17:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.652+0000 7fa466ffd640 1 -- 172.21.15.90:0/1920509663 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa458004700 con 0x7fa4680d16f0 2024-09-10T23:17:50.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.652+0000 7fa4705ec640 1 -- 172.21.15.90:0/1920509663 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46815efc0 con 0x7fa4680d16f0 2024-09-10T23:17:50.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.652+0000 7fa466ffd640 1 -- 172.21.15.90:0/1920509663 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4580456e0 con 0x7fa4680d16f0 2024-09-10T23:17:50.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.652+0000 7fa4705ec640 1 -- 172.21.15.90:0/1920509663 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4680b87a0 con 0x7fa4680d16f0 2024-09-10T23:17:50.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.653+0000 7fa4705ec640 1 -- 172.21.15.90:0/1920509663 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4680d1110 con 0x7fa4680d16f0 2024-09-10T23:17:50.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.654+0000 7fa466ffd640 1 -- 172.21.15.90:0/1920509663 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa45803a430 con 0x7fa4680d16f0 2024-09-10T23:17:50.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.654+0000 7fa466ffd640 1 --2- 172.21.15.90:0/1920509663 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa454077f70 0x7fa45407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:50.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.654+0000 7fa466ffd640 1 -- 172.21.15.90:0/1920509663 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 4857+0+0 (secure 0 0 0) 0x7fa4580bb650 con 0x7fa4680d16f0 2024-09-10T23:17:50.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.654+0000 7fa46db87640 1 --2- 172.21.15.90:0/1920509663 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa454077f70 0x7fa45407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:50.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.655+0000 7fa46db87640 1 --2- 172.21.15.90:0/1920509663 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa454077f70 0x7fa45407a430 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa46815f4c0 tx=0x7fa45c006c90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:50.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.658+0000 7fa466ffd640 1 -- 172.21.15.90:0/1920509663 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa4680d1110 con 0x7fa4680d16f0 2024-09-10T23:17:50.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.901+0000 7fa4705ec640 1 -- 172.21.15.90:0/1920509663 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa46806d6f0 con 0x7fa4680d16f0 2024-09-10T23:17:50.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.902+0000 7fa466ffd640 1 -- 172.21.15.90:0/1920509663 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v29) ==== 80+0+5304 (secure 0 0 0) 0x7fa4580844b0 con 0x7fa4680d16f0 2024-09-10T23:17:50.903 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:50.903 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:17:50.903 INFO:teuthology.orchestra.run.smithi090.stdout: "auth_dump": [ 2024-09-10T23:17:50.903 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.903 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.a", 2024-09-10T23:17:50.903 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBm/QY6KxAAKT1mZg/6ZcszcNrPmouZfw==", 2024-09-10T23:17:50.903 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.903 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:17:50.903 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:17:50.903 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:17:50.903 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:50.904 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.904 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.904 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.904 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.b", 2024-09-10T23:17:50.904 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmSqPhNhAA3flpsOGFszFMeaPUoHAtJg==", 2024-09-10T23:17:50.904 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.904 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:17:50.904 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:17:50.904 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:17:50.904 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:50.904 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.904 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.905 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.905 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.c", 2024-09-10T23:17:50.905 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmDVE4MhAAHal/PtI10hL4nKdTUO5BiQ==", 2024-09-10T23:17:50.905 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.905 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:17:50.905 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:17:50.905 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:17:50.905 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:50.905 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.905 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.905 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.905 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.d", 2024-09-10T23:17:50.905 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmr3lfAhAAFdZ7zvJmGNFHRwCr+mdY7w==", 2024-09-10T23:17:50.906 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.906 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:17:50.906 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:17:50.906 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:17:50.906 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:50.906 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.906 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.906 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.906 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.0", 2024-09-10T23:17:50.907 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCa0uBmZKxTJRAAfEBB/vykopmDbmREyy227g==", 2024-09-10T23:17:50.907 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.907 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:17:50.907 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:17:50.907 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:50.907 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.907 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.907 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.907 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.1", 2024-09-10T23:17:50.907 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCd0uBmJHG8NRAAS8QD8Zgrxrxddq7kN4P9Ag==", 2024-09-10T23:17:50.907 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.907 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:17:50.907 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:17:50.907 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:50.908 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.908 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.908 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.908 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.2", 2024-09-10T23:17:50.908 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCh0uBmtUUmDBAAmYRv9P/wjX8HLVkLatoXuQ==", 2024-09-10T23:17:50.908 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.908 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:17:50.908 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:17:50.908 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:50.908 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.908 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.908 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.908 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.3", 2024-09-10T23:17:50.908 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCk0uBm4397HBAAGZK0ktD0ORY/0CPlMprYFg==", 2024-09-10T23:17:50.909 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.909 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:17:50.909 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:17:50.909 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:50.909 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.909 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.909 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.909 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.4", 2024-09-10T23:17:50.909 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCq0uBmBaMINBAAkuhNrc4YFAYQfcxMQenCBQ==", 2024-09-10T23:17:50.909 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.909 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:17:50.909 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:17:50.909 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:50.910 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.910 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.910 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.910 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.5", 2024-09-10T23:17:50.910 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCu0uBmLOrnCBAAwZTy+62ZN3g5jfH20jB4qw==", 2024-09-10T23:17:50.910 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.910 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:17:50.910 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:17:50.910 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:50.910 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.910 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.910 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.910 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.6", 2024-09-10T23:17:50.910 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCx0uBmr4bYChAAdWog9uHnYgiiXniefs25DA==", 2024-09-10T23:17:50.911 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.911 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:17:50.911 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:17:50.911 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:50.911 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.911 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.911 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.911 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.7", 2024-09-10T23:17:50.911 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQC00uBmhU7+DBAAEagAuXuCs1v/vDhIkapi+g==", 2024-09-10T23:17:50.911 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.911 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:17:50.911 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:17:50.911 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:50.911 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.912 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.912 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.912 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.0", 2024-09-10T23:17:50.912 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmiYBwBhAABMV9erpQ+KZlTmf0kDZ0gw==", 2024-09-10T23:17:50.912 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.912 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:17:50.912 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow r", 2024-09-10T23:17:50.912 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:17:50.912 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.912 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.912 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.912 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.1", 2024-09-10T23:17:50.912 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBm+TBDDxAA4o+iZ4PwpBRpY++ATzt+wg==", 2024-09-10T23:17:50.913 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.913 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:17:50.913 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:17:50.913 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:17:50.913 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:17:50.913 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.913 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.913 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.913 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.2", 2024-09-10T23:17:50.913 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmJYcKDBAArXISnuT+R9uzuQnL3V+wSg==", 2024-09-10T23:17:50.913 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.913 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:17:50.913 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:17:50.913 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:17:50.914 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:17:50.914 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.914 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.914 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.914 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.3", 2024-09-10T23:17:50.914 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmPQvkFBAAaCikPByOvk5xUzTWXdcFPA==", 2024-09-10T23:17:50.914 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.914 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:17:50.914 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:17:50.914 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:17:50.914 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:17:50.914 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.914 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.914 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.915 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.admin", 2024-09-10T23:17:50.915 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmVVIQEBAAY7yzFxxQCyV1YCM3xYC7Og==", 2024-09-10T23:17:50.915 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.915 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:17:50.915 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:17:50.915 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:17:50.915 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:50.915 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.915 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.915 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.915 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.x", 2024-09-10T23:17:50.915 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBm4r0EKBAAIZ4VjoTsUpdB6KFbi7EQLQ==", 2024-09-10T23:17:50.915 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.916 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:17:50.916 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2024-09-10T23:17:50.916 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:50.916 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.916 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:17:50.916 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:50.916 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.y", 2024-09-10T23:17:50.916 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmkRSfJBAAWPpV5e4zeX0Es78Xqh9pYw==", 2024-09-10T23:17:50.916 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:17:50.916 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:17:50.916 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2024-09-10T23:17:50.916 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:17:50.916 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.916 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:50.917 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-10T23:17:50.917 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:17:50.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.904+0000 7fa4705ec640 1 -- 172.21.15.90:0/1920509663 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa454077f70 msgr2=0x7fa45407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:50.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.904+0000 7fa4705ec640 1 --2- 172.21.15.90:0/1920509663 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa454077f70 0x7fa45407a430 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa46815f4c0 tx=0x7fa45c006c90 comp rx=0 tx=0).stop 2024-09-10T23:17:50.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.904+0000 7fa4705ec640 1 -- 172.21.15.90:0/1920509663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4680d16f0 msgr2=0x7fa46815e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:50.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.904+0000 7fa4705ec640 1 --2- 172.21.15.90:0/1920509663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4680d16f0 0x7fa46815e8c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fa458000f80 tx=0x7fa458003f90 comp rx=0 tx=0).stop 2024-09-10T23:17:50.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.904+0000 7fa4705ec640 1 -- 172.21.15.90:0/1920509663 shutdown_connections 2024-09-10T23:17:50.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.904+0000 7fa4705ec640 1 --2- 172.21.15.90:0/1920509663 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa454077f70 0x7fa45407a430 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:50.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.904+0000 7fa4705ec640 1 --2- 172.21.15.90:0/1920509663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa46815e310 0x7fa46814ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:50.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.904+0000 7fa4705ec640 1 --2- 172.21.15.90:0/1920509663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4680d4b80 0x7fa46814c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:50.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.904+0000 7fa4705ec640 1 --2- 172.21.15.90:0/1920509663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4680d16f0 0x7fa46815e8c0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:50.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.904+0000 7fa4705ec640 1 -- 172.21.15.90:0/1920509663 >> 172.21.15.90:0/1920509663 conn(0x7fa4680d4090 msgr2=0x7fa46815caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:50.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.904+0000 7fa4705ec640 1 -- 172.21.15.90:0/1920509663 shutdown_connections 2024-09-10T23:17:50.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:50.904+0000 7fa4705ec640 1 -- 172.21.15.90:0/1920509663 wait complete. 2024-09-10T23:17:50.919 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:17:51.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.019+0000 7f21a75da640 1 -- 172.21.15.90:0/1615124321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21a00ceca0 msgr2=0x7f21a00cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:51.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.019+0000 7f21a75da640 1 --2- 172.21.15.90:0/1615124321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21a00ceca0 0x7f21a00cf110 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2198005fd0 tx=0x7f219802a820 comp rx=0 tx=0).stop 2024-09-10T23:17:51.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.019+0000 7f21a75da640 1 -- 172.21.15.90:0/1615124321 shutdown_connections 2024-09-10T23:17:51.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.019+0000 7f21a75da640 1 --2- 172.21.15.90:0/1615124321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21a00ceca0 0x7f21a00cf110 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.019+0000 7f21a75da640 1 --2- 172.21.15.90:0/1615124321 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a015e970 0x7f21a00b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.019+0000 7f21a75da640 1 -- 172.21.15.90:0/1615124321 >> 172.21.15.90:0/1615124321 conn(0x7f21a00b19c0 msgr2=0x7f21a00b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:51.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.020+0000 7f21a75da640 1 -- 172.21.15.90:0/1615124321 shutdown_connections 2024-09-10T23:17:51.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.020+0000 7f21a75da640 1 -- 172.21.15.90:0/1615124321 wait complete. 2024-09-10T23:17:51.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.021+0000 7f21a75da640 1 Processor -- start 2024-09-10T23:17:51.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.021+0000 7f21a75da640 1 -- start start 2024-09-10T23:17:51.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.021+0000 7f21a75da640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21a00b3310 0x7f21a00cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:51.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.021+0000 7f21a75da640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a00ceca0 0x7f21a014c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:51.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.021+0000 7f21a75da640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21a014c960 0x7f21a009c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:51.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.021+0000 7f21a75da640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f21a015b930 con 0x7f21a00b3310 2024-09-10T23:17:51.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.021+0000 7f21a75da640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f21a015b7b0 con 0x7f21a014c960 2024-09-10T23:17:51.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.021+0000 7f21a75da640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f21a015bab0 con 0x7f21a00ceca0 2024-09-10T23:17:51.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.022+0000 7f21a5376640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21a00b3310 0x7f21a00cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:51.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.022+0000 7f21a5376640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21a00b3310 0x7f21a00cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48182/0 (socket says 172.21.15.90:48182) 2024-09-10T23:17:51.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.022+0000 7f21a5376640 1 -- 172.21.15.90:0/3098880383 learned_addr learned my addr 172.21.15.90:0/3098880383 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:51.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.022+0000 7f21a5b77640 1 --2- 172.21.15.90:0/3098880383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21a014c960 0x7f21a009c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:51.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.022+0000 7f21a4b75640 1 --2- 172.21.15.90:0/3098880383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a00ceca0 0x7f21a014c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:51.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.022+0000 7f21a5376640 1 -- 172.21.15.90:0/3098880383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a00ceca0 msgr2=0x7f21a014c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:51.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.022+0000 7f21a5376640 1 --2- 172.21.15.90:0/3098880383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a00ceca0 0x7f21a014c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.022+0000 7f21a5376640 1 -- 172.21.15.90:0/3098880383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21a014c960 msgr2=0x7f21a009c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:51.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.022+0000 7f21a5376640 1 --2- 172.21.15.90:0/3098880383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21a014c960 0x7f21a009c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.022+0000 7f21a5376640 1 -- 172.21.15.90:0/3098880383 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a014cdc0 con 0x7f21a00b3310 2024-09-10T23:17:51.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.022+0000 7f21a5376640 1 --2- 172.21.15.90:0/3098880383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21a00b3310 0x7f21a00cde00 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f219c00c480 tx=0x7f219c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:51.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.022+0000 7f2195ffb640 1 -- 172.21.15.90:0/3098880383 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c0052d0 con 0x7f21a00b3310 2024-09-10T23:17:51.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.022+0000 7f2195ffb640 1 -- 172.21.15.90:0/3098880383 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f219c005470 con 0x7f21a00b3310 2024-09-10T23:17:51.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.022+0000 7f21a75da640 1 -- 172.21.15.90:0/3098880383 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a009ab80 con 0x7f21a00b3310 2024-09-10T23:17:51.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.022+0000 7f2195ffb640 1 -- 172.21.15.90:0/3098880383 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c012870 con 0x7f21a00b3310 2024-09-10T23:17:51.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.022+0000 7f21a75da640 1 -- 172.21.15.90:0/3098880383 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a009b100 con 0x7f21a00b3310 2024-09-10T23:17:51.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.023+0000 7f21a75da640 1 -- 172.21.15.90:0/3098880383 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21a00cf110 con 0x7f21a00b3310 2024-09-10T23:17:51.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.024+0000 7f2195ffb640 1 -- 172.21.15.90:0/3098880383 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f219c0035f0 con 0x7f21a00b3310 2024-09-10T23:17:51.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.024+0000 7f2195ffb640 1 --2- 172.21.15.90:0/3098880383 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2184077f70 0x7f218407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:51.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.025+0000 7f2195ffb640 1 -- 172.21.15.90:0/3098880383 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 4857+0+0 (secure 0 0 0) 0x7f219c0995d0 con 0x7f21a00b3310 2024-09-10T23:17:51.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.025+0000 7f21a4b75640 1 --2- 172.21.15.90:0/3098880383 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2184077f70 0x7f218407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:51.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.025+0000 7f21a4b75640 1 --2- 172.21.15.90:0/3098880383 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2184077f70 0x7f218407a430 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f21a01504e0 tx=0x7f2190009260 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:51.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.029+0000 7f2195ffb640 1 -- 172.21.15.90:0/3098880383 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f219c0624b0 con 0x7f21a00b3310 2024-09-10T23:17:51.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.207+0000 7f21a75da640 1 -- 172.21.15.90:0/3098880383 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f21a00708d0 con 0x7f21a00b3310 2024-09-10T23:17:51.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.208+0000 7f2195ffb640 1 -- 172.21.15.90:0/3098880383 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v88) ==== 84+0+65 (secure 0 0 0) 0x7f219c061db0 con 0x7f21a00b3310 2024-09-10T23:17:51.209 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:51.209 INFO:teuthology.orchestra.run.smithi090.stdout:[ 2024-09-10T23:17:51.209 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:17:51.209 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 1, 2024-09-10T23:17:51.209 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": ".mgr" 2024-09-10T23:17:51.209 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:17:51.209 INFO:teuthology.orchestra.run.smithi090.stdout:] 2024-09-10T23:17:51.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.210+0000 7f21a75da640 1 -- 172.21.15.90:0/3098880383 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2184077f70 msgr2=0x7f218407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:51.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.210+0000 7f21a75da640 1 --2- 172.21.15.90:0/3098880383 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2184077f70 0x7f218407a430 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f21a01504e0 tx=0x7f2190009260 comp rx=0 tx=0).stop 2024-09-10T23:17:51.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.210+0000 7f21a75da640 1 -- 172.21.15.90:0/3098880383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21a00b3310 msgr2=0x7f21a00cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:51.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.210+0000 7f21a75da640 1 --2- 172.21.15.90:0/3098880383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21a00b3310 0x7f21a00cde00 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f219c00c480 tx=0x7f219c00c940 comp rx=0 tx=0).stop 2024-09-10T23:17:51.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.210+0000 7f21a75da640 1 -- 172.21.15.90:0/3098880383 shutdown_connections 2024-09-10T23:17:51.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.210+0000 7f21a75da640 1 --2- 172.21.15.90:0/3098880383 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2184077f70 0x7f218407a430 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.210+0000 7f21a75da640 1 --2- 172.21.15.90:0/3098880383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21a014c960 0x7f21a009c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.210+0000 7f21a75da640 1 --2- 172.21.15.90:0/3098880383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21a00ceca0 0x7f21a014c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.210+0000 7f21a75da640 1 --2- 172.21.15.90:0/3098880383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21a00b3310 0x7f21a00cde00 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.210+0000 7f21a75da640 1 -- 172.21.15.90:0/3098880383 >> 172.21.15.90:0/3098880383 conn(0x7f21a00b19c0 msgr2=0x7f21a0072f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:51.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.210+0000 7f21a75da640 1 -- 172.21.15.90:0/3098880383 shutdown_connections 2024-09-10T23:17:51.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.210+0000 7f21a75da640 1 -- 172.21.15.90:0/3098880383 wait complete. 2024-09-10T23:17:51.222 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:17:51.222 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:17:51.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.326+0000 7f39d2cdd640 1 -- 172.21.15.90:0/1404326726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc06f900 msgr2=0x7f39cc06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:51.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.326+0000 7f39d2cdd640 1 --2- 172.21.15.90:0/1404326726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc06f900 0x7f39cc06fdb0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0d1f30 tx=0x7f39c402a560 comp rx=0 tx=0).stop 2024-09-10T23:17:51.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.326+0000 7f39d2cdd640 1 -- 172.21.15.90:0/1404326726 shutdown_connections 2024-09-10T23:17:51.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.326+0000 7f39d2cdd640 1 --2- 172.21.15.90:0/1404326726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc06f900 0x7f39cc06fdb0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.326+0000 7f39d2cdd640 1 --2- 172.21.15.90:0/1404326726 >> v2:172.21.15.171:3300/0 conn(0x7f39cc0b04e0 0x7f39cc06cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.326+0000 7f39d2cdd640 1 --2- 172.21.15.90:0/1404326726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39cc06cb70 0x7f39cc15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.326+0000 7f39d2cdd640 1 -- 172.21.15.90:0/1404326726 >> 172.21.15.90:0/1404326726 conn(0x7f39cc0b2b90 msgr2=0x7f39cc0b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:51.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.326+0000 7f39d2cdd640 1 -- 172.21.15.90:0/1404326726 shutdown_connections 2024-09-10T23:17:51.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.326+0000 7f39d2cdd640 1 -- 172.21.15.90:0/1404326726 wait complete. 2024-09-10T23:17:51.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.327+0000 7f39d2cdd640 1 Processor -- start 2024-09-10T23:17:51.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.327+0000 7f39d2cdd640 1 -- start start 2024-09-10T23:17:51.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.328+0000 7f39d2cdd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc06cb70 0x7f39cc146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:51.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.328+0000 7f39d2cdd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39cc06f900 0x7f39cc1f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:51.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.328+0000 7f39d2cdd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39cc0b04e0 0x7f39cc157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:51.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.328+0000 7f39d2cdd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc0ade70 con 0x7f39cc06cb70 2024-09-10T23:17:51.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.328+0000 7f39d2cdd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc15d3d0 con 0x7f39cc0b04e0 2024-09-10T23:17:51.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.328+0000 7f39d2cdd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f39cc0adff0 con 0x7f39cc06f900 2024-09-10T23:17:51.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.328+0000 7f39d0a79640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc06cb70 0x7f39cc146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:51.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.328+0000 7f39d0a79640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc06cb70 0x7f39cc146fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48208/0 (socket says 172.21.15.90:48208) 2024-09-10T23:17:51.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.328+0000 7f39d0a79640 1 -- 172.21.15.90:0/804569143 learned_addr learned my addr 172.21.15.90:0/804569143 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:51.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.329+0000 7f39cbfff640 1 --2- 172.21.15.90:0/804569143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39cc06f900 0x7f39cc1f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:51.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.329+0000 7f39d127a640 1 --2- 172.21.15.90:0/804569143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39cc0b04e0 0x7f39cc157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:51.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.329+0000 7f39d0a79640 1 -- 172.21.15.90:0/804569143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39cc06f900 msgr2=0x7f39cc1f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.329+0000 7f39d0a79640 1 --2- 172.21.15.90:0/804569143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39cc06f900 0x7f39cc1f6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.329+0000 7f39d0a79640 1 -- 172.21.15.90:0/804569143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39cc0b04e0 msgr2=0x7f39cc157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.329+0000 7f39d0a79640 1 --2- 172.21.15.90:0/804569143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39cc0b04e0 0x7f39cc157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.329+0000 7f39d0a79640 1 -- 172.21.15.90:0/804569143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39cc1f2480 con 0x7f39cc06cb70 2024-09-10T23:17:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.329+0000 7f39cbfff640 1 --2- 172.21.15.90:0/804569143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39cc06f900 0x7f39cc1f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.329+0000 7f39d0a79640 1 --2- 172.21.15.90:0/804569143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc06cb70 0x7f39cc146fe0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00d750 tx=0x7f39bc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.329+0000 7f39c97fa640 1 -- 172.21.15.90:0/804569143 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc017070 con 0x7f39cc06cb70 2024-09-10T23:17:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.329+0000 7f39c97fa640 1 -- 172.21.15.90:0/804569143 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39bc009cc0 con 0x7f39cc06cb70 2024-09-10T23:17:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.329+0000 7f39d2cdd640 1 -- 172.21.15.90:0/804569143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39cc1f2760 con 0x7f39cc06cb70 2024-09-10T23:17:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.329+0000 7f39c97fa640 1 -- 172.21.15.90:0/804569143 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc00de60 con 0x7f39cc06cb70 2024-09-10T23:17:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.329+0000 7f39d2cdd640 1 -- 172.21.15.90:0/804569143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39cc1f2d20 con 0x7f39cc06cb70 2024-09-10T23:17:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.330+0000 7f39d2cdd640 1 -- 172.21.15.90:0/804569143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39cc070570 con 0x7f39cc06cb70 2024-09-10T23:17:51.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.331+0000 7f39c97fa640 1 -- 172.21.15.90:0/804569143 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f39bc005280 con 0x7f39cc06cb70 2024-09-10T23:17:51.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.331+0000 7f39c97fa640 1 --2- 172.21.15.90:0/804569143 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f39b8077f70 0x7f39b807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:51.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.332+0000 7f39c97fa640 1 -- 172.21.15.90:0/804569143 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 4857+0+0 (secure 0 0 0) 0x7f39bc099ad0 con 0x7f39cc06cb70 2024-09-10T23:17:51.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.332+0000 7f39cbfff640 1 --2- 172.21.15.90:0/804569143 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f39b8077f70 0x7f39b807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:51.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.332+0000 7f39cbfff640 1 --2- 172.21.15.90:0/804569143 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f39b8077f70 0x7f39b807a430 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f39cc15e930 tx=0x7f39c00094a0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:51.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.336+0000 7f39c97fa640 1 -- 172.21.15.90:0/804569143 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f39bc0629b0 con 0x7f39cc06cb70 2024-09-10T23:17:51.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.510+0000 7f39d2cdd640 1 -- 172.21.15.90:0/804569143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f39cc0b3110 con 0x7f39cc06cb70 2024-09-10T23:17:51.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.544+0000 7f39c97fa640 1 -- 172.21.15.90:0/804569143 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v89) ==== 138+0+0 (secure 0 0 0) 0x7f39bc06b0d0 con 0x7f39cc06cb70 2024-09-10T23:17:51.545 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' created 2024-09-10T23:17:51.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.546+0000 7f39d2cdd640 1 -- 172.21.15.90:0/804569143 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f39b8077f70 msgr2=0x7f39b807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:51.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.546+0000 7f39d2cdd640 1 --2- 172.21.15.90:0/804569143 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f39b8077f70 0x7f39b807a430 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f39cc15e930 tx=0x7f39c00094a0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.546+0000 7f39d2cdd640 1 -- 172.21.15.90:0/804569143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc06cb70 msgr2=0x7f39cc146fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:51.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.546+0000 7f39d2cdd640 1 --2- 172.21.15.90:0/804569143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc06cb70 0x7f39cc146fe0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00d750 tx=0x7f39bc00dc10 comp rx=0 tx=0).stop 2024-09-10T23:17:51.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.546+0000 7f39d2cdd640 1 -- 172.21.15.90:0/804569143 shutdown_connections 2024-09-10T23:17:51.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.546+0000 7f39d2cdd640 1 --2- 172.21.15.90:0/804569143 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f39b8077f70 0x7f39b807a430 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.546+0000 7f39d2cdd640 1 --2- 172.21.15.90:0/804569143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39cc0b04e0 0x7f39cc157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.546+0000 7f39d2cdd640 1 --2- 172.21.15.90:0/804569143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39cc06f900 0x7f39cc1f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.546+0000 7f39d2cdd640 1 --2- 172.21.15.90:0/804569143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39cc06cb70 0x7f39cc146fe0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.546+0000 7f39d2cdd640 1 -- 172.21.15.90:0/804569143 >> 172.21.15.90:0/804569143 conn(0x7f39cc0b2b90 msgr2=0x7f39cc159b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:51.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.546+0000 7f39d2cdd640 1 -- 172.21.15.90:0/804569143 shutdown_connections 2024-09-10T23:17:51.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.546+0000 7f39d2cdd640 1 -- 172.21.15.90:0/804569143 wait complete. 2024-09-10T23:17:51.562 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:17:51.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.669+0000 7f3bcacef640 1 -- 172.21.15.90:0/133809706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bac004800 msgr2=0x7f3bac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:51.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.669+0000 7f3bcacef640 1 --2- 172.21.15.90:0/133809706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bac004800 0x7f3bac004c80 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8009b50 tx=0x7f3bac005830 comp rx=0 tx=0).stop 2024-09-10T23:17:51.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.669+0000 7f3bc928c640 1 -- 172.21.15.90:0/133809706 reap_dead start 2024-09-10T23:17:51.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.670+0000 7f3bcacef640 1 -- 172.21.15.90:0/133809706 shutdown_connections 2024-09-10T23:17:51.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.670+0000 7f3bcacef640 1 -- 172.21.15.90:0/133809706 >> 172.21.15.90:0/133809706 conn(0x7f3bc40b19c0 msgr2=0x7f3bc40b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:51.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.670+0000 7f3bcacef640 1 -- 172.21.15.90:0/133809706 shutdown_connections 2024-09-10T23:17:51.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.670+0000 7f3bcacef640 1 -- 172.21.15.90:0/133809706 wait complete. 2024-09-10T23:17:51.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.671+0000 7f3bcacef640 1 Processor -- start 2024-09-10T23:17:51.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.671+0000 7f3bcacef640 1 -- start start 2024-09-10T23:17:51.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bcacef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bac004800 0x7f3bc409b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:51.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bcacef640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc41577b0 0x7f3bc40cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:51.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bcacef640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bc4157c30 0x7f3bc40ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:51.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bcacef640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc40b2870 con 0x7f3bac004800 2024-09-10T23:17:51.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bcacef640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc40b26f0 con 0x7f3bc4157c30 2024-09-10T23:17:51.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bcacef640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc415bec0 con 0x7f3bc41577b0 2024-09-10T23:17:51.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bc8a8b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bac004800 0x7f3bc409b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:51.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bc8a8b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bac004800 0x7f3bc409b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48228/0 (socket says 172.21.15.90:48228) 2024-09-10T23:17:51.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bc8a8b640 1 -- 172.21.15.90:0/556944193 learned_addr learned my addr 172.21.15.90:0/556944193 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:51.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bc3fff640 1 --2- 172.21.15.90:0/556944193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc41577b0 0x7f3bc40cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:51.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bc928c640 1 --2- 172.21.15.90:0/556944193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bc4157c30 0x7f3bc40ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:51.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bc8a8b640 1 -- 172.21.15.90:0/556944193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc41577b0 msgr2=0x7f3bc40cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:51.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bc8a8b640 1 --2- 172.21.15.90:0/556944193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc41577b0 0x7f3bc40cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bc8a8b640 1 -- 172.21.15.90:0/556944193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bc4157c30 msgr2=0x7f3bc40ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:51.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bc8a8b640 1 --2- 172.21.15.90:0/556944193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bc4157c30 0x7f3bc40ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:51.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bc8a8b640 1 -- 172.21.15.90:0/556944193 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc41e5cb0 con 0x7f3bac004800 2024-09-10T23:17:51.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bc8a8b640 1 --2- 172.21.15.90:0/556944193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bac004800 0x7f3bc409b7b0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4001eb0 tx=0x7f3bb400ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:51.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bc17fa640 1 -- 172.21.15.90:0/556944193 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4015070 con 0x7f3bac004800 2024-09-10T23:17:51.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bc17fa640 1 -- 172.21.15.90:0/556944193 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bb400ca80 con 0x7f3bac004800 2024-09-10T23:17:51.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bcacef640 1 -- 172.21.15.90:0/556944193 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc41e5f90 con 0x7f3bac004800 2024-09-10T23:17:51.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bc17fa640 1 -- 172.21.15.90:0/556944193 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4011460 con 0x7f3bac004800 2024-09-10T23:17:51.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.672+0000 7f3bcacef640 1 -- 172.21.15.90:0/556944193 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc406f2b0 con 0x7f3bac004800 2024-09-10T23:17:51.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.673+0000 7f3bcacef640 1 -- 172.21.15.90:0/556944193 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bc40aefc0 con 0x7f3bac004800 2024-09-10T23:17:51.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.674+0000 7f3bc17fa640 1 -- 172.21.15.90:0/556944193 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3bb4011600 con 0x7f3bac004800 2024-09-10T23:17:51.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.674+0000 7f3bc17fa640 1 --2- 172.21.15.90:0/556944193 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3bb0077f70 0x7f3bb007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:51.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.675+0000 7f3bc17fa640 1 -- 172.21.15.90:0/556944193 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5227+0+0 (secure 0 0 0) 0x7f3bb409a220 con 0x7f3bac004800 2024-09-10T23:17:51.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.675+0000 7f3bc3fff640 1 --2- 172.21.15.90:0/556944193 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3bb0077f70 0x7f3bb007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:51.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.675+0000 7f3bc3fff640 1 --2- 172.21.15.90:0/556944193 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3bb0077f70 0x7f3bb007a430 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8035000 tx=0x7f3bb802d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:51.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.679+0000 7f3bc17fa640 1 -- 172.21.15.90:0/556944193 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3bc40aefc0 con 0x7f3bac004800 2024-09-10T23:17:51.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:51.855+0000 7f3bcacef640 1 -- 172.21.15.90:0/556944193 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3bc40b4f50 con 0x7f3bac004800 2024-09-10T23:17:52.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.550+0000 7f3bc17fa640 1 -- 172.21.15.90:0/556944193 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v90) ==== 170+0+0 (secure 0 0 0) 0x7f3bb4062fc0 con 0x7f3bac004800 2024-09-10T23:17:52.575 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' created 2024-09-10T23:17:52.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.553+0000 7f3bcacef640 1 -- 172.21.15.90:0/556944193 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3bb0077f70 msgr2=0x7f3bb007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:52.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.553+0000 7f3bcacef640 1 --2- 172.21.15.90:0/556944193 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3bb0077f70 0x7f3bb007a430 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8035000 tx=0x7f3bb802d040 comp rx=0 tx=0).stop 2024-09-10T23:17:52.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.553+0000 7f3bcacef640 1 -- 172.21.15.90:0/556944193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bac004800 msgr2=0x7f3bc409b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:52.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.553+0000 7f3bcacef640 1 --2- 172.21.15.90:0/556944193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bac004800 0x7f3bc409b7b0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4001eb0 tx=0x7f3bb400ea90 comp rx=0 tx=0).stop 2024-09-10T23:17:52.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.553+0000 7f3bcacef640 1 -- 172.21.15.90:0/556944193 shutdown_connections 2024-09-10T23:17:52.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.553+0000 7f3bcacef640 1 --2- 172.21.15.90:0/556944193 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3bb0077f70 0x7f3bb007a430 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:52.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.553+0000 7f3bcacef640 1 --2- 172.21.15.90:0/556944193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bc4157c30 0x7f3bc40ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:52.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.553+0000 7f3bcacef640 1 --2- 172.21.15.90:0/556944193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc41577b0 0x7f3bc40cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:52.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.553+0000 7f3bcacef640 1 --2- 172.21.15.90:0/556944193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bac004800 0x7f3bc409b7b0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:52.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.553+0000 7f3bcacef640 1 -- 172.21.15.90:0/556944193 >> 172.21.15.90:0/556944193 conn(0x7f3bc40b19c0 msgr2=0x7f3bc40b0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:52.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.553+0000 7f3bcacef640 1 -- 172.21.15.90:0/556944193 shutdown_connections 2024-09-10T23:17:52.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.553+0000 7f3bcacef640 1 -- 172.21.15.90:0/556944193 wait complete. 2024-09-10T23:17:52.578 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:17:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.683+0000 7f56d280c640 1 -- 172.21.15.90:0/2192707023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56cc156530 msgr2=0x7f56cc15c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.683+0000 7f56d280c640 1 --2- 172.21.15.90:0/2192707023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56cc156530 0x7f56cc15c310 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f56bc009830 tx=0x7f56bc02a510 comp rx=0 tx=0).stop 2024-09-10T23:17:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.683+0000 7f56d280c640 1 -- 172.21.15.90:0/2192707023 shutdown_connections 2024-09-10T23:17:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.683+0000 7f56d280c640 1 --2- 172.21.15.90:0/2192707023 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56cc0d04d0 0x7f56cc0d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:52.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.683+0000 7f56d280c640 1 --2- 172.21.15.90:0/2192707023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56cc156530 0x7f56cc15c310 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:52.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.683+0000 7f56d280c640 1 -- 172.21.15.90:0/2192707023 >> 172.21.15.90:0/2192707023 conn(0x7f56cc0697a0 msgr2=0x7f56cc06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:52.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.683+0000 7f56d280c640 1 -- 172.21.15.90:0/2192707023 shutdown_connections 2024-09-10T23:17:52.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.683+0000 7f56d280c640 1 -- 172.21.15.90:0/2192707023 wait complete. 2024-09-10T23:17:52.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.684+0000 7f56d280c640 1 Processor -- start 2024-09-10T23:17:52.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.684+0000 7f56d280c640 1 -- start start 2024-09-10T23:17:52.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.685+0000 7f56d280c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56cc0b4450 0x7f56cc159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:52.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.685+0000 7f56d280c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56cc0d04d0 0x7f56cc15a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:52.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.685+0000 7f56d280c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56cc156530 0x7f56cc0b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:52.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.685+0000 7f56d280c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56cc0739c0 con 0x7f56cc156530 2024-09-10T23:17:52.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.685+0000 7f56d280c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f56cc073840 con 0x7f56cc0b4450 2024-09-10T23:17:52.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.685+0000 7f56d280c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f56cc073b40 con 0x7f56cc0d04d0 2024-09-10T23:17:52.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.685+0000 7f56d0da9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56cc156530 0x7f56cc0b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:52.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.685+0000 7f56d0da9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56cc156530 0x7f56cc0b19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48246/0 (socket says 172.21.15.90:48246) 2024-09-10T23:17:52.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.685+0000 7f56d0da9640 1 -- 172.21.15.90:0/1935673852 learned_addr learned my addr 172.21.15.90:0/1935673852 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:52.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.685+0000 7f56cbfff640 1 --2- 172.21.15.90:0/1935673852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56cc0b4450 0x7f56cc159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:52.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.686+0000 7f56d0da9640 1 -- 172.21.15.90:0/1935673852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56cc0d04d0 msgr2=0x7f56cc15a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:52.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.686+0000 7f56d0da9640 1 --2- 172.21.15.90:0/1935673852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56cc0d04d0 0x7f56cc15a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:52.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.686+0000 7f56d0da9640 1 -- 172.21.15.90:0/1935673852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56cc0b4450 msgr2=0x7f56cc159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:52.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.686+0000 7f56d0da9640 1 --2- 172.21.15.90:0/1935673852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56cc0b4450 0x7f56cc159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:52.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.686+0000 7f56d0da9640 1 -- 172.21.15.90:0/1935673852 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56cc141de0 con 0x7f56cc156530 2024-09-10T23:17:52.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.686+0000 7f56d0da9640 1 --2- 172.21.15.90:0/1935673852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56cc156530 0x7f56cc0b19e0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f56c400eaa0 tx=0x7f56c400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:52.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.686+0000 7f56c8ff9640 1 -- 172.21.15.90:0/1935673852 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c400cdb0 con 0x7f56cc156530 2024-09-10T23:17:52.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.686+0000 7f56c8ff9640 1 -- 172.21.15.90:0/1935673852 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56c4004c10 con 0x7f56cc156530 2024-09-10T23:17:52.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.686+0000 7f56d280c640 1 -- 172.21.15.90:0/1935673852 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56cc1420c0 con 0x7f56cc156530 2024-09-10T23:17:52.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.686+0000 7f56c8ff9640 1 -- 172.21.15.90:0/1935673852 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c4005020 con 0x7f56cc156530 2024-09-10T23:17:52.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.686+0000 7f56d280c640 1 -- 172.21.15.90:0/1935673852 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56cc142680 con 0x7f56cc156530 2024-09-10T23:17:52.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.687+0000 7f56d280c640 1 -- 172.21.15.90:0/1935673852 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56cc06a430 con 0x7f56cc156530 2024-09-10T23:17:52.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.688+0000 7f56c8ff9640 1 -- 172.21.15.90:0/1935673852 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f56c400f040 con 0x7f56cc156530 2024-09-10T23:17:52.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.688+0000 7f56c8ff9640 1 --2- 172.21.15.90:0/1935673852 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f56b8077f70 0x7f56b807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:52.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.688+0000 7f56c8ff9640 1 -- 172.21.15.90:0/1935673852 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5609+0+0 (secure 0 0 0) 0x7f56c409a380 con 0x7f56cc156530 2024-09-10T23:17:52.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.689+0000 7f56cbfff640 1 --2- 172.21.15.90:0/1935673852 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f56b8077f70 0x7f56b807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:52.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.689+0000 7f56cbfff640 1 --2- 172.21.15.90:0/1935673852 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f56b8077f70 0x7f56b807a430 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f56bc034000 tx=0x7f56bc004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:52.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.693+0000 7f56c8ff9640 1 -- 172.21.15.90:0/1935673852 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f56c4016030 con 0x7f56cc156530 2024-09-10T23:17:52.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:52.906+0000 7f56d280c640 1 -- 172.21.15.90:0/1935673852 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f56cc073ff0 con 0x7f56cc156530 2024-09-10T23:17:53.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.558+0000 7f56c8ff9640 1 -- 172.21.15.90:0/1935673852 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v49) ==== 174+0+0 (secure 0 0 0) 0x7f56c40628a0 con 0x7f56cc156530 2024-09-10T23:17:53.559 INFO:teuthology.orchestra.run.smithi090.stderr:new fs with metadata pool 14 and data pool 15 2024-09-10T23:17:53.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.563+0000 7f56d280c640 1 -- 172.21.15.90:0/1935673852 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f56b8077f70 msgr2=0x7f56b807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:53.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.563+0000 7f56d280c640 1 --2- 172.21.15.90:0/1935673852 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f56b8077f70 0x7f56b807a430 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f56bc034000 tx=0x7f56bc004730 comp rx=0 tx=0).stop 2024-09-10T23:17:53.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.563+0000 7f56d280c640 1 -- 172.21.15.90:0/1935673852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56cc156530 msgr2=0x7f56cc0b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:53.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.563+0000 7f56d280c640 1 --2- 172.21.15.90:0/1935673852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56cc156530 0x7f56cc0b19e0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f56c400eaa0 tx=0x7f56c400ef60 comp rx=0 tx=0).stop 2024-09-10T23:17:53.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.563+0000 7f56d280c640 1 -- 172.21.15.90:0/1935673852 shutdown_connections 2024-09-10T23:17:53.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.563+0000 7f56d280c640 1 --2- 172.21.15.90:0/1935673852 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f56b8077f70 0x7f56b807a430 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:53.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.563+0000 7f56d280c640 1 --2- 172.21.15.90:0/1935673852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56cc156530 0x7f56cc0b19e0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:53.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.563+0000 7f56d280c640 1 --2- 172.21.15.90:0/1935673852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56cc0d04d0 0x7f56cc15a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:53.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.563+0000 7f56d280c640 1 --2- 172.21.15.90:0/1935673852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56cc0b4450 0x7f56cc159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:53.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.563+0000 7f56d280c640 1 -- 172.21.15.90:0/1935673852 >> 172.21.15.90:0/1935673852 conn(0x7f56cc0697a0 msgr2=0x7f56cc06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:53.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.564+0000 7f56d280c640 1 -- 172.21.15.90:0/1935673852 shutdown_connections 2024-09-10T23:17:53.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.564+0000 7f56d280c640 1 -- 172.21.15.90:0/1935673852 wait complete. 2024-09-10T23:17:53.580 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:17:53.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.682+0000 7f14cc8cf640 1 -- 172.21.15.90:0/2405937156 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14b4004d40 msgr2=0x7f14b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:53.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.682+0000 7f14cc8cf640 1 --2- 172.21.15.90:0/2405937156 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14b4004d40 0x7f14b40051c0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f14b8009b20 tx=0x7f14b4005830 comp rx=0 tx=0).stop 2024-09-10T23:17:53.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.682+0000 7f14c6d9d640 1 -- 172.21.15.90:0/2405937156 reap_dead start 2024-09-10T23:17:53.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.682+0000 7f14cc8cf640 1 -- 172.21.15.90:0/2405937156 shutdown_connections 2024-09-10T23:17:53.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.682+0000 7f14cc8cf640 1 -- 172.21.15.90:0/2405937156 >> 172.21.15.90:0/2405937156 conn(0x7f14c80d4090 msgr2=0x7f14c80d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:53.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.682+0000 7f14cc8cf640 1 -- 172.21.15.90:0/2405937156 shutdown_connections 2024-09-10T23:17:53.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.682+0000 7f14cc8cf640 1 -- 172.21.15.90:0/2405937156 wait complete. 2024-09-10T23:17:53.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.683+0000 7f14cc8cf640 1 Processor -- start 2024-09-10T23:17:53.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.683+0000 7f14cc8cf640 1 -- start start 2024-09-10T23:17:53.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.684+0000 7f14cc8cf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14b4004d40 0x7f14c814d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:53.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.684+0000 7f14cc8cf640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14c815f310 0x7f14c814da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:53.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.684+0000 7f14cc8cf640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14c81f89a0 0x7f14c81f8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:53.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.684+0000 7f14cc8cf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f14c80cf850 con 0x7f14b4004d40 2024-09-10T23:17:53.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.684+0000 7f14cc8cf640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f14c80d4d90 con 0x7f14c815f310 2024-09-10T23:17:53.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.684+0000 7f14cc8cf640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f14c80d0a80 con 0x7f14c81f89a0 2024-09-10T23:17:53.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.684+0000 7f14c659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14b4004d40 0x7f14c814d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:53.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.684+0000 7f14c659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14b4004d40 0x7f14c814d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48262/0 (socket says 172.21.15.90:48262) 2024-09-10T23:17:53.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.684+0000 7f14c659c640 1 -- 172.21.15.90:0/2142979639 learned_addr learned my addr 172.21.15.90:0/2142979639 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:53.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.684+0000 7f14c6d9d640 1 --2- 172.21.15.90:0/2142979639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14c81f89a0 0x7f14c81f8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:53.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.684+0000 7f14c5d9b640 1 --2- 172.21.15.90:0/2142979639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14c815f310 0x7f14c814da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:53.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.685+0000 7f14c659c640 1 -- 172.21.15.90:0/2142979639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14c81f89a0 msgr2=0x7f14c81f8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:53.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.685+0000 7f14c659c640 1 --2- 172.21.15.90:0/2142979639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14c81f89a0 0x7f14c81f8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:53.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.685+0000 7f14c659c640 1 -- 172.21.15.90:0/2142979639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14c815f310 msgr2=0x7f14c814da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:53.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.685+0000 7f14c659c640 1 --2- 172.21.15.90:0/2142979639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14c815f310 0x7f14c814da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:53.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.685+0000 7f14c659c640 1 -- 172.21.15.90:0/2142979639 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c8160320 con 0x7f14b4004d40 2024-09-10T23:17:53.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.685+0000 7f14c659c640 1 --2- 172.21.15.90:0/2142979639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14b4004d40 0x7f14c814d500 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f14c0011d60 tx=0x7f14c000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:53.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.685+0000 7f14beffd640 1 -- 172.21.15.90:0/2142979639 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0003d80 con 0x7f14b4004d40 2024-09-10T23:17:53.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.685+0000 7f14beffd640 1 -- 172.21.15.90:0/2142979639 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14c0004b20 con 0x7f14b4004d40 2024-09-10T23:17:53.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.685+0000 7f14cc8cf640 1 -- 172.21.15.90:0/2142979639 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14c815f7a0 con 0x7f14b4004d40 2024-09-10T23:17:53.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.685+0000 7f14beffd640 1 -- 172.21.15.90:0/2142979639 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0004050 con 0x7f14b4004d40 2024-09-10T23:17:53.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.685+0000 7f14cc8cf640 1 -- 172.21.15.90:0/2142979639 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14c815fd60 con 0x7f14b4004d40 2024-09-10T23:17:53.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.686+0000 7f14cc8cf640 1 -- 172.21.15.90:0/2142979639 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14c806ebf0 con 0x7f14b4004d40 2024-09-10T23:17:53.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.686+0000 7f14beffd640 1 -- 172.21.15.90:0/2142979639 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f14c0018070 con 0x7f14b4004d40 2024-09-10T23:17:53.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.687+0000 7f14beffd640 1 --2- 172.21.15.90:0/2142979639 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14a8077fa0 0x7f14a807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:53.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.687+0000 7f14beffd640 1 -- 172.21.15.90:0/2142979639 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5709+0+0 (secure 0 0 0) 0x7f14c009a930 con 0x7f14b4004d40 2024-09-10T23:17:53.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.687+0000 7f14c5d9b640 1 --2- 172.21.15.90:0/2142979639 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14a8077fa0 0x7f14a807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:53.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.688+0000 7f14c5d9b640 1 --2- 172.21.15.90:0/2142979639 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14a8077fa0 0x7f14a807a460 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f14c81f8690 tx=0x7f14b0006720 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:53.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.691+0000 7f14beffd640 1 -- 172.21.15.90:0/2142979639 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f14c806ebf0 con 0x7f14b4004d40 2024-09-10T23:17:53.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.867+0000 7f14cc8cf640 1 -- 172.21.15.90:0/2142979639 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14c815e6f0 con 0x7f14b4004d40 2024-09-10T23:17:53.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.868+0000 7f14beffd640 1 -- 172.21.15.90:0/2142979639 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+16681 (secure 0 0 0) 0x7f14c0062e70 con 0x7f14b4004d40 2024-09-10T23:17:53.870 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:53.870 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":91,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:17:52.907403+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:17:51.514546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-10T23:17:51.860237+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:17:53.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.871+0000 7f14cc8cf640 1 -- 172.21.15.90:0/2142979639 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14a8077fa0 msgr2=0x7f14a807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:53.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.871+0000 7f14cc8cf640 1 --2- 172.21.15.90:0/2142979639 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14a8077fa0 0x7f14a807a460 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f14c81f8690 tx=0x7f14b0006720 comp rx=0 tx=0).stop 2024-09-10T23:17:53.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.871+0000 7f14cc8cf640 1 -- 172.21.15.90:0/2142979639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14b4004d40 msgr2=0x7f14c814d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:53.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.871+0000 7f14cc8cf640 1 --2- 172.21.15.90:0/2142979639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14b4004d40 0x7f14c814d500 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f14c0011d60 tx=0x7f14c000f790 comp rx=0 tx=0).stop 2024-09-10T23:17:53.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.871+0000 7f14cc8cf640 1 -- 172.21.15.90:0/2142979639 shutdown_connections 2024-09-10T23:17:53.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.871+0000 7f14cc8cf640 1 --2- 172.21.15.90:0/2142979639 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14a8077fa0 0x7f14a807a460 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:53.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.871+0000 7f14cc8cf640 1 --2- 172.21.15.90:0/2142979639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14c815f310 0x7f14c814da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:53.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.871+0000 7f14cc8cf640 1 --2- 172.21.15.90:0/2142979639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14c81f89a0 0x7f14c81f8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:53.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.871+0000 7f14cc8cf640 1 --2- 172.21.15.90:0/2142979639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14b4004d40 0x7f14c814d500 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:53.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.871+0000 7f14cc8cf640 1 -- 172.21.15.90:0/2142979639 >> 172.21.15.90:0/2142979639 conn(0x7f14c80d4090 msgr2=0x7f14c80d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:53.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.871+0000 7f14cc8cf640 1 -- 172.21.15.90:0/2142979639 shutdown_connections 2024-09-10T23:17:53.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.871+0000 7f14cc8cf640 1 -- 172.21.15.90:0/2142979639 wait complete. 2024-09-10T23:17:53.883 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:17:53.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.982+0000 7fa7d9b2c640 1 -- 172.21.15.90:0/726885206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7d40d1190 msgr2=0x7fa7d40d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:53.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.982+0000 7fa7d9b2c640 1 --2- 172.21.15.90:0/726885206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7d40d1190 0x7fa7d40d28c0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc005fd0 tx=0x7fa7bc02a4a0 comp rx=0 tx=0).stop 2024-09-10T23:17:53.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.982+0000 7fa7d9b2c640 1 -- 172.21.15.90:0/726885206 shutdown_connections 2024-09-10T23:17:53.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.982+0000 7fa7d9b2c640 1 --2- 172.21.15.90:0/726885206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7d40d16f0 0x7fa7d40d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:53.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.982+0000 7fa7d9b2c640 1 --2- 172.21.15.90:0/726885206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7d40d1190 0x7fa7d40d28c0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:53.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.982+0000 7fa7d9b2c640 1 -- 172.21.15.90:0/726885206 >> 172.21.15.90:0/726885206 conn(0x7fa7d40d4090 msgr2=0x7fa7d40d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:53.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.982+0000 7fa7d9b2c640 1 -- 172.21.15.90:0/726885206 shutdown_connections 2024-09-10T23:17:53.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.982+0000 7fa7d9b2c640 1 -- 172.21.15.90:0/726885206 wait complete. 2024-09-10T23:17:53.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.983+0000 7fa7d9b2c640 1 Processor -- start 2024-09-10T23:17:53.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.984+0000 7fa7d9b2c640 1 -- start start 2024-09-10T23:17:53.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.984+0000 7fa7d9b2c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7d40d1190 0x7fa7d40b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:53.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.984+0000 7fa7d9b2c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7d40d16f0 0x7fa7d41f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:53.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.984+0000 7fa7d9b2c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7d415e310 0x7fa7d4156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:53.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.984+0000 7fa7d9b2c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d40d3340 con 0x7fa7d40d16f0 2024-09-10T23:17:53.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.984+0000 7fa7d9b2c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d40d4d90 con 0x7fa7d40d1190 2024-09-10T23:17:53.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.984+0000 7fa7d9b2c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa7d40d34c0 con 0x7fa7d415e310 2024-09-10T23:17:53.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.984+0000 7fa7caffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7d40d16f0 0x7fa7d41f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:53.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.984+0000 7fa7caffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7d40d16f0 0x7fa7d41f7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48282/0 (socket says 172.21.15.90:48282) 2024-09-10T23:17:53.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.984+0000 7fa7caffd640 1 -- 172.21.15.90:0/1074614766 learned_addr learned my addr 172.21.15.90:0/1074614766 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:53.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.985+0000 7fa7d37fe640 1 --2- 172.21.15.90:0/1074614766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7d40d1190 0x7fa7d40b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:53.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.985+0000 7fa7d3fff640 1 --2- 172.21.15.90:0/1074614766 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7d415e310 0x7fa7d4156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:53.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.985+0000 7fa7caffd640 1 -- 172.21.15.90:0/1074614766 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7d415e310 msgr2=0x7fa7d4156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:53.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.985+0000 7fa7caffd640 1 --2- 172.21.15.90:0/1074614766 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7d415e310 0x7fa7d4156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:53.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.985+0000 7fa7caffd640 1 -- 172.21.15.90:0/1074614766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7d40d1190 msgr2=0x7fa7d40b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:53.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.985+0000 7fa7caffd640 1 --2- 172.21.15.90:0/1074614766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7d40d1190 0x7fa7d40b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:53.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.985+0000 7fa7caffd640 1 -- 172.21.15.90:0/1074614766 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d41f8b90 con 0x7fa7d40d16f0 2024-09-10T23:17:53.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.985+0000 7fa7caffd640 1 --2- 172.21.15.90:0/1074614766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7d40d16f0 0x7fa7d41f7fa0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009850 tx=0x7fa7bc0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:53.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.985+0000 7fa7d0ff9640 1 -- 172.21.15.90:0/1074614766 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc03f070 con 0x7fa7d40d16f0 2024-09-10T23:17:53.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.985+0000 7fa7d0ff9640 1 -- 172.21.15.90:0/1074614766 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7bc0047a0 con 0x7fa7d40d16f0 2024-09-10T23:17:53.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.985+0000 7fa7d9b2c640 1 -- 172.21.15.90:0/1074614766 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d40ce270 con 0x7fa7d40d16f0 2024-09-10T23:17:53.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.985+0000 7fa7d0ff9640 1 -- 172.21.15.90:0/1074614766 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc035030 con 0x7fa7d40d16f0 2024-09-10T23:17:53.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.985+0000 7fa7d9b2c640 1 -- 172.21.15.90:0/1074614766 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d40cc440 con 0x7fa7d40d16f0 2024-09-10T23:17:53.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.986+0000 7fa7d9b2c640 1 -- 172.21.15.90:0/1074614766 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d406f1b0 con 0x7fa7d40d16f0 2024-09-10T23:17:53.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.987+0000 7fa7d0ff9640 1 -- 172.21.15.90:0/1074614766 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa7bc004b90 con 0x7fa7d40d16f0 2024-09-10T23:17:53.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.987+0000 7fa7d0ff9640 1 --2- 172.21.15.90:0/1074614766 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa7b4077f70 0x7fa7b407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:53.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.987+0000 7fa7d0ff9640 1 -- 172.21.15.90:0/1074614766 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5709+0+0 (secure 0 0 0) 0x7fa7bc0badb0 con 0x7fa7d40d16f0 2024-09-10T23:17:53.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.988+0000 7fa7d37fe640 1 --2- 172.21.15.90:0/1074614766 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa7b4077f70 0x7fa7b407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:53.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.988+0000 7fa7d37fe640 1 --2- 172.21.15.90:0/1074614766 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa7b4077f70 0x7fa7b407a430 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4006fd0 tx=0x7fa7c4009060 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:53.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:53.991+0000 7fa7d0ff9640 1 -- 172.21.15.90:0/1074614766 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa7d406f1b0 con 0x7fa7d40d16f0 2024-09-10T23:17:54.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.169+0000 7fa7d9b2c640 1 -- 172.21.15.90:0/1074614766 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7d40d3910 con 0x7fa7d40d16f0 2024-09-10T23:17:54.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.170+0000 7fa7d0ff9640 1 -- 172.21.15.90:0/1074614766 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+16681 (secure 0 0 0) 0x7fa7bc088e20 con 0x7fa7d40d16f0 2024-09-10T23:17:54.171 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:54.171 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":91,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:17:52.907403+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:17:51.514546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-10T23:17:51.860237+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:17:54.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.172+0000 7fa7d9b2c640 1 -- 172.21.15.90:0/1074614766 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa7b4077f70 msgr2=0x7fa7b407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:54.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.172+0000 7fa7d9b2c640 1 --2- 172.21.15.90:0/1074614766 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa7b4077f70 0x7fa7b407a430 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4006fd0 tx=0x7fa7c4009060 comp rx=0 tx=0).stop 2024-09-10T23:17:54.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.172+0000 7fa7d9b2c640 1 -- 172.21.15.90:0/1074614766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7d40d16f0 msgr2=0x7fa7d41f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:54.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.172+0000 7fa7d9b2c640 1 --2- 172.21.15.90:0/1074614766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7d40d16f0 0x7fa7d41f7fa0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009850 tx=0x7fa7bc0038a0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.172+0000 7fa7d9b2c640 1 -- 172.21.15.90:0/1074614766 shutdown_connections 2024-09-10T23:17:54.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.172+0000 7fa7d9b2c640 1 --2- 172.21.15.90:0/1074614766 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa7b4077f70 0x7fa7b407a430 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.172+0000 7fa7d9b2c640 1 --2- 172.21.15.90:0/1074614766 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7d415e310 0x7fa7d4156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.172+0000 7fa7d9b2c640 1 --2- 172.21.15.90:0/1074614766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7d40d16f0 0x7fa7d41f7fa0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.172+0000 7fa7d9b2c640 1 --2- 172.21.15.90:0/1074614766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7d40d1190 0x7fa7d40b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.172+0000 7fa7d9b2c640 1 -- 172.21.15.90:0/1074614766 >> 172.21.15.90:0/1074614766 conn(0x7fa7d40d4090 msgr2=0x7fa7d406d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:54.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.173+0000 7fa7d9b2c640 1 -- 172.21.15.90:0/1074614766 shutdown_connections 2024-09-10T23:17:54.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.173+0000 7fa7d9b2c640 1 -- 172.21.15.90:0/1074614766 wait complete. 2024-09-10T23:17:54.185 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:17:54.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.288+0000 7f5cc1839640 1 -- 172.21.15.90:0/2638143604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ca4004800 msgr2=0x7f5ca4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:54.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.288+0000 7f5cc1839640 1 --2- 172.21.15.90:0/2638143604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ca4004800 0x7f5ca4004c80 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0001eb0 tx=0x7f5ca4005830 comp rx=0 tx=0).stop 2024-09-10T23:17:54.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.288+0000 7f5cbb7fe640 1 -- 172.21.15.90:0/2638143604 reap_dead start 2024-09-10T23:17:54.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.288+0000 7f5cc1839640 1 -- 172.21.15.90:0/2638143604 shutdown_connections 2024-09-10T23:17:54.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.288+0000 7f5cc1839640 1 -- 172.21.15.90:0/2638143604 >> 172.21.15.90:0/2638143604 conn(0x7f5cbc0d4090 msgr2=0x7f5cbc0d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:54.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.288+0000 7f5cc1839640 1 -- 172.21.15.90:0/2638143604 shutdown_connections 2024-09-10T23:17:54.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.288+0000 7f5cc1839640 1 -- 172.21.15.90:0/2638143604 wait complete. 2024-09-10T23:17:54.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.290+0000 7f5cc1839640 1 Processor -- start 2024-09-10T23:17:54.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.290+0000 7f5cc1839640 1 -- start start 2024-09-10T23:17:54.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.290+0000 7f5cc1839640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ca4004800 0x7f5cbc1f8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:54.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.290+0000 7f5cc1839640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cbc1f4b40 0x7f5cbc1574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:54.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.290+0000 7f5cc1839640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cbc0b3fd0 0x7f5cbc0b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:54.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.290+0000 7f5cc1839640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5cbc0d2150 con 0x7f5cbc1f4b40 2024-09-10T23:17:54.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.290+0000 7f5cc1839640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5cbc0d1fd0 con 0x7f5cbc0b3fd0 2024-09-10T23:17:54.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.290+0000 7f5cc1839640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5cbc0d4bb0 con 0x7f5ca4004800 2024-09-10T23:17:54.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.291+0000 7f5cba7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cbc1f4b40 0x7f5cbc1574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:54.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.291+0000 7f5cba7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cbc1f4b40 0x7f5cbc1574b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48306/0 (socket says 172.21.15.90:48306) 2024-09-10T23:17:54.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.291+0000 7f5cba7fc640 1 -- 172.21.15.90:0/2579905322 learned_addr learned my addr 172.21.15.90:0/2579905322 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:54.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.291+0000 7f5cbb7fe640 1 --2- 172.21.15.90:0/2579905322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cbc0b3fd0 0x7f5cbc0b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:54.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.291+0000 7f5cbaffd640 1 --2- 172.21.15.90:0/2579905322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ca4004800 0x7f5cbc1f8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:54.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.291+0000 7f5cba7fc640 1 -- 172.21.15.90:0/2579905322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ca4004800 msgr2=0x7f5cbc1f8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:54.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.291+0000 7f5cba7fc640 1 --2- 172.21.15.90:0/2579905322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ca4004800 0x7f5cbc1f8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.291+0000 7f5cba7fc640 1 -- 172.21.15.90:0/2579905322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cbc0b3fd0 msgr2=0x7f5cbc0b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:54.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.291+0000 7f5cba7fc640 1 --2- 172.21.15.90:0/2579905322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cbc0b3fd0 0x7f5cbc0b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.291+0000 7f5cba7fc640 1 -- 172.21.15.90:0/2579905322 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cbc1f5400 con 0x7f5cbc1f4b40 2024-09-10T23:17:54.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.291+0000 7f5cbaffd640 1 --2- 172.21.15.90:0/2579905322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ca4004800 0x7f5cbc1f8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:54.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.291+0000 7f5cba7fc640 1 --2- 172.21.15.90:0/2579905322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cbc1f4b40 0x7f5cbc1574b0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f5cb002b0f0 tx=0x7f5cb0006cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:54.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.291+0000 7f5ca3fff640 1 -- 172.21.15.90:0/2579905322 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0031040 con 0x7f5cbc1f4b40 2024-09-10T23:17:54.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.291+0000 7f5ca3fff640 1 -- 172.21.15.90:0/2579905322 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cb00035f0 con 0x7f5cbc1f4b40 2024-09-10T23:17:54.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.291+0000 7f5ca3fff640 1 -- 172.21.15.90:0/2579905322 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0003a40 con 0x7f5cbc1f4b40 2024-09-10T23:17:54.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.291+0000 7f5cc1839640 1 -- 172.21.15.90:0/2579905322 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cbc1f56e0 con 0x7f5cbc1f4b40 2024-09-10T23:17:54.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.291+0000 7f5cc1839640 1 -- 172.21.15.90:0/2579905322 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cbc0b37d0 con 0x7f5cbc1f4b40 2024-09-10T23:17:54.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.292+0000 7f5cc1839640 1 -- 172.21.15.90:0/2579905322 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cbc0d0300 con 0x7f5cbc1f4b40 2024-09-10T23:17:54.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.293+0000 7f5ca3fff640 1 -- 172.21.15.90:0/2579905322 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5cb0048030 con 0x7f5cbc1f4b40 2024-09-10T23:17:54.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.293+0000 7f5ca3fff640 1 --2- 172.21.15.90:0/2579905322 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ca8077f70 0x7f5ca807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:54.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.293+0000 7f5ca3fff640 1 -- 172.21.15.90:0/2579905322 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5709+0+0 (secure 0 0 0) 0x7f5cb00b9b90 con 0x7f5cbc1f4b40 2024-09-10T23:17:54.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.294+0000 7f5cbaffd640 1 --2- 172.21.15.90:0/2579905322 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ca8077f70 0x7f5ca807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:54.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.294+0000 7f5cbaffd640 1 --2- 172.21.15.90:0/2579905322 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ca8077f70 0x7f5ca807a430 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5cac005fd0 tx=0x7f5cac00f510 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:54.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.298+0000 7f5ca3fff640 1 -- 172.21.15.90:0/2579905322 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5cb0082600 con 0x7f5cbc1f4b40 2024-09-10T23:17:54.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.508+0000 7f5cc1839640 1 -- 172.21.15.90:0/2579905322 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5cbc0b1ec0 con 0x7f5cbc1f4b40 2024-09-10T23:17:54.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.561+0000 7f5ca3fff640 1 -- 172.21.15.90:0/2579905322 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v50) ==== 118+0+0 (secure 0 0 0) 0x7f5cb0081f00 con 0x7f5cbc1f4b40 2024-09-10T23:17:54.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.563+0000 7f5cc1839640 1 -- 172.21.15.90:0/2579905322 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ca8077f70 msgr2=0x7f5ca807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:54.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.563+0000 7f5cc1839640 1 --2- 172.21.15.90:0/2579905322 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ca8077f70 0x7f5ca807a430 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5cac005fd0 tx=0x7f5cac00f510 comp rx=0 tx=0).stop 2024-09-10T23:17:54.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.563+0000 7f5cc1839640 1 -- 172.21.15.90:0/2579905322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cbc1f4b40 msgr2=0x7f5cbc1574b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:54.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.563+0000 7f5cc1839640 1 --2- 172.21.15.90:0/2579905322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cbc1f4b40 0x7f5cbc1574b0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f5cb002b0f0 tx=0x7f5cb0006cc0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.563+0000 7f5cc1839640 1 -- 172.21.15.90:0/2579905322 shutdown_connections 2024-09-10T23:17:54.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.563+0000 7f5cc1839640 1 --2- 172.21.15.90:0/2579905322 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ca8077f70 0x7f5ca807a430 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.563+0000 7f5cc1839640 1 --2- 172.21.15.90:0/2579905322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cbc0b3fd0 0x7f5cbc0b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.563+0000 7f5cc1839640 1 --2- 172.21.15.90:0/2579905322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cbc1f4b40 0x7f5cbc1574b0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.563+0000 7f5cc1839640 1 --2- 172.21.15.90:0/2579905322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ca4004800 0x7f5cbc1f8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.563+0000 7f5cc1839640 1 -- 172.21.15.90:0/2579905322 >> 172.21.15.90:0/2579905322 conn(0x7f5cbc0d4090 msgr2=0x7f5cbc0b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:54.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.563+0000 7f5cc1839640 1 -- 172.21.15.90:0/2579905322 shutdown_connections 2024-09-10T23:17:54.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.563+0000 7f5cc1839640 1 -- 172.21.15.90:0/2579905322 wait complete. 2024-09-10T23:17:54.575 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:17:54.575 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:17:54.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.678+0000 7f64f41df640 1 -- 172.21.15.90:0/1102989762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64ec0b3310 msgr2=0x7f64ec0b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:54.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.678+0000 7f64f41df640 1 --2- 172.21.15.90:0/1102989762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64ec0b3310 0x7f64ec0b24e0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f64ec075000 tx=0x7f64dc02a4d0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.678+0000 7f64f41df640 1 -- 172.21.15.90:0/1102989762 shutdown_connections 2024-09-10T23:17:54.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.678+0000 7f64f41df640 1 --2- 172.21.15.90:0/1102989762 >> v2:172.21.15.171:3300/0 conn(0x7f64ec0ceca0 0x7f64ec0cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.678+0000 7f64f41df640 1 --2- 172.21.15.90:0/1102989762 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ec15e970 0x7f64ec0727c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.678+0000 7f64f41df640 1 --2- 172.21.15.90:0/1102989762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64ec0b3310 0x7f64ec0b24e0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.678+0000 7f64f41df640 1 -- 172.21.15.90:0/1102989762 >> 172.21.15.90:0/1102989762 conn(0x7f64ec0b19c0 msgr2=0x7f64ec0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:54.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.678+0000 7f64f41df640 1 -- 172.21.15.90:0/1102989762 shutdown_connections 2024-09-10T23:17:54.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.678+0000 7f64f41df640 1 -- 172.21.15.90:0/1102989762 wait complete. 2024-09-10T23:17:54.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.679+0000 7f64f41df640 1 Processor -- start 2024-09-10T23:17:54.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.679+0000 7f64f41df640 1 -- start start 2024-09-10T23:17:54.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.680+0000 7f64f41df640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ec0b3310 0x7f64ec155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:54.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.680+0000 7f64f41df640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64ec0ceca0 0x7f64ec14d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:54.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.680+0000 7f64f41df640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64ec153bc0 0x7f64ec0b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:54.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.680+0000 7f64f41df640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec15b7b0 con 0x7f64ec153bc0 2024-09-10T23:17:54.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.680+0000 7f64f41df640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec0af780 con 0x7f64ec0ceca0 2024-09-10T23:17:54.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.680+0000 7f64f41df640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f64ec15b930 con 0x7f64ec0b3310 2024-09-10T23:17:54.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.680+0000 7f64f277c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64ec153bc0 0x7f64ec0b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:54.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.680+0000 7f64f277c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64ec153bc0 0x7f64ec0b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48324/0 (socket says 172.21.15.90:48324) 2024-09-10T23:17:54.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.680+0000 7f64f277c640 1 -- 172.21.15.90:0/2110165479 learned_addr learned my addr 172.21.15.90:0/2110165479 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:54.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.680+0000 7f64f177a640 1 --2- 172.21.15.90:0/2110165479 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64ec0ceca0 0x7f64ec14d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:54.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.680+0000 7f64f1f7b640 1 --2- 172.21.15.90:0/2110165479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ec0b3310 0x7f64ec155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:54.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.680+0000 7f64f277c640 1 -- 172.21.15.90:0/2110165479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ec0b3310 msgr2=0x7f64ec155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:54.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.680+0000 7f64f277c640 1 --2- 172.21.15.90:0/2110165479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ec0b3310 0x7f64ec155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.680+0000 7f64f277c640 1 -- 172.21.15.90:0/2110165479 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64ec0ceca0 msgr2=0x7f64ec14d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:54.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.680+0000 7f64f277c640 1 --2- 172.21.15.90:0/2110165479 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64ec0ceca0 0x7f64ec14d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:54.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.680+0000 7f64f277c640 1 -- 172.21.15.90:0/2110165479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ec06fdb0 con 0x7f64ec153bc0 2024-09-10T23:17:54.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.680+0000 7f64f1f7b640 1 --2- 172.21.15.90:0/2110165479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ec0b3310 0x7f64ec155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:54.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.681+0000 7f64f277c640 1 --2- 172.21.15.90:0/2110165479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64ec153bc0 0x7f64ec0b0d40 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f64e400b970 tx=0x7f64e400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:54.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.681+0000 7f64ea7fc640 1 -- 172.21.15.90:0/2110165479 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e4019070 con 0x7f64ec153bc0 2024-09-10T23:17:54.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.681+0000 7f64ea7fc640 1 -- 172.21.15.90:0/2110165479 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64e400cc50 con 0x7f64ec153bc0 2024-09-10T23:17:54.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.681+0000 7f64f41df640 1 -- 172.21.15.90:0/2110165479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ec14c540 con 0x7f64ec153bc0 2024-09-10T23:17:54.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.681+0000 7f64ea7fc640 1 -- 172.21.15.90:0/2110165479 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e40146a0 con 0x7f64ec153bc0 2024-09-10T23:17:54.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.681+0000 7f64f41df640 1 -- 172.21.15.90:0/2110165479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ec06fa80 con 0x7f64ec153bc0 2024-09-10T23:17:54.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.682+0000 7f64f41df640 1 -- 172.21.15.90:0/2110165479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64ec0cf110 con 0x7f64ec153bc0 2024-09-10T23:17:54.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.682+0000 7f64ea7fc640 1 -- 172.21.15.90:0/2110165479 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f64e401d3b0 con 0x7f64ec153bc0 2024-09-10T23:17:54.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.683+0000 7f64ea7fc640 1 --2- 172.21.15.90:0/2110165479 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64d8077f70 0x7f64d807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:54.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.683+0000 7f64ea7fc640 1 -- 172.21.15.90:0/2110165479 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f64e4099c70 con 0x7f64ec153bc0 2024-09-10T23:17:54.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.683+0000 7f64f1f7b640 1 --2- 172.21.15.90:0/2110165479 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64d8077f70 0x7f64d807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:54.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.684+0000 7f64f1f7b640 1 --2- 172.21.15.90:0/2110165479 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64d8077f70 0x7f64d807a430 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f64dc033000 tx=0x7f64dc004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:54.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.687+0000 7f64ea7fc640 1 -- 172.21.15.90:0/2110165479 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f64e40621b0 con 0x7f64ec153bc0 2024-09-10T23:17:54.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:54.898+0000 7f64f41df640 1 -- 172.21.15.90:0/2110165479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f64ec0b4f50 con 0x7f64ec153bc0 2024-09-10T23:17:55.211 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:17:55.214 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:17:55.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.562+0000 7f64ea7fc640 1 -- 172.21.15.90:0/2110165479 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v51) ==== 122+0+0 (secure 0 0 0) 0x7f64e4066be0 con 0x7f64ec153bc0 2024-09-10T23:17:55.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.564+0000 7f64f41df640 1 -- 172.21.15.90:0/2110165479 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64d8077f70 msgr2=0x7f64d807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:55.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.564+0000 7f64f41df640 1 --2- 172.21.15.90:0/2110165479 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64d8077f70 0x7f64d807a430 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f64dc033000 tx=0x7f64dc004730 comp rx=0 tx=0).stop 2024-09-10T23:17:55.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.564+0000 7f64f41df640 1 -- 172.21.15.90:0/2110165479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64ec153bc0 msgr2=0x7f64ec0b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:55.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.564+0000 7f64f41df640 1 --2- 172.21.15.90:0/2110165479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64ec153bc0 0x7f64ec0b0d40 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f64e400b970 tx=0x7f64e400be30 comp rx=0 tx=0).stop 2024-09-10T23:17:55.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.564+0000 7f64f41df640 1 -- 172.21.15.90:0/2110165479 shutdown_connections 2024-09-10T23:17:55.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.564+0000 7f64f41df640 1 --2- 172.21.15.90:0/2110165479 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64d8077f70 0x7f64d807a430 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:55.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.564+0000 7f64f41df640 1 --2- 172.21.15.90:0/2110165479 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64ec0ceca0 0x7f64ec14d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:55.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.564+0000 7f64f41df640 1 --2- 172.21.15.90:0/2110165479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64ec153bc0 0x7f64ec0b0d40 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:55.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.564+0000 7f64f41df640 1 --2- 172.21.15.90:0/2110165479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ec0b3310 0x7f64ec155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:55.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.564+0000 7f64f41df640 1 -- 172.21.15.90:0/2110165479 >> 172.21.15.90:0/2110165479 conn(0x7f64ec0b19c0 msgr2=0x7f64ec0af990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:55.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.564+0000 7f64f41df640 1 -- 172.21.15.90:0/2110165479 shutdown_connections 2024-09-10T23:17:55.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.564+0000 7f64f41df640 1 -- 172.21.15.90:0/2110165479 wait complete. 2024-09-10T23:17:55.577 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:17:55.577 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:17:55.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.678+0000 7eff6bb18640 1 -- 172.21.15.90:0/369962177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4c0052e0 msgr2=0x7eff4c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:55.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.678+0000 7eff6bb18640 1 --2- 172.21.15.90:0/369962177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4c0052e0 0x7eff4c00b9c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7eff54005fd0 tx=0x7eff4c005830 comp rx=0 tx=0).stop 2024-09-10T23:17:55.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.678+0000 7eff6bb18640 1 -- 172.21.15.90:0/369962177 shutdown_connections 2024-09-10T23:17:55.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.678+0000 7eff6bb18640 1 --2- 172.21.15.90:0/369962177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4c0052e0 0x7eff4c00b9c0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:55.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.678+0000 7eff6bb18640 1 -- 172.21.15.90:0/369962177 >> 172.21.15.90:0/369962177 conn(0x7eff640d4090 msgr2=0x7eff640d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:55.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.678+0000 7eff6bb18640 1 -- 172.21.15.90:0/369962177 shutdown_connections 2024-09-10T23:17:55.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.678+0000 7eff6bb18640 1 -- 172.21.15.90:0/369962177 wait complete. 2024-09-10T23:17:55.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.679+0000 7eff6bb18640 1 Processor -- start 2024-09-10T23:17:55.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.679+0000 7eff6bb18640 1 -- start start 2024-09-10T23:17:55.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff6bb18640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff4c0052e0 0x7eff6415f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:55.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff6bb18640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff640c8860 0x7eff641f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:55.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff6bb18640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff640c8ce0 0x7eff641f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:55.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff6bb18640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7eff640d0a80 con 0x7eff640c8860 2024-09-10T23:17:55.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff6bb18640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7eff640d4d90 con 0x7eff640c8ce0 2024-09-10T23:17:55.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff6bb18640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7eff640d0c00 con 0x7eff4c0052e0 2024-09-10T23:17:55.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff690b3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff640c8860 0x7eff641f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff690b3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff640c8860 0x7eff641f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48340/0 (socket says 172.21.15.90:48340) 2024-09-10T23:17:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff690b3640 1 -- 172.21.15.90:0/2473070120 learned_addr learned my addr 172.21.15.90:0/2473070120 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff690b3640 1 -- 172.21.15.90:0/2473070120 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff4c0052e0 msgr2=0x7eff6415f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff690b3640 1 --2- 172.21.15.90:0/2473070120 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff4c0052e0 0x7eff6415f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff690b3640 1 -- 172.21.15.90:0/2473070120 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff640c8ce0 msgr2=0x7eff641f55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff690b3640 1 --2- 172.21.15.90:0/2473070120 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff640c8ce0 0x7eff641f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff690b3640 1 -- 172.21.15.90:0/2473070120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff640c9260 con 0x7eff640c8860 2024-09-10T23:17:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff690b3640 1 --2- 172.21.15.90:0/2473070120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff640c8860 0x7eff641f5090 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7eff58004f30 tx=0x7eff580016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff627fc640 1 -- 172.21.15.90:0/2473070120 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff580107d0 con 0x7eff640c8860 2024-09-10T23:17:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff627fc640 1 -- 172.21.15.90:0/2473070120 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff58010a60 con 0x7eff640c8860 2024-09-10T23:17:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff6bb18640 1 -- 172.21.15.90:0/2473070120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff6415e8e0 con 0x7eff640c8860 2024-09-10T23:17:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff627fc640 1 -- 172.21.15.90:0/2473070120 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff58011460 con 0x7eff640c8860 2024-09-10T23:17:55.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.680+0000 7eff6bb18640 1 -- 172.21.15.90:0/2473070120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff6415eea0 con 0x7eff640c8860 2024-09-10T23:17:55.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.681+0000 7eff6bb18640 1 -- 172.21.15.90:0/2473070120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff6406deb0 con 0x7eff640c8860 2024-09-10T23:17:55.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.682+0000 7eff627fc640 1 -- 172.21.15.90:0/2473070120 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7eff58011600 con 0x7eff640c8860 2024-09-10T23:17:55.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.683+0000 7eff627fc640 1 --2- 172.21.15.90:0/2473070120 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff50077fa0 0x7eff5007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:55.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.683+0000 7eff627fc640 1 -- 172.21.15.90:0/2473070120 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7eff5809a6a0 con 0x7eff640c8860 2024-09-10T23:17:55.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.683+0000 7eff698b4640 1 --2- 172.21.15.90:0/2473070120 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff50077fa0 0x7eff5007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:55.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.683+0000 7eff698b4640 1 --2- 172.21.15.90:0/2473070120 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff50077fa0 0x7eff5007a460 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7eff640c7ba0 tx=0x7eff5c004a90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:55.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.687+0000 7eff627fc640 1 -- 172.21.15.90:0/2473070120 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7eff580631a0 con 0x7eff640c8860 2024-09-10T23:17:55.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.899+0000 7eff6bb18640 1 -- 172.21.15.90:0/2473070120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff640d47f0 con 0x7eff640c8860 2024-09-10T23:17:55.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.899+0000 7eff627fc640 1 -- 172.21.15.90:0/2473070120 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5222 (secure 0 0 0) 0x7eff58062aa0 con 0x7eff640c8860 2024-09-10T23:17:55.900 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:55.901 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":51,"btime":"2024-09-10T23:17:55:561728+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5741,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/991470791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":991470791},{"type":"v1","addr":"172.21.15.171:6836","nonce":991470791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6037,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/372190727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":372190727},{"type":"v1","addr":"172.21.15.171:6837","nonce":372190727}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/970952744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":970952744},{"type":"v1","addr":"172.21.15.90:6834","nonce":970952744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:52.907365+0000","modified":"2024-09-10T23:17:54.899883+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/3653031756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":3653031756},{"type":"v1","addr":"172.21.15.90:6835","nonce":3653031756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6714,"qdb_cluster":[6714]},"id":7}]} 2024-09-10T23:17:55.901 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 51 2024-09-10T23:17:55.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.901+0000 7eff6bb18640 1 -- 172.21.15.90:0/2473070120 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff50077fa0 msgr2=0x7eff5007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:55.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.901+0000 7eff6bb18640 1 --2- 172.21.15.90:0/2473070120 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff50077fa0 0x7eff5007a460 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7eff640c7ba0 tx=0x7eff5c004a90 comp rx=0 tx=0).stop 2024-09-10T23:17:55.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.901+0000 7eff6bb18640 1 -- 172.21.15.90:0/2473070120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff640c8860 msgr2=0x7eff641f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:55.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.901+0000 7eff6bb18640 1 --2- 172.21.15.90:0/2473070120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff640c8860 0x7eff641f5090 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7eff58004f30 tx=0x7eff580016f0 comp rx=0 tx=0).stop 2024-09-10T23:17:55.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.901+0000 7eff6bb18640 1 -- 172.21.15.90:0/2473070120 shutdown_connections 2024-09-10T23:17:55.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.901+0000 7eff6bb18640 1 --2- 172.21.15.90:0/2473070120 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff50077fa0 0x7eff5007a460 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:55.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.901+0000 7eff6bb18640 1 --2- 172.21.15.90:0/2473070120 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff640c8ce0 0x7eff641f55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:55.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.901+0000 7eff6bb18640 1 --2- 172.21.15.90:0/2473070120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff640c8860 0x7eff641f5090 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:55.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.901+0000 7eff6bb18640 1 --2- 172.21.15.90:0/2473070120 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff4c0052e0 0x7eff6415f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:55.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.901+0000 7eff6bb18640 1 -- 172.21.15.90:0/2473070120 >> 172.21.15.90:0/2473070120 conn(0x7eff640d4090 msgr2=0x7eff640b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:55.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.901+0000 7eff6bb18640 1 -- 172.21.15.90:0/2473070120 shutdown_connections 2024-09-10T23:17:55.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:55.901+0000 7eff6bb18640 1 -- 172.21.15.90:0/2473070120 wait complete. 2024-09-10T23:17:55.913 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:17:56.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.013+0000 7f229efec640 1 -- 172.21.15.90:0/3170910941 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2298070e30 msgr2=0x7f22980712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.013+0000 7f229efec640 1 --2- 172.21.15.90:0/3170910941 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2298070e30 0x7f22980712c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2290005fd0 tx=0x7f229002a8b0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.013+0000 7f229efec640 1 -- 172.21.15.90:0/3170910941 shutdown_connections 2024-09-10T23:17:56.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.013+0000 7f229efec640 1 --2- 172.21.15.90:0/3170910941 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2298070e30 0x7f22980712c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.013+0000 7f229efec640 1 --2- 172.21.15.90:0/3170910941 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22980737b0 0x7f2298073bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.013+0000 7f229efec640 1 -- 172.21.15.90:0/3170910941 >> 172.21.15.90:0/3170910941 conn(0x7f22980b2940 msgr2=0x7f22980b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:56.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.013+0000 7f229efec640 1 -- 172.21.15.90:0/3170910941 shutdown_connections 2024-09-10T23:17:56.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.013+0000 7f229efec640 1 -- 172.21.15.90:0/3170910941 wait complete. 2024-09-10T23:17:56.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.014+0000 7f229efec640 1 Processor -- start 2024-09-10T23:17:56.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.014+0000 7f229efec640 1 -- start start 2024-09-10T23:17:56.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.015+0000 7f229efec640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2298070e30 0x7f22981f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:56.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.015+0000 7f229efec640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22980737b0 0x7f229809dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:56.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.015+0000 7f229efec640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f229815ab10 0x7f229809e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:56.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.015+0000 7f229efec640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f22980b5000 con 0x7f229815ab10 2024-09-10T23:17:56.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.015+0000 7f229efec640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f22980b4e80 con 0x7f2298070e30 2024-09-10T23:17:56.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.015+0000 7f229efec640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f22980b5180 con 0x7f22980737b0 2024-09-10T23:17:56.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.015+0000 7f229d589640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f229815ab10 0x7f229809e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:56.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.015+0000 7f229d589640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f229815ab10 0x7f229809e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48356/0 (socket says 172.21.15.90:48356) 2024-09-10T23:17:56.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.015+0000 7f229d589640 1 -- 172.21.15.90:0/4159297317 learned_addr learned my addr 172.21.15.90:0/4159297317 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:56.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.015+0000 7f2297fff640 1 --2- 172.21.15.90:0/4159297317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22980737b0 0x7f229809dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:56.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.015+0000 7f229cd88640 1 --2- 172.21.15.90:0/4159297317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2298070e30 0x7f22981f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:56.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.016+0000 7f229d589640 1 -- 172.21.15.90:0/4159297317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22980737b0 msgr2=0x7f229809dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.016+0000 7f229d589640 1 --2- 172.21.15.90:0/4159297317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22980737b0 0x7f229809dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.016+0000 7f229d589640 1 -- 172.21.15.90:0/4159297317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2298070e30 msgr2=0x7f22981f3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.016+0000 7f229d589640 1 --2- 172.21.15.90:0/4159297317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2298070e30 0x7f22981f3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.016+0000 7f229d589640 1 -- 172.21.15.90:0/4159297317 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229814bed0 con 0x7f229815ab10 2024-09-10T23:17:56.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.016+0000 7f229d589640 1 --2- 172.21.15.90:0/4159297317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f229815ab10 0x7f229809e200 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f2290009cd0 tx=0x7f2290031760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:56.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.016+0000 7f22957fa640 1 -- 172.21.15.90:0/4159297317 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290040070 con 0x7f229815ab10 2024-09-10T23:17:56.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.016+0000 7f22957fa640 1 -- 172.21.15.90:0/4159297317 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2290004040 con 0x7f229815ab10 2024-09-10T23:17:56.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.016+0000 7f229efec640 1 -- 172.21.15.90:0/4159297317 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f229815c270 con 0x7f229815ab10 2024-09-10T23:17:56.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.016+0000 7f22957fa640 1 -- 172.21.15.90:0/4159297317 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290004450 con 0x7f229815ab10 2024-09-10T23:17:56.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.016+0000 7f229efec640 1 -- 172.21.15.90:0/4159297317 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f229815c830 con 0x7f229815ab10 2024-09-10T23:17:56.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.017+0000 7f229efec640 1 -- 172.21.15.90:0/4159297317 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22980b5670 con 0x7f229815ab10 2024-09-10T23:17:56.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.018+0000 7f22957fa640 1 -- 172.21.15.90:0/4159297317 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f229004d030 con 0x7f229815ab10 2024-09-10T23:17:56.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.018+0000 7f22957fa640 1 --2- 172.21.15.90:0/4159297317 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2284077f70 0x7f228407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:56.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.018+0000 7f22957fa640 1 -- 172.21.15.90:0/4159297317 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f22900bb180 con 0x7f229815ab10 2024-09-10T23:17:56.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.018+0000 7f229cd88640 1 --2- 172.21.15.90:0/4159297317 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2284077f70 0x7f228407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:56.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.019+0000 7f229cd88640 1 --2- 172.21.15.90:0/4159297317 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2284077f70 0x7f228407a430 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f229809f2f0 tx=0x7f2288009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:56.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.022+0000 7f22957fa640 1 -- 172.21.15.90:0/4159297317 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2290083630 con 0x7f229815ab10 2024-09-10T23:17:56.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.198+0000 7f229efec640 1 -- 172.21.15.90:0/4159297317 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22980b5cd0 con 0x7f229815ab10 2024-09-10T23:17:56.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.199+0000 7f22957fa640 1 -- 172.21.15.90:0/4159297317 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16668 (secure 0 0 0) 0x7f2290088060 con 0x7f229815ab10 2024-09-10T23:17:56.200 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:56.201 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":92,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:17:54.535851+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:17:51.514546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-10T23:17:51.860237+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:17:56.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.201+0000 7f229efec640 1 -- 172.21.15.90:0/4159297317 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2284077f70 msgr2=0x7f228407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.201+0000 7f229efec640 1 --2- 172.21.15.90:0/4159297317 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2284077f70 0x7f228407a430 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f229809f2f0 tx=0x7f2288009040 comp rx=0 tx=0).stop 2024-09-10T23:17:56.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.201+0000 7f229efec640 1 -- 172.21.15.90:0/4159297317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f229815ab10 msgr2=0x7f229809e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.201+0000 7f229efec640 1 --2- 172.21.15.90:0/4159297317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f229815ab10 0x7f229809e200 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f2290009cd0 tx=0x7f2290031760 comp rx=0 tx=0).stop 2024-09-10T23:17:56.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.202+0000 7f229efec640 1 -- 172.21.15.90:0/4159297317 shutdown_connections 2024-09-10T23:17:56.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.202+0000 7f229efec640 1 --2- 172.21.15.90:0/4159297317 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2284077f70 0x7f228407a430 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.202+0000 7f229efec640 1 --2- 172.21.15.90:0/4159297317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f229815ab10 0x7f229809e200 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.202+0000 7f229efec640 1 --2- 172.21.15.90:0/4159297317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22980737b0 0x7f229809dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.202+0000 7f229efec640 1 --2- 172.21.15.90:0/4159297317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2298070e30 0x7f22981f3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.202+0000 7f229efec640 1 -- 172.21.15.90:0/4159297317 >> 172.21.15.90:0/4159297317 conn(0x7f22980b2940 msgr2=0x7f22980ae700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:56.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.202+0000 7f229efec640 1 -- 172.21.15.90:0/4159297317 shutdown_connections 2024-09-10T23:17:56.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.202+0000 7f229efec640 1 -- 172.21.15.90:0/4159297317 wait complete. 2024-09-10T23:17:56.214 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:17:56.214 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:17:56.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.315+0000 7fb55b2b0640 1 -- 172.21.15.90:0/3670531905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb53c004800 msgr2=0x7fb53c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.315+0000 7fb55b2b0640 1 --2- 172.21.15.90:0/3670531905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb53c004800 0x7fb53c004c80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fb548009e00 tx=0x7fb53c005830 comp rx=0 tx=0).stop 2024-09-10T23:17:56.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.315+0000 7fb55b2b0640 1 -- 172.21.15.90:0/3670531905 shutdown_connections 2024-09-10T23:17:56.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.315+0000 7fb55b2b0640 1 --2- 172.21.15.90:0/3670531905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb53c004800 0x7fb53c004c80 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.315+0000 7fb55b2b0640 1 -- 172.21.15.90:0/3670531905 >> 172.21.15.90:0/3670531905 conn(0x7fb5540b19c0 msgr2=0x7fb5540b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:56.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.315+0000 7fb55b2b0640 1 -- 172.21.15.90:0/3670531905 shutdown_connections 2024-09-10T23:17:56.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.315+0000 7fb55b2b0640 1 -- 172.21.15.90:0/3670531905 wait complete. 2024-09-10T23:17:56.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.316+0000 7fb55b2b0640 1 Processor -- start 2024-09-10T23:17:56.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.316+0000 7fb55b2b0640 1 -- start start 2024-09-10T23:17:56.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55b2b0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb53c004800 0x7fb5540cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:56.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55b2b0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5541f3130 0x7fb55406fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:56.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55b2b0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb554157360 0x7fb5541577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:56.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55b2b0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5540b2870 con 0x7fb554157360 2024-09-10T23:17:56.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55b2b0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb5540b26f0 con 0x7fb5541f3130 2024-09-10T23:17:56.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55b2b0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb5540727c0 con 0x7fb53c004800 2024-09-10T23:17:56.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55984d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb554157360 0x7fb5541577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:56.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55984d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb554157360 0x7fb5541577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48374/0 (socket says 172.21.15.90:48374) 2024-09-10T23:17:56.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55984d640 1 -- 172.21.15.90:0/892143826 learned_addr learned my addr 172.21.15.90:0/892143826 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:56.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55904c640 1 --2- 172.21.15.90:0/892143826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb53c004800 0x7fb5540cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:56.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55884b640 1 --2- 172.21.15.90:0/892143826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5541f3130 0x7fb55406fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:56.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55984d640 1 -- 172.21.15.90:0/892143826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb53c004800 msgr2=0x7fb5540cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55984d640 1 --2- 172.21.15.90:0/892143826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb53c004800 0x7fb5540cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55984d640 1 -- 172.21.15.90:0/892143826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5541f3130 msgr2=0x7fb55406fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55984d640 1 --2- 172.21.15.90:0/892143826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5541f3130 0x7fb55406fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55984d640 1 -- 172.21.15.90:0/892143826 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb554157d30 con 0x7fb554157360 2024-09-10T23:17:56.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55884b640 1 --2- 172.21.15.90:0/892143826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5541f3130 0x7fb55406fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:56.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.317+0000 7fb55904c640 1 --2- 172.21.15.90:0/892143826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb53c004800 0x7fb5540cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:56.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.318+0000 7fb55984d640 1 --2- 172.21.15.90:0/892143826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb554157360 0x7fb5541577f0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fb554072770 tx=0x7fb544001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:56.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.318+0000 7fb551ffb640 1 -- 172.21.15.90:0/892143826 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb544011430 con 0x7fb554157360 2024-09-10T23:17:56.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.318+0000 7fb551ffb640 1 -- 172.21.15.90:0/892143826 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5440115d0 con 0x7fb554157360 2024-09-10T23:17:56.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.318+0000 7fb551ffb640 1 -- 172.21.15.90:0/892143826 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb544011a20 con 0x7fb554157360 2024-09-10T23:17:56.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.318+0000 7fb55b2b0640 1 -- 172.21.15.90:0/892143826 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5540cbb30 con 0x7fb554157360 2024-09-10T23:17:56.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.318+0000 7fb55b2b0640 1 -- 172.21.15.90:0/892143826 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5540c4ed0 con 0x7fb554157360 2024-09-10T23:17:56.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.319+0000 7fb55b2b0640 1 -- 172.21.15.90:0/892143826 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5540cf0b0 con 0x7fb554157360 2024-09-10T23:17:56.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.319+0000 7fb551ffb640 1 -- 172.21.15.90:0/892143826 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb544011bc0 con 0x7fb554157360 2024-09-10T23:17:56.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.320+0000 7fb551ffb640 1 --2- 172.21.15.90:0/892143826 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb540077f70 0x7fb54007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:56.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.320+0000 7fb551ffb640 1 -- 172.21.15.90:0/892143826 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fb54409a1c0 con 0x7fb554157360 2024-09-10T23:17:56.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.320+0000 7fb55904c640 1 --2- 172.21.15.90:0/892143826 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb540077f70 0x7fb54007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:56.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.321+0000 7fb55904c640 1 --2- 172.21.15.90:0/892143826 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb540077f70 0x7fb54007a430 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb54c006c90 tx=0x7fb54c0067a0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:56.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.324+0000 7fb551ffb640 1 -- 172.21.15.90:0/892143826 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb5540cbb30 con 0x7fb554157360 2024-09-10T23:17:56.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.496+0000 7fb55b2b0640 1 -- 172.21.15.90:0/892143826 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5540708d0 con 0x7fb540077f70 2024-09-10T23:17:56.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.500+0000 7fb551ffb640 1 -- 172.21.15.90:0/892143826 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251324 (secure 0 0 0) 0x7fb5540708d0 con 0x7fb540077f70 2024-09-10T23:17:56.504 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:56.505 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:17:56.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.503+0000 7fb55b2b0640 1 -- 172.21.15.90:0/892143826 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb540077f70 msgr2=0x7fb54007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.503+0000 7fb55b2b0640 1 --2- 172.21.15.90:0/892143826 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb540077f70 0x7fb54007a430 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb54c006c90 tx=0x7fb54c0067a0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.503+0000 7fb55b2b0640 1 -- 172.21.15.90:0/892143826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb554157360 msgr2=0x7fb5541577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.503+0000 7fb55b2b0640 1 --2- 172.21.15.90:0/892143826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb554157360 0x7fb5541577f0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fb554072770 tx=0x7fb544001630 comp rx=0 tx=0).stop 2024-09-10T23:17:56.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.503+0000 7fb55b2b0640 1 -- 172.21.15.90:0/892143826 shutdown_connections 2024-09-10T23:17:56.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.503+0000 7fb55b2b0640 1 --2- 172.21.15.90:0/892143826 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb540077f70 0x7fb54007a430 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.503+0000 7fb55b2b0640 1 --2- 172.21.15.90:0/892143826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5541f3130 0x7fb55406fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.503+0000 7fb55b2b0640 1 --2- 172.21.15.90:0/892143826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb554157360 0x7fb5541577f0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.503+0000 7fb55b2b0640 1 --2- 172.21.15.90:0/892143826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb53c004800 0x7fb5540cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.503+0000 7fb55b2b0640 1 -- 172.21.15.90:0/892143826 >> 172.21.15.90:0/892143826 conn(0x7fb5540b19c0 msgr2=0x7fb5540ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:56.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.503+0000 7fb55b2b0640 1 -- 172.21.15.90:0/892143826 shutdown_connections 2024-09-10T23:17:56.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.503+0000 7fb55b2b0640 1 -- 172.21.15.90:0/892143826 wait complete. 2024-09-10T23:17:56.515 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-09-10T23:17:56.482333+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255372,"kb_used_data":9980,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719348,"statfs":{"total":773094113280,"available":772832612352,"internally_reserved":0,"allocated":10219520,"data_stored":4968555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.935747"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477298+0000","last_change":"2024-09-10T23:17:53.560279+0000","last_active":"2024-09-10T23:17:55.477298+0000","last_peered":"2024-09-10T23:17:55.477298+0000","last_clean":"2024-09-10T23:17:55.477298+0000","last_became_active":"2024-09-10T23:17:53.556589+0000","last_became_peered":"2024-09-10T23:17:53.556589+0000","last_unstale":"2024-09-10T23:17:55.477298+0000","last_undegraded":"2024-09-10T23:17:55.477298+0000","last_fullsized":"2024-09-10T23:17:55.477298+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:20.124209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.562100+0000","last_change":"2024-09-10T23:17:52.562100+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.562100+0000","last_undegraded":"2024-09-10T23:17:52.562100+0000","last_fullsized":"2024-09-10T23:17:52.562100+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477747+0000","last_change":"2024-09-10T23:17:53.556897+0000","last_active":"2024-09-10T23:17:55.477747+0000","last_peered":"2024-09-10T23:17:55.477747+0000","last_clean":"2024-09-10T23:17:55.477747+0000","last_became_active":"2024-09-10T23:17:53.556564+0000","last_became_peered":"2024-09-10T23:17:53.556564+0000","last_unstale":"2024-09-10T23:17:55.477747+0000","last_undegraded":"2024-09-10T23:17:55.477747+0000","last_fullsized":"2024-09-10T23:17:55.477747+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:32.013618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541845+0000","last_change":"2024-09-10T23:17:53.554128+0000","last_active":"2024-09-10T23:17:54.541845+0000","last_peered":"2024-09-10T23:17:54.541845+0000","last_clean":"2024-09-10T23:17:54.541845+0000","last_became_active":"2024-09-10T23:17:53.553837+0000","last_became_peered":"2024-09-10T23:17:53.553837+0000","last_unstale":"2024-09-10T23:17:54.541845+0000","last_undegraded":"2024-09-10T23:17:54.541845+0000","last_fullsized":"2024-09-10T23:17:54.541845+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:16.073355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478024+0000","last_change":"2024-09-10T23:17:53.561325+0000","last_active":"2024-09-10T23:17:55.478024+0000","last_peered":"2024-09-10T23:17:55.478024+0000","last_clean":"2024-09-10T23:17:55.478024+0000","last_became_active":"2024-09-10T23:17:53.561035+0000","last_became_peered":"2024-09-10T23:17:53.561035+0000","last_unstale":"2024-09-10T23:17:55.478024+0000","last_undegraded":"2024-09-10T23:17:55.478024+0000","last_fullsized":"2024-09-10T23:17:55.478024+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:05.151677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477659+0000","last_change":"2024-09-10T23:17:53.547173+0000","last_active":"2024-09-10T23:17:55.477659+0000","last_peered":"2024-09-10T23:17:55.477659+0000","last_clean":"2024-09-10T23:17:55.477659+0000","last_became_active":"2024-09-10T23:17:53.546924+0000","last_became_peered":"2024-09-10T23:17:53.546924+0000","last_unstale":"2024-09-10T23:17:55.477659+0000","last_undegraded":"2024-09-10T23:17:55.477659+0000","last_fullsized":"2024-09-10T23:17:55.477659+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:36.528978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477648+0000","last_change":"2024-09-10T23:17:53.544392+0000","last_active":"2024-09-10T23:17:55.477648+0000","last_peered":"2024-09-10T23:17:55.477648+0000","last_clean":"2024-09-10T23:17:55.477648+0000","last_became_active":"2024-09-10T23:17:53.544080+0000","last_became_peered":"2024-09-10T23:17:53.544080+0000","last_unstale":"2024-09-10T23:17:55.477648+0000","last_undegraded":"2024-09-10T23:17:55.477648+0000","last_fullsized":"2024-09-10T23:17:55.477648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:33.836216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.561234+0000","last_change":"2024-09-10T23:17:52.561234+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.561234+0000","last_undegraded":"2024-09-10T23:17:52.561234+0000","last_fullsized":"2024-09-10T23:17:52.561234+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541325+0000","last_change":"2024-09-10T23:17:53.560387+0000","last_active":"2024-09-10T23:17:54.541325+0000","last_peered":"2024-09-10T23:17:54.541325+0000","last_clean":"2024-09-10T23:17:54.541325+0000","last_became_active":"2024-09-10T23:17:53.560096+0000","last_became_peered":"2024-09-10T23:17:53.560096+0000","last_unstale":"2024-09-10T23:17:54.541325+0000","last_undegraded":"2024-09-10T23:17:54.541325+0000","last_fullsized":"2024-09-10T23:17:54.541325+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:33:38.997089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477837+0000","last_change":"2024-09-10T23:17:53.565740+0000","last_active":"2024-09-10T23:17:55.477837+0000","last_peered":"2024-09-10T23:17:55.477837+0000","last_clean":"2024-09-10T23:17:55.477837+0000","last_became_active":"2024-09-10T23:17:53.565440+0000","last_became_peered":"2024-09-10T23:17:53.565440+0000","last_unstale":"2024-09-10T23:17:55.477837+0000","last_undegraded":"2024-09-10T23:17:55.477837+0000","last_fullsized":"2024-09-10T23:17:55.477837+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:27.057119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477721+0000","last_change":"2024-09-10T23:17:53.555393+0000","last_active":"2024-09-10T23:17:55.477721+0000","last_peered":"2024-09-10T23:17:55.477721+0000","last_clean":"2024-09-10T23:17:55.477721+0000","last_became_active":"2024-09-10T23:17:53.555122+0000","last_became_peered":"2024-09-10T23:17:53.555122+0000","last_unstale":"2024-09-10T23:17:55.477721+0000","last_undegraded":"2024-09-10T23:17:55.477721+0000","last_fullsized":"2024-09-10T23:17:55.477721+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:29.522521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541083+0000","last_change":"2024-09-10T23:17:53.560808+0000","last_active":"2024-09-10T23:17:54.541083+0000","last_peered":"2024-09-10T23:17:54.541083+0000","last_clean":"2024-09-10T23:17:54.541083+0000","last_became_active":"2024-09-10T23:17:53.560407+0000","last_became_peered":"2024-09-10T23:17:53.560407+0000","last_unstale":"2024-09-10T23:17:54.541083+0000","last_undegraded":"2024-09-10T23:17:54.541083+0000","last_fullsized":"2024-09-10T23:17:54.541083+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:27.057119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541860+0000","last_change":"2024-09-10T23:17:53.557682+0000","last_active":"2024-09-10T23:17:54.541860+0000","last_peered":"2024-09-10T23:17:54.541860+0000","last_clean":"2024-09-10T23:17:54.541860+0000","last_became_active":"2024-09-10T23:17:53.557417+0000","last_became_peered":"2024-09-10T23:17:53.557417+0000","last_unstale":"2024-09-10T23:17:54.541860+0000","last_undegraded":"2024-09-10T23:17:54.541860+0000","last_fullsized":"2024-09-10T23:17:54.541860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:46.228987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477985+0000","last_change":"2024-09-10T23:17:53.552624+0000","last_active":"2024-09-10T23:17:55.477985+0000","last_peered":"2024-09-10T23:17:55.477985+0000","last_clean":"2024-09-10T23:17:55.477985+0000","last_became_active":"2024-09-10T23:17:53.552371+0000","last_became_peered":"2024-09-10T23:17:53.552371+0000","last_unstale":"2024-09-10T23:17:55.477985+0000","last_undegraded":"2024-09-10T23:17:55.477985+0000","last_fullsized":"2024-09-10T23:17:55.477985+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:45.051857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541808+0000","last_change":"2024-09-10T23:17:53.559674+0000","last_active":"2024-09-10T23:17:54.541808+0000","last_peered":"2024-09-10T23:17:54.541808+0000","last_clean":"2024-09-10T23:17:54.541808+0000","last_became_active":"2024-09-10T23:17:53.559392+0000","last_became_peered":"2024-09-10T23:17:53.559392+0000","last_unstale":"2024-09-10T23:17:54.541808+0000","last_undegraded":"2024-09-10T23:17:54.541808+0000","last_fullsized":"2024-09-10T23:17:54.541808+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:33.836216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477893+0000","last_change":"2024-09-10T23:17:53.548614+0000","last_active":"2024-09-10T23:17:55.477893+0000","last_peered":"2024-09-10T23:17:55.477893+0000","last_clean":"2024-09-10T23:17:55.477893+0000","last_became_active":"2024-09-10T23:17:53.548291+0000","last_became_peered":"2024-09-10T23:17:53.548291+0000","last_unstale":"2024-09-10T23:17:55.477893+0000","last_undegraded":"2024-09-10T23:17:55.477893+0000","last_fullsized":"2024-09-10T23:17:55.477893+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:23.095017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560750+0000","last_change":"2024-09-10T23:17:52.560750+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560750+0000","last_undegraded":"2024-09-10T23:17:52.560750+0000","last_fullsized":"2024-09-10T23:17:52.560750+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541749+0000","last_change":"2024-09-10T23:17:53.554180+0000","last_active":"2024-09-10T23:17:54.541749+0000","last_peered":"2024-09-10T23:17:54.541749+0000","last_clean":"2024-09-10T23:17:54.541749+0000","last_became_active":"2024-09-10T23:17:53.553901+0000","last_became_peered":"2024-09-10T23:17:53.553901+0000","last_unstale":"2024-09-10T23:17:54.541749+0000","last_undegraded":"2024-09-10T23:17:54.541749+0000","last_fullsized":"2024-09-10T23:17:54.541749+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:34.087388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477219+0000","last_change":"2024-09-10T23:17:53.557802+0000","last_active":"2024-09-10T23:17:55.477219+0000","last_peered":"2024-09-10T23:17:55.477219+0000","last_clean":"2024-09-10T23:17:55.477219+0000","last_became_active":"2024-09-10T23:17:53.557537+0000","last_became_peered":"2024-09-10T23:17:53.557537+0000","last_unstale":"2024-09-10T23:17:55.477219+0000","last_undegraded":"2024-09-10T23:17:55.477219+0000","last_fullsized":"2024-09-10T23:17:55.477219+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:07.646491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541143+0000","last_change":"2024-09-10T23:17:53.561436+0000","last_active":"2024-09-10T23:17:54.541143+0000","last_peered":"2024-09-10T23:17:54.541143+0000","last_clean":"2024-09-10T23:17:54.541143+0000","last_became_active":"2024-09-10T23:17:53.561173+0000","last_became_peered":"2024-09-10T23:17:53.561173+0000","last_unstale":"2024-09-10T23:17:54.541143+0000","last_undegraded":"2024-09-10T23:17:54.541143+0000","last_fullsized":"2024-09-10T23:17:54.541143+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:19:38.295347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477755+0000","last_change":"2024-09-10T23:17:53.545062+0000","last_active":"2024-09-10T23:17:55.477755+0000","last_peered":"2024-09-10T23:17:55.477755+0000","last_clean":"2024-09-10T23:17:55.477755+0000","last_became_active":"2024-09-10T23:17:53.544797+0000","last_became_peered":"2024-09-10T23:17:53.544797+0000","last_unstale":"2024-09-10T23:17:55.477755+0000","last_undegraded":"2024-09-10T23:17:55.477755+0000","last_fullsized":"2024-09-10T23:17:55.477755+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:31.712561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560460+0000","last_change":"2024-09-10T23:17:52.560460+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560460+0000","last_undegraded":"2024-09-10T23:17:52.560460+0000","last_fullsized":"2024-09-10T23:17:52.560460+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.558847+0000","last_change":"2024-09-10T23:17:52.558847+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.558847+0000","last_undegraded":"2024-09-10T23:17:52.558847+0000","last_fullsized":"2024-09-10T23:17:52.558847+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477630+0000","last_change":"2024-09-10T23:17:53.560079+0000","last_active":"2024-09-10T23:17:55.477630+0000","last_peered":"2024-09-10T23:17:55.477630+0000","last_clean":"2024-09-10T23:17:55.477630+0000","last_became_active":"2024-09-10T23:17:53.559507+0000","last_became_peered":"2024-09-10T23:17:53.559507+0000","last_unstale":"2024-09-10T23:17:55.477630+0000","last_undegraded":"2024-09-10T23:17:55.477630+0000","last_fullsized":"2024-09-10T23:17:55.477630+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:51.603445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478504+0000","last_change":"2024-09-10T23:17:53.563818+0000","last_active":"2024-09-10T23:17:55.478504+0000","last_peered":"2024-09-10T23:17:55.478504+0000","last_clean":"2024-09-10T23:17:55.478504+0000","last_became_active":"2024-09-10T23:17:53.563533+0000","last_became_peered":"2024-09-10T23:17:53.563533+0000","last_unstale":"2024-09-10T23:17:55.478504+0000","last_undegraded":"2024-09-10T23:17:55.478504+0000","last_fullsized":"2024-09-10T23:17:55.478504+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:34.435158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560995+0000","last_change":"2024-09-10T23:17:52.560995+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560995+0000","last_undegraded":"2024-09-10T23:17:52.560995+0000","last_fullsized":"2024-09-10T23:17:52.560995+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478026+0000","last_change":"2024-09-10T23:17:53.551936+0000","last_active":"2024-09-10T23:17:55.478026+0000","last_peered":"2024-09-10T23:17:55.478026+0000","last_clean":"2024-09-10T23:17:55.478026+0000","last_became_active":"2024-09-10T23:17:53.550713+0000","last_became_peered":"2024-09-10T23:17:53.550713+0000","last_unstale":"2024-09-10T23:17:55.478026+0000","last_undegraded":"2024-09-10T23:17:55.478026+0000","last_fullsized":"2024-09-10T23:17:55.478026+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:49.704662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478330+0000","last_change":"2024-09-10T23:17:53.560875+0000","last_active":"2024-09-10T23:17:55.478330+0000","last_peered":"2024-09-10T23:17:55.478330+0000","last_clean":"2024-09-10T23:17:55.478330+0000","last_became_active":"2024-09-10T23:17:53.560567+0000","last_became_peered":"2024-09-10T23:17:53.560567+0000","last_unstale":"2024-09-10T23:17:55.478330+0000","last_undegraded":"2024-09-10T23:17:55.478330+0000","last_fullsized":"2024-09-10T23:17:55.478330+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:31.501371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.559679+0000","last_change":"2024-09-10T23:17:52.559679+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.559679+0000","last_undegraded":"2024-09-10T23:17:52.559679+0000","last_fullsized":"2024-09-10T23:17:52.559679+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478167+0000","last_change":"2024-09-10T23:17:53.558562+0000","last_active":"2024-09-10T23:17:55.478167+0000","last_peered":"2024-09-10T23:17:55.478167+0000","last_clean":"2024-09-10T23:17:55.478167+0000","last_became_active":"2024-09-10T23:17:53.558327+0000","last_became_peered":"2024-09-10T23:17:53.558327+0000","last_unstale":"2024-09-10T23:17:55.478167+0000","last_undegraded":"2024-09-10T23:17:55.478167+0000","last_fullsized":"2024-09-10T23:17:55.478167+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:41.417295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541843+0000","last_change":"2024-09-10T23:17:53.554219+0000","last_active":"2024-09-10T23:17:54.541843+0000","last_peered":"2024-09-10T23:17:54.541843+0000","last_clean":"2024-09-10T23:17:54.541843+0000","last_became_active":"2024-09-10T23:17:53.553751+0000","last_became_peered":"2024-09-10T23:17:53.553751+0000","last_unstale":"2024-09-10T23:17:54.541843+0000","last_undegraded":"2024-09-10T23:17:54.541843+0000","last_fullsized":"2024-09-10T23:17:54.541843+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:08.996959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478297+0000","last_change":"2024-09-10T23:17:53.556628+0000","last_active":"2024-09-10T23:17:55.478297+0000","last_peered":"2024-09-10T23:17:55.478297+0000","last_clean":"2024-09-10T23:17:55.478297+0000","last_became_active":"2024-09-10T23:17:53.556310+0000","last_became_peered":"2024-09-10T23:17:53.556310+0000","last_unstale":"2024-09-10T23:17:55.478297+0000","last_undegraded":"2024-09-10T23:17:55.478297+0000","last_fullsized":"2024-09-10T23:17:55.478297+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:39.854761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478272+0000","last_change":"2024-09-10T23:17:53.544501+0000","last_active":"2024-09-10T23:17:55.478272+0000","last_peered":"2024-09-10T23:17:55.478272+0000","last_clean":"2024-09-10T23:17:55.478272+0000","last_became_active":"2024-09-10T23:17:53.544244+0000","last_became_peered":"2024-09-10T23:17:53.544244+0000","last_unstale":"2024-09-10T23:17:55.478272+0000","last_undegraded":"2024-09-10T23:17:55.478272+0000","last_fullsized":"2024-09-10T23:17:55.478272+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:46.501299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572678+0000","last_change":"2024-09-10T23:17:52.567737+0000","last_active":"2024-09-10T23:17:52.572678+0000","last_peered":"2024-09-10T23:17:52.572678+0000","last_clean":"2024-09-10T23:17:52.572678+0000","last_became_active":"2024-09-10T23:17:52.567475+0000","last_became_peered":"2024-09-10T23:17:52.567475+0000","last_unstale":"2024-09-10T23:17:52.572678+0000","last_undegraded":"2024-09-10T23:17:52.572678+0000","last_fullsized":"2024-09-10T23:17:52.572678+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:43.747947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541868+0000","last_change":"2024-09-10T23:17:53.553734+0000","last_active":"2024-09-10T23:17:54.541868+0000","last_peered":"2024-09-10T23:17:54.541868+0000","last_clean":"2024-09-10T23:17:54.541868+0000","last_became_active":"2024-09-10T23:17:53.553335+0000","last_became_peered":"2024-09-10T23:17:53.553335+0000","last_unstale":"2024-09-10T23:17:54.541868+0000","last_undegraded":"2024-09-10T23:17:54.541868+0000","last_fullsized":"2024-09-10T23:17:54.541868+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:36.528978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477455+0000","last_change":"2024-09-10T23:17:52.573013+0000","last_active":"2024-09-10T23:17:55.477455+0000","last_peered":"2024-09-10T23:17:55.477455+0000","last_clean":"2024-09-10T23:17:55.477455+0000","last_became_active":"2024-09-10T23:17:52.572803+0000","last_became_peered":"2024-09-10T23:17:52.572803+0000","last_unstale":"2024-09-10T23:17:55.477455+0000","last_undegraded":"2024-09-10T23:17:55.477455+0000","last_fullsized":"2024-09-10T23:17:55.477455+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:11.857169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477450+0000","last_change":"2024-09-10T23:17:53.559140+0000","last_active":"2024-09-10T23:17:55.477450+0000","last_peered":"2024-09-10T23:17:55.477450+0000","last_clean":"2024-09-10T23:17:55.477450+0000","last_became_active":"2024-09-10T23:17:53.558865+0000","last_became_peered":"2024-09-10T23:17:53.558865+0000","last_unstale":"2024-09-10T23:17:55.477450+0000","last_undegraded":"2024-09-10T23:17:55.477450+0000","last_fullsized":"2024-09-10T23:17:55.477450+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:30.481697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572832+0000","last_change":"2024-09-10T23:17:52.568443+0000","last_active":"2024-09-10T23:17:52.572832+0000","last_peered":"2024-09-10T23:17:52.572832+0000","last_clean":"2024-09-10T23:17:52.572832+0000","last_became_active":"2024-09-10T23:17:52.568203+0000","last_became_peered":"2024-09-10T23:17:52.568203+0000","last_unstale":"2024-09-10T23:17:52.572832+0000","last_undegraded":"2024-09-10T23:17:52.572832+0000","last_fullsized":"2024-09-10T23:17:52.572832+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:36.731524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541077+0000","last_change":"2024-09-10T23:17:53.560547+0000","last_active":"2024-09-10T23:17:54.541077+0000","last_peered":"2024-09-10T23:17:54.541077+0000","last_clean":"2024-09-10T23:17:54.541077+0000","last_became_active":"2024-09-10T23:17:53.560260+0000","last_became_peered":"2024-09-10T23:17:53.560260+0000","last_unstale":"2024-09-10T23:17:54.541077+0000","last_undegraded":"2024-09-10T23:17:54.541077+0000","last_fullsized":"2024-09-10T23:17:54.541077+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:02.968645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572783+0000","last_change":"2024-09-10T23:17:52.568272+0000","last_active":"2024-09-10T23:17:52.572783+0000","last_peered":"2024-09-10T23:17:52.572783+0000","last_clean":"2024-09-10T23:17:52.572783+0000","last_became_active":"2024-09-10T23:17:52.567941+0000","last_became_peered":"2024-09-10T23:17:52.567941+0000","last_unstale":"2024-09-10T23:17:52.572783+0000","last_undegraded":"2024-09-10T23:17:52.572783+0000","last_fullsized":"2024-09-10T23:17:52.572783+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:52.125614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540931+0000","last_change":"2024-09-10T23:17:53.555155+0000","last_active":"2024-09-10T23:17:54.540931+0000","last_peered":"2024-09-10T23:17:54.540931+0000","last_clean":"2024-09-10T23:17:54.540931+0000","last_became_active":"2024-09-10T23:17:53.554877+0000","last_became_peered":"2024-09-10T23:17:53.554877+0000","last_unstale":"2024-09-10T23:17:54.540931+0000","last_undegraded":"2024-09-10T23:17:54.540931+0000","last_fullsized":"2024-09-10T23:17:54.540931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:08.979105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477954+0000","last_change":"2024-09-10T23:17:52.570450+0000","last_active":"2024-09-10T23:17:55.477954+0000","last_peered":"2024-09-10T23:17:55.477954+0000","last_clean":"2024-09-10T23:17:55.477954+0000","last_became_active":"2024-09-10T23:17:52.570182+0000","last_became_peered":"2024-09-10T23:17:52.570182+0000","last_unstale":"2024-09-10T23:17:55.477954+0000","last_undegraded":"2024-09-10T23:17:55.477954+0000","last_fullsized":"2024-09-10T23:17:55.477954+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:20.967251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477601+0000","last_change":"2024-09-10T23:17:53.552719+0000","last_active":"2024-09-10T23:17:55.477601+0000","last_peered":"2024-09-10T23:17:55.477601+0000","last_clean":"2024-09-10T23:17:55.477601+0000","last_became_active":"2024-09-10T23:17:53.552447+0000","last_became_peered":"2024-09-10T23:17:53.552447+0000","last_unstale":"2024-09-10T23:17:55.477601+0000","last_undegraded":"2024-09-10T23:17:55.477601+0000","last_fullsized":"2024-09-10T23:17:55.477601+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:16.073355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.577849+0000","last_change":"2024-09-10T23:17:52.572229+0000","last_active":"2024-09-10T23:17:52.577849+0000","last_peered":"2024-09-10T23:17:52.577849+0000","last_clean":"2024-09-10T23:17:52.577849+0000","last_became_active":"2024-09-10T23:17:52.571988+0000","last_became_peered":"2024-09-10T23:17:52.571988+0000","last_unstale":"2024-09-10T23:17:52.577849+0000","last_undegraded":"2024-09-10T23:17:52.577849+0000","last_fullsized":"2024-09-10T23:17:52.577849+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:32.280575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541603+0000","last_change":"2024-09-10T23:17:53.560055+0000","last_active":"2024-09-10T23:17:54.541603+0000","last_peered":"2024-09-10T23:17:54.541603+0000","last_clean":"2024-09-10T23:17:54.541603+0000","last_became_active":"2024-09-10T23:17:53.559593+0000","last_became_peered":"2024-09-10T23:17:53.559593+0000","last_unstale":"2024-09-10T23:17:54.541603+0000","last_undegraded":"2024-09-10T23:17:54.541603+0000","last_fullsized":"2024-09-10T23:17:54.541603+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:56.948906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477390+0000","last_change":"2024-09-10T23:17:52.572129+0000","last_active":"2024-09-10T23:17:55.477390+0000","last_peered":"2024-09-10T23:17:55.477390+0000","last_clean":"2024-09-10T23:17:55.477390+0000","last_became_active":"2024-09-10T23:17:52.571852+0000","last_became_peered":"2024-09-10T23:17:52.571852+0000","last_unstale":"2024-09-10T23:17:55.477390+0000","last_undegraded":"2024-09-10T23:17:55.477390+0000","last_fullsized":"2024-09-10T23:17:55.477390+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:25.388962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540659+0000","last_change":"2024-09-10T23:17:53.563186+0000","last_active":"2024-09-10T23:17:54.540659+0000","last_peered":"2024-09-10T23:17:54.540659+0000","last_clean":"2024-09-10T23:17:54.540659+0000","last_became_active":"2024-09-10T23:17:53.562911+0000","last_became_peered":"2024-09-10T23:17:53.562911+0000","last_unstale":"2024-09-10T23:17:54.540659+0000","last_undegraded":"2024-09-10T23:17:54.540659+0000","last_fullsized":"2024-09-10T23:17:54.540659+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:57.998079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478408+0000","last_change":"2024-09-10T23:17:52.570474+0000","last_active":"2024-09-10T23:17:55.478408+0000","last_peered":"2024-09-10T23:17:55.478408+0000","last_clean":"2024-09-10T23:17:55.478408+0000","last_became_active":"2024-09-10T23:17:52.570229+0000","last_became_peered":"2024-09-10T23:17:52.570229+0000","last_unstale":"2024-09-10T23:17:55.478408+0000","last_undegraded":"2024-09-10T23:17:55.478408+0000","last_fullsized":"2024-09-10T23:17:55.478408+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:45.686357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560511+0000","last_change":"2024-09-10T23:17:52.560511+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560511+0000","last_undegraded":"2024-09-10T23:17:52.560511+0000","last_fullsized":"2024-09-10T23:17:52.560511+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477566+0000","last_change":"2024-09-10T23:17:52.571527+0000","last_active":"2024-09-10T23:17:55.477566+0000","last_peered":"2024-09-10T23:17:55.477566+0000","last_clean":"2024-09-10T23:17:55.477566+0000","last_became_active":"2024-09-10T23:17:52.570946+0000","last_became_peered":"2024-09-10T23:17:52.570946+0000","last_unstale":"2024-09-10T23:17:55.477566+0000","last_undegraded":"2024-09-10T23:17:55.477566+0000","last_fullsized":"2024-09-10T23:17:55.477566+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:20.824122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541493+0000","last_change":"2024-09-10T23:17:53.556628+0000","last_active":"2024-09-10T23:17:54.541493+0000","last_peered":"2024-09-10T23:17:54.541493+0000","last_clean":"2024-09-10T23:17:54.541493+0000","last_became_active":"2024-09-10T23:17:53.556314+0000","last_became_peered":"2024-09-10T23:17:53.556314+0000","last_unstale":"2024-09-10T23:17:54.541493+0000","last_undegraded":"2024-09-10T23:17:54.541493+0000","last_fullsized":"2024-09-10T23:17:54.541493+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:45.780193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541619+0000","last_change":"2024-09-10T23:17:52.565643+0000","last_active":"2024-09-10T23:17:54.541619+0000","last_peered":"2024-09-10T23:17:54.541619+0000","last_clean":"2024-09-10T23:17:54.541619+0000","last_became_active":"2024-09-10T23:17:52.565379+0000","last_became_peered":"2024-09-10T23:17:52.565379+0000","last_unstale":"2024-09-10T23:17:54.541619+0000","last_undegraded":"2024-09-10T23:17:54.541619+0000","last_fullsized":"2024-09-10T23:17:54.541619+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:28.775557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478303+0000","last_change":"2024-09-10T23:17:53.556574+0000","last_active":"2024-09-10T23:17:55.478303+0000","last_peered":"2024-09-10T23:17:55.478303+0000","last_clean":"2024-09-10T23:17:55.478303+0000","last_became_active":"2024-09-10T23:17:53.556314+0000","last_became_peered":"2024-09-10T23:17:53.556314+0000","last_unstale":"2024-09-10T23:17:55.478303+0000","last_undegraded":"2024-09-10T23:17:55.478303+0000","last_fullsized":"2024-09-10T23:17:55.478303+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:36.485396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"91'3","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478090+0000","last_change":"2024-09-10T23:17:52.569674+0000","last_active":"2024-09-10T23:17:55.478090+0000","last_peered":"2024-09-10T23:17:55.478090+0000","last_clean":"2024-09-10T23:17:55.478090+0000","last_became_active":"2024-09-10T23:17:52.569405+0000","last_became_peered":"2024-09-10T23:17:52.569405+0000","last_unstale":"2024-09-10T23:17:55.478090+0000","last_undegraded":"2024-09-10T23:17:55.478090+0000","last_fullsized":"2024-09-10T23:17:55.478090+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:54.496199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477866+0000","last_change":"2024-09-10T23:17:53.551292+0000","last_active":"2024-09-10T23:17:55.477866+0000","last_peered":"2024-09-10T23:17:55.477866+0000","last_clean":"2024-09-10T23:17:55.477866+0000","last_became_active":"2024-09-10T23:17:53.550916+0000","last_became_peered":"2024-09-10T23:17:53.550916+0000","last_unstale":"2024-09-10T23:17:55.477866+0000","last_undegraded":"2024-09-10T23:17:55.477866+0000","last_fullsized":"2024-09-10T23:17:55.477866+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:39.164979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"91'6","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541301+0000","last_change":"2024-09-10T23:17:52.568133+0000","last_active":"2024-09-10T23:17:54.541301+0000","last_peered":"2024-09-10T23:17:54.541301+0000","last_clean":"2024-09-10T23:17:54.541301+0000","last_became_active":"2024-09-10T23:17:52.567833+0000","last_became_peered":"2024-09-10T23:17:52.567833+0000","last_unstale":"2024-09-10T23:17:54.541301+0000","last_undegraded":"2024-09-10T23:17:54.541301+0000","last_fullsized":"2024-09-10T23:17:54.541301+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:33.259359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541656+0000","last_change":"2024-09-10T23:17:53.555595+0000","last_active":"2024-09-10T23:17:54.541656+0000","last_peered":"2024-09-10T23:17:54.541656+0000","last_clean":"2024-09-10T23:17:54.541656+0000","last_became_active":"2024-09-10T23:17:53.555336+0000","last_became_peered":"2024-09-10T23:17:53.555336+0000","last_unstale":"2024-09-10T23:17:54.541656+0000","last_undegraded":"2024-09-10T23:17:54.541656+0000","last_fullsized":"2024-09-10T23:17:54.541656+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:34.435158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477939+0000","last_change":"2024-09-10T23:17:52.575370+0000","last_active":"2024-09-10T23:17:55.477939+0000","last_peered":"2024-09-10T23:17:55.477939+0000","last_clean":"2024-09-10T23:17:55.477939+0000","last_became_active":"2024-09-10T23:17:52.575116+0000","last_became_peered":"2024-09-10T23:17:52.575116+0000","last_unstale":"2024-09-10T23:17:55.477939+0000","last_undegraded":"2024-09-10T23:17:55.477939+0000","last_fullsized":"2024-09-10T23:17:55.477939+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:47.723623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477917+0000","last_change":"2024-09-10T23:17:53.557083+0000","last_active":"2024-09-10T23:17:55.477917+0000","last_peered":"2024-09-10T23:17:55.477917+0000","last_clean":"2024-09-10T23:17:55.477917+0000","last_became_active":"2024-09-10T23:17:53.556330+0000","last_became_peered":"2024-09-10T23:17:53.556330+0000","last_unstale":"2024-09-10T23:17:55.477917+0000","last_undegraded":"2024-09-10T23:17:55.477917+0000","last_fullsized":"2024-09-10T23:17:55.477917+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:25.335933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478310+0000","last_change":"2024-09-10T23:17:52.570569+0000","last_active":"2024-09-10T23:17:55.478310+0000","last_peered":"2024-09-10T23:17:55.478310+0000","last_clean":"2024-09-10T23:17:55.478310+0000","last_became_active":"2024-09-10T23:17:52.570266+0000","last_became_peered":"2024-09-10T23:17:52.570266+0000","last_unstale":"2024-09-10T23:17:55.478310+0000","last_undegraded":"2024-09-10T23:17:55.478310+0000","last_fullsized":"2024-09-10T23:17:55.478310+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:11.558545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540387+0000","last_change":"2024-09-10T23:17:53.557358+0000","last_active":"2024-09-10T23:17:54.540387+0000","last_peered":"2024-09-10T23:17:54.540387+0000","last_clean":"2024-09-10T23:17:54.540387+0000","last_became_active":"2024-09-10T23:17:53.557053+0000","last_became_peered":"2024-09-10T23:17:53.557053+0000","last_unstale":"2024-09-10T23:17:54.540387+0000","last_undegraded":"2024-09-10T23:17:54.540387+0000","last_fullsized":"2024-09-10T23:17:54.540387+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:55.181222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540720+0000","last_change":"2024-09-10T23:17:52.566896+0000","last_active":"2024-09-10T23:17:54.540720+0000","last_peered":"2024-09-10T23:17:54.540720+0000","last_clean":"2024-09-10T23:17:54.540720+0000","last_became_active":"2024-09-10T23:17:52.566614+0000","last_became_peered":"2024-09-10T23:17:52.566614+0000","last_unstale":"2024-09-10T23:17:54.540720+0000","last_undegraded":"2024-09-10T23:17:54.540720+0000","last_fullsized":"2024-09-10T23:17:54.540720+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:44.749574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477408+0000","last_change":"2024-09-10T23:17:53.554939+0000","last_active":"2024-09-10T23:17:55.477408+0000","last_peered":"2024-09-10T23:17:55.477408+0000","last_clean":"2024-09-10T23:17:55.477408+0000","last_became_active":"2024-09-10T23:17:53.554628+0000","last_became_peered":"2024-09-10T23:17:53.554628+0000","last_unstale":"2024-09-10T23:17:55.477408+0000","last_undegraded":"2024-09-10T23:17:55.477408+0000","last_fullsized":"2024-09-10T23:17:55.477408+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:17:48.513922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"91'8","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478414+0000","last_change":"2024-09-10T23:17:52.572070+0000","last_active":"2024-09-10T23:17:55.478414+0000","last_peered":"2024-09-10T23:17:55.478414+0000","last_clean":"2024-09-10T23:17:55.478414+0000","last_became_active":"2024-09-10T23:17:52.570996+0000","last_became_peered":"2024-09-10T23:17:52.570996+0000","last_unstale":"2024-09-10T23:17:55.478414+0000","last_undegraded":"2024-09-10T23:17:55.478414+0000","last_fullsized":"2024-09-10T23:17:55.478414+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:41.583773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478481+0000","last_change":"2024-09-10T23:17:53.558187+0000","last_active":"2024-09-10T23:17:55.478481+0000","last_peered":"2024-09-10T23:17:55.478481+0000","last_clean":"2024-09-10T23:17:55.478481+0000","last_became_active":"2024-09-10T23:17:53.557822+0000","last_became_peered":"2024-09-10T23:17:53.557822+0000","last_unstale":"2024-09-10T23:17:55.478481+0000","last_undegraded":"2024-09-10T23:17:55.478481+0000","last_fullsized":"2024-09-10T23:17:55.478481+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:56.948906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540894+0000","last_change":"2024-09-10T23:17:52.576217+0000","last_active":"2024-09-10T23:17:54.540894+0000","last_peered":"2024-09-10T23:17:54.540894+0000","last_clean":"2024-09-10T23:17:54.540894+0000","last_became_active":"2024-09-10T23:17:52.575912+0000","last_became_peered":"2024-09-10T23:17:52.575912+0000","last_unstale":"2024-09-10T23:17:54.540894+0000","last_undegraded":"2024-09-10T23:17:54.540894+0000","last_fullsized":"2024-09-10T23:17:54.540894+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:09.495386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540997+0000","last_change":"2024-09-10T23:17:53.553565+0000","last_active":"2024-09-10T23:17:54.540997+0000","last_peered":"2024-09-10T23:17:54.540997+0000","last_clean":"2024-09-10T23:17:54.540997+0000","last_became_active":"2024-09-10T23:17:53.553303+0000","last_became_peered":"2024-09-10T23:17:53.553303+0000","last_unstale":"2024-09-10T23:17:54.540997+0000","last_undegraded":"2024-09-10T23:17:54.540997+0000","last_fullsized":"2024-09-10T23:17:54.540997+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:21.604281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478159+0000","last_change":"2024-09-10T23:17:52.564087+0000","last_active":"2024-09-10T23:17:55.478159+0000","last_peered":"2024-09-10T23:17:55.478159+0000","last_clean":"2024-09-10T23:17:55.478159+0000","last_became_active":"2024-09-10T23:17:52.563797+0000","last_became_peered":"2024-09-10T23:17:52.563797+0000","last_unstale":"2024-09-10T23:17:55.478159+0000","last_undegraded":"2024-09-10T23:17:55.478159+0000","last_fullsized":"2024-09-10T23:17:55.478159+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:02.781778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477966+0000","last_change":"2024-09-10T23:17:53.554719+0000","last_active":"2024-09-10T23:17:55.477966+0000","last_peered":"2024-09-10T23:17:55.477966+0000","last_clean":"2024-09-10T23:17:55.477966+0000","last_became_active":"2024-09-10T23:17:53.554460+0000","last_became_peered":"2024-09-10T23:17:53.554460+0000","last_unstale":"2024-09-10T23:17:55.477966+0000","last_undegraded":"2024-09-10T23:17:55.477966+0000","last_fullsized":"2024-09-10T23:17:55.477966+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:52.272283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572500+0000","last_change":"2024-09-10T23:17:52.566947+0000","last_active":"2024-09-10T23:17:52.572500+0000","last_peered":"2024-09-10T23:17:52.572500+0000","last_clean":"2024-09-10T23:17:52.572500+0000","last_became_active":"2024-09-10T23:17:52.566704+0000","last_became_peered":"2024-09-10T23:17:52.566704+0000","last_unstale":"2024-09-10T23:17:52.572500+0000","last_undegraded":"2024-09-10T23:17:52.572500+0000","last_fullsized":"2024-09-10T23:17:52.572500+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:58.125611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478178+0000","last_change":"2024-09-10T23:17:53.551313+0000","last_active":"2024-09-10T23:17:55.478178+0000","last_peered":"2024-09-10T23:17:55.478178+0000","last_clean":"2024-09-10T23:17:55.478178+0000","last_became_active":"2024-09-10T23:17:53.550774+0000","last_became_peered":"2024-09-10T23:17:53.550774+0000","last_unstale":"2024-09-10T23:17:55.478178+0000","last_undegraded":"2024-09-10T23:17:55.478178+0000","last_fullsized":"2024-09-10T23:17:55.478178+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:33.555549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.580764+0000","last_change":"2024-09-10T23:17:52.575545+0000","last_active":"2024-09-10T23:17:52.580764+0000","last_peered":"2024-09-10T23:17:52.580764+0000","last_clean":"2024-09-10T23:17:52.580764+0000","last_became_active":"2024-09-10T23:17:52.575282+0000","last_became_peered":"2024-09-10T23:17:52.575282+0000","last_unstale":"2024-09-10T23:17:52.580764+0000","last_undegraded":"2024-09-10T23:17:52.580764+0000","last_fullsized":"2024-09-10T23:17:52.580764+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:52.940489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477947+0000","last_change":"2024-09-10T23:17:53.548656+0000","last_active":"2024-09-10T23:17:55.477947+0000","last_peered":"2024-09-10T23:17:55.477947+0000","last_clean":"2024-09-10T23:17:55.477947+0000","last_became_active":"2024-09-10T23:17:53.548388+0000","last_became_peered":"2024-09-10T23:17:53.548388+0000","last_unstale":"2024-09-10T23:17:55.477947+0000","last_undegraded":"2024-09-10T23:17:55.477947+0000","last_fullsized":"2024-09-10T23:17:55.477947+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:57.483201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541095+0000","last_change":"2024-09-10T23:17:52.569306+0000","last_active":"2024-09-10T23:17:54.541095+0000","last_peered":"2024-09-10T23:17:54.541095+0000","last_clean":"2024-09-10T23:17:54.541095+0000","last_became_active":"2024-09-10T23:17:52.569038+0000","last_became_peered":"2024-09-10T23:17:52.569038+0000","last_unstale":"2024-09-10T23:17:54.541095+0000","last_undegraded":"2024-09-10T23:17:54.541095+0000","last_fullsized":"2024-09-10T23:17:54.541095+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:34.625142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477680+0000","last_change":"2024-09-10T23:17:53.550802+0000","last_active":"2024-09-10T23:17:55.477680+0000","last_peered":"2024-09-10T23:17:55.477680+0000","last_clean":"2024-09-10T23:17:55.477680+0000","last_became_active":"2024-09-10T23:17:53.550519+0000","last_became_peered":"2024-09-10T23:17:53.550519+0000","last_unstale":"2024-09-10T23:17:55.477680+0000","last_undegraded":"2024-09-10T23:17:55.477680+0000","last_fullsized":"2024-09-10T23:17:55.477680+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:25.004260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540279+0000","last_change":"2024-09-10T23:17:52.570230+0000","last_active":"2024-09-10T23:17:54.540279+0000","last_peered":"2024-09-10T23:17:54.540279+0000","last_clean":"2024-09-10T23:17:54.540279+0000","last_became_active":"2024-09-10T23:17:52.569918+0000","last_became_peered":"2024-09-10T23:17:52.569918+0000","last_unstale":"2024-09-10T23:17:54.540279+0000","last_undegraded":"2024-09-10T23:17:54.540279+0000","last_fullsized":"2024-09-10T23:17:54.540279+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:38.853089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477272+0000","last_change":"2024-09-10T23:17:53.566019+0000","last_active":"2024-09-10T23:17:55.477272+0000","last_peered":"2024-09-10T23:17:55.477272+0000","last_clean":"2024-09-10T23:17:55.477272+0000","last_became_active":"2024-09-10T23:17:53.565331+0000","last_became_peered":"2024-09-10T23:17:53.565331+0000","last_unstale":"2024-09-10T23:17:55.477272+0000","last_undegraded":"2024-09-10T23:17:55.477272+0000","last_fullsized":"2024-09-10T23:17:55.477272+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:55.497871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.575313+0000","last_change":"2024-09-10T23:17:52.571701+0000","last_active":"2024-09-10T23:17:52.575313+0000","last_peered":"2024-09-10T23:17:52.575313+0000","last_clean":"2024-09-10T23:17:52.575313+0000","last_became_active":"2024-09-10T23:17:52.571455+0000","last_became_peered":"2024-09-10T23:17:52.571455+0000","last_unstale":"2024-09-10T23:17:52.575313+0000","last_undegraded":"2024-09-10T23:17:52.575313+0000","last_fullsized":"2024-09-10T23:17:52.575313+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:38.467005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560136+0000","last_change":"2024-09-10T23:17:52.560136+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560136+0000","last_undegraded":"2024-09-10T23:17:52.560136+0000","last_fullsized":"2024-09-10T23:17:52.560136+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541581+0000","last_change":"2024-09-10T23:17:52.566757+0000","last_active":"2024-09-10T23:17:54.541581+0000","last_peered":"2024-09-10T23:17:54.541581+0000","last_clean":"2024-09-10T23:17:54.541581+0000","last_became_active":"2024-09-10T23:17:52.566440+0000","last_became_peered":"2024-09-10T23:17:52.566440+0000","last_unstale":"2024-09-10T23:17:54.541581+0000","last_undegraded":"2024-09-10T23:17:54.541581+0000","last_fullsized":"2024-09-10T23:17:54.541581+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:14.026848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477479+0000","last_change":"2024-09-10T23:17:53.560579+0000","last_active":"2024-09-10T23:17:55.477479+0000","last_peered":"2024-09-10T23:17:55.477479+0000","last_clean":"2024-09-10T23:17:55.477479+0000","last_became_active":"2024-09-10T23:17:53.560328+0000","last_became_peered":"2024-09-10T23:17:53.560328+0000","last_unstale":"2024-09-10T23:17:55.477479+0000","last_undegraded":"2024-09-10T23:17:55.477479+0000","last_fullsized":"2024-09-10T23:17:55.477479+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:09.110684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572809+0000","last_change":"2024-09-10T23:17:52.569086+0000","last_active":"2024-09-10T23:17:52.572809+0000","last_peered":"2024-09-10T23:17:52.572809+0000","last_clean":"2024-09-10T23:17:52.572809+0000","last_became_active":"2024-09-10T23:17:52.568848+0000","last_became_peered":"2024-09-10T23:17:52.568848+0000","last_unstale":"2024-09-10T23:17:52.572809+0000","last_undegraded":"2024-09-10T23:17:52.572809+0000","last_fullsized":"2024-09-10T23:17:52.572809+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:33.695089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477633+0000","last_change":"2024-09-10T23:17:53.557393+0000","last_active":"2024-09-10T23:17:55.477633+0000","last_peered":"2024-09-10T23:17:55.477633+0000","last_clean":"2024-09-10T23:17:55.477633+0000","last_became_active":"2024-09-10T23:17:53.556251+0000","last_became_peered":"2024-09-10T23:17:53.556251+0000","last_unstale":"2024-09-10T23:17:55.477633+0000","last_undegraded":"2024-09-10T23:17:55.477633+0000","last_fullsized":"2024-09-10T23:17:55.477633+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:57.307923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.575071+0000","last_change":"2024-09-10T23:17:52.570424+0000","last_active":"2024-09-10T23:17:52.575071+0000","last_peered":"2024-09-10T23:17:52.575071+0000","last_clean":"2024-09-10T23:17:52.575071+0000","last_became_active":"2024-09-10T23:17:52.570165+0000","last_became_peered":"2024-09-10T23:17:52.570165+0000","last_unstale":"2024-09-10T23:17:52.575071+0000","last_undegraded":"2024-09-10T23:17:52.575071+0000","last_fullsized":"2024-09-10T23:17:52.575071+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:08.811918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477645+0000","last_change":"2024-09-10T23:17:53.564128+0000","last_active":"2024-09-10T23:17:55.477645+0000","last_peered":"2024-09-10T23:17:55.477645+0000","last_clean":"2024-09-10T23:17:55.477645+0000","last_became_active":"2024-09-10T23:17:53.563904+0000","last_became_peered":"2024-09-10T23:17:53.563904+0000","last_unstale":"2024-09-10T23:17:55.477645+0000","last_undegraded":"2024-09-10T23:17:55.477645+0000","last_fullsized":"2024-09-10T23:17:55.477645+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:25.531536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478432+0000","last_change":"2024-09-10T23:17:52.566701+0000","last_active":"2024-09-10T23:17:55.478432+0000","last_peered":"2024-09-10T23:17:55.478432+0000","last_clean":"2024-09-10T23:17:55.478432+0000","last_became_active":"2024-09-10T23:17:52.566074+0000","last_became_peered":"2024-09-10T23:17:52.566074+0000","last_unstale":"2024-09-10T23:17:55.478432+0000","last_undegraded":"2024-09-10T23:17:55.478432+0000","last_fullsized":"2024-09-10T23:17:55.478432+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:20.781641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478386+0000","last_change":"2024-09-10T23:17:53.557300+0000","last_active":"2024-09-10T23:17:55.478386+0000","last_peered":"2024-09-10T23:17:55.478386+0000","last_clean":"2024-09-10T23:17:55.478386+0000","last_became_active":"2024-09-10T23:17:53.556997+0000","last_became_peered":"2024-09-10T23:17:53.556997+0000","last_unstale":"2024-09-10T23:17:55.478386+0000","last_undegraded":"2024-09-10T23:17:55.478386+0000","last_fullsized":"2024-09-10T23:17:55.478386+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:12.740294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.575016+0000","last_change":"2024-09-10T23:17:52.569372+0000","last_active":"2024-09-10T23:17:52.575016+0000","last_peered":"2024-09-10T23:17:52.575016+0000","last_clean":"2024-09-10T23:17:52.575016+0000","last_became_active":"2024-09-10T23:17:52.569138+0000","last_became_peered":"2024-09-10T23:17:52.569138+0000","last_unstale":"2024-09-10T23:17:52.575016+0000","last_undegraded":"2024-09-10T23:17:52.575016+0000","last_fullsized":"2024-09-10T23:17:52.575016+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:19.835444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540543+0000","last_change":"2024-09-10T23:17:53.553407+0000","last_active":"2024-09-10T23:17:54.540543+0000","last_peered":"2024-09-10T23:17:54.540543+0000","last_clean":"2024-09-10T23:17:54.540543+0000","last_became_active":"2024-09-10T23:17:53.553115+0000","last_became_peered":"2024-09-10T23:17:53.553115+0000","last_unstale":"2024-09-10T23:17:54.540543+0000","last_undegraded":"2024-09-10T23:17:54.540543+0000","last_fullsized":"2024-09-10T23:17:54.540543+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:09.097652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477705+0000","last_change":"2024-09-10T23:17:52.568101+0000","last_active":"2024-09-10T23:17:55.477705+0000","last_peered":"2024-09-10T23:17:55.477705+0000","last_clean":"2024-09-10T23:17:55.477705+0000","last_became_active":"2024-09-10T23:17:52.567822+0000","last_became_peered":"2024-09-10T23:17:52.567822+0000","last_unstale":"2024-09-10T23:17:55.477705+0000","last_undegraded":"2024-09-10T23:17:55.477705+0000","last_fullsized":"2024-09-10T23:17:55.477705+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:01.850714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477722+0000","last_change":"2024-09-10T23:17:53.554947+0000","last_active":"2024-09-10T23:17:55.477722+0000","last_peered":"2024-09-10T23:17:55.477722+0000","last_clean":"2024-09-10T23:17:55.477722+0000","last_became_active":"2024-09-10T23:17:53.554642+0000","last_became_peered":"2024-09-10T23:17:53.554642+0000","last_unstale":"2024-09-10T23:17:55.477722+0000","last_undegraded":"2024-09-10T23:17:55.477722+0000","last_fullsized":"2024-09-10T23:17:55.477722+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:17.947754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541905+0000","last_change":"2024-09-10T23:17:52.569265+0000","last_active":"2024-09-10T23:17:54.541905+0000","last_peered":"2024-09-10T23:17:54.541905+0000","last_clean":"2024-09-10T23:17:54.541905+0000","last_became_active":"2024-09-10T23:17:52.569021+0000","last_became_peered":"2024-09-10T23:17:52.569021+0000","last_unstale":"2024-09-10T23:17:54.541905+0000","last_undegraded":"2024-09-10T23:17:54.541905+0000","last_fullsized":"2024-09-10T23:17:54.541905+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:37:36.066729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477301+0000","last_change":"2024-09-10T23:17:53.561543+0000","last_active":"2024-09-10T23:17:55.477301+0000","last_peered":"2024-09-10T23:17:55.477301+0000","last_clean":"2024-09-10T23:17:55.477301+0000","last_became_active":"2024-09-10T23:17:53.561264+0000","last_became_peered":"2024-09-10T23:17:53.561264+0000","last_unstale":"2024-09-10T23:17:55.477301+0000","last_undegraded":"2024-09-10T23:17:55.477301+0000","last_fullsized":"2024-09-10T23:17:55.477301+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:52.661481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477776+0000","last_change":"2024-09-10T23:17:52.573386+0000","last_active":"2024-09-10T23:17:55.477776+0000","last_peered":"2024-09-10T23:17:55.477776+0000","last_clean":"2024-09-10T23:17:55.477776+0000","last_became_active":"2024-09-10T23:17:52.573120+0000","last_became_peered":"2024-09-10T23:17:52.573120+0000","last_unstale":"2024-09-10T23:17:55.477776+0000","last_undegraded":"2024-09-10T23:17:55.477776+0000","last_fullsized":"2024-09-10T23:17:55.477776+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:06.971289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478299+0000","last_change":"2024-09-10T23:17:53.550292+0000","last_active":"2024-09-10T23:17:55.478299+0000","last_peered":"2024-09-10T23:17:55.478299+0000","last_clean":"2024-09-10T23:17:55.478299+0000","last_became_active":"2024-09-10T23:17:53.550026+0000","last_became_peered":"2024-09-10T23:17:53.550026+0000","last_unstale":"2024-09-10T23:17:55.478299+0000","last_undegraded":"2024-09-10T23:17:55.478299+0000","last_fullsized":"2024-09-10T23:17:55.478299+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:54.395956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477575+0000","last_change":"2024-09-10T23:17:52.569598+0000","last_active":"2024-09-10T23:17:55.477575+0000","last_peered":"2024-09-10T23:17:55.477575+0000","last_clean":"2024-09-10T23:17:55.477575+0000","last_became_active":"2024-09-10T23:17:52.569310+0000","last_became_peered":"2024-09-10T23:17:52.569310+0000","last_unstale":"2024-09-10T23:17:55.477575+0000","last_undegraded":"2024-09-10T23:17:55.477575+0000","last_fullsized":"2024-09-10T23:17:55.477575+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:58.550027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":236,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477703+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:17:55.477703+0000","last_peered":"2024-09-10T23:17:55.477703+0000","last_clean":"2024-09-10T23:17:55.477703+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:17:55.477703+0000","last_undegraded":"2024-09-10T23:17:55.477703+0000","last_fullsized":"2024-09-10T23:17:55.477703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28720,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343120,"statfs":{"total":96636764160,"available":96607354880,"internally_reserved":0,"allocated":1720320,"data_stored":1061912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1126400,"data_stored":472084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509485,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1134592,"data_stored":477802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1150976,"data_stored":479468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1146880,"data_stored":479366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1122304,"data_stored":471466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1118208,"data_stored":471432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32860,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338980,"statfs":{"total":96636764160,"available":96603115520,"internally_reserved":0,"allocated":1699840,"data_stored":1055025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:17:56.519 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:17:56.535 INFO:tasks.ceph.mds.a.smithi090.stderr:2024-09-10T23:17:56.534+0000 7fbf0b0a2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:17:56.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.636+0000 7fcc66a01640 1 -- 172.21.15.90:0/3455495150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc600cd470 msgr2=0x7fcc600ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.636+0000 7fcc66a01640 1 --2- 172.21.15.90:0/3455495150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc600cd470 0x7fcc600ce0d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcc58005fd0 tx=0x7fcc5802a8b0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.636+0000 7fcc66a01640 1 -- 172.21.15.90:0/3455495150 shutdown_connections 2024-09-10T23:17:56.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.636+0000 7fcc66a01640 1 --2- 172.21.15.90:0/3455495150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc600cd470 0x7fcc600ce0d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.636+0000 7fcc66a01640 1 --2- 172.21.15.90:0/3455495150 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc600cf860 0x7fcc600cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.636+0000 7fcc66a01640 1 -- 172.21.15.90:0/3455495150 >> 172.21.15.90:0/3455495150 conn(0x7fcc600b19c0 msgr2=0x7fcc600b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:56.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.636+0000 7fcc66a01640 1 -- 172.21.15.90:0/3455495150 shutdown_connections 2024-09-10T23:17:56.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.636+0000 7fcc66a01640 1 -- 172.21.15.90:0/3455495150 wait complete. 2024-09-10T23:17:56.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.637+0000 7fcc66a01640 1 Processor -- start 2024-09-10T23:17:56.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.637+0000 7fcc66a01640 1 -- start start 2024-09-10T23:17:56.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.638+0000 7fcc66a01640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc600b44a0 0x7fcc6009aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:56.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.638+0000 7fcc66a01640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc600cd470 0x7fcc60148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:56.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.638+0000 7fcc66a01640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc600cf860 0x7fcc60152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:56.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.638+0000 7fcc66a01640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcc600cc710 con 0x7fcc600cd470 2024-09-10T23:17:56.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.638+0000 7fcc66a01640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6015aad0 con 0x7fcc600b44a0 2024-09-10T23:17:56.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.638+0000 7fcc66a01640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcc600cc890 con 0x7fcc600cf860 2024-09-10T23:17:56.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.638+0000 7fcc57fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc600cd470 0x7fcc60148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:56.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.638+0000 7fcc57fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc600cd470 0x7fcc60148e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48376/0 (socket says 172.21.15.90:48376) 2024-09-10T23:17:56.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.638+0000 7fcc57fff640 1 -- 172.21.15.90:0/293568279 learned_addr learned my addr 172.21.15.90:0/293568279 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:56.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.638+0000 7fcc5ffff640 1 --2- 172.21.15.90:0/293568279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc600b44a0 0x7fcc6009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:56.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.638+0000 7fcc64f9e640 1 --2- 172.21.15.90:0/293568279 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc600cf860 0x7fcc60152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:56.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.639+0000 7fcc57fff640 1 -- 172.21.15.90:0/293568279 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc600cf860 msgr2=0x7fcc60152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.639+0000 7fcc57fff640 1 --2- 172.21.15.90:0/293568279 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc600cf860 0x7fcc60152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.639+0000 7fcc57fff640 1 -- 172.21.15.90:0/293568279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc600b44a0 msgr2=0x7fcc6009aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.639+0000 7fcc57fff640 1 --2- 172.21.15.90:0/293568279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc600b44a0 0x7fcc6009aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.639+0000 7fcc57fff640 1 -- 172.21.15.90:0/293568279 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc601f6190 con 0x7fcc600cd470 2024-09-10T23:17:56.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.639+0000 7fcc57fff640 1 --2- 172.21.15.90:0/293568279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc600cd470 0x7fcc60148e50 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800e9f0 tx=0x7fcc4800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:56.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.639+0000 7fcc5d7fa640 1 -- 172.21.15.90:0/293568279 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4800cd80 con 0x7fcc600cd470 2024-09-10T23:17:56.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.639+0000 7fcc5d7fa640 1 -- 172.21.15.90:0/293568279 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc48004020 con 0x7fcc600cd470 2024-09-10T23:17:56.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.639+0000 7fcc66a01640 1 -- 172.21.15.90:0/293568279 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc601f6430 con 0x7fcc600cd470 2024-09-10T23:17:56.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.639+0000 7fcc5d7fa640 1 -- 172.21.15.90:0/293568279 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48004470 con 0x7fcc600cd470 2024-09-10T23:17:56.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.639+0000 7fcc66a01640 1 -- 172.21.15.90:0/293568279 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc601f69f0 con 0x7fcc600cd470 2024-09-10T23:17:56.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.640+0000 7fcc66a01640 1 -- 172.21.15.90:0/293568279 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc600b4880 con 0x7fcc600cd470 2024-09-10T23:17:56.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.641+0000 7fcc5d7fa640 1 -- 172.21.15.90:0/293568279 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcc480035f0 con 0x7fcc600cd470 2024-09-10T23:17:56.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.641+0000 7fcc5d7fa640 1 --2- 172.21.15.90:0/293568279 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcc40077f70 0x7fcc4007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:56.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.641+0000 7fcc5d7fa640 1 -- 172.21.15.90:0/293568279 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fcc4809a540 con 0x7fcc600cd470 2024-09-10T23:17:56.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.641+0000 7fcc5ffff640 1 --2- 172.21.15.90:0/293568279 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcc40077f70 0x7fcc4007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:56.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.642+0000 7fcc5ffff640 1 --2- 172.21.15.90:0/293568279 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcc40077f70 0x7fcc4007a430 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcc500017c0 tx=0x7fcc50009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:56.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.645+0000 7fcc5d7fa640 1 -- 172.21.15.90:0/293568279 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcc48062a00 con 0x7fcc600cd470 2024-09-10T23:17:56.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.817+0000 7fcc66a01640 1 -- 172.21.15.90:0/293568279 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc600cc480 con 0x7fcc40077f70 2024-09-10T23:17:56.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.822+0000 7fcc5d7fa640 1 -- 172.21.15.90:0/293568279 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251324 (secure 0 0 0) 0x7fcc600cc480 con 0x7fcc40077f70 2024-09-10T23:17:56.825 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:56.827 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:17:56.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.825+0000 7fcc66a01640 1 -- 172.21.15.90:0/293568279 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcc40077f70 msgr2=0x7fcc4007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.825+0000 7fcc66a01640 1 --2- 172.21.15.90:0/293568279 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcc40077f70 0x7fcc4007a430 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcc500017c0 tx=0x7fcc50009040 comp rx=0 tx=0).stop 2024-09-10T23:17:56.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.825+0000 7fcc66a01640 1 -- 172.21.15.90:0/293568279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc600cd470 msgr2=0x7fcc60148e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.825+0000 7fcc66a01640 1 --2- 172.21.15.90:0/293568279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc600cd470 0x7fcc60148e50 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800e9f0 tx=0x7fcc4800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.825+0000 7fcc66a01640 1 -- 172.21.15.90:0/293568279 shutdown_connections 2024-09-10T23:17:56.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.825+0000 7fcc66a01640 1 --2- 172.21.15.90:0/293568279 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcc40077f70 0x7fcc4007a430 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.825+0000 7fcc66a01640 1 --2- 172.21.15.90:0/293568279 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc600cf860 0x7fcc60152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.825+0000 7fcc66a01640 1 --2- 172.21.15.90:0/293568279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc600cd470 0x7fcc60148e50 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.825+0000 7fcc66a01640 1 --2- 172.21.15.90:0/293568279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc600b44a0 0x7fcc6009aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.825+0000 7fcc66a01640 1 -- 172.21.15.90:0/293568279 >> 172.21.15.90:0/293568279 conn(0x7fcc600b19c0 msgr2=0x7fcc60159b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:56.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.825+0000 7fcc66a01640 1 -- 172.21.15.90:0/293568279 shutdown_connections 2024-09-10T23:17:56.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.825+0000 7fcc66a01640 1 -- 172.21.15.90:0/293568279 wait complete. 2024-09-10T23:17:56.837 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-09-10T23:17:56.482333+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255372,"kb_used_data":9980,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719348,"statfs":{"total":773094113280,"available":772832612352,"internally_reserved":0,"allocated":10219520,"data_stored":4968555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.935747"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477298+0000","last_change":"2024-09-10T23:17:53.560279+0000","last_active":"2024-09-10T23:17:55.477298+0000","last_peered":"2024-09-10T23:17:55.477298+0000","last_clean":"2024-09-10T23:17:55.477298+0000","last_became_active":"2024-09-10T23:17:53.556589+0000","last_became_peered":"2024-09-10T23:17:53.556589+0000","last_unstale":"2024-09-10T23:17:55.477298+0000","last_undegraded":"2024-09-10T23:17:55.477298+0000","last_fullsized":"2024-09-10T23:17:55.477298+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:20.124209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.562100+0000","last_change":"2024-09-10T23:17:52.562100+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.562100+0000","last_undegraded":"2024-09-10T23:17:52.562100+0000","last_fullsized":"2024-09-10T23:17:52.562100+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477747+0000","last_change":"2024-09-10T23:17:53.556897+0000","last_active":"2024-09-10T23:17:55.477747+0000","last_peered":"2024-09-10T23:17:55.477747+0000","last_clean":"2024-09-10T23:17:55.477747+0000","last_became_active":"2024-09-10T23:17:53.556564+0000","last_became_peered":"2024-09-10T23:17:53.556564+0000","last_unstale":"2024-09-10T23:17:55.477747+0000","last_undegraded":"2024-09-10T23:17:55.477747+0000","last_fullsized":"2024-09-10T23:17:55.477747+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:32.013618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541845+0000","last_change":"2024-09-10T23:17:53.554128+0000","last_active":"2024-09-10T23:17:54.541845+0000","last_peered":"2024-09-10T23:17:54.541845+0000","last_clean":"2024-09-10T23:17:54.541845+0000","last_became_active":"2024-09-10T23:17:53.553837+0000","last_became_peered":"2024-09-10T23:17:53.553837+0000","last_unstale":"2024-09-10T23:17:54.541845+0000","last_undegraded":"2024-09-10T23:17:54.541845+0000","last_fullsized":"2024-09-10T23:17:54.541845+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:16.073355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478024+0000","last_change":"2024-09-10T23:17:53.561325+0000","last_active":"2024-09-10T23:17:55.478024+0000","last_peered":"2024-09-10T23:17:55.478024+0000","last_clean":"2024-09-10T23:17:55.478024+0000","last_became_active":"2024-09-10T23:17:53.561035+0000","last_became_peered":"2024-09-10T23:17:53.561035+0000","last_unstale":"2024-09-10T23:17:55.478024+0000","last_undegraded":"2024-09-10T23:17:55.478024+0000","last_fullsized":"2024-09-10T23:17:55.478024+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:05.151677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477659+0000","last_change":"2024-09-10T23:17:53.547173+0000","last_active":"2024-09-10T23:17:55.477659+0000","last_peered":"2024-09-10T23:17:55.477659+0000","last_clean":"2024-09-10T23:17:55.477659+0000","last_became_active":"2024-09-10T23:17:53.546924+0000","last_became_peered":"2024-09-10T23:17:53.546924+0000","last_unstale":"2024-09-10T23:17:55.477659+0000","last_undegraded":"2024-09-10T23:17:55.477659+0000","last_fullsized":"2024-09-10T23:17:55.477659+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:36.528978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477648+0000","last_change":"2024-09-10T23:17:53.544392+0000","last_active":"2024-09-10T23:17:55.477648+0000","last_peered":"2024-09-10T23:17:55.477648+0000","last_clean":"2024-09-10T23:17:55.477648+0000","last_became_active":"2024-09-10T23:17:53.544080+0000","last_became_peered":"2024-09-10T23:17:53.544080+0000","last_unstale":"2024-09-10T23:17:55.477648+0000","last_undegraded":"2024-09-10T23:17:55.477648+0000","last_fullsized":"2024-09-10T23:17:55.477648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:33.836216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.561234+0000","last_change":"2024-09-10T23:17:52.561234+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.561234+0000","last_undegraded":"2024-09-10T23:17:52.561234+0000","last_fullsized":"2024-09-10T23:17:52.561234+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541325+0000","last_change":"2024-09-10T23:17:53.560387+0000","last_active":"2024-09-10T23:17:54.541325+0000","last_peered":"2024-09-10T23:17:54.541325+0000","last_clean":"2024-09-10T23:17:54.541325+0000","last_became_active":"2024-09-10T23:17:53.560096+0000","last_became_peered":"2024-09-10T23:17:53.560096+0000","last_unstale":"2024-09-10T23:17:54.541325+0000","last_undegraded":"2024-09-10T23:17:54.541325+0000","last_fullsized":"2024-09-10T23:17:54.541325+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:33:38.997089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477837+0000","last_change":"2024-09-10T23:17:53.565740+0000","last_active":"2024-09-10T23:17:55.477837+0000","last_peered":"2024-09-10T23:17:55.477837+0000","last_clean":"2024-09-10T23:17:55.477837+0000","last_became_active":"2024-09-10T23:17:53.565440+0000","last_became_peered":"2024-09-10T23:17:53.565440+0000","last_unstale":"2024-09-10T23:17:55.477837+0000","last_undegraded":"2024-09-10T23:17:55.477837+0000","last_fullsized":"2024-09-10T23:17:55.477837+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:27.057119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477721+0000","last_change":"2024-09-10T23:17:53.555393+0000","last_active":"2024-09-10T23:17:55.477721+0000","last_peered":"2024-09-10T23:17:55.477721+0000","last_clean":"2024-09-10T23:17:55.477721+0000","last_became_active":"2024-09-10T23:17:53.555122+0000","last_became_peered":"2024-09-10T23:17:53.555122+0000","last_unstale":"2024-09-10T23:17:55.477721+0000","last_undegraded":"2024-09-10T23:17:55.477721+0000","last_fullsized":"2024-09-10T23:17:55.477721+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:29.522521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541083+0000","last_change":"2024-09-10T23:17:53.560808+0000","last_active":"2024-09-10T23:17:54.541083+0000","last_peered":"2024-09-10T23:17:54.541083+0000","last_clean":"2024-09-10T23:17:54.541083+0000","last_became_active":"2024-09-10T23:17:53.560407+0000","last_became_peered":"2024-09-10T23:17:53.560407+0000","last_unstale":"2024-09-10T23:17:54.541083+0000","last_undegraded":"2024-09-10T23:17:54.541083+0000","last_fullsized":"2024-09-10T23:17:54.541083+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:27.057119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541860+0000","last_change":"2024-09-10T23:17:53.557682+0000","last_active":"2024-09-10T23:17:54.541860+0000","last_peered":"2024-09-10T23:17:54.541860+0000","last_clean":"2024-09-10T23:17:54.541860+0000","last_became_active":"2024-09-10T23:17:53.557417+0000","last_became_peered":"2024-09-10T23:17:53.557417+0000","last_unstale":"2024-09-10T23:17:54.541860+0000","last_undegraded":"2024-09-10T23:17:54.541860+0000","last_fullsized":"2024-09-10T23:17:54.541860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:46.228987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477985+0000","last_change":"2024-09-10T23:17:53.552624+0000","last_active":"2024-09-10T23:17:55.477985+0000","last_peered":"2024-09-10T23:17:55.477985+0000","last_clean":"2024-09-10T23:17:55.477985+0000","last_became_active":"2024-09-10T23:17:53.552371+0000","last_became_peered":"2024-09-10T23:17:53.552371+0000","last_unstale":"2024-09-10T23:17:55.477985+0000","last_undegraded":"2024-09-10T23:17:55.477985+0000","last_fullsized":"2024-09-10T23:17:55.477985+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:45.051857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541808+0000","last_change":"2024-09-10T23:17:53.559674+0000","last_active":"2024-09-10T23:17:54.541808+0000","last_peered":"2024-09-10T23:17:54.541808+0000","last_clean":"2024-09-10T23:17:54.541808+0000","last_became_active":"2024-09-10T23:17:53.559392+0000","last_became_peered":"2024-09-10T23:17:53.559392+0000","last_unstale":"2024-09-10T23:17:54.541808+0000","last_undegraded":"2024-09-10T23:17:54.541808+0000","last_fullsized":"2024-09-10T23:17:54.541808+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:33.836216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477893+0000","last_change":"2024-09-10T23:17:53.548614+0000","last_active":"2024-09-10T23:17:55.477893+0000","last_peered":"2024-09-10T23:17:55.477893+0000","last_clean":"2024-09-10T23:17:55.477893+0000","last_became_active":"2024-09-10T23:17:53.548291+0000","last_became_peered":"2024-09-10T23:17:53.548291+0000","last_unstale":"2024-09-10T23:17:55.477893+0000","last_undegraded":"2024-09-10T23:17:55.477893+0000","last_fullsized":"2024-09-10T23:17:55.477893+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:23.095017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560750+0000","last_change":"2024-09-10T23:17:52.560750+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560750+0000","last_undegraded":"2024-09-10T23:17:52.560750+0000","last_fullsized":"2024-09-10T23:17:52.560750+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541749+0000","last_change":"2024-09-10T23:17:53.554180+0000","last_active":"2024-09-10T23:17:54.541749+0000","last_peered":"2024-09-10T23:17:54.541749+0000","last_clean":"2024-09-10T23:17:54.541749+0000","last_became_active":"2024-09-10T23:17:53.553901+0000","last_became_peered":"2024-09-10T23:17:53.553901+0000","last_unstale":"2024-09-10T23:17:54.541749+0000","last_undegraded":"2024-09-10T23:17:54.541749+0000","last_fullsized":"2024-09-10T23:17:54.541749+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:34.087388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477219+0000","last_change":"2024-09-10T23:17:53.557802+0000","last_active":"2024-09-10T23:17:55.477219+0000","last_peered":"2024-09-10T23:17:55.477219+0000","last_clean":"2024-09-10T23:17:55.477219+0000","last_became_active":"2024-09-10T23:17:53.557537+0000","last_became_peered":"2024-09-10T23:17:53.557537+0000","last_unstale":"2024-09-10T23:17:55.477219+0000","last_undegraded":"2024-09-10T23:17:55.477219+0000","last_fullsized":"2024-09-10T23:17:55.477219+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:07.646491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541143+0000","last_change":"2024-09-10T23:17:53.561436+0000","last_active":"2024-09-10T23:17:54.541143+0000","last_peered":"2024-09-10T23:17:54.541143+0000","last_clean":"2024-09-10T23:17:54.541143+0000","last_became_active":"2024-09-10T23:17:53.561173+0000","last_became_peered":"2024-09-10T23:17:53.561173+0000","last_unstale":"2024-09-10T23:17:54.541143+0000","last_undegraded":"2024-09-10T23:17:54.541143+0000","last_fullsized":"2024-09-10T23:17:54.541143+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:19:38.295347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477755+0000","last_change":"2024-09-10T23:17:53.545062+0000","last_active":"2024-09-10T23:17:55.477755+0000","last_peered":"2024-09-10T23:17:55.477755+0000","last_clean":"2024-09-10T23:17:55.477755+0000","last_became_active":"2024-09-10T23:17:53.544797+0000","last_became_peered":"2024-09-10T23:17:53.544797+0000","last_unstale":"2024-09-10T23:17:55.477755+0000","last_undegraded":"2024-09-10T23:17:55.477755+0000","last_fullsized":"2024-09-10T23:17:55.477755+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:31.712561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560460+0000","last_change":"2024-09-10T23:17:52.560460+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560460+0000","last_undegraded":"2024-09-10T23:17:52.560460+0000","last_fullsized":"2024-09-10T23:17:52.560460+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.558847+0000","last_change":"2024-09-10T23:17:52.558847+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.558847+0000","last_undegraded":"2024-09-10T23:17:52.558847+0000","last_fullsized":"2024-09-10T23:17:52.558847+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477630+0000","last_change":"2024-09-10T23:17:53.560079+0000","last_active":"2024-09-10T23:17:55.477630+0000","last_peered":"2024-09-10T23:17:55.477630+0000","last_clean":"2024-09-10T23:17:55.477630+0000","last_became_active":"2024-09-10T23:17:53.559507+0000","last_became_peered":"2024-09-10T23:17:53.559507+0000","last_unstale":"2024-09-10T23:17:55.477630+0000","last_undegraded":"2024-09-10T23:17:55.477630+0000","last_fullsized":"2024-09-10T23:17:55.477630+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:51.603445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478504+0000","last_change":"2024-09-10T23:17:53.563818+0000","last_active":"2024-09-10T23:17:55.478504+0000","last_peered":"2024-09-10T23:17:55.478504+0000","last_clean":"2024-09-10T23:17:55.478504+0000","last_became_active":"2024-09-10T23:17:53.563533+0000","last_became_peered":"2024-09-10T23:17:53.563533+0000","last_unstale":"2024-09-10T23:17:55.478504+0000","last_undegraded":"2024-09-10T23:17:55.478504+0000","last_fullsized":"2024-09-10T23:17:55.478504+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:34.435158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560995+0000","last_change":"2024-09-10T23:17:52.560995+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560995+0000","last_undegraded":"2024-09-10T23:17:52.560995+0000","last_fullsized":"2024-09-10T23:17:52.560995+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478026+0000","last_change":"2024-09-10T23:17:53.551936+0000","last_active":"2024-09-10T23:17:55.478026+0000","last_peered":"2024-09-10T23:17:55.478026+0000","last_clean":"2024-09-10T23:17:55.478026+0000","last_became_active":"2024-09-10T23:17:53.550713+0000","last_became_peered":"2024-09-10T23:17:53.550713+0000","last_unstale":"2024-09-10T23:17:55.478026+0000","last_undegraded":"2024-09-10T23:17:55.478026+0000","last_fullsized":"2024-09-10T23:17:55.478026+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:49.704662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478330+0000","last_change":"2024-09-10T23:17:53.560875+0000","last_active":"2024-09-10T23:17:55.478330+0000","last_peered":"2024-09-10T23:17:55.478330+0000","last_clean":"2024-09-10T23:17:55.478330+0000","last_became_active":"2024-09-10T23:17:53.560567+0000","last_became_peered":"2024-09-10T23:17:53.560567+0000","last_unstale":"2024-09-10T23:17:55.478330+0000","last_undegraded":"2024-09-10T23:17:55.478330+0000","last_fullsized":"2024-09-10T23:17:55.478330+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:31.501371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.559679+0000","last_change":"2024-09-10T23:17:52.559679+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.559679+0000","last_undegraded":"2024-09-10T23:17:52.559679+0000","last_fullsized":"2024-09-10T23:17:52.559679+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478167+0000","last_change":"2024-09-10T23:17:53.558562+0000","last_active":"2024-09-10T23:17:55.478167+0000","last_peered":"2024-09-10T23:17:55.478167+0000","last_clean":"2024-09-10T23:17:55.478167+0000","last_became_active":"2024-09-10T23:17:53.558327+0000","last_became_peered":"2024-09-10T23:17:53.558327+0000","last_unstale":"2024-09-10T23:17:55.478167+0000","last_undegraded":"2024-09-10T23:17:55.478167+0000","last_fullsized":"2024-09-10T23:17:55.478167+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:41.417295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541843+0000","last_change":"2024-09-10T23:17:53.554219+0000","last_active":"2024-09-10T23:17:54.541843+0000","last_peered":"2024-09-10T23:17:54.541843+0000","last_clean":"2024-09-10T23:17:54.541843+0000","last_became_active":"2024-09-10T23:17:53.553751+0000","last_became_peered":"2024-09-10T23:17:53.553751+0000","last_unstale":"2024-09-10T23:17:54.541843+0000","last_undegraded":"2024-09-10T23:17:54.541843+0000","last_fullsized":"2024-09-10T23:17:54.541843+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:08.996959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478297+0000","last_change":"2024-09-10T23:17:53.556628+0000","last_active":"2024-09-10T23:17:55.478297+0000","last_peered":"2024-09-10T23:17:55.478297+0000","last_clean":"2024-09-10T23:17:55.478297+0000","last_became_active":"2024-09-10T23:17:53.556310+0000","last_became_peered":"2024-09-10T23:17:53.556310+0000","last_unstale":"2024-09-10T23:17:55.478297+0000","last_undegraded":"2024-09-10T23:17:55.478297+0000","last_fullsized":"2024-09-10T23:17:55.478297+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:39.854761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478272+0000","last_change":"2024-09-10T23:17:53.544501+0000","last_active":"2024-09-10T23:17:55.478272+0000","last_peered":"2024-09-10T23:17:55.478272+0000","last_clean":"2024-09-10T23:17:55.478272+0000","last_became_active":"2024-09-10T23:17:53.544244+0000","last_became_peered":"2024-09-10T23:17:53.544244+0000","last_unstale":"2024-09-10T23:17:55.478272+0000","last_undegraded":"2024-09-10T23:17:55.478272+0000","last_fullsized":"2024-09-10T23:17:55.478272+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:46.501299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572678+0000","last_change":"2024-09-10T23:17:52.567737+0000","last_active":"2024-09-10T23:17:52.572678+0000","last_peered":"2024-09-10T23:17:52.572678+0000","last_clean":"2024-09-10T23:17:52.572678+0000","last_became_active":"2024-09-10T23:17:52.567475+0000","last_became_peered":"2024-09-10T23:17:52.567475+0000","last_unstale":"2024-09-10T23:17:52.572678+0000","last_undegraded":"2024-09-10T23:17:52.572678+0000","last_fullsized":"2024-09-10T23:17:52.572678+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:43.747947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541868+0000","last_change":"2024-09-10T23:17:53.553734+0000","last_active":"2024-09-10T23:17:54.541868+0000","last_peered":"2024-09-10T23:17:54.541868+0000","last_clean":"2024-09-10T23:17:54.541868+0000","last_became_active":"2024-09-10T23:17:53.553335+0000","last_became_peered":"2024-09-10T23:17:53.553335+0000","last_unstale":"2024-09-10T23:17:54.541868+0000","last_undegraded":"2024-09-10T23:17:54.541868+0000","last_fullsized":"2024-09-10T23:17:54.541868+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:36.528978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477455+0000","last_change":"2024-09-10T23:17:52.573013+0000","last_active":"2024-09-10T23:17:55.477455+0000","last_peered":"2024-09-10T23:17:55.477455+0000","last_clean":"2024-09-10T23:17:55.477455+0000","last_became_active":"2024-09-10T23:17:52.572803+0000","last_became_peered":"2024-09-10T23:17:52.572803+0000","last_unstale":"2024-09-10T23:17:55.477455+0000","last_undegraded":"2024-09-10T23:17:55.477455+0000","last_fullsized":"2024-09-10T23:17:55.477455+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:11.857169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477450+0000","last_change":"2024-09-10T23:17:53.559140+0000","last_active":"2024-09-10T23:17:55.477450+0000","last_peered":"2024-09-10T23:17:55.477450+0000","last_clean":"2024-09-10T23:17:55.477450+0000","last_became_active":"2024-09-10T23:17:53.558865+0000","last_became_peered":"2024-09-10T23:17:53.558865+0000","last_unstale":"2024-09-10T23:17:55.477450+0000","last_undegraded":"2024-09-10T23:17:55.477450+0000","last_fullsized":"2024-09-10T23:17:55.477450+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:30.481697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572832+0000","last_change":"2024-09-10T23:17:52.568443+0000","last_active":"2024-09-10T23:17:52.572832+0000","last_peered":"2024-09-10T23:17:52.572832+0000","last_clean":"2024-09-10T23:17:52.572832+0000","last_became_active":"2024-09-10T23:17:52.568203+0000","last_became_peered":"2024-09-10T23:17:52.568203+0000","last_unstale":"2024-09-10T23:17:52.572832+0000","last_undegraded":"2024-09-10T23:17:52.572832+0000","last_fullsized":"2024-09-10T23:17:52.572832+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:36.731524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541077+0000","last_change":"2024-09-10T23:17:53.560547+0000","last_active":"2024-09-10T23:17:54.541077+0000","last_peered":"2024-09-10T23:17:54.541077+0000","last_clean":"2024-09-10T23:17:54.541077+0000","last_became_active":"2024-09-10T23:17:53.560260+0000","last_became_peered":"2024-09-10T23:17:53.560260+0000","last_unstale":"2024-09-10T23:17:54.541077+0000","last_undegraded":"2024-09-10T23:17:54.541077+0000","last_fullsized":"2024-09-10T23:17:54.541077+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:02.968645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572783+0000","last_change":"2024-09-10T23:17:52.568272+0000","last_active":"2024-09-10T23:17:52.572783+0000","last_peered":"2024-09-10T23:17:52.572783+0000","last_clean":"2024-09-10T23:17:52.572783+0000","last_became_active":"2024-09-10T23:17:52.567941+0000","last_became_peered":"2024-09-10T23:17:52.567941+0000","last_unstale":"2024-09-10T23:17:52.572783+0000","last_undegraded":"2024-09-10T23:17:52.572783+0000","last_fullsized":"2024-09-10T23:17:52.572783+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:52.125614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540931+0000","last_change":"2024-09-10T23:17:53.555155+0000","last_active":"2024-09-10T23:17:54.540931+0000","last_peered":"2024-09-10T23:17:54.540931+0000","last_clean":"2024-09-10T23:17:54.540931+0000","last_became_active":"2024-09-10T23:17:53.554877+0000","last_became_peered":"2024-09-10T23:17:53.554877+0000","last_unstale":"2024-09-10T23:17:54.540931+0000","last_undegraded":"2024-09-10T23:17:54.540931+0000","last_fullsized":"2024-09-10T23:17:54.540931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:08.979105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477954+0000","last_change":"2024-09-10T23:17:52.570450+0000","last_active":"2024-09-10T23:17:55.477954+0000","last_peered":"2024-09-10T23:17:55.477954+0000","last_clean":"2024-09-10T23:17:55.477954+0000","last_became_active":"2024-09-10T23:17:52.570182+0000","last_became_peered":"2024-09-10T23:17:52.570182+0000","last_unstale":"2024-09-10T23:17:55.477954+0000","last_undegraded":"2024-09-10T23:17:55.477954+0000","last_fullsized":"2024-09-10T23:17:55.477954+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:20.967251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477601+0000","last_change":"2024-09-10T23:17:53.552719+0000","last_active":"2024-09-10T23:17:55.477601+0000","last_peered":"2024-09-10T23:17:55.477601+0000","last_clean":"2024-09-10T23:17:55.477601+0000","last_became_active":"2024-09-10T23:17:53.552447+0000","last_became_peered":"2024-09-10T23:17:53.552447+0000","last_unstale":"2024-09-10T23:17:55.477601+0000","last_undegraded":"2024-09-10T23:17:55.477601+0000","last_fullsized":"2024-09-10T23:17:55.477601+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:16.073355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.577849+0000","last_change":"2024-09-10T23:17:52.572229+0000","last_active":"2024-09-10T23:17:52.577849+0000","last_peered":"2024-09-10T23:17:52.577849+0000","last_clean":"2024-09-10T23:17:52.577849+0000","last_became_active":"2024-09-10T23:17:52.571988+0000","last_became_peered":"2024-09-10T23:17:52.571988+0000","last_unstale":"2024-09-10T23:17:52.577849+0000","last_undegraded":"2024-09-10T23:17:52.577849+0000","last_fullsized":"2024-09-10T23:17:52.577849+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:32.280575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541603+0000","last_change":"2024-09-10T23:17:53.560055+0000","last_active":"2024-09-10T23:17:54.541603+0000","last_peered":"2024-09-10T23:17:54.541603+0000","last_clean":"2024-09-10T23:17:54.541603+0000","last_became_active":"2024-09-10T23:17:53.559593+0000","last_became_peered":"2024-09-10T23:17:53.559593+0000","last_unstale":"2024-09-10T23:17:54.541603+0000","last_undegraded":"2024-09-10T23:17:54.541603+0000","last_fullsized":"2024-09-10T23:17:54.541603+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:56.948906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477390+0000","last_change":"2024-09-10T23:17:52.572129+0000","last_active":"2024-09-10T23:17:55.477390+0000","last_peered":"2024-09-10T23:17:55.477390+0000","last_clean":"2024-09-10T23:17:55.477390+0000","last_became_active":"2024-09-10T23:17:52.571852+0000","last_became_peered":"2024-09-10T23:17:52.571852+0000","last_unstale":"2024-09-10T23:17:55.477390+0000","last_undegraded":"2024-09-10T23:17:55.477390+0000","last_fullsized":"2024-09-10T23:17:55.477390+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:25.388962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540659+0000","last_change":"2024-09-10T23:17:53.563186+0000","last_active":"2024-09-10T23:17:54.540659+0000","last_peered":"2024-09-10T23:17:54.540659+0000","last_clean":"2024-09-10T23:17:54.540659+0000","last_became_active":"2024-09-10T23:17:53.562911+0000","last_became_peered":"2024-09-10T23:17:53.562911+0000","last_unstale":"2024-09-10T23:17:54.540659+0000","last_undegraded":"2024-09-10T23:17:54.540659+0000","last_fullsized":"2024-09-10T23:17:54.540659+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:57.998079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478408+0000","last_change":"2024-09-10T23:17:52.570474+0000","last_active":"2024-09-10T23:17:55.478408+0000","last_peered":"2024-09-10T23:17:55.478408+0000","last_clean":"2024-09-10T23:17:55.478408+0000","last_became_active":"2024-09-10T23:17:52.570229+0000","last_became_peered":"2024-09-10T23:17:52.570229+0000","last_unstale":"2024-09-10T23:17:55.478408+0000","last_undegraded":"2024-09-10T23:17:55.478408+0000","last_fullsized":"2024-09-10T23:17:55.478408+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:45.686357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560511+0000","last_change":"2024-09-10T23:17:52.560511+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560511+0000","last_undegraded":"2024-09-10T23:17:52.560511+0000","last_fullsized":"2024-09-10T23:17:52.560511+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477566+0000","last_change":"2024-09-10T23:17:52.571527+0000","last_active":"2024-09-10T23:17:55.477566+0000","last_peered":"2024-09-10T23:17:55.477566+0000","last_clean":"2024-09-10T23:17:55.477566+0000","last_became_active":"2024-09-10T23:17:52.570946+0000","last_became_peered":"2024-09-10T23:17:52.570946+0000","last_unstale":"2024-09-10T23:17:55.477566+0000","last_undegraded":"2024-09-10T23:17:55.477566+0000","last_fullsized":"2024-09-10T23:17:55.477566+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:20.824122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541493+0000","last_change":"2024-09-10T23:17:53.556628+0000","last_active":"2024-09-10T23:17:54.541493+0000","last_peered":"2024-09-10T23:17:54.541493+0000","last_clean":"2024-09-10T23:17:54.541493+0000","last_became_active":"2024-09-10T23:17:53.556314+0000","last_became_peered":"2024-09-10T23:17:53.556314+0000","last_unstale":"2024-09-10T23:17:54.541493+0000","last_undegraded":"2024-09-10T23:17:54.541493+0000","last_fullsized":"2024-09-10T23:17:54.541493+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:45.780193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541619+0000","last_change":"2024-09-10T23:17:52.565643+0000","last_active":"2024-09-10T23:17:54.541619+0000","last_peered":"2024-09-10T23:17:54.541619+0000","last_clean":"2024-09-10T23:17:54.541619+0000","last_became_active":"2024-09-10T23:17:52.565379+0000","last_became_peered":"2024-09-10T23:17:52.565379+0000","last_unstale":"2024-09-10T23:17:54.541619+0000","last_undegraded":"2024-09-10T23:17:54.541619+0000","last_fullsized":"2024-09-10T23:17:54.541619+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:28.775557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478303+0000","last_change":"2024-09-10T23:17:53.556574+0000","last_active":"2024-09-10T23:17:55.478303+0000","last_peered":"2024-09-10T23:17:55.478303+0000","last_clean":"2024-09-10T23:17:55.478303+0000","last_became_active":"2024-09-10T23:17:53.556314+0000","last_became_peered":"2024-09-10T23:17:53.556314+0000","last_unstale":"2024-09-10T23:17:55.478303+0000","last_undegraded":"2024-09-10T23:17:55.478303+0000","last_fullsized":"2024-09-10T23:17:55.478303+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:36.485396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"91'3","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478090+0000","last_change":"2024-09-10T23:17:52.569674+0000","last_active":"2024-09-10T23:17:55.478090+0000","last_peered":"2024-09-10T23:17:55.478090+0000","last_clean":"2024-09-10T23:17:55.478090+0000","last_became_active":"2024-09-10T23:17:52.569405+0000","last_became_peered":"2024-09-10T23:17:52.569405+0000","last_unstale":"2024-09-10T23:17:55.478090+0000","last_undegraded":"2024-09-10T23:17:55.478090+0000","last_fullsized":"2024-09-10T23:17:55.478090+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:54.496199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477866+0000","last_change":"2024-09-10T23:17:53.551292+0000","last_active":"2024-09-10T23:17:55.477866+0000","last_peered":"2024-09-10T23:17:55.477866+0000","last_clean":"2024-09-10T23:17:55.477866+0000","last_became_active":"2024-09-10T23:17:53.550916+0000","last_became_peered":"2024-09-10T23:17:53.550916+0000","last_unstale":"2024-09-10T23:17:55.477866+0000","last_undegraded":"2024-09-10T23:17:55.477866+0000","last_fullsized":"2024-09-10T23:17:55.477866+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:39.164979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"91'6","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541301+0000","last_change":"2024-09-10T23:17:52.568133+0000","last_active":"2024-09-10T23:17:54.541301+0000","last_peered":"2024-09-10T23:17:54.541301+0000","last_clean":"2024-09-10T23:17:54.541301+0000","last_became_active":"2024-09-10T23:17:52.567833+0000","last_became_peered":"2024-09-10T23:17:52.567833+0000","last_unstale":"2024-09-10T23:17:54.541301+0000","last_undegraded":"2024-09-10T23:17:54.541301+0000","last_fullsized":"2024-09-10T23:17:54.541301+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:33.259359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541656+0000","last_change":"2024-09-10T23:17:53.555595+0000","last_active":"2024-09-10T23:17:54.541656+0000","last_peered":"2024-09-10T23:17:54.541656+0000","last_clean":"2024-09-10T23:17:54.541656+0000","last_became_active":"2024-09-10T23:17:53.555336+0000","last_became_peered":"2024-09-10T23:17:53.555336+0000","last_unstale":"2024-09-10T23:17:54.541656+0000","last_undegraded":"2024-09-10T23:17:54.541656+0000","last_fullsized":"2024-09-10T23:17:54.541656+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:34.435158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477939+0000","last_change":"2024-09-10T23:17:52.575370+0000","last_active":"2024-09-10T23:17:55.477939+0000","last_peered":"2024-09-10T23:17:55.477939+0000","last_clean":"2024-09-10T23:17:55.477939+0000","last_became_active":"2024-09-10T23:17:52.575116+0000","last_became_peered":"2024-09-10T23:17:52.575116+0000","last_unstale":"2024-09-10T23:17:55.477939+0000","last_undegraded":"2024-09-10T23:17:55.477939+0000","last_fullsized":"2024-09-10T23:17:55.477939+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:47.723623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477917+0000","last_change":"2024-09-10T23:17:53.557083+0000","last_active":"2024-09-10T23:17:55.477917+0000","last_peered":"2024-09-10T23:17:55.477917+0000","last_clean":"2024-09-10T23:17:55.477917+0000","last_became_active":"2024-09-10T23:17:53.556330+0000","last_became_peered":"2024-09-10T23:17:53.556330+0000","last_unstale":"2024-09-10T23:17:55.477917+0000","last_undegraded":"2024-09-10T23:17:55.477917+0000","last_fullsized":"2024-09-10T23:17:55.477917+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:25.335933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478310+0000","last_change":"2024-09-10T23:17:52.570569+0000","last_active":"2024-09-10T23:17:55.478310+0000","last_peered":"2024-09-10T23:17:55.478310+0000","last_clean":"2024-09-10T23:17:55.478310+0000","last_became_active":"2024-09-10T23:17:52.570266+0000","last_became_peered":"2024-09-10T23:17:52.570266+0000","last_unstale":"2024-09-10T23:17:55.478310+0000","last_undegraded":"2024-09-10T23:17:55.478310+0000","last_fullsized":"2024-09-10T23:17:55.478310+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:11.558545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540387+0000","last_change":"2024-09-10T23:17:53.557358+0000","last_active":"2024-09-10T23:17:54.540387+0000","last_peered":"2024-09-10T23:17:54.540387+0000","last_clean":"2024-09-10T23:17:54.540387+0000","last_became_active":"2024-09-10T23:17:53.557053+0000","last_became_peered":"2024-09-10T23:17:53.557053+0000","last_unstale":"2024-09-10T23:17:54.540387+0000","last_undegraded":"2024-09-10T23:17:54.540387+0000","last_fullsized":"2024-09-10T23:17:54.540387+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:55.181222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540720+0000","last_change":"2024-09-10T23:17:52.566896+0000","last_active":"2024-09-10T23:17:54.540720+0000","last_peered":"2024-09-10T23:17:54.540720+0000","last_clean":"2024-09-10T23:17:54.540720+0000","last_became_active":"2024-09-10T23:17:52.566614+0000","last_became_peered":"2024-09-10T23:17:52.566614+0000","last_unstale":"2024-09-10T23:17:54.540720+0000","last_undegraded":"2024-09-10T23:17:54.540720+0000","last_fullsized":"2024-09-10T23:17:54.540720+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:44.749574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477408+0000","last_change":"2024-09-10T23:17:53.554939+0000","last_active":"2024-09-10T23:17:55.477408+0000","last_peered":"2024-09-10T23:17:55.477408+0000","last_clean":"2024-09-10T23:17:55.477408+0000","last_became_active":"2024-09-10T23:17:53.554628+0000","last_became_peered":"2024-09-10T23:17:53.554628+0000","last_unstale":"2024-09-10T23:17:55.477408+0000","last_undegraded":"2024-09-10T23:17:55.477408+0000","last_fullsized":"2024-09-10T23:17:55.477408+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:17:48.513922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"91'8","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478414+0000","last_change":"2024-09-10T23:17:52.572070+0000","last_active":"2024-09-10T23:17:55.478414+0000","last_peered":"2024-09-10T23:17:55.478414+0000","last_clean":"2024-09-10T23:17:55.478414+0000","last_became_active":"2024-09-10T23:17:52.570996+0000","last_became_peered":"2024-09-10T23:17:52.570996+0000","last_unstale":"2024-09-10T23:17:55.478414+0000","last_undegraded":"2024-09-10T23:17:55.478414+0000","last_fullsized":"2024-09-10T23:17:55.478414+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:41.583773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478481+0000","last_change":"2024-09-10T23:17:53.558187+0000","last_active":"2024-09-10T23:17:55.478481+0000","last_peered":"2024-09-10T23:17:55.478481+0000","last_clean":"2024-09-10T23:17:55.478481+0000","last_became_active":"2024-09-10T23:17:53.557822+0000","last_became_peered":"2024-09-10T23:17:53.557822+0000","last_unstale":"2024-09-10T23:17:55.478481+0000","last_undegraded":"2024-09-10T23:17:55.478481+0000","last_fullsized":"2024-09-10T23:17:55.478481+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:56.948906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540894+0000","last_change":"2024-09-10T23:17:52.576217+0000","last_active":"2024-09-10T23:17:54.540894+0000","last_peered":"2024-09-10T23:17:54.540894+0000","last_clean":"2024-09-10T23:17:54.540894+0000","last_became_active":"2024-09-10T23:17:52.575912+0000","last_became_peered":"2024-09-10T23:17:52.575912+0000","last_unstale":"2024-09-10T23:17:54.540894+0000","last_undegraded":"2024-09-10T23:17:54.540894+0000","last_fullsized":"2024-09-10T23:17:54.540894+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:09.495386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540997+0000","last_change":"2024-09-10T23:17:53.553565+0000","last_active":"2024-09-10T23:17:54.540997+0000","last_peered":"2024-09-10T23:17:54.540997+0000","last_clean":"2024-09-10T23:17:54.540997+0000","last_became_active":"2024-09-10T23:17:53.553303+0000","last_became_peered":"2024-09-10T23:17:53.553303+0000","last_unstale":"2024-09-10T23:17:54.540997+0000","last_undegraded":"2024-09-10T23:17:54.540997+0000","last_fullsized":"2024-09-10T23:17:54.540997+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:21.604281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478159+0000","last_change":"2024-09-10T23:17:52.564087+0000","last_active":"2024-09-10T23:17:55.478159+0000","last_peered":"2024-09-10T23:17:55.478159+0000","last_clean":"2024-09-10T23:17:55.478159+0000","last_became_active":"2024-09-10T23:17:52.563797+0000","last_became_peered":"2024-09-10T23:17:52.563797+0000","last_unstale":"2024-09-10T23:17:55.478159+0000","last_undegraded":"2024-09-10T23:17:55.478159+0000","last_fullsized":"2024-09-10T23:17:55.478159+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:02.781778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477966+0000","last_change":"2024-09-10T23:17:53.554719+0000","last_active":"2024-09-10T23:17:55.477966+0000","last_peered":"2024-09-10T23:17:55.477966+0000","last_clean":"2024-09-10T23:17:55.477966+0000","last_became_active":"2024-09-10T23:17:53.554460+0000","last_became_peered":"2024-09-10T23:17:53.554460+0000","last_unstale":"2024-09-10T23:17:55.477966+0000","last_undegraded":"2024-09-10T23:17:55.477966+0000","last_fullsized":"2024-09-10T23:17:55.477966+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:52.272283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572500+0000","last_change":"2024-09-10T23:17:52.566947+0000","last_active":"2024-09-10T23:17:52.572500+0000","last_peered":"2024-09-10T23:17:52.572500+0000","last_clean":"2024-09-10T23:17:52.572500+0000","last_became_active":"2024-09-10T23:17:52.566704+0000","last_became_peered":"2024-09-10T23:17:52.566704+0000","last_unstale":"2024-09-10T23:17:52.572500+0000","last_undegraded":"2024-09-10T23:17:52.572500+0000","last_fullsized":"2024-09-10T23:17:52.572500+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:58.125611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478178+0000","last_change":"2024-09-10T23:17:53.551313+0000","last_active":"2024-09-10T23:17:55.478178+0000","last_peered":"2024-09-10T23:17:55.478178+0000","last_clean":"2024-09-10T23:17:55.478178+0000","last_became_active":"2024-09-10T23:17:53.550774+0000","last_became_peered":"2024-09-10T23:17:53.550774+0000","last_unstale":"2024-09-10T23:17:55.478178+0000","last_undegraded":"2024-09-10T23:17:55.478178+0000","last_fullsized":"2024-09-10T23:17:55.478178+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:33.555549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.580764+0000","last_change":"2024-09-10T23:17:52.575545+0000","last_active":"2024-09-10T23:17:52.580764+0000","last_peered":"2024-09-10T23:17:52.580764+0000","last_clean":"2024-09-10T23:17:52.580764+0000","last_became_active":"2024-09-10T23:17:52.575282+0000","last_became_peered":"2024-09-10T23:17:52.575282+0000","last_unstale":"2024-09-10T23:17:52.580764+0000","last_undegraded":"2024-09-10T23:17:52.580764+0000","last_fullsized":"2024-09-10T23:17:52.580764+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:52.940489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477947+0000","last_change":"2024-09-10T23:17:53.548656+0000","last_active":"2024-09-10T23:17:55.477947+0000","last_peered":"2024-09-10T23:17:55.477947+0000","last_clean":"2024-09-10T23:17:55.477947+0000","last_became_active":"2024-09-10T23:17:53.548388+0000","last_became_peered":"2024-09-10T23:17:53.548388+0000","last_unstale":"2024-09-10T23:17:55.477947+0000","last_undegraded":"2024-09-10T23:17:55.477947+0000","last_fullsized":"2024-09-10T23:17:55.477947+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:57.483201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541095+0000","last_change":"2024-09-10T23:17:52.569306+0000","last_active":"2024-09-10T23:17:54.541095+0000","last_peered":"2024-09-10T23:17:54.541095+0000","last_clean":"2024-09-10T23:17:54.541095+0000","last_became_active":"2024-09-10T23:17:52.569038+0000","last_became_peered":"2024-09-10T23:17:52.569038+0000","last_unstale":"2024-09-10T23:17:54.541095+0000","last_undegraded":"2024-09-10T23:17:54.541095+0000","last_fullsized":"2024-09-10T23:17:54.541095+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:34.625142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477680+0000","last_change":"2024-09-10T23:17:53.550802+0000","last_active":"2024-09-10T23:17:55.477680+0000","last_peered":"2024-09-10T23:17:55.477680+0000","last_clean":"2024-09-10T23:17:55.477680+0000","last_became_active":"2024-09-10T23:17:53.550519+0000","last_became_peered":"2024-09-10T23:17:53.550519+0000","last_unstale":"2024-09-10T23:17:55.477680+0000","last_undegraded":"2024-09-10T23:17:55.477680+0000","last_fullsized":"2024-09-10T23:17:55.477680+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:25.004260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540279+0000","last_change":"2024-09-10T23:17:52.570230+0000","last_active":"2024-09-10T23:17:54.540279+0000","last_peered":"2024-09-10T23:17:54.540279+0000","last_clean":"2024-09-10T23:17:54.540279+0000","last_became_active":"2024-09-10T23:17:52.569918+0000","last_became_peered":"2024-09-10T23:17:52.569918+0000","last_unstale":"2024-09-10T23:17:54.540279+0000","last_undegraded":"2024-09-10T23:17:54.540279+0000","last_fullsized":"2024-09-10T23:17:54.540279+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:38.853089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477272+0000","last_change":"2024-09-10T23:17:53.566019+0000","last_active":"2024-09-10T23:17:55.477272+0000","last_peered":"2024-09-10T23:17:55.477272+0000","last_clean":"2024-09-10T23:17:55.477272+0000","last_became_active":"2024-09-10T23:17:53.565331+0000","last_became_peered":"2024-09-10T23:17:53.565331+0000","last_unstale":"2024-09-10T23:17:55.477272+0000","last_undegraded":"2024-09-10T23:17:55.477272+0000","last_fullsized":"2024-09-10T23:17:55.477272+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:55.497871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.575313+0000","last_change":"2024-09-10T23:17:52.571701+0000","last_active":"2024-09-10T23:17:52.575313+0000","last_peered":"2024-09-10T23:17:52.575313+0000","last_clean":"2024-09-10T23:17:52.575313+0000","last_became_active":"2024-09-10T23:17:52.571455+0000","last_became_peered":"2024-09-10T23:17:52.571455+0000","last_unstale":"2024-09-10T23:17:52.575313+0000","last_undegraded":"2024-09-10T23:17:52.575313+0000","last_fullsized":"2024-09-10T23:17:52.575313+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:38.467005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560136+0000","last_change":"2024-09-10T23:17:52.560136+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560136+0000","last_undegraded":"2024-09-10T23:17:52.560136+0000","last_fullsized":"2024-09-10T23:17:52.560136+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541581+0000","last_change":"2024-09-10T23:17:52.566757+0000","last_active":"2024-09-10T23:17:54.541581+0000","last_peered":"2024-09-10T23:17:54.541581+0000","last_clean":"2024-09-10T23:17:54.541581+0000","last_became_active":"2024-09-10T23:17:52.566440+0000","last_became_peered":"2024-09-10T23:17:52.566440+0000","last_unstale":"2024-09-10T23:17:54.541581+0000","last_undegraded":"2024-09-10T23:17:54.541581+0000","last_fullsized":"2024-09-10T23:17:54.541581+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:14.026848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477479+0000","last_change":"2024-09-10T23:17:53.560579+0000","last_active":"2024-09-10T23:17:55.477479+0000","last_peered":"2024-09-10T23:17:55.477479+0000","last_clean":"2024-09-10T23:17:55.477479+0000","last_became_active":"2024-09-10T23:17:53.560328+0000","last_became_peered":"2024-09-10T23:17:53.560328+0000","last_unstale":"2024-09-10T23:17:55.477479+0000","last_undegraded":"2024-09-10T23:17:55.477479+0000","last_fullsized":"2024-09-10T23:17:55.477479+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:09.110684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572809+0000","last_change":"2024-09-10T23:17:52.569086+0000","last_active":"2024-09-10T23:17:52.572809+0000","last_peered":"2024-09-10T23:17:52.572809+0000","last_clean":"2024-09-10T23:17:52.572809+0000","last_became_active":"2024-09-10T23:17:52.568848+0000","last_became_peered":"2024-09-10T23:17:52.568848+0000","last_unstale":"2024-09-10T23:17:52.572809+0000","last_undegraded":"2024-09-10T23:17:52.572809+0000","last_fullsized":"2024-09-10T23:17:52.572809+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:33.695089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477633+0000","last_change":"2024-09-10T23:17:53.557393+0000","last_active":"2024-09-10T23:17:55.477633+0000","last_peered":"2024-09-10T23:17:55.477633+0000","last_clean":"2024-09-10T23:17:55.477633+0000","last_became_active":"2024-09-10T23:17:53.556251+0000","last_became_peered":"2024-09-10T23:17:53.556251+0000","last_unstale":"2024-09-10T23:17:55.477633+0000","last_undegraded":"2024-09-10T23:17:55.477633+0000","last_fullsized":"2024-09-10T23:17:55.477633+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:57.307923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.575071+0000","last_change":"2024-09-10T23:17:52.570424+0000","last_active":"2024-09-10T23:17:52.575071+0000","last_peered":"2024-09-10T23:17:52.575071+0000","last_clean":"2024-09-10T23:17:52.575071+0000","last_became_active":"2024-09-10T23:17:52.570165+0000","last_became_peered":"2024-09-10T23:17:52.570165+0000","last_unstale":"2024-09-10T23:17:52.575071+0000","last_undegraded":"2024-09-10T23:17:52.575071+0000","last_fullsized":"2024-09-10T23:17:52.575071+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:08.811918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477645+0000","last_change":"2024-09-10T23:17:53.564128+0000","last_active":"2024-09-10T23:17:55.477645+0000","last_peered":"2024-09-10T23:17:55.477645+0000","last_clean":"2024-09-10T23:17:55.477645+0000","last_became_active":"2024-09-10T23:17:53.563904+0000","last_became_peered":"2024-09-10T23:17:53.563904+0000","last_unstale":"2024-09-10T23:17:55.477645+0000","last_undegraded":"2024-09-10T23:17:55.477645+0000","last_fullsized":"2024-09-10T23:17:55.477645+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:25.531536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478432+0000","last_change":"2024-09-10T23:17:52.566701+0000","last_active":"2024-09-10T23:17:55.478432+0000","last_peered":"2024-09-10T23:17:55.478432+0000","last_clean":"2024-09-10T23:17:55.478432+0000","last_became_active":"2024-09-10T23:17:52.566074+0000","last_became_peered":"2024-09-10T23:17:52.566074+0000","last_unstale":"2024-09-10T23:17:55.478432+0000","last_undegraded":"2024-09-10T23:17:55.478432+0000","last_fullsized":"2024-09-10T23:17:55.478432+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:20.781641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478386+0000","last_change":"2024-09-10T23:17:53.557300+0000","last_active":"2024-09-10T23:17:55.478386+0000","last_peered":"2024-09-10T23:17:55.478386+0000","last_clean":"2024-09-10T23:17:55.478386+0000","last_became_active":"2024-09-10T23:17:53.556997+0000","last_became_peered":"2024-09-10T23:17:53.556997+0000","last_unstale":"2024-09-10T23:17:55.478386+0000","last_undegraded":"2024-09-10T23:17:55.478386+0000","last_fullsized":"2024-09-10T23:17:55.478386+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:12.740294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.575016+0000","last_change":"2024-09-10T23:17:52.569372+0000","last_active":"2024-09-10T23:17:52.575016+0000","last_peered":"2024-09-10T23:17:52.575016+0000","last_clean":"2024-09-10T23:17:52.575016+0000","last_became_active":"2024-09-10T23:17:52.569138+0000","last_became_peered":"2024-09-10T23:17:52.569138+0000","last_unstale":"2024-09-10T23:17:52.575016+0000","last_undegraded":"2024-09-10T23:17:52.575016+0000","last_fullsized":"2024-09-10T23:17:52.575016+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:19.835444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540543+0000","last_change":"2024-09-10T23:17:53.553407+0000","last_active":"2024-09-10T23:17:54.540543+0000","last_peered":"2024-09-10T23:17:54.540543+0000","last_clean":"2024-09-10T23:17:54.540543+0000","last_became_active":"2024-09-10T23:17:53.553115+0000","last_became_peered":"2024-09-10T23:17:53.553115+0000","last_unstale":"2024-09-10T23:17:54.540543+0000","last_undegraded":"2024-09-10T23:17:54.540543+0000","last_fullsized":"2024-09-10T23:17:54.540543+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:09.097652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477705+0000","last_change":"2024-09-10T23:17:52.568101+0000","last_active":"2024-09-10T23:17:55.477705+0000","last_peered":"2024-09-10T23:17:55.477705+0000","last_clean":"2024-09-10T23:17:55.477705+0000","last_became_active":"2024-09-10T23:17:52.567822+0000","last_became_peered":"2024-09-10T23:17:52.567822+0000","last_unstale":"2024-09-10T23:17:55.477705+0000","last_undegraded":"2024-09-10T23:17:55.477705+0000","last_fullsized":"2024-09-10T23:17:55.477705+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:01.850714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477722+0000","last_change":"2024-09-10T23:17:53.554947+0000","last_active":"2024-09-10T23:17:55.477722+0000","last_peered":"2024-09-10T23:17:55.477722+0000","last_clean":"2024-09-10T23:17:55.477722+0000","last_became_active":"2024-09-10T23:17:53.554642+0000","last_became_peered":"2024-09-10T23:17:53.554642+0000","last_unstale":"2024-09-10T23:17:55.477722+0000","last_undegraded":"2024-09-10T23:17:55.477722+0000","last_fullsized":"2024-09-10T23:17:55.477722+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:17.947754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541905+0000","last_change":"2024-09-10T23:17:52.569265+0000","last_active":"2024-09-10T23:17:54.541905+0000","last_peered":"2024-09-10T23:17:54.541905+0000","last_clean":"2024-09-10T23:17:54.541905+0000","last_became_active":"2024-09-10T23:17:52.569021+0000","last_became_peered":"2024-09-10T23:17:52.569021+0000","last_unstale":"2024-09-10T23:17:54.541905+0000","last_undegraded":"2024-09-10T23:17:54.541905+0000","last_fullsized":"2024-09-10T23:17:54.541905+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:37:36.066729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477301+0000","last_change":"2024-09-10T23:17:53.561543+0000","last_active":"2024-09-10T23:17:55.477301+0000","last_peered":"2024-09-10T23:17:55.477301+0000","last_clean":"2024-09-10T23:17:55.477301+0000","last_became_active":"2024-09-10T23:17:53.561264+0000","last_became_peered":"2024-09-10T23:17:53.561264+0000","last_unstale":"2024-09-10T23:17:55.477301+0000","last_undegraded":"2024-09-10T23:17:55.477301+0000","last_fullsized":"2024-09-10T23:17:55.477301+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:52.661481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477776+0000","last_change":"2024-09-10T23:17:52.573386+0000","last_active":"2024-09-10T23:17:55.477776+0000","last_peered":"2024-09-10T23:17:55.477776+0000","last_clean":"2024-09-10T23:17:55.477776+0000","last_became_active":"2024-09-10T23:17:52.573120+0000","last_became_peered":"2024-09-10T23:17:52.573120+0000","last_unstale":"2024-09-10T23:17:55.477776+0000","last_undegraded":"2024-09-10T23:17:55.477776+0000","last_fullsized":"2024-09-10T23:17:55.477776+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:06.971289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478299+0000","last_change":"2024-09-10T23:17:53.550292+0000","last_active":"2024-09-10T23:17:55.478299+0000","last_peered":"2024-09-10T23:17:55.478299+0000","last_clean":"2024-09-10T23:17:55.478299+0000","last_became_active":"2024-09-10T23:17:53.550026+0000","last_became_peered":"2024-09-10T23:17:53.550026+0000","last_unstale":"2024-09-10T23:17:55.478299+0000","last_undegraded":"2024-09-10T23:17:55.478299+0000","last_fullsized":"2024-09-10T23:17:55.478299+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:54.395956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477575+0000","last_change":"2024-09-10T23:17:52.569598+0000","last_active":"2024-09-10T23:17:55.477575+0000","last_peered":"2024-09-10T23:17:55.477575+0000","last_clean":"2024-09-10T23:17:55.477575+0000","last_became_active":"2024-09-10T23:17:52.569310+0000","last_became_peered":"2024-09-10T23:17:52.569310+0000","last_unstale":"2024-09-10T23:17:55.477575+0000","last_undegraded":"2024-09-10T23:17:55.477575+0000","last_fullsized":"2024-09-10T23:17:55.477575+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:58.550027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":236,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477703+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:17:55.477703+0000","last_peered":"2024-09-10T23:17:55.477703+0000","last_clean":"2024-09-10T23:17:55.477703+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:17:55.477703+0000","last_undegraded":"2024-09-10T23:17:55.477703+0000","last_fullsized":"2024-09-10T23:17:55.477703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28720,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343120,"statfs":{"total":96636764160,"available":96607354880,"internally_reserved":0,"allocated":1720320,"data_stored":1061912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1126400,"data_stored":472084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509485,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1134592,"data_stored":477802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1150976,"data_stored":479468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1146880,"data_stored":479366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1122304,"data_stored":471466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1118208,"data_stored":471432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32860,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338980,"statfs":{"total":96636764160,"available":96603115520,"internally_reserved":0,"allocated":1699840,"data_stored":1055025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:17:56.841 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:17:56.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.977+0000 7f927fc18640 1 -- 172.21.15.90:0/3208358497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f927806fc60 msgr2=0x7f92780cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.977+0000 7f927fc18640 1 --2- 172.21.15.90:0/3208358497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f927806fc60 0x7f92780cdfd0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f927806dfb0 tx=0x7f927002a530 comp rx=0 tx=0).stop 2024-09-10T23:17:56.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.977+0000 7f927fc18640 1 -- 172.21.15.90:0/3208358497 shutdown_connections 2024-09-10T23:17:56.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.977+0000 7f927fc18640 1 --2- 172.21.15.90:0/3208358497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f927806fc60 0x7f92780cdfd0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.977+0000 7f927fc18640 1 --2- 172.21.15.90:0/3208358497 >> v2:172.21.15.171:3300/0 conn(0x7f927815f750 0x7f9278073de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.977+0000 7f927fc18640 1 -- 172.21.15.90:0/3208358497 >> 172.21.15.90:0/3208358497 conn(0x7f92780b19c0 msgr2=0x7f92780b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:56.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.977+0000 7f927fc18640 1 -- 172.21.15.90:0/3208358497 shutdown_connections 2024-09-10T23:17:56.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.977+0000 7f927fc18640 1 -- 172.21.15.90:0/3208358497 wait complete. 2024-09-10T23:17:56.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.978+0000 7f927fc18640 1 Processor -- start 2024-09-10T23:17:56.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.978+0000 7f927fc18640 1 -- start start 2024-09-10T23:17:56.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.979+0000 7f927fc18640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f927806fc60 0x7f927814e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:56.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.979+0000 7f927fc18640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92780cdb90 0x7f927815a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:56.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.979+0000 7f927fc18640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f927815f750 0x7f927815ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:56.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.979+0000 7f927fc18640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f92780cc9f0 con 0x7f927806fc60 2024-09-10T23:17:56.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.979+0000 7f927fc18640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f92780cc870 con 0x7f927815f750 2024-09-10T23:17:56.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.979+0000 7f927fc18640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f92780ccb70 con 0x7f92780cdb90 2024-09-10T23:17:56.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.979+0000 7f927d9b4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f927806fc60 0x7f927814e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:56.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.979+0000 7f927d9b4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f927806fc60 0x7f927814e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48394/0 (socket says 172.21.15.90:48394) 2024-09-10T23:17:56.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.979+0000 7f927d9b4640 1 -- 172.21.15.90:0/2715241907 learned_addr learned my addr 172.21.15.90:0/2715241907 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:56.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.979+0000 7f927e1b5640 1 --2- 172.21.15.90:0/2715241907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f927815f750 0x7f927815ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:56.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.979+0000 7f927d1b3640 1 --2- 172.21.15.90:0/2715241907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92780cdb90 0x7f927815a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:56.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.980+0000 7f927d9b4640 1 -- 172.21.15.90:0/2715241907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92780cdb90 msgr2=0x7f927815a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.980+0000 7f927d9b4640 1 --2- 172.21.15.90:0/2715241907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92780cdb90 0x7f927815a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.980+0000 7f927d9b4640 1 -- 172.21.15.90:0/2715241907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f927815f750 msgr2=0x7f927815ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:56.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.980+0000 7f927d9b4640 1 --2- 172.21.15.90:0/2715241907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f927815f750 0x7f927815ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:56.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.980+0000 7f927d9b4640 1 -- 172.21.15.90:0/2715241907 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92780b2ef0 con 0x7f927806fc60 2024-09-10T23:17:56.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.980+0000 7f927e1b5640 1 --2- 172.21.15.90:0/2715241907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f927815f750 0x7f927815ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:56.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.980+0000 7f927d1b3640 1 --2- 172.21.15.90:0/2715241907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92780cdb90 0x7f927815a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:17:56.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.980+0000 7f927d9b4640 1 --2- 172.21.15.90:0/2715241907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f927806fc60 0x7f927814e540 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f926800dac0 tx=0x7f926800df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:56.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.980+0000 7f92767fc640 1 -- 172.21.15.90:0/2715241907 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9268017070 con 0x7f927806fc60 2024-09-10T23:17:56.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.980+0000 7f92767fc640 1 -- 172.21.15.90:0/2715241907 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9268003970 con 0x7f927806fc60 2024-09-10T23:17:56.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.980+0000 7f927fc18640 1 -- 172.21.15.90:0/2715241907 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92780b31d0 con 0x7f927806fc60 2024-09-10T23:17:56.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.980+0000 7f92767fc640 1 -- 172.21.15.90:0/2715241907 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9268003dc0 con 0x7f927806fc60 2024-09-10T23:17:56.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.980+0000 7f927fc18640 1 -- 172.21.15.90:0/2715241907 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92780b3790 con 0x7f927806fc60 2024-09-10T23:17:56.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.981+0000 7f927fc18640 1 -- 172.21.15.90:0/2715241907 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92780cd100 con 0x7f927806fc60 2024-09-10T23:17:56.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.981+0000 7f92767fc640 1 -- 172.21.15.90:0/2715241907 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9268004020 con 0x7f927806fc60 2024-09-10T23:17:56.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.982+0000 7f92767fc640 1 --2- 172.21.15.90:0/2715241907 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9264077f70 0x7f926407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:56.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.982+0000 7f92767fc640 1 -- 172.21.15.90:0/2715241907 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f926809a450 con 0x7f927806fc60 2024-09-10T23:17:56.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.982+0000 7f927d1b3640 1 --2- 172.21.15.90:0/2715241907 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9264077f70 0x7f926407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:56.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.983+0000 7f927d1b3640 1 --2- 172.21.15.90:0/2715241907 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9264077f70 0x7f926407a430 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f927809ded0 tx=0x7f926c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:56.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:56.986+0000 7f92767fc640 1 -- 172.21.15.90:0/2715241907 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9268020030 con 0x7f927806fc60 2024-09-10T23:17:57.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.158+0000 7f927fc18640 1 -- 172.21.15.90:0/2715241907 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f92780cc1f0 con 0x7f9264077f70 2024-09-10T23:17:57.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.162+0000 7f92767fc640 1 -- 172.21.15.90:0/2715241907 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251324 (secure 0 0 0) 0x7f92780cc1f0 con 0x7f9264077f70 2024-09-10T23:17:57.169 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:57.171 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:17:57.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.165+0000 7f927fc18640 1 -- 172.21.15.90:0/2715241907 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9264077f70 msgr2=0x7f926407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:57.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.165+0000 7f927fc18640 1 --2- 172.21.15.90:0/2715241907 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9264077f70 0x7f926407a430 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f927809ded0 tx=0x7f926c009040 comp rx=0 tx=0).stop 2024-09-10T23:17:57.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.165+0000 7f927fc18640 1 -- 172.21.15.90:0/2715241907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f927806fc60 msgr2=0x7f927814e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:57.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.165+0000 7f927fc18640 1 --2- 172.21.15.90:0/2715241907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f927806fc60 0x7f927814e540 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f926800dac0 tx=0x7f926800df80 comp rx=0 tx=0).stop 2024-09-10T23:17:57.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.165+0000 7f927fc18640 1 -- 172.21.15.90:0/2715241907 shutdown_connections 2024-09-10T23:17:57.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.165+0000 7f927fc18640 1 --2- 172.21.15.90:0/2715241907 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9264077f70 0x7f926407a430 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.165+0000 7f927fc18640 1 --2- 172.21.15.90:0/2715241907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f927815f750 0x7f927815ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.165+0000 7f927fc18640 1 --2- 172.21.15.90:0/2715241907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92780cdb90 0x7f927815a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.165+0000 7f927fc18640 1 --2- 172.21.15.90:0/2715241907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f927806fc60 0x7f927814e540 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.165+0000 7f927fc18640 1 -- 172.21.15.90:0/2715241907 >> 172.21.15.90:0/2715241907 conn(0x7f92780b19c0 msgr2=0x7f92780b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:57.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.165+0000 7f927fc18640 1 -- 172.21.15.90:0/2715241907 shutdown_connections 2024-09-10T23:17:57.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.165+0000 7f927fc18640 1 -- 172.21.15.90:0/2715241907 wait complete. 2024-09-10T23:17:57.177 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-09-10T23:17:56.482333+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255372,"kb_used_data":9980,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719348,"statfs":{"total":773094113280,"available":772832612352,"internally_reserved":0,"allocated":10219520,"data_stored":4968555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.935747"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477298+0000","last_change":"2024-09-10T23:17:53.560279+0000","last_active":"2024-09-10T23:17:55.477298+0000","last_peered":"2024-09-10T23:17:55.477298+0000","last_clean":"2024-09-10T23:17:55.477298+0000","last_became_active":"2024-09-10T23:17:53.556589+0000","last_became_peered":"2024-09-10T23:17:53.556589+0000","last_unstale":"2024-09-10T23:17:55.477298+0000","last_undegraded":"2024-09-10T23:17:55.477298+0000","last_fullsized":"2024-09-10T23:17:55.477298+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:20.124209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.562100+0000","last_change":"2024-09-10T23:17:52.562100+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.562100+0000","last_undegraded":"2024-09-10T23:17:52.562100+0000","last_fullsized":"2024-09-10T23:17:52.562100+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477747+0000","last_change":"2024-09-10T23:17:53.556897+0000","last_active":"2024-09-10T23:17:55.477747+0000","last_peered":"2024-09-10T23:17:55.477747+0000","last_clean":"2024-09-10T23:17:55.477747+0000","last_became_active":"2024-09-10T23:17:53.556564+0000","last_became_peered":"2024-09-10T23:17:53.556564+0000","last_unstale":"2024-09-10T23:17:55.477747+0000","last_undegraded":"2024-09-10T23:17:55.477747+0000","last_fullsized":"2024-09-10T23:17:55.477747+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:32.013618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541845+0000","last_change":"2024-09-10T23:17:53.554128+0000","last_active":"2024-09-10T23:17:54.541845+0000","last_peered":"2024-09-10T23:17:54.541845+0000","last_clean":"2024-09-10T23:17:54.541845+0000","last_became_active":"2024-09-10T23:17:53.553837+0000","last_became_peered":"2024-09-10T23:17:53.553837+0000","last_unstale":"2024-09-10T23:17:54.541845+0000","last_undegraded":"2024-09-10T23:17:54.541845+0000","last_fullsized":"2024-09-10T23:17:54.541845+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:16.073355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478024+0000","last_change":"2024-09-10T23:17:53.561325+0000","last_active":"2024-09-10T23:17:55.478024+0000","last_peered":"2024-09-10T23:17:55.478024+0000","last_clean":"2024-09-10T23:17:55.478024+0000","last_became_active":"2024-09-10T23:17:53.561035+0000","last_became_peered":"2024-09-10T23:17:53.561035+0000","last_unstale":"2024-09-10T23:17:55.478024+0000","last_undegraded":"2024-09-10T23:17:55.478024+0000","last_fullsized":"2024-09-10T23:17:55.478024+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:05.151677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477659+0000","last_change":"2024-09-10T23:17:53.547173+0000","last_active":"2024-09-10T23:17:55.477659+0000","last_peered":"2024-09-10T23:17:55.477659+0000","last_clean":"2024-09-10T23:17:55.477659+0000","last_became_active":"2024-09-10T23:17:53.546924+0000","last_became_peered":"2024-09-10T23:17:53.546924+0000","last_unstale":"2024-09-10T23:17:55.477659+0000","last_undegraded":"2024-09-10T23:17:55.477659+0000","last_fullsized":"2024-09-10T23:17:55.477659+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:36.528978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477648+0000","last_change":"2024-09-10T23:17:53.544392+0000","last_active":"2024-09-10T23:17:55.477648+0000","last_peered":"2024-09-10T23:17:55.477648+0000","last_clean":"2024-09-10T23:17:55.477648+0000","last_became_active":"2024-09-10T23:17:53.544080+0000","last_became_peered":"2024-09-10T23:17:53.544080+0000","last_unstale":"2024-09-10T23:17:55.477648+0000","last_undegraded":"2024-09-10T23:17:55.477648+0000","last_fullsized":"2024-09-10T23:17:55.477648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:33.836216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.561234+0000","last_change":"2024-09-10T23:17:52.561234+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.561234+0000","last_undegraded":"2024-09-10T23:17:52.561234+0000","last_fullsized":"2024-09-10T23:17:52.561234+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541325+0000","last_change":"2024-09-10T23:17:53.560387+0000","last_active":"2024-09-10T23:17:54.541325+0000","last_peered":"2024-09-10T23:17:54.541325+0000","last_clean":"2024-09-10T23:17:54.541325+0000","last_became_active":"2024-09-10T23:17:53.560096+0000","last_became_peered":"2024-09-10T23:17:53.560096+0000","last_unstale":"2024-09-10T23:17:54.541325+0000","last_undegraded":"2024-09-10T23:17:54.541325+0000","last_fullsized":"2024-09-10T23:17:54.541325+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:33:38.997089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477837+0000","last_change":"2024-09-10T23:17:53.565740+0000","last_active":"2024-09-10T23:17:55.477837+0000","last_peered":"2024-09-10T23:17:55.477837+0000","last_clean":"2024-09-10T23:17:55.477837+0000","last_became_active":"2024-09-10T23:17:53.565440+0000","last_became_peered":"2024-09-10T23:17:53.565440+0000","last_unstale":"2024-09-10T23:17:55.477837+0000","last_undegraded":"2024-09-10T23:17:55.477837+0000","last_fullsized":"2024-09-10T23:17:55.477837+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:27.057119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477721+0000","last_change":"2024-09-10T23:17:53.555393+0000","last_active":"2024-09-10T23:17:55.477721+0000","last_peered":"2024-09-10T23:17:55.477721+0000","last_clean":"2024-09-10T23:17:55.477721+0000","last_became_active":"2024-09-10T23:17:53.555122+0000","last_became_peered":"2024-09-10T23:17:53.555122+0000","last_unstale":"2024-09-10T23:17:55.477721+0000","last_undegraded":"2024-09-10T23:17:55.477721+0000","last_fullsized":"2024-09-10T23:17:55.477721+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:29.522521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541083+0000","last_change":"2024-09-10T23:17:53.560808+0000","last_active":"2024-09-10T23:17:54.541083+0000","last_peered":"2024-09-10T23:17:54.541083+0000","last_clean":"2024-09-10T23:17:54.541083+0000","last_became_active":"2024-09-10T23:17:53.560407+0000","last_became_peered":"2024-09-10T23:17:53.560407+0000","last_unstale":"2024-09-10T23:17:54.541083+0000","last_undegraded":"2024-09-10T23:17:54.541083+0000","last_fullsized":"2024-09-10T23:17:54.541083+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:27.057119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541860+0000","last_change":"2024-09-10T23:17:53.557682+0000","last_active":"2024-09-10T23:17:54.541860+0000","last_peered":"2024-09-10T23:17:54.541860+0000","last_clean":"2024-09-10T23:17:54.541860+0000","last_became_active":"2024-09-10T23:17:53.557417+0000","last_became_peered":"2024-09-10T23:17:53.557417+0000","last_unstale":"2024-09-10T23:17:54.541860+0000","last_undegraded":"2024-09-10T23:17:54.541860+0000","last_fullsized":"2024-09-10T23:17:54.541860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:46.228987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477985+0000","last_change":"2024-09-10T23:17:53.552624+0000","last_active":"2024-09-10T23:17:55.477985+0000","last_peered":"2024-09-10T23:17:55.477985+0000","last_clean":"2024-09-10T23:17:55.477985+0000","last_became_active":"2024-09-10T23:17:53.552371+0000","last_became_peered":"2024-09-10T23:17:53.552371+0000","last_unstale":"2024-09-10T23:17:55.477985+0000","last_undegraded":"2024-09-10T23:17:55.477985+0000","last_fullsized":"2024-09-10T23:17:55.477985+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:45.051857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541808+0000","last_change":"2024-09-10T23:17:53.559674+0000","last_active":"2024-09-10T23:17:54.541808+0000","last_peered":"2024-09-10T23:17:54.541808+0000","last_clean":"2024-09-10T23:17:54.541808+0000","last_became_active":"2024-09-10T23:17:53.559392+0000","last_became_peered":"2024-09-10T23:17:53.559392+0000","last_unstale":"2024-09-10T23:17:54.541808+0000","last_undegraded":"2024-09-10T23:17:54.541808+0000","last_fullsized":"2024-09-10T23:17:54.541808+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:33.836216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477893+0000","last_change":"2024-09-10T23:17:53.548614+0000","last_active":"2024-09-10T23:17:55.477893+0000","last_peered":"2024-09-10T23:17:55.477893+0000","last_clean":"2024-09-10T23:17:55.477893+0000","last_became_active":"2024-09-10T23:17:53.548291+0000","last_became_peered":"2024-09-10T23:17:53.548291+0000","last_unstale":"2024-09-10T23:17:55.477893+0000","last_undegraded":"2024-09-10T23:17:55.477893+0000","last_fullsized":"2024-09-10T23:17:55.477893+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:23.095017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560750+0000","last_change":"2024-09-10T23:17:52.560750+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560750+0000","last_undegraded":"2024-09-10T23:17:52.560750+0000","last_fullsized":"2024-09-10T23:17:52.560750+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541749+0000","last_change":"2024-09-10T23:17:53.554180+0000","last_active":"2024-09-10T23:17:54.541749+0000","last_peered":"2024-09-10T23:17:54.541749+0000","last_clean":"2024-09-10T23:17:54.541749+0000","last_became_active":"2024-09-10T23:17:53.553901+0000","last_became_peered":"2024-09-10T23:17:53.553901+0000","last_unstale":"2024-09-10T23:17:54.541749+0000","last_undegraded":"2024-09-10T23:17:54.541749+0000","last_fullsized":"2024-09-10T23:17:54.541749+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:34.087388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477219+0000","last_change":"2024-09-10T23:17:53.557802+0000","last_active":"2024-09-10T23:17:55.477219+0000","last_peered":"2024-09-10T23:17:55.477219+0000","last_clean":"2024-09-10T23:17:55.477219+0000","last_became_active":"2024-09-10T23:17:53.557537+0000","last_became_peered":"2024-09-10T23:17:53.557537+0000","last_unstale":"2024-09-10T23:17:55.477219+0000","last_undegraded":"2024-09-10T23:17:55.477219+0000","last_fullsized":"2024-09-10T23:17:55.477219+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:07.646491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541143+0000","last_change":"2024-09-10T23:17:53.561436+0000","last_active":"2024-09-10T23:17:54.541143+0000","last_peered":"2024-09-10T23:17:54.541143+0000","last_clean":"2024-09-10T23:17:54.541143+0000","last_became_active":"2024-09-10T23:17:53.561173+0000","last_became_peered":"2024-09-10T23:17:53.561173+0000","last_unstale":"2024-09-10T23:17:54.541143+0000","last_undegraded":"2024-09-10T23:17:54.541143+0000","last_fullsized":"2024-09-10T23:17:54.541143+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:19:38.295347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477755+0000","last_change":"2024-09-10T23:17:53.545062+0000","last_active":"2024-09-10T23:17:55.477755+0000","last_peered":"2024-09-10T23:17:55.477755+0000","last_clean":"2024-09-10T23:17:55.477755+0000","last_became_active":"2024-09-10T23:17:53.544797+0000","last_became_peered":"2024-09-10T23:17:53.544797+0000","last_unstale":"2024-09-10T23:17:55.477755+0000","last_undegraded":"2024-09-10T23:17:55.477755+0000","last_fullsized":"2024-09-10T23:17:55.477755+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:31.712561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560460+0000","last_change":"2024-09-10T23:17:52.560460+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560460+0000","last_undegraded":"2024-09-10T23:17:52.560460+0000","last_fullsized":"2024-09-10T23:17:52.560460+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.558847+0000","last_change":"2024-09-10T23:17:52.558847+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.558847+0000","last_undegraded":"2024-09-10T23:17:52.558847+0000","last_fullsized":"2024-09-10T23:17:52.558847+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477630+0000","last_change":"2024-09-10T23:17:53.560079+0000","last_active":"2024-09-10T23:17:55.477630+0000","last_peered":"2024-09-10T23:17:55.477630+0000","last_clean":"2024-09-10T23:17:55.477630+0000","last_became_active":"2024-09-10T23:17:53.559507+0000","last_became_peered":"2024-09-10T23:17:53.559507+0000","last_unstale":"2024-09-10T23:17:55.477630+0000","last_undegraded":"2024-09-10T23:17:55.477630+0000","last_fullsized":"2024-09-10T23:17:55.477630+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:51.603445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478504+0000","last_change":"2024-09-10T23:17:53.563818+0000","last_active":"2024-09-10T23:17:55.478504+0000","last_peered":"2024-09-10T23:17:55.478504+0000","last_clean":"2024-09-10T23:17:55.478504+0000","last_became_active":"2024-09-10T23:17:53.563533+0000","last_became_peered":"2024-09-10T23:17:53.563533+0000","last_unstale":"2024-09-10T23:17:55.478504+0000","last_undegraded":"2024-09-10T23:17:55.478504+0000","last_fullsized":"2024-09-10T23:17:55.478504+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:34.435158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560995+0000","last_change":"2024-09-10T23:17:52.560995+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560995+0000","last_undegraded":"2024-09-10T23:17:52.560995+0000","last_fullsized":"2024-09-10T23:17:52.560995+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478026+0000","last_change":"2024-09-10T23:17:53.551936+0000","last_active":"2024-09-10T23:17:55.478026+0000","last_peered":"2024-09-10T23:17:55.478026+0000","last_clean":"2024-09-10T23:17:55.478026+0000","last_became_active":"2024-09-10T23:17:53.550713+0000","last_became_peered":"2024-09-10T23:17:53.550713+0000","last_unstale":"2024-09-10T23:17:55.478026+0000","last_undegraded":"2024-09-10T23:17:55.478026+0000","last_fullsized":"2024-09-10T23:17:55.478026+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:49.704662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478330+0000","last_change":"2024-09-10T23:17:53.560875+0000","last_active":"2024-09-10T23:17:55.478330+0000","last_peered":"2024-09-10T23:17:55.478330+0000","last_clean":"2024-09-10T23:17:55.478330+0000","last_became_active":"2024-09-10T23:17:53.560567+0000","last_became_peered":"2024-09-10T23:17:53.560567+0000","last_unstale":"2024-09-10T23:17:55.478330+0000","last_undegraded":"2024-09-10T23:17:55.478330+0000","last_fullsized":"2024-09-10T23:17:55.478330+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:31.501371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.559679+0000","last_change":"2024-09-10T23:17:52.559679+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.559679+0000","last_undegraded":"2024-09-10T23:17:52.559679+0000","last_fullsized":"2024-09-10T23:17:52.559679+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478167+0000","last_change":"2024-09-10T23:17:53.558562+0000","last_active":"2024-09-10T23:17:55.478167+0000","last_peered":"2024-09-10T23:17:55.478167+0000","last_clean":"2024-09-10T23:17:55.478167+0000","last_became_active":"2024-09-10T23:17:53.558327+0000","last_became_peered":"2024-09-10T23:17:53.558327+0000","last_unstale":"2024-09-10T23:17:55.478167+0000","last_undegraded":"2024-09-10T23:17:55.478167+0000","last_fullsized":"2024-09-10T23:17:55.478167+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:41.417295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541843+0000","last_change":"2024-09-10T23:17:53.554219+0000","last_active":"2024-09-10T23:17:54.541843+0000","last_peered":"2024-09-10T23:17:54.541843+0000","last_clean":"2024-09-10T23:17:54.541843+0000","last_became_active":"2024-09-10T23:17:53.553751+0000","last_became_peered":"2024-09-10T23:17:53.553751+0000","last_unstale":"2024-09-10T23:17:54.541843+0000","last_undegraded":"2024-09-10T23:17:54.541843+0000","last_fullsized":"2024-09-10T23:17:54.541843+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:08.996959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478297+0000","last_change":"2024-09-10T23:17:53.556628+0000","last_active":"2024-09-10T23:17:55.478297+0000","last_peered":"2024-09-10T23:17:55.478297+0000","last_clean":"2024-09-10T23:17:55.478297+0000","last_became_active":"2024-09-10T23:17:53.556310+0000","last_became_peered":"2024-09-10T23:17:53.556310+0000","last_unstale":"2024-09-10T23:17:55.478297+0000","last_undegraded":"2024-09-10T23:17:55.478297+0000","last_fullsized":"2024-09-10T23:17:55.478297+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:39.854761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478272+0000","last_change":"2024-09-10T23:17:53.544501+0000","last_active":"2024-09-10T23:17:55.478272+0000","last_peered":"2024-09-10T23:17:55.478272+0000","last_clean":"2024-09-10T23:17:55.478272+0000","last_became_active":"2024-09-10T23:17:53.544244+0000","last_became_peered":"2024-09-10T23:17:53.544244+0000","last_unstale":"2024-09-10T23:17:55.478272+0000","last_undegraded":"2024-09-10T23:17:55.478272+0000","last_fullsized":"2024-09-10T23:17:55.478272+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:46.501299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572678+0000","last_change":"2024-09-10T23:17:52.567737+0000","last_active":"2024-09-10T23:17:52.572678+0000","last_peered":"2024-09-10T23:17:52.572678+0000","last_clean":"2024-09-10T23:17:52.572678+0000","last_became_active":"2024-09-10T23:17:52.567475+0000","last_became_peered":"2024-09-10T23:17:52.567475+0000","last_unstale":"2024-09-10T23:17:52.572678+0000","last_undegraded":"2024-09-10T23:17:52.572678+0000","last_fullsized":"2024-09-10T23:17:52.572678+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:43.747947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541868+0000","last_change":"2024-09-10T23:17:53.553734+0000","last_active":"2024-09-10T23:17:54.541868+0000","last_peered":"2024-09-10T23:17:54.541868+0000","last_clean":"2024-09-10T23:17:54.541868+0000","last_became_active":"2024-09-10T23:17:53.553335+0000","last_became_peered":"2024-09-10T23:17:53.553335+0000","last_unstale":"2024-09-10T23:17:54.541868+0000","last_undegraded":"2024-09-10T23:17:54.541868+0000","last_fullsized":"2024-09-10T23:17:54.541868+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:36.528978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477455+0000","last_change":"2024-09-10T23:17:52.573013+0000","last_active":"2024-09-10T23:17:55.477455+0000","last_peered":"2024-09-10T23:17:55.477455+0000","last_clean":"2024-09-10T23:17:55.477455+0000","last_became_active":"2024-09-10T23:17:52.572803+0000","last_became_peered":"2024-09-10T23:17:52.572803+0000","last_unstale":"2024-09-10T23:17:55.477455+0000","last_undegraded":"2024-09-10T23:17:55.477455+0000","last_fullsized":"2024-09-10T23:17:55.477455+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:11.857169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477450+0000","last_change":"2024-09-10T23:17:53.559140+0000","last_active":"2024-09-10T23:17:55.477450+0000","last_peered":"2024-09-10T23:17:55.477450+0000","last_clean":"2024-09-10T23:17:55.477450+0000","last_became_active":"2024-09-10T23:17:53.558865+0000","last_became_peered":"2024-09-10T23:17:53.558865+0000","last_unstale":"2024-09-10T23:17:55.477450+0000","last_undegraded":"2024-09-10T23:17:55.477450+0000","last_fullsized":"2024-09-10T23:17:55.477450+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:30.481697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572832+0000","last_change":"2024-09-10T23:17:52.568443+0000","last_active":"2024-09-10T23:17:52.572832+0000","last_peered":"2024-09-10T23:17:52.572832+0000","last_clean":"2024-09-10T23:17:52.572832+0000","last_became_active":"2024-09-10T23:17:52.568203+0000","last_became_peered":"2024-09-10T23:17:52.568203+0000","last_unstale":"2024-09-10T23:17:52.572832+0000","last_undegraded":"2024-09-10T23:17:52.572832+0000","last_fullsized":"2024-09-10T23:17:52.572832+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:36.731524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541077+0000","last_change":"2024-09-10T23:17:53.560547+0000","last_active":"2024-09-10T23:17:54.541077+0000","last_peered":"2024-09-10T23:17:54.541077+0000","last_clean":"2024-09-10T23:17:54.541077+0000","last_became_active":"2024-09-10T23:17:53.560260+0000","last_became_peered":"2024-09-10T23:17:53.560260+0000","last_unstale":"2024-09-10T23:17:54.541077+0000","last_undegraded":"2024-09-10T23:17:54.541077+0000","last_fullsized":"2024-09-10T23:17:54.541077+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:02.968645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572783+0000","last_change":"2024-09-10T23:17:52.568272+0000","last_active":"2024-09-10T23:17:52.572783+0000","last_peered":"2024-09-10T23:17:52.572783+0000","last_clean":"2024-09-10T23:17:52.572783+0000","last_became_active":"2024-09-10T23:17:52.567941+0000","last_became_peered":"2024-09-10T23:17:52.567941+0000","last_unstale":"2024-09-10T23:17:52.572783+0000","last_undegraded":"2024-09-10T23:17:52.572783+0000","last_fullsized":"2024-09-10T23:17:52.572783+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:52.125614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540931+0000","last_change":"2024-09-10T23:17:53.555155+0000","last_active":"2024-09-10T23:17:54.540931+0000","last_peered":"2024-09-10T23:17:54.540931+0000","last_clean":"2024-09-10T23:17:54.540931+0000","last_became_active":"2024-09-10T23:17:53.554877+0000","last_became_peered":"2024-09-10T23:17:53.554877+0000","last_unstale":"2024-09-10T23:17:54.540931+0000","last_undegraded":"2024-09-10T23:17:54.540931+0000","last_fullsized":"2024-09-10T23:17:54.540931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:08.979105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477954+0000","last_change":"2024-09-10T23:17:52.570450+0000","last_active":"2024-09-10T23:17:55.477954+0000","last_peered":"2024-09-10T23:17:55.477954+0000","last_clean":"2024-09-10T23:17:55.477954+0000","last_became_active":"2024-09-10T23:17:52.570182+0000","last_became_peered":"2024-09-10T23:17:52.570182+0000","last_unstale":"2024-09-10T23:17:55.477954+0000","last_undegraded":"2024-09-10T23:17:55.477954+0000","last_fullsized":"2024-09-10T23:17:55.477954+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:20.967251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477601+0000","last_change":"2024-09-10T23:17:53.552719+0000","last_active":"2024-09-10T23:17:55.477601+0000","last_peered":"2024-09-10T23:17:55.477601+0000","last_clean":"2024-09-10T23:17:55.477601+0000","last_became_active":"2024-09-10T23:17:53.552447+0000","last_became_peered":"2024-09-10T23:17:53.552447+0000","last_unstale":"2024-09-10T23:17:55.477601+0000","last_undegraded":"2024-09-10T23:17:55.477601+0000","last_fullsized":"2024-09-10T23:17:55.477601+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:16.073355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.577849+0000","last_change":"2024-09-10T23:17:52.572229+0000","last_active":"2024-09-10T23:17:52.577849+0000","last_peered":"2024-09-10T23:17:52.577849+0000","last_clean":"2024-09-10T23:17:52.577849+0000","last_became_active":"2024-09-10T23:17:52.571988+0000","last_became_peered":"2024-09-10T23:17:52.571988+0000","last_unstale":"2024-09-10T23:17:52.577849+0000","last_undegraded":"2024-09-10T23:17:52.577849+0000","last_fullsized":"2024-09-10T23:17:52.577849+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:32.280575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541603+0000","last_change":"2024-09-10T23:17:53.560055+0000","last_active":"2024-09-10T23:17:54.541603+0000","last_peered":"2024-09-10T23:17:54.541603+0000","last_clean":"2024-09-10T23:17:54.541603+0000","last_became_active":"2024-09-10T23:17:53.559593+0000","last_became_peered":"2024-09-10T23:17:53.559593+0000","last_unstale":"2024-09-10T23:17:54.541603+0000","last_undegraded":"2024-09-10T23:17:54.541603+0000","last_fullsized":"2024-09-10T23:17:54.541603+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:56.948906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477390+0000","last_change":"2024-09-10T23:17:52.572129+0000","last_active":"2024-09-10T23:17:55.477390+0000","last_peered":"2024-09-10T23:17:55.477390+0000","last_clean":"2024-09-10T23:17:55.477390+0000","last_became_active":"2024-09-10T23:17:52.571852+0000","last_became_peered":"2024-09-10T23:17:52.571852+0000","last_unstale":"2024-09-10T23:17:55.477390+0000","last_undegraded":"2024-09-10T23:17:55.477390+0000","last_fullsized":"2024-09-10T23:17:55.477390+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:25.388962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540659+0000","last_change":"2024-09-10T23:17:53.563186+0000","last_active":"2024-09-10T23:17:54.540659+0000","last_peered":"2024-09-10T23:17:54.540659+0000","last_clean":"2024-09-10T23:17:54.540659+0000","last_became_active":"2024-09-10T23:17:53.562911+0000","last_became_peered":"2024-09-10T23:17:53.562911+0000","last_unstale":"2024-09-10T23:17:54.540659+0000","last_undegraded":"2024-09-10T23:17:54.540659+0000","last_fullsized":"2024-09-10T23:17:54.540659+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:57.998079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478408+0000","last_change":"2024-09-10T23:17:52.570474+0000","last_active":"2024-09-10T23:17:55.478408+0000","last_peered":"2024-09-10T23:17:55.478408+0000","last_clean":"2024-09-10T23:17:55.478408+0000","last_became_active":"2024-09-10T23:17:52.570229+0000","last_became_peered":"2024-09-10T23:17:52.570229+0000","last_unstale":"2024-09-10T23:17:55.478408+0000","last_undegraded":"2024-09-10T23:17:55.478408+0000","last_fullsized":"2024-09-10T23:17:55.478408+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:45.686357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560511+0000","last_change":"2024-09-10T23:17:52.560511+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560511+0000","last_undegraded":"2024-09-10T23:17:52.560511+0000","last_fullsized":"2024-09-10T23:17:52.560511+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477566+0000","last_change":"2024-09-10T23:17:52.571527+0000","last_active":"2024-09-10T23:17:55.477566+0000","last_peered":"2024-09-10T23:17:55.477566+0000","last_clean":"2024-09-10T23:17:55.477566+0000","last_became_active":"2024-09-10T23:17:52.570946+0000","last_became_peered":"2024-09-10T23:17:52.570946+0000","last_unstale":"2024-09-10T23:17:55.477566+0000","last_undegraded":"2024-09-10T23:17:55.477566+0000","last_fullsized":"2024-09-10T23:17:55.477566+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:20.824122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541493+0000","last_change":"2024-09-10T23:17:53.556628+0000","last_active":"2024-09-10T23:17:54.541493+0000","last_peered":"2024-09-10T23:17:54.541493+0000","last_clean":"2024-09-10T23:17:54.541493+0000","last_became_active":"2024-09-10T23:17:53.556314+0000","last_became_peered":"2024-09-10T23:17:53.556314+0000","last_unstale":"2024-09-10T23:17:54.541493+0000","last_undegraded":"2024-09-10T23:17:54.541493+0000","last_fullsized":"2024-09-10T23:17:54.541493+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:45.780193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541619+0000","last_change":"2024-09-10T23:17:52.565643+0000","last_active":"2024-09-10T23:17:54.541619+0000","last_peered":"2024-09-10T23:17:54.541619+0000","last_clean":"2024-09-10T23:17:54.541619+0000","last_became_active":"2024-09-10T23:17:52.565379+0000","last_became_peered":"2024-09-10T23:17:52.565379+0000","last_unstale":"2024-09-10T23:17:54.541619+0000","last_undegraded":"2024-09-10T23:17:54.541619+0000","last_fullsized":"2024-09-10T23:17:54.541619+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:28.775557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478303+0000","last_change":"2024-09-10T23:17:53.556574+0000","last_active":"2024-09-10T23:17:55.478303+0000","last_peered":"2024-09-10T23:17:55.478303+0000","last_clean":"2024-09-10T23:17:55.478303+0000","last_became_active":"2024-09-10T23:17:53.556314+0000","last_became_peered":"2024-09-10T23:17:53.556314+0000","last_unstale":"2024-09-10T23:17:55.478303+0000","last_undegraded":"2024-09-10T23:17:55.478303+0000","last_fullsized":"2024-09-10T23:17:55.478303+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:36.485396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"91'3","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478090+0000","last_change":"2024-09-10T23:17:52.569674+0000","last_active":"2024-09-10T23:17:55.478090+0000","last_peered":"2024-09-10T23:17:55.478090+0000","last_clean":"2024-09-10T23:17:55.478090+0000","last_became_active":"2024-09-10T23:17:52.569405+0000","last_became_peered":"2024-09-10T23:17:52.569405+0000","last_unstale":"2024-09-10T23:17:55.478090+0000","last_undegraded":"2024-09-10T23:17:55.478090+0000","last_fullsized":"2024-09-10T23:17:55.478090+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:54.496199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477866+0000","last_change":"2024-09-10T23:17:53.551292+0000","last_active":"2024-09-10T23:17:55.477866+0000","last_peered":"2024-09-10T23:17:55.477866+0000","last_clean":"2024-09-10T23:17:55.477866+0000","last_became_active":"2024-09-10T23:17:53.550916+0000","last_became_peered":"2024-09-10T23:17:53.550916+0000","last_unstale":"2024-09-10T23:17:55.477866+0000","last_undegraded":"2024-09-10T23:17:55.477866+0000","last_fullsized":"2024-09-10T23:17:55.477866+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:39.164979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"91'6","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541301+0000","last_change":"2024-09-10T23:17:52.568133+0000","last_active":"2024-09-10T23:17:54.541301+0000","last_peered":"2024-09-10T23:17:54.541301+0000","last_clean":"2024-09-10T23:17:54.541301+0000","last_became_active":"2024-09-10T23:17:52.567833+0000","last_became_peered":"2024-09-10T23:17:52.567833+0000","last_unstale":"2024-09-10T23:17:54.541301+0000","last_undegraded":"2024-09-10T23:17:54.541301+0000","last_fullsized":"2024-09-10T23:17:54.541301+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:33.259359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541656+0000","last_change":"2024-09-10T23:17:53.555595+0000","last_active":"2024-09-10T23:17:54.541656+0000","last_peered":"2024-09-10T23:17:54.541656+0000","last_clean":"2024-09-10T23:17:54.541656+0000","last_became_active":"2024-09-10T23:17:53.555336+0000","last_became_peered":"2024-09-10T23:17:53.555336+0000","last_unstale":"2024-09-10T23:17:54.541656+0000","last_undegraded":"2024-09-10T23:17:54.541656+0000","last_fullsized":"2024-09-10T23:17:54.541656+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:34.435158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477939+0000","last_change":"2024-09-10T23:17:52.575370+0000","last_active":"2024-09-10T23:17:55.477939+0000","last_peered":"2024-09-10T23:17:55.477939+0000","last_clean":"2024-09-10T23:17:55.477939+0000","last_became_active":"2024-09-10T23:17:52.575116+0000","last_became_peered":"2024-09-10T23:17:52.575116+0000","last_unstale":"2024-09-10T23:17:55.477939+0000","last_undegraded":"2024-09-10T23:17:55.477939+0000","last_fullsized":"2024-09-10T23:17:55.477939+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:47.723623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477917+0000","last_change":"2024-09-10T23:17:53.557083+0000","last_active":"2024-09-10T23:17:55.477917+0000","last_peered":"2024-09-10T23:17:55.477917+0000","last_clean":"2024-09-10T23:17:55.477917+0000","last_became_active":"2024-09-10T23:17:53.556330+0000","last_became_peered":"2024-09-10T23:17:53.556330+0000","last_unstale":"2024-09-10T23:17:55.477917+0000","last_undegraded":"2024-09-10T23:17:55.477917+0000","last_fullsized":"2024-09-10T23:17:55.477917+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:25.335933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478310+0000","last_change":"2024-09-10T23:17:52.570569+0000","last_active":"2024-09-10T23:17:55.478310+0000","last_peered":"2024-09-10T23:17:55.478310+0000","last_clean":"2024-09-10T23:17:55.478310+0000","last_became_active":"2024-09-10T23:17:52.570266+0000","last_became_peered":"2024-09-10T23:17:52.570266+0000","last_unstale":"2024-09-10T23:17:55.478310+0000","last_undegraded":"2024-09-10T23:17:55.478310+0000","last_fullsized":"2024-09-10T23:17:55.478310+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:11.558545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540387+0000","last_change":"2024-09-10T23:17:53.557358+0000","last_active":"2024-09-10T23:17:54.540387+0000","last_peered":"2024-09-10T23:17:54.540387+0000","last_clean":"2024-09-10T23:17:54.540387+0000","last_became_active":"2024-09-10T23:17:53.557053+0000","last_became_peered":"2024-09-10T23:17:53.557053+0000","last_unstale":"2024-09-10T23:17:54.540387+0000","last_undegraded":"2024-09-10T23:17:54.540387+0000","last_fullsized":"2024-09-10T23:17:54.540387+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:55.181222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540720+0000","last_change":"2024-09-10T23:17:52.566896+0000","last_active":"2024-09-10T23:17:54.540720+0000","last_peered":"2024-09-10T23:17:54.540720+0000","last_clean":"2024-09-10T23:17:54.540720+0000","last_became_active":"2024-09-10T23:17:52.566614+0000","last_became_peered":"2024-09-10T23:17:52.566614+0000","last_unstale":"2024-09-10T23:17:54.540720+0000","last_undegraded":"2024-09-10T23:17:54.540720+0000","last_fullsized":"2024-09-10T23:17:54.540720+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:44.749574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477408+0000","last_change":"2024-09-10T23:17:53.554939+0000","last_active":"2024-09-10T23:17:55.477408+0000","last_peered":"2024-09-10T23:17:55.477408+0000","last_clean":"2024-09-10T23:17:55.477408+0000","last_became_active":"2024-09-10T23:17:53.554628+0000","last_became_peered":"2024-09-10T23:17:53.554628+0000","last_unstale":"2024-09-10T23:17:55.477408+0000","last_undegraded":"2024-09-10T23:17:55.477408+0000","last_fullsized":"2024-09-10T23:17:55.477408+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:17:48.513922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"91'8","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478414+0000","last_change":"2024-09-10T23:17:52.572070+0000","last_active":"2024-09-10T23:17:55.478414+0000","last_peered":"2024-09-10T23:17:55.478414+0000","last_clean":"2024-09-10T23:17:55.478414+0000","last_became_active":"2024-09-10T23:17:52.570996+0000","last_became_peered":"2024-09-10T23:17:52.570996+0000","last_unstale":"2024-09-10T23:17:55.478414+0000","last_undegraded":"2024-09-10T23:17:55.478414+0000","last_fullsized":"2024-09-10T23:17:55.478414+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:41.583773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478481+0000","last_change":"2024-09-10T23:17:53.558187+0000","last_active":"2024-09-10T23:17:55.478481+0000","last_peered":"2024-09-10T23:17:55.478481+0000","last_clean":"2024-09-10T23:17:55.478481+0000","last_became_active":"2024-09-10T23:17:53.557822+0000","last_became_peered":"2024-09-10T23:17:53.557822+0000","last_unstale":"2024-09-10T23:17:55.478481+0000","last_undegraded":"2024-09-10T23:17:55.478481+0000","last_fullsized":"2024-09-10T23:17:55.478481+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:56.948906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540894+0000","last_change":"2024-09-10T23:17:52.576217+0000","last_active":"2024-09-10T23:17:54.540894+0000","last_peered":"2024-09-10T23:17:54.540894+0000","last_clean":"2024-09-10T23:17:54.540894+0000","last_became_active":"2024-09-10T23:17:52.575912+0000","last_became_peered":"2024-09-10T23:17:52.575912+0000","last_unstale":"2024-09-10T23:17:54.540894+0000","last_undegraded":"2024-09-10T23:17:54.540894+0000","last_fullsized":"2024-09-10T23:17:54.540894+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:09.495386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540997+0000","last_change":"2024-09-10T23:17:53.553565+0000","last_active":"2024-09-10T23:17:54.540997+0000","last_peered":"2024-09-10T23:17:54.540997+0000","last_clean":"2024-09-10T23:17:54.540997+0000","last_became_active":"2024-09-10T23:17:53.553303+0000","last_became_peered":"2024-09-10T23:17:53.553303+0000","last_unstale":"2024-09-10T23:17:54.540997+0000","last_undegraded":"2024-09-10T23:17:54.540997+0000","last_fullsized":"2024-09-10T23:17:54.540997+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:21.604281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478159+0000","last_change":"2024-09-10T23:17:52.564087+0000","last_active":"2024-09-10T23:17:55.478159+0000","last_peered":"2024-09-10T23:17:55.478159+0000","last_clean":"2024-09-10T23:17:55.478159+0000","last_became_active":"2024-09-10T23:17:52.563797+0000","last_became_peered":"2024-09-10T23:17:52.563797+0000","last_unstale":"2024-09-10T23:17:55.478159+0000","last_undegraded":"2024-09-10T23:17:55.478159+0000","last_fullsized":"2024-09-10T23:17:55.478159+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:02.781778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477966+0000","last_change":"2024-09-10T23:17:53.554719+0000","last_active":"2024-09-10T23:17:55.477966+0000","last_peered":"2024-09-10T23:17:55.477966+0000","last_clean":"2024-09-10T23:17:55.477966+0000","last_became_active":"2024-09-10T23:17:53.554460+0000","last_became_peered":"2024-09-10T23:17:53.554460+0000","last_unstale":"2024-09-10T23:17:55.477966+0000","last_undegraded":"2024-09-10T23:17:55.477966+0000","last_fullsized":"2024-09-10T23:17:55.477966+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:52.272283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572500+0000","last_change":"2024-09-10T23:17:52.566947+0000","last_active":"2024-09-10T23:17:52.572500+0000","last_peered":"2024-09-10T23:17:52.572500+0000","last_clean":"2024-09-10T23:17:52.572500+0000","last_became_active":"2024-09-10T23:17:52.566704+0000","last_became_peered":"2024-09-10T23:17:52.566704+0000","last_unstale":"2024-09-10T23:17:52.572500+0000","last_undegraded":"2024-09-10T23:17:52.572500+0000","last_fullsized":"2024-09-10T23:17:52.572500+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:58.125611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478178+0000","last_change":"2024-09-10T23:17:53.551313+0000","last_active":"2024-09-10T23:17:55.478178+0000","last_peered":"2024-09-10T23:17:55.478178+0000","last_clean":"2024-09-10T23:17:55.478178+0000","last_became_active":"2024-09-10T23:17:53.550774+0000","last_became_peered":"2024-09-10T23:17:53.550774+0000","last_unstale":"2024-09-10T23:17:55.478178+0000","last_undegraded":"2024-09-10T23:17:55.478178+0000","last_fullsized":"2024-09-10T23:17:55.478178+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:33.555549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.580764+0000","last_change":"2024-09-10T23:17:52.575545+0000","last_active":"2024-09-10T23:17:52.580764+0000","last_peered":"2024-09-10T23:17:52.580764+0000","last_clean":"2024-09-10T23:17:52.580764+0000","last_became_active":"2024-09-10T23:17:52.575282+0000","last_became_peered":"2024-09-10T23:17:52.575282+0000","last_unstale":"2024-09-10T23:17:52.580764+0000","last_undegraded":"2024-09-10T23:17:52.580764+0000","last_fullsized":"2024-09-10T23:17:52.580764+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:52.940489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477947+0000","last_change":"2024-09-10T23:17:53.548656+0000","last_active":"2024-09-10T23:17:55.477947+0000","last_peered":"2024-09-10T23:17:55.477947+0000","last_clean":"2024-09-10T23:17:55.477947+0000","last_became_active":"2024-09-10T23:17:53.548388+0000","last_became_peered":"2024-09-10T23:17:53.548388+0000","last_unstale":"2024-09-10T23:17:55.477947+0000","last_undegraded":"2024-09-10T23:17:55.477947+0000","last_fullsized":"2024-09-10T23:17:55.477947+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:57.483201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541095+0000","last_change":"2024-09-10T23:17:52.569306+0000","last_active":"2024-09-10T23:17:54.541095+0000","last_peered":"2024-09-10T23:17:54.541095+0000","last_clean":"2024-09-10T23:17:54.541095+0000","last_became_active":"2024-09-10T23:17:52.569038+0000","last_became_peered":"2024-09-10T23:17:52.569038+0000","last_unstale":"2024-09-10T23:17:54.541095+0000","last_undegraded":"2024-09-10T23:17:54.541095+0000","last_fullsized":"2024-09-10T23:17:54.541095+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:34.625142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477680+0000","last_change":"2024-09-10T23:17:53.550802+0000","last_active":"2024-09-10T23:17:55.477680+0000","last_peered":"2024-09-10T23:17:55.477680+0000","last_clean":"2024-09-10T23:17:55.477680+0000","last_became_active":"2024-09-10T23:17:53.550519+0000","last_became_peered":"2024-09-10T23:17:53.550519+0000","last_unstale":"2024-09-10T23:17:55.477680+0000","last_undegraded":"2024-09-10T23:17:55.477680+0000","last_fullsized":"2024-09-10T23:17:55.477680+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:25.004260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540279+0000","last_change":"2024-09-10T23:17:52.570230+0000","last_active":"2024-09-10T23:17:54.540279+0000","last_peered":"2024-09-10T23:17:54.540279+0000","last_clean":"2024-09-10T23:17:54.540279+0000","last_became_active":"2024-09-10T23:17:52.569918+0000","last_became_peered":"2024-09-10T23:17:52.569918+0000","last_unstale":"2024-09-10T23:17:54.540279+0000","last_undegraded":"2024-09-10T23:17:54.540279+0000","last_fullsized":"2024-09-10T23:17:54.540279+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:38.853089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477272+0000","last_change":"2024-09-10T23:17:53.566019+0000","last_active":"2024-09-10T23:17:55.477272+0000","last_peered":"2024-09-10T23:17:55.477272+0000","last_clean":"2024-09-10T23:17:55.477272+0000","last_became_active":"2024-09-10T23:17:53.565331+0000","last_became_peered":"2024-09-10T23:17:53.565331+0000","last_unstale":"2024-09-10T23:17:55.477272+0000","last_undegraded":"2024-09-10T23:17:55.477272+0000","last_fullsized":"2024-09-10T23:17:55.477272+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:55.497871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.575313+0000","last_change":"2024-09-10T23:17:52.571701+0000","last_active":"2024-09-10T23:17:52.575313+0000","last_peered":"2024-09-10T23:17:52.575313+0000","last_clean":"2024-09-10T23:17:52.575313+0000","last_became_active":"2024-09-10T23:17:52.571455+0000","last_became_peered":"2024-09-10T23:17:52.571455+0000","last_unstale":"2024-09-10T23:17:52.575313+0000","last_undegraded":"2024-09-10T23:17:52.575313+0000","last_fullsized":"2024-09-10T23:17:52.575313+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:38.467005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560136+0000","last_change":"2024-09-10T23:17:52.560136+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560136+0000","last_undegraded":"2024-09-10T23:17:52.560136+0000","last_fullsized":"2024-09-10T23:17:52.560136+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541581+0000","last_change":"2024-09-10T23:17:52.566757+0000","last_active":"2024-09-10T23:17:54.541581+0000","last_peered":"2024-09-10T23:17:54.541581+0000","last_clean":"2024-09-10T23:17:54.541581+0000","last_became_active":"2024-09-10T23:17:52.566440+0000","last_became_peered":"2024-09-10T23:17:52.566440+0000","last_unstale":"2024-09-10T23:17:54.541581+0000","last_undegraded":"2024-09-10T23:17:54.541581+0000","last_fullsized":"2024-09-10T23:17:54.541581+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:14.026848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477479+0000","last_change":"2024-09-10T23:17:53.560579+0000","last_active":"2024-09-10T23:17:55.477479+0000","last_peered":"2024-09-10T23:17:55.477479+0000","last_clean":"2024-09-10T23:17:55.477479+0000","last_became_active":"2024-09-10T23:17:53.560328+0000","last_became_peered":"2024-09-10T23:17:53.560328+0000","last_unstale":"2024-09-10T23:17:55.477479+0000","last_undegraded":"2024-09-10T23:17:55.477479+0000","last_fullsized":"2024-09-10T23:17:55.477479+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:09.110684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572809+0000","last_change":"2024-09-10T23:17:52.569086+0000","last_active":"2024-09-10T23:17:52.572809+0000","last_peered":"2024-09-10T23:17:52.572809+0000","last_clean":"2024-09-10T23:17:52.572809+0000","last_became_active":"2024-09-10T23:17:52.568848+0000","last_became_peered":"2024-09-10T23:17:52.568848+0000","last_unstale":"2024-09-10T23:17:52.572809+0000","last_undegraded":"2024-09-10T23:17:52.572809+0000","last_fullsized":"2024-09-10T23:17:52.572809+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:33.695089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477633+0000","last_change":"2024-09-10T23:17:53.557393+0000","last_active":"2024-09-10T23:17:55.477633+0000","last_peered":"2024-09-10T23:17:55.477633+0000","last_clean":"2024-09-10T23:17:55.477633+0000","last_became_active":"2024-09-10T23:17:53.556251+0000","last_became_peered":"2024-09-10T23:17:53.556251+0000","last_unstale":"2024-09-10T23:17:55.477633+0000","last_undegraded":"2024-09-10T23:17:55.477633+0000","last_fullsized":"2024-09-10T23:17:55.477633+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:57.307923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.575071+0000","last_change":"2024-09-10T23:17:52.570424+0000","last_active":"2024-09-10T23:17:52.575071+0000","last_peered":"2024-09-10T23:17:52.575071+0000","last_clean":"2024-09-10T23:17:52.575071+0000","last_became_active":"2024-09-10T23:17:52.570165+0000","last_became_peered":"2024-09-10T23:17:52.570165+0000","last_unstale":"2024-09-10T23:17:52.575071+0000","last_undegraded":"2024-09-10T23:17:52.575071+0000","last_fullsized":"2024-09-10T23:17:52.575071+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:08.811918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477645+0000","last_change":"2024-09-10T23:17:53.564128+0000","last_active":"2024-09-10T23:17:55.477645+0000","last_peered":"2024-09-10T23:17:55.477645+0000","last_clean":"2024-09-10T23:17:55.477645+0000","last_became_active":"2024-09-10T23:17:53.563904+0000","last_became_peered":"2024-09-10T23:17:53.563904+0000","last_unstale":"2024-09-10T23:17:55.477645+0000","last_undegraded":"2024-09-10T23:17:55.477645+0000","last_fullsized":"2024-09-10T23:17:55.477645+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:25.531536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478432+0000","last_change":"2024-09-10T23:17:52.566701+0000","last_active":"2024-09-10T23:17:55.478432+0000","last_peered":"2024-09-10T23:17:55.478432+0000","last_clean":"2024-09-10T23:17:55.478432+0000","last_became_active":"2024-09-10T23:17:52.566074+0000","last_became_peered":"2024-09-10T23:17:52.566074+0000","last_unstale":"2024-09-10T23:17:55.478432+0000","last_undegraded":"2024-09-10T23:17:55.478432+0000","last_fullsized":"2024-09-10T23:17:55.478432+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:20.781641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478386+0000","last_change":"2024-09-10T23:17:53.557300+0000","last_active":"2024-09-10T23:17:55.478386+0000","last_peered":"2024-09-10T23:17:55.478386+0000","last_clean":"2024-09-10T23:17:55.478386+0000","last_became_active":"2024-09-10T23:17:53.556997+0000","last_became_peered":"2024-09-10T23:17:53.556997+0000","last_unstale":"2024-09-10T23:17:55.478386+0000","last_undegraded":"2024-09-10T23:17:55.478386+0000","last_fullsized":"2024-09-10T23:17:55.478386+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:12.740294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.575016+0000","last_change":"2024-09-10T23:17:52.569372+0000","last_active":"2024-09-10T23:17:52.575016+0000","last_peered":"2024-09-10T23:17:52.575016+0000","last_clean":"2024-09-10T23:17:52.575016+0000","last_became_active":"2024-09-10T23:17:52.569138+0000","last_became_peered":"2024-09-10T23:17:52.569138+0000","last_unstale":"2024-09-10T23:17:52.575016+0000","last_undegraded":"2024-09-10T23:17:52.575016+0000","last_fullsized":"2024-09-10T23:17:52.575016+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:19.835444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540543+0000","last_change":"2024-09-10T23:17:53.553407+0000","last_active":"2024-09-10T23:17:54.540543+0000","last_peered":"2024-09-10T23:17:54.540543+0000","last_clean":"2024-09-10T23:17:54.540543+0000","last_became_active":"2024-09-10T23:17:53.553115+0000","last_became_peered":"2024-09-10T23:17:53.553115+0000","last_unstale":"2024-09-10T23:17:54.540543+0000","last_undegraded":"2024-09-10T23:17:54.540543+0000","last_fullsized":"2024-09-10T23:17:54.540543+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:09.097652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477705+0000","last_change":"2024-09-10T23:17:52.568101+0000","last_active":"2024-09-10T23:17:55.477705+0000","last_peered":"2024-09-10T23:17:55.477705+0000","last_clean":"2024-09-10T23:17:55.477705+0000","last_became_active":"2024-09-10T23:17:52.567822+0000","last_became_peered":"2024-09-10T23:17:52.567822+0000","last_unstale":"2024-09-10T23:17:55.477705+0000","last_undegraded":"2024-09-10T23:17:55.477705+0000","last_fullsized":"2024-09-10T23:17:55.477705+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:01.850714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477722+0000","last_change":"2024-09-10T23:17:53.554947+0000","last_active":"2024-09-10T23:17:55.477722+0000","last_peered":"2024-09-10T23:17:55.477722+0000","last_clean":"2024-09-10T23:17:55.477722+0000","last_became_active":"2024-09-10T23:17:53.554642+0000","last_became_peered":"2024-09-10T23:17:53.554642+0000","last_unstale":"2024-09-10T23:17:55.477722+0000","last_undegraded":"2024-09-10T23:17:55.477722+0000","last_fullsized":"2024-09-10T23:17:55.477722+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:17.947754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541905+0000","last_change":"2024-09-10T23:17:52.569265+0000","last_active":"2024-09-10T23:17:54.541905+0000","last_peered":"2024-09-10T23:17:54.541905+0000","last_clean":"2024-09-10T23:17:54.541905+0000","last_became_active":"2024-09-10T23:17:52.569021+0000","last_became_peered":"2024-09-10T23:17:52.569021+0000","last_unstale":"2024-09-10T23:17:54.541905+0000","last_undegraded":"2024-09-10T23:17:54.541905+0000","last_fullsized":"2024-09-10T23:17:54.541905+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:37:36.066729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477301+0000","last_change":"2024-09-10T23:17:53.561543+0000","last_active":"2024-09-10T23:17:55.477301+0000","last_peered":"2024-09-10T23:17:55.477301+0000","last_clean":"2024-09-10T23:17:55.477301+0000","last_became_active":"2024-09-10T23:17:53.561264+0000","last_became_peered":"2024-09-10T23:17:53.561264+0000","last_unstale":"2024-09-10T23:17:55.477301+0000","last_undegraded":"2024-09-10T23:17:55.477301+0000","last_fullsized":"2024-09-10T23:17:55.477301+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:52.661481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477776+0000","last_change":"2024-09-10T23:17:52.573386+0000","last_active":"2024-09-10T23:17:55.477776+0000","last_peered":"2024-09-10T23:17:55.477776+0000","last_clean":"2024-09-10T23:17:55.477776+0000","last_became_active":"2024-09-10T23:17:52.573120+0000","last_became_peered":"2024-09-10T23:17:52.573120+0000","last_unstale":"2024-09-10T23:17:55.477776+0000","last_undegraded":"2024-09-10T23:17:55.477776+0000","last_fullsized":"2024-09-10T23:17:55.477776+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:06.971289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478299+0000","last_change":"2024-09-10T23:17:53.550292+0000","last_active":"2024-09-10T23:17:55.478299+0000","last_peered":"2024-09-10T23:17:55.478299+0000","last_clean":"2024-09-10T23:17:55.478299+0000","last_became_active":"2024-09-10T23:17:53.550026+0000","last_became_peered":"2024-09-10T23:17:53.550026+0000","last_unstale":"2024-09-10T23:17:55.478299+0000","last_undegraded":"2024-09-10T23:17:55.478299+0000","last_fullsized":"2024-09-10T23:17:55.478299+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:54.395956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477575+0000","last_change":"2024-09-10T23:17:52.569598+0000","last_active":"2024-09-10T23:17:55.477575+0000","last_peered":"2024-09-10T23:17:55.477575+0000","last_clean":"2024-09-10T23:17:55.477575+0000","last_became_active":"2024-09-10T23:17:52.569310+0000","last_became_peered":"2024-09-10T23:17:52.569310+0000","last_unstale":"2024-09-10T23:17:55.477575+0000","last_undegraded":"2024-09-10T23:17:55.477575+0000","last_fullsized":"2024-09-10T23:17:55.477575+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:58.550027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":236,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477703+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:17:55.477703+0000","last_peered":"2024-09-10T23:17:55.477703+0000","last_clean":"2024-09-10T23:17:55.477703+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:17:55.477703+0000","last_undegraded":"2024-09-10T23:17:55.477703+0000","last_fullsized":"2024-09-10T23:17:55.477703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28720,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343120,"statfs":{"total":96636764160,"available":96607354880,"internally_reserved":0,"allocated":1720320,"data_stored":1061912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1126400,"data_stored":472084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509485,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1134592,"data_stored":477802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1150976,"data_stored":479468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1146880,"data_stored":479366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1122304,"data_stored":471466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1118208,"data_stored":471432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32860,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338980,"statfs":{"total":96636764160,"available":96603115520,"internally_reserved":0,"allocated":1699840,"data_stored":1055025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:17:57.181 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3e is not active+clean 2024-09-10T23:17:57.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:52.562100+0000', 'last_change': '2024-09-10T23:17:52.562100+0000', 'last_active': '2024-09-10T23:17:52.545222+0000', 'last_peered': '2024-09-10T23:17:52.545222+0000', 'last_clean': '2024-09-10T23:17:52.545222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:52.562100+0000', 'last_undegraded': '2024-09-10T23:17:52.562100+0000', 'last_fullsized': '2024-09-10T23:17:52.562100+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:17:57.181 INFO:tasks.ceph.ceph_manager.ceph:PG 15.38 is not active+clean 2024-09-10T23:17:57.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:52.561234+0000', 'last_change': '2024-09-10T23:17:52.561234+0000', 'last_active': '2024-09-10T23:17:52.545222+0000', 'last_peered': '2024-09-10T23:17:52.545222+0000', 'last_clean': '2024-09-10T23:17:52.545222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:52.561234+0000', 'last_undegraded': '2024-09-10T23:17:52.561234+0000', 'last_fullsized': '2024-09-10T23:17:52.561234+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:17:57.181 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2f is not active+clean 2024-09-10T23:17:57.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:52.560750+0000', 'last_change': '2024-09-10T23:17:52.560750+0000', 'last_active': '2024-09-10T23:17:52.545222+0000', 'last_peered': '2024-09-10T23:17:52.545222+0000', 'last_clean': '2024-09-10T23:17:52.545222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:52.560750+0000', 'last_undegraded': '2024-09-10T23:17:52.560750+0000', 'last_fullsized': '2024-09-10T23:17:52.560750+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:17:57.182 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2a is not active+clean 2024-09-10T23:17:57.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:52.560460+0000', 'last_change': '2024-09-10T23:17:52.560460+0000', 'last_active': '2024-09-10T23:17:52.545222+0000', 'last_peered': '2024-09-10T23:17:52.545222+0000', 'last_clean': '2024-09-10T23:17:52.545222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:52.560460+0000', 'last_undegraded': '2024-09-10T23:17:52.560460+0000', 'last_fullsized': '2024-09-10T23:17:52.560460+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:17:57.182 INFO:tasks.ceph.ceph_manager.ceph:PG 15.29 is not active+clean 2024-09-10T23:17:57.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:52.558847+0000', 'last_change': '2024-09-10T23:17:52.558847+0000', 'last_active': '2024-09-10T23:17:52.545222+0000', 'last_peered': '2024-09-10T23:17:52.545222+0000', 'last_clean': '2024-09-10T23:17:52.545222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:52.558847+0000', 'last_undegraded': '2024-09-10T23:17:52.558847+0000', 'last_fullsized': '2024-09-10T23:17:52.558847+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:17:57.182 INFO:tasks.ceph.ceph_manager.ceph:PG 15.26 is not active+clean 2024-09-10T23:17:57.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:52.560995+0000', 'last_change': '2024-09-10T23:17:52.560995+0000', 'last_active': '2024-09-10T23:17:52.545222+0000', 'last_peered': '2024-09-10T23:17:52.545222+0000', 'last_clean': '2024-09-10T23:17:52.545222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:52.560995+0000', 'last_undegraded': '2024-09-10T23:17:52.560995+0000', 'last_fullsized': '2024-09-10T23:17:52.560995+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:17:57.182 INFO:tasks.ceph.ceph_manager.ceph:PG 15.23 is not active+clean 2024-09-10T23:17:57.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:52.559679+0000', 'last_change': '2024-09-10T23:17:52.559679+0000', 'last_active': '2024-09-10T23:17:52.545222+0000', 'last_peered': '2024-09-10T23:17:52.545222+0000', 'last_clean': '2024-09-10T23:17:52.545222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:52.559679+0000', 'last_undegraded': '2024-09-10T23:17:52.559679+0000', 'last_fullsized': '2024-09-10T23:17:52.559679+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:17:57.182 INFO:tasks.ceph.ceph_manager.ceph:PG 15.16 is not active+clean 2024-09-10T23:17:57.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:52.560511+0000', 'last_change': '2024-09-10T23:17:52.560511+0000', 'last_active': '2024-09-10T23:17:52.545222+0000', 'last_peered': '2024-09-10T23:17:52.545222+0000', 'last_clean': '2024-09-10T23:17:52.545222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:52.560511+0000', 'last_undegraded': '2024-09-10T23:17:52.560511+0000', 'last_fullsized': '2024-09-10T23:17:52.560511+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:17:57.183 INFO:tasks.ceph.ceph_manager.ceph:PG 15.6 is not active+clean 2024-09-10T23:17:57.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:17:52.560136+0000', 'last_change': '2024-09-10T23:17:52.560136+0000', 'last_active': '2024-09-10T23:17:52.545222+0000', 'last_peered': '2024-09-10T23:17:52.545222+0000', 'last_clean': '2024-09-10T23:17:52.545222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:17:52.560136+0000', 'last_undegraded': '2024-09-10T23:17:52.560136+0000', 'last_fullsized': '2024-09-10T23:17:52.560136+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'last_clean_scrub_stamp': '2024-09-10T23:17:52.545222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:17:57.183 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:17:57.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.317+0000 7f7559d2b640 1 -- 172.21.15.90:0/2415120871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75541617f0 msgr2=0x7f75540d2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:57.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.317+0000 7f7559d2b640 1 --2- 172.21.15.90:0/2415120871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75541617f0 0x7f75540d2d00 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f7544009830 tx=0x7f754402a510 comp rx=0 tx=0).stop 2024-09-10T23:17:57.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.317+0000 7f7559d2b640 1 -- 172.21.15.90:0/2415120871 shutdown_connections 2024-09-10T23:17:57.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.317+0000 7f7559d2b640 1 --2- 172.21.15.90:0/2415120871 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75540d3570 0x7f75540d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.317+0000 7f7559d2b640 1 --2- 172.21.15.90:0/2415120871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75541617f0 0x7f75540d2d00 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.317+0000 7f7559d2b640 1 -- 172.21.15.90:0/2415120871 >> 172.21.15.90:0/2415120871 conn(0x7f75540d4110 msgr2=0x7f75540d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:57.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.317+0000 7f7559d2b640 1 -- 172.21.15.90:0/2415120871 shutdown_connections 2024-09-10T23:17:57.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.317+0000 7f7559d2b640 1 -- 172.21.15.90:0/2415120871 wait complete. 2024-09-10T23:17:57.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.319+0000 7f7559d2b640 1 Processor -- start 2024-09-10T23:17:57.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.319+0000 7f7559d2b640 1 -- start start 2024-09-10T23:17:57.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.319+0000 7f7559d2b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75540d0940 0x7f75541f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:57.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.319+0000 7f7559d2b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75540d3570 0x7f75541f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:57.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.319+0000 7f7559d2b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75541617f0 0x7f755415e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:57.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.319+0000 7f7559d2b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f755406e9a0 con 0x7f75541617f0 2024-09-10T23:17:57.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.319+0000 7f7559d2b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f75540cfc30 con 0x7f75540d0940 2024-09-10T23:17:57.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.319+0000 7f7559d2b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f755415c8f0 con 0x7f75540d3570 2024-09-10T23:17:57.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.320+0000 7f7553fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75541617f0 0x7f755415e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:57.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.320+0000 7f7553fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75541617f0 0x7f755415e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48426/0 (socket says 172.21.15.90:48426) 2024-09-10T23:17:57.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.320+0000 7f7553fff640 1 -- 172.21.15.90:0/3398751567 learned_addr learned my addr 172.21.15.90:0/3398751567 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:57.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.320+0000 7f75537fe640 1 --2- 172.21.15.90:0/3398751567 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75540d0940 0x7f75541f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:57.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.320+0000 7f7552ffd640 1 --2- 172.21.15.90:0/3398751567 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75540d3570 0x7f75541f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:57.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.320+0000 7f7553fff640 1 -- 172.21.15.90:0/3398751567 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75540d3570 msgr2=0x7f75541f79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:57.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.320+0000 7f7553fff640 1 --2- 172.21.15.90:0/3398751567 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75540d3570 0x7f75541f79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.320+0000 7f7553fff640 1 -- 172.21.15.90:0/3398751567 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75540d0940 msgr2=0x7f75541f4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:57.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.320+0000 7f7553fff640 1 --2- 172.21.15.90:0/3398751567 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75540d0940 0x7f75541f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.320+0000 7f7553fff640 1 -- 172.21.15.90:0/3398751567 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f755415bd50 con 0x7f75541617f0 2024-09-10T23:17:57.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.320+0000 7f7553fff640 1 --2- 172.21.15.90:0/3398751567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75541617f0 0x7f755415e720 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f754c00cbf0 tx=0x7f754c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:57.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.320+0000 7f753bfff640 1 -- 172.21.15.90:0/3398751567 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c016020 con 0x7f75541617f0 2024-09-10T23:17:57.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.320+0000 7f753bfff640 1 -- 172.21.15.90:0/3398751567 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f754c00ad50 con 0x7f75541617f0 2024-09-10T23:17:57.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.320+0000 7f7559d2b640 1 -- 172.21.15.90:0/3398751567 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75540ca9f0 con 0x7f75541617f0 2024-09-10T23:17:57.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.320+0000 7f753bfff640 1 -- 172.21.15.90:0/3398751567 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c012680 con 0x7f75541617f0 2024-09-10T23:17:57.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.320+0000 7f7559d2b640 1 -- 172.21.15.90:0/3398751567 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f755415c2a0 con 0x7f75541617f0 2024-09-10T23:17:57.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.321+0000 7f7559d2b640 1 -- 172.21.15.90:0/3398751567 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75540d0400 con 0x7f75541617f0 2024-09-10T23:17:57.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.322+0000 7f753bfff640 1 -- 172.21.15.90:0/3398751567 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f754c01a3b0 con 0x7f75541617f0 2024-09-10T23:17:57.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.322+0000 7f753bfff640 1 --2- 172.21.15.90:0/3398751567 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7540077f70 0x7f754007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:57.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.322+0000 7f753bfff640 1 -- 172.21.15.90:0/3398751567 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f754c09a440 con 0x7f75541617f0 2024-09-10T23:17:57.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.323+0000 7f75537fe640 1 --2- 172.21.15.90:0/3398751567 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7540077f70 0x7f754007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:57.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.323+0000 7f75537fe640 1 --2- 172.21.15.90:0/3398751567 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7540077f70 0x7f754007a430 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7544034000 tx=0x7f7544004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:57.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.326+0000 7f753bfff640 1 -- 172.21.15.90:0/3398751567 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f754c020030 con 0x7f75541617f0 2024-09-10T23:17:57.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.573+0000 7f7559d2b640 1 -- 172.21.15.90:0/3398751567 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f7554160050 con 0x7f75541617f0 2024-09-10T23:17:57.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.574+0000 7f753bfff640 1 -- 172.21.15.90:0/3398751567 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1561 (secure 0 0 0) 0x7f75540ca9f0 con 0x7f75541617f0 2024-09-10T23:17:57.577 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:57.578 INFO:teuthology.orchestra.run.smithi090.stdout:{"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":225,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":92,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010065,"num_in_osds":8,"osd_in_since":1726010055,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":88},{"state_name":"creating+peering","count":9}],"num_pgs":97,"num_pools":3,"num_objects":18,"data_bytes":592196,"bytes_used":261500928,"bytes_avail":772832612352,"bytes_total":773094113280,"inactive_pgs_ratio":0.092783503234386444,"write_bytes_sec":2697,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":51,"btime":"2024-09-10T23:17:55:561728+0000","id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":6714}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-09-10T23:17:44.479494+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:17:57.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.576+0000 7f7559d2b640 1 -- 172.21.15.90:0/3398751567 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7540077f70 msgr2=0x7f754007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:57.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.576+0000 7f7559d2b640 1 --2- 172.21.15.90:0/3398751567 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7540077f70 0x7f754007a430 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7544034000 tx=0x7f7544004730 comp rx=0 tx=0).stop 2024-09-10T23:17:57.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.576+0000 7f7559d2b640 1 -- 172.21.15.90:0/3398751567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75541617f0 msgr2=0x7f755415e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:57.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.576+0000 7f7559d2b640 1 --2- 172.21.15.90:0/3398751567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75541617f0 0x7f755415e720 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f754c00cbf0 tx=0x7f754c00a430 comp rx=0 tx=0).stop 2024-09-10T23:17:57.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.576+0000 7f7559d2b640 1 -- 172.21.15.90:0/3398751567 shutdown_connections 2024-09-10T23:17:57.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.576+0000 7f7559d2b640 1 --2- 172.21.15.90:0/3398751567 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7540077f70 0x7f754007a430 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.576+0000 7f7559d2b640 1 --2- 172.21.15.90:0/3398751567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75541617f0 0x7f755415e720 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.576+0000 7f7559d2b640 1 --2- 172.21.15.90:0/3398751567 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75540d3570 0x7f75541f79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.576+0000 7f7559d2b640 1 --2- 172.21.15.90:0/3398751567 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75540d0940 0x7f75541f4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.576+0000 7f7559d2b640 1 -- 172.21.15.90:0/3398751567 >> 172.21.15.90:0/3398751567 conn(0x7f75540d4110 msgr2=0x7f755406d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:57.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.576+0000 7f7559d2b640 1 -- 172.21.15.90:0/3398751567 shutdown_connections 2024-09-10T23:17:57.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.576+0000 7f7559d2b640 1 -- 172.21.15.90:0/3398751567 wait complete. 2024-09-10T23:17:57.588 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T23:17:57.588 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:17:57.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.688+0000 7f02363ad640 1 -- 172.21.15.90:0/889192335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02300cdea0 msgr2=0x7f02300c5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:57.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.688+0000 7f02363ad640 1 --2- 172.21.15.90:0/889192335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02300cdea0 0x7f02300c5d60 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0228005fd0 tx=0x7f022802a820 comp rx=0 tx=0).stop 2024-09-10T23:17:57.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.688+0000 7f02363ad640 1 -- 172.21.15.90:0/889192335 shutdown_connections 2024-09-10T23:17:57.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.688+0000 7f02363ad640 1 --2- 172.21.15.90:0/889192335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02300cdea0 0x7f02300c5d60 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.688+0000 7f02363ad640 1 --2- 172.21.15.90:0/889192335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f023015ab30 0x7f0230070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.688+0000 7f02363ad640 1 -- 172.21.15.90:0/889192335 >> 172.21.15.90:0/889192335 conn(0x7f02300b2a40 msgr2=0x7f02300b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:57.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.688+0000 7f02363ad640 1 -- 172.21.15.90:0/889192335 shutdown_connections 2024-09-10T23:17:57.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.688+0000 7f02363ad640 1 -- 172.21.15.90:0/889192335 wait complete. 2024-09-10T23:17:57.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.689+0000 7f02363ad640 1 Processor -- start 2024-09-10T23:17:57.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.690+0000 7f02363ad640 1 -- start start 2024-09-10T23:17:57.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.690+0000 7f02363ad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02300cdea0 0x7f02300b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:57.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.690+0000 7f02363ad640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f023015ab30 0x7f023014d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:57.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.690+0000 7f02363ad640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f023015af10 0x7f0230149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:57.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.690+0000 7f02363ad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f02300c62a0 con 0x7f02300cdea0 2024-09-10T23:17:57.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.690+0000 7f02363ad640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0230074730 con 0x7f023015ab30 2024-09-10T23:17:57.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.690+0000 7f02363ad640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f02300c6420 con 0x7f023015af10 2024-09-10T23:17:57.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.691+0000 7f022ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02300cdea0 0x7f02300b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:57.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.691+0000 7f022ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02300cdea0 0x7f02300b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48450/0 (socket says 172.21.15.90:48450) 2024-09-10T23:17:57.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.691+0000 7f022ffff640 1 -- 172.21.15.90:0/483131639 learned_addr learned my addr 172.21.15.90:0/483131639 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:17:57.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.691+0000 7f023494a640 1 --2- 172.21.15.90:0/483131639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f023015af10 0x7f0230149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:57.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.691+0000 7f022f7fe640 1 --2- 172.21.15.90:0/483131639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f023015ab30 0x7f023014d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:57.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.691+0000 7f022ffff640 1 -- 172.21.15.90:0/483131639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f023015af10 msgr2=0x7f0230149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:57.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.691+0000 7f022ffff640 1 --2- 172.21.15.90:0/483131639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f023015af10 0x7f0230149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.691+0000 7f022ffff640 1 -- 172.21.15.90:0/483131639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f023015ab30 msgr2=0x7f023014d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:57.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.691+0000 7f022ffff640 1 --2- 172.21.15.90:0/483131639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f023015ab30 0x7f023014d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.691+0000 7f022ffff640 1 -- 172.21.15.90:0/483131639 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023014d930 con 0x7f02300cdea0 2024-09-10T23:17:57.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.691+0000 7f022f7fe640 1 --2- 172.21.15.90:0/483131639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f023015ab30 0x7f023014d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:17:57.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.691+0000 7f022ffff640 1 --2- 172.21.15.90:0/483131639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02300cdea0 0x7f02300b3e20 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f022000b4a0 tx=0x7f022000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:57.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.691+0000 7f022cff9640 1 -- 172.21.15.90:0/483131639 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220014070 con 0x7f02300cdea0 2024-09-10T23:17:57.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.691+0000 7f022cff9640 1 -- 172.21.15.90:0/483131639 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0220010700 con 0x7f02300cdea0 2024-09-10T23:17:57.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.691+0000 7f022cff9640 1 -- 172.21.15.90:0/483131639 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220010b50 con 0x7f02300cdea0 2024-09-10T23:17:57.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.691+0000 7f02363ad640 1 -- 172.21.15.90:0/483131639 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02301f83a0 con 0x7f02300cdea0 2024-09-10T23:17:57.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.691+0000 7f02363ad640 1 -- 172.21.15.90:0/483131639 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02301f8960 con 0x7f02300cdea0 2024-09-10T23:17:57.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.692+0000 7f02363ad640 1 -- 172.21.15.90:0/483131639 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02301f9130 con 0x7f02300cdea0 2024-09-10T23:17:57.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.693+0000 7f022cff9640 1 -- 172.21.15.90:0/483131639 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0220017360 con 0x7f02300cdea0 2024-09-10T23:17:57.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.693+0000 7f022cff9640 1 --2- 172.21.15.90:0/483131639 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f021c077f70 0x7f021c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:17:57.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.693+0000 7f022cff9640 1 -- 172.21.15.90:0/483131639 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f0220099960 con 0x7f02300cdea0 2024-09-10T23:17:57.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.694+0000 7f022f7fe640 1 --2- 172.21.15.90:0/483131639 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f021c077f70 0x7f021c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:17:57.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.694+0000 7f022f7fe640 1 --2- 172.21.15.90:0/483131639 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f021c077f70 0x7f021c07a430 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f02300ce8f0 tx=0x7f0224009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:17:57.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.697+0000 7f022cff9640 1 -- 172.21.15.90:0/483131639 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f023014d930 con 0x7f02300cdea0 2024-09-10T23:17:57.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.869+0000 7f02363ad640 1 -- 172.21.15.90:0/483131639 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f02300c6980 con 0x7f021c077f70 2024-09-10T23:17:57.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.874+0000 7f022cff9640 1 -- 172.21.15.90:0/483131639 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251324 (secure 0 0 0) 0x7f02300c6980 con 0x7f021c077f70 2024-09-10T23:17:57.877 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:17:57.878 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:17:57.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.877+0000 7f02363ad640 1 -- 172.21.15.90:0/483131639 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f021c077f70 msgr2=0x7f021c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:57.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.877+0000 7f02363ad640 1 --2- 172.21.15.90:0/483131639 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f021c077f70 0x7f021c07a430 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f02300ce8f0 tx=0x7f0224009040 comp rx=0 tx=0).stop 2024-09-10T23:17:57.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.877+0000 7f02363ad640 1 -- 172.21.15.90:0/483131639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02300cdea0 msgr2=0x7f02300b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:17:57.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.877+0000 7f02363ad640 1 --2- 172.21.15.90:0/483131639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02300cdea0 0x7f02300b3e20 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f022000b4a0 tx=0x7f022000b960 comp rx=0 tx=0).stop 2024-09-10T23:17:57.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.877+0000 7f02363ad640 1 -- 172.21.15.90:0/483131639 shutdown_connections 2024-09-10T23:17:57.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.877+0000 7f02363ad640 1 --2- 172.21.15.90:0/483131639 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f021c077f70 0x7f021c07a430 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.877+0000 7f02363ad640 1 --2- 172.21.15.90:0/483131639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f023015ab30 0x7f023014d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.877+0000 7f02363ad640 1 --2- 172.21.15.90:0/483131639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f023015af10 0x7f0230149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.877+0000 7f02363ad640 1 --2- 172.21.15.90:0/483131639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02300cdea0 0x7f02300b3e20 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:17:57.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.877+0000 7f02363ad640 1 -- 172.21.15.90:0/483131639 >> 172.21.15.90:0/483131639 conn(0x7f02300b2a40 msgr2=0x7f02300d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:17:57.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.877+0000 7f02363ad640 1 -- 172.21.15.90:0/483131639 shutdown_connections 2024-09-10T23:17:57.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:17:57.877+0000 7f02363ad640 1 -- 172.21.15.90:0/483131639 wait complete. 2024-09-10T23:17:57.889 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-09-10T23:17:56.482333+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255372,"kb_used_data":9980,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719348,"statfs":{"total":773094113280,"available":772832612352,"internally_reserved":0,"allocated":10219520,"data_stored":4968555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.935747"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477298+0000","last_change":"2024-09-10T23:17:53.560279+0000","last_active":"2024-09-10T23:17:55.477298+0000","last_peered":"2024-09-10T23:17:55.477298+0000","last_clean":"2024-09-10T23:17:55.477298+0000","last_became_active":"2024-09-10T23:17:53.556589+0000","last_became_peered":"2024-09-10T23:17:53.556589+0000","last_unstale":"2024-09-10T23:17:55.477298+0000","last_undegraded":"2024-09-10T23:17:55.477298+0000","last_fullsized":"2024-09-10T23:17:55.477298+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:20.124209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.562100+0000","last_change":"2024-09-10T23:17:52.562100+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.562100+0000","last_undegraded":"2024-09-10T23:17:52.562100+0000","last_fullsized":"2024-09-10T23:17:52.562100+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477747+0000","last_change":"2024-09-10T23:17:53.556897+0000","last_active":"2024-09-10T23:17:55.477747+0000","last_peered":"2024-09-10T23:17:55.477747+0000","last_clean":"2024-09-10T23:17:55.477747+0000","last_became_active":"2024-09-10T23:17:53.556564+0000","last_became_peered":"2024-09-10T23:17:53.556564+0000","last_unstale":"2024-09-10T23:17:55.477747+0000","last_undegraded":"2024-09-10T23:17:55.477747+0000","last_fullsized":"2024-09-10T23:17:55.477747+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:32.013618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541845+0000","last_change":"2024-09-10T23:17:53.554128+0000","last_active":"2024-09-10T23:17:54.541845+0000","last_peered":"2024-09-10T23:17:54.541845+0000","last_clean":"2024-09-10T23:17:54.541845+0000","last_became_active":"2024-09-10T23:17:53.553837+0000","last_became_peered":"2024-09-10T23:17:53.553837+0000","last_unstale":"2024-09-10T23:17:54.541845+0000","last_undegraded":"2024-09-10T23:17:54.541845+0000","last_fullsized":"2024-09-10T23:17:54.541845+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:16.073355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478024+0000","last_change":"2024-09-10T23:17:53.561325+0000","last_active":"2024-09-10T23:17:55.478024+0000","last_peered":"2024-09-10T23:17:55.478024+0000","last_clean":"2024-09-10T23:17:55.478024+0000","last_became_active":"2024-09-10T23:17:53.561035+0000","last_became_peered":"2024-09-10T23:17:53.561035+0000","last_unstale":"2024-09-10T23:17:55.478024+0000","last_undegraded":"2024-09-10T23:17:55.478024+0000","last_fullsized":"2024-09-10T23:17:55.478024+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:05.151677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477659+0000","last_change":"2024-09-10T23:17:53.547173+0000","last_active":"2024-09-10T23:17:55.477659+0000","last_peered":"2024-09-10T23:17:55.477659+0000","last_clean":"2024-09-10T23:17:55.477659+0000","last_became_active":"2024-09-10T23:17:53.546924+0000","last_became_peered":"2024-09-10T23:17:53.546924+0000","last_unstale":"2024-09-10T23:17:55.477659+0000","last_undegraded":"2024-09-10T23:17:55.477659+0000","last_fullsized":"2024-09-10T23:17:55.477659+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:36.528978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477648+0000","last_change":"2024-09-10T23:17:53.544392+0000","last_active":"2024-09-10T23:17:55.477648+0000","last_peered":"2024-09-10T23:17:55.477648+0000","last_clean":"2024-09-10T23:17:55.477648+0000","last_became_active":"2024-09-10T23:17:53.544080+0000","last_became_peered":"2024-09-10T23:17:53.544080+0000","last_unstale":"2024-09-10T23:17:55.477648+0000","last_undegraded":"2024-09-10T23:17:55.477648+0000","last_fullsized":"2024-09-10T23:17:55.477648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:33.836216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.561234+0000","last_change":"2024-09-10T23:17:52.561234+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.561234+0000","last_undegraded":"2024-09-10T23:17:52.561234+0000","last_fullsized":"2024-09-10T23:17:52.561234+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541325+0000","last_change":"2024-09-10T23:17:53.560387+0000","last_active":"2024-09-10T23:17:54.541325+0000","last_peered":"2024-09-10T23:17:54.541325+0000","last_clean":"2024-09-10T23:17:54.541325+0000","last_became_active":"2024-09-10T23:17:53.560096+0000","last_became_peered":"2024-09-10T23:17:53.560096+0000","last_unstale":"2024-09-10T23:17:54.541325+0000","last_undegraded":"2024-09-10T23:17:54.541325+0000","last_fullsized":"2024-09-10T23:17:54.541325+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:33:38.997089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477837+0000","last_change":"2024-09-10T23:17:53.565740+0000","last_active":"2024-09-10T23:17:55.477837+0000","last_peered":"2024-09-10T23:17:55.477837+0000","last_clean":"2024-09-10T23:17:55.477837+0000","last_became_active":"2024-09-10T23:17:53.565440+0000","last_became_peered":"2024-09-10T23:17:53.565440+0000","last_unstale":"2024-09-10T23:17:55.477837+0000","last_undegraded":"2024-09-10T23:17:55.477837+0000","last_fullsized":"2024-09-10T23:17:55.477837+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:27.057119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477721+0000","last_change":"2024-09-10T23:17:53.555393+0000","last_active":"2024-09-10T23:17:55.477721+0000","last_peered":"2024-09-10T23:17:55.477721+0000","last_clean":"2024-09-10T23:17:55.477721+0000","last_became_active":"2024-09-10T23:17:53.555122+0000","last_became_peered":"2024-09-10T23:17:53.555122+0000","last_unstale":"2024-09-10T23:17:55.477721+0000","last_undegraded":"2024-09-10T23:17:55.477721+0000","last_fullsized":"2024-09-10T23:17:55.477721+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:29.522521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541083+0000","last_change":"2024-09-10T23:17:53.560808+0000","last_active":"2024-09-10T23:17:54.541083+0000","last_peered":"2024-09-10T23:17:54.541083+0000","last_clean":"2024-09-10T23:17:54.541083+0000","last_became_active":"2024-09-10T23:17:53.560407+0000","last_became_peered":"2024-09-10T23:17:53.560407+0000","last_unstale":"2024-09-10T23:17:54.541083+0000","last_undegraded":"2024-09-10T23:17:54.541083+0000","last_fullsized":"2024-09-10T23:17:54.541083+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:27.057119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541860+0000","last_change":"2024-09-10T23:17:53.557682+0000","last_active":"2024-09-10T23:17:54.541860+0000","last_peered":"2024-09-10T23:17:54.541860+0000","last_clean":"2024-09-10T23:17:54.541860+0000","last_became_active":"2024-09-10T23:17:53.557417+0000","last_became_peered":"2024-09-10T23:17:53.557417+0000","last_unstale":"2024-09-10T23:17:54.541860+0000","last_undegraded":"2024-09-10T23:17:54.541860+0000","last_fullsized":"2024-09-10T23:17:54.541860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:46.228987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477985+0000","last_change":"2024-09-10T23:17:53.552624+0000","last_active":"2024-09-10T23:17:55.477985+0000","last_peered":"2024-09-10T23:17:55.477985+0000","last_clean":"2024-09-10T23:17:55.477985+0000","last_became_active":"2024-09-10T23:17:53.552371+0000","last_became_peered":"2024-09-10T23:17:53.552371+0000","last_unstale":"2024-09-10T23:17:55.477985+0000","last_undegraded":"2024-09-10T23:17:55.477985+0000","last_fullsized":"2024-09-10T23:17:55.477985+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:45.051857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541808+0000","last_change":"2024-09-10T23:17:53.559674+0000","last_active":"2024-09-10T23:17:54.541808+0000","last_peered":"2024-09-10T23:17:54.541808+0000","last_clean":"2024-09-10T23:17:54.541808+0000","last_became_active":"2024-09-10T23:17:53.559392+0000","last_became_peered":"2024-09-10T23:17:53.559392+0000","last_unstale":"2024-09-10T23:17:54.541808+0000","last_undegraded":"2024-09-10T23:17:54.541808+0000","last_fullsized":"2024-09-10T23:17:54.541808+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:33.836216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477893+0000","last_change":"2024-09-10T23:17:53.548614+0000","last_active":"2024-09-10T23:17:55.477893+0000","last_peered":"2024-09-10T23:17:55.477893+0000","last_clean":"2024-09-10T23:17:55.477893+0000","last_became_active":"2024-09-10T23:17:53.548291+0000","last_became_peered":"2024-09-10T23:17:53.548291+0000","last_unstale":"2024-09-10T23:17:55.477893+0000","last_undegraded":"2024-09-10T23:17:55.477893+0000","last_fullsized":"2024-09-10T23:17:55.477893+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:23.095017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560750+0000","last_change":"2024-09-10T23:17:52.560750+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560750+0000","last_undegraded":"2024-09-10T23:17:52.560750+0000","last_fullsized":"2024-09-10T23:17:52.560750+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541749+0000","last_change":"2024-09-10T23:17:53.554180+0000","last_active":"2024-09-10T23:17:54.541749+0000","last_peered":"2024-09-10T23:17:54.541749+0000","last_clean":"2024-09-10T23:17:54.541749+0000","last_became_active":"2024-09-10T23:17:53.553901+0000","last_became_peered":"2024-09-10T23:17:53.553901+0000","last_unstale":"2024-09-10T23:17:54.541749+0000","last_undegraded":"2024-09-10T23:17:54.541749+0000","last_fullsized":"2024-09-10T23:17:54.541749+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:34.087388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477219+0000","last_change":"2024-09-10T23:17:53.557802+0000","last_active":"2024-09-10T23:17:55.477219+0000","last_peered":"2024-09-10T23:17:55.477219+0000","last_clean":"2024-09-10T23:17:55.477219+0000","last_became_active":"2024-09-10T23:17:53.557537+0000","last_became_peered":"2024-09-10T23:17:53.557537+0000","last_unstale":"2024-09-10T23:17:55.477219+0000","last_undegraded":"2024-09-10T23:17:55.477219+0000","last_fullsized":"2024-09-10T23:17:55.477219+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:07.646491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541143+0000","last_change":"2024-09-10T23:17:53.561436+0000","last_active":"2024-09-10T23:17:54.541143+0000","last_peered":"2024-09-10T23:17:54.541143+0000","last_clean":"2024-09-10T23:17:54.541143+0000","last_became_active":"2024-09-10T23:17:53.561173+0000","last_became_peered":"2024-09-10T23:17:53.561173+0000","last_unstale":"2024-09-10T23:17:54.541143+0000","last_undegraded":"2024-09-10T23:17:54.541143+0000","last_fullsized":"2024-09-10T23:17:54.541143+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:19:38.295347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477755+0000","last_change":"2024-09-10T23:17:53.545062+0000","last_active":"2024-09-10T23:17:55.477755+0000","last_peered":"2024-09-10T23:17:55.477755+0000","last_clean":"2024-09-10T23:17:55.477755+0000","last_became_active":"2024-09-10T23:17:53.544797+0000","last_became_peered":"2024-09-10T23:17:53.544797+0000","last_unstale":"2024-09-10T23:17:55.477755+0000","last_undegraded":"2024-09-10T23:17:55.477755+0000","last_fullsized":"2024-09-10T23:17:55.477755+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:31.712561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560460+0000","last_change":"2024-09-10T23:17:52.560460+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560460+0000","last_undegraded":"2024-09-10T23:17:52.560460+0000","last_fullsized":"2024-09-10T23:17:52.560460+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.558847+0000","last_change":"2024-09-10T23:17:52.558847+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.558847+0000","last_undegraded":"2024-09-10T23:17:52.558847+0000","last_fullsized":"2024-09-10T23:17:52.558847+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477630+0000","last_change":"2024-09-10T23:17:53.560079+0000","last_active":"2024-09-10T23:17:55.477630+0000","last_peered":"2024-09-10T23:17:55.477630+0000","last_clean":"2024-09-10T23:17:55.477630+0000","last_became_active":"2024-09-10T23:17:53.559507+0000","last_became_peered":"2024-09-10T23:17:53.559507+0000","last_unstale":"2024-09-10T23:17:55.477630+0000","last_undegraded":"2024-09-10T23:17:55.477630+0000","last_fullsized":"2024-09-10T23:17:55.477630+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:51.603445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478504+0000","last_change":"2024-09-10T23:17:53.563818+0000","last_active":"2024-09-10T23:17:55.478504+0000","last_peered":"2024-09-10T23:17:55.478504+0000","last_clean":"2024-09-10T23:17:55.478504+0000","last_became_active":"2024-09-10T23:17:53.563533+0000","last_became_peered":"2024-09-10T23:17:53.563533+0000","last_unstale":"2024-09-10T23:17:55.478504+0000","last_undegraded":"2024-09-10T23:17:55.478504+0000","last_fullsized":"2024-09-10T23:17:55.478504+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:34.435158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560995+0000","last_change":"2024-09-10T23:17:52.560995+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560995+0000","last_undegraded":"2024-09-10T23:17:52.560995+0000","last_fullsized":"2024-09-10T23:17:52.560995+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478026+0000","last_change":"2024-09-10T23:17:53.551936+0000","last_active":"2024-09-10T23:17:55.478026+0000","last_peered":"2024-09-10T23:17:55.478026+0000","last_clean":"2024-09-10T23:17:55.478026+0000","last_became_active":"2024-09-10T23:17:53.550713+0000","last_became_peered":"2024-09-10T23:17:53.550713+0000","last_unstale":"2024-09-10T23:17:55.478026+0000","last_undegraded":"2024-09-10T23:17:55.478026+0000","last_fullsized":"2024-09-10T23:17:55.478026+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:49.704662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478330+0000","last_change":"2024-09-10T23:17:53.560875+0000","last_active":"2024-09-10T23:17:55.478330+0000","last_peered":"2024-09-10T23:17:55.478330+0000","last_clean":"2024-09-10T23:17:55.478330+0000","last_became_active":"2024-09-10T23:17:53.560567+0000","last_became_peered":"2024-09-10T23:17:53.560567+0000","last_unstale":"2024-09-10T23:17:55.478330+0000","last_undegraded":"2024-09-10T23:17:55.478330+0000","last_fullsized":"2024-09-10T23:17:55.478330+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:31.501371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.559679+0000","last_change":"2024-09-10T23:17:52.559679+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.559679+0000","last_undegraded":"2024-09-10T23:17:52.559679+0000","last_fullsized":"2024-09-10T23:17:52.559679+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478167+0000","last_change":"2024-09-10T23:17:53.558562+0000","last_active":"2024-09-10T23:17:55.478167+0000","last_peered":"2024-09-10T23:17:55.478167+0000","last_clean":"2024-09-10T23:17:55.478167+0000","last_became_active":"2024-09-10T23:17:53.558327+0000","last_became_peered":"2024-09-10T23:17:53.558327+0000","last_unstale":"2024-09-10T23:17:55.478167+0000","last_undegraded":"2024-09-10T23:17:55.478167+0000","last_fullsized":"2024-09-10T23:17:55.478167+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:41.417295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541843+0000","last_change":"2024-09-10T23:17:53.554219+0000","last_active":"2024-09-10T23:17:54.541843+0000","last_peered":"2024-09-10T23:17:54.541843+0000","last_clean":"2024-09-10T23:17:54.541843+0000","last_became_active":"2024-09-10T23:17:53.553751+0000","last_became_peered":"2024-09-10T23:17:53.553751+0000","last_unstale":"2024-09-10T23:17:54.541843+0000","last_undegraded":"2024-09-10T23:17:54.541843+0000","last_fullsized":"2024-09-10T23:17:54.541843+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:08.996959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478297+0000","last_change":"2024-09-10T23:17:53.556628+0000","last_active":"2024-09-10T23:17:55.478297+0000","last_peered":"2024-09-10T23:17:55.478297+0000","last_clean":"2024-09-10T23:17:55.478297+0000","last_became_active":"2024-09-10T23:17:53.556310+0000","last_became_peered":"2024-09-10T23:17:53.556310+0000","last_unstale":"2024-09-10T23:17:55.478297+0000","last_undegraded":"2024-09-10T23:17:55.478297+0000","last_fullsized":"2024-09-10T23:17:55.478297+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:39.854761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478272+0000","last_change":"2024-09-10T23:17:53.544501+0000","last_active":"2024-09-10T23:17:55.478272+0000","last_peered":"2024-09-10T23:17:55.478272+0000","last_clean":"2024-09-10T23:17:55.478272+0000","last_became_active":"2024-09-10T23:17:53.544244+0000","last_became_peered":"2024-09-10T23:17:53.544244+0000","last_unstale":"2024-09-10T23:17:55.478272+0000","last_undegraded":"2024-09-10T23:17:55.478272+0000","last_fullsized":"2024-09-10T23:17:55.478272+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:46.501299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572678+0000","last_change":"2024-09-10T23:17:52.567737+0000","last_active":"2024-09-10T23:17:52.572678+0000","last_peered":"2024-09-10T23:17:52.572678+0000","last_clean":"2024-09-10T23:17:52.572678+0000","last_became_active":"2024-09-10T23:17:52.567475+0000","last_became_peered":"2024-09-10T23:17:52.567475+0000","last_unstale":"2024-09-10T23:17:52.572678+0000","last_undegraded":"2024-09-10T23:17:52.572678+0000","last_fullsized":"2024-09-10T23:17:52.572678+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:43.747947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541868+0000","last_change":"2024-09-10T23:17:53.553734+0000","last_active":"2024-09-10T23:17:54.541868+0000","last_peered":"2024-09-10T23:17:54.541868+0000","last_clean":"2024-09-10T23:17:54.541868+0000","last_became_active":"2024-09-10T23:17:53.553335+0000","last_became_peered":"2024-09-10T23:17:53.553335+0000","last_unstale":"2024-09-10T23:17:54.541868+0000","last_undegraded":"2024-09-10T23:17:54.541868+0000","last_fullsized":"2024-09-10T23:17:54.541868+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:36.528978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477455+0000","last_change":"2024-09-10T23:17:52.573013+0000","last_active":"2024-09-10T23:17:55.477455+0000","last_peered":"2024-09-10T23:17:55.477455+0000","last_clean":"2024-09-10T23:17:55.477455+0000","last_became_active":"2024-09-10T23:17:52.572803+0000","last_became_peered":"2024-09-10T23:17:52.572803+0000","last_unstale":"2024-09-10T23:17:55.477455+0000","last_undegraded":"2024-09-10T23:17:55.477455+0000","last_fullsized":"2024-09-10T23:17:55.477455+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:11.857169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477450+0000","last_change":"2024-09-10T23:17:53.559140+0000","last_active":"2024-09-10T23:17:55.477450+0000","last_peered":"2024-09-10T23:17:55.477450+0000","last_clean":"2024-09-10T23:17:55.477450+0000","last_became_active":"2024-09-10T23:17:53.558865+0000","last_became_peered":"2024-09-10T23:17:53.558865+0000","last_unstale":"2024-09-10T23:17:55.477450+0000","last_undegraded":"2024-09-10T23:17:55.477450+0000","last_fullsized":"2024-09-10T23:17:55.477450+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:30.481697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572832+0000","last_change":"2024-09-10T23:17:52.568443+0000","last_active":"2024-09-10T23:17:52.572832+0000","last_peered":"2024-09-10T23:17:52.572832+0000","last_clean":"2024-09-10T23:17:52.572832+0000","last_became_active":"2024-09-10T23:17:52.568203+0000","last_became_peered":"2024-09-10T23:17:52.568203+0000","last_unstale":"2024-09-10T23:17:52.572832+0000","last_undegraded":"2024-09-10T23:17:52.572832+0000","last_fullsized":"2024-09-10T23:17:52.572832+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:36.731524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541077+0000","last_change":"2024-09-10T23:17:53.560547+0000","last_active":"2024-09-10T23:17:54.541077+0000","last_peered":"2024-09-10T23:17:54.541077+0000","last_clean":"2024-09-10T23:17:54.541077+0000","last_became_active":"2024-09-10T23:17:53.560260+0000","last_became_peered":"2024-09-10T23:17:53.560260+0000","last_unstale":"2024-09-10T23:17:54.541077+0000","last_undegraded":"2024-09-10T23:17:54.541077+0000","last_fullsized":"2024-09-10T23:17:54.541077+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:02.968645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572783+0000","last_change":"2024-09-10T23:17:52.568272+0000","last_active":"2024-09-10T23:17:52.572783+0000","last_peered":"2024-09-10T23:17:52.572783+0000","last_clean":"2024-09-10T23:17:52.572783+0000","last_became_active":"2024-09-10T23:17:52.567941+0000","last_became_peered":"2024-09-10T23:17:52.567941+0000","last_unstale":"2024-09-10T23:17:52.572783+0000","last_undegraded":"2024-09-10T23:17:52.572783+0000","last_fullsized":"2024-09-10T23:17:52.572783+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:52.125614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540931+0000","last_change":"2024-09-10T23:17:53.555155+0000","last_active":"2024-09-10T23:17:54.540931+0000","last_peered":"2024-09-10T23:17:54.540931+0000","last_clean":"2024-09-10T23:17:54.540931+0000","last_became_active":"2024-09-10T23:17:53.554877+0000","last_became_peered":"2024-09-10T23:17:53.554877+0000","last_unstale":"2024-09-10T23:17:54.540931+0000","last_undegraded":"2024-09-10T23:17:54.540931+0000","last_fullsized":"2024-09-10T23:17:54.540931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:08.979105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477954+0000","last_change":"2024-09-10T23:17:52.570450+0000","last_active":"2024-09-10T23:17:55.477954+0000","last_peered":"2024-09-10T23:17:55.477954+0000","last_clean":"2024-09-10T23:17:55.477954+0000","last_became_active":"2024-09-10T23:17:52.570182+0000","last_became_peered":"2024-09-10T23:17:52.570182+0000","last_unstale":"2024-09-10T23:17:55.477954+0000","last_undegraded":"2024-09-10T23:17:55.477954+0000","last_fullsized":"2024-09-10T23:17:55.477954+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:20.967251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477601+0000","last_change":"2024-09-10T23:17:53.552719+0000","last_active":"2024-09-10T23:17:55.477601+0000","last_peered":"2024-09-10T23:17:55.477601+0000","last_clean":"2024-09-10T23:17:55.477601+0000","last_became_active":"2024-09-10T23:17:53.552447+0000","last_became_peered":"2024-09-10T23:17:53.552447+0000","last_unstale":"2024-09-10T23:17:55.477601+0000","last_undegraded":"2024-09-10T23:17:55.477601+0000","last_fullsized":"2024-09-10T23:17:55.477601+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:16.073355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.577849+0000","last_change":"2024-09-10T23:17:52.572229+0000","last_active":"2024-09-10T23:17:52.577849+0000","last_peered":"2024-09-10T23:17:52.577849+0000","last_clean":"2024-09-10T23:17:52.577849+0000","last_became_active":"2024-09-10T23:17:52.571988+0000","last_became_peered":"2024-09-10T23:17:52.571988+0000","last_unstale":"2024-09-10T23:17:52.577849+0000","last_undegraded":"2024-09-10T23:17:52.577849+0000","last_fullsized":"2024-09-10T23:17:52.577849+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:32.280575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541603+0000","last_change":"2024-09-10T23:17:53.560055+0000","last_active":"2024-09-10T23:17:54.541603+0000","last_peered":"2024-09-10T23:17:54.541603+0000","last_clean":"2024-09-10T23:17:54.541603+0000","last_became_active":"2024-09-10T23:17:53.559593+0000","last_became_peered":"2024-09-10T23:17:53.559593+0000","last_unstale":"2024-09-10T23:17:54.541603+0000","last_undegraded":"2024-09-10T23:17:54.541603+0000","last_fullsized":"2024-09-10T23:17:54.541603+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:56.948906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477390+0000","last_change":"2024-09-10T23:17:52.572129+0000","last_active":"2024-09-10T23:17:55.477390+0000","last_peered":"2024-09-10T23:17:55.477390+0000","last_clean":"2024-09-10T23:17:55.477390+0000","last_became_active":"2024-09-10T23:17:52.571852+0000","last_became_peered":"2024-09-10T23:17:52.571852+0000","last_unstale":"2024-09-10T23:17:55.477390+0000","last_undegraded":"2024-09-10T23:17:55.477390+0000","last_fullsized":"2024-09-10T23:17:55.477390+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:25.388962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540659+0000","last_change":"2024-09-10T23:17:53.563186+0000","last_active":"2024-09-10T23:17:54.540659+0000","last_peered":"2024-09-10T23:17:54.540659+0000","last_clean":"2024-09-10T23:17:54.540659+0000","last_became_active":"2024-09-10T23:17:53.562911+0000","last_became_peered":"2024-09-10T23:17:53.562911+0000","last_unstale":"2024-09-10T23:17:54.540659+0000","last_undegraded":"2024-09-10T23:17:54.540659+0000","last_fullsized":"2024-09-10T23:17:54.540659+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:57.998079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478408+0000","last_change":"2024-09-10T23:17:52.570474+0000","last_active":"2024-09-10T23:17:55.478408+0000","last_peered":"2024-09-10T23:17:55.478408+0000","last_clean":"2024-09-10T23:17:55.478408+0000","last_became_active":"2024-09-10T23:17:52.570229+0000","last_became_peered":"2024-09-10T23:17:52.570229+0000","last_unstale":"2024-09-10T23:17:55.478408+0000","last_undegraded":"2024-09-10T23:17:55.478408+0000","last_fullsized":"2024-09-10T23:17:55.478408+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:45.686357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560511+0000","last_change":"2024-09-10T23:17:52.560511+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560511+0000","last_undegraded":"2024-09-10T23:17:52.560511+0000","last_fullsized":"2024-09-10T23:17:52.560511+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477566+0000","last_change":"2024-09-10T23:17:52.571527+0000","last_active":"2024-09-10T23:17:55.477566+0000","last_peered":"2024-09-10T23:17:55.477566+0000","last_clean":"2024-09-10T23:17:55.477566+0000","last_became_active":"2024-09-10T23:17:52.570946+0000","last_became_peered":"2024-09-10T23:17:52.570946+0000","last_unstale":"2024-09-10T23:17:55.477566+0000","last_undegraded":"2024-09-10T23:17:55.477566+0000","last_fullsized":"2024-09-10T23:17:55.477566+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:20.824122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541493+0000","last_change":"2024-09-10T23:17:53.556628+0000","last_active":"2024-09-10T23:17:54.541493+0000","last_peered":"2024-09-10T23:17:54.541493+0000","last_clean":"2024-09-10T23:17:54.541493+0000","last_became_active":"2024-09-10T23:17:53.556314+0000","last_became_peered":"2024-09-10T23:17:53.556314+0000","last_unstale":"2024-09-10T23:17:54.541493+0000","last_undegraded":"2024-09-10T23:17:54.541493+0000","last_fullsized":"2024-09-10T23:17:54.541493+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:45.780193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541619+0000","last_change":"2024-09-10T23:17:52.565643+0000","last_active":"2024-09-10T23:17:54.541619+0000","last_peered":"2024-09-10T23:17:54.541619+0000","last_clean":"2024-09-10T23:17:54.541619+0000","last_became_active":"2024-09-10T23:17:52.565379+0000","last_became_peered":"2024-09-10T23:17:52.565379+0000","last_unstale":"2024-09-10T23:17:54.541619+0000","last_undegraded":"2024-09-10T23:17:54.541619+0000","last_fullsized":"2024-09-10T23:17:54.541619+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:28.775557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478303+0000","last_change":"2024-09-10T23:17:53.556574+0000","last_active":"2024-09-10T23:17:55.478303+0000","last_peered":"2024-09-10T23:17:55.478303+0000","last_clean":"2024-09-10T23:17:55.478303+0000","last_became_active":"2024-09-10T23:17:53.556314+0000","last_became_peered":"2024-09-10T23:17:53.556314+0000","last_unstale":"2024-09-10T23:17:55.478303+0000","last_undegraded":"2024-09-10T23:17:55.478303+0000","last_fullsized":"2024-09-10T23:17:55.478303+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:36.485396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"91'3","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478090+0000","last_change":"2024-09-10T23:17:52.569674+0000","last_active":"2024-09-10T23:17:55.478090+0000","last_peered":"2024-09-10T23:17:55.478090+0000","last_clean":"2024-09-10T23:17:55.478090+0000","last_became_active":"2024-09-10T23:17:52.569405+0000","last_became_peered":"2024-09-10T23:17:52.569405+0000","last_unstale":"2024-09-10T23:17:55.478090+0000","last_undegraded":"2024-09-10T23:17:55.478090+0000","last_fullsized":"2024-09-10T23:17:55.478090+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:54.496199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477866+0000","last_change":"2024-09-10T23:17:53.551292+0000","last_active":"2024-09-10T23:17:55.477866+0000","last_peered":"2024-09-10T23:17:55.477866+0000","last_clean":"2024-09-10T23:17:55.477866+0000","last_became_active":"2024-09-10T23:17:53.550916+0000","last_became_peered":"2024-09-10T23:17:53.550916+0000","last_unstale":"2024-09-10T23:17:55.477866+0000","last_undegraded":"2024-09-10T23:17:55.477866+0000","last_fullsized":"2024-09-10T23:17:55.477866+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:39.164979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"91'6","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541301+0000","last_change":"2024-09-10T23:17:52.568133+0000","last_active":"2024-09-10T23:17:54.541301+0000","last_peered":"2024-09-10T23:17:54.541301+0000","last_clean":"2024-09-10T23:17:54.541301+0000","last_became_active":"2024-09-10T23:17:52.567833+0000","last_became_peered":"2024-09-10T23:17:52.567833+0000","last_unstale":"2024-09-10T23:17:54.541301+0000","last_undegraded":"2024-09-10T23:17:54.541301+0000","last_fullsized":"2024-09-10T23:17:54.541301+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:33.259359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541656+0000","last_change":"2024-09-10T23:17:53.555595+0000","last_active":"2024-09-10T23:17:54.541656+0000","last_peered":"2024-09-10T23:17:54.541656+0000","last_clean":"2024-09-10T23:17:54.541656+0000","last_became_active":"2024-09-10T23:17:53.555336+0000","last_became_peered":"2024-09-10T23:17:53.555336+0000","last_unstale":"2024-09-10T23:17:54.541656+0000","last_undegraded":"2024-09-10T23:17:54.541656+0000","last_fullsized":"2024-09-10T23:17:54.541656+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:34.435158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477939+0000","last_change":"2024-09-10T23:17:52.575370+0000","last_active":"2024-09-10T23:17:55.477939+0000","last_peered":"2024-09-10T23:17:55.477939+0000","last_clean":"2024-09-10T23:17:55.477939+0000","last_became_active":"2024-09-10T23:17:52.575116+0000","last_became_peered":"2024-09-10T23:17:52.575116+0000","last_unstale":"2024-09-10T23:17:55.477939+0000","last_undegraded":"2024-09-10T23:17:55.477939+0000","last_fullsized":"2024-09-10T23:17:55.477939+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:47.723623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477917+0000","last_change":"2024-09-10T23:17:53.557083+0000","last_active":"2024-09-10T23:17:55.477917+0000","last_peered":"2024-09-10T23:17:55.477917+0000","last_clean":"2024-09-10T23:17:55.477917+0000","last_became_active":"2024-09-10T23:17:53.556330+0000","last_became_peered":"2024-09-10T23:17:53.556330+0000","last_unstale":"2024-09-10T23:17:55.477917+0000","last_undegraded":"2024-09-10T23:17:55.477917+0000","last_fullsized":"2024-09-10T23:17:55.477917+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:25.335933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478310+0000","last_change":"2024-09-10T23:17:52.570569+0000","last_active":"2024-09-10T23:17:55.478310+0000","last_peered":"2024-09-10T23:17:55.478310+0000","last_clean":"2024-09-10T23:17:55.478310+0000","last_became_active":"2024-09-10T23:17:52.570266+0000","last_became_peered":"2024-09-10T23:17:52.570266+0000","last_unstale":"2024-09-10T23:17:55.478310+0000","last_undegraded":"2024-09-10T23:17:55.478310+0000","last_fullsized":"2024-09-10T23:17:55.478310+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:11.558545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540387+0000","last_change":"2024-09-10T23:17:53.557358+0000","last_active":"2024-09-10T23:17:54.540387+0000","last_peered":"2024-09-10T23:17:54.540387+0000","last_clean":"2024-09-10T23:17:54.540387+0000","last_became_active":"2024-09-10T23:17:53.557053+0000","last_became_peered":"2024-09-10T23:17:53.557053+0000","last_unstale":"2024-09-10T23:17:54.540387+0000","last_undegraded":"2024-09-10T23:17:54.540387+0000","last_fullsized":"2024-09-10T23:17:54.540387+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:55.181222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540720+0000","last_change":"2024-09-10T23:17:52.566896+0000","last_active":"2024-09-10T23:17:54.540720+0000","last_peered":"2024-09-10T23:17:54.540720+0000","last_clean":"2024-09-10T23:17:54.540720+0000","last_became_active":"2024-09-10T23:17:52.566614+0000","last_became_peered":"2024-09-10T23:17:52.566614+0000","last_unstale":"2024-09-10T23:17:54.540720+0000","last_undegraded":"2024-09-10T23:17:54.540720+0000","last_fullsized":"2024-09-10T23:17:54.540720+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:44.749574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477408+0000","last_change":"2024-09-10T23:17:53.554939+0000","last_active":"2024-09-10T23:17:55.477408+0000","last_peered":"2024-09-10T23:17:55.477408+0000","last_clean":"2024-09-10T23:17:55.477408+0000","last_became_active":"2024-09-10T23:17:53.554628+0000","last_became_peered":"2024-09-10T23:17:53.554628+0000","last_unstale":"2024-09-10T23:17:55.477408+0000","last_undegraded":"2024-09-10T23:17:55.477408+0000","last_fullsized":"2024-09-10T23:17:55.477408+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:17:48.513922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"91'8","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478414+0000","last_change":"2024-09-10T23:17:52.572070+0000","last_active":"2024-09-10T23:17:55.478414+0000","last_peered":"2024-09-10T23:17:55.478414+0000","last_clean":"2024-09-10T23:17:55.478414+0000","last_became_active":"2024-09-10T23:17:52.570996+0000","last_became_peered":"2024-09-10T23:17:52.570996+0000","last_unstale":"2024-09-10T23:17:55.478414+0000","last_undegraded":"2024-09-10T23:17:55.478414+0000","last_fullsized":"2024-09-10T23:17:55.478414+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:41.583773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478481+0000","last_change":"2024-09-10T23:17:53.558187+0000","last_active":"2024-09-10T23:17:55.478481+0000","last_peered":"2024-09-10T23:17:55.478481+0000","last_clean":"2024-09-10T23:17:55.478481+0000","last_became_active":"2024-09-10T23:17:53.557822+0000","last_became_peered":"2024-09-10T23:17:53.557822+0000","last_unstale":"2024-09-10T23:17:55.478481+0000","last_undegraded":"2024-09-10T23:17:55.478481+0000","last_fullsized":"2024-09-10T23:17:55.478481+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:56.948906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540894+0000","last_change":"2024-09-10T23:17:52.576217+0000","last_active":"2024-09-10T23:17:54.540894+0000","last_peered":"2024-09-10T23:17:54.540894+0000","last_clean":"2024-09-10T23:17:54.540894+0000","last_became_active":"2024-09-10T23:17:52.575912+0000","last_became_peered":"2024-09-10T23:17:52.575912+0000","last_unstale":"2024-09-10T23:17:54.540894+0000","last_undegraded":"2024-09-10T23:17:54.540894+0000","last_fullsized":"2024-09-10T23:17:54.540894+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:09.495386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540997+0000","last_change":"2024-09-10T23:17:53.553565+0000","last_active":"2024-09-10T23:17:54.540997+0000","last_peered":"2024-09-10T23:17:54.540997+0000","last_clean":"2024-09-10T23:17:54.540997+0000","last_became_active":"2024-09-10T23:17:53.553303+0000","last_became_peered":"2024-09-10T23:17:53.553303+0000","last_unstale":"2024-09-10T23:17:54.540997+0000","last_undegraded":"2024-09-10T23:17:54.540997+0000","last_fullsized":"2024-09-10T23:17:54.540997+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:21.604281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478159+0000","last_change":"2024-09-10T23:17:52.564087+0000","last_active":"2024-09-10T23:17:55.478159+0000","last_peered":"2024-09-10T23:17:55.478159+0000","last_clean":"2024-09-10T23:17:55.478159+0000","last_became_active":"2024-09-10T23:17:52.563797+0000","last_became_peered":"2024-09-10T23:17:52.563797+0000","last_unstale":"2024-09-10T23:17:55.478159+0000","last_undegraded":"2024-09-10T23:17:55.478159+0000","last_fullsized":"2024-09-10T23:17:55.478159+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:02.781778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477966+0000","last_change":"2024-09-10T23:17:53.554719+0000","last_active":"2024-09-10T23:17:55.477966+0000","last_peered":"2024-09-10T23:17:55.477966+0000","last_clean":"2024-09-10T23:17:55.477966+0000","last_became_active":"2024-09-10T23:17:53.554460+0000","last_became_peered":"2024-09-10T23:17:53.554460+0000","last_unstale":"2024-09-10T23:17:55.477966+0000","last_undegraded":"2024-09-10T23:17:55.477966+0000","last_fullsized":"2024-09-10T23:17:55.477966+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:52.272283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572500+0000","last_change":"2024-09-10T23:17:52.566947+0000","last_active":"2024-09-10T23:17:52.572500+0000","last_peered":"2024-09-10T23:17:52.572500+0000","last_clean":"2024-09-10T23:17:52.572500+0000","last_became_active":"2024-09-10T23:17:52.566704+0000","last_became_peered":"2024-09-10T23:17:52.566704+0000","last_unstale":"2024-09-10T23:17:52.572500+0000","last_undegraded":"2024-09-10T23:17:52.572500+0000","last_fullsized":"2024-09-10T23:17:52.572500+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:58.125611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478178+0000","last_change":"2024-09-10T23:17:53.551313+0000","last_active":"2024-09-10T23:17:55.478178+0000","last_peered":"2024-09-10T23:17:55.478178+0000","last_clean":"2024-09-10T23:17:55.478178+0000","last_became_active":"2024-09-10T23:17:53.550774+0000","last_became_peered":"2024-09-10T23:17:53.550774+0000","last_unstale":"2024-09-10T23:17:55.478178+0000","last_undegraded":"2024-09-10T23:17:55.478178+0000","last_fullsized":"2024-09-10T23:17:55.478178+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:33.555549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.580764+0000","last_change":"2024-09-10T23:17:52.575545+0000","last_active":"2024-09-10T23:17:52.580764+0000","last_peered":"2024-09-10T23:17:52.580764+0000","last_clean":"2024-09-10T23:17:52.580764+0000","last_became_active":"2024-09-10T23:17:52.575282+0000","last_became_peered":"2024-09-10T23:17:52.575282+0000","last_unstale":"2024-09-10T23:17:52.580764+0000","last_undegraded":"2024-09-10T23:17:52.580764+0000","last_fullsized":"2024-09-10T23:17:52.580764+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:52.940489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477947+0000","last_change":"2024-09-10T23:17:53.548656+0000","last_active":"2024-09-10T23:17:55.477947+0000","last_peered":"2024-09-10T23:17:55.477947+0000","last_clean":"2024-09-10T23:17:55.477947+0000","last_became_active":"2024-09-10T23:17:53.548388+0000","last_became_peered":"2024-09-10T23:17:53.548388+0000","last_unstale":"2024-09-10T23:17:55.477947+0000","last_undegraded":"2024-09-10T23:17:55.477947+0000","last_fullsized":"2024-09-10T23:17:55.477947+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:57.483201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541095+0000","last_change":"2024-09-10T23:17:52.569306+0000","last_active":"2024-09-10T23:17:54.541095+0000","last_peered":"2024-09-10T23:17:54.541095+0000","last_clean":"2024-09-10T23:17:54.541095+0000","last_became_active":"2024-09-10T23:17:52.569038+0000","last_became_peered":"2024-09-10T23:17:52.569038+0000","last_unstale":"2024-09-10T23:17:54.541095+0000","last_undegraded":"2024-09-10T23:17:54.541095+0000","last_fullsized":"2024-09-10T23:17:54.541095+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:34.625142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477680+0000","last_change":"2024-09-10T23:17:53.550802+0000","last_active":"2024-09-10T23:17:55.477680+0000","last_peered":"2024-09-10T23:17:55.477680+0000","last_clean":"2024-09-10T23:17:55.477680+0000","last_became_active":"2024-09-10T23:17:53.550519+0000","last_became_peered":"2024-09-10T23:17:53.550519+0000","last_unstale":"2024-09-10T23:17:55.477680+0000","last_undegraded":"2024-09-10T23:17:55.477680+0000","last_fullsized":"2024-09-10T23:17:55.477680+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:25.004260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540279+0000","last_change":"2024-09-10T23:17:52.570230+0000","last_active":"2024-09-10T23:17:54.540279+0000","last_peered":"2024-09-10T23:17:54.540279+0000","last_clean":"2024-09-10T23:17:54.540279+0000","last_became_active":"2024-09-10T23:17:52.569918+0000","last_became_peered":"2024-09-10T23:17:52.569918+0000","last_unstale":"2024-09-10T23:17:54.540279+0000","last_undegraded":"2024-09-10T23:17:54.540279+0000","last_fullsized":"2024-09-10T23:17:54.540279+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:38.853089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477272+0000","last_change":"2024-09-10T23:17:53.566019+0000","last_active":"2024-09-10T23:17:55.477272+0000","last_peered":"2024-09-10T23:17:55.477272+0000","last_clean":"2024-09-10T23:17:55.477272+0000","last_became_active":"2024-09-10T23:17:53.565331+0000","last_became_peered":"2024-09-10T23:17:53.565331+0000","last_unstale":"2024-09-10T23:17:55.477272+0000","last_undegraded":"2024-09-10T23:17:55.477272+0000","last_fullsized":"2024-09-10T23:17:55.477272+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:55.497871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.575313+0000","last_change":"2024-09-10T23:17:52.571701+0000","last_active":"2024-09-10T23:17:52.575313+0000","last_peered":"2024-09-10T23:17:52.575313+0000","last_clean":"2024-09-10T23:17:52.575313+0000","last_became_active":"2024-09-10T23:17:52.571455+0000","last_became_peered":"2024-09-10T23:17:52.571455+0000","last_unstale":"2024-09-10T23:17:52.575313+0000","last_undegraded":"2024-09-10T23:17:52.575313+0000","last_fullsized":"2024-09-10T23:17:52.575313+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:38.467005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T23:17:52.560136+0000","last_change":"2024-09-10T23:17:52.560136+0000","last_active":"2024-09-10T23:17:52.545222+0000","last_peered":"2024-09-10T23:17:52.545222+0000","last_clean":"2024-09-10T23:17:52.545222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:17:52.560136+0000","last_undegraded":"2024-09-10T23:17:52.560136+0000","last_fullsized":"2024-09-10T23:17:52.560136+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541581+0000","last_change":"2024-09-10T23:17:52.566757+0000","last_active":"2024-09-10T23:17:54.541581+0000","last_peered":"2024-09-10T23:17:54.541581+0000","last_clean":"2024-09-10T23:17:54.541581+0000","last_became_active":"2024-09-10T23:17:52.566440+0000","last_became_peered":"2024-09-10T23:17:52.566440+0000","last_unstale":"2024-09-10T23:17:54.541581+0000","last_undegraded":"2024-09-10T23:17:54.541581+0000","last_fullsized":"2024-09-10T23:17:54.541581+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:14.026848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477479+0000","last_change":"2024-09-10T23:17:53.560579+0000","last_active":"2024-09-10T23:17:55.477479+0000","last_peered":"2024-09-10T23:17:55.477479+0000","last_clean":"2024-09-10T23:17:55.477479+0000","last_became_active":"2024-09-10T23:17:53.560328+0000","last_became_peered":"2024-09-10T23:17:53.560328+0000","last_unstale":"2024-09-10T23:17:55.477479+0000","last_undegraded":"2024-09-10T23:17:55.477479+0000","last_fullsized":"2024-09-10T23:17:55.477479+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:09.110684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.572809+0000","last_change":"2024-09-10T23:17:52.569086+0000","last_active":"2024-09-10T23:17:52.572809+0000","last_peered":"2024-09-10T23:17:52.572809+0000","last_clean":"2024-09-10T23:17:52.572809+0000","last_became_active":"2024-09-10T23:17:52.568848+0000","last_became_peered":"2024-09-10T23:17:52.568848+0000","last_unstale":"2024-09-10T23:17:52.572809+0000","last_undegraded":"2024-09-10T23:17:52.572809+0000","last_fullsized":"2024-09-10T23:17:52.572809+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:33.695089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477633+0000","last_change":"2024-09-10T23:17:53.557393+0000","last_active":"2024-09-10T23:17:55.477633+0000","last_peered":"2024-09-10T23:17:55.477633+0000","last_clean":"2024-09-10T23:17:55.477633+0000","last_became_active":"2024-09-10T23:17:53.556251+0000","last_became_peered":"2024-09-10T23:17:53.556251+0000","last_unstale":"2024-09-10T23:17:55.477633+0000","last_undegraded":"2024-09-10T23:17:55.477633+0000","last_fullsized":"2024-09-10T23:17:55.477633+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:57.307923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.575071+0000","last_change":"2024-09-10T23:17:52.570424+0000","last_active":"2024-09-10T23:17:52.575071+0000","last_peered":"2024-09-10T23:17:52.575071+0000","last_clean":"2024-09-10T23:17:52.575071+0000","last_became_active":"2024-09-10T23:17:52.570165+0000","last_became_peered":"2024-09-10T23:17:52.570165+0000","last_unstale":"2024-09-10T23:17:52.575071+0000","last_undegraded":"2024-09-10T23:17:52.575071+0000","last_fullsized":"2024-09-10T23:17:52.575071+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:08.811918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477645+0000","last_change":"2024-09-10T23:17:53.564128+0000","last_active":"2024-09-10T23:17:55.477645+0000","last_peered":"2024-09-10T23:17:55.477645+0000","last_clean":"2024-09-10T23:17:55.477645+0000","last_became_active":"2024-09-10T23:17:53.563904+0000","last_became_peered":"2024-09-10T23:17:53.563904+0000","last_unstale":"2024-09-10T23:17:55.477645+0000","last_undegraded":"2024-09-10T23:17:55.477645+0000","last_fullsized":"2024-09-10T23:17:55.477645+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:25.531536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478432+0000","last_change":"2024-09-10T23:17:52.566701+0000","last_active":"2024-09-10T23:17:55.478432+0000","last_peered":"2024-09-10T23:17:55.478432+0000","last_clean":"2024-09-10T23:17:55.478432+0000","last_became_active":"2024-09-10T23:17:52.566074+0000","last_became_peered":"2024-09-10T23:17:52.566074+0000","last_unstale":"2024-09-10T23:17:55.478432+0000","last_undegraded":"2024-09-10T23:17:55.478432+0000","last_fullsized":"2024-09-10T23:17:55.478432+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:20.781641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478386+0000","last_change":"2024-09-10T23:17:53.557300+0000","last_active":"2024-09-10T23:17:55.478386+0000","last_peered":"2024-09-10T23:17:55.478386+0000","last_clean":"2024-09-10T23:17:55.478386+0000","last_became_active":"2024-09-10T23:17:53.556997+0000","last_became_peered":"2024-09-10T23:17:53.556997+0000","last_unstale":"2024-09-10T23:17:55.478386+0000","last_undegraded":"2024-09-10T23:17:55.478386+0000","last_fullsized":"2024-09-10T23:17:55.478386+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:12.740294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T23:17:52.575016+0000","last_change":"2024-09-10T23:17:52.569372+0000","last_active":"2024-09-10T23:17:52.575016+0000","last_peered":"2024-09-10T23:17:52.575016+0000","last_clean":"2024-09-10T23:17:52.575016+0000","last_became_active":"2024-09-10T23:17:52.569138+0000","last_became_peered":"2024-09-10T23:17:52.569138+0000","last_unstale":"2024-09-10T23:17:52.575016+0000","last_undegraded":"2024-09-10T23:17:52.575016+0000","last_fullsized":"2024-09-10T23:17:52.575016+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:19.835444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540543+0000","last_change":"2024-09-10T23:17:53.553407+0000","last_active":"2024-09-10T23:17:54.540543+0000","last_peered":"2024-09-10T23:17:54.540543+0000","last_clean":"2024-09-10T23:17:54.540543+0000","last_became_active":"2024-09-10T23:17:53.553115+0000","last_became_peered":"2024-09-10T23:17:53.553115+0000","last_unstale":"2024-09-10T23:17:54.540543+0000","last_undegraded":"2024-09-10T23:17:54.540543+0000","last_fullsized":"2024-09-10T23:17:54.540543+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:09.097652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477705+0000","last_change":"2024-09-10T23:17:52.568101+0000","last_active":"2024-09-10T23:17:55.477705+0000","last_peered":"2024-09-10T23:17:55.477705+0000","last_clean":"2024-09-10T23:17:55.477705+0000","last_became_active":"2024-09-10T23:17:52.567822+0000","last_became_peered":"2024-09-10T23:17:52.567822+0000","last_unstale":"2024-09-10T23:17:55.477705+0000","last_undegraded":"2024-09-10T23:17:55.477705+0000","last_fullsized":"2024-09-10T23:17:55.477705+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:01.850714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477722+0000","last_change":"2024-09-10T23:17:53.554947+0000","last_active":"2024-09-10T23:17:55.477722+0000","last_peered":"2024-09-10T23:17:55.477722+0000","last_clean":"2024-09-10T23:17:55.477722+0000","last_became_active":"2024-09-10T23:17:53.554642+0000","last_became_peered":"2024-09-10T23:17:53.554642+0000","last_unstale":"2024-09-10T23:17:55.477722+0000","last_undegraded":"2024-09-10T23:17:55.477722+0000","last_fullsized":"2024-09-10T23:17:55.477722+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:17.947754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541905+0000","last_change":"2024-09-10T23:17:52.569265+0000","last_active":"2024-09-10T23:17:54.541905+0000","last_peered":"2024-09-10T23:17:54.541905+0000","last_clean":"2024-09-10T23:17:54.541905+0000","last_became_active":"2024-09-10T23:17:52.569021+0000","last_became_peered":"2024-09-10T23:17:52.569021+0000","last_unstale":"2024-09-10T23:17:54.541905+0000","last_undegraded":"2024-09-10T23:17:54.541905+0000","last_fullsized":"2024-09-10T23:17:54.541905+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:37:36.066729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477301+0000","last_change":"2024-09-10T23:17:53.561543+0000","last_active":"2024-09-10T23:17:55.477301+0000","last_peered":"2024-09-10T23:17:55.477301+0000","last_clean":"2024-09-10T23:17:55.477301+0000","last_became_active":"2024-09-10T23:17:53.561264+0000","last_became_peered":"2024-09-10T23:17:53.561264+0000","last_unstale":"2024-09-10T23:17:55.477301+0000","last_undegraded":"2024-09-10T23:17:55.477301+0000","last_fullsized":"2024-09-10T23:17:55.477301+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:52.661481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477776+0000","last_change":"2024-09-10T23:17:52.573386+0000","last_active":"2024-09-10T23:17:55.477776+0000","last_peered":"2024-09-10T23:17:55.477776+0000","last_clean":"2024-09-10T23:17:55.477776+0000","last_became_active":"2024-09-10T23:17:52.573120+0000","last_became_peered":"2024-09-10T23:17:52.573120+0000","last_unstale":"2024-09-10T23:17:55.477776+0000","last_undegraded":"2024-09-10T23:17:55.477776+0000","last_fullsized":"2024-09-10T23:17:55.477776+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:06.971289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478299+0000","last_change":"2024-09-10T23:17:53.550292+0000","last_active":"2024-09-10T23:17:55.478299+0000","last_peered":"2024-09-10T23:17:55.478299+0000","last_clean":"2024-09-10T23:17:55.478299+0000","last_became_active":"2024-09-10T23:17:53.550026+0000","last_became_peered":"2024-09-10T23:17:53.550026+0000","last_unstale":"2024-09-10T23:17:55.478299+0000","last_undegraded":"2024-09-10T23:17:55.478299+0000","last_fullsized":"2024-09-10T23:17:55.478299+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:54.395956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477575+0000","last_change":"2024-09-10T23:17:52.569598+0000","last_active":"2024-09-10T23:17:55.477575+0000","last_peered":"2024-09-10T23:17:55.477575+0000","last_clean":"2024-09-10T23:17:55.477575+0000","last_became_active":"2024-09-10T23:17:52.569310+0000","last_became_peered":"2024-09-10T23:17:52.569310+0000","last_unstale":"2024-09-10T23:17:55.477575+0000","last_undegraded":"2024-09-10T23:17:55.477575+0000","last_fullsized":"2024-09-10T23:17:55.477575+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:58.550027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":236,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477703+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:17:55.477703+0000","last_peered":"2024-09-10T23:17:55.477703+0000","last_clean":"2024-09-10T23:17:55.477703+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:17:55.477703+0000","last_undegraded":"2024-09-10T23:17:55.477703+0000","last_fullsized":"2024-09-10T23:17:55.477703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28720,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343120,"statfs":{"total":96636764160,"available":96607354880,"internally_reserved":0,"allocated":1720320,"data_stored":1061912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1126400,"data_stored":472084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509485,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1134592,"data_stored":477802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509485,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1150976,"data_stored":479468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1146880,"data_stored":479366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1122304,"data_stored":471466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1118208,"data_stored":471432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32860,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338980,"statfs":{"total":96636764160,"available":96603115520,"internally_reserved":0,"allocated":1699840,"data_stored":1055025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:18:00.894 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:18:01.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.007+0000 7f15d92f6640 1 -- 172.21.15.90:0/2220934328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d406d6d0 msgr2=0x7f15d40cf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:01.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.007+0000 7f15d92f6640 1 --2- 172.21.15.90:0/2220934328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d406d6d0 0x7f15d40cf180 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f15cc005fd0 tx=0x7f15cc02a5c0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.007+0000 7f15d92f6640 1 -- 172.21.15.90:0/2220934328 shutdown_connections 2024-09-10T23:18:01.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.007+0000 7f15d92f6640 1 --2- 172.21.15.90:0/2220934328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d406d6d0 0x7f15d40cf180 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.007+0000 7f15d92f6640 1 --2- 172.21.15.90:0/2220934328 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15d406e750 0x7f15d40d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.007+0000 7f15d92f6640 1 -- 172.21.15.90:0/2220934328 >> 172.21.15.90:0/2220934328 conn(0x7f15d40d4090 msgr2=0x7f15d40d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:01.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.007+0000 7f15d92f6640 1 -- 172.21.15.90:0/2220934328 shutdown_connections 2024-09-10T23:18:01.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.007+0000 7f15d92f6640 1 -- 172.21.15.90:0/2220934328 wait complete. 2024-09-10T23:18:01.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.008+0000 7f15d92f6640 1 Processor -- start 2024-09-10T23:18:01.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.008+0000 7f15d92f6640 1 -- start start 2024-09-10T23:18:01.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.009+0000 7f15d92f6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15d406d6d0 0x7f15d4152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:01.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.009+0000 7f15d92f6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d406e750 0x7f15d40b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:01.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.009+0000 7f15d92f6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15d415e180 0x7f15d41f8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:01.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.009+0000 7f15d92f6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f15d40cf840 con 0x7f15d406e750 2024-09-10T23:18:01.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.009+0000 7f15d92f6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f15d40cf6c0 con 0x7f15d415e180 2024-09-10T23:18:01.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.009+0000 7f15d92f6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f15d40cf9c0 con 0x7f15d406d6d0 2024-09-10T23:18:01.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.009+0000 7f15d27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d406e750 0x7f15d40b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:01.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.009+0000 7f15d27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d406e750 0x7f15d40b5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52388/0 (socket says 172.21.15.90:52388) 2024-09-10T23:18:01.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.009+0000 7f15d27fc640 1 -- 172.21.15.90:0/4136904739 learned_addr learned my addr 172.21.15.90:0/4136904739 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:01.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.009+0000 7f15d2ffd640 1 --2- 172.21.15.90:0/4136904739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15d406d6d0 0x7f15d4152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:01.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.009+0000 7f15d37fe640 1 --2- 172.21.15.90:0/4136904739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15d415e180 0x7f15d41f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:01.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.010+0000 7f15d27fc640 1 -- 172.21.15.90:0/4136904739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15d406d6d0 msgr2=0x7f15d4152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:01.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.010+0000 7f15d27fc640 1 --2- 172.21.15.90:0/4136904739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15d406d6d0 0x7f15d4152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.010+0000 7f15d27fc640 1 -- 172.21.15.90:0/4136904739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15d415e180 msgr2=0x7f15d41f8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:01.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.010+0000 7f15d27fc640 1 --2- 172.21.15.90:0/4136904739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15d415e180 0x7f15d41f8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.010+0000 7f15d27fc640 1 -- 172.21.15.90:0/4136904739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d41f9130 con 0x7f15d406e750 2024-09-10T23:18:01.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.010+0000 7f15d37fe640 1 --2- 172.21.15.90:0/4136904739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15d415e180 0x7f15d41f8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:01.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.010+0000 7f15d27fc640 1 --2- 172.21.15.90:0/4136904739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d406e750 0x7f15d40b5e40 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f15c800c890 tx=0x7f15c800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:01.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.010+0000 7f15bb7fe640 1 -- 172.21.15.90:0/4136904739 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8004220 con 0x7f15d406e750 2024-09-10T23:18:01.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.010+0000 7f15bb7fe640 1 -- 172.21.15.90:0/4136904739 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15c80079b0 con 0x7f15d406e750 2024-09-10T23:18:01.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.010+0000 7f15bb7fe640 1 -- 172.21.15.90:0/4136904739 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8007de0 con 0x7f15d406e750 2024-09-10T23:18:01.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.010+0000 7f15d92f6640 1 -- 172.21.15.90:0/4136904739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d414fe30 con 0x7f15d406e750 2024-09-10T23:18:01.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.010+0000 7f15d92f6640 1 -- 172.21.15.90:0/4136904739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d40cce40 con 0x7f15d406e750 2024-09-10T23:18:01.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.011+0000 7f15d92f6640 1 -- 172.21.15.90:0/4136904739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d40cfee0 con 0x7f15d406e750 2024-09-10T23:18:01.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.012+0000 7f15bb7fe640 1 -- 172.21.15.90:0/4136904739 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f15c8005020 con 0x7f15d406e750 2024-09-10T23:18:01.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.012+0000 7f15bb7fe640 1 --2- 172.21.15.90:0/4136904739 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f15c0077f70 0x7f15c007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:01.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.012+0000 7f15bb7fe640 1 -- 172.21.15.90:0/4136904739 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f15c809a0e0 con 0x7f15d406e750 2024-09-10T23:18:01.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.012+0000 7f15d2ffd640 1 --2- 172.21.15.90:0/4136904739 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f15c0077f70 0x7f15c007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:01.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.013+0000 7f15d2ffd640 1 --2- 172.21.15.90:0/4136904739 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f15c0077f70 0x7f15c007a430 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f15c400b450 tx=0x7f15c400d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:01.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.016+0000 7f15bb7fe640 1 -- 172.21.15.90:0/4136904739 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f15c8014030 con 0x7f15d406e750 2024-09-10T23:18:01.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.189+0000 7f15d92f6640 1 -- 172.21.15.90:0/4136904739 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f15d40b6380 con 0x7f15c0077f70 2024-09-10T23:18:01.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.194+0000 7f15bb7fe640 1 -- 172.21.15.90:0/4136904739 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252026 (secure 0 0 0) 0x7f15d40b6380 con 0x7f15c0077f70 2024-09-10T23:18:01.197 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:01.198 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:18:01.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.197+0000 7f15d92f6640 1 -- 172.21.15.90:0/4136904739 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f15c0077f70 msgr2=0x7f15c007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:01.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.197+0000 7f15d92f6640 1 --2- 172.21.15.90:0/4136904739 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f15c0077f70 0x7f15c007a430 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f15c400b450 tx=0x7f15c400d040 comp rx=0 tx=0).stop 2024-09-10T23:18:01.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.197+0000 7f15d92f6640 1 -- 172.21.15.90:0/4136904739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d406e750 msgr2=0x7f15d40b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:01.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.197+0000 7f15d92f6640 1 --2- 172.21.15.90:0/4136904739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d406e750 0x7f15d40b5e40 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f15c800c890 tx=0x7f15c800cd50 comp rx=0 tx=0).stop 2024-09-10T23:18:01.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.197+0000 7f15d92f6640 1 -- 172.21.15.90:0/4136904739 shutdown_connections 2024-09-10T23:18:01.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.197+0000 7f15d92f6640 1 --2- 172.21.15.90:0/4136904739 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f15c0077f70 0x7f15c007a430 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.197+0000 7f15d92f6640 1 --2- 172.21.15.90:0/4136904739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15d415e180 0x7f15d41f8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.197+0000 7f15d92f6640 1 --2- 172.21.15.90:0/4136904739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15d406e750 0x7f15d40b5e40 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.197+0000 7f15d92f6640 1 --2- 172.21.15.90:0/4136904739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15d406d6d0 0x7f15d4152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.197+0000 7f15d92f6640 1 -- 172.21.15.90:0/4136904739 >> 172.21.15.90:0/4136904739 conn(0x7f15d40d4090 msgr2=0x7f15d4158260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:01.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.197+0000 7f15d92f6640 1 -- 172.21.15.90:0/4136904739 shutdown_connections 2024-09-10T23:18:01.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.197+0000 7f15d92f6640 1 -- 172.21.15.90:0/4136904739 wait complete. 2024-09-10T23:18:01.209 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-09-10T23:18:00.483232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255388,"kb_used_data":10032,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719332,"statfs":{"total":773094113280,"available":772832595968,"internally_reserved":0,"allocated":10272768,"data_stored":4994812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.927873"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477298+0000","last_change":"2024-09-10T23:17:53.560279+0000","last_active":"2024-09-10T23:17:55.477298+0000","last_peered":"2024-09-10T23:17:55.477298+0000","last_clean":"2024-09-10T23:17:55.477298+0000","last_became_active":"2024-09-10T23:17:53.556589+0000","last_became_peered":"2024-09-10T23:17:53.556589+0000","last_unstale":"2024-09-10T23:17:55.477298+0000","last_undegraded":"2024-09-10T23:17:55.477298+0000","last_fullsized":"2024-09-10T23:17:55.477298+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:20.124209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478509+0000","last_change":"2024-09-10T23:17:53.554717+0000","last_active":"2024-09-10T23:17:55.478509+0000","last_peered":"2024-09-10T23:17:55.478509+0000","last_clean":"2024-09-10T23:17:55.478509+0000","last_became_active":"2024-09-10T23:17:53.554452+0000","last_became_peered":"2024-09-10T23:17:53.554452+0000","last_unstale":"2024-09-10T23:17:55.478509+0000","last_undegraded":"2024-09-10T23:17:55.478509+0000","last_fullsized":"2024-09-10T23:17:55.478509+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:59.079452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477747+0000","last_change":"2024-09-10T23:17:53.556897+0000","last_active":"2024-09-10T23:17:55.477747+0000","last_peered":"2024-09-10T23:17:55.477747+0000","last_clean":"2024-09-10T23:17:55.477747+0000","last_became_active":"2024-09-10T23:17:53.556564+0000","last_became_peered":"2024-09-10T23:17:53.556564+0000","last_unstale":"2024-09-10T23:17:55.477747+0000","last_undegraded":"2024-09-10T23:17:55.477747+0000","last_fullsized":"2024-09-10T23:17:55.477747+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:32.013618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541845+0000","last_change":"2024-09-10T23:17:53.554128+0000","last_active":"2024-09-10T23:17:54.541845+0000","last_peered":"2024-09-10T23:17:54.541845+0000","last_clean":"2024-09-10T23:17:54.541845+0000","last_became_active":"2024-09-10T23:17:53.553837+0000","last_became_peered":"2024-09-10T23:17:53.553837+0000","last_unstale":"2024-09-10T23:17:54.541845+0000","last_undegraded":"2024-09-10T23:17:54.541845+0000","last_fullsized":"2024-09-10T23:17:54.541845+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:16.073355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478024+0000","last_change":"2024-09-10T23:17:53.561325+0000","last_active":"2024-09-10T23:17:55.478024+0000","last_peered":"2024-09-10T23:17:55.478024+0000","last_clean":"2024-09-10T23:17:55.478024+0000","last_became_active":"2024-09-10T23:17:53.561035+0000","last_became_peered":"2024-09-10T23:17:53.561035+0000","last_unstale":"2024-09-10T23:17:55.478024+0000","last_undegraded":"2024-09-10T23:17:55.478024+0000","last_fullsized":"2024-09-10T23:17:55.478024+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:05.151677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477659+0000","last_change":"2024-09-10T23:17:53.547173+0000","last_active":"2024-09-10T23:17:55.477659+0000","last_peered":"2024-09-10T23:17:55.477659+0000","last_clean":"2024-09-10T23:17:55.477659+0000","last_became_active":"2024-09-10T23:17:53.546924+0000","last_became_peered":"2024-09-10T23:17:53.546924+0000","last_unstale":"2024-09-10T23:17:55.477659+0000","last_undegraded":"2024-09-10T23:17:55.477659+0000","last_fullsized":"2024-09-10T23:17:55.477659+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:36.528978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477648+0000","last_change":"2024-09-10T23:17:53.544392+0000","last_active":"2024-09-10T23:17:55.477648+0000","last_peered":"2024-09-10T23:17:55.477648+0000","last_clean":"2024-09-10T23:17:55.477648+0000","last_became_active":"2024-09-10T23:17:53.544080+0000","last_became_peered":"2024-09-10T23:17:53.544080+0000","last_unstale":"2024-09-10T23:17:55.477648+0000","last_undegraded":"2024-09-10T23:17:55.477648+0000","last_fullsized":"2024-09-10T23:17:55.477648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:33.836216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477535+0000","last_change":"2024-09-10T23:17:53.551993+0000","last_active":"2024-09-10T23:17:55.477535+0000","last_peered":"2024-09-10T23:17:55.477535+0000","last_clean":"2024-09-10T23:17:55.477535+0000","last_became_active":"2024-09-10T23:17:53.551706+0000","last_became_peered":"2024-09-10T23:17:53.551706+0000","last_unstale":"2024-09-10T23:17:55.477535+0000","last_undegraded":"2024-09-10T23:17:55.477535+0000","last_fullsized":"2024-09-10T23:17:55.477535+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:36.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541325+0000","last_change":"2024-09-10T23:17:53.560387+0000","last_active":"2024-09-10T23:17:54.541325+0000","last_peered":"2024-09-10T23:17:54.541325+0000","last_clean":"2024-09-10T23:17:54.541325+0000","last_became_active":"2024-09-10T23:17:53.560096+0000","last_became_peered":"2024-09-10T23:17:53.560096+0000","last_unstale":"2024-09-10T23:17:54.541325+0000","last_undegraded":"2024-09-10T23:17:54.541325+0000","last_fullsized":"2024-09-10T23:17:54.541325+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:33:38.997089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477837+0000","last_change":"2024-09-10T23:17:53.565740+0000","last_active":"2024-09-10T23:17:55.477837+0000","last_peered":"2024-09-10T23:17:55.477837+0000","last_clean":"2024-09-10T23:17:55.477837+0000","last_became_active":"2024-09-10T23:17:53.565440+0000","last_became_peered":"2024-09-10T23:17:53.565440+0000","last_unstale":"2024-09-10T23:17:55.477837+0000","last_undegraded":"2024-09-10T23:17:55.477837+0000","last_fullsized":"2024-09-10T23:17:55.477837+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:27.057119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477721+0000","last_change":"2024-09-10T23:17:53.555393+0000","last_active":"2024-09-10T23:17:55.477721+0000","last_peered":"2024-09-10T23:17:55.477721+0000","last_clean":"2024-09-10T23:17:55.477721+0000","last_became_active":"2024-09-10T23:17:53.555122+0000","last_became_peered":"2024-09-10T23:17:53.555122+0000","last_unstale":"2024-09-10T23:17:55.477721+0000","last_undegraded":"2024-09-10T23:17:55.477721+0000","last_fullsized":"2024-09-10T23:17:55.477721+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:29.522521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541083+0000","last_change":"2024-09-10T23:17:53.560808+0000","last_active":"2024-09-10T23:17:54.541083+0000","last_peered":"2024-09-10T23:17:54.541083+0000","last_clean":"2024-09-10T23:17:54.541083+0000","last_became_active":"2024-09-10T23:17:53.560407+0000","last_became_peered":"2024-09-10T23:17:53.560407+0000","last_unstale":"2024-09-10T23:17:54.541083+0000","last_undegraded":"2024-09-10T23:17:54.541083+0000","last_fullsized":"2024-09-10T23:17:54.541083+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:27.057119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541860+0000","last_change":"2024-09-10T23:17:53.557682+0000","last_active":"2024-09-10T23:17:54.541860+0000","last_peered":"2024-09-10T23:17:54.541860+0000","last_clean":"2024-09-10T23:17:54.541860+0000","last_became_active":"2024-09-10T23:17:53.557417+0000","last_became_peered":"2024-09-10T23:17:53.557417+0000","last_unstale":"2024-09-10T23:17:54.541860+0000","last_undegraded":"2024-09-10T23:17:54.541860+0000","last_fullsized":"2024-09-10T23:17:54.541860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:46.228987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477985+0000","last_change":"2024-09-10T23:17:53.552624+0000","last_active":"2024-09-10T23:17:55.477985+0000","last_peered":"2024-09-10T23:17:55.477985+0000","last_clean":"2024-09-10T23:17:55.477985+0000","last_became_active":"2024-09-10T23:17:53.552371+0000","last_became_peered":"2024-09-10T23:17:53.552371+0000","last_unstale":"2024-09-10T23:17:55.477985+0000","last_undegraded":"2024-09-10T23:17:55.477985+0000","last_fullsized":"2024-09-10T23:17:55.477985+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:45.051857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541808+0000","last_change":"2024-09-10T23:17:53.559674+0000","last_active":"2024-09-10T23:17:54.541808+0000","last_peered":"2024-09-10T23:17:54.541808+0000","last_clean":"2024-09-10T23:17:54.541808+0000","last_became_active":"2024-09-10T23:17:53.559392+0000","last_became_peered":"2024-09-10T23:17:53.559392+0000","last_unstale":"2024-09-10T23:17:54.541808+0000","last_undegraded":"2024-09-10T23:17:54.541808+0000","last_fullsized":"2024-09-10T23:17:54.541808+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:33.836216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477893+0000","last_change":"2024-09-10T23:17:53.548614+0000","last_active":"2024-09-10T23:17:55.477893+0000","last_peered":"2024-09-10T23:17:55.477893+0000","last_clean":"2024-09-10T23:17:55.477893+0000","last_became_active":"2024-09-10T23:17:53.548291+0000","last_became_peered":"2024-09-10T23:17:53.548291+0000","last_unstale":"2024-09-10T23:17:55.477893+0000","last_undegraded":"2024-09-10T23:17:55.477893+0000","last_fullsized":"2024-09-10T23:17:55.477893+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:23.095017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478559+0000","last_change":"2024-09-10T23:17:53.558197+0000","last_active":"2024-09-10T23:17:55.478559+0000","last_peered":"2024-09-10T23:17:55.478559+0000","last_clean":"2024-09-10T23:17:55.478559+0000","last_became_active":"2024-09-10T23:17:53.557828+0000","last_became_peered":"2024-09-10T23:17:53.557828+0000","last_unstale":"2024-09-10T23:17:55.478559+0000","last_undegraded":"2024-09-10T23:17:55.478559+0000","last_fullsized":"2024-09-10T23:17:55.478559+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:43.394537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541749+0000","last_change":"2024-09-10T23:17:53.554180+0000","last_active":"2024-09-10T23:17:54.541749+0000","last_peered":"2024-09-10T23:17:54.541749+0000","last_clean":"2024-09-10T23:17:54.541749+0000","last_became_active":"2024-09-10T23:17:53.553901+0000","last_became_peered":"2024-09-10T23:17:53.553901+0000","last_unstale":"2024-09-10T23:17:54.541749+0000","last_undegraded":"2024-09-10T23:17:54.541749+0000","last_fullsized":"2024-09-10T23:17:54.541749+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:34.087388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477219+0000","last_change":"2024-09-10T23:17:53.557802+0000","last_active":"2024-09-10T23:17:55.477219+0000","last_peered":"2024-09-10T23:17:55.477219+0000","last_clean":"2024-09-10T23:17:55.477219+0000","last_became_active":"2024-09-10T23:17:53.557537+0000","last_became_peered":"2024-09-10T23:17:53.557537+0000","last_unstale":"2024-09-10T23:17:55.477219+0000","last_undegraded":"2024-09-10T23:17:55.477219+0000","last_fullsized":"2024-09-10T23:17:55.477219+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:07.646491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541143+0000","last_change":"2024-09-10T23:17:53.561436+0000","last_active":"2024-09-10T23:17:54.541143+0000","last_peered":"2024-09-10T23:17:54.541143+0000","last_clean":"2024-09-10T23:17:54.541143+0000","last_became_active":"2024-09-10T23:17:53.561173+0000","last_became_peered":"2024-09-10T23:17:53.561173+0000","last_unstale":"2024-09-10T23:17:54.541143+0000","last_undegraded":"2024-09-10T23:17:54.541143+0000","last_fullsized":"2024-09-10T23:17:54.541143+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:19:38.295347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477755+0000","last_change":"2024-09-10T23:17:53.545062+0000","last_active":"2024-09-10T23:17:55.477755+0000","last_peered":"2024-09-10T23:17:55.477755+0000","last_clean":"2024-09-10T23:17:55.477755+0000","last_became_active":"2024-09-10T23:17:53.544797+0000","last_became_peered":"2024-09-10T23:17:53.544797+0000","last_unstale":"2024-09-10T23:17:55.477755+0000","last_undegraded":"2024-09-10T23:17:55.477755+0000","last_fullsized":"2024-09-10T23:17:55.477755+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:31.712561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477054+0000","last_change":"2024-09-10T23:17:53.557469+0000","last_active":"2024-09-10T23:17:55.477054+0000","last_peered":"2024-09-10T23:17:55.477054+0000","last_clean":"2024-09-10T23:17:55.477054+0000","last_became_active":"2024-09-10T23:17:53.556095+0000","last_became_peered":"2024-09-10T23:17:53.556095+0000","last_unstale":"2024-09-10T23:17:55.477054+0000","last_undegraded":"2024-09-10T23:17:55.477054+0000","last_fullsized":"2024-09-10T23:17:55.477054+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:16.945454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477096+0000","last_change":"2024-09-10T23:17:53.551839+0000","last_active":"2024-09-10T23:17:55.477096+0000","last_peered":"2024-09-10T23:17:55.477096+0000","last_clean":"2024-09-10T23:17:55.477096+0000","last_became_active":"2024-09-10T23:17:53.551593+0000","last_became_peered":"2024-09-10T23:17:53.551593+0000","last_unstale":"2024-09-10T23:17:55.477096+0000","last_undegraded":"2024-09-10T23:17:55.477096+0000","last_fullsized":"2024-09-10T23:17:55.477096+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:14.186837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477630+0000","last_change":"2024-09-10T23:17:53.560079+0000","last_active":"2024-09-10T23:17:55.477630+0000","last_peered":"2024-09-10T23:17:55.477630+0000","last_clean":"2024-09-10T23:17:55.477630+0000","last_became_active":"2024-09-10T23:17:53.559507+0000","last_became_peered":"2024-09-10T23:17:53.559507+0000","last_unstale":"2024-09-10T23:17:55.477630+0000","last_undegraded":"2024-09-10T23:17:55.477630+0000","last_fullsized":"2024-09-10T23:17:55.477630+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:51.603445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478504+0000","last_change":"2024-09-10T23:17:53.563818+0000","last_active":"2024-09-10T23:17:55.478504+0000","last_peered":"2024-09-10T23:17:55.478504+0000","last_clean":"2024-09-10T23:17:55.478504+0000","last_became_active":"2024-09-10T23:17:53.563533+0000","last_became_peered":"2024-09-10T23:17:53.563533+0000","last_unstale":"2024-09-10T23:17:55.478504+0000","last_undegraded":"2024-09-10T23:17:55.478504+0000","last_fullsized":"2024-09-10T23:17:55.478504+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:34.435158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478688+0000","last_change":"2024-09-10T23:17:53.562948+0000","last_active":"2024-09-10T23:17:55.478688+0000","last_peered":"2024-09-10T23:17:55.478688+0000","last_clean":"2024-09-10T23:17:55.478688+0000","last_became_active":"2024-09-10T23:17:53.562667+0000","last_became_peered":"2024-09-10T23:17:53.562667+0000","last_unstale":"2024-09-10T23:17:55.478688+0000","last_undegraded":"2024-09-10T23:17:55.478688+0000","last_fullsized":"2024-09-10T23:17:55.478688+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:58.576114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478026+0000","last_change":"2024-09-10T23:17:53.551936+0000","last_active":"2024-09-10T23:17:55.478026+0000","last_peered":"2024-09-10T23:17:55.478026+0000","last_clean":"2024-09-10T23:17:55.478026+0000","last_became_active":"2024-09-10T23:17:53.550713+0000","last_became_peered":"2024-09-10T23:17:53.550713+0000","last_unstale":"2024-09-10T23:17:55.478026+0000","last_undegraded":"2024-09-10T23:17:55.478026+0000","last_fullsized":"2024-09-10T23:17:55.478026+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:49.704662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478330+0000","last_change":"2024-09-10T23:17:53.560875+0000","last_active":"2024-09-10T23:17:55.478330+0000","last_peered":"2024-09-10T23:17:55.478330+0000","last_clean":"2024-09-10T23:17:55.478330+0000","last_became_active":"2024-09-10T23:17:53.560567+0000","last_became_peered":"2024-09-10T23:17:53.560567+0000","last_unstale":"2024-09-10T23:17:55.478330+0000","last_undegraded":"2024-09-10T23:17:55.478330+0000","last_fullsized":"2024-09-10T23:17:55.478330+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:31.501371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478065+0000","last_change":"2024-09-10T23:17:53.562825+0000","last_active":"2024-09-10T23:17:55.478065+0000","last_peered":"2024-09-10T23:17:55.478065+0000","last_clean":"2024-09-10T23:17:55.478065+0000","last_became_active":"2024-09-10T23:17:53.562552+0000","last_became_peered":"2024-09-10T23:17:53.562552+0000","last_unstale":"2024-09-10T23:17:55.478065+0000","last_undegraded":"2024-09-10T23:17:55.478065+0000","last_fullsized":"2024-09-10T23:17:55.478065+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:43.108066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478167+0000","last_change":"2024-09-10T23:17:53.558562+0000","last_active":"2024-09-10T23:17:55.478167+0000","last_peered":"2024-09-10T23:17:55.478167+0000","last_clean":"2024-09-10T23:17:55.478167+0000","last_became_active":"2024-09-10T23:17:53.558327+0000","last_became_peered":"2024-09-10T23:17:53.558327+0000","last_unstale":"2024-09-10T23:17:55.478167+0000","last_undegraded":"2024-09-10T23:17:55.478167+0000","last_fullsized":"2024-09-10T23:17:55.478167+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:41.417295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541843+0000","last_change":"2024-09-10T23:17:53.554219+0000","last_active":"2024-09-10T23:17:54.541843+0000","last_peered":"2024-09-10T23:17:54.541843+0000","last_clean":"2024-09-10T23:17:54.541843+0000","last_became_active":"2024-09-10T23:17:53.553751+0000","last_became_peered":"2024-09-10T23:17:53.553751+0000","last_unstale":"2024-09-10T23:17:54.541843+0000","last_undegraded":"2024-09-10T23:17:54.541843+0000","last_fullsized":"2024-09-10T23:17:54.541843+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:08.996959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478297+0000","last_change":"2024-09-10T23:17:53.556628+0000","last_active":"2024-09-10T23:17:55.478297+0000","last_peered":"2024-09-10T23:17:55.478297+0000","last_clean":"2024-09-10T23:17:55.478297+0000","last_became_active":"2024-09-10T23:17:53.556310+0000","last_became_peered":"2024-09-10T23:17:53.556310+0000","last_unstale":"2024-09-10T23:17:55.478297+0000","last_undegraded":"2024-09-10T23:17:55.478297+0000","last_fullsized":"2024-09-10T23:17:55.478297+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:39.854761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478272+0000","last_change":"2024-09-10T23:17:53.544501+0000","last_active":"2024-09-10T23:17:55.478272+0000","last_peered":"2024-09-10T23:17:55.478272+0000","last_clean":"2024-09-10T23:17:55.478272+0000","last_became_active":"2024-09-10T23:17:53.544244+0000","last_became_peered":"2024-09-10T23:17:53.544244+0000","last_unstale":"2024-09-10T23:17:55.478272+0000","last_undegraded":"2024-09-10T23:17:55.478272+0000","last_fullsized":"2024-09-10T23:17:55.478272+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:46.501299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"91'4","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478608+0000","last_change":"2024-09-10T23:17:52.567737+0000","last_active":"2024-09-10T23:17:55.478608+0000","last_peered":"2024-09-10T23:17:55.478608+0000","last_clean":"2024-09-10T23:17:55.478608+0000","last_became_active":"2024-09-10T23:17:52.567475+0000","last_became_peered":"2024-09-10T23:17:52.567475+0000","last_unstale":"2024-09-10T23:17:55.478608+0000","last_undegraded":"2024-09-10T23:17:55.478608+0000","last_fullsized":"2024-09-10T23:17:55.478608+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:09.960839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541868+0000","last_change":"2024-09-10T23:17:53.553734+0000","last_active":"2024-09-10T23:17:54.541868+0000","last_peered":"2024-09-10T23:17:54.541868+0000","last_clean":"2024-09-10T23:17:54.541868+0000","last_became_active":"2024-09-10T23:17:53.553335+0000","last_became_peered":"2024-09-10T23:17:53.553335+0000","last_unstale":"2024-09-10T23:17:54.541868+0000","last_undegraded":"2024-09-10T23:17:54.541868+0000","last_fullsized":"2024-09-10T23:17:54.541868+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:36.528978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477455+0000","last_change":"2024-09-10T23:17:52.573013+0000","last_active":"2024-09-10T23:17:55.477455+0000","last_peered":"2024-09-10T23:17:55.477455+0000","last_clean":"2024-09-10T23:17:55.477455+0000","last_became_active":"2024-09-10T23:17:52.572803+0000","last_became_peered":"2024-09-10T23:17:52.572803+0000","last_unstale":"2024-09-10T23:17:55.477455+0000","last_undegraded":"2024-09-10T23:17:55.477455+0000","last_fullsized":"2024-09-10T23:17:55.477455+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:11.857169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477450+0000","last_change":"2024-09-10T23:17:53.559140+0000","last_active":"2024-09-10T23:17:55.477450+0000","last_peered":"2024-09-10T23:17:55.477450+0000","last_clean":"2024-09-10T23:17:55.477450+0000","last_became_active":"2024-09-10T23:17:53.558865+0000","last_became_peered":"2024-09-10T23:17:53.558865+0000","last_unstale":"2024-09-10T23:17:55.477450+0000","last_undegraded":"2024-09-10T23:17:55.477450+0000","last_fullsized":"2024-09-10T23:17:55.477450+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:30.481697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478473+0000","last_change":"2024-09-10T23:17:52.568443+0000","last_active":"2024-09-10T23:17:55.478473+0000","last_peered":"2024-09-10T23:17:55.478473+0000","last_clean":"2024-09-10T23:17:55.478473+0000","last_became_active":"2024-09-10T23:17:52.568203+0000","last_became_peered":"2024-09-10T23:17:52.568203+0000","last_unstale":"2024-09-10T23:17:55.478473+0000","last_undegraded":"2024-09-10T23:17:55.478473+0000","last_fullsized":"2024-09-10T23:17:55.478473+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:06.583844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541077+0000","last_change":"2024-09-10T23:17:53.560547+0000","last_active":"2024-09-10T23:17:54.541077+0000","last_peered":"2024-09-10T23:17:54.541077+0000","last_clean":"2024-09-10T23:17:54.541077+0000","last_became_active":"2024-09-10T23:17:53.560260+0000","last_became_peered":"2024-09-10T23:17:53.560260+0000","last_unstale":"2024-09-10T23:17:54.541077+0000","last_undegraded":"2024-09-10T23:17:54.541077+0000","last_fullsized":"2024-09-10T23:17:54.541077+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:02.968645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478503+0000","last_change":"2024-09-10T23:17:52.568272+0000","last_active":"2024-09-10T23:17:55.478503+0000","last_peered":"2024-09-10T23:17:55.478503+0000","last_clean":"2024-09-10T23:17:55.478503+0000","last_became_active":"2024-09-10T23:17:52.567941+0000","last_became_peered":"2024-09-10T23:17:52.567941+0000","last_unstale":"2024-09-10T23:17:55.478503+0000","last_undegraded":"2024-09-10T23:17:55.478503+0000","last_fullsized":"2024-09-10T23:17:55.478503+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:12.629252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540931+0000","last_change":"2024-09-10T23:17:53.555155+0000","last_active":"2024-09-10T23:17:54.540931+0000","last_peered":"2024-09-10T23:17:54.540931+0000","last_clean":"2024-09-10T23:17:54.540931+0000","last_became_active":"2024-09-10T23:17:53.554877+0000","last_became_peered":"2024-09-10T23:17:53.554877+0000","last_unstale":"2024-09-10T23:17:54.540931+0000","last_undegraded":"2024-09-10T23:17:54.540931+0000","last_fullsized":"2024-09-10T23:17:54.540931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:08.979105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477954+0000","last_change":"2024-09-10T23:17:52.570450+0000","last_active":"2024-09-10T23:17:55.477954+0000","last_peered":"2024-09-10T23:17:55.477954+0000","last_clean":"2024-09-10T23:17:55.477954+0000","last_became_active":"2024-09-10T23:17:52.570182+0000","last_became_peered":"2024-09-10T23:17:52.570182+0000","last_unstale":"2024-09-10T23:17:55.477954+0000","last_undegraded":"2024-09-10T23:17:55.477954+0000","last_fullsized":"2024-09-10T23:17:55.477954+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:20.967251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477601+0000","last_change":"2024-09-10T23:17:53.552719+0000","last_active":"2024-09-10T23:17:55.477601+0000","last_peered":"2024-09-10T23:17:55.477601+0000","last_clean":"2024-09-10T23:17:55.477601+0000","last_became_active":"2024-09-10T23:17:53.552447+0000","last_became_peered":"2024-09-10T23:17:53.552447+0000","last_unstale":"2024-09-10T23:17:55.477601+0000","last_undegraded":"2024-09-10T23:17:55.477601+0000","last_fullsized":"2024-09-10T23:17:55.477601+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:16.073355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477220+0000","last_change":"2024-09-10T23:17:52.572229+0000","last_active":"2024-09-10T23:17:55.477220+0000","last_peered":"2024-09-10T23:17:55.477220+0000","last_clean":"2024-09-10T23:17:55.477220+0000","last_became_active":"2024-09-10T23:17:52.571988+0000","last_became_peered":"2024-09-10T23:17:52.571988+0000","last_unstale":"2024-09-10T23:17:55.477220+0000","last_undegraded":"2024-09-10T23:17:55.477220+0000","last_fullsized":"2024-09-10T23:17:55.477220+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:56.862149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541603+0000","last_change":"2024-09-10T23:17:53.560055+0000","last_active":"2024-09-10T23:17:54.541603+0000","last_peered":"2024-09-10T23:17:54.541603+0000","last_clean":"2024-09-10T23:17:54.541603+0000","last_became_active":"2024-09-10T23:17:53.559593+0000","last_became_peered":"2024-09-10T23:17:53.559593+0000","last_unstale":"2024-09-10T23:17:54.541603+0000","last_undegraded":"2024-09-10T23:17:54.541603+0000","last_fullsized":"2024-09-10T23:17:54.541603+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:56.948906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477390+0000","last_change":"2024-09-10T23:17:52.572129+0000","last_active":"2024-09-10T23:17:55.477390+0000","last_peered":"2024-09-10T23:17:55.477390+0000","last_clean":"2024-09-10T23:17:55.477390+0000","last_became_active":"2024-09-10T23:17:52.571852+0000","last_became_peered":"2024-09-10T23:17:52.571852+0000","last_unstale":"2024-09-10T23:17:55.477390+0000","last_undegraded":"2024-09-10T23:17:55.477390+0000","last_fullsized":"2024-09-10T23:17:55.477390+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:25.388962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540659+0000","last_change":"2024-09-10T23:17:53.563186+0000","last_active":"2024-09-10T23:17:54.540659+0000","last_peered":"2024-09-10T23:17:54.540659+0000","last_clean":"2024-09-10T23:17:54.540659+0000","last_became_active":"2024-09-10T23:17:53.562911+0000","last_became_peered":"2024-09-10T23:17:53.562911+0000","last_unstale":"2024-09-10T23:17:54.540659+0000","last_undegraded":"2024-09-10T23:17:54.540659+0000","last_fullsized":"2024-09-10T23:17:54.540659+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:57.998079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478408+0000","last_change":"2024-09-10T23:17:52.570474+0000","last_active":"2024-09-10T23:17:55.478408+0000","last_peered":"2024-09-10T23:17:55.478408+0000","last_clean":"2024-09-10T23:17:55.478408+0000","last_became_active":"2024-09-10T23:17:52.570229+0000","last_became_peered":"2024-09-10T23:17:52.570229+0000","last_unstale":"2024-09-10T23:17:55.478408+0000","last_undegraded":"2024-09-10T23:17:55.478408+0000","last_fullsized":"2024-09-10T23:17:55.478408+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:45.686357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478757+0000","last_change":"2024-09-10T23:17:53.556710+0000","last_active":"2024-09-10T23:17:55.478757+0000","last_peered":"2024-09-10T23:17:55.478757+0000","last_clean":"2024-09-10T23:17:55.478757+0000","last_became_active":"2024-09-10T23:17:53.555864+0000","last_became_peered":"2024-09-10T23:17:53.555864+0000","last_unstale":"2024-09-10T23:17:55.478757+0000","last_undegraded":"2024-09-10T23:17:55.478757+0000","last_fullsized":"2024-09-10T23:17:55.478757+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:35.796312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477566+0000","last_change":"2024-09-10T23:17:52.571527+0000","last_active":"2024-09-10T23:17:55.477566+0000","last_peered":"2024-09-10T23:17:55.477566+0000","last_clean":"2024-09-10T23:17:55.477566+0000","last_became_active":"2024-09-10T23:17:52.570946+0000","last_became_peered":"2024-09-10T23:17:52.570946+0000","last_unstale":"2024-09-10T23:17:55.477566+0000","last_undegraded":"2024-09-10T23:17:55.477566+0000","last_fullsized":"2024-09-10T23:17:55.477566+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:20.824122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541493+0000","last_change":"2024-09-10T23:17:53.556628+0000","last_active":"2024-09-10T23:17:54.541493+0000","last_peered":"2024-09-10T23:17:54.541493+0000","last_clean":"2024-09-10T23:17:54.541493+0000","last_became_active":"2024-09-10T23:17:53.556314+0000","last_became_peered":"2024-09-10T23:17:53.556314+0000","last_unstale":"2024-09-10T23:17:54.541493+0000","last_undegraded":"2024-09-10T23:17:54.541493+0000","last_fullsized":"2024-09-10T23:17:54.541493+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:45.780193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541619+0000","last_change":"2024-09-10T23:17:52.565643+0000","last_active":"2024-09-10T23:17:54.541619+0000","last_peered":"2024-09-10T23:17:54.541619+0000","last_clean":"2024-09-10T23:17:54.541619+0000","last_became_active":"2024-09-10T23:17:52.565379+0000","last_became_peered":"2024-09-10T23:17:52.565379+0000","last_unstale":"2024-09-10T23:17:54.541619+0000","last_undegraded":"2024-09-10T23:17:54.541619+0000","last_fullsized":"2024-09-10T23:17:54.541619+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:28.775557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478303+0000","last_change":"2024-09-10T23:17:53.556574+0000","last_active":"2024-09-10T23:17:55.478303+0000","last_peered":"2024-09-10T23:17:55.478303+0000","last_clean":"2024-09-10T23:17:55.478303+0000","last_became_active":"2024-09-10T23:17:53.556314+0000","last_became_peered":"2024-09-10T23:17:53.556314+0000","last_unstale":"2024-09-10T23:17:55.478303+0000","last_undegraded":"2024-09-10T23:17:55.478303+0000","last_fullsized":"2024-09-10T23:17:55.478303+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:36.485396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"91'3","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478090+0000","last_change":"2024-09-10T23:17:52.569674+0000","last_active":"2024-09-10T23:17:55.478090+0000","last_peered":"2024-09-10T23:17:55.478090+0000","last_clean":"2024-09-10T23:17:55.478090+0000","last_became_active":"2024-09-10T23:17:52.569405+0000","last_became_peered":"2024-09-10T23:17:52.569405+0000","last_unstale":"2024-09-10T23:17:55.478090+0000","last_undegraded":"2024-09-10T23:17:55.478090+0000","last_fullsized":"2024-09-10T23:17:55.478090+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:54.496199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477866+0000","last_change":"2024-09-10T23:17:53.551292+0000","last_active":"2024-09-10T23:17:55.477866+0000","last_peered":"2024-09-10T23:17:55.477866+0000","last_clean":"2024-09-10T23:17:55.477866+0000","last_became_active":"2024-09-10T23:17:53.550916+0000","last_became_peered":"2024-09-10T23:17:53.550916+0000","last_unstale":"2024-09-10T23:17:55.477866+0000","last_undegraded":"2024-09-10T23:17:55.477866+0000","last_fullsized":"2024-09-10T23:17:55.477866+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:39.164979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"91'6","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541301+0000","last_change":"2024-09-10T23:17:52.568133+0000","last_active":"2024-09-10T23:17:54.541301+0000","last_peered":"2024-09-10T23:17:54.541301+0000","last_clean":"2024-09-10T23:17:54.541301+0000","last_became_active":"2024-09-10T23:17:52.567833+0000","last_became_peered":"2024-09-10T23:17:52.567833+0000","last_unstale":"2024-09-10T23:17:54.541301+0000","last_undegraded":"2024-09-10T23:17:54.541301+0000","last_fullsized":"2024-09-10T23:17:54.541301+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:33.259359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541656+0000","last_change":"2024-09-10T23:17:53.555595+0000","last_active":"2024-09-10T23:17:54.541656+0000","last_peered":"2024-09-10T23:17:54.541656+0000","last_clean":"2024-09-10T23:17:54.541656+0000","last_became_active":"2024-09-10T23:17:53.555336+0000","last_became_peered":"2024-09-10T23:17:53.555336+0000","last_unstale":"2024-09-10T23:17:54.541656+0000","last_undegraded":"2024-09-10T23:17:54.541656+0000","last_fullsized":"2024-09-10T23:17:54.541656+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:34.435158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477939+0000","last_change":"2024-09-10T23:17:52.575370+0000","last_active":"2024-09-10T23:17:55.477939+0000","last_peered":"2024-09-10T23:17:55.477939+0000","last_clean":"2024-09-10T23:17:55.477939+0000","last_became_active":"2024-09-10T23:17:52.575116+0000","last_became_peered":"2024-09-10T23:17:52.575116+0000","last_unstale":"2024-09-10T23:17:55.477939+0000","last_undegraded":"2024-09-10T23:17:55.477939+0000","last_fullsized":"2024-09-10T23:17:55.477939+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:47.723623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477917+0000","last_change":"2024-09-10T23:17:53.557083+0000","last_active":"2024-09-10T23:17:55.477917+0000","last_peered":"2024-09-10T23:17:55.477917+0000","last_clean":"2024-09-10T23:17:55.477917+0000","last_became_active":"2024-09-10T23:17:53.556330+0000","last_became_peered":"2024-09-10T23:17:53.556330+0000","last_unstale":"2024-09-10T23:17:55.477917+0000","last_undegraded":"2024-09-10T23:17:55.477917+0000","last_fullsized":"2024-09-10T23:17:55.477917+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:25.335933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478310+0000","last_change":"2024-09-10T23:17:52.570569+0000","last_active":"2024-09-10T23:17:55.478310+0000","last_peered":"2024-09-10T23:17:55.478310+0000","last_clean":"2024-09-10T23:17:55.478310+0000","last_became_active":"2024-09-10T23:17:52.570266+0000","last_became_peered":"2024-09-10T23:17:52.570266+0000","last_unstale":"2024-09-10T23:17:55.478310+0000","last_undegraded":"2024-09-10T23:17:55.478310+0000","last_fullsized":"2024-09-10T23:17:55.478310+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:11.558545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540387+0000","last_change":"2024-09-10T23:17:53.557358+0000","last_active":"2024-09-10T23:17:54.540387+0000","last_peered":"2024-09-10T23:17:54.540387+0000","last_clean":"2024-09-10T23:17:54.540387+0000","last_became_active":"2024-09-10T23:17:53.557053+0000","last_became_peered":"2024-09-10T23:17:53.557053+0000","last_unstale":"2024-09-10T23:17:54.540387+0000","last_undegraded":"2024-09-10T23:17:54.540387+0000","last_fullsized":"2024-09-10T23:17:54.540387+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:55.181222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540720+0000","last_change":"2024-09-10T23:17:52.566896+0000","last_active":"2024-09-10T23:17:54.540720+0000","last_peered":"2024-09-10T23:17:54.540720+0000","last_clean":"2024-09-10T23:17:54.540720+0000","last_became_active":"2024-09-10T23:17:52.566614+0000","last_became_peered":"2024-09-10T23:17:52.566614+0000","last_unstale":"2024-09-10T23:17:54.540720+0000","last_undegraded":"2024-09-10T23:17:54.540720+0000","last_fullsized":"2024-09-10T23:17:54.540720+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:44.749574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477408+0000","last_change":"2024-09-10T23:17:53.554939+0000","last_active":"2024-09-10T23:17:55.477408+0000","last_peered":"2024-09-10T23:17:55.477408+0000","last_clean":"2024-09-10T23:17:55.477408+0000","last_became_active":"2024-09-10T23:17:53.554628+0000","last_became_peered":"2024-09-10T23:17:53.554628+0000","last_unstale":"2024-09-10T23:17:55.477408+0000","last_undegraded":"2024-09-10T23:17:55.477408+0000","last_fullsized":"2024-09-10T23:17:55.477408+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:17:48.513922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"91'8","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478414+0000","last_change":"2024-09-10T23:17:52.572070+0000","last_active":"2024-09-10T23:17:55.478414+0000","last_peered":"2024-09-10T23:17:55.478414+0000","last_clean":"2024-09-10T23:17:55.478414+0000","last_became_active":"2024-09-10T23:17:52.570996+0000","last_became_peered":"2024-09-10T23:17:52.570996+0000","last_unstale":"2024-09-10T23:17:55.478414+0000","last_undegraded":"2024-09-10T23:17:55.478414+0000","last_fullsized":"2024-09-10T23:17:55.478414+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:41.583773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478481+0000","last_change":"2024-09-10T23:17:53.558187+0000","last_active":"2024-09-10T23:17:55.478481+0000","last_peered":"2024-09-10T23:17:55.478481+0000","last_clean":"2024-09-10T23:17:55.478481+0000","last_became_active":"2024-09-10T23:17:53.557822+0000","last_became_peered":"2024-09-10T23:17:53.557822+0000","last_unstale":"2024-09-10T23:17:55.478481+0000","last_undegraded":"2024-09-10T23:17:55.478481+0000","last_fullsized":"2024-09-10T23:17:55.478481+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:56.948906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540894+0000","last_change":"2024-09-10T23:17:52.576217+0000","last_active":"2024-09-10T23:17:54.540894+0000","last_peered":"2024-09-10T23:17:54.540894+0000","last_clean":"2024-09-10T23:17:54.540894+0000","last_became_active":"2024-09-10T23:17:52.575912+0000","last_became_peered":"2024-09-10T23:17:52.575912+0000","last_unstale":"2024-09-10T23:17:54.540894+0000","last_undegraded":"2024-09-10T23:17:54.540894+0000","last_fullsized":"2024-09-10T23:17:54.540894+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:09.495386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540997+0000","last_change":"2024-09-10T23:17:53.553565+0000","last_active":"2024-09-10T23:17:54.540997+0000","last_peered":"2024-09-10T23:17:54.540997+0000","last_clean":"2024-09-10T23:17:54.540997+0000","last_became_active":"2024-09-10T23:17:53.553303+0000","last_became_peered":"2024-09-10T23:17:53.553303+0000","last_unstale":"2024-09-10T23:17:54.540997+0000","last_undegraded":"2024-09-10T23:17:54.540997+0000","last_fullsized":"2024-09-10T23:17:54.540997+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:21.604281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478159+0000","last_change":"2024-09-10T23:17:52.564087+0000","last_active":"2024-09-10T23:17:55.478159+0000","last_peered":"2024-09-10T23:17:55.478159+0000","last_clean":"2024-09-10T23:17:55.478159+0000","last_became_active":"2024-09-10T23:17:52.563797+0000","last_became_peered":"2024-09-10T23:17:52.563797+0000","last_unstale":"2024-09-10T23:17:55.478159+0000","last_undegraded":"2024-09-10T23:17:55.478159+0000","last_fullsized":"2024-09-10T23:17:55.478159+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:02.781778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477966+0000","last_change":"2024-09-10T23:17:53.554719+0000","last_active":"2024-09-10T23:17:55.477966+0000","last_peered":"2024-09-10T23:17:55.477966+0000","last_clean":"2024-09-10T23:17:55.477966+0000","last_became_active":"2024-09-10T23:17:53.554460+0000","last_became_peered":"2024-09-10T23:17:53.554460+0000","last_unstale":"2024-09-10T23:17:55.477966+0000","last_undegraded":"2024-09-10T23:17:55.477966+0000","last_fullsized":"2024-09-10T23:17:55.477966+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:52.272283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478598+0000","last_change":"2024-09-10T23:17:52.566947+0000","last_active":"2024-09-10T23:17:55.478598+0000","last_peered":"2024-09-10T23:17:55.478598+0000","last_clean":"2024-09-10T23:17:55.478598+0000","last_became_active":"2024-09-10T23:17:52.566704+0000","last_became_peered":"2024-09-10T23:17:52.566704+0000","last_unstale":"2024-09-10T23:17:55.478598+0000","last_undegraded":"2024-09-10T23:17:55.478598+0000","last_fullsized":"2024-09-10T23:17:55.478598+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:36.184390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478178+0000","last_change":"2024-09-10T23:17:53.551313+0000","last_active":"2024-09-10T23:17:55.478178+0000","last_peered":"2024-09-10T23:17:55.478178+0000","last_clean":"2024-09-10T23:17:55.478178+0000","last_became_active":"2024-09-10T23:17:53.550774+0000","last_became_peered":"2024-09-10T23:17:53.550774+0000","last_unstale":"2024-09-10T23:17:55.478178+0000","last_undegraded":"2024-09-10T23:17:55.478178+0000","last_fullsized":"2024-09-10T23:17:55.478178+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:33.555549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478209+0000","last_change":"2024-09-10T23:17:52.575545+0000","last_active":"2024-09-10T23:17:55.478209+0000","last_peered":"2024-09-10T23:17:55.478209+0000","last_clean":"2024-09-10T23:17:55.478209+0000","last_became_active":"2024-09-10T23:17:52.575282+0000","last_became_peered":"2024-09-10T23:17:52.575282+0000","last_unstale":"2024-09-10T23:17:55.478209+0000","last_undegraded":"2024-09-10T23:17:55.478209+0000","last_fullsized":"2024-09-10T23:17:55.478209+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:58.395064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477947+0000","last_change":"2024-09-10T23:17:53.548656+0000","last_active":"2024-09-10T23:17:55.477947+0000","last_peered":"2024-09-10T23:17:55.477947+0000","last_clean":"2024-09-10T23:17:55.477947+0000","last_became_active":"2024-09-10T23:17:53.548388+0000","last_became_peered":"2024-09-10T23:17:53.548388+0000","last_unstale":"2024-09-10T23:17:55.477947+0000","last_undegraded":"2024-09-10T23:17:55.477947+0000","last_fullsized":"2024-09-10T23:17:55.477947+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:57.483201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541095+0000","last_change":"2024-09-10T23:17:52.569306+0000","last_active":"2024-09-10T23:17:54.541095+0000","last_peered":"2024-09-10T23:17:54.541095+0000","last_clean":"2024-09-10T23:17:54.541095+0000","last_became_active":"2024-09-10T23:17:52.569038+0000","last_became_peered":"2024-09-10T23:17:52.569038+0000","last_unstale":"2024-09-10T23:17:54.541095+0000","last_undegraded":"2024-09-10T23:17:54.541095+0000","last_fullsized":"2024-09-10T23:17:54.541095+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:34.625142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477680+0000","last_change":"2024-09-10T23:17:53.550802+0000","last_active":"2024-09-10T23:17:55.477680+0000","last_peered":"2024-09-10T23:17:55.477680+0000","last_clean":"2024-09-10T23:17:55.477680+0000","last_became_active":"2024-09-10T23:17:53.550519+0000","last_became_peered":"2024-09-10T23:17:53.550519+0000","last_unstale":"2024-09-10T23:17:55.477680+0000","last_undegraded":"2024-09-10T23:17:55.477680+0000","last_fullsized":"2024-09-10T23:17:55.477680+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:25.004260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540279+0000","last_change":"2024-09-10T23:17:52.570230+0000","last_active":"2024-09-10T23:17:54.540279+0000","last_peered":"2024-09-10T23:17:54.540279+0000","last_clean":"2024-09-10T23:17:54.540279+0000","last_became_active":"2024-09-10T23:17:52.569918+0000","last_became_peered":"2024-09-10T23:17:52.569918+0000","last_unstale":"2024-09-10T23:17:54.540279+0000","last_undegraded":"2024-09-10T23:17:54.540279+0000","last_fullsized":"2024-09-10T23:17:54.540279+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:38.853089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477272+0000","last_change":"2024-09-10T23:17:53.566019+0000","last_active":"2024-09-10T23:17:55.477272+0000","last_peered":"2024-09-10T23:17:55.477272+0000","last_clean":"2024-09-10T23:17:55.477272+0000","last_became_active":"2024-09-10T23:17:53.565331+0000","last_became_peered":"2024-09-10T23:17:53.565331+0000","last_unstale":"2024-09-10T23:17:55.477272+0000","last_undegraded":"2024-09-10T23:17:55.477272+0000","last_fullsized":"2024-09-10T23:17:55.477272+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:55.497871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477666+0000","last_change":"2024-09-10T23:17:52.571701+0000","last_active":"2024-09-10T23:17:55.477666+0000","last_peered":"2024-09-10T23:17:55.477666+0000","last_clean":"2024-09-10T23:17:55.477666+0000","last_became_active":"2024-09-10T23:17:52.571455+0000","last_became_peered":"2024-09-10T23:17:52.571455+0000","last_unstale":"2024-09-10T23:17:55.477666+0000","last_undegraded":"2024-09-10T23:17:55.477666+0000","last_fullsized":"2024-09-10T23:17:55.477666+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:34.915898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478802+0000","last_change":"2024-09-10T23:17:53.551733+0000","last_active":"2024-09-10T23:17:55.478802+0000","last_peered":"2024-09-10T23:17:55.478802+0000","last_clean":"2024-09-10T23:17:55.478802+0000","last_became_active":"2024-09-10T23:17:53.551489+0000","last_became_peered":"2024-09-10T23:17:53.551489+0000","last_unstale":"2024-09-10T23:17:55.478802+0000","last_undegraded":"2024-09-10T23:17:55.478802+0000","last_fullsized":"2024-09-10T23:17:55.478802+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:32.049143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541581+0000","last_change":"2024-09-10T23:17:52.566757+0000","last_active":"2024-09-10T23:17:54.541581+0000","last_peered":"2024-09-10T23:17:54.541581+0000","last_clean":"2024-09-10T23:17:54.541581+0000","last_became_active":"2024-09-10T23:17:52.566440+0000","last_became_peered":"2024-09-10T23:17:52.566440+0000","last_unstale":"2024-09-10T23:17:54.541581+0000","last_undegraded":"2024-09-10T23:17:54.541581+0000","last_fullsized":"2024-09-10T23:17:54.541581+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:14.026848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477479+0000","last_change":"2024-09-10T23:17:53.560579+0000","last_active":"2024-09-10T23:17:55.477479+0000","last_peered":"2024-09-10T23:17:55.477479+0000","last_clean":"2024-09-10T23:17:55.477479+0000","last_became_active":"2024-09-10T23:17:53.560328+0000","last_became_peered":"2024-09-10T23:17:53.560328+0000","last_unstale":"2024-09-10T23:17:55.477479+0000","last_undegraded":"2024-09-10T23:17:55.477479+0000","last_fullsized":"2024-09-10T23:17:55.477479+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:09.110684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"92'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478910+0000","last_change":"2024-09-10T23:17:52.569086+0000","last_active":"2024-09-10T23:17:55.478910+0000","last_peered":"2024-09-10T23:17:55.478910+0000","last_clean":"2024-09-10T23:17:55.478910+0000","last_became_active":"2024-09-10T23:17:52.568848+0000","last_became_peered":"2024-09-10T23:17:52.568848+0000","last_unstale":"2024-09-10T23:17:55.478910+0000","last_undegraded":"2024-09-10T23:17:55.478910+0000","last_fullsized":"2024-09-10T23:17:55.478910+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:46:31.496657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477633+0000","last_change":"2024-09-10T23:17:53.557393+0000","last_active":"2024-09-10T23:17:55.477633+0000","last_peered":"2024-09-10T23:17:55.477633+0000","last_clean":"2024-09-10T23:17:55.477633+0000","last_became_active":"2024-09-10T23:17:53.556251+0000","last_became_peered":"2024-09-10T23:17:53.556251+0000","last_unstale":"2024-09-10T23:17:55.477633+0000","last_undegraded":"2024-09-10T23:17:55.477633+0000","last_fullsized":"2024-09-10T23:17:55.477633+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:57.307923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478575+0000","last_change":"2024-09-10T23:17:52.570424+0000","last_active":"2024-09-10T23:17:55.478575+0000","last_peered":"2024-09-10T23:17:55.478575+0000","last_clean":"2024-09-10T23:17:55.478575+0000","last_became_active":"2024-09-10T23:17:52.570165+0000","last_became_peered":"2024-09-10T23:17:52.570165+0000","last_unstale":"2024-09-10T23:17:55.478575+0000","last_undegraded":"2024-09-10T23:17:55.478575+0000","last_fullsized":"2024-09-10T23:17:55.478575+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:16.192330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477645+0000","last_change":"2024-09-10T23:17:53.564128+0000","last_active":"2024-09-10T23:17:55.477645+0000","last_peered":"2024-09-10T23:17:55.477645+0000","last_clean":"2024-09-10T23:17:55.477645+0000","last_became_active":"2024-09-10T23:17:53.563904+0000","last_became_peered":"2024-09-10T23:17:53.563904+0000","last_unstale":"2024-09-10T23:17:55.477645+0000","last_undegraded":"2024-09-10T23:17:55.477645+0000","last_fullsized":"2024-09-10T23:17:55.477645+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:25.531536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478432+0000","last_change":"2024-09-10T23:17:52.566701+0000","last_active":"2024-09-10T23:17:55.478432+0000","last_peered":"2024-09-10T23:17:55.478432+0000","last_clean":"2024-09-10T23:17:55.478432+0000","last_became_active":"2024-09-10T23:17:52.566074+0000","last_became_peered":"2024-09-10T23:17:52.566074+0000","last_unstale":"2024-09-10T23:17:55.478432+0000","last_undegraded":"2024-09-10T23:17:55.478432+0000","last_fullsized":"2024-09-10T23:17:55.478432+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:20.781641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478386+0000","last_change":"2024-09-10T23:17:53.557300+0000","last_active":"2024-09-10T23:17:55.478386+0000","last_peered":"2024-09-10T23:17:55.478386+0000","last_clean":"2024-09-10T23:17:55.478386+0000","last_became_active":"2024-09-10T23:17:53.556997+0000","last_became_peered":"2024-09-10T23:17:53.556997+0000","last_unstale":"2024-09-10T23:17:55.478386+0000","last_undegraded":"2024-09-10T23:17:55.478386+0000","last_fullsized":"2024-09-10T23:17:55.478386+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:12.740294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478307+0000","last_change":"2024-09-10T23:17:52.569372+0000","last_active":"2024-09-10T23:17:55.478307+0000","last_peered":"2024-09-10T23:17:55.478307+0000","last_clean":"2024-09-10T23:17:55.478307+0000","last_became_active":"2024-09-10T23:17:52.569138+0000","last_became_peered":"2024-09-10T23:17:52.569138+0000","last_unstale":"2024-09-10T23:17:55.478307+0000","last_undegraded":"2024-09-10T23:17:55.478307+0000","last_fullsized":"2024-09-10T23:17:55.478307+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:23.822158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.540543+0000","last_change":"2024-09-10T23:17:53.553407+0000","last_active":"2024-09-10T23:17:54.540543+0000","last_peered":"2024-09-10T23:17:54.540543+0000","last_clean":"2024-09-10T23:17:54.540543+0000","last_became_active":"2024-09-10T23:17:53.553115+0000","last_became_peered":"2024-09-10T23:17:53.553115+0000","last_unstale":"2024-09-10T23:17:54.540543+0000","last_undegraded":"2024-09-10T23:17:54.540543+0000","last_fullsized":"2024-09-10T23:17:54.540543+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:09.097652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477705+0000","last_change":"2024-09-10T23:17:52.568101+0000","last_active":"2024-09-10T23:17:55.477705+0000","last_peered":"2024-09-10T23:17:55.477705+0000","last_clean":"2024-09-10T23:17:55.477705+0000","last_became_active":"2024-09-10T23:17:52.567822+0000","last_became_peered":"2024-09-10T23:17:52.567822+0000","last_unstale":"2024-09-10T23:17:55.477705+0000","last_undegraded":"2024-09-10T23:17:55.477705+0000","last_fullsized":"2024-09-10T23:17:55.477705+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:01.850714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477722+0000","last_change":"2024-09-10T23:17:53.554947+0000","last_active":"2024-09-10T23:17:55.477722+0000","last_peered":"2024-09-10T23:17:55.477722+0000","last_clean":"2024-09-10T23:17:55.477722+0000","last_became_active":"2024-09-10T23:17:53.554642+0000","last_became_peered":"2024-09-10T23:17:53.554642+0000","last_unstale":"2024-09-10T23:17:55.477722+0000","last_undegraded":"2024-09-10T23:17:55.477722+0000","last_fullsized":"2024-09-10T23:17:55.477722+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:17.947754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:54.541905+0000","last_change":"2024-09-10T23:17:52.569265+0000","last_active":"2024-09-10T23:17:54.541905+0000","last_peered":"2024-09-10T23:17:54.541905+0000","last_clean":"2024-09-10T23:17:54.541905+0000","last_became_active":"2024-09-10T23:17:52.569021+0000","last_became_peered":"2024-09-10T23:17:52.569021+0000","last_unstale":"2024-09-10T23:17:54.541905+0000","last_undegraded":"2024-09-10T23:17:54.541905+0000","last_fullsized":"2024-09-10T23:17:54.541905+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:37:36.066729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477301+0000","last_change":"2024-09-10T23:17:53.561543+0000","last_active":"2024-09-10T23:17:55.477301+0000","last_peered":"2024-09-10T23:17:55.477301+0000","last_clean":"2024-09-10T23:17:55.477301+0000","last_became_active":"2024-09-10T23:17:53.561264+0000","last_became_peered":"2024-09-10T23:17:53.561264+0000","last_unstale":"2024-09-10T23:17:55.477301+0000","last_undegraded":"2024-09-10T23:17:55.477301+0000","last_fullsized":"2024-09-10T23:17:55.477301+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:52.661481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477776+0000","last_change":"2024-09-10T23:17:52.573386+0000","last_active":"2024-09-10T23:17:55.477776+0000","last_peered":"2024-09-10T23:17:55.477776+0000","last_clean":"2024-09-10T23:17:55.477776+0000","last_became_active":"2024-09-10T23:17:52.573120+0000","last_became_peered":"2024-09-10T23:17:52.573120+0000","last_unstale":"2024-09-10T23:17:55.477776+0000","last_undegraded":"2024-09-10T23:17:55.477776+0000","last_fullsized":"2024-09-10T23:17:55.477776+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:06.971289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.478299+0000","last_change":"2024-09-10T23:17:53.550292+0000","last_active":"2024-09-10T23:17:55.478299+0000","last_peered":"2024-09-10T23:17:55.478299+0000","last_clean":"2024-09-10T23:17:55.478299+0000","last_became_active":"2024-09-10T23:17:53.550026+0000","last_became_peered":"2024-09-10T23:17:53.550026+0000","last_unstale":"2024-09-10T23:17:55.478299+0000","last_undegraded":"2024-09-10T23:17:55.478299+0000","last_fullsized":"2024-09-10T23:17:55.478299+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:52.545222+0000","last_clean_scrub_stamp":"2024-09-10T23:17:52.545222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:54.395956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477575+0000","last_change":"2024-09-10T23:17:52.569598+0000","last_active":"2024-09-10T23:17:55.477575+0000","last_peered":"2024-09-10T23:17:55.477575+0000","last_clean":"2024-09-10T23:17:55.477575+0000","last_became_active":"2024-09-10T23:17:52.569310+0000","last_became_peered":"2024-09-10T23:17:52.569310+0000","last_unstale":"2024-09-10T23:17:55.477575+0000","last_undegraded":"2024-09-10T23:17:55.477575+0000","last_fullsized":"2024-09-10T23:17:55.477575+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:17:51.543550+0000","last_clean_scrub_stamp":"2024-09-10T23:17:51.543550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:58.550027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":236,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T23:17:55.477703+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:17:55.477703+0000","last_peered":"2024-09-10T23:17:55.477703+0000","last_clean":"2024-09-10T23:17:55.477703+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:17:55.477703+0000","last_undegraded":"2024-09-10T23:17:55.477703+0000","last_fullsized":"2024-09-10T23:17:55.477703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28720,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343120,"statfs":{"total":96636764160,"available":96607354880,"internally_reserved":0,"allocated":1732608,"data_stored":1068212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1138688,"data_stored":478384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1134592,"data_stored":477802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1150976,"data_stored":479468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1146880,"data_stored":479366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1122304,"data_stored":471466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1118208,"data_stored":471432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32876,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338964,"statfs":{"total":96636764160,"available":96603099136,"internally_reserved":0,"allocated":1728512,"data_stored":1068682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:18:01.212 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:18:01.212 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:18:01.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.357+0000 7fcefd5d3640 1 -- 172.21.15.90:0/3673307567 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef80d38d0 msgr2=0x7fcef80d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:01.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.357+0000 7fcefd5d3640 1 --2- 172.21.15.90:0/3673307567 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef80d38d0 0x7fcef80d0fc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009830 tx=0x7fcef002a480 comp rx=0 tx=0).stop 2024-09-10T23:18:01.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.357+0000 7fcefd5d3640 1 -- 172.21.15.90:0/3673307567 shutdown_connections 2024-09-10T23:18:01.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.357+0000 7fcefd5d3640 1 --2- 172.21.15.90:0/3673307567 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef80d38d0 0x7fcef80d0fc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.357+0000 7fcefd5d3640 1 --2- 172.21.15.90:0/3673307567 >> v2:172.21.15.171:3300/0 conn(0x7fcef815e310 0x7fcef80d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.357+0000 7fcefd5d3640 1 -- 172.21.15.90:0/3673307567 >> 172.21.15.90:0/3673307567 conn(0x7fcef80d4090 msgr2=0x7fcef80d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:01.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.357+0000 7fcefd5d3640 1 -- 172.21.15.90:0/3673307567 shutdown_connections 2024-09-10T23:18:01.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.357+0000 7fcefd5d3640 1 -- 172.21.15.90:0/3673307567 wait complete. 2024-09-10T23:18:01.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.358+0000 7fcefd5d3640 1 Processor -- start 2024-09-10T23:18:01.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.358+0000 7fcefd5d3640 1 -- start start 2024-09-10T23:18:01.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcefd5d3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef80d16f0 0x7fcef81f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:01.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcefd5d3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcef80d38d0 0x7fcef8157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:01.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcefd5d3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcef815e310 0x7fcef815ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:01.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcefd5d3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcef806de00 con 0x7fcef80d38d0 2024-09-10T23:18:01.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcefd5d3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcef80d4d90 con 0x7fcef815e310 2024-09-10T23:18:01.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcefd5d3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcef806df80 con 0x7fcef80d16f0 2024-09-10T23:18:01.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcef67fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcef80d38d0 0x7fcef8157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:01.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcef67fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcef80d38d0 0x7fcef8157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52398/0 (socket says 172.21.15.90:52398) 2024-09-10T23:18:01.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcef67fc640 1 -- 172.21.15.90:0/1383619718 learned_addr learned my addr 172.21.15.90:0/1383619718 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:01.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcef6ffd640 1 --2- 172.21.15.90:0/1383619718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef80d16f0 0x7fcef81f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:01.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcef77fe640 1 --2- 172.21.15.90:0/1383619718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcef815e310 0x7fcef815ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:01.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcef67fc640 1 -- 172.21.15.90:0/1383619718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef80d16f0 msgr2=0x7fcef81f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:01.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcef67fc640 1 --2- 172.21.15.90:0/1383619718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef80d16f0 0x7fcef81f57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcef67fc640 1 -- 172.21.15.90:0/1383619718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcef815e310 msgr2=0x7fcef815ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:01.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcef67fc640 1 --2- 172.21.15.90:0/1383619718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcef815e310 0x7fcef815ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcef67fc640 1 -- 172.21.15.90:0/1383619718 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef81f5d10 con 0x7fcef80d38d0 2024-09-10T23:18:01.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcef67fc640 1 --2- 172.21.15.90:0/1383619718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcef80d38d0 0x7fcef8157010 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fcee000c480 tx=0x7fcee000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:01.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fceef7fe640 1 -- 172.21.15.90:0/1383619718 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee0016020 con 0x7fcef80d38d0 2024-09-10T23:18:01.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fceef7fe640 1 -- 172.21.15.90:0/1383619718 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcee0012920 con 0x7fcef80d38d0 2024-09-10T23:18:01.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fcefd5d3640 1 -- 172.21.15.90:0/1383619718 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcef8157a10 con 0x7fcef80d38d0 2024-09-10T23:18:01.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.359+0000 7fceef7fe640 1 -- 172.21.15.90:0/1383619718 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee0012d70 con 0x7fcef80d38d0 2024-09-10T23:18:01.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.360+0000 7fcefd5d3640 1 -- 172.21.15.90:0/1383619718 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcef8157fd0 con 0x7fcef80d38d0 2024-09-10T23:18:01.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.360+0000 7fcefd5d3640 1 -- 172.21.15.90:0/1383619718 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcef806f1b0 con 0x7fcef80d38d0 2024-09-10T23:18:01.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.361+0000 7fceef7fe640 1 -- 172.21.15.90:0/1383619718 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcee001b400 con 0x7fcef80d38d0 2024-09-10T23:18:01.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.362+0000 7fceef7fe640 1 --2- 172.21.15.90:0/1383619718 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fced8077fa0 0x7fced807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:01.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.362+0000 7fceef7fe640 1 -- 172.21.15.90:0/1383619718 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fcee0099dd0 con 0x7fcef80d38d0 2024-09-10T23:18:01.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.362+0000 7fcef6ffd640 1 --2- 172.21.15.90:0/1383619718 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fced8077fa0 0x7fced807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:01.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.362+0000 7fcef6ffd640 1 --2- 172.21.15.90:0/1383619718 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fced8077fa0 0x7fced807a460 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcee80099a0 tx=0x7fcee8009500 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:01.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.366+0000 7fceef7fe640 1 -- 172.21.15.90:0/1383619718 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcef806f1b0 con 0x7fcef80d38d0 2024-09-10T23:18:01.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.612+0000 7fcefd5d3640 1 -- 172.21.15.90:0/1383619718 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fcef8069690 con 0x7fcef80d38d0 2024-09-10T23:18:01.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.614+0000 7fceef7fe640 1 -- 172.21.15.90:0/1383619718 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v30) ==== 190+0+147 (secure 0 0 0) 0x7fcee009b0b0 con 0x7fcef80d38d0 2024-09-10T23:18:01.615 INFO:teuthology.orchestra.run.smithi090.stdout:[client.0] 2024-09-10T23:18:01.615 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCX0uBmiYBwBhAABMV9erpQ+KZlTmf0kDZ0gw== 2024-09-10T23:18:01.615 INFO:teuthology.orchestra.run.smithi090.stdout: caps mds = "allow" 2024-09-10T23:18:01.615 INFO:teuthology.orchestra.run.smithi090.stdout: caps mon = "allow r" 2024-09-10T23:18:01.615 INFO:teuthology.orchestra.run.smithi090.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:18:01.615 INFO:teuthology.orchestra.run.smithi090.stderr:updated caps for client.0 2024-09-10T23:18:01.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.616+0000 7fcefd5d3640 1 -- 172.21.15.90:0/1383619718 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fced8077fa0 msgr2=0x7fced807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:01.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.616+0000 7fcefd5d3640 1 --2- 172.21.15.90:0/1383619718 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fced8077fa0 0x7fced807a460 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcee80099a0 tx=0x7fcee8009500 comp rx=0 tx=0).stop 2024-09-10T23:18:01.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.616+0000 7fcefd5d3640 1 -- 172.21.15.90:0/1383619718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcef80d38d0 msgr2=0x7fcef8157010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:01.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.616+0000 7fcefd5d3640 1 --2- 172.21.15.90:0/1383619718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcef80d38d0 0x7fcef8157010 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fcee000c480 tx=0x7fcee000c940 comp rx=0 tx=0).stop 2024-09-10T23:18:01.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.616+0000 7fcefd5d3640 1 -- 172.21.15.90:0/1383619718 shutdown_connections 2024-09-10T23:18:01.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.616+0000 7fcefd5d3640 1 --2- 172.21.15.90:0/1383619718 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fced8077fa0 0x7fced807a460 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.616+0000 7fcefd5d3640 1 --2- 172.21.15.90:0/1383619718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcef815e310 0x7fcef815ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.616+0000 7fcefd5d3640 1 --2- 172.21.15.90:0/1383619718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcef80d38d0 0x7fcef8157010 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.616+0000 7fcefd5d3640 1 --2- 172.21.15.90:0/1383619718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef80d16f0 0x7fcef81f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.616+0000 7fcefd5d3640 1 -- 172.21.15.90:0/1383619718 >> 172.21.15.90:0/1383619718 conn(0x7fcef80d4090 msgr2=0x7fcef80b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:01.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.616+0000 7fcefd5d3640 1 -- 172.21.15.90:0/1383619718 shutdown_connections 2024-09-10T23:18:01.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.616+0000 7fcefd5d3640 1 -- 172.21.15.90:0/1383619718 wait complete. 2024-09-10T23:18:01.628 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:01.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.728+0000 7f9f0ff5d640 1 -- 172.21.15.90:0/917386551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f080cf860 msgr2=0x7f9f0815e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:01.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.728+0000 7f9f0ff5d640 1 --2- 172.21.15.90:0/917386551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f080cf860 0x7f9f0815e180 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8005fd0 tx=0x7f9ef802a530 comp rx=0 tx=0).stop 2024-09-10T23:18:01.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.728+0000 7f9f0ff5d640 1 -- 172.21.15.90:0/917386551 shutdown_connections 2024-09-10T23:18:01.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.728+0000 7f9f0ff5d640 1 --2- 172.21.15.90:0/917386551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f080cf860 0x7f9f0815e180 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.728+0000 7f9f0ff5d640 1 --2- 172.21.15.90:0/917386551 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f080b44a0 0x7f9f080b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.728+0000 7f9f0ff5d640 1 -- 172.21.15.90:0/917386551 >> 172.21.15.90:0/917386551 conn(0x7f9f080b19c0 msgr2=0x7f9f080b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:01.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.728+0000 7f9f0ff5d640 1 -- 172.21.15.90:0/917386551 shutdown_connections 2024-09-10T23:18:01.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.728+0000 7f9f0ff5d640 1 -- 172.21.15.90:0/917386551 wait complete. 2024-09-10T23:18:01.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.729+0000 7f9f0ff5d640 1 Processor -- start 2024-09-10T23:18:01.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.729+0000 7f9f0ff5d640 1 -- start start 2024-09-10T23:18:01.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.730+0000 7f9f0ff5d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f080b44a0 0x7f9f0814bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:01.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.730+0000 7f9f0ff5d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f080cd470 0x7f9f081f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:01.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.730+0000 7f9f0ff5d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f080cf860 0x7f9f080cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.730+0000 7f9f0ff5d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9f080ced20 con 0x7f9f080cf860 2024-09-10T23:18:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.730+0000 7f9f0ff5d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9f080ceba0 con 0x7f9f080b44a0 2024-09-10T23:18:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.730+0000 7f9f0ff5d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9f0815a8c0 con 0x7f9f080cd470 2024-09-10T23:18:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.730+0000 7f9f0e4fa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f080cf860 0x7f9f080cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.730+0000 7f9f0e4fa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f080cf860 0x7f9f080cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52414/0 (socket says 172.21.15.90:52414) 2024-09-10T23:18:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.730+0000 7f9f0e4fa640 1 -- 172.21.15.90:0/4106232162 learned_addr learned my addr 172.21.15.90:0/4106232162 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.730+0000 7f9f0d4f8640 1 --2- 172.21.15.90:0/4106232162 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f080cd470 0x7f9f081f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.730+0000 7f9f0dcf9640 1 --2- 172.21.15.90:0/4106232162 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f080b44a0 0x7f9f0814bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.731+0000 7f9f0e4fa640 1 -- 172.21.15.90:0/4106232162 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f080cd470 msgr2=0x7f9f081f8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.731+0000 7f9f0e4fa640 1 --2- 172.21.15.90:0/4106232162 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f080cd470 0x7f9f081f8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.731+0000 7f9f0e4fa640 1 -- 172.21.15.90:0/4106232162 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f080b44a0 msgr2=0x7f9f0814bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.731+0000 7f9f0e4fa640 1 --2- 172.21.15.90:0/4106232162 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f080b44a0 0x7f9f0814bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.731+0000 7f9f0e4fa640 1 -- 172.21.15.90:0/4106232162 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0814c420 con 0x7f9f080cf860 2024-09-10T23:18:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.731+0000 7f9f0e4fa640 1 --2- 172.21.15.90:0/4106232162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f080cf860 0x7f9f080cde00 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000c390 tx=0x7f9f0000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:01.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.731+0000 7f9efe7fc640 1 -- 172.21.15.90:0/4106232162 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00017070 con 0x7f9f080cf860 2024-09-10T23:18:01.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.731+0000 7f9efe7fc640 1 -- 172.21.15.90:0/4106232162 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f000035f0 con 0x7f9f080cf860 2024-09-10T23:18:01.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.731+0000 7f9efe7fc640 1 -- 172.21.15.90:0/4106232162 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00003a40 con 0x7f9f080cf860 2024-09-10T23:18:01.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.731+0000 7f9f0ff5d640 1 -- 172.21.15.90:0/4106232162 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0814c700 con 0x7f9f080cf860 2024-09-10T23:18:01.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.731+0000 7f9f0ff5d640 1 -- 172.21.15.90:0/4106232162 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f080ce340 con 0x7f9f080cf860 2024-09-10T23:18:01.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.732+0000 7f9f0ff5d640 1 -- 172.21.15.90:0/4106232162 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f081f4ec0 con 0x7f9f080cf860 2024-09-10T23:18:01.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.732+0000 7f9efe7fc640 1 -- 172.21.15.90:0/4106232162 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9f00003be0 con 0x7f9f080cf860 2024-09-10T23:18:01.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.733+0000 7f9efe7fc640 1 --2- 172.21.15.90:0/4106232162 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9eec077f70 0x7f9eec07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:01.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.733+0000 7f9efe7fc640 1 -- 172.21.15.90:0/4106232162 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f9f00099350 con 0x7f9f080cf860 2024-09-10T23:18:01.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.733+0000 7f9f0dcf9640 1 --2- 172.21.15.90:0/4106232162 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9eec077f70 0x7f9eec07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:01.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.734+0000 7f9f0dcf9640 1 --2- 172.21.15.90:0/4106232162 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9eec077f70 0x7f9eec07a430 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9f08159fc0 tx=0x7f9f040094f0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:01.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.737+0000 7f9efe7fc640 1 -- 172.21.15.90:0/4106232162 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9f00061ee0 con 0x7f9f080cf860 2024-09-10T23:18:01.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.946+0000 7f9f0ff5d640 1 -- 172.21.15.90:0/4106232162 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f0815eeb0 con 0x7f9f080cf860 2024-09-10T23:18:01.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.946+0000 7f9efe7fc640 1 -- 172.21.15.90:0/4106232162 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5222 (secure 0 0 0) 0x7f9f000617e0 con 0x7f9f080cf860 2024-09-10T23:18:01.947 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:01.947 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":51,"btime":"2024-09-10T23:17:55:561728+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5741,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/991470791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":991470791},{"type":"v1","addr":"172.21.15.171:6836","nonce":991470791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6037,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/372190727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":372190727},{"type":"v1","addr":"172.21.15.171:6837","nonce":372190727}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/970952744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":970952744},{"type":"v1","addr":"172.21.15.90:6834","nonce":970952744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:52.907365+0000","modified":"2024-09-10T23:17:54.899883+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/3653031756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":3653031756},{"type":"v1","addr":"172.21.15.90:6835","nonce":3653031756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6714,"qdb_cluster":[6714]},"id":7}]} 2024-09-10T23:18:01.948 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 51 2024-09-10T23:18:01.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.948+0000 7f9f0ff5d640 1 -- 172.21.15.90:0/4106232162 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9eec077f70 msgr2=0x7f9eec07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.948+0000 7f9f0ff5d640 1 --2- 172.21.15.90:0/4106232162 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9eec077f70 0x7f9eec07a430 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9f08159fc0 tx=0x7f9f040094f0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.948+0000 7f9f0ff5d640 1 -- 172.21.15.90:0/4106232162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f080cf860 msgr2=0x7f9f080cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.948+0000 7f9f0ff5d640 1 --2- 172.21.15.90:0/4106232162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f080cf860 0x7f9f080cde00 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000c390 tx=0x7f9f0000c850 comp rx=0 tx=0).stop 2024-09-10T23:18:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.948+0000 7f9f0ff5d640 1 -- 172.21.15.90:0/4106232162 shutdown_connections 2024-09-10T23:18:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.948+0000 7f9f0ff5d640 1 --2- 172.21.15.90:0/4106232162 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9eec077f70 0x7f9eec07a430 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.948+0000 7f9f0ff5d640 1 --2- 172.21.15.90:0/4106232162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f080cf860 0x7f9f080cde00 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.948+0000 7f9f0ff5d640 1 --2- 172.21.15.90:0/4106232162 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f080cd470 0x7f9f081f8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.948+0000 7f9f0ff5d640 1 --2- 172.21.15.90:0/4106232162 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f080b44a0 0x7f9f0814bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.948+0000 7f9f0ff5d640 1 -- 172.21.15.90:0/4106232162 >> 172.21.15.90:0/4106232162 conn(0x7f9f080b19c0 msgr2=0x7f9f080cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.948+0000 7f9f0ff5d640 1 -- 172.21.15.90:0/4106232162 shutdown_connections 2024-09-10T23:18:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:01.948+0000 7f9f0ff5d640 1 -- 172.21.15.90:0/4106232162 wait complete. 2024-09-10T23:18:02.363 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:17:52.907365+0000', 'modified': '2024-09-10T23:17:54.899883+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6714}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6714': {'gid': 6714, 'name': 'a', 'rank': 0, 'incarnation': 49, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.90:6835/3653031756', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6833', 'nonce': 3653031756}, {'type': 'v1', 'addr': '172.21.15.90:6835', 'nonce': 3653031756}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6714, 'qdb_cluster': [6714]} 2024-09-10T23:18:02.363 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:18:02.363 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T23:18:02.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.467+0000 7f51c8f17640 1 -- 172.21.15.90:0/705973515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51c40d1190 msgr2=0x7f51c40d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:02.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.467+0000 7f51c8f17640 1 --2- 172.21.15.90:0/705973515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51c40d1190 0x7f51c40d28c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f51ac005fd0 tx=0x7f51ac02a540 comp rx=0 tx=0).stop 2024-09-10T23:18:02.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.467+0000 7f51c8f17640 1 -- 172.21.15.90:0/705973515 shutdown_connections 2024-09-10T23:18:02.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.467+0000 7f51c8f17640 1 --2- 172.21.15.90:0/705973515 >> v2:172.21.15.171:3300/0 conn(0x7f51c40d16f0 0x7f51c40d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.467+0000 7f51c8f17640 1 --2- 172.21.15.90:0/705973515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51c40d1190 0x7f51c40d28c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.467+0000 7f51c8f17640 1 -- 172.21.15.90:0/705973515 >> 172.21.15.90:0/705973515 conn(0x7f51c40d4090 msgr2=0x7f51c40d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:02.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.467+0000 7f51c8f17640 1 -- 172.21.15.90:0/705973515 shutdown_connections 2024-09-10T23:18:02.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.467+0000 7f51c8f17640 1 -- 172.21.15.90:0/705973515 wait complete. 2024-09-10T23:18:02.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.468+0000 7f51c8f17640 1 Processor -- start 2024-09-10T23:18:02.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.468+0000 7f51c8f17640 1 -- start start 2024-09-10T23:18:02.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.469+0000 7f51c8f17640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51c40d1190 0x7f51c41582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.469+0000 7f51c8f17640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51c40d16f0 0x7f51c41f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.469+0000 7f51c8f17640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51c415e310 0x7f51c40cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.469+0000 7f51c8f17640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51c40d3340 con 0x7f51c415e310 2024-09-10T23:18:02.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.469+0000 7f51c8f17640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f51c40d4d90 con 0x7f51c40d16f0 2024-09-10T23:18:02.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.469+0000 7f51c8f17640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f51c40d34c0 con 0x7f51c40d1190 2024-09-10T23:18:02.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.469+0000 7f51c2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51c415e310 0x7f51c40cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.469+0000 7f51c2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51c415e310 0x7f51c40cb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52422/0 (socket says 172.21.15.90:52422) 2024-09-10T23:18:02.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.469+0000 7f51c2d9d640 1 -- 172.21.15.90:0/2042421407 learned_addr learned my addr 172.21.15.90:0/2042421407 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:02.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.470+0000 7f51c1d9b640 1 --2- 172.21.15.90:0/2042421407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51c40d16f0 0x7f51c41f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.470+0000 7f51c259c640 1 --2- 172.21.15.90:0/2042421407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51c40d1190 0x7f51c41582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.470+0000 7f51c2d9d640 1 -- 172.21.15.90:0/2042421407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51c40d1190 msgr2=0x7f51c41582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:02.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.470+0000 7f51c2d9d640 1 --2- 172.21.15.90:0/2042421407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51c40d1190 0x7f51c41582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.470+0000 7f51c2d9d640 1 -- 172.21.15.90:0/2042421407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51c40d16f0 msgr2=0x7f51c41f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:02.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.470+0000 7f51c2d9d640 1 --2- 172.21.15.90:0/2042421407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51c40d16f0 0x7f51c41f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.470+0000 7f51c2d9d640 1 -- 172.21.15.90:0/2042421407 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c41612f0 con 0x7f51c415e310 2024-09-10T23:18:02.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.470+0000 7f51c2d9d640 1 --2- 172.21.15.90:0/2042421407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51c415e310 0x7f51c40cb610 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00eb10 tx=0x7f51bc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:02.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.470+0000 7f51baffd640 1 -- 172.21.15.90:0/2042421407 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc004b20 con 0x7f51c415e310 2024-09-10T23:18:02.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.470+0000 7f51baffd640 1 -- 172.21.15.90:0/2042421407 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51bc004ce0 con 0x7f51c415e310 2024-09-10T23:18:02.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.470+0000 7f51c8f17640 1 -- 172.21.15.90:0/2042421407 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c41615b0 con 0x7f51c415e310 2024-09-10T23:18:02.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.470+0000 7f51baffd640 1 -- 172.21.15.90:0/2042421407 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc005280 con 0x7f51c415e310 2024-09-10T23:18:02.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.470+0000 7f51c8f17640 1 -- 172.21.15.90:0/2042421407 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c41f8cf0 con 0x7f51c415e310 2024-09-10T23:18:02.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.472+0000 7f51baffd640 1 -- 172.21.15.90:0/2042421407 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f51bc005420 con 0x7f51c415e310 2024-09-10T23:18:02.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.473+0000 7f51baffd640 1 --2- 172.21.15.90:0/2042421407 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f51a4077f70 0x7f51a407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.473+0000 7f51baffd640 1 -- 172.21.15.90:0/2042421407 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f51bc09aae0 con 0x7f51c415e310 2024-09-10T23:18:02.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.473+0000 7f51c259c640 1 --2- 172.21.15.90:0/2042421407 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f51a4077f70 0x7f51a407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.473+0000 7f51cbdc5740 1 Processor -- start 2024-09-10T23:18:02.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.473+0000 7f51c259c640 1 --2- 172.21.15.90:0/2042421407 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f51a4077f70 0x7f51a407a430 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f51c4161280 tx=0x7f51b4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:02.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.473+0000 7f51cbdc5740 1 -- start start 2024-09-10T23:18:02.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.474+0000 7f51cbdc5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c411b0 0x55fac1c18b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.474+0000 7f51cbdc5740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c60df0 0x55fac1c611f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.474+0000 7f51cbdc5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c165f0 0x55fac1c16a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.474+0000 7f51cbdc5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55fac1b8d820 con 0x55fac1c411b0 2024-09-10T23:18:02.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.474+0000 7f51cbdc5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55fac1b7cc50 con 0x55fac1c165f0 2024-09-10T23:18:02.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.474+0000 7f51cbdc5740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55fac1b80a60 con 0x55fac1c60df0 2024-09-10T23:18:02.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.474+0000 7f51c259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c411b0 0x55fac1c18b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.474+0000 7f51c259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c411b0 0x55fac1c18b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52430/0 (socket says 172.21.15.90:52430) 2024-09-10T23:18:02.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.474+0000 7f51c259c640 1 -- 172.21.15.90:0/3442379588 learned_addr learned my addr 172.21.15.90:0/3442379588 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:02.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.474+0000 7f51c1d9b640 1 --2- 172.21.15.90:0/3442379588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c60df0 0x55fac1c611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.474+0000 7f51c2d9d640 1 --2- 172.21.15.90:0/3442379588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c165f0 0x55fac1c16a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.475+0000 7f51c259c640 1 -- 172.21.15.90:0/3442379588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c60df0 msgr2=0x55fac1c611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:02.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.475+0000 7f51c259c640 1 --2- 172.21.15.90:0/3442379588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c60df0 0x55fac1c611f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.475+0000 7f51c259c640 1 -- 172.21.15.90:0/3442379588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c165f0 msgr2=0x55fac1c16a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:02.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.475+0000 7f51c259c640 1 --2- 172.21.15.90:0/3442379588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c165f0 0x55fac1c16a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.475+0000 7f51c259c640 1 -- 172.21.15.90:0/3442379588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fac18de850 con 0x55fac1c411b0 2024-09-10T23:18:02.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.475+0000 7f51c259c640 1 --2- 172.21.15.90:0/3442379588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c411b0 0x55fac1c18b20 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f51b40052b0 tx=0x7f51b4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad58dc9e949a728 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:02.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.475+0000 7f51a3fff640 1 -- 172.21.15.90:0/3442379588 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b4021450 con 0x55fac1c411b0 2024-09-10T23:18:02.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.475+0000 7f51a3fff640 1 -- 172.21.15.90:0/3442379588 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51b40216e0 con 0x55fac1c411b0 2024-09-10T23:18:02.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.475+0000 7f51a3fff640 1 -- 172.21.15.90:0/3442379588 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b4021ad0 con 0x55fac1c411b0 2024-09-10T23:18:02.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.476+0000 7f51cbdc5740 1 -- 172.21.15.90:0/3442379588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c411b0 msgr2=0x55fac1c18b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:02.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.476+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/3442379588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c411b0 0x55fac1c18b20 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f51b40052b0 tx=0x7f51b4011000 comp rx=0 tx=0).stop 2024-09-10T23:18:02.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.476+0000 7f51cbdc5740 1 -- 172.21.15.90:0/3442379588 shutdown_connections 2024-09-10T23:18:02.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.476+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/3442379588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c165f0 0x55fac1c16a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.476+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/3442379588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c60df0 0x55fac1c611f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.476+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/3442379588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c411b0 0x55fac1c18b20 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.476+0000 7f51cbdc5740 1 -- 172.21.15.90:0/3442379588 >> 172.21.15.90:0/3442379588 conn(0x55fac1c176a0 msgr2=0x55fac1c1b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:02.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.476+0000 7f51cbdc5740 1 -- 172.21.15.90:0/3442379588 shutdown_connections 2024-09-10T23:18:02.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.476+0000 7f51cbdc5740 1 -- 172.21.15.90:0/3442379588 wait complete. 2024-09-10T23:18:02.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.476+0000 7f51cbdc5740 1 -- start start 2024-09-10T23:18:02.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.476+0000 7f51cbdc5740 1 Processor -- start 2024-09-10T23:18:02.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.477+0000 7f51cbdc5740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c411b0 0x55fac1c59880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.477+0000 7f51cbdc5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c60df0 0x55fac1c38c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.477+0000 7f51cbdc5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c394f0 0x55fac1c3a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.477+0000 7f51cbdc5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55fac18ed620 con 0x55fac1c60df0 2024-09-10T23:18:02.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.477+0000 7f51cbdc5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55fac1b225f0 con 0x55fac1c394f0 2024-09-10T23:18:02.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.477+0000 7f51cbdc5740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55fac1c15b30 con 0x55fac1c411b0 2024-09-10T23:18:02.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.477+0000 7f51cbdc5740 10 client.0 _ll_register_callbacks cb 0x55fac1b260a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:02.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.477+0000 7f51c1d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c60df0 0x55fac1c38c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.477+0000 7f51c1d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c60df0 0x55fac1c38c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52440/0 (socket says 172.21.15.90:52440) 2024-09-10T23:18:02.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.477+0000 7f51c1d9b640 1 -- 172.21.15.90:0/196993662 learned_addr learned my addr 172.21.15.90:0/196993662 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:02.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51c259c640 1 --2- 172.21.15.90:0/196993662 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c411b0 0x55fac1c59880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51c2d9d640 1 --2- 172.21.15.90:0/196993662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c394f0 0x55fac1c3a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51c1d9b640 1 -- 172.21.15.90:0/196993662 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c411b0 msgr2=0x55fac1c59880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:02.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51c1d9b640 1 --2- 172.21.15.90:0/196993662 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c411b0 0x55fac1c59880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51c1d9b640 1 -- 172.21.15.90:0/196993662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c394f0 msgr2=0x55fac1c3a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:02.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51c1d9b640 1 --2- 172.21.15.90:0/196993662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c394f0 0x55fac1c3a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51c1d9b640 1 -- 172.21.15.90:0/196993662 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fac19556b0 con 0x55fac1c60df0 2024-09-10T23:18:02.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51c1d9b640 1 --2- 172.21.15.90:0/196993662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c60df0 0x55fac1c38c60 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009850 tx=0x7f51ac003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135067ca3a5af580 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:02.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:18:02.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51a17fa640 1 -- 172.21.15.90:0/196993662 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ac035070 con 0x55fac1c60df0 2024-09-10T23:18:02.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51a17fa640 1 -- 172.21.15.90:0/196993662 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f51ac003c10 con 0x55fac1c60df0 2024-09-10T23:18:02.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51cbdc5740 1 -- 172.21.15.90:0/196993662 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51b40216e0 con 0x55fac1c60df0 2024-09-10T23:18:02.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51a17fa640 1 -- 172.21.15.90:0/196993662 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f51ac005d50 con 0x55fac1c60df0 2024-09-10T23:18:02.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51cbdc5740 10 client.6852 fetch_fsmap learned FSMap version 51 2024-09-10T23:18:02.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51cbdc5740 1 -- 172.21.15.90:0/196993662 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) -- 0x55fac1c3bfb0 con 0x55fac1c60df0 2024-09-10T23:18:02.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51a17fa640 1 -- 172.21.15.90:0/196993662 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51b40216e0 con 0x55fac1c60df0 2024-09-10T23:18:02.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51a17fa640 1 -- 172.21.15.90:0/196993662 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 51) ==== 3502+0+0 (secure 0 0 0) 0x7f51ac03b430 con 0x55fac1c60df0 2024-09-10T23:18:02.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51cbdc5740 10 client.6852 fetch_fsmap finished waiting for FSMap version 51 2024-09-10T23:18:02.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51cbdc5740 10 client.6852 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:18:02.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51cbdc5740 20 client.6852 populate_metadata read hostname 'smithi090' 2024-09-10T23:18:02.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/196993662 >> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] conn(0x55fac1c732b0 0x55fac1c56e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51cbdc5740 4 client.6852 mds_command: new command op to 6714 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:18:02.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.478+0000 7f51cbdc5740 1 -- 172.21.15.90:0/196993662 --> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fac1b8f770 con 0x55fac1c732b0 2024-09-10T23:18:02.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.479+0000 7f51c259c640 1 --2- 172.21.15.90:0/196993662 >> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] conn(0x55fac1c732b0 0x55fac1c56e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.479+0000 7f51a17fa640 10 client.6852 ms_handle_connect on v2:172.21.15.90:6833/3653031756 2024-09-10T23:18:02.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.479+0000 7f51c259c640 1 --2- 172.21.15.90:0/196993662 >> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] conn(0x55fac1c732b0 0x55fac1c56e70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cb382bb07cbd6ec server_cookie=b68afe68e4600dc9 in_seq=0 out_seq=0 2024-09-10T23:18:02.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.479+0000 7f51a17fa640 1 -- 172.21.15.90:0/196993662 <== mds.0 v2:172.21.15.90:6833/3653031756 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fac1b8f770 con 0x55fac1c732b0 2024-09-10T23:18:02.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.479+0000 7f51a17fa640 10 client.6852 handle_command_reply: tid=0 2024-09-10T23:18:02.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.480+0000 7f51cbdc5740 1 client.6852 shutdown 2024-09-10T23:18:02.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.480+0000 7f51cbdc5740 1 -- 172.21.15.90:0/196993662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c60df0 msgr2=0x55fac1c38c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:02.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.480+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/196993662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c60df0 0x55fac1c38c60 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009850 tx=0x7f51ac003820 comp rx=0 tx=0).stop 2024-09-10T23:18:02.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.480+0000 7f51cbdc5740 1 -- 172.21.15.90:0/196993662 shutdown_connections 2024-09-10T23:18:02.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.480+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/196993662 >> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] conn(0x55fac1c732b0 0x55fac1c56e70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.480+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/196993662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c394f0 0x55fac1c3a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.480+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/196993662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c60df0 0x55fac1c38c60 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.480+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/196993662 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c411b0 0x55fac1c59880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.480+0000 7f51a17fa640 0 client.6852 ms_handle_reset on v2:172.21.15.90:6833/3653031756 2024-09-10T23:18:02.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.480+0000 7f51cbdc5740 1 -- 172.21.15.90:0/196993662 >> 172.21.15.90:0/196993662 conn(0x55fac1c165f0 msgr2=0x55fac1c1aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:02.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.480+0000 7f51cbdc5740 1 -- 172.21.15.90:0/196993662 shutdown_connections 2024-09-10T23:18:02.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.480+0000 7f51cbdc5740 1 -- 172.21.15.90:0/196993662 wait complete. 2024-09-10T23:18:02.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.480+0000 7f51cbdc5740 20 client.6852 trim_cache size 0 max 16384 2024-09-10T23:18:02.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.498+0000 7f51cbdc5740 1 Processor -- start 2024-09-10T23:18:02.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.498+0000 7f51cbdc5740 1 -- start start 2024-09-10T23:18:02.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.498+0000 7f51cbdc5740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c394f0 0x55fac1c38b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.498+0000 7f51cbdc5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c411b0 0x55fac1c57070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.498+0000 7f51cbdc5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c60df0 0x55fac1c575b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.498+0000 7f51cbdc5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51c4200420 con 0x55fac1c411b0 2024-09-10T23:18:02.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.498+0000 7f51cbdc5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f51c415fad0 con 0x55fac1c60df0 2024-09-10T23:18:02.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.498+0000 7f51cbdc5740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f51c4160120 con 0x55fac1c394f0 2024-09-10T23:18:02.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.499+0000 7f51c1d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c411b0 0x55fac1c57070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.499+0000 7f51c1d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c411b0 0x55fac1c57070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52444/0 (socket says 172.21.15.90:52444) 2024-09-10T23:18:02.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.499+0000 7f51c1d9b640 1 -- 172.21.15.90:0/3533558880 learned_addr learned my addr 172.21.15.90:0/3533558880 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:02.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.499+0000 7f51c1d9b640 1 -- 172.21.15.90:0/3533558880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c394f0 msgr2=0x55fac1c38b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:02.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.499+0000 7f51c1d9b640 1 --2- 172.21.15.90:0/3533558880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c394f0 0x55fac1c38b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.499+0000 7f51c1d9b640 1 -- 172.21.15.90:0/3533558880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c60df0 msgr2=0x55fac1c575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:02.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.499+0000 7f51c1d9b640 1 --2- 172.21.15.90:0/3533558880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c60df0 0x55fac1c575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.499+0000 7f51c1d9b640 1 -- 172.21.15.90:0/3533558880 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fac1c17300 con 0x55fac1c411b0 2024-09-10T23:18:02.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.499+0000 7f51c1d9b640 1 --2- 172.21.15.90:0/3533558880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c411b0 0x55fac1c57070 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f51ac004410 tx=0x7f51ac02a540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b630940f05d14168 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:02.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.499+0000 7f51a37fe640 1 -- 172.21.15.90:0/3533558880 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ac035070 con 0x55fac1c411b0 2024-09-10T23:18:02.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.499+0000 7f51a37fe640 1 -- 172.21.15.90:0/3533558880 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51ac03b540 con 0x55fac1c411b0 2024-09-10T23:18:02.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.499+0000 7f51a37fe640 1 -- 172.21.15.90:0/3533558880 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ac03bb70 con 0x55fac1c411b0 2024-09-10T23:18:02.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.500+0000 7f51cbdc5740 1 -- 172.21.15.90:0/3533558880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c411b0 msgr2=0x55fac1c57070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:02.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.500+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/3533558880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c411b0 0x55fac1c57070 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f51ac004410 tx=0x7f51ac02a540 comp rx=0 tx=0).stop 2024-09-10T23:18:02.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.500+0000 7f51cbdc5740 1 -- 172.21.15.90:0/3533558880 shutdown_connections 2024-09-10T23:18:02.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.500+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/3533558880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c60df0 0x55fac1c575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.500+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/3533558880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c411b0 0x55fac1c57070 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.500+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/3533558880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c394f0 0x55fac1c38b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.500+0000 7f51cbdc5740 1 -- 172.21.15.90:0/3533558880 >> 172.21.15.90:0/3533558880 conn(0x55fac1c165f0 msgr2=0x55fac1c58080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:02.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.500+0000 7f51cbdc5740 1 -- 172.21.15.90:0/3533558880 shutdown_connections 2024-09-10T23:18:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.500+0000 7f51cbdc5740 1 -- 172.21.15.90:0/3533558880 wait complete. 2024-09-10T23:18:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.500+0000 7f51cbdc5740 1 -- start start 2024-09-10T23:18:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.501+0000 7f51cbdc5740 1 Processor -- start 2024-09-10T23:18:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.501+0000 7f51cbdc5740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c394f0 0x55fac1ce0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.501+0000 7f51cbdc5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c411b0 0x55fac1ce0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.501+0000 7f51cbdc5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c60df0 0x55fac1c56df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.501+0000 7f51cbdc5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55fac1c73130 con 0x55fac1c60df0 2024-09-10T23:18:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.501+0000 7f51cbdc5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55fac1c57d50 con 0x55fac1c411b0 2024-09-10T23:18:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.501+0000 7f51cbdc5740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55fac1c73750 con 0x55fac1c394f0 2024-09-10T23:18:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51cbdc5740 10 client.0 _ll_register_callbacks cb 0x7f51bc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51c2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c60df0 0x55fac1c56df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51c2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c60df0 0x55fac1c56df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52448/0 (socket says 172.21.15.90:52448) 2024-09-10T23:18:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51c2d9d640 1 -- 172.21.15.90:0/2088810488 learned_addr learned my addr 172.21.15.90:0/2088810488 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51c1d9b640 1 --2- 172.21.15.90:0/2088810488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c411b0 0x55fac1ce0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51c259c640 1 --2- 172.21.15.90:0/2088810488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c394f0 0x55fac1ce0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51c2d9d640 1 -- 172.21.15.90:0/2088810488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c394f0 msgr2=0x55fac1ce0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51c2d9d640 1 --2- 172.21.15.90:0/2088810488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c394f0 0x55fac1ce0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51c2d9d640 1 -- 172.21.15.90:0/2088810488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c411b0 msgr2=0x55fac1ce0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51c2d9d640 1 --2- 172.21.15.90:0/2088810488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c411b0 0x55fac1ce0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51c2d9d640 1 -- 172.21.15.90:0/2088810488 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fac1c61300 con 0x55fac1c60df0 2024-09-10T23:18:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51c2d9d640 1 --2- 172.21.15.90:0/2088810488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c60df0 0x55fac1c56df0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0049d0 tx=0x7f51bc063480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05651da64d9deda server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:18:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51a17fa640 1 -- 172.21.15.90:0/2088810488 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0635e0 con 0x55fac1c60df0 2024-09-10T23:18:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51a17fa640 1 -- 172.21.15.90:0/2088810488 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f51bc068b50 con 0x55fac1c60df0 2024-09-10T23:18:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51cbdc5740 1 -- 172.21.15.90:0/2088810488 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51ac03b540 con 0x55fac1c60df0 2024-09-10T23:18:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51a17fa640 1 -- 172.21.15.90:0/2088810488 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f51bc083050 con 0x55fac1c60df0 2024-09-10T23:18:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51cbdc5740 10 client.6858 fetch_fsmap learned FSMap version 51 2024-09-10T23:18:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51cbdc5740 1 -- 172.21.15.90:0/2088810488 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) -- 0x55fac1c618c0 con 0x55fac1c60df0 2024-09-10T23:18:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.502+0000 7f51a17fa640 1 -- 172.21.15.90:0/2088810488 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51ac03b540 con 0x55fac1c60df0 2024-09-10T23:18:02.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51a17fa640 1 -- 172.21.15.90:0/2088810488 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 51) ==== 3502+0+0 (secure 0 0 0) 0x7f51bc062140 con 0x55fac1c60df0 2024-09-10T23:18:02.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51cbdc5740 10 client.6858 fetch_fsmap finished waiting for FSMap version 51 2024-09-10T23:18:02.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51cbdc5740 10 client.6858 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:18:02.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51cbdc5740 20 client.6858 populate_metadata read hostname 'smithi090' 2024-09-10T23:18:02.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/2088810488 >> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] conn(0x55fac1ce37d0 0x55fac1ce3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51cbdc5740 4 client.6858 mds_command: new command op to 6714 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:18:02.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51cbdc5740 1 -- 172.21.15.90:0/2088810488 --> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] -- command(tid 0: {"prefix": "status"}) -- 0x55fac1b8b220 con 0x55fac1ce37d0 2024-09-10T23:18:02.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51c259c640 1 --2- 172.21.15.90:0/2088810488 >> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] conn(0x55fac1ce37d0 0x55fac1ce3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51a17fa640 10 client.6858 ms_handle_connect on v2:172.21.15.90:6833/3653031756 2024-09-10T23:18:02.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51c259c640 1 --2- 172.21.15.90:0/2088810488 >> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] conn(0x55fac1ce37d0 0x55fac1ce3bb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ceda2b4eef3d5681 server_cookie=e89c16689c99b471 in_seq=0 out_seq=0 2024-09-10T23:18:02.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51a17fa640 1 -- 172.21.15.90:0/2088810488 <== mds.0 v2:172.21.15.90:6833/3653031756 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55fac1b8b220 con 0x55fac1ce37d0 2024-09-10T23:18:02.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51a17fa640 10 client.6858 handle_command_reply: tid=0 2024-09-10T23:18:02.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51cbdc5740 1 client.6858 shutdown 2024-09-10T23:18:02.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51cbdc5740 1 -- 172.21.15.90:0/2088810488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c60df0 msgr2=0x55fac1c56df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:02.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/2088810488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c60df0 0x55fac1c56df0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0049d0 tx=0x7f51bc063480 comp rx=0 tx=0).stop 2024-09-10T23:18:02.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51cbdc5740 1 -- 172.21.15.90:0/2088810488 shutdown_connections 2024-09-10T23:18:02.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/2088810488 >> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] conn(0x55fac1ce37d0 0x55fac1ce3bb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.503+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/2088810488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fac1c411b0 0x55fac1ce0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/2088810488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fac1c60df0 0x55fac1c56df0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51cbdc5740 1 --2- 172.21.15.90:0/2088810488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fac1c394f0 0x55fac1ce0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51a17fa640 0 client.6858 ms_handle_reset on v2:172.21.15.90:6833/3653031756 2024-09-10T23:18:02.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51cbdc5740 1 -- 172.21.15.90:0/2088810488 >> 172.21.15.90:0/2088810488 conn(0x55fac1c165f0 msgr2=0x55fac1c6efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:02.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51cbdc5740 1 -- 172.21.15.90:0/2088810488 shutdown_connections 2024-09-10T23:18:02.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51cbdc5740 1 -- 172.21.15.90:0/2088810488 wait complete. 2024-09-10T23:18:02.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51cbdc5740 20 client.6858 trim_cache size 0 max 16384 2024-09-10T23:18:02.511 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:18:02.511 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd", 2024-09-10T23:18:02.511 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2024-09-10T23:18:02.511 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 6714, 2024-09-10T23:18:02.511 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-09-10T23:18:02.511 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-09-10T23:18:02.511 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2024-09-10T23:18:02.511 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 8.947461444, 2024-09-10T23:18:02.511 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 51, 2024-09-10T23:18:02.511 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 92, 2024-09-10T23:18:02.511 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 92, 2024-09-10T23:18:02.511 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 12.701654528000001 2024-09-10T23:18:02.511 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:18:02.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51c8f17640 1 -- 172.21.15.90:0/2042421407 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f51a4077f70 msgr2=0x7f51a407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:02.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51c8f17640 1 --2- 172.21.15.90:0/2042421407 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f51a4077f70 0x7f51a407a430 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f51c4161280 tx=0x7f51b4009040 comp rx=0 tx=0).stop 2024-09-10T23:18:02.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51c8f17640 1 -- 172.21.15.90:0/2042421407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51c415e310 msgr2=0x7f51c40cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:02.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51c8f17640 1 --2- 172.21.15.90:0/2042421407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51c415e310 0x7f51c40cb610 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00eb10 tx=0x7f51bc00c2d0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51c8f17640 1 -- 172.21.15.90:0/2042421407 shutdown_connections 2024-09-10T23:18:02.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51c8f17640 1 --2- 172.21.15.90:0/2042421407 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f51a4077f70 0x7f51a407a430 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51c8f17640 1 --2- 172.21.15.90:0/2042421407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51c40d16f0 0x7f51c41f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51c8f17640 1 --2- 172.21.15.90:0/2042421407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51c415e310 0x7f51c40cb610 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51c8f17640 1 --2- 172.21.15.90:0/2042421407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51c40d1190 0x7f51c41582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51c8f17640 1 -- 172.21.15.90:0/2042421407 >> 172.21.15.90:0/2042421407 conn(0x7f51c40d4090 msgr2=0x7f51c40b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:02.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51c8f17640 1 -- 172.21.15.90:0/2042421407 shutdown_connections 2024-09-10T23:18:02.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.504+0000 7f51c8f17640 1 -- 172.21.15.90:0/2042421407 wait complete. 2024-09-10T23:18:02.516 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:18:02.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.617+0000 7ff246dec640 1 -- 172.21.15.90:0/397635518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff24015e970 msgr2=0x7ff2400b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:02.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.617+0000 7ff246dec640 1 --2- 172.21.15.90:0/397635518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff24015e970 0x7ff2400b24e0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7ff230009830 tx=0x7ff23002a480 comp rx=0 tx=0).stop 2024-09-10T23:18:02.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.617+0000 7ff246dec640 1 -- 172.21.15.90:0/397635518 shutdown_connections 2024-09-10T23:18:02.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.617+0000 7ff246dec640 1 --2- 172.21.15.90:0/397635518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2400ceca0 0x7ff2400cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.617+0000 7ff246dec640 1 --2- 172.21.15.90:0/397635518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff24015e970 0x7ff2400b24e0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.617+0000 7ff246dec640 1 -- 172.21.15.90:0/397635518 >> 172.21.15.90:0/397635518 conn(0x7ff2400b19c0 msgr2=0x7ff2400b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:02.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.617+0000 7ff246dec640 1 -- 172.21.15.90:0/397635518 shutdown_connections 2024-09-10T23:18:02.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.617+0000 7ff246dec640 1 -- 172.21.15.90:0/397635518 wait complete. 2024-09-10T23:18:02.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.618+0000 7ff246dec640 1 Processor -- start 2024-09-10T23:18:02.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.618+0000 7ff246dec640 1 -- start start 2024-09-10T23:18:02.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.619+0000 7ff246dec640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2400b3310 0x7ff2401f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.619+0000 7ff246dec640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2400ceca0 0x7ff24009d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.619+0000 7ff246dec640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2401f5f70 0x7ff2401f6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.619+0000 7ff246dec640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff24015bb40 con 0x7ff2400ceca0 2024-09-10T23:18:02.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.619+0000 7ff246dec640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff24015b9c0 con 0x7ff2400b3310 2024-09-10T23:18:02.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.619+0000 7ff246dec640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff24015bcc0 con 0x7ff2401f5f70 2024-09-10T23:18:02.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.619+0000 7ff237fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2400ceca0 0x7ff24009d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.619+0000 7ff237fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2400ceca0 0x7ff24009d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52458/0 (socket says 172.21.15.90:52458) 2024-09-10T23:18:02.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.619+0000 7ff237fff640 1 -- 172.21.15.90:0/4067615430 learned_addr learned my addr 172.21.15.90:0/4067615430 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:02.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.619+0000 7ff244b88640 1 --2- 172.21.15.90:0/4067615430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2400b3310 0x7ff2401f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.620+0000 7ff245389640 1 --2- 172.21.15.90:0/4067615430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2401f5f70 0x7ff2401f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.620+0000 7ff237fff640 1 -- 172.21.15.90:0/4067615430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2401f5f70 msgr2=0x7ff2401f6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:02.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.620+0000 7ff237fff640 1 --2- 172.21.15.90:0/4067615430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2401f5f70 0x7ff2401f6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.620+0000 7ff237fff640 1 -- 172.21.15.90:0/4067615430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2400b3310 msgr2=0x7ff2401f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:02.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.620+0000 7ff237fff640 1 --2- 172.21.15.90:0/4067615430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2400b3310 0x7ff2401f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.620+0000 7ff237fff640 1 -- 172.21.15.90:0/4067615430 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff240070180 con 0x7ff2400ceca0 2024-09-10T23:18:02.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.620+0000 7ff245389640 1 --2- 172.21.15.90:0/4067615430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2401f5f70 0x7ff2401f6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:02.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.620+0000 7ff237fff640 1 --2- 172.21.15.90:0/4067615430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2400ceca0 0x7ff24009d490 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff230000c00 tx=0x7ff230033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:02.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.620+0000 7ff2357fa640 1 -- 172.21.15.90:0/4067615430 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff230031d60 con 0x7ff2400ceca0 2024-09-10T23:18:02.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.620+0000 7ff2357fa640 1 -- 172.21.15.90:0/4067615430 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2300330d0 con 0x7ff2400ceca0 2024-09-10T23:18:02.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.620+0000 7ff246dec640 1 -- 172.21.15.90:0/4067615430 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2401f6aa0 con 0x7ff2400ceca0 2024-09-10T23:18:02.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.620+0000 7ff2357fa640 1 -- 172.21.15.90:0/4067615430 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff230033520 con 0x7ff2400ceca0 2024-09-10T23:18:02.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.620+0000 7ff246dec640 1 -- 172.21.15.90:0/4067615430 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2401f2a90 con 0x7ff2400ceca0 2024-09-10T23:18:02.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.621+0000 7ff246dec640 1 -- 172.21.15.90:0/4067615430 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff24015c1e0 con 0x7ff2400ceca0 2024-09-10T23:18:02.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.622+0000 7ff2357fa640 1 -- 172.21.15.90:0/4067615430 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff23004b030 con 0x7ff2400ceca0 2024-09-10T23:18:02.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.622+0000 7ff2357fa640 1 --2- 172.21.15.90:0/4067615430 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff22c077fa0 0x7ff22c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:02.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.622+0000 7ff2357fa640 1 -- 172.21.15.90:0/4067615430 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7ff2300bacd0 con 0x7ff2400ceca0 2024-09-10T23:18:02.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.622+0000 7ff244b88640 1 --2- 172.21.15.90:0/4067615430 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff22c077fa0 0x7ff22c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:02.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.623+0000 7ff244b88640 1 --2- 172.21.15.90:0/4067615430 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff22c077fa0 0x7ff22c07a460 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff23c007fd0 tx=0x7ff23c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:02.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.626+0000 7ff2357fa640 1 -- 172.21.15.90:0/4067615430 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff23003f030 con 0x7ff2400ceca0 2024-09-10T23:18:02.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.839+0000 7ff246dec640 1 -- 172.21.15.90:0/4067615430 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff2400b4f50 con 0x7ff2400ceca0 2024-09-10T23:18:02.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.839+0000 7ff2357fa640 1 -- 172.21.15.90:0/4067615430 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) ==== 53+0+73 (secure 0 0 0) 0x7ff230083860 con 0x7ff2400ceca0 2024-09-10T23:18:02.840 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:18:02.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.841+0000 7ff246dec640 1 -- 172.21.15.90:0/4067615430 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff22c077fa0 msgr2=0x7ff22c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:02.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.841+0000 7ff246dec640 1 --2- 172.21.15.90:0/4067615430 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff22c077fa0 0x7ff22c07a460 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff23c007fd0 tx=0x7ff23c009040 comp rx=0 tx=0).stop 2024-09-10T23:18:02.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.841+0000 7ff246dec640 1 -- 172.21.15.90:0/4067615430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2400ceca0 msgr2=0x7ff24009d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:02.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.841+0000 7ff246dec640 1 --2- 172.21.15.90:0/4067615430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2400ceca0 0x7ff24009d490 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff230000c00 tx=0x7ff230033d60 comp rx=0 tx=0).stop 2024-09-10T23:18:02.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.841+0000 7ff246dec640 1 -- 172.21.15.90:0/4067615430 shutdown_connections 2024-09-10T23:18:02.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.841+0000 7ff246dec640 1 --2- 172.21.15.90:0/4067615430 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff22c077fa0 0x7ff22c07a460 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.841+0000 7ff246dec640 1 --2- 172.21.15.90:0/4067615430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2401f5f70 0x7ff2401f6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.841+0000 7ff246dec640 1 --2- 172.21.15.90:0/4067615430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2400ceca0 0x7ff24009d490 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.841+0000 7ff246dec640 1 --2- 172.21.15.90:0/4067615430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2400b3310 0x7ff2401f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:02.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.841+0000 7ff246dec640 1 -- 172.21.15.90:0/4067615430 >> 172.21.15.90:0/4067615430 conn(0x7ff2400b19c0 msgr2=0x7ff2400adfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:02.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.841+0000 7ff246dec640 1 -- 172.21.15.90:0/4067615430 shutdown_connections 2024-09-10T23:18:02.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:02.841+0000 7ff246dec640 1 -- 172.21.15.90:0/4067615430 wait complete. 2024-09-10T23:18:02.853 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:18:02.853 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:18:02.853 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2024-09-10T23:18:02.853 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:18:02.853 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:18:02.854 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:18:02.854 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:18:02.854 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:18:02.854 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:18:02.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:02.854 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2024-09-10T23:18:02.870 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:18:02.870 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:18:02.870 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:18:02.871 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:02.871 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-10T23:18:02.871 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:02.871 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:02.871 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:02.871 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2024-09-10T23:18:02.871 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:02.871 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:02.871 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2024-09-10T23:18:02.871 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:02.871 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:02.871 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:18:02.871 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:02.872 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:18:02.872 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42565sec preferred_lft 42565sec 2024-09-10T23:18:02.872 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link noprefixroute 2024-09-10T23:18:02.872 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:02.872 INFO:teuthology.orchestra.run.smithi090.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:18:02.872 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:02.872 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:18:02.872 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:02.872 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::882a:a9ff:fefc:893f/64 scope link 2024-09-10T23:18:02.872 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:02.872 INFO:teuthology.orchestra.run.smithi090.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:18:02.872 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 76:ad:51:1a:2a:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:18:02.872 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::74ad:51ff:fe1a:2a60/64 scope link 2024-09-10T23:18:02.873 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:02.873 INFO:teuthology.orchestra.run.smithi090.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:18:02.873 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:18:02.873 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::3414:abff:fe49:366c/64 scope link 2024-09-10T23:18:02.873 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:02.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:02.873 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:18:02.934 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-09-10T23:18:02.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:02.936 DEBUG:teuthology.orchestra.run.smithi090:> route 2024-09-10T23:18:02.991 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2024-09-10T23:18:02.991 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:18:02.992 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:18:02.992 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:18:02.992 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:18:02.992 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:18:02.992 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:18:02.992 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:18:02.992 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:18:02.992 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:18:02.992 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:18:03.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:18:03.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:18:03.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:03.117 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-10T23:18:03.132 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:18:03.132 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:18:03.132 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:18:03.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:03.133 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2024-09-10T23:18:03.197 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:18:03.198 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:18:03.253 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:18:03.253 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:18:03.253 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:18:03.309 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:18:03.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:03.309 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:18:03.392 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:18:03.392 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:18:03.392 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:18:03.400 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:18:03.401 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:18:03.401 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:18:03.401 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:18:03.401 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:18:03.406 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:18:03.406 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:18:03.406 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:18:03.406 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:18:03.406 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:18:03.406 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:18:03.406 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:18:03.406 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:18:03.407 INFO:teuthology.orchestra.run.smithi090.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T23:18:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:18:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:18:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:18:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:18:03.408 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:18:03.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:03.408 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:18:03.474 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:18:03.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:18:03.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:18:03.574 INFO:teuthology.orchestra.run.smithi090.stdout:client5843 2024-09-10T23:18:03.574 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:18:03.574 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:03.591 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:18:03.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.732+0000 7fa8cb145640 1 -- 172.21.15.90:0/720700388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8ac004800 msgr2=0x7fa8ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:03.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.732+0000 7fa8cb145640 1 --2- 172.21.15.90:0/720700388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8ac004800 0x7fa8ac004c80 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800c610 tx=0x7fa8ac005830 comp rx=0 tx=0).stop 2024-09-10T23:18:03.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.732+0000 7fa8cb145640 1 -- 172.21.15.90:0/720700388 shutdown_connections 2024-09-10T23:18:03.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.732+0000 7fa8cb145640 1 --2- 172.21.15.90:0/720700388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8ac004800 0x7fa8ac004c80 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:03.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.732+0000 7fa8cb145640 1 -- 172.21.15.90:0/720700388 >> 172.21.15.90:0/720700388 conn(0x7fa8c40d4090 msgr2=0x7fa8c40d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:03.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.732+0000 7fa8cb145640 1 -- 172.21.15.90:0/720700388 shutdown_connections 2024-09-10T23:18:03.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.732+0000 7fa8cb145640 1 -- 172.21.15.90:0/720700388 wait complete. 2024-09-10T23:18:03.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.733+0000 7fa8cb145640 1 Processor -- start 2024-09-10T23:18:03.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.733+0000 7fa8cb145640 1 -- start start 2024-09-10T23:18:03.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.734+0000 7fa8cb145640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8ac004800 0x7fa8c41599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:03.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.734+0000 7fa8cb145640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8c4160d40 0x7fa8c41566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:03.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.734+0000 7fa8cb145640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8c41611c0 0x7fa8c4156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:03.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.734+0000 7fa8cb145640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c40d0a80 con 0x7fa8c41611c0 2024-09-10T23:18:03.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.734+0000 7fa8cb145640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c40d4d90 con 0x7fa8ac004800 2024-09-10T23:18:03.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.734+0000 7fa8cb145640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c40d0c00 con 0x7fa8c4160d40 2024-09-10T23:18:03.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.734+0000 7fa8c96e2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8c41611c0 0x7fa8c4156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:03.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.734+0000 7fa8c96e2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8c41611c0 0x7fa8c4156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52478/0 (socket says 172.21.15.90:52478) 2024-09-10T23:18:03.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.734+0000 7fa8c96e2640 1 -- 172.21.15.90:0/2416391848 learned_addr learned my addr 172.21.15.90:0/2416391848 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:03.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.735+0000 7fa8c96e2640 1 -- 172.21.15.90:0/2416391848 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8c4160d40 msgr2=0x7fa8c41566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:03.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.735+0000 7fa8c96e2640 1 --2- 172.21.15.90:0/2416391848 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8c4160d40 0x7fa8c41566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:03.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.735+0000 7fa8c96e2640 1 -- 172.21.15.90:0/2416391848 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8ac004800 msgr2=0x7fa8c41599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:03.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.735+0000 7fa8c96e2640 1 --2- 172.21.15.90:0/2416391848 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8ac004800 0x7fa8c41599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:03.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.735+0000 7fa8c96e2640 1 -- 172.21.15.90:0/2416391848 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c4157120 con 0x7fa8c41611c0 2024-09-10T23:18:03.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.735+0000 7fa8c96e2640 1 --2- 172.21.15.90:0/2416391848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8c41611c0 0x7fa8c4156be0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40ce770 tx=0x7fa8bc011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:03.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.735+0000 7fa8c17fa640 1 -- 172.21.15.90:0/2416391848 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc004240 con 0x7fa8c41611c0 2024-09-10T23:18:03.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.735+0000 7fa8c17fa640 1 -- 172.21.15.90:0/2416391848 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8bc016070 con 0x7fa8c41611c0 2024-09-10T23:18:03.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.735+0000 7fa8cb145640 1 -- 172.21.15.90:0/2416391848 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c4158f40 con 0x7fa8c41611c0 2024-09-10T23:18:03.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.735+0000 7fa8c17fa640 1 -- 172.21.15.90:0/2416391848 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00faf0 con 0x7fa8c41611c0 2024-09-10T23:18:03.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.735+0000 7fa8cb145640 1 -- 172.21.15.90:0/2416391848 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c41591e0 con 0x7fa8c41611c0 2024-09-10T23:18:03.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.736+0000 7fa8cb145640 1 -- 172.21.15.90:0/2416391848 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c406f1b0 con 0x7fa8c41611c0 2024-09-10T23:18:03.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.737+0000 7fa8c17fa640 1 -- 172.21.15.90:0/2416391848 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa8bc023030 con 0x7fa8c41611c0 2024-09-10T23:18:03.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.737+0000 7fa8c17fa640 1 --2- 172.21.15.90:0/2416391848 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa8b0077f70 0x7fa8b007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:03.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.737+0000 7fa8c17fa640 1 -- 172.21.15.90:0/2416391848 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fa8bc09a4e0 con 0x7fa8c41611c0 2024-09-10T23:18:03.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.738+0000 7fa8c8ee1640 1 --2- 172.21.15.90:0/2416391848 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa8b0077f70 0x7fa8b007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:03.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.738+0000 7fa8c8ee1640 1 --2- 172.21.15.90:0/2416391848 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa8b0077f70 0x7fa8b007a430 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa8c406b830 tx=0x7fa8b4006ac0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:03.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.741+0000 7fa8c17fa640 1 -- 172.21.15.90:0/2416391848 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa8c406f1b0 con 0x7fa8c41611c0 2024-09-10T23:18:03.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.952+0000 7fa8cb145640 1 -- 172.21.15.90:0/2416391848 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa8c406d6f0 con 0x7fa8c41611c0 2024-09-10T23:18:03.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.953+0000 7fa8c17fa640 1 -- 172.21.15.90:0/2416391848 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) ==== 53+0+73 (secure 0 0 0) 0x7fa8c4157120 con 0x7fa8c41611c0 2024-09-10T23:18:03.954 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:18:03.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.955+0000 7fa8cb145640 1 -- 172.21.15.90:0/2416391848 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa8b0077f70 msgr2=0x7fa8b007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:03.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.955+0000 7fa8cb145640 1 --2- 172.21.15.90:0/2416391848 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa8b0077f70 0x7fa8b007a430 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa8c406b830 tx=0x7fa8b4006ac0 comp rx=0 tx=0).stop 2024-09-10T23:18:03.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.955+0000 7fa8cb145640 1 -- 172.21.15.90:0/2416391848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8c41611c0 msgr2=0x7fa8c4156be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:03.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.955+0000 7fa8cb145640 1 --2- 172.21.15.90:0/2416391848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8c41611c0 0x7fa8c4156be0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40ce770 tx=0x7fa8bc011b30 comp rx=0 tx=0).stop 2024-09-10T23:18:03.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.955+0000 7fa8cb145640 1 -- 172.21.15.90:0/2416391848 shutdown_connections 2024-09-10T23:18:03.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.955+0000 7fa8cb145640 1 --2- 172.21.15.90:0/2416391848 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa8b0077f70 0x7fa8b007a430 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:03.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.955+0000 7fa8cb145640 1 --2- 172.21.15.90:0/2416391848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8c41611c0 0x7fa8c4156be0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:03.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.955+0000 7fa8cb145640 1 --2- 172.21.15.90:0/2416391848 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8c4160d40 0x7fa8c41566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:03.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.955+0000 7fa8cb145640 1 --2- 172.21.15.90:0/2416391848 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8ac004800 0x7fa8c41599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:03.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.955+0000 7fa8cb145640 1 -- 172.21.15.90:0/2416391848 >> 172.21.15.90:0/2416391848 conn(0x7fa8c40d4090 msgr2=0x7fa8c40b9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:03.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.955+0000 7fa8cb145640 1 -- 172.21.15.90:0/2416391848 shutdown_connections 2024-09-10T23:18:03.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:03.955+0000 7fa8cb145640 1 -- 172.21.15.90:0/2416391848 wait complete. 2024-09-10T23:18:03.967 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:18:03.967 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:18:03.967 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-09-10T23:18:03.967 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T23:18:03.967 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T23:18:03.967 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:18:03.967 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:18:03.967 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:18:03.967 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:18:03.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:03.967 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-09-10T23:18:03.987 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:18:03.988 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:18:03.988 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:18:03.988 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:03.988 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-09-10T23:18:03.988 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:03.988 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:03.988 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:03.988 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-09-10T23:18:03.988 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:03.988 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:03.988 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-09-10T23:18:03.988 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:03.988 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:03.989 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:18:03.989 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:03.989 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:18:03.989 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42547sec preferred_lft 42547sec 2024-09-10T23:18:03.989 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link noprefixroute 2024-09-10T23:18:03.989 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:03.989 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:18:03.989 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:03.989 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:18:03.989 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:03.989 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::c18:12ff:fe41:788b/64 scope link 2024-09-10T23:18:03.989 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:03.989 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:18:03.989 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:18:03.990 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a0e4:c6ff:fe48:8d44/64 scope link 2024-09-10T23:18:03.990 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:03.990 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:18:03.990 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a6:c9:8b:0f:78:86 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:18:03.990 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a4c9:8bff:fe0f:7886/64 scope link 2024-09-10T23:18:03.990 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:03.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:03.990 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:18:04.055 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-09-10T23:18:04.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:04.057 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-09-10T23:18:04.115 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-09-10T23:18:04.115 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:18:04.115 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:18:04.115 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:18:04.115 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:18:04.116 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:18:04.116 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:18:04.116 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:18:04.116 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:18:04.116 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:18:04.116 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:18:04.208 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:18:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:18:04.241 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:18:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:18:04.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:04.248 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-09-10T23:18:04.263 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T23:18:04.264 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T23:18:04.264 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:18:04.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:04.264 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-09-10T23:18:04.329 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:18:04.329 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T23:18:04.385 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:18:04.385 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:18:04.385 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:18:04.440 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:18:04.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:04.441 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:18:04.523 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:18:04.523 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:18:04.523 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:18:04.532 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:18:04.532 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:18:04.532 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:18:04.532 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:18:04.532 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:18:04.538 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:18:04.538 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:18:04.538 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:18:04.538 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:18:04.538 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:18:04.538 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:18:04.538 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:18:04.539 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:18:04.539 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T23:18:04.539 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:18:04.539 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:18:04.539 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:18:04.539 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:18:04.541 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:18:04.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:04.541 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:18:04.607 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:18:04.697 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:18:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:18:04.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:18:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:18:04.704 INFO:teuthology.orchestra.run.smithi171.stdout:client5846 2024-09-10T23:18:04.704 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:18:04.704 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:04.721 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:18:04.721 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:04.738 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:18:04.738 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:04.795 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:18:04.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.938+0000 7f69b60ef640 1 -- 172.21.15.90:0/1233722901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69b00b3310 msgr2=0x7f69b00b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:04.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.938+0000 7f69b60ef640 1 --2- 172.21.15.90:0/1233722901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69b00b3310 0x7f69b00b24e0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f69b00af0c0 tx=0x7f69a002a820 comp rx=0 tx=0).stop 2024-09-10T23:18:04.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.938+0000 7f69b60ef640 1 -- 172.21.15.90:0/1233722901 shutdown_connections 2024-09-10T23:18:04.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.938+0000 7f69b60ef640 1 --2- 172.21.15.90:0/1233722901 >> v2:172.21.15.171:3300/0 conn(0x7f69b015e970 0x7f69b00727c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:04.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.938+0000 7f69b60ef640 1 --2- 172.21.15.90:0/1233722901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69b00b3310 0x7f69b00b24e0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:04.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.938+0000 7f69b60ef640 1 -- 172.21.15.90:0/1233722901 >> 172.21.15.90:0/1233722901 conn(0x7f69b00b19c0 msgr2=0x7f69b00b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:04.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.938+0000 7f69b60ef640 1 -- 172.21.15.90:0/1233722901 shutdown_connections 2024-09-10T23:18:04.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.938+0000 7f69b60ef640 1 -- 172.21.15.90:0/1233722901 wait complete. 2024-09-10T23:18:04.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.939+0000 7f69b60ef640 1 Processor -- start 2024-09-10T23:18:04.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.939+0000 7f69b60ef640 1 -- start start 2024-09-10T23:18:04.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69b60ef640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69b00b3310 0x7f69b014f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:04.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69b60ef640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69b00ceca0 0x7f69b009d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:04.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69b60ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69b014fb50 0x7f69b009d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:04.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69b60ef640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f69b015bb40 con 0x7f69b014fb50 2024-09-10T23:18:04.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69b60ef640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f69b015b9c0 con 0x7f69b00b3310 2024-09-10T23:18:04.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69b60ef640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f69b015bcc0 con 0x7f69b00ceca0 2024-09-10T23:18:04.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69affff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69b014fb50 0x7f69b009d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:04.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69affff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69b014fb50 0x7f69b009d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52502/0 (socket says 172.21.15.90:52502) 2024-09-10T23:18:04.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69affff640 1 -- 172.21.15.90:0/3384142489 learned_addr learned my addr 172.21.15.90:0/3384142489 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:04.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69af7fe640 1 --2- 172.21.15.90:0/3384142489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69b00b3310 0x7f69b014f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:04.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69aeffd640 1 --2- 172.21.15.90:0/3384142489 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69b00ceca0 0x7f69b009d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:04.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69affff640 1 -- 172.21.15.90:0/3384142489 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69b00ceca0 msgr2=0x7f69b009d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:04.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69affff640 1 --2- 172.21.15.90:0/3384142489 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69b00ceca0 0x7f69b009d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:04.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69affff640 1 -- 172.21.15.90:0/3384142489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69b00b3310 msgr2=0x7f69b014f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:04.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69affff640 1 --2- 172.21.15.90:0/3384142489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69b00b3310 0x7f69b014f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:04.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69affff640 1 -- 172.21.15.90:0/3384142489 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b0150c70 con 0x7f69b014fb50 2024-09-10T23:18:04.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69af7fe640 1 --2- 172.21.15.90:0/3384142489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69b00b3310 0x7f69b014f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:04.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.940+0000 7f69aeffd640 1 --2- 172.21.15.90:0/3384142489 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69b00ceca0 0x7f69b009d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:04.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.941+0000 7f69affff640 1 --2- 172.21.15.90:0/3384142489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69b014fb50 0x7f69b009d920 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f69a800c3c0 tx=0x7f69a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:04.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.941+0000 7f6997fff640 1 -- 172.21.15.90:0/3384142489 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a8011790 con 0x7f69b014fb50 2024-09-10T23:18:04.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.941+0000 7f6997fff640 1 -- 172.21.15.90:0/3384142489 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69a8017070 con 0x7f69b014fb50 2024-09-10T23:18:04.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.941+0000 7f6997fff640 1 -- 172.21.15.90:0/3384142489 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a8011cc0 con 0x7f69b014fb50 2024-09-10T23:18:04.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.941+0000 7f69b60ef640 1 -- 172.21.15.90:0/3384142489 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b0150f50 con 0x7f69b014fb50 2024-09-10T23:18:04.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.941+0000 7f69b60ef640 1 -- 172.21.15.90:0/3384142489 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b0151510 con 0x7f69b014fb50 2024-09-10T23:18:04.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.942+0000 7f69b60ef640 1 -- 172.21.15.90:0/3384142489 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b015c1e0 con 0x7f69b014fb50 2024-09-10T23:18:04.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.942+0000 7f6997fff640 1 -- 172.21.15.90:0/3384142489 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f69a801c460 con 0x7f69b014fb50 2024-09-10T23:18:04.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.943+0000 7f6997fff640 1 --2- 172.21.15.90:0/3384142489 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f699c077f70 0x7f699c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:04.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.943+0000 7f6997fff640 1 -- 172.21.15.90:0/3384142489 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f69a8099b20 con 0x7f69b014fb50 2024-09-10T23:18:04.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.943+0000 7f69af7fe640 1 --2- 172.21.15.90:0/3384142489 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f699c077f70 0x7f699c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:04.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.943+0000 7f69af7fe640 1 --2- 172.21.15.90:0/3384142489 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f699c077f70 0x7f699c07a430 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f69a0034000 tx=0x7f69a0004ab0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:04.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:04.947+0000 7f6997fff640 1 -- 172.21.15.90:0/3384142489 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f69a8062620 con 0x7f69b014fb50 2024-09-10T23:18:05.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.132+0000 7f69b60ef640 1 -- 172.21.15.90:0/3384142489 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f69b00b4f50 con 0x7f69b014fb50 2024-09-10T23:18:05.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.133+0000 7f6997fff640 1 -- 172.21.15.90:0/3384142489 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v92) ==== 80+0+0 (secure 0 0 0) 0x7f69a8061f20 con 0x7f69b014fb50 2024-09-10T23:18:05.134 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:18:05.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.135+0000 7f69b60ef640 1 -- 172.21.15.90:0/3384142489 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f699c077f70 msgr2=0x7f699c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:05.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.135+0000 7f69b60ef640 1 --2- 172.21.15.90:0/3384142489 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f699c077f70 0x7f699c07a430 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f69a0034000 tx=0x7f69a0004ab0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.135+0000 7f69b60ef640 1 -- 172.21.15.90:0/3384142489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69b014fb50 msgr2=0x7f69b009d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:05.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.135+0000 7f69b60ef640 1 --2- 172.21.15.90:0/3384142489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69b014fb50 0x7f69b009d920 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f69a800c3c0 tx=0x7f69a800c880 comp rx=0 tx=0).stop 2024-09-10T23:18:05.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.135+0000 7f69b60ef640 1 -- 172.21.15.90:0/3384142489 shutdown_connections 2024-09-10T23:18:05.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.135+0000 7f69b60ef640 1 --2- 172.21.15.90:0/3384142489 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f699c077f70 0x7f699c07a430 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.135+0000 7f69b60ef640 1 --2- 172.21.15.90:0/3384142489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69b014fb50 0x7f69b009d920 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.135+0000 7f69b60ef640 1 --2- 172.21.15.90:0/3384142489 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69b00ceca0 0x7f69b009d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.135+0000 7f69b60ef640 1 --2- 172.21.15.90:0/3384142489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69b00b3310 0x7f69b014f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.135+0000 7f69b60ef640 1 -- 172.21.15.90:0/3384142489 >> 172.21.15.90:0/3384142489 conn(0x7f69b00b19c0 msgr2=0x7f69b015d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:05.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.135+0000 7f69b60ef640 1 -- 172.21.15.90:0/3384142489 shutdown_connections 2024-09-10T23:18:05.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.135+0000 7f69b60ef640 1 -- 172.21.15.90:0/3384142489 wait complete. 2024-09-10T23:18:05.147 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T23:18:05.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:05.147 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T23:18:05.176 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:18:05.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:05.176 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:18:05.231 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:18:05.232 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:05.249 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:18:05.249 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:05.306 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:18:05.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.407+0000 7fe7ebdad640 1 -- 172.21.15.90:0/242100596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7e40d1190 msgr2=0x7fe7e40d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:05.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.407+0000 7fe7ebdad640 1 --2- 172.21.15.90:0/242100596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7e40d1190 0x7fe7e40d28c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8005fd0 tx=0x7fe7d802a4a0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.407+0000 7fe7ebdad640 1 -- 172.21.15.90:0/242100596 shutdown_connections 2024-09-10T23:18:05.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.407+0000 7fe7ebdad640 1 --2- 172.21.15.90:0/242100596 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e40d16f0 0x7fe7e40d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.407+0000 7fe7ebdad640 1 --2- 172.21.15.90:0/242100596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7e40d1190 0x7fe7e40d28c0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.407+0000 7fe7ebdad640 1 -- 172.21.15.90:0/242100596 >> 172.21.15.90:0/242100596 conn(0x7fe7e40d4090 msgr2=0x7fe7e40d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:05.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.407+0000 7fe7ebdad640 1 -- 172.21.15.90:0/242100596 shutdown_connections 2024-09-10T23:18:05.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.407+0000 7fe7ebdad640 1 -- 172.21.15.90:0/242100596 wait complete. 2024-09-10T23:18:05.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.409+0000 7fe7ebdad640 1 Processor -- start 2024-09-10T23:18:05.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.409+0000 7fe7ebdad640 1 -- start start 2024-09-10T23:18:05.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.409+0000 7fe7ebdad640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7e40d1190 0x7fe7e40b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:05.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.409+0000 7fe7ebdad640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e40d16f0 0x7fe7e41f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:05.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.409+0000 7fe7ebdad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7e415e310 0x7fe7e4156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:05.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.409+0000 7fe7ebdad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e40d3340 con 0x7fe7e415e310 2024-09-10T23:18:05.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.409+0000 7fe7ebdad640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e40d4d90 con 0x7fe7e40d1190 2024-09-10T23:18:05.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.409+0000 7fe7ebdad640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe7e40d34c0 con 0x7fe7e40d16f0 2024-09-10T23:18:05.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.410+0000 7fe7ea34a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7e415e310 0x7fe7e4156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:05.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.410+0000 7fe7ea34a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7e415e310 0x7fe7e4156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52522/0 (socket says 172.21.15.90:52522) 2024-09-10T23:18:05.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.410+0000 7fe7e9348640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e40d16f0 0x7fe7e41f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:05.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.410+0000 7fe7e9b49640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7e40d1190 0x7fe7e40b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:05.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.410+0000 7fe7ea34a640 1 -- 172.21.15.90:0/2766251754 learned_addr learned my addr 172.21.15.90:0/2766251754 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:05.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.410+0000 7fe7ea34a640 1 -- 172.21.15.90:0/2766251754 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e40d16f0 msgr2=0x7fe7e41f7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:05.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.410+0000 7fe7ea34a640 1 --2- 172.21.15.90:0/2766251754 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e40d16f0 0x7fe7e41f7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.410+0000 7fe7ea34a640 1 -- 172.21.15.90:0/2766251754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7e40d1190 msgr2=0x7fe7e40b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:05.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.410+0000 7fe7ea34a640 1 --2- 172.21.15.90:0/2766251754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7e40d1190 0x7fe7e40b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.410+0000 7fe7ea34a640 1 -- 172.21.15.90:0/2766251754 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e41f8b90 con 0x7fe7e415e310 2024-09-10T23:18:05.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.410+0000 7fe7ea34a640 1 --2- 172.21.15.90:0/2766251754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7e415e310 0x7fe7e4156e80 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400d750 tx=0x7fe7d400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:05.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.410+0000 7fe7e27fc640 1 -- 172.21.15.90:0/2766251754 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4017070 con 0x7fe7e415e310 2024-09-10T23:18:05.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.410+0000 7fe7e27fc640 1 -- 172.21.15.90:0/2766251754 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7d4009ac0 con 0x7fe7e415e310 2024-09-10T23:18:05.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.410+0000 7fe7ebdad640 1 -- 172.21.15.90:0/2766251754 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e40ce270 con 0x7fe7e415e310 2024-09-10T23:18:05.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.410+0000 7fe7e27fc640 1 -- 172.21.15.90:0/2766251754 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4005020 con 0x7fe7e415e310 2024-09-10T23:18:05.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.410+0000 7fe7ebdad640 1 -- 172.21.15.90:0/2766251754 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e40cc440 con 0x7fe7e415e310 2024-09-10T23:18:05.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.411+0000 7fe7ebdad640 1 -- 172.21.15.90:0/2766251754 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e406f1b0 con 0x7fe7e415e310 2024-09-10T23:18:05.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.412+0000 7fe7e27fc640 1 -- 172.21.15.90:0/2766251754 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe7d40051c0 con 0x7fe7e415e310 2024-09-10T23:18:05.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.412+0000 7fe7e27fc640 1 --2- 172.21.15.90:0/2766251754 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe7d0077f70 0x7fe7d007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:05.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.412+0000 7fe7e27fc640 1 -- 172.21.15.90:0/2766251754 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fe7d4099d70 con 0x7fe7e415e310 2024-09-10T23:18:05.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.413+0000 7fe7e9b49640 1 --2- 172.21.15.90:0/2766251754 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe7d0077f70 0x7fe7d007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:05.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.413+0000 7fe7e9b49640 1 --2- 172.21.15.90:0/2766251754 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe7d0077f70 0x7fe7d007a430 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc00b450 tx=0x7fe7dc00d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:05.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.416+0000 7fe7e27fc640 1 -- 172.21.15.90:0/2766251754 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe7e406f1b0 con 0x7fe7e415e310 2024-09-10T23:18:05.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.603+0000 7fe7ebdad640 1 -- 172.21.15.90:0/2766251754 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe7e40cc810 con 0x7fe7e415e310 2024-09-10T23:18:05.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.603+0000 7fe7e27fc640 1 -- 172.21.15.90:0/2766251754 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v92) ==== 80+0+0 (secure 0 0 0) 0x7fe7d4062220 con 0x7fe7e415e310 2024-09-10T23:18:05.605 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:18:05.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.605+0000 7fe7ebdad640 1 -- 172.21.15.90:0/2766251754 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe7d0077f70 msgr2=0x7fe7d007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:05.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.605+0000 7fe7ebdad640 1 --2- 172.21.15.90:0/2766251754 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe7d0077f70 0x7fe7d007a430 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc00b450 tx=0x7fe7dc00d040 comp rx=0 tx=0).stop 2024-09-10T23:18:05.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.605+0000 7fe7ebdad640 1 -- 172.21.15.90:0/2766251754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7e415e310 msgr2=0x7fe7e4156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:05.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.605+0000 7fe7ebdad640 1 --2- 172.21.15.90:0/2766251754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7e415e310 0x7fe7e4156e80 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400d750 tx=0x7fe7d400dc10 comp rx=0 tx=0).stop 2024-09-10T23:18:05.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.605+0000 7fe7ebdad640 1 -- 172.21.15.90:0/2766251754 shutdown_connections 2024-09-10T23:18:05.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.605+0000 7fe7ebdad640 1 --2- 172.21.15.90:0/2766251754 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe7d0077f70 0x7fe7d007a430 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.605+0000 7fe7ebdad640 1 --2- 172.21.15.90:0/2766251754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7e415e310 0x7fe7e4156e80 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.605+0000 7fe7ebdad640 1 --2- 172.21.15.90:0/2766251754 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e40d16f0 0x7fe7e41f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.605+0000 7fe7ebdad640 1 --2- 172.21.15.90:0/2766251754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7e40d1190 0x7fe7e40b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.605+0000 7fe7ebdad640 1 -- 172.21.15.90:0/2766251754 >> 172.21.15.90:0/2766251754 conn(0x7fe7e40d4090 msgr2=0x7fe7e406d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:05.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.606+0000 7fe7ebdad640 1 -- 172.21.15.90:0/2766251754 shutdown_connections 2024-09-10T23:18:05.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.606+0000 7fe7ebdad640 1 -- 172.21.15.90:0/2766251754 wait complete. 2024-09-10T23:18:05.617 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T23:18:05.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:05.617 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T23:18:05.647 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:18:05.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:05.648 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T23:18:05.704 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:05.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.804+0000 7f93b8cdd640 1 -- 172.21.15.90:0/1518806622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b40b3310 msgr2=0x7f93b40b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:05.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.804+0000 7f93b8cdd640 1 --2- 172.21.15.90:0/1518806622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b40b3310 0x7f93b40b24e0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f93a4005fd0 tx=0x7f93a402a540 comp rx=0 tx=0).stop 2024-09-10T23:18:05.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.804+0000 7f93b8cdd640 1 -- 172.21.15.90:0/1518806622 shutdown_connections 2024-09-10T23:18:05.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.804+0000 7f93b8cdd640 1 --2- 172.21.15.90:0/1518806622 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93b40ceca0 0x7f93b40cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.804+0000 7f93b8cdd640 1 --2- 172.21.15.90:0/1518806622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b40b3310 0x7f93b40b24e0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.804+0000 7f93b8cdd640 1 -- 172.21.15.90:0/1518806622 >> 172.21.15.90:0/1518806622 conn(0x7f93b40b19c0 msgr2=0x7f93b40b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:05.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.804+0000 7f93b8cdd640 1 -- 172.21.15.90:0/1518806622 shutdown_connections 2024-09-10T23:18:05.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.804+0000 7f93b8cdd640 1 -- 172.21.15.90:0/1518806622 wait complete. 2024-09-10T23:18:05.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.806+0000 7f93b8cdd640 1 Processor -- start 2024-09-10T23:18:05.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.806+0000 7f93b8cdd640 1 -- start start 2024-09-10T23:18:05.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b8cdd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b40b3310 0x7f93b414c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:05.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b8cdd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93b40ceca0 0x7f93b414f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:05.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b8cdd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93b414f890 0x7f93b41f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:05.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b8cdd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f93b415bb40 con 0x7f93b40b3310 2024-09-10T23:18:05.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b8cdd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f93b415b9c0 con 0x7f93b40ceca0 2024-09-10T23:18:05.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b8cdd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f93b415bcc0 con 0x7f93b414f890 2024-09-10T23:18:05.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b40b3310 0x7f93b414c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:05.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b40b3310 0x7f93b414c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52540/0 (socket says 172.21.15.90:52540) 2024-09-10T23:18:05.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b259c640 1 -- 172.21.15.90:0/2984541701 learned_addr learned my addr 172.21.15.90:0/2984541701 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:05.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93a9d9b640 1 --2- 172.21.15.90:0/2984541701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93b40ceca0 0x7f93b414f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:05.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b2d9d640 1 --2- 172.21.15.90:0/2984541701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93b414f890 0x7f93b41f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:05.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b259c640 1 -- 172.21.15.90:0/2984541701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93b414f890 msgr2=0x7f93b41f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:05.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b259c640 1 --2- 172.21.15.90:0/2984541701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93b414f890 0x7f93b41f5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b259c640 1 -- 172.21.15.90:0/2984541701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93b40ceca0 msgr2=0x7f93b414f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:05.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b259c640 1 --2- 172.21.15.90:0/2984541701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93b40ceca0 0x7f93b414f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:05.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b259c640 1 -- 172.21.15.90:0/2984541701 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b41f3c80 con 0x7f93b40b3310 2024-09-10T23:18:05.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93a9d9b640 1 --2- 172.21.15.90:0/2984541701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93b40ceca0 0x7f93b414f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:05.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b259c640 1 --2- 172.21.15.90:0/2984541701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b40b3310 0x7f93b414c6e0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f93a4009850 tx=0x7f93a40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:05.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93ab7fe640 1 -- 172.21.15.90:0/2984541701 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a403f070 con 0x7f93b40b3310 2024-09-10T23:18:05.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93ab7fe640 1 -- 172.21.15.90:0/2984541701 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93a40047a0 con 0x7f93b40b3310 2024-09-10T23:18:05.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b8cdd640 1 -- 172.21.15.90:0/2984541701 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b41f3f20 con 0x7f93b40b3310 2024-09-10T23:18:05.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93ab7fe640 1 -- 172.21.15.90:0/2984541701 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a4035030 con 0x7f93b40b3310 2024-09-10T23:18:05.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.807+0000 7f93b8cdd640 1 -- 172.21.15.90:0/2984541701 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b41f47c0 con 0x7f93b40b3310 2024-09-10T23:18:05.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.809+0000 7f93b8cdd640 1 -- 172.21.15.90:0/2984541701 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b41f4310 con 0x7f93b40b3310 2024-09-10T23:18:05.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.809+0000 7f93ab7fe640 1 -- 172.21.15.90:0/2984541701 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f93a4004b90 con 0x7f93b40b3310 2024-09-10T23:18:05.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.809+0000 7f93ab7fe640 1 --2- 172.21.15.90:0/2984541701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9394077fa0 0x7f939407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:05.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.810+0000 7f93ab7fe640 1 -- 172.21.15.90:0/2984541701 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f93a40bada0 con 0x7f93b40b3310 2024-09-10T23:18:05.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.810+0000 7f93a9d9b640 1 --2- 172.21.15.90:0/2984541701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9394077fa0 0x7f939407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:05.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.810+0000 7f93a9d9b640 1 --2- 172.21.15.90:0/2984541701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9394077fa0 0x7f939407a460 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f939c007fd0 tx=0x7f939c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:05.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:05.814+0000 7f93ab7fe640 1 -- 172.21.15.90:0/2984541701 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f93a4083250 con 0x7f93b40b3310 2024-09-10T23:18:06.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.021+0000 7f93b8cdd640 1 -- 172.21.15.90:0/2984541701 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93b415c1e0 con 0x7f93b40b3310 2024-09-10T23:18:06.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.022+0000 7f93ab7fe640 1 -- 172.21.15.90:0/2984541701 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5222 (secure 0 0 0) 0x7f93a4087c80 con 0x7f93b40b3310 2024-09-10T23:18:06.023 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:06.023 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":51,"btime":"2024-09-10T23:17:55:561728+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5741,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/991470791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":991470791},{"type":"v1","addr":"172.21.15.171:6836","nonce":991470791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6037,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/372190727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":372190727},{"type":"v1","addr":"172.21.15.171:6837","nonce":372190727}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/970952744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":970952744},{"type":"v1","addr":"172.21.15.90:6834","nonce":970952744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:52.907365+0000","modified":"2024-09-10T23:17:54.899883+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/3653031756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":3653031756},{"type":"v1","addr":"172.21.15.90:6835","nonce":3653031756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6714,"qdb_cluster":[6714]},"id":7}]} 2024-09-10T23:18:06.023 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 51 2024-09-10T23:18:06.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.024+0000 7f93b8cdd640 1 -- 172.21.15.90:0/2984541701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9394077fa0 msgr2=0x7f939407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.024+0000 7f93b8cdd640 1 --2- 172.21.15.90:0/2984541701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9394077fa0 0x7f939407a460 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f939c007fd0 tx=0x7f939c009040 comp rx=0 tx=0).stop 2024-09-10T23:18:06.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.024+0000 7f93b8cdd640 1 -- 172.21.15.90:0/2984541701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b40b3310 msgr2=0x7f93b414c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.024+0000 7f93b8cdd640 1 --2- 172.21.15.90:0/2984541701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b40b3310 0x7f93b414c6e0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f93a4009850 tx=0x7f93a40038a0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.024+0000 7f93b8cdd640 1 -- 172.21.15.90:0/2984541701 shutdown_connections 2024-09-10T23:18:06.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.024+0000 7f93b8cdd640 1 --2- 172.21.15.90:0/2984541701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9394077fa0 0x7f939407a460 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.024+0000 7f93b8cdd640 1 --2- 172.21.15.90:0/2984541701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93b40ceca0 0x7f93b414f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.024+0000 7f93b8cdd640 1 --2- 172.21.15.90:0/2984541701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93b414f890 0x7f93b41f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.024+0000 7f93b8cdd640 1 --2- 172.21.15.90:0/2984541701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b40b3310 0x7f93b414c6e0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.024+0000 7f93b8cdd640 1 -- 172.21.15.90:0/2984541701 >> 172.21.15.90:0/2984541701 conn(0x7f93b40b19c0 msgr2=0x7f93b415dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:06.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.024+0000 7f93b8cdd640 1 -- 172.21.15.90:0/2984541701 shutdown_connections 2024-09-10T23:18:06.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.024+0000 7f93b8cdd640 1 -- 172.21.15.90:0/2984541701 wait complete. 2024-09-10T23:18:06.036 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 session ls 2024-09-10T23:18:06.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.137+0000 7ff274eb0640 1 -- 172.21.15.90:0/661085352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2700b44a0 msgr2=0x7ff2700b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.137+0000 7ff274eb0640 1 --2- 172.21.15.90:0/661085352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2700b44a0 0x7ff2700b4880 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff260005fd0 tx=0x7ff26002b860 comp rx=0 tx=0).stop 2024-09-10T23:18:06.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.137+0000 7ff274eb0640 1 -- 172.21.15.90:0/661085352 shutdown_connections 2024-09-10T23:18:06.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.137+0000 7ff274eb0640 1 --2- 172.21.15.90:0/661085352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2700cd470 0x7ff27015e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.137+0000 7ff274eb0640 1 --2- 172.21.15.90:0/661085352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2700b44a0 0x7ff2700b4880 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.137+0000 7ff274eb0640 1 -- 172.21.15.90:0/661085352 >> 172.21.15.90:0/661085352 conn(0x7ff2700b19c0 msgr2=0x7ff2700b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:06.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.137+0000 7ff274eb0640 1 -- 172.21.15.90:0/661085352 shutdown_connections 2024-09-10T23:18:06.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.137+0000 7ff274eb0640 1 -- 172.21.15.90:0/661085352 wait complete. 2024-09-10T23:18:06.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.139+0000 7ff274eb0640 1 Processor -- start 2024-09-10T23:18:06.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.139+0000 7ff274eb0640 1 -- start start 2024-09-10T23:18:06.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.139+0000 7ff274eb0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2700b44a0 0x7ff2701f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.139+0000 7ff274eb0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2700cd470 0x7ff270144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.139+0000 7ff274eb0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2700cf860 0x7ff27009aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.139+0000 7ff274eb0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff2700ceba0 con 0x7ff2700b44a0 2024-09-10T23:18:06.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.139+0000 7ff274eb0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff27006f6d0 con 0x7ff2700cf860 2024-09-10T23:18:06.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.139+0000 7ff274eb0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff2700ced20 con 0x7ff2700cd470 2024-09-10T23:18:06.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.140+0000 7ff26e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2700b44a0 0x7ff2701f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.140+0000 7ff26e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2700b44a0 0x7ff2701f2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52558/0 (socket says 172.21.15.90:52558) 2024-09-10T23:18:06.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.140+0000 7ff26e59c640 1 -- 172.21.15.90:0/1231598562 learned_addr learned my addr 172.21.15.90:0/1231598562 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:06.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.140+0000 7ff26ed9d640 1 --2- 172.21.15.90:0/1231598562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2700cf860 0x7ff27009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.140+0000 7ff26dd9b640 1 --2- 172.21.15.90:0/1231598562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2700cd470 0x7ff270144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.140+0000 7ff26e59c640 1 -- 172.21.15.90:0/1231598562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2700cd470 msgr2=0x7ff270144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.140+0000 7ff26e59c640 1 --2- 172.21.15.90:0/1231598562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2700cd470 0x7ff270144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.140+0000 7ff26e59c640 1 -- 172.21.15.90:0/1231598562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2700cf860 msgr2=0x7ff27009aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.140+0000 7ff26e59c640 1 --2- 172.21.15.90:0/1231598562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2700cf860 0x7ff27009aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.140+0000 7ff26e59c640 1 -- 172.21.15.90:0/1231598562 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2701f34f0 con 0x7ff2700b44a0 2024-09-10T23:18:06.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.140+0000 7ff26e59c640 1 --2- 172.21.15.90:0/1231598562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2700b44a0 0x7ff2701f2c50 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ff260006010 tx=0x7ff260003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:06.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.140+0000 7ff266ffd640 1 -- 172.21.15.90:0/1231598562 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260004240 con 0x7ff2700b44a0 2024-09-10T23:18:06.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.140+0000 7ff266ffd640 1 -- 172.21.15.90:0/1231598562 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff260004420 con 0x7ff2700b44a0 2024-09-10T23:18:06.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.140+0000 7ff274eb0640 1 -- 172.21.15.90:0/1231598562 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2701f37d0 con 0x7ff2700b44a0 2024-09-10T23:18:06.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.140+0000 7ff266ffd640 1 -- 172.21.15.90:0/1231598562 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260003e10 con 0x7ff2700b44a0 2024-09-10T23:18:06.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.140+0000 7ff274eb0640 1 -- 172.21.15.90:0/1231598562 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2701556f0 con 0x7ff2700b44a0 2024-09-10T23:18:06.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.142+0000 7ff266ffd640 1 -- 172.21.15.90:0/1231598562 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff26004e440 con 0x7ff2700b44a0 2024-09-10T23:18:06.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.142+0000 7ff266ffd640 1 --2- 172.21.15.90:0/1231598562 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff250077f70 0x7ff25007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.143+0000 7ff266ffd640 1 -- 172.21.15.90:0/1231598562 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7ff2600bae70 con 0x7ff2700b44a0 2024-09-10T23:18:06.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.143+0000 7ff26dd9b640 1 --2- 172.21.15.90:0/1231598562 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff250077f70 0x7ff25007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.143+0000 7ff277c78740 1 Processor -- start 2024-09-10T23:18:06.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.143+0000 7ff277c78740 1 -- start start 2024-09-10T23:18:06.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.143+0000 7ff26dd9b640 1 --2- 172.21.15.90:0/1231598562 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff250077f70 0x7ff25007a430 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff258006fd0 tx=0x7ff258009060 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff277c78740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476ced3c0 0x55f476cc4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff277c78740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d0d000 0x55f476d0d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff277c78740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476cc2800 0x55f476cc2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff277c78740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f476c398e0 con 0x55f476d0d000 2024-09-10T23:18:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff277c78740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f476c28d10 con 0x55f476ced3c0 2024-09-10T23:18:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff277c78740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55f476c2cb20 con 0x55f476cc2800 2024-09-10T23:18:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff26dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d0d000 0x55f476d0d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff26dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d0d000 0x55f476d0d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52572/0 (socket says 172.21.15.90:52572) 2024-09-10T23:18:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff26dd9b640 1 -- 172.21.15.90:0/4090641536 learned_addr learned my addr 172.21.15.90:0/4090641536 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff26e59c640 1 --2- 172.21.15.90:0/4090641536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476ced3c0 0x55f476cc4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff26ed9d640 1 --2- 172.21.15.90:0/4090641536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476cc2800 0x55f476cc2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff26dd9b640 1 -- 172.21.15.90:0/4090641536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476cc2800 msgr2=0x55f476cc2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:06.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff26dd9b640 1 --2- 172.21.15.90:0/4090641536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476cc2800 0x55f476cc2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff26dd9b640 1 -- 172.21.15.90:0/4090641536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476ced3c0 msgr2=0x55f476cc4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:06.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff26dd9b640 1 --2- 172.21.15.90:0/4090641536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476ced3c0 0x55f476cc4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff26dd9b640 1 -- 172.21.15.90:0/4090641536 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f47698a970 con 0x55f476d0d000 2024-09-10T23:18:06.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff26e59c640 1 --2- 172.21.15.90:0/4090641536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476ced3c0 0x55f476cc4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:06.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.144+0000 7ff26ed9d640 1 --2- 172.21.15.90:0/4090641536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476cc2800 0x55f476cc2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:06.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.145+0000 7ff26dd9b640 1 --2- 172.21.15.90:0/4090641536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d0d000 0x55f476d0d400 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ff25800eb70 tx=0x7ff258011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242a34060cd2c421 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:06.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.145+0000 7ff24ffff640 1 -- 172.21.15.90:0/4090641536 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25801b040 con 0x55f476d0d000 2024-09-10T23:18:06.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.145+0000 7ff24ffff640 1 -- 172.21.15.90:0/4090641536 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff258024070 con 0x55f476d0d000 2024-09-10T23:18:06.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.145+0000 7ff24ffff640 1 -- 172.21.15.90:0/4090641536 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258015e50 con 0x55f476d0d000 2024-09-10T23:18:06.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.145+0000 7ff277c78740 1 -- 172.21.15.90:0/4090641536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d0d000 msgr2=0x55f476d0d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.145+0000 7ff277c78740 1 --2- 172.21.15.90:0/4090641536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d0d000 0x55f476d0d400 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ff25800eb70 tx=0x7ff258011000 comp rx=0 tx=0).stop 2024-09-10T23:18:06.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.145+0000 7ff277c78740 1 -- 172.21.15.90:0/4090641536 shutdown_connections 2024-09-10T23:18:06.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.145+0000 7ff277c78740 1 --2- 172.21.15.90:0/4090641536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476cc2800 0x55f476cc2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.145+0000 7ff277c78740 1 --2- 172.21.15.90:0/4090641536 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d0d000 0x55f476d0d400 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.145+0000 7ff277c78740 1 --2- 172.21.15.90:0/4090641536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476ced3c0 0x55f476cc4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.145+0000 7ff277c78740 1 -- 172.21.15.90:0/4090641536 >> 172.21.15.90:0/4090641536 conn(0x55f476cc38b0 msgr2=0x55f476cc72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:06.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.145+0000 7ff277c78740 1 -- 172.21.15.90:0/4090641536 shutdown_connections 2024-09-10T23:18:06.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.146+0000 7ff277c78740 1 -- 172.21.15.90:0/4090641536 wait complete. 2024-09-10T23:18:06.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.146+0000 7ff277c78740 1 -- start start 2024-09-10T23:18:06.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.146+0000 7ff277c78740 1 Processor -- start 2024-09-10T23:18:06.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.147+0000 7ff277c78740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476ced3c0 0x55f476d04250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.147+0000 7ff277c78740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476d0d000 0x55f476d086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.147+0000 7ff277c78740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d05bb0 0x55f476d02bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.147+0000 7ff277c78740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f476999740 con 0x55f476d05bb0 2024-09-10T23:18:06.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.147+0000 7ff277c78740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f476bce7f0 con 0x55f476d0d000 2024-09-10T23:18:06.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.147+0000 7ff277c78740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55f476cc1d40 con 0x55f476ced3c0 2024-09-10T23:18:06.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.147+0000 7ff277c78740 10 client.0 _ll_register_callbacks cb 0x55f476bd22a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:06.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.147+0000 7ff26ed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d05bb0 0x55f476d02bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.147+0000 7ff26ed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d05bb0 0x55f476d02bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52582/0 (socket says 172.21.15.90:52582) 2024-09-10T23:18:06.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.147+0000 7ff26ed9d640 1 -- 172.21.15.90:0/2977881239 learned_addr learned my addr 172.21.15.90:0/2977881239 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:06.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.147+0000 7ff26e59c640 1 --2- 172.21.15.90:0/2977881239 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476ced3c0 0x55f476d04250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.147+0000 7ff26dd9b640 1 --2- 172.21.15.90:0/2977881239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476d0d000 0x55f476d086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.147+0000 7ff26ed9d640 1 -- 172.21.15.90:0/2977881239 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476ced3c0 msgr2=0x55f476d04250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:06.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.147+0000 7ff26ed9d640 1 --2- 172.21.15.90:0/2977881239 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476ced3c0 0x55f476d04250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.147+0000 7ff26ed9d640 1 -- 172.21.15.90:0/2977881239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476d0d000 msgr2=0x55f476d086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:06.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.147+0000 7ff26ed9d640 1 --2- 172.21.15.90:0/2977881239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476d0d000 0x55f476d086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.147+0000 7ff26ed9d640 1 -- 172.21.15.90:0/2977881239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f476a017d0 con 0x55f476d05bb0 2024-09-10T23:18:06.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.148+0000 7ff26ed9d640 1 --2- 172.21.15.90:0/2977881239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d05bb0 0x55f476d02bd0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7ff26800b9b0 tx=0x7ff26800bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5e0c9dc7aa746 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:06.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.148+0000 7ff24d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:18:06.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.148+0000 7ff24d7fa640 1 -- 172.21.15.90:0/2977881239 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26801b440 con 0x55f476d05bb0 2024-09-10T23:18:06.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.148+0000 7ff24d7fa640 1 -- 172.21.15.90:0/2977881239 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7ff26801b5e0 con 0x55f476d05bb0 2024-09-10T23:18:06.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.148+0000 7ff277c78740 1 -- 172.21.15.90:0/2977881239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff258024070 con 0x55f476d05bb0 2024-09-10T23:18:06.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.148+0000 7ff24d7fa640 1 -- 172.21.15.90:0/2977881239 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7ff268023050 con 0x55f476d05bb0 2024-09-10T23:18:06.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.148+0000 7ff277c78740 10 client.6906 fetch_fsmap learned FSMap version 51 2024-09-10T23:18:06.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.148+0000 7ff277c78740 1 -- 172.21.15.90:0/2977881239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) -- 0x55f476d08bf0 con 0x55f476d05bb0 2024-09-10T23:18:06.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.148+0000 7ff24d7fa640 1 -- 172.21.15.90:0/2977881239 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff258024070 con 0x55f476d05bb0 2024-09-10T23:18:06.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.148+0000 7ff24d7fa640 1 -- 172.21.15.90:0/2977881239 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 51) ==== 3502+0+0 (secure 0 0 0) 0x7ff268019020 con 0x55f476d05bb0 2024-09-10T23:18:06.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.148+0000 7ff277c78740 10 client.6906 fetch_fsmap finished waiting for FSMap version 51 2024-09-10T23:18:06.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.148+0000 7ff277c78740 10 client.6906 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-10T23:18:06.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.148+0000 7ff277c78740 20 client.6906 populate_metadata read hostname 'smithi090' 2024-09-10T23:18:06.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.148+0000 7ff277c78740 1 --2- 172.21.15.90:0/2977881239 >> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] conn(0x55f476d066f0 0x55f476d06b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.148+0000 7ff277c78740 4 client.6906 mds_command: new command op to 6714 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:18:06.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.148+0000 7ff277c78740 1 -- 172.21.15.90:0/2977881239 --> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f476c3b830 con 0x55f476d066f0 2024-09-10T23:18:06.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.148+0000 7ff26e59c640 1 --2- 172.21.15.90:0/2977881239 >> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] conn(0x55f476d066f0 0x55f476d06b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.149+0000 7ff24d7fa640 10 client.6906 ms_handle_connect on v2:172.21.15.90:6833/3653031756 2024-09-10T23:18:06.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.149+0000 7ff26e59c640 1 --2- 172.21.15.90:0/2977881239 >> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] conn(0x55f476d066f0 0x55f476d06b00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5c3ddc44552cd7 server_cookie=43c5c553cb2610c0 in_seq=0 out_seq=0 2024-09-10T23:18:06.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.149+0000 7ff24d7fa640 1 -- 172.21.15.90:0/2977881239 <== mds.0 v2:172.21.15.90:6833/3653031756 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f476c3b830 con 0x55f476d066f0 2024-09-10T23:18:06.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.149+0000 7ff24d7fa640 10 client.6906 handle_command_reply: tid=0 2024-09-10T23:18:06.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.149+0000 7ff277c78740 1 client.6906 shutdown 2024-09-10T23:18:06.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.149+0000 7ff277c78740 1 -- 172.21.15.90:0/2977881239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d05bb0 msgr2=0x55f476d02bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.149+0000 7ff277c78740 1 --2- 172.21.15.90:0/2977881239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d05bb0 0x55f476d02bd0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7ff26800b9b0 tx=0x7ff26800bdb0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.149+0000 7ff277c78740 1 -- 172.21.15.90:0/2977881239 shutdown_connections 2024-09-10T23:18:06.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.149+0000 7ff277c78740 1 --2- 172.21.15.90:0/2977881239 >> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] conn(0x55f476d066f0 0x55f476d06b00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.149+0000 7ff277c78740 1 --2- 172.21.15.90:0/2977881239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476d0d000 0x55f476d086b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.149+0000 7ff277c78740 1 --2- 172.21.15.90:0/2977881239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d05bb0 0x55f476d02bd0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.149+0000 7ff24d7fa640 0 client.6906 ms_handle_reset on v2:172.21.15.90:6833/3653031756 2024-09-10T23:18:06.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.149+0000 7ff277c78740 1 --2- 172.21.15.90:0/2977881239 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476ced3c0 0x55f476d04250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.149+0000 7ff277c78740 1 -- 172.21.15.90:0/2977881239 >> 172.21.15.90:0/2977881239 conn(0x55f476cc2800 msgr2=0x55f476cc1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:06.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.150+0000 7ff277c78740 1 -- 172.21.15.90:0/2977881239 shutdown_connections 2024-09-10T23:18:06.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.150+0000 7ff277c78740 1 -- 172.21.15.90:0/2977881239 wait complete. 2024-09-10T23:18:06.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.150+0000 7ff277c78740 20 client.6906 trim_cache size 0 max 16384 2024-09-10T23:18:06.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.168+0000 7ff277c78740 1 Processor -- start 2024-09-10T23:18:06.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.168+0000 7ff277c78740 1 -- start start 2024-09-10T23:18:06.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.168+0000 7ff277c78740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476ced3c0 0x55f476d0c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.168+0000 7ff277c78740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476d05bb0 0x55f476d04ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.168+0000 7ff277c78740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476d0d000 0x55f476cc2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.168+0000 7ff277c78740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701ff210 con 0x55f476ced3c0 2024-09-10T23:18:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.168+0000 7ff277c78740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701f6ee0 con 0x55f476d05bb0 2024-09-10T23:18:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.168+0000 7ff277c78740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff2701f6240 con 0x55f476d0d000 2024-09-10T23:18:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.169+0000 7ff26e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476ced3c0 0x55f476d0c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.169+0000 7ff26e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476ced3c0 0x55f476d0c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52596/0 (socket says 172.21.15.90:52596) 2024-09-10T23:18:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.169+0000 7ff26e59c640 1 -- 172.21.15.90:0/4216486630 learned_addr learned my addr 172.21.15.90:0/4216486630 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.169+0000 7ff26e59c640 1 -- 172.21.15.90:0/4216486630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476d0d000 msgr2=0x55f476cc2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.169+0000 7ff26e59c640 1 --2- 172.21.15.90:0/4216486630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476d0d000 0x55f476cc2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.169+0000 7ff26e59c640 1 -- 172.21.15.90:0/4216486630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476d05bb0 msgr2=0x55f476d04ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:06.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.169+0000 7ff26e59c640 1 --2- 172.21.15.90:0/4216486630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476d05bb0 0x55f476d04ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.169+0000 7ff26e59c640 1 -- 172.21.15.90:0/4216486630 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f476d30280 con 0x55f476ced3c0 2024-09-10T23:18:06.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.169+0000 7ff26e59c640 1 --2- 172.21.15.90:0/4216486630 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476ced3c0 0x55f476d0c920 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7ff2600805a0 tx=0x7ff260047040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af382cbe65396dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:06.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.169+0000 7ff24f7fe640 1 -- 172.21.15.90:0/4216486630 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2600a9070 con 0x55f476ced3c0 2024-09-10T23:18:06.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.169+0000 7ff24f7fe640 1 -- 172.21.15.90:0/4216486630 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff260037040 con 0x55f476ced3c0 2024-09-10T23:18:06.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.169+0000 7ff24f7fe640 1 -- 172.21.15.90:0/4216486630 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26008c0c0 con 0x55f476ced3c0 2024-09-10T23:18:06.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.170+0000 7ff277c78740 1 -- 172.21.15.90:0/4216486630 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476ced3c0 msgr2=0x55f476d0c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.170+0000 7ff277c78740 1 --2- 172.21.15.90:0/4216486630 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476ced3c0 0x55f476d0c920 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7ff2600805a0 tx=0x7ff260047040 comp rx=0 tx=0).stop 2024-09-10T23:18:06.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.170+0000 7ff277c78740 1 -- 172.21.15.90:0/4216486630 shutdown_connections 2024-09-10T23:18:06.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.170+0000 7ff277c78740 1 --2- 172.21.15.90:0/4216486630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476d05bb0 0x55f476d04ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.170+0000 7ff277c78740 1 --2- 172.21.15.90:0/4216486630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476d0d000 0x55f476cc2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.170+0000 7ff277c78740 1 --2- 172.21.15.90:0/4216486630 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476ced3c0 0x55f476d0c920 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.170+0000 7ff277c78740 1 -- 172.21.15.90:0/4216486630 >> 172.21.15.90:0/4216486630 conn(0x55f476cc2800 msgr2=0x55f476cc1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:06.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.170+0000 7ff277c78740 1 -- 172.21.15.90:0/4216486630 shutdown_connections 2024-09-10T23:18:06.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.170+0000 7ff277c78740 1 -- 172.21.15.90:0/4216486630 wait complete. 2024-09-10T23:18:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.170+0000 7ff277c78740 1 -- start start 2024-09-10T23:18:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.170+0000 7ff277c78740 1 Processor -- start 2024-09-10T23:18:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.171+0000 7ff277c78740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476ced3c0 0x55f476cc2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.171+0000 7ff277c78740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d05bb0 0x55f476d87a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.171+0000 7ff277c78740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476d0d000 0x55f476d87f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.171+0000 7ff277c78740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701f6890 con 0x55f476d05bb0 2024-09-10T23:18:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.171+0000 7ff277c78740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f476d307a0 con 0x55f476d0d000 2024-09-10T23:18:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.171+0000 7ff277c78740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55f476d03db0 con 0x55f476ced3c0 2024-09-10T23:18:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.171+0000 7ff277c78740 10 client.0 _ll_register_callbacks cb 0x7ff268004160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:06.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.171+0000 7ff26dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d05bb0 0x55f476d87a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.171+0000 7ff26dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d05bb0 0x55f476d87a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52606/0 (socket says 172.21.15.90:52606) 2024-09-10T23:18:06.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.171+0000 7ff26dd9b640 1 -- 172.21.15.90:0/1223590158 learned_addr learned my addr 172.21.15.90:0/1223590158 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:06.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.171+0000 7ff26e59c640 1 --2- 172.21.15.90:0/1223590158 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476ced3c0 0x55f476cc2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.171+0000 7ff26ed9d640 1 --2- 172.21.15.90:0/1223590158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476d0d000 0x55f476d87f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff26dd9b640 1 -- 172.21.15.90:0/1223590158 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476ced3c0 msgr2=0x55f476cc2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:06.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff26dd9b640 1 --2- 172.21.15.90:0/1223590158 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476ced3c0 0x55f476cc2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff26dd9b640 1 -- 172.21.15.90:0/1223590158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476d0d000 msgr2=0x55f476d87f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:06.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff26dd9b640 1 --2- 172.21.15.90:0/1223590158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476d0d000 0x55f476d87f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff26dd9b640 1 -- 172.21.15.90:0/1223590158 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f476d0f190 con 0x55f476d05bb0 2024-09-10T23:18:06.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff26e59c640 1 --2- 172.21.15.90:0/1223590158 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476ced3c0 0x55f476cc2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:06.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff26ed9d640 1 --2- 172.21.15.90:0/1223590158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476d0d000 0x55f476d87f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:06.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff26dd9b640 1 --2- 172.21.15.90:0/1223590158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d05bb0 0x55f476d87a50 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7ff25800eb40 tx=0x7ff25800e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcef73e525ace85 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:06.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff24d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:18:06.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff24d7fa640 1 -- 172.21.15.90:0/1223590158 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2580138e0 con 0x55f476d05bb0 2024-09-10T23:18:06.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff24d7fa640 1 -- 172.21.15.90:0/1223590158 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7ff258013a80 con 0x55f476d05bb0 2024-09-10T23:18:06.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff277c78740 1 -- 172.21.15.90:0/1223590158 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff260037040 con 0x55f476d05bb0 2024-09-10T23:18:06.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff24d7fa640 1 -- 172.21.15.90:0/1223590158 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7ff25803c050 con 0x55f476d05bb0 2024-09-10T23:18:06.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff277c78740 10 client.6912 fetch_fsmap learned FSMap version 51 2024-09-10T23:18:06.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff277c78740 1 -- 172.21.15.90:0/1223590158 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) -- 0x55f476d07090 con 0x55f476d05bb0 2024-09-10T23:18:06.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff24d7fa640 1 -- 172.21.15.90:0/1223590158 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff260037040 con 0x55f476d05bb0 2024-09-10T23:18:06.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff24d7fa640 1 -- 172.21.15.90:0/1223590158 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 51) ==== 3502+0+0 (secure 0 0 0) 0x7ff25803f020 con 0x55f476d05bb0 2024-09-10T23:18:06.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff277c78740 10 client.6912 fetch_fsmap finished waiting for FSMap version 51 2024-09-10T23:18:06.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff277c78740 10 client.6912 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-10T23:18:06.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff277c78740 20 client.6912 populate_metadata read hostname 'smithi090' 2024-09-10T23:18:06.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff277c78740 1 --2- 172.21.15.90:0/1223590158 >> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] conn(0x55f476d03900 0x55f476d917e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff277c78740 4 client.6912 mds_command: new command op to 6714 tid=0 multi_id=0 [{"prefix": "session ls"}] 2024-09-10T23:18:06.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff277c78740 1 -- 172.21.15.90:0/1223590158 --> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] -- command(tid 0: {"prefix": "session ls"}) -- 0x55f476c372e0 con 0x55f476d03900 2024-09-10T23:18:06.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.172+0000 7ff26e59c640 1 --2- 172.21.15.90:0/1223590158 >> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] conn(0x55f476d03900 0x55f476d917e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.173+0000 7ff24d7fa640 10 client.6912 ms_handle_connect on v2:172.21.15.90:6833/3653031756 2024-09-10T23:18:06.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.173+0000 7ff26e59c640 1 --2- 172.21.15.90:0/1223590158 >> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] conn(0x55f476d03900 0x55f476d917e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a476dabe5c67d64 server_cookie=e68dcbb7b43f882b in_seq=0 out_seq=0 2024-09-10T23:18:06.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.173+0000 7ff24d7fa640 1 -- 172.21.15.90:0/1223590158 <== mds.0 v2:172.21.15.90:6833/3653031756 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f476c372e0 con 0x55f476d03900 2024-09-10T23:18:06.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.173+0000 7ff24d7fa640 10 client.6912 handle_command_reply: tid=0 2024-09-10T23:18:06.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.173+0000 7ff277c78740 1 client.6912 shutdown 2024-09-10T23:18:06.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.173+0000 7ff277c78740 1 -- 172.21.15.90:0/1223590158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d05bb0 msgr2=0x55f476d87a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.173+0000 7ff277c78740 1 --2- 172.21.15.90:0/1223590158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d05bb0 0x55f476d87a50 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7ff25800eb40 tx=0x7ff25800e6e0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.173+0000 7ff277c78740 1 -- 172.21.15.90:0/1223590158 shutdown_connections 2024-09-10T23:18:06.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.173+0000 7ff277c78740 1 --2- 172.21.15.90:0/1223590158 >> [v2:172.21.15.90:6833/3653031756,v1:172.21.15.90:6835/3653031756] conn(0x55f476d03900 0x55f476d917e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.173+0000 7ff277c78740 1 --2- 172.21.15.90:0/1223590158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f476d0d000 0x55f476d87f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.173+0000 7ff277c78740 1 --2- 172.21.15.90:0/1223590158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f476d05bb0 0x55f476d87a50 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.173+0000 7ff24d7fa640 0 client.6912 ms_handle_reset on v2:172.21.15.90:6833/3653031756 2024-09-10T23:18:06.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.173+0000 7ff277c78740 1 --2- 172.21.15.90:0/1223590158 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55f476ced3c0 0x55f476cc2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.173+0000 7ff277c78740 1 -- 172.21.15.90:0/1223590158 >> 172.21.15.90:0/1223590158 conn(0x55f476cc2800 msgr2=0x55f476ced950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:06.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.173+0000 7ff277c78740 1 -- 172.21.15.90:0/1223590158 shutdown_connections 2024-09-10T23:18:06.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.173+0000 7ff277c78740 1 -- 172.21.15.90:0/1223590158 wait complete. 2024-09-10T23:18:06.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.173+0000 7ff277c78740 20 client.6912 trim_cache size 0 max 16384 2024-09-10T23:18:06.181 INFO:teuthology.orchestra.run.smithi090.stdout:[] 2024-09-10T23:18:06.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.174+0000 7ff274eb0640 1 -- 172.21.15.90:0/1231598562 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff250077f70 msgr2=0x7ff25007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.174+0000 7ff274eb0640 1 --2- 172.21.15.90:0/1231598562 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff250077f70 0x7ff25007a430 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff258006fd0 tx=0x7ff258009060 comp rx=0 tx=0).stop 2024-09-10T23:18:06.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.174+0000 7ff274eb0640 1 -- 172.21.15.90:0/1231598562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2700b44a0 msgr2=0x7ff2701f2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.174+0000 7ff274eb0640 1 --2- 172.21.15.90:0/1231598562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2700b44a0 0x7ff2701f2c50 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ff260006010 tx=0x7ff260003c20 comp rx=0 tx=0).stop 2024-09-10T23:18:06.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.174+0000 7ff274eb0640 1 -- 172.21.15.90:0/1231598562 shutdown_connections 2024-09-10T23:18:06.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.174+0000 7ff274eb0640 1 --2- 172.21.15.90:0/1231598562 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff250077f70 0x7ff25007a430 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.174+0000 7ff274eb0640 1 --2- 172.21.15.90:0/1231598562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2700cf860 0x7ff27009aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.174+0000 7ff274eb0640 1 --2- 172.21.15.90:0/1231598562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2700cd470 0x7ff270144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.174+0000 7ff274eb0640 1 --2- 172.21.15.90:0/1231598562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2700b44a0 0x7ff2701f2c50 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.174+0000 7ff274eb0640 1 -- 172.21.15.90:0/1231598562 >> 172.21.15.90:0/1231598562 conn(0x7ff2700b19c0 msgr2=0x7ff270073260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:06.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.174+0000 7ff274eb0640 1 -- 172.21.15.90:0/1231598562 shutdown_connections 2024-09-10T23:18:06.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.174+0000 7ff274eb0640 1 -- 172.21.15.90:0/1231598562 wait complete. 2024-09-10T23:18:06.186 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-10T23:18:06.301 INFO:teuthology.orchestra.run.smithi090.stdout:[] 2024-09-10T23:18:06.301 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-10T23:18:06.302 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:18:06.302 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:18:06.342 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:18:06.389 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:18:06.389 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:18:06.389 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:18:06.389 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:06.405 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:18:06.405 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:18:06.405 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:18:06.405 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:06.424 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:18:06.424 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:18:06.424 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:18:06.424 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:06.461 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:18:06.461 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:18:06.461 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:18:06.461 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:06.484 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:18:06.484 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:06.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.602+0000 7f9de0100640 1 -- 172.21.15.90:0/3546039575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dc4003a00 msgr2=0x7f9dc4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.602+0000 7f9de0100640 1 --2- 172.21.15.90:0/3546039575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dc4003a00 0x7f9dc4003e20 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400c2e0 tx=0x7f9dc4005830 comp rx=0 tx=0).stop 2024-09-10T23:18:06.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.602+0000 7f9dde69d640 1 -- 172.21.15.90:0/3546039575 reap_dead start 2024-09-10T23:18:06.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.602+0000 7f9de0100640 1 -- 172.21.15.90:0/3546039575 shutdown_connections 2024-09-10T23:18:06.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.602+0000 7f9de0100640 1 -- 172.21.15.90:0/3546039575 >> 172.21.15.90:0/3546039575 conn(0x7f9dd80b19c0 msgr2=0x7f9dd80b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:06.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.602+0000 7f9de0100640 1 -- 172.21.15.90:0/3546039575 shutdown_connections 2024-09-10T23:18:06.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.602+0000 7f9de0100640 1 -- 172.21.15.90:0/3546039575 wait complete. 2024-09-10T23:18:06.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.603+0000 7f9de0100640 1 Processor -- start 2024-09-10T23:18:06.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.604+0000 7f9de0100640 1 -- start start 2024-09-10T23:18:06.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.604+0000 7f9de0100640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dc4003a00 0x7f9dd8152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.604+0000 7f9de0100640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dd8155ec0 0x7f9dd80b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.604+0000 7f9de0100640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dd8156340 0x7f9dd80b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.604+0000 7f9de0100640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd8070a30 con 0x7f9dd8156340 2024-09-10T23:18:06.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.604+0000 7f9de0100640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd80708b0 con 0x7f9dc4003a00 2024-09-10T23:18:06.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.604+0000 7f9de0100640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd80cdb90 con 0x7f9dd8155ec0 2024-09-10T23:18:06.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.604+0000 7f9dde69d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dd8156340 0x7f9dd80b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.604+0000 7f9dde69d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dd8156340 0x7f9dd80b1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52626/0 (socket says 172.21.15.90:52626) 2024-09-10T23:18:06.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.604+0000 7f9dde69d640 1 -- 172.21.15.90:0/2159808452 learned_addr learned my addr 172.21.15.90:0/2159808452 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:06.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.604+0000 7f9ddde9c640 1 --2- 172.21.15.90:0/2159808452 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dc4003a00 0x7f9dd8152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.604+0000 7f9ddd69b640 1 --2- 172.21.15.90:0/2159808452 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dd8155ec0 0x7f9dd80b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.605+0000 7f9dde69d640 1 -- 172.21.15.90:0/2159808452 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dd8155ec0 msgr2=0x7f9dd80b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.605+0000 7f9dde69d640 1 --2- 172.21.15.90:0/2159808452 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dd8155ec0 0x7f9dd80b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.605+0000 7f9dde69d640 1 -- 172.21.15.90:0/2159808452 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dc4003a00 msgr2=0x7f9dd8152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.605+0000 7f9dde69d640 1 --2- 172.21.15.90:0/2159808452 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dc4003a00 0x7f9dd8152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.605+0000 7f9dde69d640 1 -- 172.21.15.90:0/2159808452 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd81f3b90 con 0x7f9dd8156340 2024-09-10T23:18:06.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.605+0000 7f9ddde9c640 1 --2- 172.21.15.90:0/2159808452 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dc4003a00 0x7f9dd8152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:06.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.605+0000 7f9ddd69b640 1 --2- 172.21.15.90:0/2159808452 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dd8155ec0 0x7f9dd80b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:06.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.605+0000 7f9dde69d640 1 --2- 172.21.15.90:0/2159808452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dd8156340 0x7f9dd80b1100 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0005fd0 tx=0x7f9dd0010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:06.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.605+0000 7f9dce7fc640 1 -- 172.21.15.90:0/2159808452 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0003970 con 0x7f9dd8156340 2024-09-10T23:18:06.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.605+0000 7f9dce7fc640 1 -- 172.21.15.90:0/2159808452 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9dd0015070 con 0x7f9dd8156340 2024-09-10T23:18:06.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.605+0000 7f9de0100640 1 -- 172.21.15.90:0/2159808452 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd81f3e70 con 0x7f9dd8156340 2024-09-10T23:18:06.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.605+0000 7f9dce7fc640 1 -- 172.21.15.90:0/2159808452 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0004030 con 0x7f9dd8156340 2024-09-10T23:18:06.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.605+0000 7f9de0100640 1 -- 172.21.15.90:0/2159808452 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd81f4430 con 0x7f9dd8156340 2024-09-10T23:18:06.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.606+0000 7f9de0100640 1 -- 172.21.15.90:0/2159808452 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd806fc80 con 0x7f9dd8156340 2024-09-10T23:18:06.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.606+0000 7f9dce7fc640 1 -- 172.21.15.90:0/2159808452 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9dd00041d0 con 0x7f9dd8156340 2024-09-10T23:18:06.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.607+0000 7f9dce7fc640 1 --2- 172.21.15.90:0/2159808452 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9dbc077f70 0x7f9dbc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.607+0000 7f9dce7fc640 1 -- 172.21.15.90:0/2159808452 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f9dd009a720 con 0x7f9dd8156340 2024-09-10T23:18:06.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.608+0000 7f9ddde9c640 1 --2- 172.21.15.90:0/2159808452 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9dbc077f70 0x7f9dbc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.608+0000 7f9ddde9c640 1 --2- 172.21.15.90:0/2159808452 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9dbc077f70 0x7f9dbc07a430 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4033000 tx=0x7f9dd402d000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:06.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.611+0000 7f9dce7fc640 1 -- 172.21.15.90:0/2159808452 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9dd00632b0 con 0x7f9dd8156340 2024-09-10T23:18:06.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.823+0000 7f9de0100640 1 -- 172.21.15.90:0/2159808452 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9dd80d0360 con 0x7f9dd8156340 2024-09-10T23:18:06.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.823+0000 7f9dce7fc640 1 -- 172.21.15.90:0/2159808452 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5222 (secure 0 0 0) 0x7f9dd0062bb0 con 0x7f9dd8156340 2024-09-10T23:18:06.824 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:06.825 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":51,"btime":"2024-09-10T23:17:55:561728+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5741,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/991470791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":991470791},{"type":"v1","addr":"172.21.15.171:6836","nonce":991470791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6037,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/372190727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":372190727},{"type":"v1","addr":"172.21.15.171:6837","nonce":372190727}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/970952744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":970952744},{"type":"v1","addr":"172.21.15.90:6834","nonce":970952744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:52.907365+0000","modified":"2024-09-10T23:17:54.899883+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/3653031756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":3653031756},{"type":"v1","addr":"172.21.15.90:6835","nonce":3653031756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6714,"qdb_cluster":[6714]},"id":7}]} 2024-09-10T23:18:06.825 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 51 2024-09-10T23:18:06.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.825+0000 7f9de0100640 1 -- 172.21.15.90:0/2159808452 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9dbc077f70 msgr2=0x7f9dbc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.825+0000 7f9de0100640 1 --2- 172.21.15.90:0/2159808452 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9dbc077f70 0x7f9dbc07a430 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4033000 tx=0x7f9dd402d000 comp rx=0 tx=0).stop 2024-09-10T23:18:06.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.825+0000 7f9de0100640 1 -- 172.21.15.90:0/2159808452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dd8156340 msgr2=0x7f9dd80b1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.825+0000 7f9de0100640 1 --2- 172.21.15.90:0/2159808452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dd8156340 0x7f9dd80b1100 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0005fd0 tx=0x7f9dd0010f40 comp rx=0 tx=0).stop 2024-09-10T23:18:06.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.825+0000 7f9de0100640 1 -- 172.21.15.90:0/2159808452 shutdown_connections 2024-09-10T23:18:06.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.825+0000 7f9de0100640 1 --2- 172.21.15.90:0/2159808452 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9dbc077f70 0x7f9dbc07a430 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.825+0000 7f9de0100640 1 --2- 172.21.15.90:0/2159808452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dd8156340 0x7f9dd80b1100 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.825+0000 7f9de0100640 1 --2- 172.21.15.90:0/2159808452 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9dd8155ec0 0x7f9dd80b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.825+0000 7f9de0100640 1 --2- 172.21.15.90:0/2159808452 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dc4003a00 0x7f9dd8152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.825+0000 7f9de0100640 1 -- 172.21.15.90:0/2159808452 >> 172.21.15.90:0/2159808452 conn(0x7f9dd80b19c0 msgr2=0x7f9dd81593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:06.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.825+0000 7f9de0100640 1 -- 172.21.15.90:0/2159808452 shutdown_connections 2024-09-10T23:18:06.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.825+0000 7f9de0100640 1 -- 172.21.15.90:0/2159808452 wait complete. 2024-09-10T23:18:06.837 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:06.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.938+0000 7f7600bc2640 1 -- 172.21.15.90:0/4100814453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75fc073dc0 msgr2=0x7f75fc071920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.938+0000 7f7600bc2640 1 --2- 172.21.15.90:0/4100814453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75fc073dc0 0x7f75fc071920 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f75fc076720 tx=0x7f75f002a530 comp rx=0 tx=0).stop 2024-09-10T23:18:06.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.938+0000 7f7600bc2640 1 -- 172.21.15.90:0/4100814453 shutdown_connections 2024-09-10T23:18:06.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.938+0000 7f7600bc2640 1 --2- 172.21.15.90:0/4100814453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75fc073dc0 0x7f75fc071920 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.938+0000 7f7600bc2640 1 --2- 172.21.15.90:0/4100814453 >> v2:172.21.15.171:3300/0 conn(0x7f75fc0739e0 0x7f75fc0aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.938+0000 7f7600bc2640 1 -- 172.21.15.90:0/4100814453 >> 172.21.15.90:0/4100814453 conn(0x7f75fc0d0de0 msgr2=0x7f75fc0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:06.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.938+0000 7f7600bc2640 1 -- 172.21.15.90:0/4100814453 shutdown_connections 2024-09-10T23:18:06.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.938+0000 7f7600bc2640 1 -- 172.21.15.90:0/4100814453 wait complete. 2024-09-10T23:18:06.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.939+0000 7f7600bc2640 1 Processor -- start 2024-09-10T23:18:06.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.939+0000 7f7600bc2640 1 -- start start 2024-09-10T23:18:06.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.940+0000 7f7600bc2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75fc071e60 0x7f75fc14e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.940+0000 7f7600bc2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75fc0739e0 0x7f75fc0b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.940+0000 7f7600bc2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75fc073dc0 0x7f75fc0b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.940+0000 7f7600bc2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f75fc0cb890 con 0x7f75fc073dc0 2024-09-10T23:18:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.940+0000 7f7600bc2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f75fc0cb710 con 0x7f75fc0739e0 2024-09-10T23:18:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.940+0000 7f7600bc2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f75fc0cba10 con 0x7f75fc071e60 2024-09-10T23:18:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.940+0000 7f75fad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75fc073dc0 0x7f75fc0b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.940+0000 7f75fad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75fc073dc0 0x7f75fc0b1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52658/0 (socket says 172.21.15.90:52658) 2024-09-10T23:18:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.940+0000 7f75fad9d640 1 -- 172.21.15.90:0/2000228093 learned_addr learned my addr 172.21.15.90:0/2000228093 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.940+0000 7f75fa59c640 1 --2- 172.21.15.90:0/2000228093 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75fc071e60 0x7f75fc14e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.940+0000 7f75f9d9b640 1 --2- 172.21.15.90:0/2000228093 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75fc0739e0 0x7f75fc0b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.940+0000 7f75fad9d640 1 -- 172.21.15.90:0/2000228093 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75fc071e60 msgr2=0x7f75fc14e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.940+0000 7f75fad9d640 1 --2- 172.21.15.90:0/2000228093 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75fc071e60 0x7f75fc14e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.940+0000 7f75fad9d640 1 -- 172.21.15.90:0/2000228093 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75fc0739e0 msgr2=0x7f75fc0b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:06.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.940+0000 7f75fad9d640 1 --2- 172.21.15.90:0/2000228093 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75fc0739e0 0x7f75fc0b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:06.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.940+0000 7f75fad9d640 1 -- 172.21.15.90:0/2000228093 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75fc06f880 con 0x7f75fc073dc0 2024-09-10T23:18:06.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.941+0000 7f75fad9d640 1 --2- 172.21.15.90:0/2000228093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75fc073dc0 0x7f75fc0b1020 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f75f400c3a0 tx=0x7f75f400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:06.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.941+0000 7f75eaffd640 1 -- 172.21.15.90:0/2000228093 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f4017070 con 0x7f75fc073dc0 2024-09-10T23:18:06.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.941+0000 7f75eaffd640 1 -- 172.21.15.90:0/2000228093 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75f40035f0 con 0x7f75fc073dc0 2024-09-10T23:18:06.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.941+0000 7f7600bc2640 1 -- 172.21.15.90:0/2000228093 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75fc06fb60 con 0x7f75fc073dc0 2024-09-10T23:18:06.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.941+0000 7f75eaffd640 1 -- 172.21.15.90:0/2000228093 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f4003a40 con 0x7f75fc073dc0 2024-09-10T23:18:06.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.941+0000 7f7600bc2640 1 -- 172.21.15.90:0/2000228093 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75fc070120 con 0x7f75fc073dc0 2024-09-10T23:18:06.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.942+0000 7f7600bc2640 1 -- 172.21.15.90:0/2000228093 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75fc0aedd0 con 0x7f75fc073dc0 2024-09-10T23:18:06.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.942+0000 7f75eaffd640 1 -- 172.21.15.90:0/2000228093 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f75f4003be0 con 0x7f75fc073dc0 2024-09-10T23:18:06.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.943+0000 7f75eaffd640 1 --2- 172.21.15.90:0/2000228093 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f75dc077f70 0x7f75dc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:06.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.943+0000 7f75eaffd640 1 -- 172.21.15.90:0/2000228093 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f75f40990f0 con 0x7f75fc073dc0 2024-09-10T23:18:06.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.943+0000 7f75fa59c640 1 --2- 172.21.15.90:0/2000228093 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f75dc077f70 0x7f75dc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:06.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.944+0000 7f75fa59c640 1 --2- 172.21.15.90:0/2000228093 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f75dc077f70 0x7f75dc07a430 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009f20 tx=0x7f75ec0094f0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:06.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:06.947+0000 7f75eaffd640 1 -- 172.21.15.90:0/2000228093 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f75f40615a0 con 0x7f75fc073dc0 2024-09-10T23:18:07.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.156+0000 7f7600bc2640 1 -- 172.21.15.90:0/2000228093 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75fc0b6d60 con 0x7f75fc073dc0 2024-09-10T23:18:07.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.156+0000 7f75eaffd640 1 -- 172.21.15.90:0/2000228093 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5222 (secure 0 0 0) 0x7f75f406a310 con 0x7f75fc073dc0 2024-09-10T23:18:07.157 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:07.157 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":51,"btime":"2024-09-10T23:17:55:561728+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5741,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/991470791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":991470791},{"type":"v1","addr":"172.21.15.171:6836","nonce":991470791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6037,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/372190727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":372190727},{"type":"v1","addr":"172.21.15.171:6837","nonce":372190727}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/970952744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":970952744},{"type":"v1","addr":"172.21.15.90:6834","nonce":970952744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:52.907365+0000","modified":"2024-09-10T23:17:54.899883+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/3653031756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":3653031756},{"type":"v1","addr":"172.21.15.90:6835","nonce":3653031756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6714,"qdb_cluster":[6714]},"id":7}]} 2024-09-10T23:18:07.158 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 51 2024-09-10T23:18:07.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.158+0000 7f7600bc2640 1 -- 172.21.15.90:0/2000228093 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f75dc077f70 msgr2=0x7f75dc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:07.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.158+0000 7f7600bc2640 1 --2- 172.21.15.90:0/2000228093 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f75dc077f70 0x7f75dc07a430 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009f20 tx=0x7f75ec0094f0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.158+0000 7f7600bc2640 1 -- 172.21.15.90:0/2000228093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75fc073dc0 msgr2=0x7f75fc0b1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:07.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.158+0000 7f7600bc2640 1 --2- 172.21.15.90:0/2000228093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75fc073dc0 0x7f75fc0b1020 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f75f400c3a0 tx=0x7f75f400c860 comp rx=0 tx=0).stop 2024-09-10T23:18:07.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.158+0000 7f7600bc2640 1 -- 172.21.15.90:0/2000228093 shutdown_connections 2024-09-10T23:18:07.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.158+0000 7f7600bc2640 1 --2- 172.21.15.90:0/2000228093 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f75dc077f70 0x7f75dc07a430 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.158+0000 7f7600bc2640 1 --2- 172.21.15.90:0/2000228093 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75fc0739e0 0x7f75fc0b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.158+0000 7f7600bc2640 1 --2- 172.21.15.90:0/2000228093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75fc073dc0 0x7f75fc0b1020 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.158+0000 7f7600bc2640 1 --2- 172.21.15.90:0/2000228093 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75fc071e60 0x7f75fc14e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.158+0000 7f7600bc2640 1 -- 172.21.15.90:0/2000228093 >> 172.21.15.90:0/2000228093 conn(0x7f75fc0d0de0 msgr2=0x7f75fc158fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:07.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.158+0000 7f7600bc2640 1 -- 172.21.15.90:0/2000228093 shutdown_connections 2024-09-10T23:18:07.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.158+0000 7f7600bc2640 1 -- 172.21.15.90:0/2000228093 wait complete. 2024-09-10T23:18:07.170 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:18:07.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.270+0000 7f00af507640 1 -- 172.21.15.90:0/2100333441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0090005910 msgr2=0x7f0090005d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:07.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.270+0000 7f00af507640 1 --2- 172.21.15.90:0/2100333441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0090005910 0x7f0090005d90 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f009c0016c0 tx=0x7f0090006940 comp rx=0 tx=0).stop 2024-09-10T23:18:07.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.270+0000 7f00af507640 1 -- 172.21.15.90:0/2100333441 shutdown_connections 2024-09-10T23:18:07.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.270+0000 7f00af507640 1 --2- 172.21.15.90:0/2100333441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0090005910 0x7f0090005d90 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.270+0000 7f00af507640 1 -- 172.21.15.90:0/2100333441 >> 172.21.15.90:0/2100333441 conn(0x7f00a80b19c0 msgr2=0x7f00a80b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:07.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.270+0000 7f00af507640 1 -- 172.21.15.90:0/2100333441 shutdown_connections 2024-09-10T23:18:07.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.270+0000 7f00af507640 1 -- 172.21.15.90:0/2100333441 wait complete. 2024-09-10T23:18:07.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.271+0000 7f00af507640 1 Processor -- start 2024-09-10T23:18:07.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.271+0000 7f00af507640 1 -- start start 2024-09-10T23:18:07.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00af507640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0090005910 0x7f00a8151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:07.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00af507640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00a8153f70 0x7f00a80b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:07.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00af507640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00a8151930 0x7f00a80b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:07.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00af507640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f00a815aa40 con 0x7f0090005910 2024-09-10T23:18:07.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00af507640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f00a815a8c0 con 0x7f00a8153f70 2024-09-10T23:18:07.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00af507640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f00a80b4880 con 0x7f00a8151930 2024-09-10T23:18:07.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00ad2a3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0090005910 0x7f00a8151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:07.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00ad2a3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0090005910 0x7f00a8151140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52672/0 (socket says 172.21.15.90:52672) 2024-09-10T23:18:07.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00ad2a3640 1 -- 172.21.15.90:0/1772389768 learned_addr learned my addr 172.21.15.90:0/1772389768 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:07.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00ad2a3640 1 -- 172.21.15.90:0/1772389768 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00a8151930 msgr2=0x7f00a80b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:07.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00ad2a3640 1 --2- 172.21.15.90:0/1772389768 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00a8151930 0x7f00a80b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00ad2a3640 1 -- 172.21.15.90:0/1772389768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00a8153f70 msgr2=0x7f00a80b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:07.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00ad2a3640 1 --2- 172.21.15.90:0/1772389768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00a8153f70 0x7f00a80b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00ad2a3640 1 -- 172.21.15.90:0/1772389768 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a81e7fa0 con 0x7f0090005910 2024-09-10T23:18:07.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00ad2a3640 1 --2- 172.21.15.90:0/1772389768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0090005910 0x7f00a8151140 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f00980062f0 tx=0x7f00980067b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:07.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00a5ffb640 1 -- 172.21.15.90:0/1772389768 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098015070 con 0x7f0090005910 2024-09-10T23:18:07.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00a5ffb640 1 -- 172.21.15.90:0/1772389768 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f009800fcc0 con 0x7f0090005910 2024-09-10T23:18:07.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00af507640 1 -- 172.21.15.90:0/1772389768 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a81543f0 con 0x7f0090005910 2024-09-10T23:18:07.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00a5ffb640 1 -- 172.21.15.90:0/1772389768 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098011690 con 0x7f0090005910 2024-09-10T23:18:07.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.272+0000 7f00af507640 1 -- 172.21.15.90:0/1772389768 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a81f5fd0 con 0x7f0090005910 2024-09-10T23:18:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.273+0000 7f00af507640 1 -- 172.21.15.90:0/1772389768 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a80cc710 con 0x7f0090005910 2024-09-10T23:18:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.274+0000 7f00a5ffb640 1 -- 172.21.15.90:0/1772389768 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0098011830 con 0x7f0090005910 2024-09-10T23:18:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.274+0000 7f00a5ffb640 1 --2- 172.21.15.90:0/1772389768 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0094077fa0 0x7f009407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.274+0000 7f00a5ffb640 1 -- 172.21.15.90:0/1772389768 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f009809adc0 con 0x7f0090005910 2024-09-10T23:18:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.274+0000 7f00acaa2640 1 --2- 172.21.15.90:0/1772389768 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0094077fa0 0x7f009407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.275+0000 7f00acaa2640 1 --2- 172.21.15.90:0/1772389768 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0094077fa0 0x7f009407a460 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f009c032000 tx=0x7f009c001120 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:07.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.278+0000 7f00a5ffb640 1 -- 172.21.15.90:0/1772389768 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f00a81e7fa0 con 0x7f0090005910 2024-09-10T23:18:07.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.452+0000 7f00af507640 1 -- 172.21.15.90:0/1772389768 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00a80cc480 con 0x7f0090005910 2024-09-10T23:18:07.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.453+0000 7f00a5ffb640 1 -- 172.21.15.90:0/1772389768 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16668 (secure 0 0 0) 0x7f00980638c0 con 0x7f0090005910 2024-09-10T23:18:07.454 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:07.454 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":92,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:17:54.535851+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:17:51.514546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-10T23:17:51.860237+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:18:07.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.455+0000 7f00af507640 1 -- 172.21.15.90:0/1772389768 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0094077fa0 msgr2=0x7f009407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:07.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.455+0000 7f00af507640 1 --2- 172.21.15.90:0/1772389768 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0094077fa0 0x7f009407a460 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f009c032000 tx=0x7f009c001120 comp rx=0 tx=0).stop 2024-09-10T23:18:07.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.455+0000 7f00af507640 1 -- 172.21.15.90:0/1772389768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0090005910 msgr2=0x7f00a8151140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:07.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.455+0000 7f00af507640 1 --2- 172.21.15.90:0/1772389768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0090005910 0x7f00a8151140 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f00980062f0 tx=0x7f00980067b0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.455+0000 7f00af507640 1 -- 172.21.15.90:0/1772389768 shutdown_connections 2024-09-10T23:18:07.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.455+0000 7f00af507640 1 --2- 172.21.15.90:0/1772389768 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0094077fa0 0x7f009407a460 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.455+0000 7f00af507640 1 --2- 172.21.15.90:0/1772389768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00a8153f70 0x7f00a80b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.455+0000 7f00af507640 1 --2- 172.21.15.90:0/1772389768 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00a8151930 0x7f00a80b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.455+0000 7f00af507640 1 --2- 172.21.15.90:0/1772389768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0090005910 0x7f00a8151140 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.455+0000 7f00af507640 1 -- 172.21.15.90:0/1772389768 >> 172.21.15.90:0/1772389768 conn(0x7f00a80b19c0 msgr2=0x7f00a80740a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:07.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.455+0000 7f00af507640 1 -- 172.21.15.90:0/1772389768 shutdown_connections 2024-09-10T23:18:07.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.455+0000 7f00af507640 1 -- 172.21.15.90:0/1772389768 wait complete. 2024-09-10T23:18:07.467 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:18:07.467 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:07.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.567+0000 7f6840ecd640 1 -- 172.21.15.90:0/4084304801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f683c15e310 msgr2=0x7f683c0d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:07.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.567+0000 7f6840ecd640 1 --2- 172.21.15.90:0/4084304801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f683c15e310 0x7f683c0d0a80 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f683c08e8c0 tx=0x7f682c02aa30 comp rx=0 tx=0).stop 2024-09-10T23:18:07.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.567+0000 7f6840ecd640 1 -- 172.21.15.90:0/4084304801 shutdown_connections 2024-09-10T23:18:07.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.567+0000 7f6840ecd640 1 --2- 172.21.15.90:0/4084304801 >> v2:172.21.15.171:3300/0 conn(0x7f683c0d38d0 0x7f683c0d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.567+0000 7f6840ecd640 1 --2- 172.21.15.90:0/4084304801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f683c15e310 0x7f683c0d0a80 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.567+0000 7f6840ecd640 1 -- 172.21.15.90:0/4084304801 >> 172.21.15.90:0/4084304801 conn(0x7f683c0d4090 msgr2=0x7f683c0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:07.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.567+0000 7f6840ecd640 1 -- 172.21.15.90:0/4084304801 shutdown_connections 2024-09-10T23:18:07.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.567+0000 7f6840ecd640 1 -- 172.21.15.90:0/4084304801 wait complete. 2024-09-10T23:18:07.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.569+0000 7f6840ecd640 1 Processor -- start 2024-09-10T23:18:07.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.569+0000 7f6840ecd640 1 -- start start 2024-09-10T23:18:07.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f6840ecd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f683c0d16f0 0x7f683c0b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:07.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f6840ecd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f683c0d38d0 0x7f683c0b9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:07.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f6840ecd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f683c15e310 0x7f683c157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:07.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f6840ecd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f683c0cf800 con 0x7f683c0d16f0 2024-09-10T23:18:07.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f6840ecd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f683c0d4d90 con 0x7f683c0d38d0 2024-09-10T23:18:07.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f6840ecd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f683c06de00 con 0x7f683c15e310 2024-09-10T23:18:07.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f683a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f683c0d16f0 0x7f683c0b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:07.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f683a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f683c0d16f0 0x7f683c0b5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52688/0 (socket says 172.21.15.90:52688) 2024-09-10T23:18:07.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f683a59c640 1 -- 172.21.15.90:0/3797279886 learned_addr learned my addr 172.21.15.90:0/3797279886 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:07.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f683a59c640 1 -- 172.21.15.90:0/3797279886 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f683c15e310 msgr2=0x7f683c157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:07.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f683a59c640 1 --2- 172.21.15.90:0/3797279886 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f683c15e310 0x7f683c157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f683a59c640 1 -- 172.21.15.90:0/3797279886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f683c0d38d0 msgr2=0x7f683c0b9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:07.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f683a59c640 1 --2- 172.21.15.90:0/3797279886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f683c0d38d0 0x7f683c0b9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f683a59c640 1 -- 172.21.15.90:0/3797279886 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683c0cc6a0 con 0x7f683c0d16f0 2024-09-10T23:18:07.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f683a59c640 1 --2- 172.21.15.90:0/3797279886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f683c0d16f0 0x7f683c0b5a50 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f682c009d60 tx=0x7f682c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:07.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f6832ffd640 1 -- 172.21.15.90:0/3797279886 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c033050 con 0x7f683c0d16f0 2024-09-10T23:18:07.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f6832ffd640 1 -- 172.21.15.90:0/3797279886 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f682c0045f0 con 0x7f683c0d16f0 2024-09-10T23:18:07.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f6832ffd640 1 -- 172.21.15.90:0/3797279886 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c038450 con 0x7f683c0d16f0 2024-09-10T23:18:07.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f6840ecd640 1 -- 172.21.15.90:0/3797279886 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683c1f7e20 con 0x7f683c0d16f0 2024-09-10T23:18:07.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.570+0000 7f6840ecd640 1 -- 172.21.15.90:0/3797279886 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f683c1f83e0 con 0x7f683c0d16f0 2024-09-10T23:18:07.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.571+0000 7f6840ecd640 1 -- 172.21.15.90:0/3797279886 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f683c06e2b0 con 0x7f683c0d16f0 2024-09-10T23:18:07.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.572+0000 7f6832ffd640 1 -- 172.21.15.90:0/3797279886 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f682c040070 con 0x7f683c0d16f0 2024-09-10T23:18:07.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.573+0000 7f6832ffd640 1 --2- 172.21.15.90:0/3797279886 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f681c077f70 0x7f681c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:07.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.573+0000 7f6832ffd640 1 -- 172.21.15.90:0/3797279886 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f682c0bb1c0 con 0x7f683c0d16f0 2024-09-10T23:18:07.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.573+0000 7f6839d9b640 1 --2- 172.21.15.90:0/3797279886 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f681c077f70 0x7f681c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:07.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.573+0000 7f6839d9b640 1 --2- 172.21.15.90:0/3797279886 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f681c077f70 0x7f681c07a430 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f683c0cae90 tx=0x7f68240078d0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:07.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.577+0000 7f6832ffd640 1 -- 172.21.15.90:0/3797279886 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f682c083d50 con 0x7f683c0d16f0 2024-09-10T23:18:07.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.788+0000 7f6840ecd640 1 -- 172.21.15.90:0/3797279886 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f683c0b1f80 con 0x7f683c0d16f0 2024-09-10T23:18:07.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.788+0000 7f6832ffd640 1 -- 172.21.15.90:0/3797279886 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5222 (secure 0 0 0) 0x7f682c083650 con 0x7f683c0d16f0 2024-09-10T23:18:07.789 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:07.790 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":51,"btime":"2024-09-10T23:17:55:561728+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5741,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/991470791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":991470791},{"type":"v1","addr":"172.21.15.171:6836","nonce":991470791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6037,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/372190727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":372190727},{"type":"v1","addr":"172.21.15.171:6837","nonce":372190727}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/970952744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":970952744},{"type":"v1","addr":"172.21.15.90:6834","nonce":970952744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:52.907365+0000","modified":"2024-09-10T23:17:54.899883+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/3653031756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":3653031756},{"type":"v1","addr":"172.21.15.90:6835","nonce":3653031756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6714,"qdb_cluster":[6714]},"id":7}]} 2024-09-10T23:18:07.790 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 51 2024-09-10T23:18:07.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.791+0000 7f6840ecd640 1 -- 172.21.15.90:0/3797279886 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f681c077f70 msgr2=0x7f681c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:07.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.791+0000 7f6840ecd640 1 --2- 172.21.15.90:0/3797279886 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f681c077f70 0x7f681c07a430 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f683c0cae90 tx=0x7f68240078d0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.791+0000 7f6840ecd640 1 -- 172.21.15.90:0/3797279886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f683c0d16f0 msgr2=0x7f683c0b5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:07.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.791+0000 7f6840ecd640 1 --2- 172.21.15.90:0/3797279886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f683c0d16f0 0x7f683c0b5a50 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f682c009d60 tx=0x7f682c003f90 comp rx=0 tx=0).stop 2024-09-10T23:18:07.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.791+0000 7f6840ecd640 1 -- 172.21.15.90:0/3797279886 shutdown_connections 2024-09-10T23:18:07.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.791+0000 7f6840ecd640 1 --2- 172.21.15.90:0/3797279886 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f681c077f70 0x7f681c07a430 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.791+0000 7f6840ecd640 1 --2- 172.21.15.90:0/3797279886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f683c0d38d0 0x7f683c0b9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.791+0000 7f6840ecd640 1 --2- 172.21.15.90:0/3797279886 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f683c15e310 0x7f683c157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.791+0000 7f6840ecd640 1 --2- 172.21.15.90:0/3797279886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f683c0d16f0 0x7f683c0b5a50 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.791+0000 7f6840ecd640 1 -- 172.21.15.90:0/3797279886 >> 172.21.15.90:0/3797279886 conn(0x7f683c0d4090 msgr2=0x7f683c0b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:07.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.791+0000 7f6840ecd640 1 -- 172.21.15.90:0/3797279886 shutdown_connections 2024-09-10T23:18:07.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.791+0000 7f6840ecd640 1 -- 172.21.15.90:0/3797279886 wait complete. 2024-09-10T23:18:07.803 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:07.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.903+0000 7f5cfb3bc640 1 -- 172.21.15.90:0/1241716519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cdc0052e0 msgr2=0x7f5cdc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:07.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.903+0000 7f5cfb3bc640 1 --2- 172.21.15.90:0/1241716519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cdc0052e0 0x7f5cdc00b9c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40013d0 tx=0x7f5cdc005830 comp rx=0 tx=0).stop 2024-09-10T23:18:07.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.903+0000 7f5cfb3bc640 1 -- 172.21.15.90:0/1241716519 shutdown_connections 2024-09-10T23:18:07.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.903+0000 7f5cfb3bc640 1 --2- 172.21.15.90:0/1241716519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cdc0052e0 0x7f5cdc00b9c0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.903+0000 7f5cfb3bc640 1 -- 172.21.15.90:0/1241716519 >> 172.21.15.90:0/1241716519 conn(0x7f5cf40d4090 msgr2=0x7f5cf40d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:07.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.903+0000 7f5cfb3bc640 1 -- 172.21.15.90:0/1241716519 shutdown_connections 2024-09-10T23:18:07.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.903+0000 7f5cfb3bc640 1 -- 172.21.15.90:0/1241716519 wait complete. 2024-09-10T23:18:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.904+0000 7f5cfb3bc640 1 Processor -- start 2024-09-10T23:18:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.904+0000 7f5cfb3bc640 1 -- start start 2024-09-10T23:18:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cfb3bc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cdc0052e0 0x7f5cf41586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cfb3bc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf40b9500 0x7f5cf4158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cfb3bc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf40b9980 0x7f5cf4159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cfb3bc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf40d4d00 con 0x7f5cf40b9980 2024-09-10T23:18:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cfb3bc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf40d4b80 con 0x7f5cf40b9500 2024-09-10T23:18:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cfb3bc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf40d4e80 con 0x7f5cdc0052e0 2024-09-10T23:18:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cf9959640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf40b9980 0x7f5cf4159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cf9959640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf40b9980 0x7f5cf4159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52700/0 (socket says 172.21.15.90:52700) 2024-09-10T23:18:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cf9959640 1 -- 172.21.15.90:0/3512990103 learned_addr learned my addr 172.21.15.90:0/3512990103 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:07.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cf9158640 1 --2- 172.21.15.90:0/3512990103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cdc0052e0 0x7f5cf41586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:07.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cf8957640 1 --2- 172.21.15.90:0/3512990103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf40b9500 0x7f5cf4158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:07.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cf9959640 1 -- 172.21.15.90:0/3512990103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cdc0052e0 msgr2=0x7f5cf41586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:07.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cf9959640 1 --2- 172.21.15.90:0/3512990103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cdc0052e0 0x7f5cf41586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cf9959640 1 -- 172.21.15.90:0/3512990103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf40b9500 msgr2=0x7f5cf4158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:07.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cf9959640 1 --2- 172.21.15.90:0/3512990103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf40b9500 0x7f5cf4158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:07.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cf9959640 1 -- 172.21.15.90:0/3512990103 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf4158be0 con 0x7f5cf40b9980 2024-09-10T23:18:07.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cf9158640 1 --2- 172.21.15.90:0/3512990103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cdc0052e0 0x7f5cf41586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:07.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cf9959640 1 --2- 172.21.15.90:0/3512990103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf40b9980 0x7f5cf4159380 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f5ce402b410 tx=0x7f5ce4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:07.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cf1ffb640 1 -- 172.21.15.90:0/3512990103 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4039070 con 0x7f5cf40b9980 2024-09-10T23:18:07.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cf1ffb640 1 -- 172.21.15.90:0/3512990103 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ce402bc60 con 0x7f5cf40b9980 2024-09-10T23:18:07.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cf1ffb640 1 -- 172.21.15.90:0/3512990103 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4006330 con 0x7f5cf40b9980 2024-09-10T23:18:07.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.905+0000 7f5cfb3bc640 1 -- 172.21.15.90:0/3512990103 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf415a7b0 con 0x7f5cf40b9980 2024-09-10T23:18:07.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.906+0000 7f5cfb3bc640 1 -- 172.21.15.90:0/3512990103 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf415ad70 con 0x7f5cf40b9980 2024-09-10T23:18:07.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.906+0000 7f5cfb3bc640 1 -- 172.21.15.90:0/3512990103 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf40d0d20 con 0x7f5cf40b9980 2024-09-10T23:18:07.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.907+0000 7f5cf1ffb640 1 -- 172.21.15.90:0/3512990103 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5ce40064d0 con 0x7f5cf40b9980 2024-09-10T23:18:07.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.908+0000 7f5cf1ffb640 1 --2- 172.21.15.90:0/3512990103 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ce0077f70 0x7f5ce007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:07.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.908+0000 7f5cf1ffb640 1 -- 172.21.15.90:0/3512990103 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f5ce40b99f0 con 0x7f5cf40b9980 2024-09-10T23:18:07.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.908+0000 7f5cf9158640 1 --2- 172.21.15.90:0/3512990103 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ce0077f70 0x7f5ce007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:07.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.908+0000 7f5cf9158640 1 --2- 172.21.15.90:0/3512990103 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ce0077f70 0x7f5ce007a430 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5cf415c370 tx=0x7f5cec005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:07.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:07.912+0000 7f5cf1ffb640 1 -- 172.21.15.90:0/3512990103 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5ce40824f0 con 0x7f5cf40b9980 2024-09-10T23:18:08.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.119+0000 7f5cfb3bc640 1 -- 172.21.15.90:0/3512990103 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cf40b6380 con 0x7f5cf40b9980 2024-09-10T23:18:08.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.120+0000 7f5cf1ffb640 1 -- 172.21.15.90:0/3512990103 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5222 (secure 0 0 0) 0x7f5ce4081df0 con 0x7f5cf40b9980 2024-09-10T23:18:08.121 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:08.121 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":51,"btime":"2024-09-10T23:17:55:561728+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5741,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/991470791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":991470791},{"type":"v1","addr":"172.21.15.171:6836","nonce":991470791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6037,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/372190727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":372190727},{"type":"v1","addr":"172.21.15.171:6837","nonce":372190727}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/970952744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":970952744},{"type":"v1","addr":"172.21.15.90:6834","nonce":970952744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:17:52.907365+0000","modified":"2024-09-10T23:17:54.899883+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":2,"addr":"172.21.15.90:6835/3653031756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":3653031756},{"type":"v1","addr":"172.21.15.90:6835","nonce":3653031756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6714,"qdb_cluster":[6714]},"id":7}]} 2024-09-10T23:18:08.121 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 51 2024-09-10T23:18:08.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.122+0000 7f5cfb3bc640 1 -- 172.21.15.90:0/3512990103 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ce0077f70 msgr2=0x7f5ce007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:08.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.122+0000 7f5cfb3bc640 1 --2- 172.21.15.90:0/3512990103 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ce0077f70 0x7f5ce007a430 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5cf415c370 tx=0x7f5cec005f90 comp rx=0 tx=0).stop 2024-09-10T23:18:08.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.122+0000 7f5cfb3bc640 1 -- 172.21.15.90:0/3512990103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf40b9980 msgr2=0x7f5cf4159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:08.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.122+0000 7f5cfb3bc640 1 --2- 172.21.15.90:0/3512990103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf40b9980 0x7f5cf4159380 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f5ce402b410 tx=0x7f5ce4003ba0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.122+0000 7f5cfb3bc640 1 -- 172.21.15.90:0/3512990103 shutdown_connections 2024-09-10T23:18:08.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.122+0000 7f5cfb3bc640 1 --2- 172.21.15.90:0/3512990103 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5ce0077f70 0x7f5ce007a430 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.122+0000 7f5cfb3bc640 1 --2- 172.21.15.90:0/3512990103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf40b9500 0x7f5cf4158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.122+0000 7f5cfb3bc640 1 --2- 172.21.15.90:0/3512990103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5cf40b9980 0x7f5cf4159380 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.122+0000 7f5cfb3bc640 1 --2- 172.21.15.90:0/3512990103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cdc0052e0 0x7f5cf41586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.122+0000 7f5cfb3bc640 1 -- 172.21.15.90:0/3512990103 >> 172.21.15.90:0/3512990103 conn(0x7f5cf40d4090 msgr2=0x7f5cf40d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:08.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.122+0000 7f5cfb3bc640 1 -- 172.21.15.90:0/3512990103 shutdown_connections 2024-09-10T23:18:08.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.122+0000 7f5cfb3bc640 1 -- 172.21.15.90:0/3512990103 wait complete. 2024-09-10T23:18:08.134 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:18:08.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.235+0000 7f1740a7f640 1 -- 172.21.15.90:0/2737599237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f173c0cdb90 msgr2=0x7f173c0cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:08.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.235+0000 7f1740a7f640 1 --2- 172.21.15.90:0/2737599237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f173c0cdb90 0x7f173c0cdfd0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f1730005fd0 tx=0x7f173002a5d0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.235+0000 7f1740a7f640 1 -- 172.21.15.90:0/2737599237 shutdown_connections 2024-09-10T23:18:08.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.235+0000 7f1740a7f640 1 --2- 172.21.15.90:0/2737599237 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f173c06f550 0x7f173c06f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.235+0000 7f1740a7f640 1 --2- 172.21.15.90:0/2737599237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f173c0cdb90 0x7f173c0cdfd0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.235+0000 7f1740a7f640 1 -- 172.21.15.90:0/2737599237 >> 172.21.15.90:0/2737599237 conn(0x7f173c0b19c0 msgr2=0x7f173c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:08.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.235+0000 7f1740a7f640 1 -- 172.21.15.90:0/2737599237 shutdown_connections 2024-09-10T23:18:08.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.235+0000 7f1740a7f640 1 -- 172.21.15.90:0/2737599237 wait complete. 2024-09-10T23:18:08.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.236+0000 7f1740a7f640 1 Processor -- start 2024-09-10T23:18:08.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.236+0000 7f1740a7f640 1 -- start start 2024-09-10T23:18:08.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.237+0000 7f1740a7f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f173c06f550 0x7f173c15aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:08.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.237+0000 7f1740a7f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f173c0cdb90 0x7f173c0cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:08.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.237+0000 7f1740a7f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f173c15f750 0x7f173c0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:08.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.237+0000 7f1740a7f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f173c0cc940 con 0x7f173c15f750 2024-09-10T23:18:08.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.237+0000 7f1740a7f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f173c0cc7c0 con 0x7f173c06f550 2024-09-10T23:18:08.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.237+0000 7f1740a7f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f173c0ccac0 con 0x7f173c0cdb90 2024-09-10T23:18:08.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.237+0000 7f173ad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f173c15f750 0x7f173c0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:08.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.237+0000 7f173ad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f173c15f750 0x7f173c0cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54812/0 (socket says 172.21.15.90:54812) 2024-09-10T23:18:08.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.237+0000 7f173ad9d640 1 -- 172.21.15.90:0/2678870247 learned_addr learned my addr 172.21.15.90:0/2678870247 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:08.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.237+0000 7f1739d9b640 1 --2- 172.21.15.90:0/2678870247 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f173c0cdb90 0x7f173c0cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:08.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.237+0000 7f173a59c640 1 --2- 172.21.15.90:0/2678870247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f173c06f550 0x7f173c15aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:08.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.238+0000 7f173ad9d640 1 -- 172.21.15.90:0/2678870247 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f173c0cdb90 msgr2=0x7f173c0cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:08.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.238+0000 7f173ad9d640 1 --2- 172.21.15.90:0/2678870247 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f173c0cdb90 0x7f173c0cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.238+0000 7f173ad9d640 1 -- 172.21.15.90:0/2678870247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f173c06f550 msgr2=0x7f173c15aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:08.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.238+0000 7f173ad9d640 1 --2- 172.21.15.90:0/2678870247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f173c06f550 0x7f173c15aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.238+0000 7f173ad9d640 1 -- 172.21.15.90:0/2678870247 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173c1f5480 con 0x7f173c15f750 2024-09-10T23:18:08.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.238+0000 7f173ad9d640 1 --2- 172.21.15.90:0/2678870247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f173c15f750 0x7f173c0cbc80 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f173400d750 tx=0x7f173400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:08.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.238+0000 7f172affd640 1 -- 172.21.15.90:0/2678870247 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734017070 con 0x7f173c15f750 2024-09-10T23:18:08.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.238+0000 7f172affd640 1 -- 172.21.15.90:0/2678870247 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1734009cc0 con 0x7f173c15f750 2024-09-10T23:18:08.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.238+0000 7f172affd640 1 -- 172.21.15.90:0/2678870247 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173400de60 con 0x7f173c15f750 2024-09-10T23:18:08.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.238+0000 7f1740a7f640 1 -- 172.21.15.90:0/2678870247 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f173c1f5760 con 0x7f173c15f750 2024-09-10T23:18:08.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.238+0000 7f1740a7f640 1 -- 172.21.15.90:0/2678870247 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f173c1f5d20 con 0x7f173c15f750 2024-09-10T23:18:08.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.239+0000 7f1740a7f640 1 -- 172.21.15.90:0/2678870247 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f173c06f9e0 con 0x7f173c15f750 2024-09-10T23:18:08.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.239+0000 7f172affd640 1 -- 172.21.15.90:0/2678870247 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1734005280 con 0x7f173c15f750 2024-09-10T23:18:08.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.240+0000 7f172affd640 1 --2- 172.21.15.90:0/2678870247 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f171c077f70 0x7f171c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:08.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.240+0000 7f172affd640 1 -- 172.21.15.90:0/2678870247 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f1734099dc0 con 0x7f173c15f750 2024-09-10T23:18:08.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.240+0000 7f173a59c640 1 --2- 172.21.15.90:0/2678870247 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f171c077f70 0x7f171c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:08.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.241+0000 7f173a59c640 1 --2- 172.21.15.90:0/2678870247 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f171c077f70 0x7f171c07a430 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f172c001e20 tx=0x7f172c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:08.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.245+0000 7f172affd640 1 -- 172.21.15.90:0/2678870247 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1734062270 con 0x7f173c15f750 2024-09-10T23:18:08.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.420+0000 7f1740a7f640 1 -- 172.21.15.90:0/2678870247 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f173c0af160 con 0x7f173c15f750 2024-09-10T23:18:08.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.421+0000 7f172affd640 1 -- 172.21.15.90:0/2678870247 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16668 (secure 0 0 0) 0x7f1734066ca0 con 0x7f173c15f750 2024-09-10T23:18:08.422 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:08.422 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":92,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:17:54.535851+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:17:51.514546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-10T23:17:51.860237+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:18:08.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.423+0000 7f1740a7f640 1 -- 172.21.15.90:0/2678870247 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f171c077f70 msgr2=0x7f171c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:08.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.423+0000 7f1740a7f640 1 --2- 172.21.15.90:0/2678870247 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f171c077f70 0x7f171c07a430 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f172c001e20 tx=0x7f172c009040 comp rx=0 tx=0).stop 2024-09-10T23:18:08.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.423+0000 7f1740a7f640 1 -- 172.21.15.90:0/2678870247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f173c15f750 msgr2=0x7f173c0cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:08.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.423+0000 7f1740a7f640 1 --2- 172.21.15.90:0/2678870247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f173c15f750 0x7f173c0cbc80 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f173400d750 tx=0x7f173400dc10 comp rx=0 tx=0).stop 2024-09-10T23:18:08.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.423+0000 7f1740a7f640 1 -- 172.21.15.90:0/2678870247 shutdown_connections 2024-09-10T23:18:08.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.423+0000 7f1740a7f640 1 --2- 172.21.15.90:0/2678870247 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f171c077f70 0x7f171c07a430 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.423+0000 7f1740a7f640 1 --2- 172.21.15.90:0/2678870247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f173c15f750 0x7f173c0cbc80 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.423+0000 7f1740a7f640 1 --2- 172.21.15.90:0/2678870247 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f173c0cdb90 0x7f173c0cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.423+0000 7f1740a7f640 1 --2- 172.21.15.90:0/2678870247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f173c06f550 0x7f173c15aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.423+0000 7f1740a7f640 1 -- 172.21.15.90:0/2678870247 >> 172.21.15.90:0/2678870247 conn(0x7f173c0b19c0 msgr2=0x7f173c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:08.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.423+0000 7f1740a7f640 1 -- 172.21.15.90:0/2678870247 shutdown_connections 2024-09-10T23:18:08.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.423+0000 7f1740a7f640 1 -- 172.21.15.90:0/2678870247 wait complete. 2024-09-10T23:18:08.435 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:18:08.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.535+0000 7f0aaeb82640 1 -- 172.21.15.90:0/3687169575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0aa80d16f0 msgr2=0x7f0aa80d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:08.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.535+0000 7f0aaeb82640 1 --2- 172.21.15.90:0/3687169575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0aa80d16f0 0x7f0aa80d2e00 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8069810 tx=0x7f0a9002a560 comp rx=0 tx=0).stop 2024-09-10T23:18:08.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.535+0000 7f0aaeb82640 1 -- 172.21.15.90:0/3687169575 shutdown_connections 2024-09-10T23:18:08.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.535+0000 7f0aaeb82640 1 --2- 172.21.15.90:0/3687169575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0aa80d16f0 0x7f0aa80d2e00 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.535+0000 7f0aaeb82640 1 --2- 172.21.15.90:0/3687169575 >> v2:172.21.15.171:3300/0 conn(0x7f0aa80d1190 0x7f0aa80d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.535+0000 7f0aaeb82640 1 -- 172.21.15.90:0/3687169575 >> 172.21.15.90:0/3687169575 conn(0x7f0aa80d4090 msgr2=0x7f0aa80d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:08.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.535+0000 7f0aaeb82640 1 -- 172.21.15.90:0/3687169575 shutdown_connections 2024-09-10T23:18:08.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.535+0000 7f0aaeb82640 1 -- 172.21.15.90:0/3687169575 wait complete. 2024-09-10T23:18:08.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.537+0000 7f0aaeb82640 1 Processor -- start 2024-09-10T23:18:08.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.537+0000 7f0aaeb82640 1 -- start start 2024-09-10T23:18:08.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.537+0000 7f0aaeb82640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0aa80d1190 0x7f0aa815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:08.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.537+0000 7f0aaeb82640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0aa80d16f0 0x7f0aa8161040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:08.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.537+0000 7f0aaeb82640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0aa815e310 0x7f0aa8161580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:08.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aaeb82640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa80d3340 con 0x7f0aa80d16f0 2024-09-10T23:18:08.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aaeb82640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa80d4d90 con 0x7f0aa80d1190 2024-09-10T23:18:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aaeb82640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa80d34c0 con 0x7f0aa815e310 2024-09-10T23:18:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aa7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0aa80d16f0 0x7f0aa8161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aa7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0aa80d16f0 0x7f0aa8161040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54844/0 (socket says 172.21.15.90:54844) 2024-09-10T23:18:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aa7fff640 1 -- 172.21.15.90:0/455015570 learned_addr learned my addr 172.21.15.90:0/455015570 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aac91e640 1 --2- 172.21.15.90:0/455015570 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0aa80d1190 0x7f0aa815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aad11f640 1 --2- 172.21.15.90:0/455015570 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0aa815e310 0x7f0aa8161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aa7fff640 1 -- 172.21.15.90:0/455015570 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0aa815e310 msgr2=0x7f0aa8161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aa7fff640 1 --2- 172.21.15.90:0/455015570 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0aa815e310 0x7f0aa8161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aa7fff640 1 -- 172.21.15.90:0/455015570 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0aa80d1190 msgr2=0x7f0aa815baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aa7fff640 1 --2- 172.21.15.90:0/455015570 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0aa80d1190 0x7f0aa815baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aa7fff640 1 -- 172.21.15.90:0/455015570 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa80cc380 con 0x7f0aa80d16f0 2024-09-10T23:18:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aac91e640 1 --2- 172.21.15.90:0/455015570 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0aa80d1190 0x7f0aa815baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:08.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aad11f640 1 --2- 172.21.15.90:0/455015570 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0aa815e310 0x7f0aa8161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:08.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aa7fff640 1 --2- 172.21.15.90:0/455015570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0aa80d16f0 0x7f0aa8161040 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800cce0 tx=0x7f0a9800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:08.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aa57fa640 1 -- 172.21.15.90:0/455015570 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800f650 con 0x7f0aa80d16f0 2024-09-10T23:18:08.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aa57fa640 1 -- 172.21.15.90:0/455015570 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a9800f8e0 con 0x7f0aa80d16f0 2024-09-10T23:18:08.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aa57fa640 1 -- 172.21.15.90:0/455015570 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800fd30 con 0x7f0aa80d16f0 2024-09-10T23:18:08.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aaeb82640 1 -- 172.21.15.90:0/455015570 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa80cb2e0 con 0x7f0aa80d16f0 2024-09-10T23:18:08.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.538+0000 7f0aaeb82640 1 -- 172.21.15.90:0/455015570 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa80cb8a0 con 0x7f0aa80d16f0 2024-09-10T23:18:08.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.539+0000 7f0aaeb82640 1 -- 172.21.15.90:0/455015570 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aa806a2f0 con 0x7f0aa80d16f0 2024-09-10T23:18:08.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.540+0000 7f0aa57fa640 1 -- 172.21.15.90:0/455015570 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0a98020030 con 0x7f0aa80d16f0 2024-09-10T23:18:08.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.540+0000 7f0aa57fa640 1 --2- 172.21.15.90:0/455015570 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0a88077f70 0x7f0a8807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:08.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.541+0000 7f0aa57fa640 1 -- 172.21.15.90:0/455015570 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f0a9809a670 con 0x7f0aa80d16f0 2024-09-10T23:18:08.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.541+0000 7f0aac91e640 1 --2- 172.21.15.90:0/455015570 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0a88077f70 0x7f0a8807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:08.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.541+0000 7f0aac91e640 1 --2- 172.21.15.90:0/455015570 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0a88077f70 0x7f0a8807a430 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0000f60 tx=0x7f0aa0009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:08.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.545+0000 7f0aa57fa640 1 -- 172.21.15.90:0/455015570 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0aa806a2f0 con 0x7f0aa80d16f0 2024-09-10T23:18:08.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.758+0000 7f0aaeb82640 1 -- 172.21.15.90:0/455015570 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0aa80ccd50 con 0x7f0aa80d16f0 2024-09-10T23:18:08.759 INFO:tasks.ceph.mon.a.smithi090.stderr:2024-09-10T23:18:08.759+0000 7f1a0c84c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:18:08.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.762+0000 7f0aa57fa640 1 -- 172.21.15.90:0/455015570 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) ==== 161+0+0 (secure 0 0 0) 0x7f0a98014030 con 0x7f0aa80d16f0 2024-09-10T23:18:08.763 INFO:teuthology.orchestra.run.smithi090.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:18:08.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.764+0000 7f0aaeb82640 1 -- 172.21.15.90:0/455015570 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0a88077f70 msgr2=0x7f0a8807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:08.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.764+0000 7f0aaeb82640 1 --2- 172.21.15.90:0/455015570 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0a88077f70 0x7f0a8807a430 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0000f60 tx=0x7f0aa0009040 comp rx=0 tx=0).stop 2024-09-10T23:18:08.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.764+0000 7f0aaeb82640 1 -- 172.21.15.90:0/455015570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0aa80d16f0 msgr2=0x7f0aa8161040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:08.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.764+0000 7f0aaeb82640 1 --2- 172.21.15.90:0/455015570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0aa80d16f0 0x7f0aa8161040 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800cce0 tx=0x7f0a9800a620 comp rx=0 tx=0).stop 2024-09-10T23:18:08.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.764+0000 7f0aaeb82640 1 -- 172.21.15.90:0/455015570 shutdown_connections 2024-09-10T23:18:08.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.764+0000 7f0aaeb82640 1 --2- 172.21.15.90:0/455015570 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0a88077f70 0x7f0a8807a430 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.764+0000 7f0aaeb82640 1 --2- 172.21.15.90:0/455015570 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0aa815e310 0x7f0aa8161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.764+0000 7f0aaeb82640 1 --2- 172.21.15.90:0/455015570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0aa80d16f0 0x7f0aa8161040 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.764+0000 7f0aaeb82640 1 --2- 172.21.15.90:0/455015570 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0aa80d1190 0x7f0aa815baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.764+0000 7f0aaeb82640 1 -- 172.21.15.90:0/455015570 >> 172.21.15.90:0/455015570 conn(0x7f0aa80d4090 msgr2=0x7f0aa806d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:08.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.764+0000 7f0aaeb82640 1 -- 172.21.15.90:0/455015570 shutdown_connections 2024-09-10T23:18:08.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.764+0000 7f0aaeb82640 1 -- 172.21.15.90:0/455015570 wait complete. 2024-09-10T23:18:08.767 INFO:tasks.ceph.mds.a.smithi090.stderr: -2202> 2024-09-10T23:17:56.534+0000 7fbf0b0a2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:18:08.778 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:18:08.796 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-09-10T23:18:08.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.880+0000 7feb44de2640 1 -- 172.21.15.90:0/1507759607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb400b3310 msgr2=0x7feb400b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:08.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.880+0000 7feb44de2640 1 --2- 172.21.15.90:0/1507759607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb400b3310 0x7feb400b24e0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7feb30005fd0 tx=0x7feb3002aa10 comp rx=0 tx=0).stop 2024-09-10T23:18:08.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.881+0000 7feb44de2640 1 -- 172.21.15.90:0/1507759607 shutdown_connections 2024-09-10T23:18:08.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.881+0000 7feb44de2640 1 --2- 172.21.15.90:0/1507759607 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb400ceca0 0x7feb400cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.881+0000 7feb44de2640 1 --2- 172.21.15.90:0/1507759607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb400b3310 0x7feb400b24e0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.881+0000 7feb44de2640 1 -- 172.21.15.90:0/1507759607 >> 172.21.15.90:0/1507759607 conn(0x7feb400b19c0 msgr2=0x7feb400b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:08.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.881+0000 7feb44de2640 1 -- 172.21.15.90:0/1507759607 shutdown_connections 2024-09-10T23:18:08.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.881+0000 7feb44de2640 1 -- 172.21.15.90:0/1507759607 wait complete. 2024-09-10T23:18:08.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.882+0000 7feb44de2640 1 Processor -- start 2024-09-10T23:18:08.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.882+0000 7feb44de2640 1 -- start start 2024-09-10T23:18:08.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb44de2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb400b3310 0x7feb401e69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:08.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb44de2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb400ceca0 0x7feb4009baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:08.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb44de2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb40153a70 0x7feb4009c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:08.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb44de2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feb4015bb40 con 0x7feb400b3310 2024-09-10T23:18:08.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb44de2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feb4015b9c0 con 0x7feb400ceca0 2024-09-10T23:18:08.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb44de2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7feb4015bcc0 con 0x7feb40153a70 2024-09-10T23:18:08.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb3e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb400b3310 0x7feb401e69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:08.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb3e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb400b3310 0x7feb401e69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54888/0 (socket says 172.21.15.90:54888) 2024-09-10T23:18:08.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb3e59c640 1 -- 172.21.15.90:0/1754542433 learned_addr learned my addr 172.21.15.90:0/1754542433 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:08.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb3e59c640 1 -- 172.21.15.90:0/1754542433 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb40153a70 msgr2=0x7feb4009c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:08.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb3e59c640 1 --2- 172.21.15.90:0/1754542433 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb40153a70 0x7feb4009c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb3dd9b640 1 --2- 172.21.15.90:0/1754542433 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb400ceca0 0x7feb4009baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:08.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb3e59c640 1 -- 172.21.15.90:0/1754542433 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb400ceca0 msgr2=0x7feb4009baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:08.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb3e59c640 1 --2- 172.21.15.90:0/1754542433 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb400ceca0 0x7feb4009baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:08.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb3e59c640 1 -- 172.21.15.90:0/1754542433 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4009aa50 con 0x7feb400b3310 2024-09-10T23:18:08.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb3e59c640 1 --2- 172.21.15.90:0/1754542433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb400b3310 0x7feb401e69c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7feb3002af30 tx=0x7feb30039a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:08.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb36ffd640 1 -- 172.21.15.90:0/1754542433 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb30048070 con 0x7feb400b3310 2024-09-10T23:18:08.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb36ffd640 1 -- 172.21.15.90:0/1754542433 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb30043420 con 0x7feb400b3310 2024-09-10T23:18:08.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb36ffd640 1 -- 172.21.15.90:0/1754542433 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb30033040 con 0x7feb400b3310 2024-09-10T23:18:08.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.883+0000 7feb44de2640 1 -- 172.21.15.90:0/1754542433 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb4009ad30 con 0x7feb400b3310 2024-09-10T23:18:08.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.884+0000 7feb44de2640 1 -- 172.21.15.90:0/1754542433 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb4009b2f0 con 0x7feb400b3310 2024-09-10T23:18:08.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.885+0000 7feb44de2640 1 -- 172.21.15.90:0/1754542433 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb4015d360 con 0x7feb400b3310 2024-09-10T23:18:08.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.885+0000 7feb36ffd640 1 -- 172.21.15.90:0/1754542433 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7feb3002f6e0 con 0x7feb400b3310 2024-09-10T23:18:08.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.886+0000 7feb36ffd640 1 --2- 172.21.15.90:0/1754542433 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb20077fa0 0x7feb2007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:08.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.886+0000 7feb36ffd640 1 -- 172.21.15.90:0/1754542433 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5795+0+0 (secure 0 0 0) 0x7feb300bb090 con 0x7feb400b3310 2024-09-10T23:18:08.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.886+0000 7feb3dd9b640 1 --2- 172.21.15.90:0/1754542433 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb20077fa0 0x7feb2007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:08.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.886+0000 7feb3dd9b640 1 --2- 172.21.15.90:0/1754542433 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb20077fa0 0x7feb2007a460 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7feb400cc4d0 tx=0x7feb28009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:08.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:08.890+0000 7feb36ffd640 1 -- 172.21.15.90:0/1754542433 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7feb3003e070 con 0x7feb400b3310 2024-09-10T23:18:09.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.100+0000 7feb44de2640 1 -- 172.21.15.90:0/1754542433 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7feb4009d710 con 0x7feb400b3310 2024-09-10T23:18:09.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.766+0000 7feb36ffd640 1 -- 172.21.15.90:0/1754542433 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) ==== 104+0+0 (secure 0 0 0) 0x7feb30083b40 con 0x7feb400b3310 2024-09-10T23:18:09.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.768+0000 7feb44de2640 1 -- 172.21.15.90:0/1754542433 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb20077fa0 msgr2=0x7feb2007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.768+0000 7feb44de2640 1 --2- 172.21.15.90:0/1754542433 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb20077fa0 0x7feb2007a460 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7feb400cc4d0 tx=0x7feb28009040 comp rx=0 tx=0).stop 2024-09-10T23:18:09.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.768+0000 7feb44de2640 1 -- 172.21.15.90:0/1754542433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb400b3310 msgr2=0x7feb401e69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.769+0000 7feb44de2640 1 --2- 172.21.15.90:0/1754542433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb400b3310 0x7feb401e69c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7feb3002af30 tx=0x7feb30039a80 comp rx=0 tx=0).stop 2024-09-10T23:18:09.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.769+0000 7feb44de2640 1 -- 172.21.15.90:0/1754542433 shutdown_connections 2024-09-10T23:18:09.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.769+0000 7feb44de2640 1 --2- 172.21.15.90:0/1754542433 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb20077fa0 0x7feb2007a460 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.769+0000 7feb44de2640 1 --2- 172.21.15.90:0/1754542433 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb400ceca0 0x7feb4009baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.769+0000 7feb44de2640 1 --2- 172.21.15.90:0/1754542433 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb40153a70 0x7feb4009c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.769+0000 7feb44de2640 1 --2- 172.21.15.90:0/1754542433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb400b3310 0x7feb401e69c0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.769+0000 7feb44de2640 1 -- 172.21.15.90:0/1754542433 >> 172.21.15.90:0/1754542433 conn(0x7feb400b19c0 msgr2=0x7feb40153f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.769+0000 7feb44de2640 1 -- 172.21.15.90:0/1754542433 shutdown_connections 2024-09-10T23:18:09.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.769+0000 7feb44de2640 1 -- 172.21.15.90:0/1754542433 wait complete. 2024-09-10T23:18:09.781 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:18:09.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.927+0000 7fd386110640 1 -- 172.21.15.90:0/1785517559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3800d0ad0 msgr2=0x7fd3800cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.927+0000 7fd386110640 1 --2- 172.21.15.90:0/1785517559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3800d0ad0 0x7fd3800cd290 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fd38006dc50 tx=0x7fd37802a560 comp rx=0 tx=0).stop 2024-09-10T23:18:09.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.927+0000 7fd386110640 1 -- 172.21.15.90:0/1785517559 shutdown_connections 2024-09-10T23:18:09.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.927+0000 7fd386110640 1 --2- 172.21.15.90:0/1785517559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3800d0ad0 0x7fd3800cd290 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.927+0000 7fd386110640 1 --2- 172.21.15.90:0/1785517559 >> v2:172.21.15.171:3300/0 conn(0x7fd3800d06f0 0x7fd3800cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.927+0000 7fd386110640 1 -- 172.21.15.90:0/1785517559 >> 172.21.15.90:0/1785517559 conn(0x7fd3800d1ec0 msgr2=0x7fd3800d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.927+0000 7fd386110640 1 -- 172.21.15.90:0/1785517559 shutdown_connections 2024-09-10T23:18:09.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.927+0000 7fd386110640 1 -- 172.21.15.90:0/1785517559 wait complete. 2024-09-10T23:18:09.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.928+0000 7fd386110640 1 Processor -- start 2024-09-10T23:18:09.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.928+0000 7fd386110640 1 -- start start 2024-09-10T23:18:09.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.929+0000 7fd386110640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3800b31a0 0x7fd38015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.929+0000 7fd386110640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3800d06f0 0x7fd3800b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.929+0000 7fd386110640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3800d0ad0 0x7fd3800b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.929+0000 7fd386110640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd3800cd950 con 0x7fd3800b31a0 2024-09-10T23:18:09.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.929+0000 7fd386110640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd3800cd7d0 con 0x7fd3800d06f0 2024-09-10T23:18:09.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.929+0000 7fd386110640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd3800b1820 con 0x7fd3800d0ad0 2024-09-10T23:18:09.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.929+0000 7fd37f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3800b31a0 0x7fd38015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.929+0000 7fd37f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3800b31a0 0x7fd38015abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54902/0 (socket says 172.21.15.90:54902) 2024-09-10T23:18:09.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.929+0000 7fd37f7fe640 1 -- 172.21.15.90:0/4073843125 learned_addr learned my addr 172.21.15.90:0/4073843125 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:09.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.929+0000 7fd37effd640 1 --2- 172.21.15.90:0/4073843125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3800d06f0 0x7fd3800b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.929+0000 7fd37ffff640 1 --2- 172.21.15.90:0/4073843125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3800d0ad0 0x7fd3800b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.930+0000 7fd37f7fe640 1 -- 172.21.15.90:0/4073843125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3800d0ad0 msgr2=0x7fd3800b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.930+0000 7fd37f7fe640 1 --2- 172.21.15.90:0/4073843125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3800d0ad0 0x7fd3800b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.930+0000 7fd37f7fe640 1 -- 172.21.15.90:0/4073843125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3800d06f0 msgr2=0x7fd3800b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.930+0000 7fd37f7fe640 1 --2- 172.21.15.90:0/4073843125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3800d06f0 0x7fd3800b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.930+0000 7fd37f7fe640 1 -- 172.21.15.90:0/4073843125 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3801f8730 con 0x7fd3800b31a0 2024-09-10T23:18:09.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.930+0000 7fd37f7fe640 1 --2- 172.21.15.90:0/4073843125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3800b31a0 0x7fd38015abe0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fd37000cd10 tx=0x7fd37000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.930+0000 7fd367fff640 1 -- 172.21.15.90:0/4073843125 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370004b20 con 0x7fd3800b31a0 2024-09-10T23:18:09.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.930+0000 7fd367fff640 1 -- 172.21.15.90:0/4073843125 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd370004dd0 con 0x7fd3800b31a0 2024-09-10T23:18:09.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.930+0000 7fd386110640 1 -- 172.21.15.90:0/4073843125 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3801f8a10 con 0x7fd3800b31a0 2024-09-10T23:18:09.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.930+0000 7fd367fff640 1 -- 172.21.15.90:0/4073843125 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370005280 con 0x7fd3800b31a0 2024-09-10T23:18:09.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.930+0000 7fd386110640 1 -- 172.21.15.90:0/4073843125 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3801f8fd0 con 0x7fd3800b31a0 2024-09-10T23:18:09.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.931+0000 7fd386110640 1 -- 172.21.15.90:0/4073843125 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3800cfde0 con 0x7fd3800b31a0 2024-09-10T23:18:09.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.932+0000 7fd367fff640 1 -- 172.21.15.90:0/4073843125 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd370005420 con 0x7fd3800b31a0 2024-09-10T23:18:09.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.932+0000 7fd367fff640 1 --2- 172.21.15.90:0/4073843125 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd36c077f70 0x7fd36c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.932+0000 7fd367fff640 1 -- 172.21.15.90:0/4073843125 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5795+0+0 (secure 0 0 0) 0x7fd37009a560 con 0x7fd3800b31a0 2024-09-10T23:18:09.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.932+0000 7fd37effd640 1 --2- 172.21.15.90:0/4073843125 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd36c077f70 0x7fd36c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.933+0000 7fd37effd640 1 --2- 172.21.15.90:0/4073843125 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd36c077f70 0x7fd36c07a430 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd3801f8320 tx=0x7fd374009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:09.936+0000 7fd367fff640 1 -- 172.21.15.90:0/4073843125 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd370014030 con 0x7fd3800b31a0 2024-09-10T23:18:10.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.111+0000 7fd386110640 1 -- 172.21.15.90:0/4073843125 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd380072670 con 0x7fd3800b31a0 2024-09-10T23:18:10.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.773+0000 7fd367fff640 1 -- 172.21.15.90:0/4073843125 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) ==== 181+0+0 (secure 0 0 0) 0x7fd370062a40 con 0x7fd3800b31a0 2024-09-10T23:18:10.774 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:18:10.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.776+0000 7fd386110640 1 -- 172.21.15.90:0/4073843125 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd36c077f70 msgr2=0x7fd36c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:10.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.776+0000 7fd386110640 1 --2- 172.21.15.90:0/4073843125 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd36c077f70 0x7fd36c07a430 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd3801f8320 tx=0x7fd374009040 comp rx=0 tx=0).stop 2024-09-10T23:18:10.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.776+0000 7fd386110640 1 -- 172.21.15.90:0/4073843125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3800b31a0 msgr2=0x7fd38015abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:10.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.776+0000 7fd386110640 1 --2- 172.21.15.90:0/4073843125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3800b31a0 0x7fd38015abe0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fd37000cd10 tx=0x7fd37000a620 comp rx=0 tx=0).stop 2024-09-10T23:18:10.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.777+0000 7fd386110640 1 -- 172.21.15.90:0/4073843125 shutdown_connections 2024-09-10T23:18:10.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.777+0000 7fd386110640 1 --2- 172.21.15.90:0/4073843125 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd36c077f70 0x7fd36c07a430 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:10.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.777+0000 7fd386110640 1 --2- 172.21.15.90:0/4073843125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3800d06f0 0x7fd3800b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:10.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.777+0000 7fd386110640 1 --2- 172.21.15.90:0/4073843125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3800d0ad0 0x7fd3800b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:10.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.777+0000 7fd386110640 1 --2- 172.21.15.90:0/4073843125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3800b31a0 0x7fd38015abe0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:10.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.777+0000 7fd386110640 1 -- 172.21.15.90:0/4073843125 >> 172.21.15.90:0/4073843125 conn(0x7fd3800d1ec0 msgr2=0x7fd3800af760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:10.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.777+0000 7fd386110640 1 -- 172.21.15.90:0/4073843125 shutdown_connections 2024-09-10T23:18:10.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.777+0000 7fd386110640 1 -- 172.21.15.90:0/4073843125 wait complete. 2024-09-10T23:18:10.791 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:18:10.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.896+0000 7f0674afe640 1 -- 172.21.15.90:0/1524571348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06700b3380 msgr2=0x7f06700ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:10.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.896+0000 7f0674afe640 1 --2- 172.21.15.90:0/1524571348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06700b3380 0x7f06700ad800 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f0658009830 tx=0x7f065802a510 comp rx=0 tx=0).stop 2024-09-10T23:18:10.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.897+0000 7f0674afe640 1 -- 172.21.15.90:0/1524571348 shutdown_connections 2024-09-10T23:18:10.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.897+0000 7f0674afe640 1 --2- 172.21.15.90:0/1524571348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06700b3380 0x7f06700ad800 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:10.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.897+0000 7f0674afe640 1 --2- 172.21.15.90:0/1524571348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f067015aef0 0x7f06700b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:10.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.897+0000 7f0674afe640 1 -- 172.21.15.90:0/1524571348 >> 172.21.15.90:0/1524571348 conn(0x7f06700b1aa0 msgr2=0x7f06700b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:10.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.897+0000 7f0674afe640 1 -- 172.21.15.90:0/1524571348 shutdown_connections 2024-09-10T23:18:10.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.897+0000 7f0674afe640 1 -- 172.21.15.90:0/1524571348 wait complete. 2024-09-10T23:18:10.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.898+0000 7f0674afe640 1 Processor -- start 2024-09-10T23:18:10.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.898+0000 7f0674afe640 1 -- start start 2024-09-10T23:18:10.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0674afe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06700b3380 0x7f06700ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:10.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0674afe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f067015aef0 0x7f067015e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:10.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0674afe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f067015e9b0 0x7f0670159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:10.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0674afe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0670073870 con 0x7f067015aef0 2024-09-10T23:18:10.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0674afe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f06700736f0 con 0x7f067015e9b0 2024-09-10T23:18:10.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0674afe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f06700739f0 con 0x7f06700b3380 2024-09-10T23:18:10.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0667fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f067015aef0 0x7f067015e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:10.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0667fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f067015aef0 0x7f067015e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54914/0 (socket says 172.21.15.90:54914) 2024-09-10T23:18:10.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0667fff640 1 -- 172.21.15.90:0/2273761928 learned_addr learned my addr 172.21.15.90:0/2273761928 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:10.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0667fff640 1 -- 172.21.15.90:0/2273761928 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06700b3380 msgr2=0x7f06700ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:10.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0667fff640 1 --2- 172.21.15.90:0/2273761928 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06700b3380 0x7f06700ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:10.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0667fff640 1 -- 172.21.15.90:0/2273761928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f067015e9b0 msgr2=0x7f0670159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:10.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0667fff640 1 --2- 172.21.15.90:0/2273761928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f067015e9b0 0x7f0670159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:10.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0667fff640 1 -- 172.21.15.90:0/2273761928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06700cdc80 con 0x7f067015aef0 2024-09-10T23:18:10.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0667fff640 1 --2- 172.21.15.90:0/2273761928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f067015aef0 0x7f067015e120 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f065802ab00 tx=0x7f0658032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:10.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0666ffd640 1 -- 172.21.15.90:0/2273761928 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0658040070 con 0x7f067015aef0 2024-09-10T23:18:10.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0666ffd640 1 -- 172.21.15.90:0/2273761928 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0658005310 con 0x7f067015aef0 2024-09-10T23:18:10.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0674afe640 1 -- 172.21.15.90:0/2273761928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06700cdf60 con 0x7f067015aef0 2024-09-10T23:18:10.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0666ffd640 1 -- 172.21.15.90:0/2273761928 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0658003800 con 0x7f067015aef0 2024-09-10T23:18:10.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.899+0000 7f0674afe640 1 -- 172.21.15.90:0/2273761928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06700ce520 con 0x7f067015aef0 2024-09-10T23:18:10.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.900+0000 7f0674afe640 1 -- 172.21.15.90:0/2273761928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06700ad100 con 0x7f067015aef0 2024-09-10T23:18:10.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.901+0000 7f0666ffd640 1 -- 172.21.15.90:0/2273761928 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f065804c030 con 0x7f067015aef0 2024-09-10T23:18:10.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.902+0000 7f0666ffd640 1 --2- 172.21.15.90:0/2273761928 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0650077f70 0x7f065007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:10.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.902+0000 7f0666ffd640 1 -- 172.21.15.90:0/2273761928 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5357+0+0 (secure 0 0 0) 0x7f06580bade0 con 0x7f067015aef0 2024-09-10T23:18:10.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.902+0000 7f066e59c640 1 --2- 172.21.15.90:0/2273761928 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0650077f70 0x7f065007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:10.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.902+0000 7f066e59c640 1 --2- 172.21.15.90:0/2273761928 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0650077f70 0x7f065007a430 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0660009710 tx=0x7f0660006c90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:10.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:10.906+0000 7f0666ffd640 1 -- 172.21.15.90:0/2273761928 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f06700ad100 con 0x7f067015aef0 2024-09-10T23:18:11.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.080+0000 7f0674afe640 1 -- 172.21.15.90:0/2273761928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0670073f10 con 0x7f067015aef0 2024-09-10T23:18:11.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.781+0000 7f0666ffd640 1 -- 172.21.15.90:0/2273761928 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) ==== 169+0+0 (secure 0 0 0) 0x7f0658083a40 con 0x7f067015aef0 2024-09-10T23:18:11.782 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' removed 2024-09-10T23:18:11.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.784+0000 7f0674afe640 1 -- 172.21.15.90:0/2273761928 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0650077f70 msgr2=0x7f065007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:11.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.784+0000 7f0674afe640 1 --2- 172.21.15.90:0/2273761928 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0650077f70 0x7f065007a430 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0660009710 tx=0x7f0660006c90 comp rx=0 tx=0).stop 2024-09-10T23:18:11.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.784+0000 7f0674afe640 1 -- 172.21.15.90:0/2273761928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f067015aef0 msgr2=0x7f067015e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:11.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.784+0000 7f0674afe640 1 --2- 172.21.15.90:0/2273761928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f067015aef0 0x7f067015e120 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f065802ab00 tx=0x7f0658032cd0 comp rx=0 tx=0).stop 2024-09-10T23:18:11.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.785+0000 7f0674afe640 1 -- 172.21.15.90:0/2273761928 shutdown_connections 2024-09-10T23:18:11.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.785+0000 7f0674afe640 1 --2- 172.21.15.90:0/2273761928 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0650077f70 0x7f065007a430 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:11.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.785+0000 7f0674afe640 1 --2- 172.21.15.90:0/2273761928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f067015e9b0 0x7f0670159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:11.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.785+0000 7f0674afe640 1 --2- 172.21.15.90:0/2273761928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f067015aef0 0x7f067015e120 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:11.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.785+0000 7f0674afe640 1 --2- 172.21.15.90:0/2273761928 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06700b3380 0x7f06700ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:11.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.785+0000 7f0674afe640 1 -- 172.21.15.90:0/2273761928 >> 172.21.15.90:0/2273761928 conn(0x7f06700b1aa0 msgr2=0x7f06700ae0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:11.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.785+0000 7f0674afe640 1 -- 172.21.15.90:0/2273761928 shutdown_connections 2024-09-10T23:18:11.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.785+0000 7f0674afe640 1 -- 172.21.15.90:0/2273761928 wait complete. 2024-09-10T23:18:11.799 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:18:11.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.902+0000 7f30ae2c6640 1 -- 172.21.15.90:0/2098911966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30a80ceca0 msgr2=0x7f30a80cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:11.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.902+0000 7f30ae2c6640 1 --2- 172.21.15.90:0/2098911966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30a80ceca0 0x7f30a80cf0b0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f30a80af0c0 tx=0x7f30a002a820 comp rx=0 tx=0).stop 2024-09-10T23:18:11.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.902+0000 7f30ae2c6640 1 -- 172.21.15.90:0/2098911966 shutdown_connections 2024-09-10T23:18:11.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.902+0000 7f30ae2c6640 1 --2- 172.21.15.90:0/2098911966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30a80ceca0 0x7f30a80cf0b0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:11.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.902+0000 7f30ae2c6640 1 --2- 172.21.15.90:0/2098911966 >> v2:172.21.15.171:3300/0 conn(0x7f30a815e970 0x7f30a80b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:11.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.902+0000 7f30ae2c6640 1 -- 172.21.15.90:0/2098911966 >> 172.21.15.90:0/2098911966 conn(0x7f30a80b19c0 msgr2=0x7f30a80b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:11.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.902+0000 7f30ae2c6640 1 -- 172.21.15.90:0/2098911966 shutdown_connections 2024-09-10T23:18:11.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.902+0000 7f30ae2c6640 1 -- 172.21.15.90:0/2098911966 wait complete. 2024-09-10T23:18:11.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.904+0000 7f30ae2c6640 1 Processor -- start 2024-09-10T23:18:11.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.904+0000 7f30ae2c6640 1 -- start start 2024-09-10T23:18:11.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.904+0000 7f30ae2c6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a80b3310 0x7f30a81f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:11.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.904+0000 7f30ae2c6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30a80ceca0 0x7f30a81533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:11.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30ae2c6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30a80af760 0x7f30a814c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:11.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30ae2c6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30a815bb40 con 0x7f30a80ceca0 2024-09-10T23:18:11.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30ae2c6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f30a815b9c0 con 0x7f30a80b3310 2024-09-10T23:18:11.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30ae2c6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f30a815bcc0 con 0x7f30a80af760 2024-09-10T23:18:11.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30a77fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30a80ceca0 0x7f30a81533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:11.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30a77fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30a80ceca0 0x7f30a81533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54940/0 (socket says 172.21.15.90:54940) 2024-09-10T23:18:11.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30a77fe640 1 -- 172.21.15.90:0/132337958 learned_addr learned my addr 172.21.15.90:0/132337958 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:11.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30a7fff640 1 --2- 172.21.15.90:0/132337958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a80b3310 0x7f30a81f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:11.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30ac863640 1 --2- 172.21.15.90:0/132337958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30a80af760 0x7f30a814c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:11.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30a77fe640 1 -- 172.21.15.90:0/132337958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30a80af760 msgr2=0x7f30a814c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:11.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30a77fe640 1 --2- 172.21.15.90:0/132337958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30a80af760 0x7f30a814c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:11.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30a77fe640 1 -- 172.21.15.90:0/132337958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a80b3310 msgr2=0x7f30a81f4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:11.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30a77fe640 1 --2- 172.21.15.90:0/132337958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a80b3310 0x7f30a81f4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:11.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30a77fe640 1 -- 172.21.15.90:0/132337958 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a81f55d0 con 0x7f30a80ceca0 2024-09-10T23:18:11.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30a7fff640 1 --2- 172.21.15.90:0/132337958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a80b3310 0x7f30a81f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:11.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30ac863640 1 --2- 172.21.15.90:0/132337958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30a80af760 0x7f30a814c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:11.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30a77fe640 1 --2- 172.21.15.90:0/132337958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30a80ceca0 0x7f30a81533c0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f309c00b410 tx=0x7f309c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:11.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30a4ff9640 1 -- 172.21.15.90:0/132337958 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c015020 con 0x7f30a80ceca0 2024-09-10T23:18:11.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30a4ff9640 1 -- 172.21.15.90:0/132337958 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f309c011940 con 0x7f30a80ceca0 2024-09-10T23:18:11.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30a4ff9640 1 -- 172.21.15.90:0/132337958 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c011d90 con 0x7f30a80ceca0 2024-09-10T23:18:11.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30ae2c6640 1 -- 172.21.15.90:0/132337958 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a81f5b90 con 0x7f30a80ceca0 2024-09-10T23:18:11.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.905+0000 7f30ae2c6640 1 -- 172.21.15.90:0/132337958 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a809aa50 con 0x7f30a80ceca0 2024-09-10T23:18:11.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.906+0000 7f30ae2c6640 1 -- 172.21.15.90:0/132337958 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a81539c0 con 0x7f30a80ceca0 2024-09-10T23:18:11.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.907+0000 7f30a4ff9640 1 -- 172.21.15.90:0/132337958 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f309c01a400 con 0x7f30a80ceca0 2024-09-10T23:18:11.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.907+0000 7f30a4ff9640 1 --2- 172.21.15.90:0/132337958 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3094077f70 0x7f309407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:11.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.908+0000 7f30a4ff9640 1 -- 172.21.15.90:0/132337958 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4943+0+0 (secure 0 0 0) 0x7f309c099c40 con 0x7f30a80ceca0 2024-09-10T23:18:11.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.908+0000 7f30a7fff640 1 --2- 172.21.15.90:0/132337958 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3094077f70 0x7f309407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:11.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.908+0000 7f30a7fff640 1 --2- 172.21.15.90:0/132337958 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3094077f70 0x7f309407a430 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3098000f60 tx=0x7f3098009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:11.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:11.912+0000 7f30a4ff9640 1 -- 172.21.15.90:0/132337958 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f309c01f020 con 0x7f30a80ceca0 2024-09-10T23:18:12.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.087+0000 7f30ae2c6640 1 -- 172.21.15.90:0/132337958 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f30a815c220 con 0x7f30a80ceca0 2024-09-10T23:18:12.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.090+0000 7f30a4ff9640 1 -- 172.21.15.90:0/132337958 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v42) ==== 71+0+0 (secure 0 0 0) 0x7f309c062ad0 con 0x7f30a80ceca0 2024-09-10T23:18:12.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.092+0000 7f30ae2c6640 1 -- 172.21.15.90:0/132337958 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3094077f70 msgr2=0x7f309407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:12.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.092+0000 7f30ae2c6640 1 --2- 172.21.15.90:0/132337958 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3094077f70 0x7f309407a430 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3098000f60 tx=0x7f3098009040 comp rx=0 tx=0).stop 2024-09-10T23:18:12.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.092+0000 7f30ae2c6640 1 -- 172.21.15.90:0/132337958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30a80ceca0 msgr2=0x7f30a81533c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:12.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.092+0000 7f30ae2c6640 1 --2- 172.21.15.90:0/132337958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30a80ceca0 0x7f30a81533c0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f309c00b410 tx=0x7f309c00b8d0 comp rx=0 tx=0).stop 2024-09-10T23:18:12.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.092+0000 7f30ae2c6640 1 -- 172.21.15.90:0/132337958 shutdown_connections 2024-09-10T23:18:12.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.092+0000 7f30ae2c6640 1 --2- 172.21.15.90:0/132337958 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3094077f70 0x7f309407a430 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:12.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.092+0000 7f30ae2c6640 1 --2- 172.21.15.90:0/132337958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30a80af760 0x7f30a814c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:12.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.092+0000 7f30ae2c6640 1 --2- 172.21.15.90:0/132337958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30a80ceca0 0x7f30a81533c0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:12.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.092+0000 7f30ae2c6640 1 --2- 172.21.15.90:0/132337958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a80b3310 0x7f30a81f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:12.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.092+0000 7f30ae2c6640 1 -- 172.21.15.90:0/132337958 >> 172.21.15.90:0/132337958 conn(0x7f30a80b19c0 msgr2=0x7f30a80cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:12.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.092+0000 7f30ae2c6640 1 -- 172.21.15.90:0/132337958 shutdown_connections 2024-09-10T23:18:12.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.092+0000 7f30ae2c6640 1 -- 172.21.15.90:0/132337958 wait complete. 2024-09-10T23:18:12.104 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop' 2024-09-10T23:18:12.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.204+0000 7f6dea9e8640 1 -- 172.21.15.90:0/186217486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de415e970 msgr2=0x7f6de40727c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:12.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.204+0000 7f6dea9e8640 1 --2- 172.21.15.90:0/186217486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de415e970 0x7f6de40727c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8005fd0 tx=0x7f6dd802a540 comp rx=0 tx=0).stop 2024-09-10T23:18:12.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.204+0000 7f6dea9e8640 1 -- 172.21.15.90:0/186217486 shutdown_connections 2024-09-10T23:18:12.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.204+0000 7f6dea9e8640 1 --2- 172.21.15.90:0/186217486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de415e970 0x7f6de40727c0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:12.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.204+0000 7f6dea9e8640 1 --2- 172.21.15.90:0/186217486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6de40b3310 0x7f6de40b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:12.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.204+0000 7f6dea9e8640 1 -- 172.21.15.90:0/186217486 >> 172.21.15.90:0/186217486 conn(0x7f6de40b19c0 msgr2=0x7f6de40b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:12.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.204+0000 7f6dea9e8640 1 -- 172.21.15.90:0/186217486 shutdown_connections 2024-09-10T23:18:12.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.204+0000 7f6dea9e8640 1 -- 172.21.15.90:0/186217486 wait complete. 2024-09-10T23:18:12.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.205+0000 7f6dea9e8640 1 Processor -- start 2024-09-10T23:18:12.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.205+0000 7f6dea9e8640 1 -- start start 2024-09-10T23:18:12.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.206+0000 7f6dea9e8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6de40b3310 0x7f6de406fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:12.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.206+0000 7f6dea9e8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de40ceca0 0x7f6de40cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:12.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.206+0000 7f6dea9e8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6de4149520 0x7f6de41431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:12.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.206+0000 7f6dea9e8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6de415c250 con 0x7f6de40ceca0 2024-09-10T23:18:12.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.206+0000 7f6dea9e8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6de415c0d0 con 0x7f6de4149520 2024-09-10T23:18:12.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.206+0000 7f6dea9e8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6de40af760 con 0x7f6de40b3310 2024-09-10T23:18:12.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.206+0000 7f6de37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de40ceca0 0x7f6de40cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:12.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.206+0000 7f6de37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de40ceca0 0x7f6de40cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54958/0 (socket says 172.21.15.90:54958) 2024-09-10T23:18:12.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.206+0000 7f6de37fe640 1 -- 172.21.15.90:0/1614421885 learned_addr learned my addr 172.21.15.90:0/1614421885 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:12.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.206+0000 7f6de8f85640 1 --2- 172.21.15.90:0/1614421885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6de4149520 0x7f6de41431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:12.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.206+0000 7f6de3fff640 1 --2- 172.21.15.90:0/1614421885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6de40b3310 0x7f6de406fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:12.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.207+0000 7f6de37fe640 1 -- 172.21.15.90:0/1614421885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6de40b3310 msgr2=0x7f6de406fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:12.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.207+0000 7f6de37fe640 1 --2- 172.21.15.90:0/1614421885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6de40b3310 0x7f6de406fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:12.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.207+0000 7f6de37fe640 1 -- 172.21.15.90:0/1614421885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6de4149520 msgr2=0x7f6de41431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:12.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.207+0000 7f6de37fe640 1 --2- 172.21.15.90:0/1614421885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6de4149520 0x7f6de41431d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:12.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.207+0000 7f6de37fe640 1 -- 172.21.15.90:0/1614421885 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de4070530 con 0x7f6de40ceca0 2024-09-10T23:18:12.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.207+0000 7f6de37fe640 1 --2- 172.21.15.90:0/1614421885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de40ceca0 0x7f6de40cc6e0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8034040 tx=0x7f6dd8003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:12.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.207+0000 7f6de0ff9640 1 -- 172.21.15.90:0/1614421885 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd803e030 con 0x7f6de40ceca0 2024-09-10T23:18:12.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.207+0000 7f6de0ff9640 1 -- 172.21.15.90:0/1614421885 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dd8003e00 con 0x7f6de40ceca0 2024-09-10T23:18:12.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.207+0000 7f6de0ff9640 1 -- 172.21.15.90:0/1614421885 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8035040 con 0x7f6de40ceca0 2024-09-10T23:18:12.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.207+0000 7f6dea9e8640 1 -- 172.21.15.90:0/1614421885 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de406e770 con 0x7f6de40ceca0 2024-09-10T23:18:12.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.207+0000 7f6dea9e8640 1 -- 172.21.15.90:0/1614421885 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de406ed30 con 0x7f6de40ceca0 2024-09-10T23:18:12.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.208+0000 7f6dea9e8640 1 -- 172.21.15.90:0/1614421885 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de40cf390 con 0x7f6de40ceca0 2024-09-10T23:18:12.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.209+0000 7f6de0ff9640 1 -- 172.21.15.90:0/1614421885 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6dd8004a00 con 0x7f6de40ceca0 2024-09-10T23:18:12.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.209+0000 7f6de0ff9640 1 --2- 172.21.15.90:0/1614421885 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6dd0077f70 0x7f6dd007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:12.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.209+0000 7f6de0ff9640 1 -- 172.21.15.90:0/1614421885 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4943+0+0 (secure 0 0 0) 0x7f6dd80ba3d0 con 0x7f6de40ceca0 2024-09-10T23:18:12.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.209+0000 7f6de3fff640 1 --2- 172.21.15.90:0/1614421885 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6dd0077f70 0x7f6dd007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:12.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.210+0000 7f6de3fff640 1 --2- 172.21.15.90:0/1614421885 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6dd0077f70 0x7f6dd007a430 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4005fd0 tx=0x7f6dd400b390 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:12.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.213+0000 7f6de0ff9640 1 -- 172.21.15.90:0/1614421885 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6dd8082b80 con 0x7f6de40ceca0 2024-09-10T23:18:12.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.464+0000 7f6dea9e8640 1 -- 172.21.15.90:0/1614421885 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]} v 0) -- 0x7f6de40b4f50 con 0x7f6de40ceca0 2024-09-10T23:18:12.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.783+0000 7f6de0ff9640 1 -- 172.21.15.90:0/1614421885 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]}]=0 v216) ==== 145+0+0 (secure 0 0 0) 0x7f6dd80875b0 con 0x7f6de40ceca0 2024-09-10T23:18:12.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.785+0000 7f6dea9e8640 1 -- 172.21.15.90:0/1614421885 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6dd0077f70 msgr2=0x7f6dd007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:12.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.785+0000 7f6dea9e8640 1 --2- 172.21.15.90:0/1614421885 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6dd0077f70 0x7f6dd007a430 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4005fd0 tx=0x7f6dd400b390 comp rx=0 tx=0).stop 2024-09-10T23:18:12.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.785+0000 7f6dea9e8640 1 -- 172.21.15.90:0/1614421885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de40ceca0 msgr2=0x7f6de40cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:12.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.785+0000 7f6dea9e8640 1 --2- 172.21.15.90:0/1614421885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de40ceca0 0x7f6de40cc6e0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8034040 tx=0x7f6dd8003910 comp rx=0 tx=0).stop 2024-09-10T23:18:12.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.785+0000 7f6dea9e8640 1 -- 172.21.15.90:0/1614421885 shutdown_connections 2024-09-10T23:18:12.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.785+0000 7f6dea9e8640 1 --2- 172.21.15.90:0/1614421885 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6dd0077f70 0x7f6dd007a430 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:12.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.785+0000 7f6dea9e8640 1 --2- 172.21.15.90:0/1614421885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6de4149520 0x7f6de41431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:12.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.785+0000 7f6dea9e8640 1 --2- 172.21.15.90:0/1614421885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de40ceca0 0x7f6de40cc6e0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:12.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.785+0000 7f6dea9e8640 1 --2- 172.21.15.90:0/1614421885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6de40b3310 0x7f6de406fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:12.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.785+0000 7f6dea9e8640 1 -- 172.21.15.90:0/1614421885 >> 172.21.15.90:0/1614421885 conn(0x7f6de40b19c0 msgr2=0x7f6de4073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:12.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.785+0000 7f6dea9e8640 1 -- 172.21.15.90:0/1614421885 shutdown_connections 2024-09-10T23:18:12.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.785+0000 7f6dea9e8640 1 -- 172.21.15.90:0/1614421885 wait complete. 2024-09-10T23:18:12.798 INFO:tasks.cephfs_test_runner:That when a `tell` command is sent using the python CLI, ... ok 2024-09-10T23:18:12.798 INFO:tasks.cephfs_test_runner:Starting test: test_version_splitting (tasks.cephfs.test_sessionmap.TestSessionMap) That when many sessions are updated, they are correctly 2024-09-10T23:18:12.798 INFO:tasks.cephfs_test_runner:test_version_splitting (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-10T23:18:12.798 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:18:12.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.899+0000 7f8450823640 1 -- 172.21.15.90:0/629960188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f844c0d16f0 msgr2=0x7f844c0d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:12.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.899+0000 7f8450823640 1 --2- 172.21.15.90:0/629960188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f844c0d16f0 0x7f844c0d2e00 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f8444009830 tx=0x7f844402a480 comp rx=0 tx=0).stop 2024-09-10T23:18:12.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.899+0000 7f8450823640 1 -- 172.21.15.90:0/629960188 shutdown_connections 2024-09-10T23:18:12.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.899+0000 7f8450823640 1 --2- 172.21.15.90:0/629960188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f844c0d16f0 0x7f844c0d2e00 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:12.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.899+0000 7f8450823640 1 --2- 172.21.15.90:0/629960188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f844c0d1190 0x7f844c0d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:12.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.899+0000 7f8450823640 1 -- 172.21.15.90:0/629960188 >> 172.21.15.90:0/629960188 conn(0x7f844c0d4090 msgr2=0x7f844c0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:12.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.899+0000 7f8450823640 1 -- 172.21.15.90:0/629960188 shutdown_connections 2024-09-10T23:18:12.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.899+0000 7f8450823640 1 -- 172.21.15.90:0/629960188 wait complete. 2024-09-10T23:18:12.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.901+0000 7f8450823640 1 Processor -- start 2024-09-10T23:18:12.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.901+0000 7f8450823640 1 -- start start 2024-09-10T23:18:12.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f8450823640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f844c0d1190 0x7f844c15f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:12.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f8450823640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f844c0d16f0 0x7f844c1522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:12.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f8450823640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f844c15e310 0x7f844c1527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:12.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f8450823640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f844c0d3340 con 0x7f844c0d1190 2024-09-10T23:18:12.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f8450823640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f844c0d4d90 con 0x7f844c0d16f0 2024-09-10T23:18:12.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f8450823640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f844c0d34c0 con 0x7f844c15e310 2024-09-10T23:18:12.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f844a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f844c0d1190 0x7f844c15f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:12.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f844a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f844c0d1190 0x7f844c15f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54974/0 (socket says 172.21.15.90:54974) 2024-09-10T23:18:12.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f844a59c640 1 -- 172.21.15.90:0/386485094 learned_addr learned my addr 172.21.15.90:0/386485094 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:12.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f8449d9b640 1 --2- 172.21.15.90:0/386485094 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f844c0d16f0 0x7f844c1522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:12.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f844ad9d640 1 --2- 172.21.15.90:0/386485094 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f844c15e310 0x7f844c1527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:12.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f844a59c640 1 -- 172.21.15.90:0/386485094 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f844c15e310 msgr2=0x7f844c1527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:12.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f844a59c640 1 --2- 172.21.15.90:0/386485094 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f844c15e310 0x7f844c1527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:12.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f844a59c640 1 -- 172.21.15.90:0/386485094 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f844c0d16f0 msgr2=0x7f844c1522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:12.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f844a59c640 1 --2- 172.21.15.90:0/386485094 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f844c0d16f0 0x7f844c1522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:12.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f844a59c640 1 -- 172.21.15.90:0/386485094 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844c15f940 con 0x7f844c0d1190 2024-09-10T23:18:12.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f8449d9b640 1 --2- 172.21.15.90:0/386485094 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f844c0d16f0 0x7f844c1522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:12.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f844ad9d640 1 --2- 172.21.15.90:0/386485094 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f844c15e310 0x7f844c1527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:12.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f844a59c640 1 --2- 172.21.15.90:0/386485094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f844c0d1190 0x7f844c15f2b0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f843c00c7a0 tx=0x7f843c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:12.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f843affd640 1 -- 172.21.15.90:0/386485094 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c017070 con 0x7f844c0d1190 2024-09-10T23:18:12.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f843affd640 1 -- 172.21.15.90:0/386485094 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f843c005070 con 0x7f844c0d1190 2024-09-10T23:18:12.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f8450823640 1 -- 172.21.15.90:0/386485094 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f844c15fc20 con 0x7f844c0d1190 2024-09-10T23:18:12.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f843affd640 1 -- 172.21.15.90:0/386485094 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c0054a0 con 0x7f844c0d1190 2024-09-10T23:18:12.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.902+0000 7f8450823640 1 -- 172.21.15.90:0/386485094 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f844c1601e0 con 0x7f844c0d1190 2024-09-10T23:18:12.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.903+0000 7f8450823640 1 -- 172.21.15.90:0/386485094 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f844c0d39a0 con 0x7f844c0d1190 2024-09-10T23:18:12.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.904+0000 7f843affd640 1 -- 172.21.15.90:0/386485094 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f843c005640 con 0x7f844c0d1190 2024-09-10T23:18:12.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.904+0000 7f843affd640 1 --2- 172.21.15.90:0/386485094 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f842c077f70 0x7f842c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:12.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.905+0000 7f843affd640 1 -- 172.21.15.90:0/386485094 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4943+0+0 (secure 0 0 0) 0x7f843c099360 con 0x7f844c0d1190 2024-09-10T23:18:12.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.905+0000 7f8449d9b640 1 --2- 172.21.15.90:0/386485094 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f842c077f70 0x7f842c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:12.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.905+0000 7f8449d9b640 1 --2- 172.21.15.90:0/386485094 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f842c077f70 0x7f842c07a430 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f844c0d3180 tx=0x7f844000a5c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:12.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:12.909+0000 7f843affd640 1 -- 172.21.15.90:0/386485094 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f843c0621f0 con 0x7f844c0d1190 2024-09-10T23:18:13.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.083+0000 7f8450823640 1 -- 172.21.15.90:0/386485094 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f844c0d4710 con 0x7f844c0d1190 2024-09-10T23:18:13.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.084+0000 7f843affd640 1 -- 172.21.15.90:0/386485094 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+13033 (secure 0 0 0) 0x7f843c061af0 con 0x7f844c0d1190 2024-09-10T23:18:13.085 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:13.085 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":95,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:18:11.774567+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6835/3653031756":"2024-09-11T23:18:08.759895+0000","172.21.15.90:6833/3653031756":"2024-09-11T23:18:08.759895+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:18:13.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.086+0000 7f8450823640 1 -- 172.21.15.90:0/386485094 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f842c077f70 msgr2=0x7f842c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:13.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.086+0000 7f8450823640 1 --2- 172.21.15.90:0/386485094 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f842c077f70 0x7f842c07a430 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f844c0d3180 tx=0x7f844000a5c0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.086+0000 7f8450823640 1 -- 172.21.15.90:0/386485094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f844c0d1190 msgr2=0x7f844c15f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:13.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.086+0000 7f8450823640 1 --2- 172.21.15.90:0/386485094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f844c0d1190 0x7f844c15f2b0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f843c00c7a0 tx=0x7f843c00cc60 comp rx=0 tx=0).stop 2024-09-10T23:18:13.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.086+0000 7f8450823640 1 -- 172.21.15.90:0/386485094 shutdown_connections 2024-09-10T23:18:13.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.086+0000 7f8450823640 1 --2- 172.21.15.90:0/386485094 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f842c077f70 0x7f842c07a430 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.086+0000 7f8450823640 1 --2- 172.21.15.90:0/386485094 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f844c0d16f0 0x7f844c1522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.086+0000 7f8450823640 1 --2- 172.21.15.90:0/386485094 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f844c15e310 0x7f844c1527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.086+0000 7f8450823640 1 --2- 172.21.15.90:0/386485094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f844c0d1190 0x7f844c15f2b0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.086+0000 7f8450823640 1 -- 172.21.15.90:0/386485094 >> 172.21.15.90:0/386485094 conn(0x7f844c0d4090 msgr2=0x7f844c0b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:13.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.086+0000 7f8450823640 1 -- 172.21.15.90:0/386485094 shutdown_connections 2024-09-10T23:18:13.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.086+0000 7f8450823640 1 -- 172.21.15.90:0/386485094 wait complete. 2024-09-10T23:18:13.099 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:14:26.449950+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:18:13.099 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:18:13.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.203+0000 7f953ad10640 1 -- 172.21.15.90:0/2756271606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9524004000 msgr2=0x7f9524004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:13.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.203+0000 7f953ad10640 1 --2- 172.21.15.90:0/2756271606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9524004000 0x7f9524004800 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f9520001690 tx=0x7f9524005830 comp rx=0 tx=0).stop 2024-09-10T23:18:13.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.203+0000 7f95392ad640 1 -- 172.21.15.90:0/2756271606 reap_dead start 2024-09-10T23:18:13.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.203+0000 7f953ad10640 1 -- 172.21.15.90:0/2756271606 shutdown_connections 2024-09-10T23:18:13.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.203+0000 7f953ad10640 1 -- 172.21.15.90:0/2756271606 >> 172.21.15.90:0/2756271606 conn(0x7f95340b19c0 msgr2=0x7f95340b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:13.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.203+0000 7f953ad10640 1 -- 172.21.15.90:0/2756271606 shutdown_connections 2024-09-10T23:18:13.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.203+0000 7f953ad10640 1 -- 172.21.15.90:0/2756271606 wait complete. 2024-09-10T23:18:13.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.204+0000 7f953ad10640 1 Processor -- start 2024-09-10T23:18:13.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.204+0000 7f953ad10640 1 -- start start 2024-09-10T23:18:13.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.205+0000 7f953ad10640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9524004000 0x7f953409d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:13.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.205+0000 7f953ad10640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95341f3790 0x7f953409bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:13.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.205+0000 7f953ad10640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9534155460 0x7f95341558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:13.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.205+0000 7f953ad10640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9534073f60 con 0x7f95341f3790 2024-09-10T23:18:13.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.205+0000 7f953ad10640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9534073de0 con 0x7f9534155460 2024-09-10T23:18:13.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.205+0000 7f953ad10640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f95340740e0 con 0x7f9524004000 2024-09-10T23:18:13.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.205+0000 7f9533fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95341f3790 0x7f953409bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:13.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.205+0000 7f9533fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95341f3790 0x7f953409bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55002/0 (socket says 172.21.15.90:55002) 2024-09-10T23:18:13.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.205+0000 7f9533fff640 1 -- 172.21.15.90:0/757199426 learned_addr learned my addr 172.21.15.90:0/757199426 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:13.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.205+0000 7f9538aac640 1 --2- 172.21.15.90:0/757199426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9524004000 0x7f953409d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:13.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.205+0000 7f95392ad640 1 --2- 172.21.15.90:0/757199426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9534155460 0x7f95341558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:13.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.206+0000 7f9533fff640 1 -- 172.21.15.90:0/757199426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9524004000 msgr2=0x7f953409d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:13.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.206+0000 7f9533fff640 1 --2- 172.21.15.90:0/757199426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9524004000 0x7f953409d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.206+0000 7f9533fff640 1 -- 172.21.15.90:0/757199426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9534155460 msgr2=0x7f95341558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:13.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.206+0000 7f9533fff640 1 --2- 172.21.15.90:0/757199426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9534155460 0x7f95341558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.206+0000 7f9533fff640 1 -- 172.21.15.90:0/757199426 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95341f4070 con 0x7f95341f3790 2024-09-10T23:18:13.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.206+0000 7f95392ad640 1 --2- 172.21.15.90:0/757199426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9534155460 0x7f95341558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:13.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.206+0000 7f9533fff640 1 --2- 172.21.15.90:0/757199426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95341f3790 0x7f953409bab0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f9520000c00 tx=0x7f9520006360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:13.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.206+0000 7f95317fa640 1 -- 172.21.15.90:0/757199426 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520038070 con 0x7f95341f3790 2024-09-10T23:18:13.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.206+0000 7f95317fa640 1 -- 172.21.15.90:0/757199426 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9520003af0 con 0x7f95341f3790 2024-09-10T23:18:13.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.206+0000 7f95317fa640 1 -- 172.21.15.90:0/757199426 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520033420 con 0x7f95341f3790 2024-09-10T23:18:13.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.206+0000 7f953ad10640 1 -- 172.21.15.90:0/757199426 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f953409ac10 con 0x7f95341f3790 2024-09-10T23:18:13.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.206+0000 7f953ad10640 1 -- 172.21.15.90:0/757199426 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95341f45f0 con 0x7f95341f3790 2024-09-10T23:18:13.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.207+0000 7f953ad10640 1 -- 172.21.15.90:0/757199426 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95340cc5b0 con 0x7f95341f3790 2024-09-10T23:18:13.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.208+0000 7f95317fa640 1 -- 172.21.15.90:0/757199426 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f95200335c0 con 0x7f95341f3790 2024-09-10T23:18:13.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.208+0000 7f95317fa640 1 --2- 172.21.15.90:0/757199426 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9518077f70 0x7f951807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:13.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.208+0000 7f95317fa640 1 -- 172.21.15.90:0/757199426 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4943+0+0 (secure 0 0 0) 0x7f95200b91f0 con 0x7f95341f3790 2024-09-10T23:18:13.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.209+0000 7f9538aac640 1 --2- 172.21.15.90:0/757199426 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9518077f70 0x7f951807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:13.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.209+0000 7f9538aac640 1 --2- 172.21.15.90:0/757199426 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9518077f70 0x7f951807a430 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f953409e080 tx=0x7f9528005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:13.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.213+0000 7f95317fa640 1 -- 172.21.15.90:0/757199426 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f95200820b0 con 0x7f95341f3790 2024-09-10T23:18:13.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.387+0000 7f953ad10640 1 -- 172.21.15.90:0/757199426 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f95340af160 con 0x7f95341f3790 2024-09-10T23:18:13.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.388+0000 7f95317fa640 1 -- 172.21.15.90:0/757199426 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7f95200819b0 con 0x7f95341f3790 2024-09-10T23:18:13.389 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-09-10T23:18:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.390+0000 7f953ad10640 1 -- 172.21.15.90:0/757199426 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9518077f70 msgr2=0x7f951807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.390+0000 7f953ad10640 1 --2- 172.21.15.90:0/757199426 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9518077f70 0x7f951807a430 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f953409e080 tx=0x7f9528005f90 comp rx=0 tx=0).stop 2024-09-10T23:18:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.390+0000 7f953ad10640 1 -- 172.21.15.90:0/757199426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95341f3790 msgr2=0x7f953409bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.390+0000 7f953ad10640 1 --2- 172.21.15.90:0/757199426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95341f3790 0x7f953409bab0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f9520000c00 tx=0x7f9520006360 comp rx=0 tx=0).stop 2024-09-10T23:18:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.390+0000 7f953ad10640 1 -- 172.21.15.90:0/757199426 shutdown_connections 2024-09-10T23:18:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.390+0000 7f953ad10640 1 --2- 172.21.15.90:0/757199426 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9518077f70 0x7f951807a430 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.390+0000 7f953ad10640 1 --2- 172.21.15.90:0/757199426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9534155460 0x7f95341558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.390+0000 7f953ad10640 1 --2- 172.21.15.90:0/757199426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95341f3790 0x7f953409bab0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.390+0000 7f953ad10640 1 --2- 172.21.15.90:0/757199426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9524004000 0x7f953409d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.390+0000 7f953ad10640 1 -- 172.21.15.90:0/757199426 >> 172.21.15.90:0/757199426 conn(0x7f95340b19c0 msgr2=0x7f95340b11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.390+0000 7f953ad10640 1 -- 172.21.15.90:0/757199426 shutdown_connections 2024-09-10T23:18:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.390+0000 7f953ad10640 1 -- 172.21.15.90:0/757199426 wait complete. 2024-09-10T23:18:13.402 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting' 2024-09-10T23:18:13.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.502+0000 7f193c794640 1 -- 172.21.15.90:0/3904751752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f193415f1e0 msgr2=0x7f193415b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:13.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.502+0000 7f193c794640 1 --2- 172.21.15.90:0/3904751752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f193415f1e0 0x7f193415b200 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1924005fd0 tx=0x7f192402a8b0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.502+0000 7f193c794640 1 -- 172.21.15.90:0/3904751752 shutdown_connections 2024-09-10T23:18:13.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.502+0000 7f193c794640 1 --2- 172.21.15.90:0/3904751752 >> v2:172.21.15.171:3300/0 conn(0x7f193415b740 0x7f193406ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.502+0000 7f193c794640 1 --2- 172.21.15.90:0/3904751752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f193415f1e0 0x7f193415b200 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.502+0000 7f193c794640 1 -- 172.21.15.90:0/3904751752 >> 172.21.15.90:0/3904751752 conn(0x7f19340697a0 msgr2=0x7f193406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:13.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.502+0000 7f193c794640 1 -- 172.21.15.90:0/3904751752 shutdown_connections 2024-09-10T23:18:13.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.502+0000 7f193c794640 1 -- 172.21.15.90:0/3904751752 wait complete. 2024-09-10T23:18:13.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.504+0000 7f193c794640 1 Processor -- start 2024-09-10T23:18:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.504+0000 7f193c794640 1 -- start start 2024-09-10T23:18:13.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.504+0000 7f193c794640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f193406f1f0 0x7f1934146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:13.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.504+0000 7f193c794640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f193415b740 0x7f19341571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:13.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.504+0000 7f193c794640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f193415f1e0 0x7f19340b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:13.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.504+0000 7f193c794640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1934073640 con 0x7f193415b740 2024-09-10T23:18:13.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.504+0000 7f193c794640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f19340d0090 con 0x7f193415f1e0 2024-09-10T23:18:13.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.504+0000 7f193c794640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f19340737c0 con 0x7f193406f1f0 2024-09-10T23:18:13.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.504+0000 7f1939d2f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f193415b740 0x7f19341571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:13.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.505+0000 7f1939d2f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f193415b740 0x7f19341571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55016/0 (socket says 172.21.15.90:55016) 2024-09-10T23:18:13.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.505+0000 7f1939d2f640 1 -- 172.21.15.90:0/1348261613 learned_addr learned my addr 172.21.15.90:0/1348261613 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:13.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.505+0000 7f193a530640 1 --2- 172.21.15.90:0/1348261613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f193406f1f0 0x7f1934146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:13.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.505+0000 7f193ad31640 1 --2- 172.21.15.90:0/1348261613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f193415f1e0 0x7f19340b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:13.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.505+0000 7f1939d2f640 1 -- 172.21.15.90:0/1348261613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f193406f1f0 msgr2=0x7f1934146d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:13.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.505+0000 7f1939d2f640 1 --2- 172.21.15.90:0/1348261613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f193406f1f0 0x7f1934146d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.505+0000 7f1939d2f640 1 -- 172.21.15.90:0/1348261613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f193415f1e0 msgr2=0x7f19340b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:13.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.505+0000 7f1939d2f640 1 --2- 172.21.15.90:0/1348261613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f193415f1e0 0x7f19340b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.505+0000 7f1939d2f640 1 -- 172.21.15.90:0/1348261613 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19341f5ed0 con 0x7f193415b740 2024-09-10T23:18:13.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.505+0000 7f1939d2f640 1 --2- 172.21.15.90:0/1348261613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f193415b740 0x7f19341571a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f192800e9a0 tx=0x7f192800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:13.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.505+0000 7f1932ffd640 1 -- 172.21.15.90:0/1348261613 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192800cd80 con 0x7f193415b740 2024-09-10T23:18:13.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.505+0000 7f1932ffd640 1 -- 172.21.15.90:0/1348261613 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1928010430 con 0x7f193415b740 2024-09-10T23:18:13.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.505+0000 7f193c794640 1 -- 172.21.15.90:0/1348261613 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1934157910 con 0x7f193415b740 2024-09-10T23:18:13.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.505+0000 7f1932ffd640 1 -- 172.21.15.90:0/1348261613 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1928010880 con 0x7f193415b740 2024-09-10T23:18:13.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.505+0000 7f193c794640 1 -- 172.21.15.90:0/1348261613 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19340b28c0 con 0x7f193415b740 2024-09-10T23:18:13.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.506+0000 7f193c794640 1 -- 172.21.15.90:0/1348261613 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f193406a430 con 0x7f193415b740 2024-09-10T23:18:13.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.507+0000 7f1932ffd640 1 -- 172.21.15.90:0/1348261613 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1928010a20 con 0x7f193415b740 2024-09-10T23:18:13.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.507+0000 7f1932ffd640 1 --2- 172.21.15.90:0/1348261613 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1920077f70 0x7f192007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:13.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.507+0000 7f1932ffd640 1 -- 172.21.15.90:0/1348261613 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4943+0+0 (secure 0 0 0) 0x7f192809a480 con 0x7f193415b740 2024-09-10T23:18:13.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.508+0000 7f193a530640 1 --2- 172.21.15.90:0/1348261613 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1920077f70 0x7f192007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:13.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.508+0000 7f193a530640 1 --2- 172.21.15.90:0/1348261613 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1920077f70 0x7f192007a430 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1924034000 tx=0x7f1924004ab0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:13.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.512+0000 7f1932ffd640 1 -- 172.21.15.90:0/1348261613 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1928062c30 con 0x7f193415b740 2024-09-10T23:18:13.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.752+0000 7f193c794640 1 -- 172.21.15.90:0/1348261613 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]} v 0) -- 0x7f1934159b00 con 0x7f193415b740 2024-09-10T23:18:13.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.784+0000 7f1932ffd640 1 -- 172.21.15.90:0/1348261613 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]}]=0 v217) ==== 148+0+0 (secure 0 0 0) 0x7f1928067660 con 0x7f193415b740 2024-09-10T23:18:13.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.787+0000 7f193c794640 1 -- 172.21.15.90:0/1348261613 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1920077f70 msgr2=0x7f192007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:13.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.787+0000 7f193c794640 1 --2- 172.21.15.90:0/1348261613 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1920077f70 0x7f192007a430 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1924034000 tx=0x7f1924004ab0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.787+0000 7f193c794640 1 -- 172.21.15.90:0/1348261613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f193415b740 msgr2=0x7f19341571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:13.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.787+0000 7f193c794640 1 --2- 172.21.15.90:0/1348261613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f193415b740 0x7f19341571a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f192800e9a0 tx=0x7f192800ee60 comp rx=0 tx=0).stop 2024-09-10T23:18:13.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.787+0000 7f193c794640 1 -- 172.21.15.90:0/1348261613 shutdown_connections 2024-09-10T23:18:13.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.787+0000 7f193c794640 1 --2- 172.21.15.90:0/1348261613 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f1920077f70 0x7f192007a430 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.787+0000 7f193c794640 1 --2- 172.21.15.90:0/1348261613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f193415f1e0 0x7f19340b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.787+0000 7f193c794640 1 --2- 172.21.15.90:0/1348261613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f193415b740 0x7f19341571a0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.787+0000 7f193c794640 1 --2- 172.21.15.90:0/1348261613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f193406f1f0 0x7f1934146d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.787+0000 7f193c794640 1 -- 172.21.15.90:0/1348261613 >> 172.21.15.90:0/1348261613 conn(0x7f19340697a0 msgr2=0x7f1934072f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:13.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.787+0000 7f193c794640 1 -- 172.21.15.90:0/1348261613 shutdown_connections 2024-09-10T23:18:13.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.787+0000 7f193c794640 1 -- 172.21.15.90:0/1348261613 wait complete. 2024-09-10T23:18:13.798 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:18:13.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.899+0000 7f587754b640 1 -- 172.21.15.90:0/703354656 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f585c003a00 msgr2=0x7f585c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:13.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.899+0000 7f587754b640 1 --2- 172.21.15.90:0/703354656 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f585c003a00 0x7f585c003e00 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c290 tx=0x7f585c005830 comp rx=0 tx=0).stop 2024-09-10T23:18:13.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.899+0000 7f587754b640 1 -- 172.21.15.90:0/703354656 shutdown_connections 2024-09-10T23:18:13.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.899+0000 7f587754b640 1 --2- 172.21.15.90:0/703354656 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f585c003a00 0x7f585c003e00 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.899+0000 7f587754b640 1 -- 172.21.15.90:0/703354656 >> 172.21.15.90:0/703354656 conn(0x7f58700d4090 msgr2=0x7f58700d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:13.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.899+0000 7f587754b640 1 -- 172.21.15.90:0/703354656 shutdown_connections 2024-09-10T23:18:13.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.899+0000 7f587754b640 1 -- 172.21.15.90:0/703354656 wait complete. 2024-09-10T23:18:13.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.900+0000 7f587754b640 1 Processor -- start 2024-09-10T23:18:13.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.900+0000 7f587754b640 1 -- start start 2024-09-10T23:18:13.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f587754b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f585c003a00 0x7f58700b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:13.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f587754b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58701f7e50 0x7f58700ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:13.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f587754b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58700ca7a0 0x7f58701f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:13.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f587754b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f58700d0a80 con 0x7f58701f7e50 2024-09-10T23:18:13.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f587754b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f58700d4d90 con 0x7f585c003a00 2024-09-10T23:18:13.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f587754b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f58700d0c00 con 0x7f58700ca7a0 2024-09-10T23:18:13.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f5874ae6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58701f7e50 0x7f58700ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:13.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f5874ae6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58701f7e50 0x7f58700ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55032/0 (socket says 172.21.15.90:55032) 2024-09-10T23:18:13.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f5874ae6640 1 -- 172.21.15.90:0/2302387070 learned_addr learned my addr 172.21.15.90:0/2302387070 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:13.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f58752e7640 1 --2- 172.21.15.90:0/2302387070 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f585c003a00 0x7f58700b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:13.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f5875ae8640 1 --2- 172.21.15.90:0/2302387070 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58700ca7a0 0x7f58701f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:13.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f5874ae6640 1 -- 172.21.15.90:0/2302387070 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58700ca7a0 msgr2=0x7f58701f4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:13.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f5874ae6640 1 --2- 172.21.15.90:0/2302387070 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58700ca7a0 0x7f58701f4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f5874ae6640 1 -- 172.21.15.90:0/2302387070 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f585c003a00 msgr2=0x7f58700b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:13.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f5874ae6640 1 --2- 172.21.15.90:0/2302387070 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f585c003a00 0x7f58700b60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:13.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f5874ae6640 1 -- 172.21.15.90:0/2302387070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58701f5160 con 0x7f58701f7e50 2024-09-10T23:18:13.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f5874ae6640 1 --2- 172.21.15.90:0/2302387070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58701f7e50 0x7f58700ca260 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f586000d600 tx=0x7f586000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:13.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f5865ffb640 1 -- 172.21.15.90:0/2302387070 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860014070 con 0x7f58701f7e50 2024-09-10T23:18:13.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f5865ffb640 1 -- 172.21.15.90:0/2302387070 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f586000f9c0 con 0x7f58701f7e50 2024-09-10T23:18:13.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f587754b640 1 -- 172.21.15.90:0/2302387070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58701f5440 con 0x7f58701f7e50 2024-09-10T23:18:13.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.901+0000 7f5865ffb640 1 -- 172.21.15.90:0/2302387070 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586000fe10 con 0x7f58701f7e50 2024-09-10T23:18:13.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.902+0000 7f587754b640 1 -- 172.21.15.90:0/2302387070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58700b6610 con 0x7f58701f7e50 2024-09-10T23:18:13.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.903+0000 7f587754b640 1 -- 172.21.15.90:0/2302387070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f587006deb0 con 0x7f58701f7e50 2024-09-10T23:18:13.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.903+0000 7f5865ffb640 1 -- 172.21.15.90:0/2302387070 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5860010450 con 0x7f58701f7e50 2024-09-10T23:18:13.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.903+0000 7f5865ffb640 1 --2- 172.21.15.90:0/2302387070 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5854077f70 0x7f585407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:13.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.904+0000 7f5865ffb640 1 -- 172.21.15.90:0/2302387070 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4943+0+0 (secure 0 0 0) 0x7f586009a0f0 con 0x7f58701f7e50 2024-09-10T23:18:13.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.904+0000 7f58752e7640 1 --2- 172.21.15.90:0/2302387070 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5854077f70 0x7f585407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:13.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.904+0000 7f58752e7640 1 --2- 172.21.15.90:0/2302387070 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5854077f70 0x7f585407a430 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f586c033000 tx=0x7f58700ce7a0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:13.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:13.907+0000 7f5865ffb640 1 -- 172.21.15.90:0/2302387070 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5860062ef0 con 0x7f58701f7e50 2024-09-10T23:18:14.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.082+0000 7f587754b640 1 -- 172.21.15.90:0/2302387070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f58701f5610 con 0x7f58701f7e50 2024-09-10T23:18:14.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.082+0000 7f5865ffb640 1 -- 172.21.15.90:0/2302387070 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v42) ==== 59+0+1998 (secure 0 0 0) 0x7f58600627f0 con 0x7f58701f7e50 2024-09-10T23:18:14.083 INFO:teuthology.orchestra.run.smithi090.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:18:14.083 INFO:teuthology.orchestra.run.smithi090.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:18:14.083 INFO:teuthology.orchestra.run.smithi090.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:18:14.084 INFO:teuthology.orchestra.run.smithi090.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:18:14.084 INFO:teuthology.orchestra.run.smithi090.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8283.895139 2024-09-10T23:18:14.084 INFO:teuthology.orchestra.run.smithi090.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5684.288500 2024-09-10T23:18:14.084 INFO:teuthology.orchestra.run.smithi090.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5960.411649 2024-09-10T23:18:14.084 INFO:teuthology.orchestra.run.smithi090.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5499.929251 2024-09-10T23:18:14.084 INFO:teuthology.orchestra.run.smithi090.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5373.806301 2024-09-10T23:18:14.084 INFO:teuthology.orchestra.run.smithi090.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5138.908279 2024-09-10T23:18:14.084 INFO:teuthology.orchestra.run.smithi090.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5181.430205 2024-09-10T23:18:14.084 INFO:teuthology.orchestra.run.smithi090.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4880.265977 2024-09-10T23:18:14.084 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_mds 20/20 2024-09-10T23:18:14.084 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:18:14.084 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced debug_ms 2/2 2024-09-10T23:18:14.084 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_debug_frag true 2024-09-10T23:18:14.085 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:18:14.085 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:18:14.085 INFO:teuthology.orchestra.run.smithi090.stdout:mds dev mds_verify_scatter true 2024-09-10T23:18:14.085 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:18:14.085 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:18:14.085 INFO:teuthology.orchestra.run.smithi090.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:18:14.085 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced client_mount_timeout 600 2024-09-10T23:18:14.085 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced debug_client 20/20 2024-09-10T23:18:14.085 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced debug_ms 1/1 2024-09-10T23:18:14.085 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:18:14.085 INFO:teuthology.orchestra.run.smithi090.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:18:14.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.084+0000 7f587754b640 1 -- 172.21.15.90:0/2302387070 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5854077f70 msgr2=0x7f585407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:14.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.084+0000 7f587754b640 1 --2- 172.21.15.90:0/2302387070 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5854077f70 0x7f585407a430 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f586c033000 tx=0x7f58700ce7a0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.084+0000 7f587754b640 1 -- 172.21.15.90:0/2302387070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58701f7e50 msgr2=0x7f58700ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:14.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.084+0000 7f587754b640 1 --2- 172.21.15.90:0/2302387070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58701f7e50 0x7f58700ca260 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f586000d600 tx=0x7f586000dac0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.084+0000 7f587754b640 1 -- 172.21.15.90:0/2302387070 shutdown_connections 2024-09-10T23:18:14.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.084+0000 7f587754b640 1 --2- 172.21.15.90:0/2302387070 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5854077f70 0x7f585407a430 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.084+0000 7f587754b640 1 --2- 172.21.15.90:0/2302387070 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58700ca7a0 0x7f58701f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.084+0000 7f587754b640 1 --2- 172.21.15.90:0/2302387070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58701f7e50 0x7f58700ca260 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.084+0000 7f587754b640 1 --2- 172.21.15.90:0/2302387070 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f585c003a00 0x7f58700b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.084+0000 7f587754b640 1 -- 172.21.15.90:0/2302387070 >> 172.21.15.90:0/2302387070 conn(0x7f58700d4090 msgr2=0x7f58700b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:14.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.084+0000 7f587754b640 1 -- 172.21.15.90:0/2302387070 shutdown_connections 2024-09-10T23:18:14.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.084+0000 7f587754b640 1 -- 172.21.15.90:0/2302387070 wait complete. 2024-09-10T23:18:14.097 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:18:14.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.200+0000 7f7cf8973640 1 -- 172.21.15.90:0/61480259 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7cf40ceca0 msgr2=0x7f7cf40cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:14.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.200+0000 7f7cf8973640 1 --2- 172.21.15.90:0/61480259 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7cf40ceca0 0x7f7cf40cf110 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7cec005fd0 tx=0x7f7cec02aa10 comp rx=0 tx=0).stop 2024-09-10T23:18:14.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.200+0000 7f7cf8973640 1 -- 172.21.15.90:0/61480259 shutdown_connections 2024-09-10T23:18:14.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.200+0000 7f7cf8973640 1 --2- 172.21.15.90:0/61480259 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7cf40ceca0 0x7f7cf40cf110 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.200+0000 7f7cf8973640 1 --2- 172.21.15.90:0/61480259 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7cf40b3310 0x7f7cf40b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.200+0000 7f7cf8973640 1 -- 172.21.15.90:0/61480259 >> 172.21.15.90:0/61480259 conn(0x7f7cf40b19c0 msgr2=0x7f7cf40b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:14.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.200+0000 7f7cf8973640 1 -- 172.21.15.90:0/61480259 shutdown_connections 2024-09-10T23:18:14.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.200+0000 7f7cf8973640 1 -- 172.21.15.90:0/61480259 wait complete. 2024-09-10T23:18:14.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.201+0000 7f7cf8973640 1 Processor -- start 2024-09-10T23:18:14.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.201+0000 7f7cf8973640 1 -- start start 2024-09-10T23:18:14.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.202+0000 7f7cf8973640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf40b3310 0x7f7cf41526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:14.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.202+0000 7f7cf8973640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7cf40ceca0 0x7f7cf4151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:14.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.202+0000 7f7cf8973640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7cf4152170 0x7f7cf4153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:14.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.202+0000 7f7cf8973640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf415bb40 con 0x7f7cf40b3310 2024-09-10T23:18:14.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.202+0000 7f7cf8973640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf415b9c0 con 0x7f7cf40ceca0 2024-09-10T23:18:14.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.202+0000 7f7cf8973640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf415bcc0 con 0x7f7cf4152170 2024-09-10T23:18:14.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.202+0000 7f7cf259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf40b3310 0x7f7cf41526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:14.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.202+0000 7f7cf259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf40b3310 0x7f7cf41526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55034/0 (socket says 172.21.15.90:55034) 2024-09-10T23:18:14.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.202+0000 7f7cf259c640 1 -- 172.21.15.90:0/332266778 learned_addr learned my addr 172.21.15.90:0/332266778 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:14.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.202+0000 7f7cf2d9d640 1 --2- 172.21.15.90:0/332266778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7cf4152170 0x7f7cf4153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:14.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.202+0000 7f7ce9d9b640 1 --2- 172.21.15.90:0/332266778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7cf40ceca0 0x7f7cf4151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:14.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.203+0000 7f7cf259c640 1 -- 172.21.15.90:0/332266778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7cf4152170 msgr2=0x7f7cf4153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:14.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.203+0000 7f7cf259c640 1 --2- 172.21.15.90:0/332266778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7cf4152170 0x7f7cf4153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.203+0000 7f7cf259c640 1 -- 172.21.15.90:0/332266778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7cf40ceca0 msgr2=0x7f7cf4151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:14.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.203+0000 7f7cf259c640 1 --2- 172.21.15.90:0/332266778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7cf40ceca0 0x7f7cf4151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.203+0000 7f7cf259c640 1 -- 172.21.15.90:0/332266778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf409ca90 con 0x7f7cf40b3310 2024-09-10T23:18:14.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.203+0000 7f7cf2d9d640 1 --2- 172.21.15.90:0/332266778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7cf4152170 0x7f7cf4153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:14.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.203+0000 7f7ce9d9b640 1 --2- 172.21.15.90:0/332266778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7cf40ceca0 0x7f7cf4151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:14.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.203+0000 7f7cf259c640 1 --2- 172.21.15.90:0/332266778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf40b3310 0x7f7cf41526a0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400ea60 tx=0x7f7ce400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:14.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.203+0000 7f7ceb7fe640 1 -- 172.21.15.90:0/332266778 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce400cde0 con 0x7f7cf40b3310 2024-09-10T23:18:14.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.203+0000 7f7ceb7fe640 1 -- 172.21.15.90:0/332266778 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ce4004020 con 0x7f7cf40b3310 2024-09-10T23:18:14.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.203+0000 7f7cf8973640 1 -- 172.21.15.90:0/332266778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf409b590 con 0x7f7cf40b3310 2024-09-10T23:18:14.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.203+0000 7f7ceb7fe640 1 -- 172.21.15.90:0/332266778 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4004470 con 0x7f7cf40b3310 2024-09-10T23:18:14.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.203+0000 7f7cf8973640 1 -- 172.21.15.90:0/332266778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf409bb50 con 0x7f7cf40b3310 2024-09-10T23:18:14.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.204+0000 7f7cf8973640 1 -- 172.21.15.90:0/332266778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf41552a0 con 0x7f7cf40b3310 2024-09-10T23:18:14.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.205+0000 7f7ceb7fe640 1 -- 172.21.15.90:0/332266778 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7ce40035f0 con 0x7f7cf40b3310 2024-09-10T23:18:14.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.205+0000 7f7ceb7fe640 1 --2- 172.21.15.90:0/332266778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7cd4077f70 0x7f7cd407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:14.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.205+0000 7f7ceb7fe640 1 -- 172.21.15.90:0/332266778 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4943+0+0 (secure 0 0 0) 0x7f7ce409a470 con 0x7f7cf40b3310 2024-09-10T23:18:14.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.205+0000 7f7ce9d9b640 1 --2- 172.21.15.90:0/332266778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7cd4077f70 0x7f7cd407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:14.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.206+0000 7f7ce9d9b640 1 --2- 172.21.15.90:0/332266778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7cd4077f70 0x7f7cd407a430 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7cf415c3f0 tx=0x7f7cdc009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:14.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.209+0000 7f7ceb7fe640 1 -- 172.21.15.90:0/332266778 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7cf41552a0 con 0x7f7cf40b3310 2024-09-10T23:18:14.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.384+0000 7f7cf8973640 1 -- 172.21.15.90:0/332266778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7cf415c170 con 0x7f7cf40b3310 2024-09-10T23:18:14.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.387+0000 7f7ceb7fe640 1 -- 172.21.15.90:0/332266778 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v43)=0 v43) ==== 122+0+0 (secure 0 0 0) 0x7f7ce4063270 con 0x7f7cf40b3310 2024-09-10T23:18:14.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.389+0000 7f7cf8973640 1 -- 172.21.15.90:0/332266778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7cd4077f70 msgr2=0x7f7cd407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:14.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.389+0000 7f7cf8973640 1 --2- 172.21.15.90:0/332266778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7cd4077f70 0x7f7cd407a430 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7cf415c3f0 tx=0x7f7cdc009040 comp rx=0 tx=0).stop 2024-09-10T23:18:14.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.389+0000 7f7cf8973640 1 -- 172.21.15.90:0/332266778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf40b3310 msgr2=0x7f7cf41526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:14.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.389+0000 7f7cf8973640 1 --2- 172.21.15.90:0/332266778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf40b3310 0x7f7cf41526a0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400ea60 tx=0x7f7ce400ef20 comp rx=0 tx=0).stop 2024-09-10T23:18:14.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.389+0000 7f7cf8973640 1 -- 172.21.15.90:0/332266778 shutdown_connections 2024-09-10T23:18:14.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.389+0000 7f7cf8973640 1 --2- 172.21.15.90:0/332266778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7cd4077f70 0x7f7cd407a430 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.389+0000 7f7cf8973640 1 --2- 172.21.15.90:0/332266778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7cf40ceca0 0x7f7cf4151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.389+0000 7f7cf8973640 1 --2- 172.21.15.90:0/332266778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7cf4152170 0x7f7cf4153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.389+0000 7f7cf8973640 1 --2- 172.21.15.90:0/332266778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf40b3310 0x7f7cf41526a0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.389+0000 7f7cf8973640 1 -- 172.21.15.90:0/332266778 >> 172.21.15.90:0/332266778 conn(0x7f7cf40b19c0 msgr2=0x7f7cf40acd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:14.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.390+0000 7f7cf8973640 1 -- 172.21.15.90:0/332266778 shutdown_connections 2024-09-10T23:18:14.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.390+0000 7f7cf8973640 1 -- 172.21.15.90:0/332266778 wait complete. 2024-09-10T23:18:14.402 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:18:14.402 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:18:14.458 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:18:14.519 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:18:14.519 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:18:14.519 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:14.536 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:18:14.537 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:18:14.537 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:14.555 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:18:14.555 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:18:14.555 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:14.592 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:18:14.593 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:18:14.593 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:14.613 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:18:14.613 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:18:14.613 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:14.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.733+0000 7fa1e1816640 1 -- 172.21.15.90:0/695849932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1c8004800 msgr2=0x7fa1c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:14.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.733+0000 7fa1e1816640 1 --2- 172.21.15.90:0/695849932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1c8004800 0x7fa1c8004c80 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009b50 tx=0x7fa1c8005830 comp rx=0 tx=0).stop 2024-09-10T23:18:14.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.733+0000 7fa1e1816640 1 -- 172.21.15.90:0/695849932 shutdown_connections 2024-09-10T23:18:14.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.733+0000 7fa1e1816640 1 --2- 172.21.15.90:0/695849932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1c8004800 0x7fa1c8004c80 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.733+0000 7fa1e1816640 1 -- 172.21.15.90:0/695849932 >> 172.21.15.90:0/695849932 conn(0x7fa1dc0d4090 msgr2=0x7fa1dc0d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:14.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.733+0000 7fa1e1816640 1 -- 172.21.15.90:0/695849932 shutdown_connections 2024-09-10T23:18:14.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.733+0000 7fa1e1816640 1 -- 172.21.15.90:0/695849932 wait complete. 2024-09-10T23:18:14.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.735+0000 7fa1e1816640 1 Processor -- start 2024-09-10T23:18:14.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.735+0000 7fa1e1816640 1 -- start start 2024-09-10T23:18:14.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1e1816640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1c8004800 0x7fa1dc0b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:14.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1e1816640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1dc148f10 0x7fa1dc0ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:14.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1e1816640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1dc1f4ff0 0x7fa1dc0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:14.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1e1816640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc0d4d30 con 0x7fa1c8004800 2024-09-10T23:18:14.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1e1816640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc0d4bb0 con 0x7fa1dc148f10 2024-09-10T23:18:14.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1e1816640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa1dc0d4eb0 con 0x7fa1dc1f4ff0 2024-09-10T23:18:14.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1daffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1c8004800 0x7fa1dc0b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:14.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1daffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1c8004800 0x7fa1dc0b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55050/0 (socket says 172.21.15.90:55050) 2024-09-10T23:18:14.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1daffd640 1 -- 172.21.15.90:0/1282935585 learned_addr learned my addr 172.21.15.90:0/1282935585 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:14.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1da7fc640 1 --2- 172.21.15.90:0/1282935585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1dc148f10 0x7fa1dc0ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:14.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1db7fe640 1 --2- 172.21.15.90:0/1282935585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1dc1f4ff0 0x7fa1dc0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:14.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1daffd640 1 -- 172.21.15.90:0/1282935585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1dc1f4ff0 msgr2=0x7fa1dc0cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:14.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1daffd640 1 --2- 172.21.15.90:0/1282935585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1dc1f4ff0 0x7fa1dc0cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1daffd640 1 -- 172.21.15.90:0/1282935585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1dc148f10 msgr2=0x7fa1dc0ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:14.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1daffd640 1 --2- 172.21.15.90:0/1282935585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1dc148f10 0x7fa1dc0ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1daffd640 1 -- 172.21.15.90:0/1282935585 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1dc0cae10 con 0x7fa1c8004800 2024-09-10T23:18:14.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1da7fc640 1 --2- 172.21.15.90:0/1282935585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1dc148f10 0x7fa1dc0ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:14.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1daffd640 1 --2- 172.21.15.90:0/1282935585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1c8004800 0x7fa1dc0b37a0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40060e0 tx=0x7fa1d40065a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:14.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1d3fff640 1 -- 172.21.15.90:0/1282935585 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4015070 con 0x7fa1c8004800 2024-09-10T23:18:14.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1d3fff640 1 -- 172.21.15.90:0/1282935585 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1d400fb30 con 0x7fa1c8004800 2024-09-10T23:18:14.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1e1816640 1 -- 172.21.15.90:0/1282935585 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1dc1f58a0 con 0x7fa1c8004800 2024-09-10T23:18:14.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1d3fff640 1 -- 172.21.15.90:0/1282935585 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4011430 con 0x7fa1c8004800 2024-09-10T23:18:14.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.736+0000 7fa1e1816640 1 -- 172.21.15.90:0/1282935585 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1dc0c9df0 con 0x7fa1c8004800 2024-09-10T23:18:14.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.737+0000 7fa1e1816640 1 -- 172.21.15.90:0/1282935585 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1dc06e120 con 0x7fa1c8004800 2024-09-10T23:18:14.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.738+0000 7fa1d3fff640 1 -- 172.21.15.90:0/1282935585 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa1d40115d0 con 0x7fa1c8004800 2024-09-10T23:18:14.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.738+0000 7fa1d3fff640 1 --2- 172.21.15.90:0/1282935585 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa1bc077f70 0x7fa1bc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:14.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.739+0000 7fa1da7fc640 1 --2- 172.21.15.90:0/1282935585 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa1bc077f70 0x7fa1bc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:14.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.739+0000 7fa1d3fff640 1 -- 172.21.15.90:0/1282935585 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4943+0+0 (secure 0 0 0) 0x7fa1d409a940 con 0x7fa1c8004800 2024-09-10T23:18:14.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.739+0000 7fa1da7fc640 1 --2- 172.21.15.90:0/1282935585 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa1bc077f70 0x7fa1bc07a430 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4035000 tx=0x7fa1c40046c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:14.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.743+0000 7fa1d3fff640 1 -- 172.21.15.90:0/1282935585 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa1d4063740 con 0x7fa1c8004800 2024-09-10T23:18:14.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.951+0000 7fa1e1816640 1 -- 172.21.15.90:0/1282935585 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1dc0b72d0 con 0x7fa1c8004800 2024-09-10T23:18:14.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.951+0000 7fa1d3fff640 1 -- 172.21.15.90:0/1282935585 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+3908 (secure 0 0 0) 0x7fa1d4063040 con 0x7fa1c8004800 2024-09-10T23:18:14.953 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:14.953 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":53,"btime":"2024-09-10T23:18:09:763339+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5741,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/991470791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":991470791},{"type":"v1","addr":"172.21.15.171:6836","nonce":991470791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6037,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/372190727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":372190727},{"type":"v1","addr":"172.21.15.171:6837","nonce":372190727}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":6711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/970952744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":970952744},{"type":"v1","addr":"172.21.15.90:6834","nonce":970952744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6969,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1981815264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":1981815264},{"type":"v1","addr":"172.21.15.90:6835","nonce":1981815264}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":53}],"filesystems":[]} 2024-09-10T23:18:14.953 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 53 2024-09-10T23:18:14.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.953+0000 7fa1e1816640 1 -- 172.21.15.90:0/1282935585 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa1bc077f70 msgr2=0x7fa1bc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:14.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.953+0000 7fa1e1816640 1 --2- 172.21.15.90:0/1282935585 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa1bc077f70 0x7fa1bc07a430 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4035000 tx=0x7fa1c40046c0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.953+0000 7fa1e1816640 1 -- 172.21.15.90:0/1282935585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1c8004800 msgr2=0x7fa1dc0b37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:14.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.953+0000 7fa1e1816640 1 --2- 172.21.15.90:0/1282935585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1c8004800 0x7fa1dc0b37a0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40060e0 tx=0x7fa1d40065a0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.953+0000 7fa1e1816640 1 -- 172.21.15.90:0/1282935585 shutdown_connections 2024-09-10T23:18:14.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.953+0000 7fa1e1816640 1 --2- 172.21.15.90:0/1282935585 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa1bc077f70 0x7fa1bc07a430 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.953+0000 7fa1e1816640 1 --2- 172.21.15.90:0/1282935585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1dc148f10 0x7fa1dc0ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.953+0000 7fa1e1816640 1 --2- 172.21.15.90:0/1282935585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1dc1f4ff0 0x7fa1dc0cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.953+0000 7fa1e1816640 1 --2- 172.21.15.90:0/1282935585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1c8004800 0x7fa1dc0b37a0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:14.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.953+0000 7fa1e1816640 1 -- 172.21.15.90:0/1282935585 >> 172.21.15.90:0/1282935585 conn(0x7fa1dc0d4090 msgr2=0x7fa1dc149740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:14.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.954+0000 7fa1e1816640 1 -- 172.21.15.90:0/1282935585 shutdown_connections 2024-09-10T23:18:14.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:14.954+0000 7fa1e1816640 1 -- 172.21.15.90:0/1282935585 wait complete. 2024-09-10T23:18:14.965 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:18:14.966 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:18:14.966 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:18:14.966 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:18:14.966 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:18:14.966 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:18:14.966 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:18:14.967 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:18:14.967 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:18:14.967 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:18:14.967 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:18:14.967 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:18:14.967 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:18:14.967 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:18:14.968 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:18:14.968 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:18:14.976 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:18:14.976 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:18:14.977 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:18:14.977 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:18:14.979 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:18:14.980 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:18:14.981 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:18:14.981 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:18:15.018 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:18:15.018 DEBUG:teuthology.parallel:result is None 2024-09-10T23:18:15.019 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:18:15.019 DEBUG:teuthology.parallel:result is None 2024-09-10T23:18:15.022 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:18:15.022 DEBUG:teuthology.parallel:result is None 2024-09-10T23:18:15.023 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:18:15.023 DEBUG:teuthology.parallel:result is None 2024-09-10T23:18:15.023 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:18:15.093 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-09-10T23:18:15.093 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-09-10T23:18:15.103 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-09-10T23:18:15.104 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-09-10T23:18:15.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.128+0000 7ff40814b640 1 -- 172.21.15.90:0/857033940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff40006e750 msgr2=0x7ff4000d4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:15.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.128+0000 7ff40814b640 1 --2- 172.21.15.90:0/857033940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff40006e750 0x7ff4000d4bb0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7ff40008c2a0 tx=0x7ff3f002a680 comp rx=0 tx=0).stop 2024-09-10T23:18:15.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.128+0000 7ff40814b640 1 -- 172.21.15.90:0/857033940 shutdown_connections 2024-09-10T23:18:15.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.128+0000 7ff40814b640 1 --2- 172.21.15.90:0/857033940 >> v2:172.21.15.171:3300/0 conn(0x7ff40006d6d0 0x7ff4000cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:15.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.128+0000 7ff40814b640 1 --2- 172.21.15.90:0/857033940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff40006e750 0x7ff4000d4bb0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:15.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.128+0000 7ff40814b640 1 -- 172.21.15.90:0/857033940 >> 172.21.15.90:0/857033940 conn(0x7ff4000d4090 msgr2=0x7ff4000d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:15.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.128+0000 7ff40814b640 1 -- 172.21.15.90:0/857033940 shutdown_connections 2024-09-10T23:18:15.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.128+0000 7ff40814b640 1 -- 172.21.15.90:0/857033940 wait complete. 2024-09-10T23:18:15.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.129+0000 7ff40814b640 1 Processor -- start 2024-09-10T23:18:15.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.129+0000 7ff40814b640 1 -- start start 2024-09-10T23:18:15.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.130+0000 7ff40814b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff40006d6d0 0x7ff40014c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:15.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.130+0000 7ff40814b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff40006e750 0x7ff4000c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:15.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.130+0000 7ff40814b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff40015e180 0x7ff4000c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:15.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.130+0000 7ff40814b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff4000cf840 con 0x7ff40015e180 2024-09-10T23:18:15.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.130+0000 7ff40814b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff4000cf6c0 con 0x7ff40006e750 2024-09-10T23:18:15.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.130+0000 7ff40814b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff4000cf9c0 con 0x7ff40006d6d0 2024-09-10T23:18:15.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.130+0000 7ff4066e8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff40015e180 0x7ff4000c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:15.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.130+0000 7ff4066e8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff40015e180 0x7ff4000c9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55078/0 (socket says 172.21.15.90:55078) 2024-09-10T23:18:15.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.130+0000 7ff4066e8640 1 -- 172.21.15.90:0/1787021737 learned_addr learned my addr 172.21.15.90:0/1787021737 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:15.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.131+0000 7ff405ee7640 1 --2- 172.21.15.90:0/1787021737 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff40006d6d0 0x7ff40014c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:15.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.131+0000 7ff4056e6640 1 --2- 172.21.15.90:0/1787021737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff40006e750 0x7ff4000c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:15.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.131+0000 7ff4066e8640 1 -- 172.21.15.90:0/1787021737 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff40006d6d0 msgr2=0x7ff40014c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:15.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.131+0000 7ff4066e8640 1 --2- 172.21.15.90:0/1787021737 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff40006d6d0 0x7ff40014c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:15.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.131+0000 7ff4066e8640 1 -- 172.21.15.90:0/1787021737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff40006e750 msgr2=0x7ff4000c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:15.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.131+0000 7ff4066e8640 1 --2- 172.21.15.90:0/1787021737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff40006e750 0x7ff4000c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:15.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.131+0000 7ff4066e8640 1 -- 172.21.15.90:0/1787021737 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4001f56a0 con 0x7ff40015e180 2024-09-10T23:18:15.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.131+0000 7ff405ee7640 1 --2- 172.21.15.90:0/1787021737 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff40006d6d0 0x7ff40014c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:15.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.131+0000 7ff4056e6640 1 --2- 172.21.15.90:0/1787021737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff40006e750 0x7ff4000c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:15.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.131+0000 7ff4066e8640 1 --2- 172.21.15.90:0/1787021737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff40015e180 0x7ff4000c9ea0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800eb40 tx=0x7ff3f800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:15.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.131+0000 7ff3f67fc640 1 -- 172.21.15.90:0/1787021737 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8004b20 con 0x7ff40015e180 2024-09-10T23:18:15.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.131+0000 7ff3f67fc640 1 -- 172.21.15.90:0/1787021737 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3f8004ce0 con 0x7ff40015e180 2024-09-10T23:18:15.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.131+0000 7ff40814b640 1 -- 172.21.15.90:0/1787021737 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff40014e940 con 0x7ff40015e180 2024-09-10T23:18:15.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.131+0000 7ff3f67fc640 1 -- 172.21.15.90:0/1787021737 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8005280 con 0x7ff40015e180 2024-09-10T23:18:15.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.131+0000 7ff40814b640 1 -- 172.21.15.90:0/1787021737 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff40014ef00 con 0x7ff40015e180 2024-09-10T23:18:15.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.132+0000 7ff40814b640 1 -- 172.21.15.90:0/1787021737 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff40008e130 con 0x7ff40015e180 2024-09-10T23:18:15.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.133+0000 7ff3f67fc640 1 -- 172.21.15.90:0/1787021737 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff3f8005420 con 0x7ff40015e180 2024-09-10T23:18:15.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.134+0000 7ff3f67fc640 1 --2- 172.21.15.90:0/1787021737 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff3e4077f70 0x7ff3e407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:15.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.134+0000 7ff3f67fc640 1 -- 172.21.15.90:0/1787021737 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4943+0+0 (secure 0 0 0) 0x7ff3f809a7d0 con 0x7ff40015e180 2024-09-10T23:18:15.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.134+0000 7ff405ee7640 1 --2- 172.21.15.90:0/1787021737 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff3e4077f70 0x7ff3e407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:15.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.134+0000 7ff405ee7640 1 --2- 172.21.15.90:0/1787021737 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff3e4077f70 0x7ff3e407a430 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc007fd0 tx=0x7ff3fc009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:15.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.138+0000 7ff3f67fc640 1 -- 172.21.15.90:0/1787021737 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff3f80635d0 con 0x7ff40015e180 2024-09-10T23:18:15.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:15.324+0000 7ff40814b640 1 -- 172.21.15.90:0/1787021737 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff40015ce60 con 0x7ff40015e180 2024-09-10T23:18:16.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.410+0000 7ff3f67fc640 1 -- 172.21.15.90:0/1787021737 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v100) ==== 97+0+0 (secure 0 0 0) 0x7ff3f8062ed0 con 0x7ff40015e180 2024-09-10T23:18:16.413 INFO:teuthology.orchestra.run.smithi090.stderr: removed all blocklist entries 2024-09-10T23:18:16.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.413+0000 7ff40814b640 1 -- 172.21.15.90:0/1787021737 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff3e4077f70 msgr2=0x7ff3e407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:16.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.413+0000 7ff40814b640 1 --2- 172.21.15.90:0/1787021737 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff3e4077f70 0x7ff3e407a430 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc007fd0 tx=0x7ff3fc009040 comp rx=0 tx=0).stop 2024-09-10T23:18:16.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.413+0000 7ff40814b640 1 -- 172.21.15.90:0/1787021737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff40015e180 msgr2=0x7ff4000c9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:16.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.413+0000 7ff40814b640 1 --2- 172.21.15.90:0/1787021737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff40015e180 0x7ff4000c9ea0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800eb40 tx=0x7ff3f800c2d0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.413+0000 7ff40814b640 1 -- 172.21.15.90:0/1787021737 shutdown_connections 2024-09-10T23:18:16.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.413+0000 7ff40814b640 1 --2- 172.21.15.90:0/1787021737 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff3e4077f70 0x7ff3e407a430 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.413+0000 7ff40814b640 1 --2- 172.21.15.90:0/1787021737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff40006e750 0x7ff4000c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.413+0000 7ff40814b640 1 --2- 172.21.15.90:0/1787021737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff40015e180 0x7ff4000c9ea0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.413+0000 7ff40814b640 1 --2- 172.21.15.90:0/1787021737 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff40006d6d0 0x7ff40014c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.413+0000 7ff40814b640 1 -- 172.21.15.90:0/1787021737 >> 172.21.15.90:0/1787021737 conn(0x7ff4000d4090 msgr2=0x7ff4000b6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:16.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.414+0000 7ff40814b640 1 -- 172.21.15.90:0/1787021737 shutdown_connections 2024-09-10T23:18:16.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.414+0000 7ff40814b640 1 -- 172.21.15.90:0/1787021737 wait complete. 2024-09-10T23:18:16.428 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:18:16.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.530+0000 7f22ec62a640 1 -- 172.21.15.90:0/478393417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22e415e310 msgr2=0x7f22e40d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:16.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.530+0000 7f22ec62a640 1 --2- 172.21.15.90:0/478393417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22e415e310 0x7f22e40d0a80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f22e408e4a0 tx=0x7f22dc02a440 comp rx=0 tx=0).stop 2024-09-10T23:18:16.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.530+0000 7f22ec62a640 1 -- 172.21.15.90:0/478393417 shutdown_connections 2024-09-10T23:18:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.530+0000 7f22ec62a640 1 --2- 172.21.15.90:0/478393417 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22e40d4b80 0x7f22e406d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.530+0000 7f22ec62a640 1 --2- 172.21.15.90:0/478393417 >> v2:172.21.15.171:3300/0 conn(0x7f22e40d16f0 0x7f22e40d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.530+0000 7f22ec62a640 1 --2- 172.21.15.90:0/478393417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22e415e310 0x7f22e40d0a80 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.530+0000 7f22ec62a640 1 -- 172.21.15.90:0/478393417 >> 172.21.15.90:0/478393417 conn(0x7f22e40d4090 msgr2=0x7f22e40d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.530+0000 7f22ec62a640 1 -- 172.21.15.90:0/478393417 shutdown_connections 2024-09-10T23:18:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.530+0000 7f22ec62a640 1 -- 172.21.15.90:0/478393417 wait complete. 2024-09-10T23:18:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.531+0000 7f22ec62a640 1 Processor -- start 2024-09-10T23:18:16.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.531+0000 7f22ec62a640 1 -- start start 2024-09-10T23:18:16.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.532+0000 7f22ec62a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22e40d16f0 0x7f22e40ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:16.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.532+0000 7f22ec62a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22e40d4b80 0x7f22e414d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.532+0000 7f22ec62a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22e415e310 0x7f22e414d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.532+0000 7f22ec62a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f22e406dfc0 con 0x7f22e40d4b80 2024-09-10T23:18:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.532+0000 7f22ec62a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f22e406de40 con 0x7f22e40d16f0 2024-09-10T23:18:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.532+0000 7f22ec62a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f22e406e140 con 0x7f22e415e310 2024-09-10T23:18:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.532+0000 7f22e9bc5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22e40d4b80 0x7f22e414d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.532+0000 7f22e9bc5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22e40d4b80 0x7f22e414d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55098/0 (socket says 172.21.15.90:55098) 2024-09-10T23:18:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.532+0000 7f22e9bc5640 1 -- 172.21.15.90:0/403340350 learned_addr learned my addr 172.21.15.90:0/403340350 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.532+0000 7f22eabc7640 1 --2- 172.21.15.90:0/403340350 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22e415e310 0x7f22e414d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.532+0000 7f22ea3c6640 1 --2- 172.21.15.90:0/403340350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22e40d16f0 0x7f22e40ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.533+0000 7f22e9bc5640 1 -- 172.21.15.90:0/403340350 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22e415e310 msgr2=0x7f22e414d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.533+0000 7f22e9bc5640 1 --2- 172.21.15.90:0/403340350 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22e415e310 0x7f22e414d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.533+0000 7f22e9bc5640 1 -- 172.21.15.90:0/403340350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22e40d16f0 msgr2=0x7f22e40ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.533+0000 7f22e9bc5640 1 --2- 172.21.15.90:0/403340350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22e40d16f0 0x7f22e40ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.533+0000 7f22e9bc5640 1 -- 172.21.15.90:0/403340350 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e40b83c0 con 0x7f22e40d4b80 2024-09-10T23:18:16.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.533+0000 7f22e9bc5640 1 --2- 172.21.15.90:0/403340350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22e40d4b80 0x7f22e414d2e0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f22d800b4d0 tx=0x7f22d800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:16.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.533+0000 7f22e2ffd640 1 -- 172.21.15.90:0/403340350 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8014070 con 0x7f22e40d4b80 2024-09-10T23:18:16.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.533+0000 7f22e2ffd640 1 -- 172.21.15.90:0/403340350 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22d8010610 con 0x7f22e40d4b80 2024-09-10T23:18:16.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.533+0000 7f22ec62a640 1 -- 172.21.15.90:0/403340350 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e40b86a0 con 0x7f22e40d4b80 2024-09-10T23:18:16.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.533+0000 7f22e2ffd640 1 -- 172.21.15.90:0/403340350 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8010a60 con 0x7f22e40d4b80 2024-09-10T23:18:16.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.533+0000 7f22ec62a640 1 -- 172.21.15.90:0/403340350 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e40b8c60 con 0x7f22e40d4b80 2024-09-10T23:18:16.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.534+0000 7f22ec62a640 1 -- 172.21.15.90:0/403340350 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22e406d6f0 con 0x7f22e40d4b80 2024-09-10T23:18:16.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.535+0000 7f22e2ffd640 1 -- 172.21.15.90:0/403340350 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f22d8010c00 con 0x7f22e40d4b80 2024-09-10T23:18:16.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.535+0000 7f22e2ffd640 1 --2- 172.21.15.90:0/403340350 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f22d0077f70 0x7f22d007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:16.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.535+0000 7f22e2ffd640 1 -- 172.21.15.90:0/403340350 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 4857+0+0 (secure 0 0 0) 0x7f22d8099660 con 0x7f22e40d4b80 2024-09-10T23:18:16.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.535+0000 7f22ea3c6640 1 --2- 172.21.15.90:0/403340350 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f22d0077f70 0x7f22d007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:16.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.536+0000 7f22ea3c6640 1 --2- 172.21.15.90:0/403340350 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f22d0077f70 0x7f22d007a430 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f22dc033000 tx=0x7f22dc004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:16.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.539+0000 7f22e2ffd640 1 -- 172.21.15.90:0/403340350 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f22d8061e60 con 0x7f22e40d4b80 2024-09-10T23:18:16.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.783+0000 7f22ec62a640 1 -- 172.21.15.90:0/403340350 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f22e40b2e50 con 0x7f22e40d4b80 2024-09-10T23:18:16.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.784+0000 7f22e2ffd640 1 -- 172.21.15.90:0/403340350 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v30) ==== 80+0+5304 (secure 0 0 0) 0x7f22d8066890 con 0x7f22e40d4b80 2024-09-10T23:18:16.786 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:16.786 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:18:16.786 INFO:teuthology.orchestra.run.smithi090.stdout: "auth_dump": [ 2024-09-10T23:18:16.786 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.786 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.a", 2024-09-10T23:18:16.786 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBm/QY6KxAAKT1mZg/6ZcszcNrPmouZfw==", 2024-09-10T23:18:16.786 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.787 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:18:16.787 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:18:16.787 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:18:16.787 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:18:16.787 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.787 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.787 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.787 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.b", 2024-09-10T23:18:16.787 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmSqPhNhAA3flpsOGFszFMeaPUoHAtJg==", 2024-09-10T23:18:16.787 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.787 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:18:16.787 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:18:16.787 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:18:16.787 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:18:16.788 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.788 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.788 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.788 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.c", 2024-09-10T23:18:16.788 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmDVE4MhAAHal/PtI10hL4nKdTUO5BiQ==", 2024-09-10T23:18:16.788 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.788 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:18:16.788 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:18:16.788 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:18:16.788 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:18:16.788 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.788 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.789 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.789 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.d", 2024-09-10T23:18:16.789 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmr3lfAhAAFdZ7zvJmGNFHRwCr+mdY7w==", 2024-09-10T23:18:16.789 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.789 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:18:16.789 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:18:16.789 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:18:16.789 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:18:16.789 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.789 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.789 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.789 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.0", 2024-09-10T23:18:16.789 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCa0uBmZKxTJRAAfEBB/vykopmDbmREyy227g==", 2024-09-10T23:18:16.789 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.790 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:18:16.790 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:18:16.790 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:18:16.790 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.790 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.790 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.790 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.1", 2024-09-10T23:18:16.790 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCd0uBmJHG8NRAAS8QD8Zgrxrxddq7kN4P9Ag==", 2024-09-10T23:18:16.790 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.790 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:18:16.790 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:18:16.790 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:18:16.790 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.791 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.791 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.791 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.2", 2024-09-10T23:18:16.791 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCh0uBmtUUmDBAAmYRv9P/wjX8HLVkLatoXuQ==", 2024-09-10T23:18:16.791 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.791 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:18:16.791 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:18:16.791 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:18:16.791 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.791 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.791 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.791 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.3", 2024-09-10T23:18:16.791 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCk0uBm4397HBAAGZK0ktD0ORY/0CPlMprYFg==", 2024-09-10T23:18:16.791 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:18:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:18:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:18:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.4", 2024-09-10T23:18:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCq0uBmBaMINBAAkuhNrc4YFAYQfcxMQenCBQ==", 2024-09-10T23:18:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:18:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:18:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:18:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.5", 2024-09-10T23:18:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCu0uBmLOrnCBAAwZTy+62ZN3g5jfH20jB4qw==", 2024-09-10T23:18:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:18:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:18:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:18:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.6", 2024-09-10T23:18:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCx0uBmr4bYChAAdWog9uHnYgiiXniefs25DA==", 2024-09-10T23:18:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:18:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:18:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:18:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.7", 2024-09-10T23:18:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQC00uBmhU7+DBAAEagAuXuCs1v/vDhIkapi+g==", 2024-09-10T23:18:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-09-10T23:18:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-09-10T23:18:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:18:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.0", 2024-09-10T23:18:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmiYBwBhAABMV9erpQ+KZlTmf0kDZ0gw==", 2024-09-10T23:18:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:18:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow r", 2024-09-10T23:18:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:18:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.1", 2024-09-10T23:18:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBm+TBDDxAA4o+iZ4PwpBRpY++ATzt+wg==", 2024-09-10T23:18:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:18:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:18:16.796 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:18:16.796 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:18:16.796 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.796 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.796 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.796 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.2", 2024-09-10T23:18:16.796 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmJYcKDBAArXISnuT+R9uzuQnL3V+wSg==", 2024-09-10T23:18:16.796 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.796 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:18:16.796 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:18:16.796 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:18:16.796 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:18:16.796 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.796 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.797 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.797 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.3", 2024-09-10T23:18:16.797 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCX0uBmPQvkFBAAaCikPByOvk5xUzTWXdcFPA==", 2024-09-10T23:18:16.797 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.797 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-09-10T23:18:16.797 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-09-10T23:18:16.797 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-09-10T23:18:16.797 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-09-10T23:18:16.797 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.797 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.797 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.797 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.admin", 2024-09-10T23:18:16.797 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmVVIQEBAAY7yzFxxQCyV1YCM3xYC7Og==", 2024-09-10T23:18:16.798 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.798 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:18:16.798 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-09-10T23:18:16.798 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-09-10T23:18:16.798 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:18:16.798 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.798 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.798 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.798 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.x", 2024-09-10T23:18:16.798 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBm4r0EKBAAIZ4VjoTsUpdB6KFbi7EQLQ==", 2024-09-10T23:18:16.798 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.798 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:18:16.798 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2024-09-10T23:18:16.798 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:18:16.799 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.799 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:16.799 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:16.799 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.y", 2024-09-10T23:18:16.799 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQCW0uBmkRSfJBAAWPpV5e4zeX0Es78Xqh9pYw==", 2024-09-10T23:18:16.799 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-09-10T23:18:16.799 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-09-10T23:18:16.799 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2024-09-10T23:18:16.799 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-09-10T23:18:16.799 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.799 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:16.799 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-10T23:18:16.799 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:18:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.786+0000 7f22ec62a640 1 -- 172.21.15.90:0/403340350 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f22d0077f70 msgr2=0x7f22d007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.786+0000 7f22ec62a640 1 --2- 172.21.15.90:0/403340350 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f22d0077f70 0x7f22d007a430 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f22dc033000 tx=0x7f22dc004730 comp rx=0 tx=0).stop 2024-09-10T23:18:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.786+0000 7f22ec62a640 1 -- 172.21.15.90:0/403340350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22e40d4b80 msgr2=0x7f22e414d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.786+0000 7f22ec62a640 1 --2- 172.21.15.90:0/403340350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22e40d4b80 0x7f22e414d2e0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f22d800b4d0 tx=0x7f22d800b990 comp rx=0 tx=0).stop 2024-09-10T23:18:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.786+0000 7f22ec62a640 1 -- 172.21.15.90:0/403340350 shutdown_connections 2024-09-10T23:18:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.786+0000 7f22ec62a640 1 --2- 172.21.15.90:0/403340350 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f22d0077f70 0x7f22d007a430 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.786+0000 7f22ec62a640 1 --2- 172.21.15.90:0/403340350 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22e415e310 0x7f22e414d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.786+0000 7f22ec62a640 1 --2- 172.21.15.90:0/403340350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22e40d4b80 0x7f22e414d2e0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.786+0000 7f22ec62a640 1 --2- 172.21.15.90:0/403340350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22e40d16f0 0x7f22e40ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.786+0000 7f22ec62a640 1 -- 172.21.15.90:0/403340350 >> 172.21.15.90:0/403340350 conn(0x7f22e40d4090 msgr2=0x7f22e40b44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:16.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.786+0000 7f22ec62a640 1 -- 172.21.15.90:0/403340350 shutdown_connections 2024-09-10T23:18:16.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.786+0000 7f22ec62a640 1 -- 172.21.15.90:0/403340350 wait complete. 2024-09-10T23:18:16.802 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:18:16.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.901+0000 7f690d9c6640 1 -- 172.21.15.90:0/3864806772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69080d16f0 msgr2=0x7f69080d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:16.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.901+0000 7f690d9c6640 1 --2- 172.21.15.90:0/3864806772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69080d16f0 0x7f69080d2e00 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f6908069810 tx=0x7f690002a4d0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.901+0000 7f690d9c6640 1 -- 172.21.15.90:0/3864806772 shutdown_connections 2024-09-10T23:18:16.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.901+0000 7f690d9c6640 1 --2- 172.21.15.90:0/3864806772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69080d16f0 0x7f69080d2e00 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.901+0000 7f690d9c6640 1 --2- 172.21.15.90:0/3864806772 >> v2:172.21.15.171:3300/0 conn(0x7f69080d1190 0x7f69080d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.901+0000 7f690d9c6640 1 -- 172.21.15.90:0/3864806772 >> 172.21.15.90:0/3864806772 conn(0x7f69080d4090 msgr2=0x7f69080d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:16.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.901+0000 7f690d9c6640 1 -- 172.21.15.90:0/3864806772 shutdown_connections 2024-09-10T23:18:16.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.901+0000 7f690d9c6640 1 -- 172.21.15.90:0/3864806772 wait complete. 2024-09-10T23:18:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.902+0000 7f690d9c6640 1 Processor -- start 2024-09-10T23:18:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.903+0000 7f690d9c6640 1 -- start start 2024-09-10T23:18:16.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.903+0000 7f690d9c6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69080d1190 0x7f69081f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:16.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.903+0000 7f690d9c6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69080d16f0 0x7f69080cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:16.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.903+0000 7f690d9c6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f690815e310 0x7f69080c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:16.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.903+0000 7f690d9c6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f69080d3340 con 0x7f690815e310 2024-09-10T23:18:16.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.903+0000 7f690d9c6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f69080d4d90 con 0x7f69080d1190 2024-09-10T23:18:16.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.903+0000 7f690d9c6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f69080d34c0 con 0x7f69080d16f0 2024-09-10T23:18:16.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.904+0000 7f69077fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f690815e310 0x7f69080c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:16.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.904+0000 7f69077fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f690815e310 0x7f69080c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55120/0 (socket says 172.21.15.90:55120) 2024-09-10T23:18:16.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.904+0000 7f69077fe640 1 -- 172.21.15.90:0/4057389176 learned_addr learned my addr 172.21.15.90:0/4057389176 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:16.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.904+0000 7f6906ffd640 1 --2- 172.21.15.90:0/4057389176 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69080d1190 0x7f69081f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:16.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.904+0000 7f69067fc640 1 --2- 172.21.15.90:0/4057389176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69080d16f0 0x7f69080cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:16.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.904+0000 7f69077fe640 1 -- 172.21.15.90:0/4057389176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69080d16f0 msgr2=0x7f69080cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:16.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.904+0000 7f69077fe640 1 --2- 172.21.15.90:0/4057389176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69080d16f0 0x7f69080cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.904+0000 7f69077fe640 1 -- 172.21.15.90:0/4057389176 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69080d1190 msgr2=0x7f69081f5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:16.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.904+0000 7f69077fe640 1 --2- 172.21.15.90:0/4057389176 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69080d1190 0x7f69081f5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:16.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.904+0000 7f69077fe640 1 -- 172.21.15.90:0/4057389176 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69080ce3e0 con 0x7f690815e310 2024-09-10T23:18:16.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.904+0000 7f69077fe640 1 --2- 172.21.15.90:0/4057389176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f690815e310 0x7f69080c9260 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f69000099c0 tx=0x7f6900003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:16.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.904+0000 7f68effff640 1 -- 172.21.15.90:0/4057389176 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690003f070 con 0x7f690815e310 2024-09-10T23:18:16.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.904+0000 7f68effff640 1 -- 172.21.15.90:0/4057389176 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6900004890 con 0x7f690815e310 2024-09-10T23:18:16.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.904+0000 7f690d9c6640 1 -- 172.21.15.90:0/4057389176 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f690815fad0 con 0x7f690815e310 2024-09-10T23:18:16.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.904+0000 7f68effff640 1 -- 172.21.15.90:0/4057389176 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6900035030 con 0x7f690815e310 2024-09-10T23:18:16.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.904+0000 7f690d9c6640 1 -- 172.21.15.90:0/4057389176 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6908160090 con 0x7f690815e310 2024-09-10T23:18:16.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.905+0000 7f690d9c6640 1 -- 172.21.15.90:0/4057389176 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69080d39d0 con 0x7f690815e310 2024-09-10T23:18:16.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.906+0000 7f68effff640 1 -- 172.21.15.90:0/4057389176 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6900004cc0 con 0x7f690815e310 2024-09-10T23:18:16.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.906+0000 7f68effff640 1 --2- 172.21.15.90:0/4057389176 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f68f4077f70 0x7f68f407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:16.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.906+0000 7f68effff640 1 -- 172.21.15.90:0/4057389176 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 4857+0+0 (secure 0 0 0) 0x7f69000babf0 con 0x7f690815e310 2024-09-10T23:18:16.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.907+0000 7f6906ffd640 1 --2- 172.21.15.90:0/4057389176 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f68f4077f70 0x7f68f407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:16.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.907+0000 7f6906ffd640 1 --2- 172.21.15.90:0/4057389176 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f68f4077f70 0x7f68f407a430 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009f60 tx=0x7f68f80094f0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:16.911+0000 7f68effff640 1 -- 172.21.15.90:0/4057389176 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6900083b00 con 0x7f690815e310 2024-09-10T23:18:17.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.088+0000 7f690d9c6640 1 -- 172.21.15.90:0/4057389176 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f69080d4610 con 0x7f690815e310 2024-09-10T23:18:17.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.089+0000 7f68effff640 1 -- 172.21.15.90:0/4057389176 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v100) ==== 84+0+65 (secure 0 0 0) 0x7f6900083400 con 0x7f690815e310 2024-09-10T23:18:17.091 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:17.091 INFO:teuthology.orchestra.run.smithi090.stdout:[ 2024-09-10T23:18:17.091 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:17.091 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 1, 2024-09-10T23:18:17.091 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": ".mgr" 2024-09-10T23:18:17.091 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:17.091 INFO:teuthology.orchestra.run.smithi090.stdout:] 2024-09-10T23:18:17.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.091+0000 7f690d9c6640 1 -- 172.21.15.90:0/4057389176 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f68f4077f70 msgr2=0x7f68f407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:17.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.091+0000 7f690d9c6640 1 --2- 172.21.15.90:0/4057389176 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f68f4077f70 0x7f68f407a430 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009f60 tx=0x7f68f80094f0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.091+0000 7f690d9c6640 1 -- 172.21.15.90:0/4057389176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f690815e310 msgr2=0x7f69080c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:17.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.091+0000 7f690d9c6640 1 --2- 172.21.15.90:0/4057389176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f690815e310 0x7f69080c9260 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f69000099c0 tx=0x7f6900003960 comp rx=0 tx=0).stop 2024-09-10T23:18:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.091+0000 7f690d9c6640 1 -- 172.21.15.90:0/4057389176 shutdown_connections 2024-09-10T23:18:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.091+0000 7f690d9c6640 1 --2- 172.21.15.90:0/4057389176 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f68f4077f70 0x7f68f407a430 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.091+0000 7f690d9c6640 1 --2- 172.21.15.90:0/4057389176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f690815e310 0x7f69080c9260 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.091+0000 7f690d9c6640 1 --2- 172.21.15.90:0/4057389176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69080d16f0 0x7f69080cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.091+0000 7f690d9c6640 1 --2- 172.21.15.90:0/4057389176 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69080d1190 0x7f69081f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.091+0000 7f690d9c6640 1 -- 172.21.15.90:0/4057389176 >> 172.21.15.90:0/4057389176 conn(0x7f69080d4090 msgr2=0x7f69080b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.091+0000 7f690d9c6640 1 -- 172.21.15.90:0/4057389176 shutdown_connections 2024-09-10T23:18:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.091+0000 7f690d9c6640 1 -- 172.21.15.90:0/4057389176 wait complete. 2024-09-10T23:18:17.104 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:18:17.104 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:18:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.208+0000 7fe0ecefe640 1 -- 172.21.15.90:0/1987443109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0e80cb640 msgr2=0x7fe0e815eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.208+0000 7fe0ecefe640 1 --2- 172.21.15.90:0/1987443109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0e80cb640 0x7fe0e815eb40 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc005fd0 tx=0x7fe0dc02a530 comp rx=0 tx=0).stop 2024-09-10T23:18:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.208+0000 7fe0ecefe640 1 -- 172.21.15.90:0/1987443109 shutdown_connections 2024-09-10T23:18:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.208+0000 7fe0ecefe640 1 --2- 172.21.15.90:0/1987443109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0e815f080 0x7fe0e80ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.208+0000 7fe0ecefe640 1 --2- 172.21.15.90:0/1987443109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0e80cb640 0x7fe0e815eb40 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.208+0000 7fe0ecefe640 1 -- 172.21.15.90:0/1987443109 >> 172.21.15.90:0/1987443109 conn(0x7fe0e80b2180 msgr2=0x7fe0e80b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:17.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.208+0000 7fe0ecefe640 1 -- 172.21.15.90:0/1987443109 shutdown_connections 2024-09-10T23:18:17.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.208+0000 7fe0ecefe640 1 -- 172.21.15.90:0/1987443109 wait complete. 2024-09-10T23:18:17.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.209+0000 7fe0ecefe640 1 Processor -- start 2024-09-10T23:18:17.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.209+0000 7fe0ecefe640 1 -- start start 2024-09-10T23:18:17.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.210+0000 7fe0ecefe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0e80733e0 0x7fe0e81508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:17.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.210+0000 7fe0ecefe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0e80cb640 0x7fe0e80c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:17.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.210+0000 7fe0ecefe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0e815f080 0x7fe0e80b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:17.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.210+0000 7fe0ecefe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e80cea50 con 0x7fe0e815f080 2024-09-10T23:18:17.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.210+0000 7fe0ecefe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e80ce8d0 con 0x7fe0e80733e0 2024-09-10T23:18:17.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.210+0000 7fe0ecefe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e80cebd0 con 0x7fe0e80cb640 2024-09-10T23:18:17.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.210+0000 7fe0e6d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0e815f080 0x7fe0e80b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:17.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.210+0000 7fe0e6d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0e815f080 0x7fe0e80b58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55134/0 (socket says 172.21.15.90:55134) 2024-09-10T23:18:17.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.210+0000 7fe0e6d9d640 1 -- 172.21.15.90:0/1793885654 learned_addr learned my addr 172.21.15.90:0/1793885654 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:17.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.210+0000 7fe0e659c640 1 --2- 172.21.15.90:0/1793885654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0e80733e0 0x7fe0e81508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:17.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.210+0000 7fe0e5d9b640 1 --2- 172.21.15.90:0/1793885654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0e80cb640 0x7fe0e80c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:17.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.210+0000 7fe0e6d9d640 1 -- 172.21.15.90:0/1793885654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0e80cb640 msgr2=0x7fe0e80c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:17.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.210+0000 7fe0e6d9d640 1 --2- 172.21.15.90:0/1793885654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0e80cb640 0x7fe0e80c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.210+0000 7fe0e6d9d640 1 -- 172.21.15.90:0/1793885654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0e80733e0 msgr2=0x7fe0e81508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:17.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.210+0000 7fe0e6d9d640 1 --2- 172.21.15.90:0/1793885654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0e80733e0 0x7fe0e81508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.211+0000 7fe0e6d9d640 1 -- 172.21.15.90:0/1793885654 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e80ca7e0 con 0x7fe0e815f080 2024-09-10T23:18:17.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.211+0000 7fe0e6d9d640 1 --2- 172.21.15.90:0/1793885654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0e815f080 0x7fe0e80b58e0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000b410 tx=0x7fe0e000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:17.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.211+0000 7fe0d6ffd640 1 -- 172.21.15.90:0/1793885654 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0015020 con 0x7fe0e815f080 2024-09-10T23:18:17.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.211+0000 7fe0d6ffd640 1 -- 172.21.15.90:0/1793885654 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0e0011940 con 0x7fe0e815f080 2024-09-10T23:18:17.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.211+0000 7fe0ecefe640 1 -- 172.21.15.90:0/1793885654 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e81f8740 con 0x7fe0e815f080 2024-09-10T23:18:17.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.211+0000 7fe0d6ffd640 1 -- 172.21.15.90:0/1793885654 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0011d90 con 0x7fe0e815f080 2024-09-10T23:18:17.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.211+0000 7fe0ecefe640 1 -- 172.21.15.90:0/1793885654 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e81f8d00 con 0x7fe0e815f080 2024-09-10T23:18:17.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.212+0000 7fe0ecefe640 1 -- 172.21.15.90:0/1793885654 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e806a430 con 0x7fe0e815f080 2024-09-10T23:18:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.213+0000 7fe0d6ffd640 1 -- 172.21.15.90:0/1793885654 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe0e001a400 con 0x7fe0e815f080 2024-09-10T23:18:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.213+0000 7fe0d6ffd640 1 --2- 172.21.15.90:0/1793885654 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe0c8077f70 0x7fe0c807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.213+0000 7fe0d6ffd640 1 -- 172.21.15.90:0/1793885654 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 4857+0+0 (secure 0 0 0) 0x7fe0e0099b80 con 0x7fe0e815f080 2024-09-10T23:18:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.213+0000 7fe0e659c640 1 --2- 172.21.15.90:0/1793885654 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe0c8077f70 0x7fe0c807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:17.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.214+0000 7fe0e659c640 1 --2- 172.21.15.90:0/1793885654 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe0c8077f70 0x7fe0c807a430 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8005520 tx=0x7fe0d8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:17.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.217+0000 7fe0d6ffd640 1 -- 172.21.15.90:0/1793885654 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe0e001f020 con 0x7fe0e815f080 2024-09-10T23:18:17.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.392+0000 7fe0ecefe640 1 -- 172.21.15.90:0/1793885654 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe0e80cf0c0 con 0x7fe0e815f080 2024-09-10T23:18:17.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.796+0000 7fe0d6ffd640 1 -- 172.21.15.90:0/1793885654 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v101) ==== 138+0+0 (secure 0 0 0) 0x7fe0e0062a60 con 0x7fe0e815f080 2024-09-10T23:18:17.798 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' created 2024-09-10T23:18:17.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.800+0000 7fe0ecefe640 1 -- 172.21.15.90:0/1793885654 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe0c8077f70 msgr2=0x7fe0c807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:17.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.800+0000 7fe0ecefe640 1 --2- 172.21.15.90:0/1793885654 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe0c8077f70 0x7fe0c807a430 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8005520 tx=0x7fe0d8009040 comp rx=0 tx=0).stop 2024-09-10T23:18:17.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.800+0000 7fe0ecefe640 1 -- 172.21.15.90:0/1793885654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0e815f080 msgr2=0x7fe0e80b58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:17.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.800+0000 7fe0ecefe640 1 --2- 172.21.15.90:0/1793885654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0e815f080 0x7fe0e80b58e0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000b410 tx=0x7fe0e000b8d0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.800+0000 7fe0ecefe640 1 -- 172.21.15.90:0/1793885654 shutdown_connections 2024-09-10T23:18:17.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.800+0000 7fe0ecefe640 1 --2- 172.21.15.90:0/1793885654 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe0c8077f70 0x7fe0c807a430 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.800+0000 7fe0ecefe640 1 --2- 172.21.15.90:0/1793885654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0e815f080 0x7fe0e80b58e0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.800+0000 7fe0ecefe640 1 --2- 172.21.15.90:0/1793885654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0e80cb640 0x7fe0e80c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.800+0000 7fe0ecefe640 1 --2- 172.21.15.90:0/1793885654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0e80733e0 0x7fe0e81508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.800+0000 7fe0ecefe640 1 -- 172.21.15.90:0/1793885654 >> 172.21.15.90:0/1793885654 conn(0x7fe0e80b2180 msgr2=0x7fe0e815cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:17.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.801+0000 7fe0ecefe640 1 -- 172.21.15.90:0/1793885654 shutdown_connections 2024-09-10T23:18:17.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.801+0000 7fe0ecefe640 1 -- 172.21.15.90:0/1793885654 wait complete. 2024-09-10T23:18:17.817 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:18:17.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.924+0000 7f43ce552640 1 -- 172.21.15.90:0/1168044758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c815b740 msgr2=0x7f43c806ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:17.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.924+0000 7f43ce552640 1 --2- 172.21.15.90:0/1168044758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c815b740 0x7f43c806ecb0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f43bc005fd0 tx=0x7f43bc02a5d0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.924+0000 7f43ce552640 1 -- 172.21.15.90:0/1168044758 shutdown_connections 2024-09-10T23:18:17.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.924+0000 7f43ce552640 1 --2- 172.21.15.90:0/1168044758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c815b740 0x7f43c806ecb0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.924+0000 7f43ce552640 1 --2- 172.21.15.90:0/1168044758 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c815f1e0 0x7f43c815b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.924+0000 7f43ce552640 1 -- 172.21.15.90:0/1168044758 >> 172.21.15.90:0/1168044758 conn(0x7f43c80697a0 msgr2=0x7f43c806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:17.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.924+0000 7f43ce552640 1 -- 172.21.15.90:0/1168044758 shutdown_connections 2024-09-10T23:18:17.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.924+0000 7f43ce552640 1 -- 172.21.15.90:0/1168044758 wait complete. 2024-09-10T23:18:17.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.925+0000 7f43ce552640 1 Processor -- start 2024-09-10T23:18:17.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.925+0000 7f43ce552640 1 -- start start 2024-09-10T23:18:17.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.926+0000 7f43ce552640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c806f1f0 0x7f43c8145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:17.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.926+0000 7f43ce552640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c815b740 0x7f43c8157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:17.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.926+0000 7f43ce552640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c815f1e0 0x7f43c8157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:17.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.926+0000 7f43ce552640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f43c8073640 con 0x7f43c806f1f0 2024-09-10T23:18:17.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.926+0000 7f43ce552640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f43c80d0090 con 0x7f43c815f1e0 2024-09-10T23:18:17.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.926+0000 7f43ce552640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f43c80737c0 con 0x7f43c815b740 2024-09-10T23:18:17.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.926+0000 7f43c7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c806f1f0 0x7f43c8145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:17.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.926+0000 7f43c7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c806f1f0 0x7f43c8145c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55148/0 (socket says 172.21.15.90:55148) 2024-09-10T23:18:17.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.926+0000 7f43c7fff640 1 -- 172.21.15.90:0/1408283455 learned_addr learned my addr 172.21.15.90:0/1408283455 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:17.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.927+0000 7f43ccaef640 1 --2- 172.21.15.90:0/1408283455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c815f1e0 0x7f43c8157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:17.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.927+0000 7f43c77fe640 1 --2- 172.21.15.90:0/1408283455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c815b740 0x7f43c8157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:17.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.927+0000 7f43c7fff640 1 -- 172.21.15.90:0/1408283455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c815b740 msgr2=0x7f43c8157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:17.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.927+0000 7f43c7fff640 1 --2- 172.21.15.90:0/1408283455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c815b740 0x7f43c8157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.927+0000 7f43c7fff640 1 -- 172.21.15.90:0/1408283455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c815f1e0 msgr2=0x7f43c8157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:17.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.927+0000 7f43c7fff640 1 --2- 172.21.15.90:0/1408283455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c815f1e0 0x7f43c8157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:17.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.927+0000 7f43c7fff640 1 -- 172.21.15.90:0/1408283455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c81494b0 con 0x7f43c806f1f0 2024-09-10T23:18:17.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.927+0000 7f43ccaef640 1 --2- 172.21.15.90:0/1408283455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c815f1e0 0x7f43c8157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:17.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.927+0000 7f43c77fe640 1 --2- 172.21.15.90:0/1408283455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c815b740 0x7f43c8157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:17.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.927+0000 7f43c7fff640 1 --2- 172.21.15.90:0/1408283455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c806f1f0 0x7f43c8145c20 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f43b800d6d0 tx=0x7f43b800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:17.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.927+0000 7f43c4ff9640 1 -- 172.21.15.90:0/1408283455 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b8017070 con 0x7f43c806f1f0 2024-09-10T23:18:17.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.927+0000 7f43c4ff9640 1 -- 172.21.15.90:0/1408283455 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43b8005330 con 0x7f43c806f1f0 2024-09-10T23:18:17.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.927+0000 7f43c4ff9640 1 -- 172.21.15.90:0/1408283455 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b8009820 con 0x7f43c806f1f0 2024-09-10T23:18:17.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.927+0000 7f43ce552640 1 -- 172.21.15.90:0/1408283455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c81486f0 con 0x7f43c806f1f0 2024-09-10T23:18:17.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.927+0000 7f43ce552640 1 -- 172.21.15.90:0/1408283455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c8148cb0 con 0x7f43c806f1f0 2024-09-10T23:18:17.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.928+0000 7f43ce552640 1 -- 172.21.15.90:0/1408283455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c806a430 con 0x7f43c806f1f0 2024-09-10T23:18:17.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.929+0000 7f43c4ff9640 1 -- 172.21.15.90:0/1408283455 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f43b8009bd0 con 0x7f43c806f1f0 2024-09-10T23:18:17.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.929+0000 7f43c4ff9640 1 --2- 172.21.15.90:0/1408283455 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f43b4077f70 0x7f43b407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:17.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.929+0000 7f43c4ff9640 1 -- 172.21.15.90:0/1408283455 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5227+0+0 (secure 0 0 0) 0x7f43b8099e40 con 0x7f43c806f1f0 2024-09-10T23:18:17.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.929+0000 7f43c77fe640 1 --2- 172.21.15.90:0/1408283455 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f43b4077f70 0x7f43b407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:17.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.930+0000 7f43c77fe640 1 --2- 172.21.15.90:0/1408283455 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f43b4077f70 0x7f43b407a430 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f43bc033000 tx=0x7f43bc004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:17.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:17.933+0000 7f43c4ff9640 1 -- 172.21.15.90:0/1408283455 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f43b8062bb0 con 0x7f43c806f1f0 2024-09-10T23:18:18.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.108+0000 7f43ce552640 1 -- 172.21.15.90:0/1408283455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f43c8069fe0 con 0x7f43c806f1f0 2024-09-10T23:18:18.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.802+0000 7f43c4ff9640 1 -- 172.21.15.90:0/1408283455 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v102) ==== 170+0+0 (secure 0 0 0) 0x7f43c8069fe0 con 0x7f43c806f1f0 2024-09-10T23:18:18.804 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' created 2024-09-10T23:18:18.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.804+0000 7f43ce552640 1 -- 172.21.15.90:0/1408283455 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f43b4077f70 msgr2=0x7f43b407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:18.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.804+0000 7f43ce552640 1 --2- 172.21.15.90:0/1408283455 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f43b4077f70 0x7f43b407a430 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f43bc033000 tx=0x7f43bc004730 comp rx=0 tx=0).stop 2024-09-10T23:18:18.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.804+0000 7f43ce552640 1 -- 172.21.15.90:0/1408283455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c806f1f0 msgr2=0x7f43c8145c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:18.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.804+0000 7f43ce552640 1 --2- 172.21.15.90:0/1408283455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c806f1f0 0x7f43c8145c20 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f43b800d6d0 tx=0x7f43b800db90 comp rx=0 tx=0).stop 2024-09-10T23:18:18.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.804+0000 7f43ce552640 1 -- 172.21.15.90:0/1408283455 shutdown_connections 2024-09-10T23:18:18.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.804+0000 7f43ce552640 1 --2- 172.21.15.90:0/1408283455 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f43b4077f70 0x7f43b407a430 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:18.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.804+0000 7f43ce552640 1 --2- 172.21.15.90:0/1408283455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c815f1e0 0x7f43c8157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:18.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.804+0000 7f43ce552640 1 --2- 172.21.15.90:0/1408283455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c815b740 0x7f43c8157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:18.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.804+0000 7f43ce552640 1 --2- 172.21.15.90:0/1408283455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43c806f1f0 0x7f43c8145c20 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:18.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.804+0000 7f43ce552640 1 -- 172.21.15.90:0/1408283455 >> 172.21.15.90:0/1408283455 conn(0x7f43c80697a0 msgr2=0x7f43c80b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:18.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.804+0000 7f43ce552640 1 -- 172.21.15.90:0/1408283455 shutdown_connections 2024-09-10T23:18:18.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.804+0000 7f43ce552640 1 -- 172.21.15.90:0/1408283455 wait complete. 2024-09-10T23:18:18.825 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:18:18.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.928+0000 7fc45c375640 1 -- 172.21.15.90:0/2077157109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4540b44a0 msgr2=0x7fc4540b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:18.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.928+0000 7fc45c375640 1 --2- 172.21.15.90:0/2077157109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4540b44a0 0x7fc4540b4880 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fc4540cda30 tx=0x7fc45002a4d0 comp rx=0 tx=0).stop 2024-09-10T23:18:18.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.929+0000 7fc45c375640 1 -- 172.21.15.90:0/2077157109 shutdown_connections 2024-09-10T23:18:18.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.929+0000 7fc45c375640 1 --2- 172.21.15.90:0/2077157109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4540cd470 0x7fc45415e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:18.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.929+0000 7fc45c375640 1 --2- 172.21.15.90:0/2077157109 >> v2:172.21.15.171:3300/0 conn(0x7fc4540cf860 0x7fc45415e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:18.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.929+0000 7fc45c375640 1 --2- 172.21.15.90:0/2077157109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4540b44a0 0x7fc4540b4880 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:18.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.929+0000 7fc45c375640 1 -- 172.21.15.90:0/2077157109 >> 172.21.15.90:0/2077157109 conn(0x7fc4540b19c0 msgr2=0x7fc4540b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:18.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.929+0000 7fc45c375640 1 -- 172.21.15.90:0/2077157109 shutdown_connections 2024-09-10T23:18:18.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.929+0000 7fc45c375640 1 -- 172.21.15.90:0/2077157109 wait complete. 2024-09-10T23:18:18.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.930+0000 7fc45c375640 1 Processor -- start 2024-09-10T23:18:18.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.930+0000 7fc45c375640 1 -- start start 2024-09-10T23:18:18.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.930+0000 7fc45c375640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4540b44a0 0x7fc45409d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:18.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.930+0000 7fc45c375640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4540cd470 0x7fc45414e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:18.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.930+0000 7fc45c375640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4540cf860 0x7fc4541f5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:18.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.930+0000 7fc45c375640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc45406e870 con 0x7fc4540b44a0 2024-09-10T23:18:18.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.930+0000 7fc45c375640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc45406e6f0 con 0x7fc4540cf860 2024-09-10T23:18:18.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.930+0000 7fc45c375640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc45415a8c0 con 0x7fc4540cd470 2024-09-10T23:18:18.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.931+0000 7fc45a111640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4540b44a0 0x7fc45409d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:18.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.931+0000 7fc45a111640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4540b44a0 0x7fc45409d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56238/0 (socket says 172.21.15.90:56238) 2024-09-10T23:18:18.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.931+0000 7fc45a111640 1 -- 172.21.15.90:0/1659013698 learned_addr learned my addr 172.21.15.90:0/1659013698 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:18.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.931+0000 7fc45a912640 1 --2- 172.21.15.90:0/1659013698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4540cf860 0x7fc4541f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:18.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.931+0000 7fc459910640 1 --2- 172.21.15.90:0/1659013698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4540cd470 0x7fc45414e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:18.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.931+0000 7fc45a111640 1 -- 172.21.15.90:0/1659013698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4540cd470 msgr2=0x7fc45414e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:18.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.931+0000 7fc45a111640 1 --2- 172.21.15.90:0/1659013698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4540cd470 0x7fc45414e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:18.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.931+0000 7fc45a111640 1 -- 172.21.15.90:0/1659013698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4540cf860 msgr2=0x7fc4541f5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:18.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.931+0000 7fc45a111640 1 --2- 172.21.15.90:0/1659013698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4540cf860 0x7fc4541f5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:18.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.931+0000 7fc45a111640 1 -- 172.21.15.90:0/1659013698 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc454152ae0 con 0x7fc4540b44a0 2024-09-10T23:18:18.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.931+0000 7fc45a111640 1 --2- 172.21.15.90:0/1659013698 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4540b44a0 0x7fc45409d030 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fc450009850 tx=0x7fc450003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:18.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.931+0000 7fc44affd640 1 -- 172.21.15.90:0/1659013698 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450035070 con 0x7fc4540b44a0 2024-09-10T23:18:18.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.931+0000 7fc44affd640 1 -- 172.21.15.90:0/1659013698 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc450003c90 con 0x7fc4540b44a0 2024-09-10T23:18:18.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.931+0000 7fc45c375640 1 -- 172.21.15.90:0/1659013698 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4541e5970 con 0x7fc4540b44a0 2024-09-10T23:18:18.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.931+0000 7fc44affd640 1 -- 172.21.15.90:0/1659013698 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4500047a0 con 0x7fc4540b44a0 2024-09-10T23:18:18.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.931+0000 7fc45c375640 1 -- 172.21.15.90:0/1659013698 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4541e5690 con 0x7fc4540b44a0 2024-09-10T23:18:18.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.932+0000 7fc45c375640 1 -- 172.21.15.90:0/1659013698 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4540cc480 con 0x7fc4540b44a0 2024-09-10T23:18:18.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.933+0000 7fc44affd640 1 -- 172.21.15.90:0/1659013698 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc450004940 con 0x7fc4540b44a0 2024-09-10T23:18:18.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.933+0000 7fc44affd640 1 --2- 172.21.15.90:0/1659013698 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc438077f70 0x7fc43807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:18.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.933+0000 7fc44affd640 1 -- 172.21.15.90:0/1659013698 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5609+0+0 (secure 0 0 0) 0x7fc4500bc210 con 0x7fc4540b44a0 2024-09-10T23:18:18.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.934+0000 7fc459910640 1 --2- 172.21.15.90:0/1659013698 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc438077f70 0x7fc43807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:18.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.934+0000 7fc459910640 1 --2- 172.21.15.90:0/1659013698 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc438077f70 0x7fc43807a430 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc4541e6f30 tx=0x7fc44400b2e0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:18.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:18.938+0000 7fc44affd640 1 -- 172.21.15.90:0/1659013698 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc454152ae0 con 0x7fc4540b44a0 2024-09-10T23:18:19.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.147+0000 7fc45c375640 1 -- 172.21.15.90:0/1659013698 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc454157db0 con 0x7fc4540b44a0 2024-09-10T23:18:19.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.803+0000 7fc44affd640 1 -- 172.21.15.90:0/1659013698 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v55) ==== 174+0+0 (secure 0 0 0) 0x7fc4500847b0 con 0x7fc4540b44a0 2024-09-10T23:18:19.805 INFO:teuthology.orchestra.run.smithi090.stderr:new fs with metadata pool 16 and data pool 17 2024-09-10T23:18:19.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.805+0000 7fc45c375640 1 -- 172.21.15.90:0/1659013698 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc438077f70 msgr2=0x7fc43807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:19.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.805+0000 7fc45c375640 1 --2- 172.21.15.90:0/1659013698 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc438077f70 0x7fc43807a430 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc4541e6f30 tx=0x7fc44400b2e0 comp rx=0 tx=0).stop 2024-09-10T23:18:19.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.805+0000 7fc45c375640 1 -- 172.21.15.90:0/1659013698 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4540b44a0 msgr2=0x7fc45409d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:19.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.805+0000 7fc45c375640 1 --2- 172.21.15.90:0/1659013698 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4540b44a0 0x7fc45409d030 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fc450009850 tx=0x7fc450003890 comp rx=0 tx=0).stop 2024-09-10T23:18:19.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.805+0000 7fc45c375640 1 -- 172.21.15.90:0/1659013698 shutdown_connections 2024-09-10T23:18:19.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.805+0000 7fc45c375640 1 --2- 172.21.15.90:0/1659013698 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc438077f70 0x7fc43807a430 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:19.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.805+0000 7fc45c375640 1 --2- 172.21.15.90:0/1659013698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4540cf860 0x7fc4541f5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:19.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.805+0000 7fc45c375640 1 --2- 172.21.15.90:0/1659013698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4540cd470 0x7fc45414e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:19.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.805+0000 7fc45c375640 1 --2- 172.21.15.90:0/1659013698 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4540b44a0 0x7fc45409d030 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:19.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.805+0000 7fc45c375640 1 -- 172.21.15.90:0/1659013698 >> 172.21.15.90:0/1659013698 conn(0x7fc4540b19c0 msgr2=0x7fc4540aed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:19.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.805+0000 7fc45c375640 1 -- 172.21.15.90:0/1659013698 shutdown_connections 2024-09-10T23:18:19.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.805+0000 7fc45c375640 1 -- 172.21.15.90:0/1659013698 wait complete. 2024-09-10T23:18:19.828 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:18:19.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.930+0000 7f22b74fe640 1 -- 172.21.15.90:0/3128911394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22b006fc60 msgr2=0x7f22b00cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:19.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.930+0000 7f22b74fe640 1 --2- 172.21.15.90:0/3128911394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22b006fc60 0x7f22b00cdfd0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f22a8005fd0 tx=0x7f22a802aa90 comp rx=0 tx=0).stop 2024-09-10T23:18:19.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.930+0000 7f22b74fe640 1 -- 172.21.15.90:0/3128911394 shutdown_connections 2024-09-10T23:18:19.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.930+0000 7f22b74fe640 1 --2- 172.21.15.90:0/3128911394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22b006fc60 0x7f22b00cdfd0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:19.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.930+0000 7f22b74fe640 1 -- 172.21.15.90:0/3128911394 >> 172.21.15.90:0/3128911394 conn(0x7f22b00b19c0 msgr2=0x7f22b00b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:19.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.930+0000 7f22b74fe640 1 -- 172.21.15.90:0/3128911394 shutdown_connections 2024-09-10T23:18:19.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.930+0000 7f22b74fe640 1 -- 172.21.15.90:0/3128911394 wait complete. 2024-09-10T23:18:19.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.931+0000 7f22b74fe640 1 Processor -- start 2024-09-10T23:18:19.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.931+0000 7f22b74fe640 1 -- start start 2024-09-10T23:18:19.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.932+0000 7f22b74fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22b006fc60 0x7f22b0149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:19.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.932+0000 7f22b74fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22b00cdb90 0x7f22b015e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:19.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.932+0000 7f22b74fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22b015f750 0x7f22b015e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:19.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.932+0000 7f22b74fe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f22b0167480 con 0x7f22b015f750 2024-09-10T23:18:19.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.932+0000 7f22b74fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f22b0167300 con 0x7f22b006fc60 2024-09-10T23:18:19.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.932+0000 7f22b74fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f22b0167600 con 0x7f22b00cdb90 2024-09-10T23:18:19.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.932+0000 7f22b5a9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22b015f750 0x7f22b015e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:19.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.932+0000 7f22b5a9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22b015f750 0x7f22b015e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56268/0 (socket says 172.21.15.90:56268) 2024-09-10T23:18:19.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.932+0000 7f22b5a9b640 1 -- 172.21.15.90:0/1490017145 learned_addr learned my addr 172.21.15.90:0/1490017145 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:19.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.932+0000 7f22b5a9b640 1 -- 172.21.15.90:0/1490017145 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22b00cdb90 msgr2=0x7f22b015e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:19.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.932+0000 7f22b5a9b640 1 --2- 172.21.15.90:0/1490017145 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22b00cdb90 0x7f22b015e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:19.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.932+0000 7f22b5a9b640 1 -- 172.21.15.90:0/1490017145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22b006fc60 msgr2=0x7f22b0149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:19.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.932+0000 7f22b529a640 1 --2- 172.21.15.90:0/1490017145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22b006fc60 0x7f22b0149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:19.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.933+0000 7f22b5a9b640 1 --2- 172.21.15.90:0/1490017145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22b006fc60 0x7f22b0149260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:19.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.933+0000 7f22b5a9b640 1 -- 172.21.15.90:0/1490017145 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b015cf90 con 0x7f22b015f750 2024-09-10T23:18:19.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.933+0000 7f22b5a9b640 1 --2- 172.21.15.90:0/1490017145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22b015f750 0x7f22b015e9f0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009d90 tx=0x7f22a8003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:19.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.933+0000 7f22adffb640 1 -- 172.21.15.90:0/1490017145 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a8046070 con 0x7f22b015f750 2024-09-10T23:18:19.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.933+0000 7f22adffb640 1 -- 172.21.15.90:0/1490017145 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22a8004250 con 0x7f22b015f750 2024-09-10T23:18:19.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.933+0000 7f22adffb640 1 -- 172.21.15.90:0/1490017145 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a8004660 con 0x7f22b015f750 2024-09-10T23:18:19.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.933+0000 7f22b74fe640 1 -- 172.21.15.90:0/1490017145 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b015d270 con 0x7f22b015f750 2024-09-10T23:18:19.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.933+0000 7f22b74fe640 1 -- 172.21.15.90:0/1490017145 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b015d830 con 0x7f22b015f750 2024-09-10T23:18:19.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.934+0000 7f22b74fe640 1 -- 172.21.15.90:0/1490017145 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b015cd20 con 0x7f22b015f750 2024-09-10T23:18:19.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.935+0000 7f22adffb640 1 -- 172.21.15.90:0/1490017145 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f22a8036400 con 0x7f22b015f750 2024-09-10T23:18:19.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.935+0000 7f22adffb640 1 --2- 172.21.15.90:0/1490017145 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f229c077f70 0x7f229c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:19.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.935+0000 7f22adffb640 1 -- 172.21.15.90:0/1490017145 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f22a80bafc0 con 0x7f22b015f750 2024-09-10T23:18:19.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.936+0000 7f22b529a640 1 --2- 172.21.15.90:0/1490017145 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f229c077f70 0x7f229c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:19.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.936+0000 7f22b529a640 1 --2- 172.21.15.90:0/1490017145 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f229c077f70 0x7f229c07a430 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f22a0000f60 tx=0x7f22a0009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:19.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:19.939+0000 7f22adffb640 1 -- 172.21.15.90:0/1490017145 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f22a8032030 con 0x7f22b015f750 2024-09-10T23:18:20.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.112+0000 7f22b74fe640 1 -- 172.21.15.90:0/1490017145 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22b00cdfd0 con 0x7f22b015f750 2024-09-10T23:18:20.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.114+0000 7f22adffb640 1 -- 172.21.15.90:0/1490017145 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16700 (secure 0 0 0) 0x7f22a8083ac0 con 0x7f22b015f750 2024-09-10T23:18:20.116 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:20.116 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":103,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:18:19.149650+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:18:17.397925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-10T23:18:18.113855+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:18:20.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.116+0000 7f22b74fe640 1 -- 172.21.15.90:0/1490017145 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f229c077f70 msgr2=0x7f229c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:20.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.116+0000 7f22b74fe640 1 --2- 172.21.15.90:0/1490017145 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f229c077f70 0x7f229c07a430 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f22a0000f60 tx=0x7f22a0009040 comp rx=0 tx=0).stop 2024-09-10T23:18:20.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.116+0000 7f22b74fe640 1 -- 172.21.15.90:0/1490017145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22b015f750 msgr2=0x7f22b015e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:20.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.116+0000 7f22b74fe640 1 --2- 172.21.15.90:0/1490017145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22b015f750 0x7f22b015e9f0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009d90 tx=0x7f22a8003ce0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.116+0000 7f22b74fe640 1 -- 172.21.15.90:0/1490017145 shutdown_connections 2024-09-10T23:18:20.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.116+0000 7f22b74fe640 1 --2- 172.21.15.90:0/1490017145 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f229c077f70 0x7f229c07a430 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.116+0000 7f22b74fe640 1 --2- 172.21.15.90:0/1490017145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22b015f750 0x7f22b015e9f0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.116+0000 7f22b74fe640 1 --2- 172.21.15.90:0/1490017145 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22b00cdb90 0x7f22b015e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.116+0000 7f22b74fe640 1 --2- 172.21.15.90:0/1490017145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22b006fc60 0x7f22b0149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.116+0000 7f22b74fe640 1 -- 172.21.15.90:0/1490017145 >> 172.21.15.90:0/1490017145 conn(0x7f22b00b19c0 msgr2=0x7f22b0075890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:20.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.116+0000 7f22b74fe640 1 -- 172.21.15.90:0/1490017145 shutdown_connections 2024-09-10T23:18:20.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.116+0000 7f22b74fe640 1 -- 172.21.15.90:0/1490017145 wait complete. 2024-09-10T23:18:20.129 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:18:20.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.228+0000 7f8493f17640 1 -- 172.21.15.90:0/832599235 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848c06f1f0 msgr2=0x7f848c072f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:20.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.228+0000 7f8493f17640 1 --2- 172.21.15.90:0/832599235 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848c06f1f0 0x7f848c072f30 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f848c073fd0 tx=0x7f848402aa50 comp rx=0 tx=0).stop 2024-09-10T23:18:20.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.228+0000 7f8493f17640 1 -- 172.21.15.90:0/832599235 shutdown_connections 2024-09-10T23:18:20.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.228+0000 7f8493f17640 1 --2- 172.21.15.90:0/832599235 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848c06f1f0 0x7f848c072f30 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.228+0000 7f8493f17640 1 --2- 172.21.15.90:0/832599235 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f848c15b740 0x7f848c06ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.228+0000 7f8493f17640 1 --2- 172.21.15.90:0/832599235 >> v2:172.21.15.171:3300/0 conn(0x7f848c15f1e0 0x7f848c15b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.228+0000 7f8493f17640 1 -- 172.21.15.90:0/832599235 >> 172.21.15.90:0/832599235 conn(0x7f848c0697a0 msgr2=0x7f848c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:20.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.228+0000 7f8493f17640 1 -- 172.21.15.90:0/832599235 shutdown_connections 2024-09-10T23:18:20.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.228+0000 7f8493f17640 1 -- 172.21.15.90:0/832599235 wait complete. 2024-09-10T23:18:20.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.229+0000 7f8493f17640 1 Processor -- start 2024-09-10T23:18:20.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.229+0000 7f8493f17640 1 -- start start 2024-09-10T23:18:20.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f8493f17640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f848c06f1f0 0x7f848c13afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:20.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f8493f17640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f848c15b740 0x7f848c0b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:20.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f8493f17640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848c15f1e0 0x7f848c0b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:20.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f8493f17640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f848c073800 con 0x7f848c15f1e0 2024-09-10T23:18:20.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f8493f17640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f848c073680 con 0x7f848c06f1f0 2024-09-10T23:18:20.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f8493f17640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f848c073980 con 0x7f848c15b740 2024-09-10T23:18:20.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f84924b4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848c15f1e0 0x7f848c0b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:20.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f84924b4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848c15f1e0 0x7f848c0b1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56280/0 (socket says 172.21.15.90:56280) 2024-09-10T23:18:20.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f84924b4640 1 -- 172.21.15.90:0/1380915053 learned_addr learned my addr 172.21.15.90:0/1380915053 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:20.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f8491cb3640 1 --2- 172.21.15.90:0/1380915053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f848c06f1f0 0x7f848c13afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:20.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f84914b2640 1 --2- 172.21.15.90:0/1380915053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f848c15b740 0x7f848c0b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:20.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f84924b4640 1 -- 172.21.15.90:0/1380915053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f848c15b740 msgr2=0x7f848c0b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:20.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f84924b4640 1 --2- 172.21.15.90:0/1380915053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f848c15b740 0x7f848c0b19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f84924b4640 1 -- 172.21.15.90:0/1380915053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f848c06f1f0 msgr2=0x7f848c13afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:20.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f84924b4640 1 --2- 172.21.15.90:0/1380915053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f848c06f1f0 0x7f848c13afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f84924b4640 1 -- 172.21.15.90:0/1380915053 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848c155960 con 0x7f848c15f1e0 2024-09-10T23:18:20.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f84914b2640 1 --2- 172.21.15.90:0/1380915053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f848c15b740 0x7f848c0b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:20.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f84924b4640 1 --2- 172.21.15.90:0/1380915053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848c15f1e0 0x7f848c0b1f10 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f8484006010 tx=0x7f8484003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:20.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f84827fc640 1 -- 172.21.15.90:0/1380915053 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484047070 con 0x7f848c15f1e0 2024-09-10T23:18:20.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f84827fc640 1 -- 172.21.15.90:0/1380915053 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8484004250 con 0x7f848c15f1e0 2024-09-10T23:18:20.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f8493f17640 1 -- 172.21.15.90:0/1380915053 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f848c155c00 con 0x7f848c15f1e0 2024-09-10T23:18:20.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.230+0000 7f84827fc640 1 -- 172.21.15.90:0/1380915053 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484033050 con 0x7f848c15f1e0 2024-09-10T23:18:20.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.231+0000 7f8493f17640 1 -- 172.21.15.90:0/1380915053 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f848c1561c0 con 0x7f848c15f1e0 2024-09-10T23:18:20.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.231+0000 7f8493f17640 1 -- 172.21.15.90:0/1380915053 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f848c06a430 con 0x7f848c15f1e0 2024-09-10T23:18:20.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.232+0000 7f84827fc640 1 -- 172.21.15.90:0/1380915053 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8484004660 con 0x7f848c15f1e0 2024-09-10T23:18:20.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.233+0000 7f84827fc640 1 --2- 172.21.15.90:0/1380915053 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8470077f70 0x7f847007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:20.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.233+0000 7f84827fc640 1 -- 172.21.15.90:0/1380915053 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f84840bb120 con 0x7f848c15f1e0 2024-09-10T23:18:20.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.233+0000 7f8491cb3640 1 --2- 172.21.15.90:0/1380915053 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8470077f70 0x7f847007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:20.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.233+0000 7f8491cb3640 1 --2- 172.21.15.90:0/1380915053 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8470077f70 0x7f847007a430 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f848800bb50 tx=0x7f848800b2e0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:20.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.238+0000 7f84827fc640 1 -- 172.21.15.90:0/1380915053 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8484083660 con 0x7f848c15f1e0 2024-09-10T23:18:20.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.412+0000 7f8493f17640 1 -- 172.21.15.90:0/1380915053 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f848c0cd7d0 con 0x7f848c15f1e0 2024-09-10T23:18:20.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.413+0000 7f84827fc640 1 -- 172.21.15.90:0/1380915053 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16700 (secure 0 0 0) 0x7f8484088090 con 0x7f848c15f1e0 2024-09-10T23:18:20.415 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:20.415 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":103,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:18:19.149650+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:18:17.397925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-10T23:18:18.113855+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:18:20.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.416+0000 7f8493f17640 1 -- 172.21.15.90:0/1380915053 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8470077f70 msgr2=0x7f847007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:20.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.416+0000 7f8493f17640 1 --2- 172.21.15.90:0/1380915053 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8470077f70 0x7f847007a430 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f848800bb50 tx=0x7f848800b2e0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.416+0000 7f8493f17640 1 -- 172.21.15.90:0/1380915053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848c15f1e0 msgr2=0x7f848c0b1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:20.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.416+0000 7f8493f17640 1 --2- 172.21.15.90:0/1380915053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848c15f1e0 0x7f848c0b1f10 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f8484006010 tx=0x7f8484003f10 comp rx=0 tx=0).stop 2024-09-10T23:18:20.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.416+0000 7f8493f17640 1 -- 172.21.15.90:0/1380915053 shutdown_connections 2024-09-10T23:18:20.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.416+0000 7f8493f17640 1 --2- 172.21.15.90:0/1380915053 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8470077f70 0x7f847007a430 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.416+0000 7f8493f17640 1 --2- 172.21.15.90:0/1380915053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f848c15f1e0 0x7f848c0b1f10 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.416+0000 7f8493f17640 1 --2- 172.21.15.90:0/1380915053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f848c15b740 0x7f848c0b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.416+0000 7f8493f17640 1 --2- 172.21.15.90:0/1380915053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f848c06f1f0 0x7f848c13afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.416+0000 7f8493f17640 1 -- 172.21.15.90:0/1380915053 >> 172.21.15.90:0/1380915053 conn(0x7f848c0697a0 msgr2=0x7f848c0cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:20.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.416+0000 7f8493f17640 1 -- 172.21.15.90:0/1380915053 shutdown_connections 2024-09-10T23:18:20.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.416+0000 7f8493f17640 1 -- 172.21.15.90:0/1380915053 wait complete. 2024-09-10T23:18:20.429 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:18:20.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.531+0000 7fcba2952640 1 -- 172.21.15.90:0/3504661610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb84004800 msgr2=0x7fcb84004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:20.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.531+0000 7fcba2952640 1 --2- 172.21.15.90:0/3504661610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb84004800 0x7fcb84004c80 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000bbe0 tx=0x7fcb84005830 comp rx=0 tx=0).stop 2024-09-10T23:18:20.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.531+0000 7fcba0eef640 1 -- 172.21.15.90:0/3504661610 reap_dead start 2024-09-10T23:18:20.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.532+0000 7fcba2952640 1 -- 172.21.15.90:0/3504661610 shutdown_connections 2024-09-10T23:18:20.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.532+0000 7fcba2952640 1 -- 172.21.15.90:0/3504661610 >> 172.21.15.90:0/3504661610 conn(0x7fcb9c0d4090 msgr2=0x7fcb9c0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:20.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.532+0000 7fcba2952640 1 -- 172.21.15.90:0/3504661610 shutdown_connections 2024-09-10T23:18:20.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.532+0000 7fcba2952640 1 -- 172.21.15.90:0/3504661610 wait complete. 2024-09-10T23:18:20.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.533+0000 7fcba2952640 1 Processor -- start 2024-09-10T23:18:20.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.533+0000 7fcba2952640 1 -- start start 2024-09-10T23:18:20.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcba2952640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb84004800 0x7fcb9c0c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:20.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcba2952640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb9c0b2030 0x7fcb9c1607b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:20.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcba2952640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb9c0b24b0 0x7fcb9c0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:20.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcba2952640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9c0d28c0 con 0x7fcb9c0b2030 2024-09-10T23:18:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcba2952640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9c0d4e40 con 0x7fcb84004800 2024-09-10T23:18:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcba2952640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcb9c0d2a40 con 0x7fcb9c0b24b0 2024-09-10T23:18:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcb9b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb9c0b2030 0x7fcb9c1607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcb9b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb9c0b2030 0x7fcb9c1607b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56300/0 (socket says 172.21.15.90:56300) 2024-09-10T23:18:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcb9b7fe640 1 -- 172.21.15.90:0/3740482547 learned_addr learned my addr 172.21.15.90:0/3740482547 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcb9bfff640 1 --2- 172.21.15.90:0/3740482547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb84004800 0x7fcb9c0c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcba0eef640 1 --2- 172.21.15.90:0/3740482547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb9c0b24b0 0x7fcb9c0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcb9b7fe640 1 -- 172.21.15.90:0/3740482547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb9c0b24b0 msgr2=0x7fcb9c0c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcb9b7fe640 1 --2- 172.21.15.90:0/3740482547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb9c0b24b0 0x7fcb9c0c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcb9b7fe640 1 -- 172.21.15.90:0/3740482547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb84004800 msgr2=0x7fcb9c0c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcb9b7fe640 1 --2- 172.21.15.90:0/3740482547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb84004800 0x7fcb9c0c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcb9b7fe640 1 -- 172.21.15.90:0/3740482547 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9c1f8a30 con 0x7fcb9c0b2030 2024-09-10T23:18:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcba0eef640 1 --2- 172.21.15.90:0/3740482547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb9c0b24b0 0x7fcb9c0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcb9b7fe640 1 --2- 172.21.15.90:0/3740482547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb9c0b2030 0x7fcb9c1607b0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000bd00 tx=0x7fcb900038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcb98ff9640 1 -- 172.21.15.90:0/3740482547 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90005020 con 0x7fcb9c0b2030 2024-09-10T23:18:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcb98ff9640 1 -- 172.21.15.90:0/3740482547 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb90040070 con 0x7fcb9c0b2030 2024-09-10T23:18:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcba2952640 1 -- 172.21.15.90:0/3740482547 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb9c1f8d10 con 0x7fcb9c0b2030 2024-09-10T23:18:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcb98ff9640 1 -- 172.21.15.90:0/3740482547 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90005530 con 0x7fcb9c0b2030 2024-09-10T23:18:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.534+0000 7fcba2952640 1 -- 172.21.15.90:0/3740482547 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb9c1f92d0 con 0x7fcb9c0b2030 2024-09-10T23:18:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.535+0000 7fcba2952640 1 -- 172.21.15.90:0/3740482547 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb9c0cf060 con 0x7fcb9c0b2030 2024-09-10T23:18:20.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.536+0000 7fcb98ff9640 1 -- 172.21.15.90:0/3740482547 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcb90003ea0 con 0x7fcb9c0b2030 2024-09-10T23:18:20.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.536+0000 7fcb98ff9640 1 --2- 172.21.15.90:0/3740482547 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcb88077f70 0x7fcb8807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:20.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.537+0000 7fcb98ff9640 1 -- 172.21.15.90:0/3740482547 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fcb900bac20 con 0x7fcb9c0b2030 2024-09-10T23:18:20.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.537+0000 7fcb9bfff640 1 --2- 172.21.15.90:0/3740482547 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcb88077f70 0x7fcb8807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:20.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.537+0000 7fcb9bfff640 1 --2- 172.21.15.90:0/3740482547 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcb88077f70 0x7fcb8807a430 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c160660 tx=0x7fcb8c006d60 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:20.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.541+0000 7fcb98ff9640 1 -- 172.21.15.90:0/3740482547 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcb9c0cf060 con 0x7fcb9c0b2030 2024-09-10T23:18:20.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.750+0000 7fcba2952640 1 -- 172.21.15.90:0/3740482547 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fcb9c0c7df0 con 0x7fcb9c0b2030 2024-09-10T23:18:20.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.821+0000 7fcb98ff9640 1 -- 172.21.15.90:0/3740482547 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v56) ==== 118+0+0 (secure 0 0 0) 0x7fcb90083160 con 0x7fcb9c0b2030 2024-09-10T23:18:20.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.824+0000 7fcba2952640 1 -- 172.21.15.90:0/3740482547 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcb88077f70 msgr2=0x7fcb8807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:20.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.824+0000 7fcba2952640 1 --2- 172.21.15.90:0/3740482547 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcb88077f70 0x7fcb8807a430 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c160660 tx=0x7fcb8c006d60 comp rx=0 tx=0).stop 2024-09-10T23:18:20.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.824+0000 7fcba2952640 1 -- 172.21.15.90:0/3740482547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb9c0b2030 msgr2=0x7fcb9c1607b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:20.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.824+0000 7fcba2952640 1 --2- 172.21.15.90:0/3740482547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb9c0b2030 0x7fcb9c1607b0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000bd00 tx=0x7fcb900038a0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.824+0000 7fcba2952640 1 -- 172.21.15.90:0/3740482547 shutdown_connections 2024-09-10T23:18:20.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.824+0000 7fcba2952640 1 --2- 172.21.15.90:0/3740482547 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fcb88077f70 0x7fcb8807a430 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.824+0000 7fcba2952640 1 --2- 172.21.15.90:0/3740482547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb9c0b24b0 0x7fcb9c0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.824+0000 7fcba2952640 1 --2- 172.21.15.90:0/3740482547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb9c0b2030 0x7fcb9c1607b0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.824+0000 7fcba2952640 1 --2- 172.21.15.90:0/3740482547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb84004800 0x7fcb9c0c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.824+0000 7fcba2952640 1 -- 172.21.15.90:0/3740482547 >> 172.21.15.90:0/3740482547 conn(0x7fcb9c0d4090 msgr2=0x7fcb9c0b6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:20.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.824+0000 7fcba2952640 1 -- 172.21.15.90:0/3740482547 shutdown_connections 2024-09-10T23:18:20.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.824+0000 7fcba2952640 1 -- 172.21.15.90:0/3740482547 wait complete. 2024-09-10T23:18:20.837 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:18:20.837 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:18:20.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.939+0000 7f0fcc840640 1 -- 172.21.15.90:0/84020272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fc80d16f0 msgr2=0x7f0fc80d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:20.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.939+0000 7f0fcc840640 1 --2- 172.21.15.90:0/84020272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fc80d16f0 0x7f0fc80d2e00 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0005fd0 tx=0x7f0fc002a540 comp rx=0 tx=0).stop 2024-09-10T23:18:20.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.939+0000 7f0fcc840640 1 -- 172.21.15.90:0/84020272 shutdown_connections 2024-09-10T23:18:20.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.939+0000 7f0fcc840640 1 --2- 172.21.15.90:0/84020272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fc80d16f0 0x7f0fc80d2e00 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.939+0000 7f0fcc840640 1 --2- 172.21.15.90:0/84020272 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fc80d1190 0x7f0fc80d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.939+0000 7f0fcc840640 1 -- 172.21.15.90:0/84020272 >> 172.21.15.90:0/84020272 conn(0x7f0fc80d4090 msgr2=0x7f0fc80d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:20.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.939+0000 7f0fcc840640 1 -- 172.21.15.90:0/84020272 shutdown_connections 2024-09-10T23:18:20.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.939+0000 7f0fcc840640 1 -- 172.21.15.90:0/84020272 wait complete. 2024-09-10T23:18:20.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.940+0000 7f0fcc840640 1 Processor -- start 2024-09-10T23:18:20.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.941+0000 7f0fcc840640 1 -- start start 2024-09-10T23:18:20.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.941+0000 7f0fcc840640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fc80d1190 0x7f0fc8160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:20.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.941+0000 7f0fcc840640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fc80d16f0 0x7f0fc80b9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:20.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.941+0000 7f0fcc840640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fc815e310 0x7f0fc815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:20.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.941+0000 7f0fcc840640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc80d3340 con 0x7f0fc80d16f0 2024-09-10T23:18:20.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.941+0000 7f0fcc840640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc80d4d90 con 0x7f0fc815e310 2024-09-10T23:18:20.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.941+0000 7f0fcc840640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc80d34c0 con 0x7f0fc80d1190 2024-09-10T23:18:20.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.941+0000 7f0fc5d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fc80d16f0 0x7f0fc80b9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:20.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.941+0000 7f0fc5d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fc80d16f0 0x7f0fc80b9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56306/0 (socket says 172.21.15.90:56306) 2024-09-10T23:18:20.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.941+0000 7f0fc5d9b640 1 -- 172.21.15.90:0/395703255 learned_addr learned my addr 172.21.15.90:0/395703255 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:20.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.942+0000 7f0fc659c640 1 --2- 172.21.15.90:0/395703255 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fc80d1190 0x7f0fc8160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:20.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.942+0000 7f0fc6d9d640 1 --2- 172.21.15.90:0/395703255 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fc815e310 0x7f0fc815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:20.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.942+0000 7f0fc5d9b640 1 -- 172.21.15.90:0/395703255 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fc80d1190 msgr2=0x7f0fc8160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:20.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.942+0000 7f0fc5d9b640 1 --2- 172.21.15.90:0/395703255 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fc80d1190 0x7f0fc8160f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.942+0000 7f0fc5d9b640 1 -- 172.21.15.90:0/395703255 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fc815e310 msgr2=0x7f0fc815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:20.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.942+0000 7f0fc5d9b640 1 --2- 172.21.15.90:0/395703255 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fc815e310 0x7f0fc815e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:20.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.942+0000 7f0fc5d9b640 1 -- 172.21.15.90:0/395703255 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc81f86c0 con 0x7f0fc80d16f0 2024-09-10T23:18:20.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.942+0000 7f0fc6d9d640 1 --2- 172.21.15.90:0/395703255 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fc815e310 0x7f0fc815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:20.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.942+0000 7f0fc5d9b640 1 --2- 172.21.15.90:0/395703255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fc80d16f0 0x7f0fc80b9930 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000d980 tx=0x7f0fb000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:20.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.942+0000 7f0fbeffd640 1 -- 172.21.15.90:0/395703255 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0017070 con 0x7f0fc80d16f0 2024-09-10T23:18:20.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.942+0000 7f0fbeffd640 1 -- 172.21.15.90:0/395703255 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fb0009cc0 con 0x7f0fc80d16f0 2024-09-10T23:18:20.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.942+0000 7f0fcc840640 1 -- 172.21.15.90:0/395703255 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc81f89a0 con 0x7f0fc80d16f0 2024-09-10T23:18:20.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.942+0000 7f0fbeffd640 1 -- 172.21.15.90:0/395703255 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb00106c0 con 0x7f0fc80d16f0 2024-09-10T23:18:20.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.942+0000 7f0fcc840640 1 -- 172.21.15.90:0/395703255 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc81f8f60 con 0x7f0fc80d16f0 2024-09-10T23:18:20.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.943+0000 7f0fcc840640 1 -- 172.21.15.90:0/395703255 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc806ebf0 con 0x7f0fc80d16f0 2024-09-10T23:18:20.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.944+0000 7f0fbeffd640 1 -- 172.21.15.90:0/395703255 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0fb0010860 con 0x7f0fc80d16f0 2024-09-10T23:18:20.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.944+0000 7f0fbeffd640 1 --2- 172.21.15.90:0/395703255 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0fa8077fa0 0x7f0fa807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:20.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.944+0000 7f0fbeffd640 1 -- 172.21.15.90:0/395703255 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f0fb009a030 con 0x7f0fc80d16f0 2024-09-10T23:18:20.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.944+0000 7f0fc659c640 1 --2- 172.21.15.90:0/395703255 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0fa8077fa0 0x7f0fa807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:20.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.945+0000 7f0fc659c640 1 --2- 172.21.15.90:0/395703255 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0fa8077fa0 0x7f0fa807a460 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0fb80012e0 tx=0x7f0fb8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:20.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:20.949+0000 7f0fbeffd640 1 -- 172.21.15.90:0/395703255 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0fc806ebf0 con 0x7f0fc80d16f0 2024-09-10T23:18:21.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.157+0000 7f0fcc840640 1 -- 172.21.15.90:0/395703255 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0fc80ce810 con 0x7f0fc80d16f0 2024-09-10T23:18:21.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.827+0000 7f0fbeffd640 1 -- 172.21.15.90:0/395703255 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v57) ==== 122+0+0 (secure 0 0 0) 0x7f0fc80ce810 con 0x7f0fc80d16f0 2024-09-10T23:18:21.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.831+0000 7f0fcc840640 1 -- 172.21.15.90:0/395703255 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0fa8077fa0 msgr2=0x7f0fa807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:21.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.831+0000 7f0fcc840640 1 --2- 172.21.15.90:0/395703255 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0fa8077fa0 0x7f0fa807a460 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0fb80012e0 tx=0x7f0fb8009040 comp rx=0 tx=0).stop 2024-09-10T23:18:21.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.831+0000 7f0fcc840640 1 -- 172.21.15.90:0/395703255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fc80d16f0 msgr2=0x7f0fc80b9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:21.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.831+0000 7f0fcc840640 1 --2- 172.21.15.90:0/395703255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fc80d16f0 0x7f0fc80b9930 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000d980 tx=0x7f0fb000de40 comp rx=0 tx=0).stop 2024-09-10T23:18:21.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.831+0000 7f0fcc840640 1 -- 172.21.15.90:0/395703255 shutdown_connections 2024-09-10T23:18:21.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.831+0000 7f0fcc840640 1 --2- 172.21.15.90:0/395703255 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0fa8077fa0 0x7f0fa807a460 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:21.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.831+0000 7f0fcc840640 1 --2- 172.21.15.90:0/395703255 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fc815e310 0x7f0fc815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:21.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.831+0000 7f0fcc840640 1 --2- 172.21.15.90:0/395703255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fc80d16f0 0x7f0fc80b9930 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:21.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.831+0000 7f0fcc840640 1 --2- 172.21.15.90:0/395703255 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fc80d1190 0x7f0fc8160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:21.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.831+0000 7f0fcc840640 1 -- 172.21.15.90:0/395703255 >> 172.21.15.90:0/395703255 conn(0x7f0fc80d4090 msgr2=0x7f0fc80b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:21.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.831+0000 7f0fcc840640 1 -- 172.21.15.90:0/395703255 shutdown_connections 2024-09-10T23:18:21.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.831+0000 7f0fcc840640 1 -- 172.21.15.90:0/395703255 wait complete. 2024-09-10T23:18:21.845 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:18:21.845 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:21.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.949+0000 7f1315bfb640 1 -- 172.21.15.90:0/3002849707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f131015e180 msgr2=0x7f13100d4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:21.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.949+0000 7f1315bfb640 1 --2- 172.21.15.90:0/3002849707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f131015e180 0x7f13100d4bb0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f131008c2a0 tx=0x7f130002ab40 comp rx=0 tx=0).stop 2024-09-10T23:18:21.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.949+0000 7f1315bfb640 1 -- 172.21.15.90:0/3002849707 shutdown_connections 2024-09-10T23:18:21.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.949+0000 7f1315bfb640 1 --2- 172.21.15.90:0/3002849707 >> v2:172.21.15.171:3300/0 conn(0x7f131006e750 0x7f13100cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:21.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.949+0000 7f1315bfb640 1 --2- 172.21.15.90:0/3002849707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f131015e180 0x7f13100d4bb0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:21.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.949+0000 7f1315bfb640 1 -- 172.21.15.90:0/3002849707 >> 172.21.15.90:0/3002849707 conn(0x7f13100d4090 msgr2=0x7f13100d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:21.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.949+0000 7f1315bfb640 1 -- 172.21.15.90:0/3002849707 shutdown_connections 2024-09-10T23:18:21.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.949+0000 7f1315bfb640 1 -- 172.21.15.90:0/3002849707 wait complete. 2024-09-10T23:18:21.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.950+0000 7f1315bfb640 1 Processor -- start 2024-09-10T23:18:21.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.951+0000 7f1315bfb640 1 -- start start 2024-09-10T23:18:21.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.951+0000 7f1315bfb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f131006d6d0 0x7f13101f9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:21.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.951+0000 7f1315bfb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f131006e750 0x7f13101572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:21.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.951+0000 7f1315bfb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f131015e180 0x7f13100b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:21.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.951+0000 7f1315bfb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f13100cf840 con 0x7f131006e750 2024-09-10T23:18:21.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.951+0000 7f1315bfb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f13100cf6c0 con 0x7f131006d6d0 2024-09-10T23:18:21.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.951+0000 7f1315bfb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f13100cf9c0 con 0x7f131015e180 2024-09-10T23:18:21.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.952+0000 7f130effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f131006e750 0x7f13101572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:21.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.952+0000 7f130effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f131006e750 0x7f13101572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56334/0 (socket says 172.21.15.90:56334) 2024-09-10T23:18:21.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.952+0000 7f130effd640 1 -- 172.21.15.90:0/2301584648 learned_addr learned my addr 172.21.15.90:0/2301584648 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:21.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.952+0000 7f130f7fe640 1 --2- 172.21.15.90:0/2301584648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f131006d6d0 0x7f13101f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:21.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.952+0000 7f130ffff640 1 --2- 172.21.15.90:0/2301584648 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f131015e180 0x7f13100b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:21.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.952+0000 7f130effd640 1 -- 172.21.15.90:0/2301584648 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f131015e180 msgr2=0x7f13100b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:21.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.952+0000 7f130effd640 1 --2- 172.21.15.90:0/2301584648 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f131015e180 0x7f13100b7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:21.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.952+0000 7f130effd640 1 -- 172.21.15.90:0/2301584648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f131006d6d0 msgr2=0x7f13101f9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:21.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.952+0000 7f130effd640 1 --2- 172.21.15.90:0/2301584648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f131006d6d0 0x7f13101f9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:21.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.952+0000 7f130effd640 1 -- 172.21.15.90:0/2301584648 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1310157800 con 0x7f131006e750 2024-09-10T23:18:21.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.952+0000 7f130effd640 1 --2- 172.21.15.90:0/2301584648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f131006e750 0x7f13101572c0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f130400c500 tx=0x7f130400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:21.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.952+0000 7f12f7fff640 1 -- 172.21.15.90:0/2301584648 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13040052d0 con 0x7f131006e750 2024-09-10T23:18:21.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.952+0000 7f12f7fff640 1 -- 172.21.15.90:0/2301584648 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1304005470 con 0x7f131006e750 2024-09-10T23:18:21.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.952+0000 7f1315bfb640 1 -- 172.21.15.90:0/2301584648 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13100b6140 con 0x7f131006e750 2024-09-10T23:18:21.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.952+0000 7f12f7fff640 1 -- 172.21.15.90:0/2301584648 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304012870 con 0x7f131006e750 2024-09-10T23:18:21.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.952+0000 7f1315bfb640 1 -- 172.21.15.90:0/2301584648 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13100b57b0 con 0x7f131006e750 2024-09-10T23:18:21.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.953+0000 7f1315bfb640 1 -- 172.21.15.90:0/2301584648 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13100cff50 con 0x7f131006e750 2024-09-10T23:18:21.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.954+0000 7f12f7fff640 1 -- 172.21.15.90:0/2301584648 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f13040035f0 con 0x7f131006e750 2024-09-10T23:18:21.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.954+0000 7f12f7fff640 1 --2- 172.21.15.90:0/2301584648 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f12fc077f70 0x7f12fc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:21.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.955+0000 7f12f7fff640 1 -- 172.21.15.90:0/2301584648 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f1304099780 con 0x7f131006e750 2024-09-10T23:18:21.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.955+0000 7f130f7fe640 1 --2- 172.21.15.90:0/2301584648 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f12fc077f70 0x7f12fc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:21.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.955+0000 7f130f7fe640 1 --2- 172.21.15.90:0/2301584648 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f12fc077f70 0x7f12fc07a430 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1300035000 tx=0x7f1300038040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:21.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:21.959+0000 7f12f7fff640 1 -- 172.21.15.90:0/2301584648 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1304061c40 con 0x7f131006e750 2024-09-10T23:18:22.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.166+0000 7f1315bfb640 1 -- 172.21.15.90:0/2301584648 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f131008e130 con 0x7f131006e750 2024-09-10T23:18:22.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.166+0000 7f12f7fff640 1 -- 172.21.15.90:0/2301584648 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5228 (secure 0 0 0) 0x7f1304066670 con 0x7f131006e750 2024-09-10T23:18:22.169 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:22.169 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":57,"btime":"2024-09-10T23:18:21:823811+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1514360394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1514360394},{"type":"v1","addr":"172.21.15.171:6836","nonce":1514360394}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":7050,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/539487330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":539487330},{"type":"v1","addr":"172.21.15.90:6834","nonce":539487330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":7053,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4002726882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":4002726882},{"type":"v1","addr":"172.21.15.90:6835","nonce":4002726882}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:19.149613+0000","modified":"2024-09-10T23:18:21.159397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"d","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/3083996658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3083996658},{"type":"v1","addr":"172.21.15.171:6837","nonce":3083996658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7068,"qdb_cluster":[7068]},"id":8}]} 2024-09-10T23:18:22.170 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 57 2024-09-10T23:18:22.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.169+0000 7f1315bfb640 1 -- 172.21.15.90:0/2301584648 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f12fc077f70 msgr2=0x7f12fc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:22.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.169+0000 7f1315bfb640 1 --2- 172.21.15.90:0/2301584648 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f12fc077f70 0x7f12fc07a430 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1300035000 tx=0x7f1300038040 comp rx=0 tx=0).stop 2024-09-10T23:18:22.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.169+0000 7f1315bfb640 1 -- 172.21.15.90:0/2301584648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f131006e750 msgr2=0x7f13101572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:22.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.169+0000 7f1315bfb640 1 --2- 172.21.15.90:0/2301584648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f131006e750 0x7f13101572c0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f130400c500 tx=0x7f130400c9c0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.169+0000 7f1315bfb640 1 -- 172.21.15.90:0/2301584648 shutdown_connections 2024-09-10T23:18:22.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.169+0000 7f1315bfb640 1 --2- 172.21.15.90:0/2301584648 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f12fc077f70 0x7f12fc07a430 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.169+0000 7f1315bfb640 1 --2- 172.21.15.90:0/2301584648 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f131015e180 0x7f13100b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.169+0000 7f1315bfb640 1 --2- 172.21.15.90:0/2301584648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f131006e750 0x7f13101572c0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.169+0000 7f1315bfb640 1 --2- 172.21.15.90:0/2301584648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f131006d6d0 0x7f13101f9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.169+0000 7f1315bfb640 1 -- 172.21.15.90:0/2301584648 >> 172.21.15.90:0/2301584648 conn(0x7f13100d4090 msgr2=0x7f13100d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:22.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.169+0000 7f1315bfb640 1 -- 172.21.15.90:0/2301584648 shutdown_connections 2024-09-10T23:18:22.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.169+0000 7f1315bfb640 1 -- 172.21.15.90:0/2301584648 wait complete. 2024-09-10T23:18:22.181 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:18:22.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.279+0000 7f28e30c6640 1 -- 172.21.15.90:0/2088488160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28dc06e6f0 msgr2=0x7f28dc0cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:22.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.279+0000 7f28e30c6640 1 --2- 172.21.15.90:0/2088488160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28dc06e6f0 0x7f28dc0cd0b0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f28d0005fd0 tx=0x7f28d002a5d0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.279+0000 7f28e30c6640 1 -- 172.21.15.90:0/2088488160 shutdown_connections 2024-09-10T23:18:22.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.279+0000 7f28e30c6640 1 --2- 172.21.15.90:0/2088488160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28dc06e6f0 0x7f28dc0cd0b0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.279+0000 7f28e30c6640 1 --2- 172.21.15.90:0/2088488160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28dc15a1d0 0x7f28dc0cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.279+0000 7f28e30c6640 1 -- 172.21.15.90:0/2088488160 >> 172.21.15.90:0/2088488160 conn(0x7f28dc0b19c0 msgr2=0x7f28dc0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:22.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.279+0000 7f28e30c6640 1 -- 172.21.15.90:0/2088488160 shutdown_connections 2024-09-10T23:18:22.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.279+0000 7f28e30c6640 1 -- 172.21.15.90:0/2088488160 wait complete. 2024-09-10T23:18:22.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.280+0000 7f28e30c6640 1 Processor -- start 2024-09-10T23:18:22.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.280+0000 7f28e30c6640 1 -- start start 2024-09-10T23:18:22.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.281+0000 7f28e30c6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28dc06e6f0 0x7f28dc1f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:22.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.281+0000 7f28e30c6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28dc06f860 0x7f28dc09ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:22.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.281+0000 7f28e30c6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28dc15a1d0 0x7f28dc154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:22.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.281+0000 7f28e30c6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc06f4d0 con 0x7f28dc06f860 2024-09-10T23:18:22.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.281+0000 7f28e30c6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc070ac0 con 0x7f28dc15a1d0 2024-09-10T23:18:22.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.281+0000 7f28e30c6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f28dc0b4af0 con 0x7f28dc06e6f0 2024-09-10T23:18:22.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.281+0000 7f28dbfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28dc06f860 0x7f28dc09ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:22.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.281+0000 7f28dbfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28dc06f860 0x7f28dc09ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56348/0 (socket says 172.21.15.90:56348) 2024-09-10T23:18:22.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.281+0000 7f28dbfff640 1 -- 172.21.15.90:0/1606478515 learned_addr learned my addr 172.21.15.90:0/1606478515 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:22.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.282+0000 7f28e0e62640 1 --2- 172.21.15.90:0/1606478515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28dc06e6f0 0x7f28dc1f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:22.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.282+0000 7f28e1663640 1 --2- 172.21.15.90:0/1606478515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28dc15a1d0 0x7f28dc154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:22.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.282+0000 7f28dbfff640 1 -- 172.21.15.90:0/1606478515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28dc06e6f0 msgr2=0x7f28dc1f3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:22.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.282+0000 7f28dbfff640 1 --2- 172.21.15.90:0/1606478515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28dc06e6f0 0x7f28dc1f3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.282+0000 7f28dbfff640 1 -- 172.21.15.90:0/1606478515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28dc15a1d0 msgr2=0x7f28dc154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:22.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.282+0000 7f28dbfff640 1 --2- 172.21.15.90:0/1606478515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28dc15a1d0 0x7f28dc154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.282+0000 7f28dbfff640 1 -- 172.21.15.90:0/1606478515 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28dc15db10 con 0x7f28dc06f860 2024-09-10T23:18:22.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.282+0000 7f28dbfff640 1 --2- 172.21.15.90:0/1606478515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28dc06f860 0x7f28dc09ced0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009850 tx=0x7f28d00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:22.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.282+0000 7f28d97fa640 1 -- 172.21.15.90:0/1606478515 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d003f070 con 0x7f28dc06f860 2024-09-10T23:18:22.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.282+0000 7f28d97fa640 1 -- 172.21.15.90:0/1606478515 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28d0005600 con 0x7f28dc06f860 2024-09-10T23:18:22.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.282+0000 7f28e30c6640 1 -- 172.21.15.90:0/1606478515 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28dc15ddf0 con 0x7f28dc06f860 2024-09-10T23:18:22.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.282+0000 7f28d97fa640 1 -- 172.21.15.90:0/1606478515 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d0035030 con 0x7f28dc06f860 2024-09-10T23:18:22.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.282+0000 7f28e30c6640 1 -- 172.21.15.90:0/1606478515 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28dc15e3b0 con 0x7f28dc06f860 2024-09-10T23:18:22.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.283+0000 7f28e30c6640 1 -- 172.21.15.90:0/1606478515 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28dc050ee0 con 0x7f28dc06f860 2024-09-10T23:18:22.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.284+0000 7f28d97fa640 1 -- 172.21.15.90:0/1606478515 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f28d00049e0 con 0x7f28dc06f860 2024-09-10T23:18:22.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.284+0000 7f28d97fa640 1 --2- 172.21.15.90:0/1606478515 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f28c8077f70 0x7f28c807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:22.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.284+0000 7f28d97fa640 1 -- 172.21.15.90:0/1606478515 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f28d00baca0 con 0x7f28dc06f860 2024-09-10T23:18:22.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.284+0000 7f28e0e62640 1 --2- 172.21.15.90:0/1606478515 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f28c8077f70 0x7f28c807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:22.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.285+0000 7f28e0e62640 1 --2- 172.21.15.90:0/1606478515 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f28c8077f70 0x7f28c807a430 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f28cc005fd0 tx=0x7f28cc005850 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:22.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.288+0000 7f28d97fa640 1 -- 172.21.15.90:0/1606478515 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f28dc050ee0 con 0x7f28dc06f860 2024-09-10T23:18:22.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.462+0000 7f28e30c6640 1 -- 172.21.15.90:0/1606478515 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28dc070070 con 0x7f28dc06f860 2024-09-10T23:18:22.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.463+0000 7f28d97fa640 1 -- 172.21.15.90:0/1606478515 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+16687 (secure 0 0 0) 0x7f28d00837a0 con 0x7f28dc06f860 2024-09-10T23:18:22.465 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:22.465 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":104,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:18:20.816551+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:18:17.397925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-10T23:18:18.113855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:18:22.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.465+0000 7f28e30c6640 1 -- 172.21.15.90:0/1606478515 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f28c8077f70 msgr2=0x7f28c807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:22.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.465+0000 7f28e30c6640 1 --2- 172.21.15.90:0/1606478515 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f28c8077f70 0x7f28c807a430 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f28cc005fd0 tx=0x7f28cc005850 comp rx=0 tx=0).stop 2024-09-10T23:18:22.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.465+0000 7f28e30c6640 1 -- 172.21.15.90:0/1606478515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28dc06f860 msgr2=0x7f28dc09ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:22.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.465+0000 7f28e30c6640 1 --2- 172.21.15.90:0/1606478515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28dc06f860 0x7f28dc09ced0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009850 tx=0x7f28d00038a0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.465+0000 7f28e30c6640 1 -- 172.21.15.90:0/1606478515 shutdown_connections 2024-09-10T23:18:22.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.466+0000 7f28e30c6640 1 --2- 172.21.15.90:0/1606478515 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f28c8077f70 0x7f28c807a430 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.466+0000 7f28e30c6640 1 --2- 172.21.15.90:0/1606478515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28dc15a1d0 0x7f28dc154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.466+0000 7f28e30c6640 1 --2- 172.21.15.90:0/1606478515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28dc06f860 0x7f28dc09ced0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.466+0000 7f28e30c6640 1 --2- 172.21.15.90:0/1606478515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28dc06e6f0 0x7f28dc1f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.466+0000 7f28e30c6640 1 -- 172.21.15.90:0/1606478515 >> 172.21.15.90:0/1606478515 conn(0x7f28dc0b19c0 msgr2=0x7f28dc0727c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:22.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.466+0000 7f28e30c6640 1 -- 172.21.15.90:0/1606478515 shutdown_connections 2024-09-10T23:18:22.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.466+0000 7f28e30c6640 1 -- 172.21.15.90:0/1606478515 wait complete. 2024-09-10T23:18:22.478 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:18:22.479 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:18:22.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.579+0000 7f93904dd640 1 -- 172.21.15.90:0/3895118732 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9374003f70 msgr2=0x7f9374004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:22.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.579+0000 7f93904dd640 1 --2- 172.21.15.90:0/3895118732 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9374003f70 0x7f9374004800 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f9388070b60 tx=0x7f9374005830 comp rx=0 tx=0).stop 2024-09-10T23:18:22.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.579+0000 7f938ea7a640 1 -- 172.21.15.90:0/3895118732 reap_dead start 2024-09-10T23:18:22.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.579+0000 7f93904dd640 1 -- 172.21.15.90:0/3895118732 shutdown_connections 2024-09-10T23:18:22.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.579+0000 7f93904dd640 1 -- 172.21.15.90:0/3895118732 >> 172.21.15.90:0/3895118732 conn(0x7f93880b19c0 msgr2=0x7f93880b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:22.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.579+0000 7f93904dd640 1 -- 172.21.15.90:0/3895118732 shutdown_connections 2024-09-10T23:18:22.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.579+0000 7f93904dd640 1 -- 172.21.15.90:0/3895118732 wait complete. 2024-09-10T23:18:22.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.580+0000 7f93904dd640 1 Processor -- start 2024-09-10T23:18:22.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.580+0000 7f93904dd640 1 -- start start 2024-09-10T23:18:22.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f93904dd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9374003f70 0x7f938815e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:22.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f93904dd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f938815ec70 0x7f938815c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:22.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f93904dd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f938815ce20 0x7f93881f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:22.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f93904dd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9388073f60 con 0x7f9374003f70 2024-09-10T23:18:22.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f93904dd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9388073de0 con 0x7f938815ec70 2024-09-10T23:18:22.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f93904dd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f93880740e0 con 0x7f938815ce20 2024-09-10T23:18:22.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f938e279640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9374003f70 0x7f938815e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:22.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f938e279640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9374003f70 0x7f938815e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56372/0 (socket says 172.21.15.90:56372) 2024-09-10T23:18:22.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f938e279640 1 -- 172.21.15.90:0/839846769 learned_addr learned my addr 172.21.15.90:0/839846769 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:22.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f938ea7a640 1 --2- 172.21.15.90:0/839846769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f938815ce20 0x7f93881f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:22.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f938da78640 1 --2- 172.21.15.90:0/839846769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f938815ec70 0x7f938815c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:22.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f938e279640 1 -- 172.21.15.90:0/839846769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f938815ce20 msgr2=0x7f93881f52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:22.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f938e279640 1 --2- 172.21.15.90:0/839846769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f938815ce20 0x7f93881f52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f938e279640 1 -- 172.21.15.90:0/839846769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f938815ec70 msgr2=0x7f938815c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:22.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f938e279640 1 --2- 172.21.15.90:0/839846769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f938815ec70 0x7f938815c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f938e279640 1 -- 172.21.15.90:0/839846769 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93881f2c30 con 0x7f9374003f70 2024-09-10T23:18:22.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f938e279640 1 --2- 172.21.15.90:0/839846769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9374003f70 0x7f938815e730 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f9384011ae0 tx=0x7f9384009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:22.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.581+0000 7f937effd640 1 -- 172.21.15.90:0/839846769 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938401e070 con 0x7f9374003f70 2024-09-10T23:18:22.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.582+0000 7f937effd640 1 -- 172.21.15.90:0/839846769 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f938400fe70 con 0x7f9374003f70 2024-09-10T23:18:22.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.582+0000 7f93904dd640 1 -- 172.21.15.90:0/839846769 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93881f2f10 con 0x7f9374003f70 2024-09-10T23:18:22.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.582+0000 7f937effd640 1 -- 172.21.15.90:0/839846769 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384004290 con 0x7f9374003f70 2024-09-10T23:18:22.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.582+0000 7f93904dd640 1 -- 172.21.15.90:0/839846769 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f938809d7c0 con 0x7f9374003f70 2024-09-10T23:18:22.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.582+0000 7f93904dd640 1 -- 172.21.15.90:0/839846769 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f938809da50 con 0x7f9374003f70 2024-09-10T23:18:22.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.583+0000 7f937effd640 1 -- 172.21.15.90:0/839846769 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f93840035f0 con 0x7f9374003f70 2024-09-10T23:18:22.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.584+0000 7f937effd640 1 --2- 172.21.15.90:0/839846769 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f936c077f70 0x7f936c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:22.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.584+0000 7f937effd640 1 -- 172.21.15.90:0/839846769 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f938409ab70 con 0x7f9374003f70 2024-09-10T23:18:22.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.584+0000 7f938da78640 1 --2- 172.21.15.90:0/839846769 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f936c077f70 0x7f936c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:22.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.584+0000 7f938da78640 1 --2- 172.21.15.90:0/839846769 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f936c077f70 0x7f936c07a430 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9378032000 tx=0x7f937802c000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:22.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.588+0000 7f937effd640 1 -- 172.21.15.90:0/839846769 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f938809da50 con 0x7f9374003f70 2024-09-10T23:18:22.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.759+0000 7f93904dd640 1 -- 172.21.15.90:0/839846769 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f93880af160 con 0x7f936c077f70 2024-09-10T23:18:22.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.763+0000 7f937effd640 1 -- 172.21.15.90:0/839846769 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249958 (secure 0 0 0) 0x7f93880af160 con 0x7f936c077f70 2024-09-10T23:18:22.767 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:22.768 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:18:22.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.766+0000 7f93904dd640 1 -- 172.21.15.90:0/839846769 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f936c077f70 msgr2=0x7f936c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:22.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.766+0000 7f93904dd640 1 --2- 172.21.15.90:0/839846769 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f936c077f70 0x7f936c07a430 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9378032000 tx=0x7f937802c000 comp rx=0 tx=0).stop 2024-09-10T23:18:22.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.766+0000 7f93904dd640 1 -- 172.21.15.90:0/839846769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9374003f70 msgr2=0x7f938815e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:22.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.766+0000 7f93904dd640 1 --2- 172.21.15.90:0/839846769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9374003f70 0x7f938815e730 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f9384011ae0 tx=0x7f9384009e90 comp rx=0 tx=0).stop 2024-09-10T23:18:22.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.766+0000 7f93904dd640 1 -- 172.21.15.90:0/839846769 shutdown_connections 2024-09-10T23:18:22.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.766+0000 7f93904dd640 1 --2- 172.21.15.90:0/839846769 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f936c077f70 0x7f936c07a430 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.766+0000 7f93904dd640 1 --2- 172.21.15.90:0/839846769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f938815ec70 0x7f938815c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.766+0000 7f93904dd640 1 --2- 172.21.15.90:0/839846769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f938815ce20 0x7f93881f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.766+0000 7f93904dd640 1 --2- 172.21.15.90:0/839846769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9374003f70 0x7f938815e730 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.766+0000 7f93904dd640 1 -- 172.21.15.90:0/839846769 >> 172.21.15.90:0/839846769 conn(0x7f93880b19c0 msgr2=0x7f93880b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:22.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.767+0000 7f93904dd640 1 -- 172.21.15.90:0/839846769 shutdown_connections 2024-09-10T23:18:22.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.767+0000 7f93904dd640 1 -- 172.21.15.90:0/839846769 wait complete. 2024-09-10T23:18:22.778 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-09-10T23:18:22.488411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256484,"kb_used_data":11104,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754718236,"statfs":{"total":773094113280,"available":772831473664,"internally_reserved":0,"allocated":11370496,"data_stored":5481901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.689104"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.838845+0000","last_change":"2024-09-10T23:18:19.834081+0000","last_active":"2024-09-10T23:18:19.838845+0000","last_peered":"2024-09-10T23:18:19.838845+0000","last_clean":"2024-09-10T23:18:19.838845+0000","last_became_active":"2024-09-10T23:18:19.833811+0000","last_became_peered":"2024-09-10T23:18:19.833811+0000","last_unstale":"2024-09-10T23:18:19.838845+0000","last_undegraded":"2024-09-10T23:18:19.838845+0000","last_fullsized":"2024-09-10T23:18:19.838845+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:42.460246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834642+0000","last_change":"2024-09-10T23:18:19.832637+0000","last_active":"2024-09-10T23:18:19.834642+0000","last_peered":"2024-09-10T23:18:19.834642+0000","last_clean":"2024-09-10T23:18:19.834642+0000","last_became_active":"2024-09-10T23:18:19.832256+0000","last_became_peered":"2024-09-10T23:18:19.832256+0000","last_unstale":"2024-09-10T23:18:19.834642+0000","last_undegraded":"2024-09-10T23:18:19.834642+0000","last_fullsized":"2024-09-10T23:18:19.834642+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:30:32.840023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.828014+0000","last_change":"2024-09-10T23:18:19.825136+0000","last_active":"2024-09-10T23:18:19.828014+0000","last_peered":"2024-09-10T23:18:19.828014+0000","last_clean":"2024-09-10T23:18:19.828014+0000","last_became_active":"2024-09-10T23:18:19.824888+0000","last_became_peered":"2024-09-10T23:18:19.824888+0000","last_unstale":"2024-09-10T23:18:19.828014+0000","last_undegraded":"2024-09-10T23:18:19.828014+0000","last_fullsized":"2024-09-10T23:18:19.828014+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:28.093748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.833700+0000","last_change":"2024-09-10T23:18:19.829960+0000","last_active":"2024-09-10T23:18:19.833700+0000","last_peered":"2024-09-10T23:18:19.833700+0000","last_clean":"2024-09-10T23:18:19.833700+0000","last_became_active":"2024-09-10T23:18:19.829678+0000","last_became_peered":"2024-09-10T23:18:19.829678+0000","last_unstale":"2024-09-10T23:18:19.833700+0000","last_undegraded":"2024-09-10T23:18:19.833700+0000","last_fullsized":"2024-09-10T23:18:19.833700+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:53.316251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.826013+0000","last_change":"2024-09-10T23:18:19.824702+0000","last_active":"2024-09-10T23:18:19.826013+0000","last_peered":"2024-09-10T23:18:19.826013+0000","last_clean":"2024-09-10T23:18:19.826013+0000","last_became_active":"2024-09-10T23:18:19.824418+0000","last_became_peered":"2024-09-10T23:18:19.824418+0000","last_unstale":"2024-09-10T23:18:19.826013+0000","last_undegraded":"2024-09-10T23:18:19.826013+0000","last_fullsized":"2024-09-10T23:18:19.826013+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:31.405406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.839466+0000","last_change":"2024-09-10T23:18:19.838305+0000","last_active":"2024-09-10T23:18:19.839466+0000","last_peered":"2024-09-10T23:18:19.839466+0000","last_clean":"2024-09-10T23:18:19.839466+0000","last_became_active":"2024-09-10T23:18:19.838086+0000","last_became_peered":"2024-09-10T23:18:19.838086+0000","last_unstale":"2024-09-10T23:18:19.839466+0000","last_undegraded":"2024-09-10T23:18:19.839466+0000","last_fullsized":"2024-09-10T23:18:19.839466+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:43.611606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.829125+0000","last_change":"2024-09-10T23:18:19.823321+0000","last_active":"2024-09-10T23:18:19.829125+0000","last_peered":"2024-09-10T23:18:19.829125+0000","last_clean":"2024-09-10T23:18:19.829125+0000","last_became_active":"2024-09-10T23:18:19.823022+0000","last_became_peered":"2024-09-10T23:18:19.823022+0000","last_unstale":"2024-09-10T23:18:19.829125+0000","last_undegraded":"2024-09-10T23:18:19.829125+0000","last_fullsized":"2024-09-10T23:18:19.829125+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:53.037910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834686+0000","last_change":"2024-09-10T23:18:19.832545+0000","last_active":"2024-09-10T23:18:19.834686+0000","last_peered":"2024-09-10T23:18:19.834686+0000","last_clean":"2024-09-10T23:18:19.834686+0000","last_became_active":"2024-09-10T23:18:19.832235+0000","last_became_peered":"2024-09-10T23:18:19.832235+0000","last_unstale":"2024-09-10T23:18:19.834686+0000","last_undegraded":"2024-09-10T23:18:19.834686+0000","last_fullsized":"2024-09-10T23:18:19.834686+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:41.518449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.833830+0000","last_change":"2024-09-10T23:18:19.829837+0000","last_active":"2024-09-10T23:18:19.833830+0000","last_peered":"2024-09-10T23:18:19.833830+0000","last_clean":"2024-09-10T23:18:19.833830+0000","last_became_active":"2024-09-10T23:18:19.829518+0000","last_became_peered":"2024-09-10T23:18:19.829518+0000","last_unstale":"2024-09-10T23:18:19.833830+0000","last_undegraded":"2024-09-10T23:18:19.833830+0000","last_fullsized":"2024-09-10T23:18:19.833830+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:39.632376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.833720+0000","last_change":"2024-09-10T23:18:19.828982+0000","last_active":"2024-09-10T23:18:19.833720+0000","last_peered":"2024-09-10T23:18:19.833720+0000","last_clean":"2024-09-10T23:18:19.833720+0000","last_became_active":"2024-09-10T23:18:19.828736+0000","last_became_peered":"2024-09-10T23:18:19.828736+0000","last_unstale":"2024-09-10T23:18:19.833720+0000","last_undegraded":"2024-09-10T23:18:19.833720+0000","last_fullsized":"2024-09-10T23:18:19.833720+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:28.093748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.829196+0000","last_change":"2024-09-10T23:18:19.825287+0000","last_active":"2024-09-10T23:18:19.829196+0000","last_peered":"2024-09-10T23:18:19.829196+0000","last_clean":"2024-09-10T23:18:19.829196+0000","last_became_active":"2024-09-10T23:18:19.824111+0000","last_became_peered":"2024-09-10T23:18:19.824111+0000","last_unstale":"2024-09-10T23:18:19.829196+0000","last_undegraded":"2024-09-10T23:18:19.829196+0000","last_fullsized":"2024-09-10T23:18:19.829196+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:01:08.499643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825197+0000","last_change":"2024-09-10T23:18:19.821436+0000","last_active":"2024-09-10T23:18:19.825197+0000","last_peered":"2024-09-10T23:18:19.825197+0000","last_clean":"2024-09-10T23:18:19.825197+0000","last_became_active":"2024-09-10T23:18:19.821140+0000","last_became_peered":"2024-09-10T23:18:19.821140+0000","last_unstale":"2024-09-10T23:18:19.825197+0000","last_undegraded":"2024-09-10T23:18:19.825197+0000","last_fullsized":"2024-09-10T23:18:19.825197+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:15.016694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834087+0000","last_change":"2024-09-10T23:18:19.830445+0000","last_active":"2024-09-10T23:18:19.834087+0000","last_peered":"2024-09-10T23:18:19.834087+0000","last_clean":"2024-09-10T23:18:19.834087+0000","last_became_active":"2024-09-10T23:18:19.829974+0000","last_became_peered":"2024-09-10T23:18:19.829974+0000","last_unstale":"2024-09-10T23:18:19.834087+0000","last_undegraded":"2024-09-10T23:18:19.834087+0000","last_fullsized":"2024-09-10T23:18:19.834087+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:42.460246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834787+0000","last_change":"2024-09-10T23:18:19.831066+0000","last_active":"2024-09-10T23:18:19.834787+0000","last_peered":"2024-09-10T23:18:19.834787+0000","last_clean":"2024-09-10T23:18:19.834787+0000","last_became_active":"2024-09-10T23:18:19.830803+0000","last_became_peered":"2024-09-10T23:18:19.830803+0000","last_unstale":"2024-09-10T23:18:19.834787+0000","last_undegraded":"2024-09-10T23:18:19.834787+0000","last_fullsized":"2024-09-10T23:18:19.834787+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:09.384941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.823957+0000","last_change":"2024-09-10T23:18:19.816681+0000","last_active":"2024-09-10T23:18:19.823957+0000","last_peered":"2024-09-10T23:18:19.823957+0000","last_clean":"2024-09-10T23:18:19.823957+0000","last_became_active":"2024-09-10T23:18:19.816379+0000","last_became_peered":"2024-09-10T23:18:19.816379+0000","last_unstale":"2024-09-10T23:18:19.823957+0000","last_undegraded":"2024-09-10T23:18:19.823957+0000","last_fullsized":"2024-09-10T23:18:19.823957+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:22.335062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827839+0000","last_change":"2024-09-10T23:18:19.825076+0000","last_active":"2024-09-10T23:18:19.827839+0000","last_peered":"2024-09-10T23:18:19.827839+0000","last_clean":"2024-09-10T23:18:19.827839+0000","last_became_active":"2024-09-10T23:18:19.824432+0000","last_became_peered":"2024-09-10T23:18:19.824432+0000","last_unstale":"2024-09-10T23:18:19.827839+0000","last_undegraded":"2024-09-10T23:18:19.827839+0000","last_fullsized":"2024-09-10T23:18:19.827839+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:22.800159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834640+0000","last_change":"2024-09-10T23:18:19.831432+0000","last_active":"2024-09-10T23:18:19.834640+0000","last_peered":"2024-09-10T23:18:19.834640+0000","last_clean":"2024-09-10T23:18:19.834640+0000","last_became_active":"2024-09-10T23:18:19.831085+0000","last_became_peered":"2024-09-10T23:18:19.831085+0000","last_unstale":"2024-09-10T23:18:19.834640+0000","last_undegraded":"2024-09-10T23:18:19.834640+0000","last_fullsized":"2024-09-10T23:18:19.834640+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:39.632376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834948+0000","last_change":"2024-09-10T23:18:19.832721+0000","last_active":"2024-09-10T23:18:19.834948+0000","last_peered":"2024-09-10T23:18:19.834948+0000","last_clean":"2024-09-10T23:18:19.834948+0000","last_became_active":"2024-09-10T23:18:19.829915+0000","last_became_peered":"2024-09-10T23:18:19.829915+0000","last_unstale":"2024-09-10T23:18:19.834948+0000","last_undegraded":"2024-09-10T23:18:19.834948+0000","last_fullsized":"2024-09-10T23:18:19.834948+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:03.081250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.829107+0000","last_change":"2024-09-10T23:18:19.823585+0000","last_active":"2024-09-10T23:18:19.829107+0000","last_peered":"2024-09-10T23:18:19.829107+0000","last_clean":"2024-09-10T23:18:19.829107+0000","last_became_active":"2024-09-10T23:18:19.823326+0000","last_became_peered":"2024-09-10T23:18:19.823326+0000","last_unstale":"2024-09-10T23:18:19.829107+0000","last_undegraded":"2024-09-10T23:18:19.829107+0000","last_fullsized":"2024-09-10T23:18:19.829107+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:28.564827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837339+0000","last_change":"2024-09-10T23:18:19.831579+0000","last_active":"2024-09-10T23:18:19.837339+0000","last_peered":"2024-09-10T23:18:19.837339+0000","last_clean":"2024-09-10T23:18:19.837339+0000","last_became_active":"2024-09-10T23:18:19.831291+0000","last_became_peered":"2024-09-10T23:18:19.831291+0000","last_unstale":"2024-09-10T23:18:19.837339+0000","last_undegraded":"2024-09-10T23:18:19.837339+0000","last_fullsized":"2024-09-10T23:18:19.837339+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:53.959695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834630+0000","last_change":"2024-09-10T23:18:19.830865+0000","last_active":"2024-09-10T23:18:19.834630+0000","last_peered":"2024-09-10T23:18:19.834630+0000","last_clean":"2024-09-10T23:18:19.834630+0000","last_became_active":"2024-09-10T23:18:19.830151+0000","last_became_peered":"2024-09-10T23:18:19.830151+0000","last_unstale":"2024-09-10T23:18:19.834630+0000","last_undegraded":"2024-09-10T23:18:19.834630+0000","last_fullsized":"2024-09-10T23:18:19.834630+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:37.851110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834629+0000","last_change":"2024-09-10T23:18:19.830220+0000","last_active":"2024-09-10T23:18:19.834629+0000","last_peered":"2024-09-10T23:18:19.834629+0000","last_clean":"2024-09-10T23:18:19.834629+0000","last_became_active":"2024-09-10T23:18:19.829950+0000","last_became_peered":"2024-09-10T23:18:19.829950+0000","last_unstale":"2024-09-10T23:18:19.834629+0000","last_undegraded":"2024-09-10T23:18:19.834629+0000","last_fullsized":"2024-09-10T23:18:19.834629+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:43.624550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.822090+0000","last_change":"2024-09-10T23:18:19.817490+0000","last_active":"2024-09-10T23:18:19.822090+0000","last_peered":"2024-09-10T23:18:19.822090+0000","last_clean":"2024-09-10T23:18:19.822090+0000","last_became_active":"2024-09-10T23:18:19.816959+0000","last_became_peered":"2024-09-10T23:18:19.816959+0000","last_unstale":"2024-09-10T23:18:19.822090+0000","last_undegraded":"2024-09-10T23:18:19.822090+0000","last_fullsized":"2024-09-10T23:18:19.822090+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:51.785266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837758+0000","last_change":"2024-09-10T23:18:19.833318+0000","last_active":"2024-09-10T23:18:19.837758+0000","last_peered":"2024-09-10T23:18:19.837758+0000","last_clean":"2024-09-10T23:18:19.837758+0000","last_became_active":"2024-09-10T23:18:19.832884+0000","last_became_peered":"2024-09-10T23:18:19.832884+0000","last_unstale":"2024-09-10T23:18:19.837758+0000","last_undegraded":"2024-09-10T23:18:19.837758+0000","last_fullsized":"2024-09-10T23:18:19.837758+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:54.329061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837358+0000","last_change":"2024-09-10T23:18:19.831566+0000","last_active":"2024-09-10T23:18:19.837358+0000","last_peered":"2024-09-10T23:18:19.837358+0000","last_clean":"2024-09-10T23:18:19.837358+0000","last_became_active":"2024-09-10T23:18:19.831296+0000","last_became_peered":"2024-09-10T23:18:19.831296+0000","last_unstale":"2024-09-10T23:18:19.837358+0000","last_undegraded":"2024-09-10T23:18:19.837358+0000","last_fullsized":"2024-09-10T23:18:19.837358+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:29.710906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"103'4","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.823848+0000","last_change":"2024-09-10T23:18:18.819049+0000","last_active":"2024-09-10T23:18:19.823848+0000","last_peered":"2024-09-10T23:18:19.823848+0000","last_clean":"2024-09-10T23:18:19.823848+0000","last_became_active":"2024-09-10T23:18:18.818691+0000","last_became_peered":"2024-09-10T23:18:18.818691+0000","last_unstale":"2024-09-10T23:18:19.823848+0000","last_undegraded":"2024-09-10T23:18:19.823848+0000","last_fullsized":"2024-09-10T23:18:19.823848+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:20.746593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827135+0000","last_change":"2024-09-10T23:18:19.825731+0000","last_active":"2024-09-10T23:18:19.827135+0000","last_peered":"2024-09-10T23:18:19.827135+0000","last_clean":"2024-09-10T23:18:19.827135+0000","last_became_active":"2024-09-10T23:18:19.825416+0000","last_became_peered":"2024-09-10T23:18:19.825416+0000","last_unstale":"2024-09-10T23:18:19.827135+0000","last_undegraded":"2024-09-10T23:18:19.827135+0000","last_fullsized":"2024-09-10T23:18:19.827135+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:27.842754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.831004+0000","last_change":"2024-09-10T23:18:18.820513+0000","last_active":"2024-09-10T23:18:19.831004+0000","last_peered":"2024-09-10T23:18:19.831004+0000","last_clean":"2024-09-10T23:18:19.831004+0000","last_became_active":"2024-09-10T23:18:18.820183+0000","last_became_peered":"2024-09-10T23:18:18.820183+0000","last_unstale":"2024-09-10T23:18:19.831004+0000","last_undegraded":"2024-09-10T23:18:19.831004+0000","last_fullsized":"2024-09-10T23:18:19.831004+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:08.379933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.833668+0000","last_change":"2024-09-10T23:18:19.829138+0000","last_active":"2024-09-10T23:18:19.833668+0000","last_peered":"2024-09-10T23:18:19.833668+0000","last_clean":"2024-09-10T23:18:19.833668+0000","last_became_active":"2024-09-10T23:18:19.828828+0000","last_became_peered":"2024-09-10T23:18:19.828828+0000","last_unstale":"2024-09-10T23:18:19.833668+0000","last_undegraded":"2024-09-10T23:18:19.833668+0000","last_fullsized":"2024-09-10T23:18:19.833668+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:49.941431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.829764+0000","last_change":"2024-09-10T23:18:18.821467+0000","last_active":"2024-09-10T23:18:19.829764+0000","last_peered":"2024-09-10T23:18:19.829764+0000","last_clean":"2024-09-10T23:18:19.829764+0000","last_became_active":"2024-09-10T23:18:18.821210+0000","last_became_peered":"2024-09-10T23:18:18.821210+0000","last_unstale":"2024-09-10T23:18:19.829764+0000","last_undegraded":"2024-09-10T23:18:19.829764+0000","last_fullsized":"2024-09-10T23:18:19.829764+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:29.032172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.835172+0000","last_change":"2024-09-10T23:18:19.834277+0000","last_active":"2024-09-10T23:18:19.835172+0000","last_peered":"2024-09-10T23:18:19.835172+0000","last_clean":"2024-09-10T23:18:19.835172+0000","last_became_active":"2024-09-10T23:18:19.833905+0000","last_became_peered":"2024-09-10T23:18:19.833905+0000","last_unstale":"2024-09-10T23:18:19.835172+0000","last_undegraded":"2024-09-10T23:18:19.835172+0000","last_fullsized":"2024-09-10T23:18:19.835172+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:26.841269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.830179+0000","last_change":"2024-09-10T23:18:18.821805+0000","last_active":"2024-09-10T23:18:19.830179+0000","last_peered":"2024-09-10T23:18:19.830179+0000","last_clean":"2024-09-10T23:18:19.830179+0000","last_became_active":"2024-09-10T23:18:18.821524+0000","last_became_peered":"2024-09-10T23:18:18.821524+0000","last_unstale":"2024-09-10T23:18:19.830179+0000","last_undegraded":"2024-09-10T23:18:19.830179+0000","last_fullsized":"2024-09-10T23:18:19.830179+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:20.294151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825643+0000","last_change":"2024-09-10T23:18:18.818720+0000","last_active":"2024-09-10T23:18:19.825643+0000","last_peered":"2024-09-10T23:18:19.825643+0000","last_clean":"2024-09-10T23:18:19.825643+0000","last_became_active":"2024-09-10T23:18:18.818140+0000","last_became_peered":"2024-09-10T23:18:18.818140+0000","last_unstale":"2024-09-10T23:18:19.825643+0000","last_undegraded":"2024-09-10T23:18:19.825643+0000","last_fullsized":"2024-09-10T23:18:19.825643+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:38.107563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.831715+0000","last_change":"2024-09-10T23:18:19.824091+0000","last_active":"2024-09-10T23:18:19.831715+0000","last_peered":"2024-09-10T23:18:19.831715+0000","last_clean":"2024-09-10T23:18:19.831715+0000","last_became_active":"2024-09-10T23:18:19.823753+0000","last_became_peered":"2024-09-10T23:18:19.823753+0000","last_unstale":"2024-09-10T23:18:19.831715+0000","last_undegraded":"2024-09-10T23:18:19.831715+0000","last_fullsized":"2024-09-10T23:18:19.831715+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:17.744145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834288+0000","last_change":"2024-09-10T23:18:18.823235+0000","last_active":"2024-09-10T23:18:19.834288+0000","last_peered":"2024-09-10T23:18:19.834288+0000","last_clean":"2024-09-10T23:18:19.834288+0000","last_became_active":"2024-09-10T23:18:18.822974+0000","last_became_peered":"2024-09-10T23:18:18.822974+0000","last_unstale":"2024-09-10T23:18:19.834288+0000","last_undegraded":"2024-09-10T23:18:19.834288+0000","last_fullsized":"2024-09-10T23:18:19.834288+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:17.927105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.810595+0000","last_change":"2024-09-10T23:18:18.823934+0000","last_active":"2024-09-10T23:18:19.810595+0000","last_peered":"2024-09-10T23:18:19.810595+0000","last_clean":"2024-09-10T23:18:19.810595+0000","last_became_active":"2024-09-10T23:18:18.823678+0000","last_became_peered":"2024-09-10T23:18:18.823678+0000","last_unstale":"2024-09-10T23:18:19.810595+0000","last_undegraded":"2024-09-10T23:18:19.810595+0000","last_fullsized":"2024-09-10T23:18:19.810595+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:31.791308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825779+0000","last_change":"2024-09-10T23:18:19.823606+0000","last_active":"2024-09-10T23:18:19.825779+0000","last_peered":"2024-09-10T23:18:19.825779+0000","last_clean":"2024-09-10T23:18:19.825779+0000","last_became_active":"2024-09-10T23:18:19.823330+0000","last_became_peered":"2024-09-10T23:18:19.823330+0000","last_unstale":"2024-09-10T23:18:19.825779+0000","last_undegraded":"2024-09-10T23:18:19.825779+0000","last_fullsized":"2024-09-10T23:18:19.825779+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:53.310849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.805111+0000","last_change":"2024-09-10T23:18:17.805111+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.805111+0000","last_undegraded":"2024-09-10T23:18:17.805111+0000","last_fullsized":"2024-09-10T23:18:17.805111+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.830829+0000","last_change":"2024-09-10T23:18:19.828031+0000","last_active":"2024-09-10T23:18:19.830829+0000","last_peered":"2024-09-10T23:18:19.830829+0000","last_clean":"2024-09-10T23:18:19.830829+0000","last_became_active":"2024-09-10T23:18:19.827562+0000","last_became_peered":"2024-09-10T23:18:19.827562+0000","last_unstale":"2024-09-10T23:18:19.830829+0000","last_undegraded":"2024-09-10T23:18:19.830829+0000","last_fullsized":"2024-09-10T23:18:19.830829+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:02.739126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.816397+0000","last_change":"2024-09-10T23:18:18.819315+0000","last_active":"2024-09-10T23:18:19.816397+0000","last_peered":"2024-09-10T23:18:19.816397+0000","last_clean":"2024-09-10T23:18:19.816397+0000","last_became_active":"2024-09-10T23:18:18.819056+0000","last_became_peered":"2024-09-10T23:18:18.819056+0000","last_unstale":"2024-09-10T23:18:19.816397+0000","last_undegraded":"2024-09-10T23:18:19.816397+0000","last_fullsized":"2024-09-10T23:18:19.816397+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:14.032775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.826058+0000","last_change":"2024-09-10T23:18:19.824655+0000","last_active":"2024-09-10T23:18:19.826058+0000","last_peered":"2024-09-10T23:18:19.826058+0000","last_clean":"2024-09-10T23:18:19.826058+0000","last_became_active":"2024-09-10T23:18:19.824343+0000","last_became_peered":"2024-09-10T23:18:19.824343+0000","last_unstale":"2024-09-10T23:18:19.826058+0000","last_undegraded":"2024-09-10T23:18:19.826058+0000","last_fullsized":"2024-09-10T23:18:19.826058+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:01.734594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.813716+0000","last_change":"2024-09-10T23:18:18.818757+0000","last_active":"2024-09-10T23:18:19.813716+0000","last_peered":"2024-09-10T23:18:19.813716+0000","last_clean":"2024-09-10T23:18:19.813716+0000","last_became_active":"2024-09-10T23:18:18.818481+0000","last_became_peered":"2024-09-10T23:18:18.818481+0000","last_unstale":"2024-09-10T23:18:19.813716+0000","last_undegraded":"2024-09-10T23:18:19.813716+0000","last_fullsized":"2024-09-10T23:18:19.813716+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:26.837746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827614+0000","last_change":"2024-09-10T23:18:19.822703+0000","last_active":"2024-09-10T23:18:19.827614+0000","last_peered":"2024-09-10T23:18:19.827614+0000","last_clean":"2024-09-10T23:18:19.827614+0000","last_became_active":"2024-09-10T23:18:19.822469+0000","last_became_peered":"2024-09-10T23:18:19.822469+0000","last_unstale":"2024-09-10T23:18:19.827614+0000","last_undegraded":"2024-09-10T23:18:19.827614+0000","last_fullsized":"2024-09-10T23:18:19.827614+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:41.518449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804761+0000","last_change":"2024-09-10T23:18:17.804761+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804761+0000","last_undegraded":"2024-09-10T23:18:17.804761+0000","last_fullsized":"2024-09-10T23:18:17.804761+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.831276+0000","last_change":"2024-09-10T23:18:19.828960+0000","last_active":"2024-09-10T23:18:19.831276+0000","last_peered":"2024-09-10T23:18:19.831276+0000","last_clean":"2024-09-10T23:18:19.831276+0000","last_became_active":"2024-09-10T23:18:19.828713+0000","last_became_peered":"2024-09-10T23:18:19.828713+0000","last_unstale":"2024-09-10T23:18:19.831276+0000","last_undegraded":"2024-09-10T23:18:19.831276+0000","last_fullsized":"2024-09-10T23:18:19.831276+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:57.755101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804327+0000","last_change":"2024-09-10T23:18:17.804327+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804327+0000","last_undegraded":"2024-09-10T23:18:17.804327+0000","last_fullsized":"2024-09-10T23:18:17.804327+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827862+0000","last_change":"2024-09-10T23:18:19.825366+0000","last_active":"2024-09-10T23:18:19.827862+0000","last_peered":"2024-09-10T23:18:19.827862+0000","last_clean":"2024-09-10T23:18:19.827862+0000","last_became_active":"2024-09-10T23:18:19.824770+0000","last_became_peered":"2024-09-10T23:18:19.824770+0000","last_unstale":"2024-09-10T23:18:19.827862+0000","last_undegraded":"2024-09-10T23:18:19.827862+0000","last_fullsized":"2024-09-10T23:18:19.827862+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:03.765204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.835098+0000","last_change":"2024-09-10T23:18:18.817973+0000","last_active":"2024-09-10T23:18:19.835098+0000","last_peered":"2024-09-10T23:18:19.835098+0000","last_clean":"2024-09-10T23:18:19.835098+0000","last_became_active":"2024-09-10T23:18:18.817730+0000","last_became_peered":"2024-09-10T23:18:18.817730+0000","last_unstale":"2024-09-10T23:18:19.835098+0000","last_undegraded":"2024-09-10T23:18:19.835098+0000","last_fullsized":"2024-09-10T23:18:19.835098+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:47.032035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834233+0000","last_change":"2024-09-10T23:18:19.829079+0000","last_active":"2024-09-10T23:18:19.834233+0000","last_peered":"2024-09-10T23:18:19.834233+0000","last_clean":"2024-09-10T23:18:19.834233+0000","last_became_active":"2024-09-10T23:18:19.828829+0000","last_became_peered":"2024-09-10T23:18:19.828829+0000","last_unstale":"2024-09-10T23:18:19.834233+0000","last_undegraded":"2024-09-10T23:18:19.834233+0000","last_fullsized":"2024-09-10T23:18:19.834233+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:27.114207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.816267+0000","last_change":"2024-09-10T23:18:18.826768+0000","last_active":"2024-09-10T23:18:19.816267+0000","last_peered":"2024-09-10T23:18:19.816267+0000","last_clean":"2024-09-10T23:18:19.816267+0000","last_became_active":"2024-09-10T23:18:18.826502+0000","last_became_peered":"2024-09-10T23:18:18.826502+0000","last_unstale":"2024-09-10T23:18:19.816267+0000","last_undegraded":"2024-09-10T23:18:19.816267+0000","last_fullsized":"2024-09-10T23:18:19.816267+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:48.343739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827452+0000","last_change":"2024-09-10T23:18:19.822055+0000","last_active":"2024-09-10T23:18:19.827452+0000","last_peered":"2024-09-10T23:18:19.827452+0000","last_clean":"2024-09-10T23:18:19.827452+0000","last_became_active":"2024-09-10T23:18:19.821803+0000","last_became_peered":"2024-09-10T23:18:19.821803+0000","last_unstale":"2024-09-10T23:18:19.827452+0000","last_undegraded":"2024-09-10T23:18:19.827452+0000","last_fullsized":"2024-09-10T23:18:19.827452+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:56.084094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"103'8","reported_seq":21,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.835219+0000","last_change":"2024-09-10T23:18:18.821437+0000","last_active":"2024-09-10T23:18:19.835219+0000","last_peered":"2024-09-10T23:18:19.835219+0000","last_clean":"2024-09-10T23:18:19.835219+0000","last_became_active":"2024-09-10T23:18:18.821139+0000","last_became_peered":"2024-09-10T23:18:18.821139+0000","last_unstale":"2024-09-10T23:18:19.835219+0000","last_undegraded":"2024-09-10T23:18:19.835219+0000","last_fullsized":"2024-09-10T23:18:19.835219+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:34.527204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825319+0000","last_change":"2024-09-10T23:18:19.823839+0000","last_active":"2024-09-10T23:18:19.825319+0000","last_peered":"2024-09-10T23:18:19.825319+0000","last_clean":"2024-09-10T23:18:19.825319+0000","last_became_active":"2024-09-10T23:18:19.823562+0000","last_became_peered":"2024-09-10T23:18:19.823562+0000","last_unstale":"2024-09-10T23:18:19.825319+0000","last_undegraded":"2024-09-10T23:18:19.825319+0000","last_fullsized":"2024-09-10T23:18:19.825319+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:52.644364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804322+0000","last_change":"2024-09-10T23:18:17.804322+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804322+0000","last_undegraded":"2024-09-10T23:18:17.804322+0000","last_fullsized":"2024-09-10T23:18:17.804322+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837701+0000","last_change":"2024-09-10T23:18:19.831151+0000","last_active":"2024-09-10T23:18:19.837701+0000","last_peered":"2024-09-10T23:18:19.837701+0000","last_clean":"2024-09-10T23:18:19.837701+0000","last_became_active":"2024-09-10T23:18:19.830881+0000","last_became_peered":"2024-09-10T23:18:19.830881+0000","last_unstale":"2024-09-10T23:18:19.837701+0000","last_undegraded":"2024-09-10T23:18:19.837701+0000","last_fullsized":"2024-09-10T23:18:19.837701+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:12.216598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.832483+0000","last_change":"2024-09-10T23:18:18.822172+0000","last_active":"2024-09-10T23:18:19.832483+0000","last_peered":"2024-09-10T23:18:19.832483+0000","last_clean":"2024-09-10T23:18:19.832483+0000","last_became_active":"2024-09-10T23:18:18.821867+0000","last_became_peered":"2024-09-10T23:18:18.821867+0000","last_unstale":"2024-09-10T23:18:19.832483+0000","last_undegraded":"2024-09-10T23:18:19.832483+0000","last_fullsized":"2024-09-10T23:18:19.832483+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:28.101107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.839695+0000","last_change":"2024-09-10T23:18:19.838948+0000","last_active":"2024-09-10T23:18:19.839695+0000","last_peered":"2024-09-10T23:18:19.839695+0000","last_clean":"2024-09-10T23:18:19.839695+0000","last_became_active":"2024-09-10T23:18:19.838478+0000","last_became_peered":"2024-09-10T23:18:19.838478+0000","last_unstale":"2024-09-10T23:18:19.839695+0000","last_undegraded":"2024-09-10T23:18:19.839695+0000","last_fullsized":"2024-09-10T23:18:19.839695+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:21.069271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.828742+0000","last_change":"2024-09-10T23:18:18.828797+0000","last_active":"2024-09-10T23:18:19.828742+0000","last_peered":"2024-09-10T23:18:19.828742+0000","last_clean":"2024-09-10T23:18:19.828742+0000","last_became_active":"2024-09-10T23:18:18.828538+0000","last_became_peered":"2024-09-10T23:18:18.828538+0000","last_unstale":"2024-09-10T23:18:19.828742+0000","last_undegraded":"2024-09-10T23:18:19.828742+0000","last_fullsized":"2024-09-10T23:18:19.828742+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:14.953384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834779+0000","last_change":"2024-09-10T23:18:19.832939+0000","last_active":"2024-09-10T23:18:19.834779+0000","last_peered":"2024-09-10T23:18:19.834779+0000","last_clean":"2024-09-10T23:18:19.834779+0000","last_became_active":"2024-09-10T23:18:19.832618+0000","last_became_peered":"2024-09-10T23:18:19.832618+0000","last_unstale":"2024-09-10T23:18:19.834779+0000","last_undegraded":"2024-09-10T23:18:19.834779+0000","last_fullsized":"2024-09-10T23:18:19.834779+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:09.419897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.809176+0000","last_change":"2024-09-10T23:18:18.821792+0000","last_active":"2024-09-10T23:18:19.809176+0000","last_peered":"2024-09-10T23:18:19.809176+0000","last_clean":"2024-09-10T23:18:19.809176+0000","last_became_active":"2024-09-10T23:18:18.821465+0000","last_became_peered":"2024-09-10T23:18:18.821465+0000","last_unstale":"2024-09-10T23:18:19.809176+0000","last_undegraded":"2024-09-10T23:18:19.809176+0000","last_fullsized":"2024-09-10T23:18:19.809176+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:53.324053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834680+0000","last_change":"2024-09-10T23:18:19.832542+0000","last_active":"2024-09-10T23:18:19.834680+0000","last_peered":"2024-09-10T23:18:19.834680+0000","last_clean":"2024-09-10T23:18:19.834680+0000","last_became_active":"2024-09-10T23:18:19.832208+0000","last_became_peered":"2024-09-10T23:18:19.832208+0000","last_unstale":"2024-09-10T23:18:19.834680+0000","last_undegraded":"2024-09-10T23:18:19.834680+0000","last_fullsized":"2024-09-10T23:18:19.834680+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:38.816382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.828537+0000","last_change":"2024-09-10T23:18:18.823102+0000","last_active":"2024-09-10T23:18:19.828537+0000","last_peered":"2024-09-10T23:18:19.828537+0000","last_clean":"2024-09-10T23:18:19.828537+0000","last_became_active":"2024-09-10T23:18:18.822794+0000","last_became_peered":"2024-09-10T23:18:18.822794+0000","last_unstale":"2024-09-10T23:18:19.828537+0000","last_undegraded":"2024-09-10T23:18:19.828537+0000","last_fullsized":"2024-09-10T23:18:19.828537+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:29.032172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.817130+0000","last_change":"2024-09-10T23:18:18.821285+0000","last_active":"2024-09-10T23:18:19.817130+0000","last_peered":"2024-09-10T23:18:19.817130+0000","last_clean":"2024-09-10T23:18:19.817130+0000","last_became_active":"2024-09-10T23:18:18.820993+0000","last_became_peered":"2024-09-10T23:18:18.820993+0000","last_unstale":"2024-09-10T23:18:19.817130+0000","last_undegraded":"2024-09-10T23:18:19.817130+0000","last_fullsized":"2024-09-10T23:18:19.817130+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:47.032035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837793+0000","last_change":"2024-09-10T23:18:19.836596+0000","last_active":"2024-09-10T23:18:19.837793+0000","last_peered":"2024-09-10T23:18:19.837793+0000","last_clean":"2024-09-10T23:18:19.837793+0000","last_became_active":"2024-09-10T23:18:19.836333+0000","last_became_peered":"2024-09-10T23:18:19.836333+0000","last_unstale":"2024-09-10T23:18:19.837793+0000","last_undegraded":"2024-09-10T23:18:19.837793+0000","last_fullsized":"2024-09-10T23:18:19.837793+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:53.315354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.824644+0000","last_change":"2024-09-10T23:18:18.824334+0000","last_active":"2024-09-10T23:18:19.824644+0000","last_peered":"2024-09-10T23:18:19.824644+0000","last_clean":"2024-09-10T23:18:19.824644+0000","last_became_active":"2024-09-10T23:18:18.824076+0000","last_became_peered":"2024-09-10T23:18:18.824076+0000","last_unstale":"2024-09-10T23:18:19.824644+0000","last_undegraded":"2024-09-10T23:18:19.824644+0000","last_fullsized":"2024-09-10T23:18:19.824644+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:51.639356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.835189+0000","last_change":"2024-09-10T23:18:19.832624+0000","last_active":"2024-09-10T23:18:19.835189+0000","last_peered":"2024-09-10T23:18:19.835189+0000","last_clean":"2024-09-10T23:18:19.835189+0000","last_became_active":"2024-09-10T23:18:19.832337+0000","last_became_peered":"2024-09-10T23:18:19.832337+0000","last_unstale":"2024-09-10T23:18:19.835189+0000","last_undegraded":"2024-09-10T23:18:19.835189+0000","last_fullsized":"2024-09-10T23:18:19.835189+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:01.080207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804673+0000","last_change":"2024-09-10T23:18:17.804673+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804673+0000","last_undegraded":"2024-09-10T23:18:17.804673+0000","last_fullsized":"2024-09-10T23:18:17.804673+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825173+0000","last_change":"2024-09-10T23:18:19.819937+0000","last_active":"2024-09-10T23:18:19.825173+0000","last_peered":"2024-09-10T23:18:19.825173+0000","last_clean":"2024-09-10T23:18:19.825173+0000","last_became_active":"2024-09-10T23:18:19.819609+0000","last_became_peered":"2024-09-10T23:18:19.819609+0000","last_unstale":"2024-09-10T23:18:19.825173+0000","last_undegraded":"2024-09-10T23:18:19.825173+0000","last_fullsized":"2024-09-10T23:18:19.825173+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:33:38.788016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.836909+0000","last_change":"2024-09-10T23:18:18.823508+0000","last_active":"2024-09-10T23:18:19.836909+0000","last_peered":"2024-09-10T23:18:19.836909+0000","last_clean":"2024-09-10T23:18:19.836909+0000","last_became_active":"2024-09-10T23:18:18.823163+0000","last_became_peered":"2024-09-10T23:18:18.823163+0000","last_unstale":"2024-09-10T23:18:19.836909+0000","last_undegraded":"2024-09-10T23:18:19.836909+0000","last_fullsized":"2024-09-10T23:18:19.836909+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:57.336353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.816402+0000","last_change":"2024-09-10T23:18:18.818495+0000","last_active":"2024-09-10T23:18:19.816402+0000","last_peered":"2024-09-10T23:18:19.816402+0000","last_clean":"2024-09-10T23:18:19.816402+0000","last_became_active":"2024-09-10T23:18:18.818166+0000","last_became_peered":"2024-09-10T23:18:18.818166+0000","last_unstale":"2024-09-10T23:18:19.816402+0000","last_undegraded":"2024-09-10T23:18:19.816402+0000","last_fullsized":"2024-09-10T23:18:19.816402+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:17.521005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804344+0000","last_change":"2024-09-10T23:18:17.804344+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804344+0000","last_undegraded":"2024-09-10T23:18:17.804344+0000","last_fullsized":"2024-09-10T23:18:17.804344+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825109+0000","last_change":"2024-09-10T23:18:19.819902+0000","last_active":"2024-09-10T23:18:19.825109+0000","last_peered":"2024-09-10T23:18:19.825109+0000","last_clean":"2024-09-10T23:18:19.825109+0000","last_became_active":"2024-09-10T23:18:19.819597+0000","last_became_peered":"2024-09-10T23:18:19.819597+0000","last_unstale":"2024-09-10T23:18:19.825109+0000","last_undegraded":"2024-09-10T23:18:19.825109+0000","last_fullsized":"2024-09-10T23:18:19.825109+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:24.559448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.817328+0000","last_change":"2024-09-10T23:18:18.823716+0000","last_active":"2024-09-10T23:18:19.817328+0000","last_peered":"2024-09-10T23:18:19.817328+0000","last_clean":"2024-09-10T23:18:19.817328+0000","last_became_active":"2024-09-10T23:18:18.823450+0000","last_became_peered":"2024-09-10T23:18:18.823450+0000","last_unstale":"2024-09-10T23:18:19.817328+0000","last_undegraded":"2024-09-10T23:18:19.817328+0000","last_fullsized":"2024-09-10T23:18:19.817328+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:00.834074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.820383+0000","last_change":"2024-09-10T23:18:19.813945+0000","last_active":"2024-09-10T23:18:19.820383+0000","last_peered":"2024-09-10T23:18:19.820383+0000","last_clean":"2024-09-10T23:18:19.820383+0000","last_became_active":"2024-09-10T23:18:19.813279+0000","last_became_peered":"2024-09-10T23:18:19.813279+0000","last_unstale":"2024-09-10T23:18:19.820383+0000","last_undegraded":"2024-09-10T23:18:19.820383+0000","last_fullsized":"2024-09-10T23:18:19.820383+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:05.534969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.809221+0000","last_change":"2024-09-10T23:18:18.818409+0000","last_active":"2024-09-10T23:18:19.809221+0000","last_peered":"2024-09-10T23:18:19.809221+0000","last_clean":"2024-09-10T23:18:19.809221+0000","last_became_active":"2024-09-10T23:18:18.817769+0000","last_became_peered":"2024-09-10T23:18:18.817769+0000","last_unstale":"2024-09-10T23:18:19.809221+0000","last_undegraded":"2024-09-10T23:18:19.809221+0000","last_fullsized":"2024-09-10T23:18:19.809221+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:22:24.800421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.831874+0000","last_change":"2024-09-10T23:18:19.826769+0000","last_active":"2024-09-10T23:18:19.831874+0000","last_peered":"2024-09-10T23:18:19.831874+0000","last_clean":"2024-09-10T23:18:19.831874+0000","last_became_active":"2024-09-10T23:18:19.826467+0000","last_became_peered":"2024-09-10T23:18:19.826467+0000","last_unstale":"2024-09-10T23:18:19.831874+0000","last_undegraded":"2024-09-10T23:18:19.831874+0000","last_fullsized":"2024-09-10T23:18:19.831874+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:19.420378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.811272+0000","last_change":"2024-09-10T23:18:18.820337+0000","last_active":"2024-09-10T23:18:19.811272+0000","last_peered":"2024-09-10T23:18:19.811272+0000","last_clean":"2024-09-10T23:18:19.811272+0000","last_became_active":"2024-09-10T23:18:18.820040+0000","last_became_peered":"2024-09-10T23:18:18.820040+0000","last_unstale":"2024-09-10T23:18:19.811272+0000","last_undegraded":"2024-09-10T23:18:19.811272+0000","last_fullsized":"2024-09-10T23:18:19.811272+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:12.068147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834708+0000","last_change":"2024-09-10T23:18:19.833541+0000","last_active":"2024-09-10T23:18:19.834708+0000","last_peered":"2024-09-10T23:18:19.834708+0000","last_clean":"2024-09-10T23:18:19.834708+0000","last_became_active":"2024-09-10T23:18:19.833278+0000","last_became_peered":"2024-09-10T23:18:19.833278+0000","last_unstale":"2024-09-10T23:18:19.834708+0000","last_undegraded":"2024-09-10T23:18:19.834708+0000","last_fullsized":"2024-09-10T23:18:19.834708+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:34.315019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.815852+0000","last_change":"2024-09-10T23:18:18.822619+0000","last_active":"2024-09-10T23:18:19.815852+0000","last_peered":"2024-09-10T23:18:19.815852+0000","last_clean":"2024-09-10T23:18:19.815852+0000","last_became_active":"2024-09-10T23:18:18.822363+0000","last_became_peered":"2024-09-10T23:18:18.822363+0000","last_unstale":"2024-09-10T23:18:19.815852+0000","last_undegraded":"2024-09-10T23:18:19.815852+0000","last_fullsized":"2024-09-10T23:18:19.815852+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:13.423487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.803615+0000","last_change":"2024-09-10T23:18:17.803615+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.803615+0000","last_undegraded":"2024-09-10T23:18:17.803615+0000","last_fullsized":"2024-09-10T23:18:17.803615+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834757+0000","last_change":"2024-09-10T23:18:19.829796+0000","last_active":"2024-09-10T23:18:19.834757+0000","last_peered":"2024-09-10T23:18:19.834757+0000","last_clean":"2024-09-10T23:18:19.834757+0000","last_became_active":"2024-09-10T23:18:19.829530+0000","last_became_peered":"2024-09-10T23:18:19.829530+0000","last_unstale":"2024-09-10T23:18:19.834757+0000","last_undegraded":"2024-09-10T23:18:19.834757+0000","last_fullsized":"2024-09-10T23:18:19.834757+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:56.155914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.810245+0000","last_change":"2024-09-10T23:18:18.821522+0000","last_active":"2024-09-10T23:18:19.810245+0000","last_peered":"2024-09-10T23:18:19.810245+0000","last_clean":"2024-09-10T23:18:19.810245+0000","last_became_active":"2024-09-10T23:18:18.821236+0000","last_became_peered":"2024-09-10T23:18:18.821236+0000","last_unstale":"2024-09-10T23:18:19.810245+0000","last_undegraded":"2024-09-10T23:18:19.810245+0000","last_fullsized":"2024-09-10T23:18:19.810245+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:17.910202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":255,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825975+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:18:19.825975+0000","last_peered":"2024-09-10T23:18:19.825975+0000","last_clean":"2024-09-10T23:18:19.825975+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:18:19.825975+0000","last_undegraded":"2024-09-10T23:18:19.825975+0000","last_fullsized":"2024-09-10T23:18:19.825975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28864,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342976,"statfs":{"total":96636764160,"available":96607207424,"internally_reserved":0,"allocated":1875968,"data_stored":1130931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1277952,"data_stored":540017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1282048,"data_stored":540551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1273856,"data_stored":539947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509492,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1261568,"data_stored":533172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1273856,"data_stored":539947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509492,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1282048,"data_stored":540071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32988,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338852,"statfs":{"total":96636764160,"available":96602984448,"internally_reserved":0,"allocated":1843200,"data_stored":1117265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:18:22.785 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:18:22.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.919+0000 7fdccb4ef640 1 -- 172.21.15.90:0/903939203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcc40cdb90 msgr2=0x7fdcc40b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:22.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.919+0000 7fdccb4ef640 1 --2- 172.21.15.90:0/903939203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcc40cdb90 0x7fdcc40b43e0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40b40d0 tx=0x7fdcbc02aa10 comp rx=0 tx=0).stop 2024-09-10T23:18:22.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.919+0000 7fdccb4ef640 1 -- 172.21.15.90:0/903939203 shutdown_connections 2024-09-10T23:18:22.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.919+0000 7fdccb4ef640 1 --2- 172.21.15.90:0/903939203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcc40cdb90 0x7fdcc40b43e0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.919+0000 7fdccb4ef640 1 --2- 172.21.15.90:0/903939203 >> v2:172.21.15.171:3300/0 conn(0x7fdcc406e6f0 0x7fdcc415a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.919+0000 7fdccb4ef640 1 -- 172.21.15.90:0/903939203 >> 172.21.15.90:0/903939203 conn(0x7fdcc40b19c0 msgr2=0x7fdcc40b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:22.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.919+0000 7fdccb4ef640 1 -- 172.21.15.90:0/903939203 shutdown_connections 2024-09-10T23:18:22.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.919+0000 7fdccb4ef640 1 -- 172.21.15.90:0/903939203 wait complete. 2024-09-10T23:18:22.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.920+0000 7fdccb4ef640 1 Processor -- start 2024-09-10T23:18:22.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.920+0000 7fdccb4ef640 1 -- start start 2024-09-10T23:18:22.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.921+0000 7fdccb4ef640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcc406e6f0 0x7fdcc4145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:22.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.921+0000 7fdccb4ef640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcc40708b0 0x7fdcc409aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:22.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.921+0000 7fdccb4ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcc40cdb90 0x7fdcc41f04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:22.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.921+0000 7fdccb4ef640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc40b4cb0 con 0x7fdcc40cdb90 2024-09-10T23:18:22.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.921+0000 7fdccb4ef640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc40b4b30 con 0x7fdcc406e6f0 2024-09-10T23:18:22.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.921+0000 7fdccb4ef640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc40b4e30 con 0x7fdcc40708b0 2024-09-10T23:18:22.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.921+0000 7fdcc9a8c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcc40cdb90 0x7fdcc41f04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:22.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.921+0000 7fdcc9a8c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcc40cdb90 0x7fdcc41f04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56382/0 (socket says 172.21.15.90:56382) 2024-09-10T23:18:22.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.921+0000 7fdcc9a8c640 1 -- 172.21.15.90:0/3040574870 learned_addr learned my addr 172.21.15.90:0/3040574870 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:22.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.921+0000 7fdcc928b640 1 --2- 172.21.15.90:0/3040574870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcc406e6f0 0x7fdcc4145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:22.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.921+0000 7fdcc8a8a640 1 --2- 172.21.15.90:0/3040574870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcc40708b0 0x7fdcc409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:22.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.921+0000 7fdcc9a8c640 1 -- 172.21.15.90:0/3040574870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcc40708b0 msgr2=0x7fdcc409aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:22.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.921+0000 7fdcc9a8c640 1 --2- 172.21.15.90:0/3040574870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcc40708b0 0x7fdcc409aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.921+0000 7fdcc9a8c640 1 -- 172.21.15.90:0/3040574870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcc406e6f0 msgr2=0x7fdcc4145080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:22.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.921+0000 7fdcc9a8c640 1 --2- 172.21.15.90:0/3040574870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcc406e6f0 0x7fdcc4145080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:22.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.921+0000 7fdcc9a8c640 1 -- 172.21.15.90:0/3040574870 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc409d040 con 0x7fdcc40cdb90 2024-09-10T23:18:22.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.921+0000 7fdcc9a8c640 1 --2- 172.21.15.90:0/3040574870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcc40cdb90 0x7fdcc41f04d0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc02b000 tx=0x7fdcbc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:22.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.922+0000 7fdcb9ffb640 1 -- 172.21.15.90:0/3040574870 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc033050 con 0x7fdcc40cdb90 2024-09-10T23:18:22.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.922+0000 7fdcb9ffb640 1 -- 172.21.15.90:0/3040574870 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcbc004550 con 0x7fdcc40cdb90 2024-09-10T23:18:22.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.922+0000 7fdccb4ef640 1 -- 172.21.15.90:0/3040574870 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc409d320 con 0x7fdcc40cdb90 2024-09-10T23:18:22.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.922+0000 7fdcb9ffb640 1 -- 172.21.15.90:0/3040574870 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc038450 con 0x7fdcc40cdb90 2024-09-10T23:18:22.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.922+0000 7fdccb4ef640 1 -- 172.21.15.90:0/3040574870 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc41559c0 con 0x7fdcc40cdb90 2024-09-10T23:18:22.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.923+0000 7fdccb4ef640 1 -- 172.21.15.90:0/3040574870 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc415a1d0 con 0x7fdcc40cdb90 2024-09-10T23:18:22.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.923+0000 7fdcb9ffb640 1 -- 172.21.15.90:0/3040574870 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdcbc040070 con 0x7fdcc40cdb90 2024-09-10T23:18:22.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.924+0000 7fdcb9ffb640 1 --2- 172.21.15.90:0/3040574870 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdca8077f70 0x7fdca807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:22.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.924+0000 7fdcb9ffb640 1 -- 172.21.15.90:0/3040574870 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fdcbc0bb1a0 con 0x7fdcc40cdb90 2024-09-10T23:18:22.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.924+0000 7fdcc928b640 1 --2- 172.21.15.90:0/3040574870 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdca8077f70 0x7fdca807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:22.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.925+0000 7fdcc928b640 1 --2- 172.21.15.90:0/3040574870 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdca8077f70 0x7fdca807a430 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00058c0 tx=0x7fdcc000a4c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:22.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:22.928+0000 7fdcb9ffb640 1 -- 172.21.15.90:0/3040574870 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdcbc083ca0 con 0x7fdcc40cdb90 2024-09-10T23:18:23.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.099+0000 7fdccb4ef640 1 -- 172.21.15.90:0/3040574870 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdcc4155b90 con 0x7fdca8077f70 2024-09-10T23:18:23.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.103+0000 7fdcb9ffb640 1 -- 172.21.15.90:0/3040574870 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249958 (secure 0 0 0) 0x7fdcc4155b90 con 0x7fdca8077f70 2024-09-10T23:18:23.127 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:23.128 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:18:23.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.106+0000 7fdccb4ef640 1 -- 172.21.15.90:0/3040574870 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdca8077f70 msgr2=0x7fdca807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:23.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.106+0000 7fdccb4ef640 1 --2- 172.21.15.90:0/3040574870 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdca8077f70 0x7fdca807a430 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00058c0 tx=0x7fdcc000a4c0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.106+0000 7fdccb4ef640 1 -- 172.21.15.90:0/3040574870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcc40cdb90 msgr2=0x7fdcc41f04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:23.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.106+0000 7fdccb4ef640 1 --2- 172.21.15.90:0/3040574870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcc40cdb90 0x7fdcc41f04d0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc02b000 tx=0x7fdcbc003f10 comp rx=0 tx=0).stop 2024-09-10T23:18:23.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.106+0000 7fdccb4ef640 1 -- 172.21.15.90:0/3040574870 shutdown_connections 2024-09-10T23:18:23.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.106+0000 7fdccb4ef640 1 --2- 172.21.15.90:0/3040574870 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdca8077f70 0x7fdca807a430 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.106+0000 7fdccb4ef640 1 --2- 172.21.15.90:0/3040574870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcc40cdb90 0x7fdcc41f04d0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.106+0000 7fdccb4ef640 1 --2- 172.21.15.90:0/3040574870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcc40708b0 0x7fdcc409aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.106+0000 7fdccb4ef640 1 --2- 172.21.15.90:0/3040574870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcc406e6f0 0x7fdcc4145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.106+0000 7fdccb4ef640 1 -- 172.21.15.90:0/3040574870 >> 172.21.15.90:0/3040574870 conn(0x7fdcc40b19c0 msgr2=0x7fdcc40727c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:23.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.106+0000 7fdccb4ef640 1 -- 172.21.15.90:0/3040574870 shutdown_connections 2024-09-10T23:18:23.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.106+0000 7fdccb4ef640 1 -- 172.21.15.90:0/3040574870 wait complete. 2024-09-10T23:18:23.131 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-09-10T23:18:22.488411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256484,"kb_used_data":11104,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754718236,"statfs":{"total":773094113280,"available":772831473664,"internally_reserved":0,"allocated":11370496,"data_stored":5481901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.689104"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.838845+0000","last_change":"2024-09-10T23:18:19.834081+0000","last_active":"2024-09-10T23:18:19.838845+0000","last_peered":"2024-09-10T23:18:19.838845+0000","last_clean":"2024-09-10T23:18:19.838845+0000","last_became_active":"2024-09-10T23:18:19.833811+0000","last_became_peered":"2024-09-10T23:18:19.833811+0000","last_unstale":"2024-09-10T23:18:19.838845+0000","last_undegraded":"2024-09-10T23:18:19.838845+0000","last_fullsized":"2024-09-10T23:18:19.838845+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:42.460246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834642+0000","last_change":"2024-09-10T23:18:19.832637+0000","last_active":"2024-09-10T23:18:19.834642+0000","last_peered":"2024-09-10T23:18:19.834642+0000","last_clean":"2024-09-10T23:18:19.834642+0000","last_became_active":"2024-09-10T23:18:19.832256+0000","last_became_peered":"2024-09-10T23:18:19.832256+0000","last_unstale":"2024-09-10T23:18:19.834642+0000","last_undegraded":"2024-09-10T23:18:19.834642+0000","last_fullsized":"2024-09-10T23:18:19.834642+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:30:32.840023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.828014+0000","last_change":"2024-09-10T23:18:19.825136+0000","last_active":"2024-09-10T23:18:19.828014+0000","last_peered":"2024-09-10T23:18:19.828014+0000","last_clean":"2024-09-10T23:18:19.828014+0000","last_became_active":"2024-09-10T23:18:19.824888+0000","last_became_peered":"2024-09-10T23:18:19.824888+0000","last_unstale":"2024-09-10T23:18:19.828014+0000","last_undegraded":"2024-09-10T23:18:19.828014+0000","last_fullsized":"2024-09-10T23:18:19.828014+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:28.093748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.833700+0000","last_change":"2024-09-10T23:18:19.829960+0000","last_active":"2024-09-10T23:18:19.833700+0000","last_peered":"2024-09-10T23:18:19.833700+0000","last_clean":"2024-09-10T23:18:19.833700+0000","last_became_active":"2024-09-10T23:18:19.829678+0000","last_became_peered":"2024-09-10T23:18:19.829678+0000","last_unstale":"2024-09-10T23:18:19.833700+0000","last_undegraded":"2024-09-10T23:18:19.833700+0000","last_fullsized":"2024-09-10T23:18:19.833700+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:53.316251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.826013+0000","last_change":"2024-09-10T23:18:19.824702+0000","last_active":"2024-09-10T23:18:19.826013+0000","last_peered":"2024-09-10T23:18:19.826013+0000","last_clean":"2024-09-10T23:18:19.826013+0000","last_became_active":"2024-09-10T23:18:19.824418+0000","last_became_peered":"2024-09-10T23:18:19.824418+0000","last_unstale":"2024-09-10T23:18:19.826013+0000","last_undegraded":"2024-09-10T23:18:19.826013+0000","last_fullsized":"2024-09-10T23:18:19.826013+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:31.405406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.839466+0000","last_change":"2024-09-10T23:18:19.838305+0000","last_active":"2024-09-10T23:18:19.839466+0000","last_peered":"2024-09-10T23:18:19.839466+0000","last_clean":"2024-09-10T23:18:19.839466+0000","last_became_active":"2024-09-10T23:18:19.838086+0000","last_became_peered":"2024-09-10T23:18:19.838086+0000","last_unstale":"2024-09-10T23:18:19.839466+0000","last_undegraded":"2024-09-10T23:18:19.839466+0000","last_fullsized":"2024-09-10T23:18:19.839466+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:43.611606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.829125+0000","last_change":"2024-09-10T23:18:19.823321+0000","last_active":"2024-09-10T23:18:19.829125+0000","last_peered":"2024-09-10T23:18:19.829125+0000","last_clean":"2024-09-10T23:18:19.829125+0000","last_became_active":"2024-09-10T23:18:19.823022+0000","last_became_peered":"2024-09-10T23:18:19.823022+0000","last_unstale":"2024-09-10T23:18:19.829125+0000","last_undegraded":"2024-09-10T23:18:19.829125+0000","last_fullsized":"2024-09-10T23:18:19.829125+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:53.037910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834686+0000","last_change":"2024-09-10T23:18:19.832545+0000","last_active":"2024-09-10T23:18:19.834686+0000","last_peered":"2024-09-10T23:18:19.834686+0000","last_clean":"2024-09-10T23:18:19.834686+0000","last_became_active":"2024-09-10T23:18:19.832235+0000","last_became_peered":"2024-09-10T23:18:19.832235+0000","last_unstale":"2024-09-10T23:18:19.834686+0000","last_undegraded":"2024-09-10T23:18:19.834686+0000","last_fullsized":"2024-09-10T23:18:19.834686+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:41.518449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.833830+0000","last_change":"2024-09-10T23:18:19.829837+0000","last_active":"2024-09-10T23:18:19.833830+0000","last_peered":"2024-09-10T23:18:19.833830+0000","last_clean":"2024-09-10T23:18:19.833830+0000","last_became_active":"2024-09-10T23:18:19.829518+0000","last_became_peered":"2024-09-10T23:18:19.829518+0000","last_unstale":"2024-09-10T23:18:19.833830+0000","last_undegraded":"2024-09-10T23:18:19.833830+0000","last_fullsized":"2024-09-10T23:18:19.833830+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:39.632376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.833720+0000","last_change":"2024-09-10T23:18:19.828982+0000","last_active":"2024-09-10T23:18:19.833720+0000","last_peered":"2024-09-10T23:18:19.833720+0000","last_clean":"2024-09-10T23:18:19.833720+0000","last_became_active":"2024-09-10T23:18:19.828736+0000","last_became_peered":"2024-09-10T23:18:19.828736+0000","last_unstale":"2024-09-10T23:18:19.833720+0000","last_undegraded":"2024-09-10T23:18:19.833720+0000","last_fullsized":"2024-09-10T23:18:19.833720+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:28.093748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.829196+0000","last_change":"2024-09-10T23:18:19.825287+0000","last_active":"2024-09-10T23:18:19.829196+0000","last_peered":"2024-09-10T23:18:19.829196+0000","last_clean":"2024-09-10T23:18:19.829196+0000","last_became_active":"2024-09-10T23:18:19.824111+0000","last_became_peered":"2024-09-10T23:18:19.824111+0000","last_unstale":"2024-09-10T23:18:19.829196+0000","last_undegraded":"2024-09-10T23:18:19.829196+0000","last_fullsized":"2024-09-10T23:18:19.829196+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:01:08.499643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825197+0000","last_change":"2024-09-10T23:18:19.821436+0000","last_active":"2024-09-10T23:18:19.825197+0000","last_peered":"2024-09-10T23:18:19.825197+0000","last_clean":"2024-09-10T23:18:19.825197+0000","last_became_active":"2024-09-10T23:18:19.821140+0000","last_became_peered":"2024-09-10T23:18:19.821140+0000","last_unstale":"2024-09-10T23:18:19.825197+0000","last_undegraded":"2024-09-10T23:18:19.825197+0000","last_fullsized":"2024-09-10T23:18:19.825197+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:15.016694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834087+0000","last_change":"2024-09-10T23:18:19.830445+0000","last_active":"2024-09-10T23:18:19.834087+0000","last_peered":"2024-09-10T23:18:19.834087+0000","last_clean":"2024-09-10T23:18:19.834087+0000","last_became_active":"2024-09-10T23:18:19.829974+0000","last_became_peered":"2024-09-10T23:18:19.829974+0000","last_unstale":"2024-09-10T23:18:19.834087+0000","last_undegraded":"2024-09-10T23:18:19.834087+0000","last_fullsized":"2024-09-10T23:18:19.834087+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:42.460246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834787+0000","last_change":"2024-09-10T23:18:19.831066+0000","last_active":"2024-09-10T23:18:19.834787+0000","last_peered":"2024-09-10T23:18:19.834787+0000","last_clean":"2024-09-10T23:18:19.834787+0000","last_became_active":"2024-09-10T23:18:19.830803+0000","last_became_peered":"2024-09-10T23:18:19.830803+0000","last_unstale":"2024-09-10T23:18:19.834787+0000","last_undegraded":"2024-09-10T23:18:19.834787+0000","last_fullsized":"2024-09-10T23:18:19.834787+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:09.384941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.823957+0000","last_change":"2024-09-10T23:18:19.816681+0000","last_active":"2024-09-10T23:18:19.823957+0000","last_peered":"2024-09-10T23:18:19.823957+0000","last_clean":"2024-09-10T23:18:19.823957+0000","last_became_active":"2024-09-10T23:18:19.816379+0000","last_became_peered":"2024-09-10T23:18:19.816379+0000","last_unstale":"2024-09-10T23:18:19.823957+0000","last_undegraded":"2024-09-10T23:18:19.823957+0000","last_fullsized":"2024-09-10T23:18:19.823957+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:22.335062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827839+0000","last_change":"2024-09-10T23:18:19.825076+0000","last_active":"2024-09-10T23:18:19.827839+0000","last_peered":"2024-09-10T23:18:19.827839+0000","last_clean":"2024-09-10T23:18:19.827839+0000","last_became_active":"2024-09-10T23:18:19.824432+0000","last_became_peered":"2024-09-10T23:18:19.824432+0000","last_unstale":"2024-09-10T23:18:19.827839+0000","last_undegraded":"2024-09-10T23:18:19.827839+0000","last_fullsized":"2024-09-10T23:18:19.827839+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:22.800159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834640+0000","last_change":"2024-09-10T23:18:19.831432+0000","last_active":"2024-09-10T23:18:19.834640+0000","last_peered":"2024-09-10T23:18:19.834640+0000","last_clean":"2024-09-10T23:18:19.834640+0000","last_became_active":"2024-09-10T23:18:19.831085+0000","last_became_peered":"2024-09-10T23:18:19.831085+0000","last_unstale":"2024-09-10T23:18:19.834640+0000","last_undegraded":"2024-09-10T23:18:19.834640+0000","last_fullsized":"2024-09-10T23:18:19.834640+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:39.632376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834948+0000","last_change":"2024-09-10T23:18:19.832721+0000","last_active":"2024-09-10T23:18:19.834948+0000","last_peered":"2024-09-10T23:18:19.834948+0000","last_clean":"2024-09-10T23:18:19.834948+0000","last_became_active":"2024-09-10T23:18:19.829915+0000","last_became_peered":"2024-09-10T23:18:19.829915+0000","last_unstale":"2024-09-10T23:18:19.834948+0000","last_undegraded":"2024-09-10T23:18:19.834948+0000","last_fullsized":"2024-09-10T23:18:19.834948+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:03.081250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.829107+0000","last_change":"2024-09-10T23:18:19.823585+0000","last_active":"2024-09-10T23:18:19.829107+0000","last_peered":"2024-09-10T23:18:19.829107+0000","last_clean":"2024-09-10T23:18:19.829107+0000","last_became_active":"2024-09-10T23:18:19.823326+0000","last_became_peered":"2024-09-10T23:18:19.823326+0000","last_unstale":"2024-09-10T23:18:19.829107+0000","last_undegraded":"2024-09-10T23:18:19.829107+0000","last_fullsized":"2024-09-10T23:18:19.829107+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:28.564827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837339+0000","last_change":"2024-09-10T23:18:19.831579+0000","last_active":"2024-09-10T23:18:19.837339+0000","last_peered":"2024-09-10T23:18:19.837339+0000","last_clean":"2024-09-10T23:18:19.837339+0000","last_became_active":"2024-09-10T23:18:19.831291+0000","last_became_peered":"2024-09-10T23:18:19.831291+0000","last_unstale":"2024-09-10T23:18:19.837339+0000","last_undegraded":"2024-09-10T23:18:19.837339+0000","last_fullsized":"2024-09-10T23:18:19.837339+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:53.959695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834630+0000","last_change":"2024-09-10T23:18:19.830865+0000","last_active":"2024-09-10T23:18:19.834630+0000","last_peered":"2024-09-10T23:18:19.834630+0000","last_clean":"2024-09-10T23:18:19.834630+0000","last_became_active":"2024-09-10T23:18:19.830151+0000","last_became_peered":"2024-09-10T23:18:19.830151+0000","last_unstale":"2024-09-10T23:18:19.834630+0000","last_undegraded":"2024-09-10T23:18:19.834630+0000","last_fullsized":"2024-09-10T23:18:19.834630+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:37.851110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834629+0000","last_change":"2024-09-10T23:18:19.830220+0000","last_active":"2024-09-10T23:18:19.834629+0000","last_peered":"2024-09-10T23:18:19.834629+0000","last_clean":"2024-09-10T23:18:19.834629+0000","last_became_active":"2024-09-10T23:18:19.829950+0000","last_became_peered":"2024-09-10T23:18:19.829950+0000","last_unstale":"2024-09-10T23:18:19.834629+0000","last_undegraded":"2024-09-10T23:18:19.834629+0000","last_fullsized":"2024-09-10T23:18:19.834629+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:43.624550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.822090+0000","last_change":"2024-09-10T23:18:19.817490+0000","last_active":"2024-09-10T23:18:19.822090+0000","last_peered":"2024-09-10T23:18:19.822090+0000","last_clean":"2024-09-10T23:18:19.822090+0000","last_became_active":"2024-09-10T23:18:19.816959+0000","last_became_peered":"2024-09-10T23:18:19.816959+0000","last_unstale":"2024-09-10T23:18:19.822090+0000","last_undegraded":"2024-09-10T23:18:19.822090+0000","last_fullsized":"2024-09-10T23:18:19.822090+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:51.785266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837758+0000","last_change":"2024-09-10T23:18:19.833318+0000","last_active":"2024-09-10T23:18:19.837758+0000","last_peered":"2024-09-10T23:18:19.837758+0000","last_clean":"2024-09-10T23:18:19.837758+0000","last_became_active":"2024-09-10T23:18:19.832884+0000","last_became_peered":"2024-09-10T23:18:19.832884+0000","last_unstale":"2024-09-10T23:18:19.837758+0000","last_undegraded":"2024-09-10T23:18:19.837758+0000","last_fullsized":"2024-09-10T23:18:19.837758+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:54.329061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837358+0000","last_change":"2024-09-10T23:18:19.831566+0000","last_active":"2024-09-10T23:18:19.837358+0000","last_peered":"2024-09-10T23:18:19.837358+0000","last_clean":"2024-09-10T23:18:19.837358+0000","last_became_active":"2024-09-10T23:18:19.831296+0000","last_became_peered":"2024-09-10T23:18:19.831296+0000","last_unstale":"2024-09-10T23:18:19.837358+0000","last_undegraded":"2024-09-10T23:18:19.837358+0000","last_fullsized":"2024-09-10T23:18:19.837358+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:29.710906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"103'4","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.823848+0000","last_change":"2024-09-10T23:18:18.819049+0000","last_active":"2024-09-10T23:18:19.823848+0000","last_peered":"2024-09-10T23:18:19.823848+0000","last_clean":"2024-09-10T23:18:19.823848+0000","last_became_active":"2024-09-10T23:18:18.818691+0000","last_became_peered":"2024-09-10T23:18:18.818691+0000","last_unstale":"2024-09-10T23:18:19.823848+0000","last_undegraded":"2024-09-10T23:18:19.823848+0000","last_fullsized":"2024-09-10T23:18:19.823848+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:20.746593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827135+0000","last_change":"2024-09-10T23:18:19.825731+0000","last_active":"2024-09-10T23:18:19.827135+0000","last_peered":"2024-09-10T23:18:19.827135+0000","last_clean":"2024-09-10T23:18:19.827135+0000","last_became_active":"2024-09-10T23:18:19.825416+0000","last_became_peered":"2024-09-10T23:18:19.825416+0000","last_unstale":"2024-09-10T23:18:19.827135+0000","last_undegraded":"2024-09-10T23:18:19.827135+0000","last_fullsized":"2024-09-10T23:18:19.827135+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:27.842754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.831004+0000","last_change":"2024-09-10T23:18:18.820513+0000","last_active":"2024-09-10T23:18:19.831004+0000","last_peered":"2024-09-10T23:18:19.831004+0000","last_clean":"2024-09-10T23:18:19.831004+0000","last_became_active":"2024-09-10T23:18:18.820183+0000","last_became_peered":"2024-09-10T23:18:18.820183+0000","last_unstale":"2024-09-10T23:18:19.831004+0000","last_undegraded":"2024-09-10T23:18:19.831004+0000","last_fullsized":"2024-09-10T23:18:19.831004+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:08.379933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.833668+0000","last_change":"2024-09-10T23:18:19.829138+0000","last_active":"2024-09-10T23:18:19.833668+0000","last_peered":"2024-09-10T23:18:19.833668+0000","last_clean":"2024-09-10T23:18:19.833668+0000","last_became_active":"2024-09-10T23:18:19.828828+0000","last_became_peered":"2024-09-10T23:18:19.828828+0000","last_unstale":"2024-09-10T23:18:19.833668+0000","last_undegraded":"2024-09-10T23:18:19.833668+0000","last_fullsized":"2024-09-10T23:18:19.833668+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:49.941431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.829764+0000","last_change":"2024-09-10T23:18:18.821467+0000","last_active":"2024-09-10T23:18:19.829764+0000","last_peered":"2024-09-10T23:18:19.829764+0000","last_clean":"2024-09-10T23:18:19.829764+0000","last_became_active":"2024-09-10T23:18:18.821210+0000","last_became_peered":"2024-09-10T23:18:18.821210+0000","last_unstale":"2024-09-10T23:18:19.829764+0000","last_undegraded":"2024-09-10T23:18:19.829764+0000","last_fullsized":"2024-09-10T23:18:19.829764+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:29.032172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.835172+0000","last_change":"2024-09-10T23:18:19.834277+0000","last_active":"2024-09-10T23:18:19.835172+0000","last_peered":"2024-09-10T23:18:19.835172+0000","last_clean":"2024-09-10T23:18:19.835172+0000","last_became_active":"2024-09-10T23:18:19.833905+0000","last_became_peered":"2024-09-10T23:18:19.833905+0000","last_unstale":"2024-09-10T23:18:19.835172+0000","last_undegraded":"2024-09-10T23:18:19.835172+0000","last_fullsized":"2024-09-10T23:18:19.835172+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:26.841269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.830179+0000","last_change":"2024-09-10T23:18:18.821805+0000","last_active":"2024-09-10T23:18:19.830179+0000","last_peered":"2024-09-10T23:18:19.830179+0000","last_clean":"2024-09-10T23:18:19.830179+0000","last_became_active":"2024-09-10T23:18:18.821524+0000","last_became_peered":"2024-09-10T23:18:18.821524+0000","last_unstale":"2024-09-10T23:18:19.830179+0000","last_undegraded":"2024-09-10T23:18:19.830179+0000","last_fullsized":"2024-09-10T23:18:19.830179+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:20.294151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825643+0000","last_change":"2024-09-10T23:18:18.818720+0000","last_active":"2024-09-10T23:18:19.825643+0000","last_peered":"2024-09-10T23:18:19.825643+0000","last_clean":"2024-09-10T23:18:19.825643+0000","last_became_active":"2024-09-10T23:18:18.818140+0000","last_became_peered":"2024-09-10T23:18:18.818140+0000","last_unstale":"2024-09-10T23:18:19.825643+0000","last_undegraded":"2024-09-10T23:18:19.825643+0000","last_fullsized":"2024-09-10T23:18:19.825643+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:38.107563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.831715+0000","last_change":"2024-09-10T23:18:19.824091+0000","last_active":"2024-09-10T23:18:19.831715+0000","last_peered":"2024-09-10T23:18:19.831715+0000","last_clean":"2024-09-10T23:18:19.831715+0000","last_became_active":"2024-09-10T23:18:19.823753+0000","last_became_peered":"2024-09-10T23:18:19.823753+0000","last_unstale":"2024-09-10T23:18:19.831715+0000","last_undegraded":"2024-09-10T23:18:19.831715+0000","last_fullsized":"2024-09-10T23:18:19.831715+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:17.744145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834288+0000","last_change":"2024-09-10T23:18:18.823235+0000","last_active":"2024-09-10T23:18:19.834288+0000","last_peered":"2024-09-10T23:18:19.834288+0000","last_clean":"2024-09-10T23:18:19.834288+0000","last_became_active":"2024-09-10T23:18:18.822974+0000","last_became_peered":"2024-09-10T23:18:18.822974+0000","last_unstale":"2024-09-10T23:18:19.834288+0000","last_undegraded":"2024-09-10T23:18:19.834288+0000","last_fullsized":"2024-09-10T23:18:19.834288+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:17.927105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.810595+0000","last_change":"2024-09-10T23:18:18.823934+0000","last_active":"2024-09-10T23:18:19.810595+0000","last_peered":"2024-09-10T23:18:19.810595+0000","last_clean":"2024-09-10T23:18:19.810595+0000","last_became_active":"2024-09-10T23:18:18.823678+0000","last_became_peered":"2024-09-10T23:18:18.823678+0000","last_unstale":"2024-09-10T23:18:19.810595+0000","last_undegraded":"2024-09-10T23:18:19.810595+0000","last_fullsized":"2024-09-10T23:18:19.810595+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:31.791308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825779+0000","last_change":"2024-09-10T23:18:19.823606+0000","last_active":"2024-09-10T23:18:19.825779+0000","last_peered":"2024-09-10T23:18:19.825779+0000","last_clean":"2024-09-10T23:18:19.825779+0000","last_became_active":"2024-09-10T23:18:19.823330+0000","last_became_peered":"2024-09-10T23:18:19.823330+0000","last_unstale":"2024-09-10T23:18:19.825779+0000","last_undegraded":"2024-09-10T23:18:19.825779+0000","last_fullsized":"2024-09-10T23:18:19.825779+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:53.310849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.805111+0000","last_change":"2024-09-10T23:18:17.805111+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.805111+0000","last_undegraded":"2024-09-10T23:18:17.805111+0000","last_fullsized":"2024-09-10T23:18:17.805111+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.830829+0000","last_change":"2024-09-10T23:18:19.828031+0000","last_active":"2024-09-10T23:18:19.830829+0000","last_peered":"2024-09-10T23:18:19.830829+0000","last_clean":"2024-09-10T23:18:19.830829+0000","last_became_active":"2024-09-10T23:18:19.827562+0000","last_became_peered":"2024-09-10T23:18:19.827562+0000","last_unstale":"2024-09-10T23:18:19.830829+0000","last_undegraded":"2024-09-10T23:18:19.830829+0000","last_fullsized":"2024-09-10T23:18:19.830829+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:02.739126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.816397+0000","last_change":"2024-09-10T23:18:18.819315+0000","last_active":"2024-09-10T23:18:19.816397+0000","last_peered":"2024-09-10T23:18:19.816397+0000","last_clean":"2024-09-10T23:18:19.816397+0000","last_became_active":"2024-09-10T23:18:18.819056+0000","last_became_peered":"2024-09-10T23:18:18.819056+0000","last_unstale":"2024-09-10T23:18:19.816397+0000","last_undegraded":"2024-09-10T23:18:19.816397+0000","last_fullsized":"2024-09-10T23:18:19.816397+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:14.032775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.826058+0000","last_change":"2024-09-10T23:18:19.824655+0000","last_active":"2024-09-10T23:18:19.826058+0000","last_peered":"2024-09-10T23:18:19.826058+0000","last_clean":"2024-09-10T23:18:19.826058+0000","last_became_active":"2024-09-10T23:18:19.824343+0000","last_became_peered":"2024-09-10T23:18:19.824343+0000","last_unstale":"2024-09-10T23:18:19.826058+0000","last_undegraded":"2024-09-10T23:18:19.826058+0000","last_fullsized":"2024-09-10T23:18:19.826058+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:01.734594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.813716+0000","last_change":"2024-09-10T23:18:18.818757+0000","last_active":"2024-09-10T23:18:19.813716+0000","last_peered":"2024-09-10T23:18:19.813716+0000","last_clean":"2024-09-10T23:18:19.813716+0000","last_became_active":"2024-09-10T23:18:18.818481+0000","last_became_peered":"2024-09-10T23:18:18.818481+0000","last_unstale":"2024-09-10T23:18:19.813716+0000","last_undegraded":"2024-09-10T23:18:19.813716+0000","last_fullsized":"2024-09-10T23:18:19.813716+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:26.837746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827614+0000","last_change":"2024-09-10T23:18:19.822703+0000","last_active":"2024-09-10T23:18:19.827614+0000","last_peered":"2024-09-10T23:18:19.827614+0000","last_clean":"2024-09-10T23:18:19.827614+0000","last_became_active":"2024-09-10T23:18:19.822469+0000","last_became_peered":"2024-09-10T23:18:19.822469+0000","last_unstale":"2024-09-10T23:18:19.827614+0000","last_undegraded":"2024-09-10T23:18:19.827614+0000","last_fullsized":"2024-09-10T23:18:19.827614+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:41.518449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804761+0000","last_change":"2024-09-10T23:18:17.804761+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804761+0000","last_undegraded":"2024-09-10T23:18:17.804761+0000","last_fullsized":"2024-09-10T23:18:17.804761+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.831276+0000","last_change":"2024-09-10T23:18:19.828960+0000","last_active":"2024-09-10T23:18:19.831276+0000","last_peered":"2024-09-10T23:18:19.831276+0000","last_clean":"2024-09-10T23:18:19.831276+0000","last_became_active":"2024-09-10T23:18:19.828713+0000","last_became_peered":"2024-09-10T23:18:19.828713+0000","last_unstale":"2024-09-10T23:18:19.831276+0000","last_undegraded":"2024-09-10T23:18:19.831276+0000","last_fullsized":"2024-09-10T23:18:19.831276+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:57.755101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804327+0000","last_change":"2024-09-10T23:18:17.804327+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804327+0000","last_undegraded":"2024-09-10T23:18:17.804327+0000","last_fullsized":"2024-09-10T23:18:17.804327+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827862+0000","last_change":"2024-09-10T23:18:19.825366+0000","last_active":"2024-09-10T23:18:19.827862+0000","last_peered":"2024-09-10T23:18:19.827862+0000","last_clean":"2024-09-10T23:18:19.827862+0000","last_became_active":"2024-09-10T23:18:19.824770+0000","last_became_peered":"2024-09-10T23:18:19.824770+0000","last_unstale":"2024-09-10T23:18:19.827862+0000","last_undegraded":"2024-09-10T23:18:19.827862+0000","last_fullsized":"2024-09-10T23:18:19.827862+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:03.765204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.835098+0000","last_change":"2024-09-10T23:18:18.817973+0000","last_active":"2024-09-10T23:18:19.835098+0000","last_peered":"2024-09-10T23:18:19.835098+0000","last_clean":"2024-09-10T23:18:19.835098+0000","last_became_active":"2024-09-10T23:18:18.817730+0000","last_became_peered":"2024-09-10T23:18:18.817730+0000","last_unstale":"2024-09-10T23:18:19.835098+0000","last_undegraded":"2024-09-10T23:18:19.835098+0000","last_fullsized":"2024-09-10T23:18:19.835098+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:47.032035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834233+0000","last_change":"2024-09-10T23:18:19.829079+0000","last_active":"2024-09-10T23:18:19.834233+0000","last_peered":"2024-09-10T23:18:19.834233+0000","last_clean":"2024-09-10T23:18:19.834233+0000","last_became_active":"2024-09-10T23:18:19.828829+0000","last_became_peered":"2024-09-10T23:18:19.828829+0000","last_unstale":"2024-09-10T23:18:19.834233+0000","last_undegraded":"2024-09-10T23:18:19.834233+0000","last_fullsized":"2024-09-10T23:18:19.834233+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:27.114207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.816267+0000","last_change":"2024-09-10T23:18:18.826768+0000","last_active":"2024-09-10T23:18:19.816267+0000","last_peered":"2024-09-10T23:18:19.816267+0000","last_clean":"2024-09-10T23:18:19.816267+0000","last_became_active":"2024-09-10T23:18:18.826502+0000","last_became_peered":"2024-09-10T23:18:18.826502+0000","last_unstale":"2024-09-10T23:18:19.816267+0000","last_undegraded":"2024-09-10T23:18:19.816267+0000","last_fullsized":"2024-09-10T23:18:19.816267+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:48.343739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827452+0000","last_change":"2024-09-10T23:18:19.822055+0000","last_active":"2024-09-10T23:18:19.827452+0000","last_peered":"2024-09-10T23:18:19.827452+0000","last_clean":"2024-09-10T23:18:19.827452+0000","last_became_active":"2024-09-10T23:18:19.821803+0000","last_became_peered":"2024-09-10T23:18:19.821803+0000","last_unstale":"2024-09-10T23:18:19.827452+0000","last_undegraded":"2024-09-10T23:18:19.827452+0000","last_fullsized":"2024-09-10T23:18:19.827452+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:56.084094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"103'8","reported_seq":21,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.835219+0000","last_change":"2024-09-10T23:18:18.821437+0000","last_active":"2024-09-10T23:18:19.835219+0000","last_peered":"2024-09-10T23:18:19.835219+0000","last_clean":"2024-09-10T23:18:19.835219+0000","last_became_active":"2024-09-10T23:18:18.821139+0000","last_became_peered":"2024-09-10T23:18:18.821139+0000","last_unstale":"2024-09-10T23:18:19.835219+0000","last_undegraded":"2024-09-10T23:18:19.835219+0000","last_fullsized":"2024-09-10T23:18:19.835219+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:34.527204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825319+0000","last_change":"2024-09-10T23:18:19.823839+0000","last_active":"2024-09-10T23:18:19.825319+0000","last_peered":"2024-09-10T23:18:19.825319+0000","last_clean":"2024-09-10T23:18:19.825319+0000","last_became_active":"2024-09-10T23:18:19.823562+0000","last_became_peered":"2024-09-10T23:18:19.823562+0000","last_unstale":"2024-09-10T23:18:19.825319+0000","last_undegraded":"2024-09-10T23:18:19.825319+0000","last_fullsized":"2024-09-10T23:18:19.825319+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:52.644364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804322+0000","last_change":"2024-09-10T23:18:17.804322+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804322+0000","last_undegraded":"2024-09-10T23:18:17.804322+0000","last_fullsized":"2024-09-10T23:18:17.804322+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837701+0000","last_change":"2024-09-10T23:18:19.831151+0000","last_active":"2024-09-10T23:18:19.837701+0000","last_peered":"2024-09-10T23:18:19.837701+0000","last_clean":"2024-09-10T23:18:19.837701+0000","last_became_active":"2024-09-10T23:18:19.830881+0000","last_became_peered":"2024-09-10T23:18:19.830881+0000","last_unstale":"2024-09-10T23:18:19.837701+0000","last_undegraded":"2024-09-10T23:18:19.837701+0000","last_fullsized":"2024-09-10T23:18:19.837701+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:12.216598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.832483+0000","last_change":"2024-09-10T23:18:18.822172+0000","last_active":"2024-09-10T23:18:19.832483+0000","last_peered":"2024-09-10T23:18:19.832483+0000","last_clean":"2024-09-10T23:18:19.832483+0000","last_became_active":"2024-09-10T23:18:18.821867+0000","last_became_peered":"2024-09-10T23:18:18.821867+0000","last_unstale":"2024-09-10T23:18:19.832483+0000","last_undegraded":"2024-09-10T23:18:19.832483+0000","last_fullsized":"2024-09-10T23:18:19.832483+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:28.101107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.839695+0000","last_change":"2024-09-10T23:18:19.838948+0000","last_active":"2024-09-10T23:18:19.839695+0000","last_peered":"2024-09-10T23:18:19.839695+0000","last_clean":"2024-09-10T23:18:19.839695+0000","last_became_active":"2024-09-10T23:18:19.838478+0000","last_became_peered":"2024-09-10T23:18:19.838478+0000","last_unstale":"2024-09-10T23:18:19.839695+0000","last_undegraded":"2024-09-10T23:18:19.839695+0000","last_fullsized":"2024-09-10T23:18:19.839695+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:21.069271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.828742+0000","last_change":"2024-09-10T23:18:18.828797+0000","last_active":"2024-09-10T23:18:19.828742+0000","last_peered":"2024-09-10T23:18:19.828742+0000","last_clean":"2024-09-10T23:18:19.828742+0000","last_became_active":"2024-09-10T23:18:18.828538+0000","last_became_peered":"2024-09-10T23:18:18.828538+0000","last_unstale":"2024-09-10T23:18:19.828742+0000","last_undegraded":"2024-09-10T23:18:19.828742+0000","last_fullsized":"2024-09-10T23:18:19.828742+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:14.953384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834779+0000","last_change":"2024-09-10T23:18:19.832939+0000","last_active":"2024-09-10T23:18:19.834779+0000","last_peered":"2024-09-10T23:18:19.834779+0000","last_clean":"2024-09-10T23:18:19.834779+0000","last_became_active":"2024-09-10T23:18:19.832618+0000","last_became_peered":"2024-09-10T23:18:19.832618+0000","last_unstale":"2024-09-10T23:18:19.834779+0000","last_undegraded":"2024-09-10T23:18:19.834779+0000","last_fullsized":"2024-09-10T23:18:19.834779+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:09.419897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.809176+0000","last_change":"2024-09-10T23:18:18.821792+0000","last_active":"2024-09-10T23:18:19.809176+0000","last_peered":"2024-09-10T23:18:19.809176+0000","last_clean":"2024-09-10T23:18:19.809176+0000","last_became_active":"2024-09-10T23:18:18.821465+0000","last_became_peered":"2024-09-10T23:18:18.821465+0000","last_unstale":"2024-09-10T23:18:19.809176+0000","last_undegraded":"2024-09-10T23:18:19.809176+0000","last_fullsized":"2024-09-10T23:18:19.809176+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:53.324053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834680+0000","last_change":"2024-09-10T23:18:19.832542+0000","last_active":"2024-09-10T23:18:19.834680+0000","last_peered":"2024-09-10T23:18:19.834680+0000","last_clean":"2024-09-10T23:18:19.834680+0000","last_became_active":"2024-09-10T23:18:19.832208+0000","last_became_peered":"2024-09-10T23:18:19.832208+0000","last_unstale":"2024-09-10T23:18:19.834680+0000","last_undegraded":"2024-09-10T23:18:19.834680+0000","last_fullsized":"2024-09-10T23:18:19.834680+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:38.816382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.828537+0000","last_change":"2024-09-10T23:18:18.823102+0000","last_active":"2024-09-10T23:18:19.828537+0000","last_peered":"2024-09-10T23:18:19.828537+0000","last_clean":"2024-09-10T23:18:19.828537+0000","last_became_active":"2024-09-10T23:18:18.822794+0000","last_became_peered":"2024-09-10T23:18:18.822794+0000","last_unstale":"2024-09-10T23:18:19.828537+0000","last_undegraded":"2024-09-10T23:18:19.828537+0000","last_fullsized":"2024-09-10T23:18:19.828537+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:29.032172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.817130+0000","last_change":"2024-09-10T23:18:18.821285+0000","last_active":"2024-09-10T23:18:19.817130+0000","last_peered":"2024-09-10T23:18:19.817130+0000","last_clean":"2024-09-10T23:18:19.817130+0000","last_became_active":"2024-09-10T23:18:18.820993+0000","last_became_peered":"2024-09-10T23:18:18.820993+0000","last_unstale":"2024-09-10T23:18:19.817130+0000","last_undegraded":"2024-09-10T23:18:19.817130+0000","last_fullsized":"2024-09-10T23:18:19.817130+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:47.032035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837793+0000","last_change":"2024-09-10T23:18:19.836596+0000","last_active":"2024-09-10T23:18:19.837793+0000","last_peered":"2024-09-10T23:18:19.837793+0000","last_clean":"2024-09-10T23:18:19.837793+0000","last_became_active":"2024-09-10T23:18:19.836333+0000","last_became_peered":"2024-09-10T23:18:19.836333+0000","last_unstale":"2024-09-10T23:18:19.837793+0000","last_undegraded":"2024-09-10T23:18:19.837793+0000","last_fullsized":"2024-09-10T23:18:19.837793+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:53.315354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.824644+0000","last_change":"2024-09-10T23:18:18.824334+0000","last_active":"2024-09-10T23:18:19.824644+0000","last_peered":"2024-09-10T23:18:19.824644+0000","last_clean":"2024-09-10T23:18:19.824644+0000","last_became_active":"2024-09-10T23:18:18.824076+0000","last_became_peered":"2024-09-10T23:18:18.824076+0000","last_unstale":"2024-09-10T23:18:19.824644+0000","last_undegraded":"2024-09-10T23:18:19.824644+0000","last_fullsized":"2024-09-10T23:18:19.824644+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:51.639356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.835189+0000","last_change":"2024-09-10T23:18:19.832624+0000","last_active":"2024-09-10T23:18:19.835189+0000","last_peered":"2024-09-10T23:18:19.835189+0000","last_clean":"2024-09-10T23:18:19.835189+0000","last_became_active":"2024-09-10T23:18:19.832337+0000","last_became_peered":"2024-09-10T23:18:19.832337+0000","last_unstale":"2024-09-10T23:18:19.835189+0000","last_undegraded":"2024-09-10T23:18:19.835189+0000","last_fullsized":"2024-09-10T23:18:19.835189+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:01.080207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804673+0000","last_change":"2024-09-10T23:18:17.804673+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804673+0000","last_undegraded":"2024-09-10T23:18:17.804673+0000","last_fullsized":"2024-09-10T23:18:17.804673+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825173+0000","last_change":"2024-09-10T23:18:19.819937+0000","last_active":"2024-09-10T23:18:19.825173+0000","last_peered":"2024-09-10T23:18:19.825173+0000","last_clean":"2024-09-10T23:18:19.825173+0000","last_became_active":"2024-09-10T23:18:19.819609+0000","last_became_peered":"2024-09-10T23:18:19.819609+0000","last_unstale":"2024-09-10T23:18:19.825173+0000","last_undegraded":"2024-09-10T23:18:19.825173+0000","last_fullsized":"2024-09-10T23:18:19.825173+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:33:38.788016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.836909+0000","last_change":"2024-09-10T23:18:18.823508+0000","last_active":"2024-09-10T23:18:19.836909+0000","last_peered":"2024-09-10T23:18:19.836909+0000","last_clean":"2024-09-10T23:18:19.836909+0000","last_became_active":"2024-09-10T23:18:18.823163+0000","last_became_peered":"2024-09-10T23:18:18.823163+0000","last_unstale":"2024-09-10T23:18:19.836909+0000","last_undegraded":"2024-09-10T23:18:19.836909+0000","last_fullsized":"2024-09-10T23:18:19.836909+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:57.336353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.816402+0000","last_change":"2024-09-10T23:18:18.818495+0000","last_active":"2024-09-10T23:18:19.816402+0000","last_peered":"2024-09-10T23:18:19.816402+0000","last_clean":"2024-09-10T23:18:19.816402+0000","last_became_active":"2024-09-10T23:18:18.818166+0000","last_became_peered":"2024-09-10T23:18:18.818166+0000","last_unstale":"2024-09-10T23:18:19.816402+0000","last_undegraded":"2024-09-10T23:18:19.816402+0000","last_fullsized":"2024-09-10T23:18:19.816402+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:17.521005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804344+0000","last_change":"2024-09-10T23:18:17.804344+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804344+0000","last_undegraded":"2024-09-10T23:18:17.804344+0000","last_fullsized":"2024-09-10T23:18:17.804344+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825109+0000","last_change":"2024-09-10T23:18:19.819902+0000","last_active":"2024-09-10T23:18:19.825109+0000","last_peered":"2024-09-10T23:18:19.825109+0000","last_clean":"2024-09-10T23:18:19.825109+0000","last_became_active":"2024-09-10T23:18:19.819597+0000","last_became_peered":"2024-09-10T23:18:19.819597+0000","last_unstale":"2024-09-10T23:18:19.825109+0000","last_undegraded":"2024-09-10T23:18:19.825109+0000","last_fullsized":"2024-09-10T23:18:19.825109+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:24.559448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.817328+0000","last_change":"2024-09-10T23:18:18.823716+0000","last_active":"2024-09-10T23:18:19.817328+0000","last_peered":"2024-09-10T23:18:19.817328+0000","last_clean":"2024-09-10T23:18:19.817328+0000","last_became_active":"2024-09-10T23:18:18.823450+0000","last_became_peered":"2024-09-10T23:18:18.823450+0000","last_unstale":"2024-09-10T23:18:19.817328+0000","last_undegraded":"2024-09-10T23:18:19.817328+0000","last_fullsized":"2024-09-10T23:18:19.817328+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:00.834074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.820383+0000","last_change":"2024-09-10T23:18:19.813945+0000","last_active":"2024-09-10T23:18:19.820383+0000","last_peered":"2024-09-10T23:18:19.820383+0000","last_clean":"2024-09-10T23:18:19.820383+0000","last_became_active":"2024-09-10T23:18:19.813279+0000","last_became_peered":"2024-09-10T23:18:19.813279+0000","last_unstale":"2024-09-10T23:18:19.820383+0000","last_undegraded":"2024-09-10T23:18:19.820383+0000","last_fullsized":"2024-09-10T23:18:19.820383+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:05.534969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.809221+0000","last_change":"2024-09-10T23:18:18.818409+0000","last_active":"2024-09-10T23:18:19.809221+0000","last_peered":"2024-09-10T23:18:19.809221+0000","last_clean":"2024-09-10T23:18:19.809221+0000","last_became_active":"2024-09-10T23:18:18.817769+0000","last_became_peered":"2024-09-10T23:18:18.817769+0000","last_unstale":"2024-09-10T23:18:19.809221+0000","last_undegraded":"2024-09-10T23:18:19.809221+0000","last_fullsized":"2024-09-10T23:18:19.809221+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:22:24.800421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.831874+0000","last_change":"2024-09-10T23:18:19.826769+0000","last_active":"2024-09-10T23:18:19.831874+0000","last_peered":"2024-09-10T23:18:19.831874+0000","last_clean":"2024-09-10T23:18:19.831874+0000","last_became_active":"2024-09-10T23:18:19.826467+0000","last_became_peered":"2024-09-10T23:18:19.826467+0000","last_unstale":"2024-09-10T23:18:19.831874+0000","last_undegraded":"2024-09-10T23:18:19.831874+0000","last_fullsized":"2024-09-10T23:18:19.831874+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:19.420378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.811272+0000","last_change":"2024-09-10T23:18:18.820337+0000","last_active":"2024-09-10T23:18:19.811272+0000","last_peered":"2024-09-10T23:18:19.811272+0000","last_clean":"2024-09-10T23:18:19.811272+0000","last_became_active":"2024-09-10T23:18:18.820040+0000","last_became_peered":"2024-09-10T23:18:18.820040+0000","last_unstale":"2024-09-10T23:18:19.811272+0000","last_undegraded":"2024-09-10T23:18:19.811272+0000","last_fullsized":"2024-09-10T23:18:19.811272+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:12.068147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834708+0000","last_change":"2024-09-10T23:18:19.833541+0000","last_active":"2024-09-10T23:18:19.834708+0000","last_peered":"2024-09-10T23:18:19.834708+0000","last_clean":"2024-09-10T23:18:19.834708+0000","last_became_active":"2024-09-10T23:18:19.833278+0000","last_became_peered":"2024-09-10T23:18:19.833278+0000","last_unstale":"2024-09-10T23:18:19.834708+0000","last_undegraded":"2024-09-10T23:18:19.834708+0000","last_fullsized":"2024-09-10T23:18:19.834708+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:34.315019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.815852+0000","last_change":"2024-09-10T23:18:18.822619+0000","last_active":"2024-09-10T23:18:19.815852+0000","last_peered":"2024-09-10T23:18:19.815852+0000","last_clean":"2024-09-10T23:18:19.815852+0000","last_became_active":"2024-09-10T23:18:18.822363+0000","last_became_peered":"2024-09-10T23:18:18.822363+0000","last_unstale":"2024-09-10T23:18:19.815852+0000","last_undegraded":"2024-09-10T23:18:19.815852+0000","last_fullsized":"2024-09-10T23:18:19.815852+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:13.423487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.803615+0000","last_change":"2024-09-10T23:18:17.803615+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.803615+0000","last_undegraded":"2024-09-10T23:18:17.803615+0000","last_fullsized":"2024-09-10T23:18:17.803615+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834757+0000","last_change":"2024-09-10T23:18:19.829796+0000","last_active":"2024-09-10T23:18:19.834757+0000","last_peered":"2024-09-10T23:18:19.834757+0000","last_clean":"2024-09-10T23:18:19.834757+0000","last_became_active":"2024-09-10T23:18:19.829530+0000","last_became_peered":"2024-09-10T23:18:19.829530+0000","last_unstale":"2024-09-10T23:18:19.834757+0000","last_undegraded":"2024-09-10T23:18:19.834757+0000","last_fullsized":"2024-09-10T23:18:19.834757+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:56.155914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.810245+0000","last_change":"2024-09-10T23:18:18.821522+0000","last_active":"2024-09-10T23:18:19.810245+0000","last_peered":"2024-09-10T23:18:19.810245+0000","last_clean":"2024-09-10T23:18:19.810245+0000","last_became_active":"2024-09-10T23:18:18.821236+0000","last_became_peered":"2024-09-10T23:18:18.821236+0000","last_unstale":"2024-09-10T23:18:19.810245+0000","last_undegraded":"2024-09-10T23:18:19.810245+0000","last_fullsized":"2024-09-10T23:18:19.810245+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:17.910202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":255,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825975+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:18:19.825975+0000","last_peered":"2024-09-10T23:18:19.825975+0000","last_clean":"2024-09-10T23:18:19.825975+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:18:19.825975+0000","last_undegraded":"2024-09-10T23:18:19.825975+0000","last_fullsized":"2024-09-10T23:18:19.825975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28864,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342976,"statfs":{"total":96636764160,"available":96607207424,"internally_reserved":0,"allocated":1875968,"data_stored":1130931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1277952,"data_stored":540017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1282048,"data_stored":540551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1273856,"data_stored":539947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509492,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1261568,"data_stored":533172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1273856,"data_stored":539947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509492,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1282048,"data_stored":540071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32988,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338852,"statfs":{"total":96636764160,"available":96602984448,"internally_reserved":0,"allocated":1843200,"data_stored":1117265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:18:23.134 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:18:23.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.235+0000 7ff2a7433640 1 -- 172.21.15.90:0/869559343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a006e6f0 msgr2=0x7ff2a00cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:23.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.235+0000 7ff2a7433640 1 --2- 172.21.15.90:0/869559343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a006e6f0 0x7ff2a00cd0b0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7ff2a006e640 tx=0x7ff29002a4a0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.235+0000 7ff2a7433640 1 -- 172.21.15.90:0/869559343 shutdown_connections 2024-09-10T23:18:23.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.235+0000 7ff2a7433640 1 --2- 172.21.15.90:0/869559343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a006e6f0 0x7ff2a00cd0b0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.235+0000 7ff2a7433640 1 --2- 172.21.15.90:0/869559343 >> v2:172.21.15.171:3300/0 conn(0x7ff2a015a1d0 0x7ff2a00cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.235+0000 7ff2a7433640 1 -- 172.21.15.90:0/869559343 >> 172.21.15.90:0/869559343 conn(0x7ff2a00b19c0 msgr2=0x7ff2a00b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:23.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.235+0000 7ff2a7433640 1 -- 172.21.15.90:0/869559343 shutdown_connections 2024-09-10T23:18:23.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.235+0000 7ff2a7433640 1 -- 172.21.15.90:0/869559343 wait complete. 2024-09-10T23:18:23.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.236+0000 7ff2a7433640 1 Processor -- start 2024-09-10T23:18:23.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.236+0000 7ff2a7433640 1 -- start start 2024-09-10T23:18:23.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a7433640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a006e6f0 0x7ff2a009b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:23.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a7433640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2a006f860 0x7ff2a014c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:23.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a7433640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2a015a1d0 0x7ff2a01594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:23.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a7433640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a0070a30 con 0x7ff2a006e6f0 2024-09-10T23:18:23.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a7433640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a00708b0 con 0x7ff2a006f860 2024-09-10T23:18:23.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a7433640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff2a006fcf0 con 0x7ff2a015a1d0 2024-09-10T23:18:23.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a51cf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a006e6f0 0x7ff2a009b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:23.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a51cf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a006e6f0 0x7ff2a009b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56402/0 (socket says 172.21.15.90:56402) 2024-09-10T23:18:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a51cf640 1 -- 172.21.15.90:0/1306482910 learned_addr learned my addr 172.21.15.90:0/1306482910 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a49ce640 1 --2- 172.21.15.90:0/1306482910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2a006f860 0x7ff2a014c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a59d0640 1 --2- 172.21.15.90:0/1306482910 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2a015a1d0 0x7ff2a01594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a51cf640 1 -- 172.21.15.90:0/1306482910 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2a015a1d0 msgr2=0x7ff2a01594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a51cf640 1 --2- 172.21.15.90:0/1306482910 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2a015a1d0 0x7ff2a01594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a51cf640 1 -- 172.21.15.90:0/1306482910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2a006f860 msgr2=0x7ff2a014c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a51cf640 1 --2- 172.21.15.90:0/1306482910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2a006f860 0x7ff2a014c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a51cf640 1 -- 172.21.15.90:0/1306482910 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a0167540 con 0x7ff2a006e6f0 2024-09-10T23:18:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a49ce640 1 --2- 172.21.15.90:0/1306482910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2a006f860 0x7ff2a014c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.237+0000 7ff2a51cf640 1 --2- 172.21.15.90:0/1306482910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a006e6f0 0x7ff2a009b460 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00c9a0 tx=0x7ff29c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.238+0000 7ff295ffb640 1 -- 172.21.15.90:0/1306482910 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c007bb0 con 0x7ff2a006e6f0 2024-09-10T23:18:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.238+0000 7ff295ffb640 1 -- 172.21.15.90:0/1306482910 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff29c007e40 con 0x7ff2a006e6f0 2024-09-10T23:18:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.238+0000 7ff2a7433640 1 -- 172.21.15.90:0/1306482910 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a0157510 con 0x7ff2a006e6f0 2024-09-10T23:18:23.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.238+0000 7ff295ffb640 1 -- 172.21.15.90:0/1306482910 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c00f690 con 0x7ff2a006e6f0 2024-09-10T23:18:23.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.238+0000 7ff2a7433640 1 -- 172.21.15.90:0/1306482910 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a0157ad0 con 0x7ff2a006e6f0 2024-09-10T23:18:23.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.239+0000 7ff2a7433640 1 -- 172.21.15.90:0/1306482910 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2a00cd0b0 con 0x7ff2a006e6f0 2024-09-10T23:18:23.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.239+0000 7ff295ffb640 1 -- 172.21.15.90:0/1306482910 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff29c020030 con 0x7ff2a006e6f0 2024-09-10T23:18:23.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.240+0000 7ff295ffb640 1 --2- 172.21.15.90:0/1306482910 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff284077f70 0x7ff28407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:23.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.240+0000 7ff295ffb640 1 -- 172.21.15.90:0/1306482910 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7ff29c09a1b0 con 0x7ff2a006e6f0 2024-09-10T23:18:23.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.240+0000 7ff2a49ce640 1 --2- 172.21.15.90:0/1306482910 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff284077f70 0x7ff28407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:23.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.241+0000 7ff2a49ce640 1 --2- 172.21.15.90:0/1306482910 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff284077f70 0x7ff28407a430 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff290034000 tx=0x7ff290004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:23.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.244+0000 7ff295ffb640 1 -- 172.21.15.90:0/1306482910 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff29c014030 con 0x7ff2a006e6f0 2024-09-10T23:18:23.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.415+0000 7ff2a7433640 1 -- 172.21.15.90:0/1306482910 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2a00af2e0 con 0x7ff284077f70 2024-09-10T23:18:23.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.419+0000 7ff295ffb640 1 -- 172.21.15.90:0/1306482910 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249958 (secure 0 0 0) 0x7ff2a00af2e0 con 0x7ff284077f70 2024-09-10T23:18:23.423 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:23.424 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:18:23.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.422+0000 7ff2a7433640 1 -- 172.21.15.90:0/1306482910 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff284077f70 msgr2=0x7ff28407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:23.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.422+0000 7ff2a7433640 1 --2- 172.21.15.90:0/1306482910 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff284077f70 0x7ff28407a430 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff290034000 tx=0x7ff290004730 comp rx=0 tx=0).stop 2024-09-10T23:18:23.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.422+0000 7ff2a7433640 1 -- 172.21.15.90:0/1306482910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a006e6f0 msgr2=0x7ff2a009b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:23.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.422+0000 7ff2a7433640 1 --2- 172.21.15.90:0/1306482910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a006e6f0 0x7ff2a009b460 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00c9a0 tx=0x7ff29c00ce60 comp rx=0 tx=0).stop 2024-09-10T23:18:23.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.422+0000 7ff2a7433640 1 -- 172.21.15.90:0/1306482910 shutdown_connections 2024-09-10T23:18:23.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.422+0000 7ff2a7433640 1 --2- 172.21.15.90:0/1306482910 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff284077f70 0x7ff28407a430 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.422+0000 7ff2a7433640 1 --2- 172.21.15.90:0/1306482910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2a006f860 0x7ff2a014c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.422+0000 7ff2a7433640 1 --2- 172.21.15.90:0/1306482910 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2a015a1d0 0x7ff2a01594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.422+0000 7ff2a7433640 1 --2- 172.21.15.90:0/1306482910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a006e6f0 0x7ff2a009b460 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.422+0000 7ff2a7433640 1 -- 172.21.15.90:0/1306482910 >> 172.21.15.90:0/1306482910 conn(0x7ff2a00b19c0 msgr2=0x7ff2a0073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:23.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.423+0000 7ff2a7433640 1 -- 172.21.15.90:0/1306482910 shutdown_connections 2024-09-10T23:18:23.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.423+0000 7ff2a7433640 1 -- 172.21.15.90:0/1306482910 wait complete. 2024-09-10T23:18:23.434 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-09-10T23:18:22.488411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256484,"kb_used_data":11104,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754718236,"statfs":{"total":773094113280,"available":772831473664,"internally_reserved":0,"allocated":11370496,"data_stored":5481901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.689104"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.838845+0000","last_change":"2024-09-10T23:18:19.834081+0000","last_active":"2024-09-10T23:18:19.838845+0000","last_peered":"2024-09-10T23:18:19.838845+0000","last_clean":"2024-09-10T23:18:19.838845+0000","last_became_active":"2024-09-10T23:18:19.833811+0000","last_became_peered":"2024-09-10T23:18:19.833811+0000","last_unstale":"2024-09-10T23:18:19.838845+0000","last_undegraded":"2024-09-10T23:18:19.838845+0000","last_fullsized":"2024-09-10T23:18:19.838845+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:42.460246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834642+0000","last_change":"2024-09-10T23:18:19.832637+0000","last_active":"2024-09-10T23:18:19.834642+0000","last_peered":"2024-09-10T23:18:19.834642+0000","last_clean":"2024-09-10T23:18:19.834642+0000","last_became_active":"2024-09-10T23:18:19.832256+0000","last_became_peered":"2024-09-10T23:18:19.832256+0000","last_unstale":"2024-09-10T23:18:19.834642+0000","last_undegraded":"2024-09-10T23:18:19.834642+0000","last_fullsized":"2024-09-10T23:18:19.834642+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:30:32.840023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.828014+0000","last_change":"2024-09-10T23:18:19.825136+0000","last_active":"2024-09-10T23:18:19.828014+0000","last_peered":"2024-09-10T23:18:19.828014+0000","last_clean":"2024-09-10T23:18:19.828014+0000","last_became_active":"2024-09-10T23:18:19.824888+0000","last_became_peered":"2024-09-10T23:18:19.824888+0000","last_unstale":"2024-09-10T23:18:19.828014+0000","last_undegraded":"2024-09-10T23:18:19.828014+0000","last_fullsized":"2024-09-10T23:18:19.828014+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:28.093748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.833700+0000","last_change":"2024-09-10T23:18:19.829960+0000","last_active":"2024-09-10T23:18:19.833700+0000","last_peered":"2024-09-10T23:18:19.833700+0000","last_clean":"2024-09-10T23:18:19.833700+0000","last_became_active":"2024-09-10T23:18:19.829678+0000","last_became_peered":"2024-09-10T23:18:19.829678+0000","last_unstale":"2024-09-10T23:18:19.833700+0000","last_undegraded":"2024-09-10T23:18:19.833700+0000","last_fullsized":"2024-09-10T23:18:19.833700+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:53.316251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.826013+0000","last_change":"2024-09-10T23:18:19.824702+0000","last_active":"2024-09-10T23:18:19.826013+0000","last_peered":"2024-09-10T23:18:19.826013+0000","last_clean":"2024-09-10T23:18:19.826013+0000","last_became_active":"2024-09-10T23:18:19.824418+0000","last_became_peered":"2024-09-10T23:18:19.824418+0000","last_unstale":"2024-09-10T23:18:19.826013+0000","last_undegraded":"2024-09-10T23:18:19.826013+0000","last_fullsized":"2024-09-10T23:18:19.826013+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:31.405406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.839466+0000","last_change":"2024-09-10T23:18:19.838305+0000","last_active":"2024-09-10T23:18:19.839466+0000","last_peered":"2024-09-10T23:18:19.839466+0000","last_clean":"2024-09-10T23:18:19.839466+0000","last_became_active":"2024-09-10T23:18:19.838086+0000","last_became_peered":"2024-09-10T23:18:19.838086+0000","last_unstale":"2024-09-10T23:18:19.839466+0000","last_undegraded":"2024-09-10T23:18:19.839466+0000","last_fullsized":"2024-09-10T23:18:19.839466+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:43.611606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.829125+0000","last_change":"2024-09-10T23:18:19.823321+0000","last_active":"2024-09-10T23:18:19.829125+0000","last_peered":"2024-09-10T23:18:19.829125+0000","last_clean":"2024-09-10T23:18:19.829125+0000","last_became_active":"2024-09-10T23:18:19.823022+0000","last_became_peered":"2024-09-10T23:18:19.823022+0000","last_unstale":"2024-09-10T23:18:19.829125+0000","last_undegraded":"2024-09-10T23:18:19.829125+0000","last_fullsized":"2024-09-10T23:18:19.829125+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:53.037910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834686+0000","last_change":"2024-09-10T23:18:19.832545+0000","last_active":"2024-09-10T23:18:19.834686+0000","last_peered":"2024-09-10T23:18:19.834686+0000","last_clean":"2024-09-10T23:18:19.834686+0000","last_became_active":"2024-09-10T23:18:19.832235+0000","last_became_peered":"2024-09-10T23:18:19.832235+0000","last_unstale":"2024-09-10T23:18:19.834686+0000","last_undegraded":"2024-09-10T23:18:19.834686+0000","last_fullsized":"2024-09-10T23:18:19.834686+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:41.518449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.833830+0000","last_change":"2024-09-10T23:18:19.829837+0000","last_active":"2024-09-10T23:18:19.833830+0000","last_peered":"2024-09-10T23:18:19.833830+0000","last_clean":"2024-09-10T23:18:19.833830+0000","last_became_active":"2024-09-10T23:18:19.829518+0000","last_became_peered":"2024-09-10T23:18:19.829518+0000","last_unstale":"2024-09-10T23:18:19.833830+0000","last_undegraded":"2024-09-10T23:18:19.833830+0000","last_fullsized":"2024-09-10T23:18:19.833830+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:39.632376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.833720+0000","last_change":"2024-09-10T23:18:19.828982+0000","last_active":"2024-09-10T23:18:19.833720+0000","last_peered":"2024-09-10T23:18:19.833720+0000","last_clean":"2024-09-10T23:18:19.833720+0000","last_became_active":"2024-09-10T23:18:19.828736+0000","last_became_peered":"2024-09-10T23:18:19.828736+0000","last_unstale":"2024-09-10T23:18:19.833720+0000","last_undegraded":"2024-09-10T23:18:19.833720+0000","last_fullsized":"2024-09-10T23:18:19.833720+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:28.093748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.829196+0000","last_change":"2024-09-10T23:18:19.825287+0000","last_active":"2024-09-10T23:18:19.829196+0000","last_peered":"2024-09-10T23:18:19.829196+0000","last_clean":"2024-09-10T23:18:19.829196+0000","last_became_active":"2024-09-10T23:18:19.824111+0000","last_became_peered":"2024-09-10T23:18:19.824111+0000","last_unstale":"2024-09-10T23:18:19.829196+0000","last_undegraded":"2024-09-10T23:18:19.829196+0000","last_fullsized":"2024-09-10T23:18:19.829196+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:01:08.499643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825197+0000","last_change":"2024-09-10T23:18:19.821436+0000","last_active":"2024-09-10T23:18:19.825197+0000","last_peered":"2024-09-10T23:18:19.825197+0000","last_clean":"2024-09-10T23:18:19.825197+0000","last_became_active":"2024-09-10T23:18:19.821140+0000","last_became_peered":"2024-09-10T23:18:19.821140+0000","last_unstale":"2024-09-10T23:18:19.825197+0000","last_undegraded":"2024-09-10T23:18:19.825197+0000","last_fullsized":"2024-09-10T23:18:19.825197+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:15.016694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834087+0000","last_change":"2024-09-10T23:18:19.830445+0000","last_active":"2024-09-10T23:18:19.834087+0000","last_peered":"2024-09-10T23:18:19.834087+0000","last_clean":"2024-09-10T23:18:19.834087+0000","last_became_active":"2024-09-10T23:18:19.829974+0000","last_became_peered":"2024-09-10T23:18:19.829974+0000","last_unstale":"2024-09-10T23:18:19.834087+0000","last_undegraded":"2024-09-10T23:18:19.834087+0000","last_fullsized":"2024-09-10T23:18:19.834087+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:42.460246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834787+0000","last_change":"2024-09-10T23:18:19.831066+0000","last_active":"2024-09-10T23:18:19.834787+0000","last_peered":"2024-09-10T23:18:19.834787+0000","last_clean":"2024-09-10T23:18:19.834787+0000","last_became_active":"2024-09-10T23:18:19.830803+0000","last_became_peered":"2024-09-10T23:18:19.830803+0000","last_unstale":"2024-09-10T23:18:19.834787+0000","last_undegraded":"2024-09-10T23:18:19.834787+0000","last_fullsized":"2024-09-10T23:18:19.834787+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:09.384941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.823957+0000","last_change":"2024-09-10T23:18:19.816681+0000","last_active":"2024-09-10T23:18:19.823957+0000","last_peered":"2024-09-10T23:18:19.823957+0000","last_clean":"2024-09-10T23:18:19.823957+0000","last_became_active":"2024-09-10T23:18:19.816379+0000","last_became_peered":"2024-09-10T23:18:19.816379+0000","last_unstale":"2024-09-10T23:18:19.823957+0000","last_undegraded":"2024-09-10T23:18:19.823957+0000","last_fullsized":"2024-09-10T23:18:19.823957+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:22.335062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827839+0000","last_change":"2024-09-10T23:18:19.825076+0000","last_active":"2024-09-10T23:18:19.827839+0000","last_peered":"2024-09-10T23:18:19.827839+0000","last_clean":"2024-09-10T23:18:19.827839+0000","last_became_active":"2024-09-10T23:18:19.824432+0000","last_became_peered":"2024-09-10T23:18:19.824432+0000","last_unstale":"2024-09-10T23:18:19.827839+0000","last_undegraded":"2024-09-10T23:18:19.827839+0000","last_fullsized":"2024-09-10T23:18:19.827839+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:22.800159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834640+0000","last_change":"2024-09-10T23:18:19.831432+0000","last_active":"2024-09-10T23:18:19.834640+0000","last_peered":"2024-09-10T23:18:19.834640+0000","last_clean":"2024-09-10T23:18:19.834640+0000","last_became_active":"2024-09-10T23:18:19.831085+0000","last_became_peered":"2024-09-10T23:18:19.831085+0000","last_unstale":"2024-09-10T23:18:19.834640+0000","last_undegraded":"2024-09-10T23:18:19.834640+0000","last_fullsized":"2024-09-10T23:18:19.834640+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:39.632376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834948+0000","last_change":"2024-09-10T23:18:19.832721+0000","last_active":"2024-09-10T23:18:19.834948+0000","last_peered":"2024-09-10T23:18:19.834948+0000","last_clean":"2024-09-10T23:18:19.834948+0000","last_became_active":"2024-09-10T23:18:19.829915+0000","last_became_peered":"2024-09-10T23:18:19.829915+0000","last_unstale":"2024-09-10T23:18:19.834948+0000","last_undegraded":"2024-09-10T23:18:19.834948+0000","last_fullsized":"2024-09-10T23:18:19.834948+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:03.081250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.829107+0000","last_change":"2024-09-10T23:18:19.823585+0000","last_active":"2024-09-10T23:18:19.829107+0000","last_peered":"2024-09-10T23:18:19.829107+0000","last_clean":"2024-09-10T23:18:19.829107+0000","last_became_active":"2024-09-10T23:18:19.823326+0000","last_became_peered":"2024-09-10T23:18:19.823326+0000","last_unstale":"2024-09-10T23:18:19.829107+0000","last_undegraded":"2024-09-10T23:18:19.829107+0000","last_fullsized":"2024-09-10T23:18:19.829107+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:28.564827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837339+0000","last_change":"2024-09-10T23:18:19.831579+0000","last_active":"2024-09-10T23:18:19.837339+0000","last_peered":"2024-09-10T23:18:19.837339+0000","last_clean":"2024-09-10T23:18:19.837339+0000","last_became_active":"2024-09-10T23:18:19.831291+0000","last_became_peered":"2024-09-10T23:18:19.831291+0000","last_unstale":"2024-09-10T23:18:19.837339+0000","last_undegraded":"2024-09-10T23:18:19.837339+0000","last_fullsized":"2024-09-10T23:18:19.837339+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:53.959695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834630+0000","last_change":"2024-09-10T23:18:19.830865+0000","last_active":"2024-09-10T23:18:19.834630+0000","last_peered":"2024-09-10T23:18:19.834630+0000","last_clean":"2024-09-10T23:18:19.834630+0000","last_became_active":"2024-09-10T23:18:19.830151+0000","last_became_peered":"2024-09-10T23:18:19.830151+0000","last_unstale":"2024-09-10T23:18:19.834630+0000","last_undegraded":"2024-09-10T23:18:19.834630+0000","last_fullsized":"2024-09-10T23:18:19.834630+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:37.851110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834629+0000","last_change":"2024-09-10T23:18:19.830220+0000","last_active":"2024-09-10T23:18:19.834629+0000","last_peered":"2024-09-10T23:18:19.834629+0000","last_clean":"2024-09-10T23:18:19.834629+0000","last_became_active":"2024-09-10T23:18:19.829950+0000","last_became_peered":"2024-09-10T23:18:19.829950+0000","last_unstale":"2024-09-10T23:18:19.834629+0000","last_undegraded":"2024-09-10T23:18:19.834629+0000","last_fullsized":"2024-09-10T23:18:19.834629+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:43.624550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.822090+0000","last_change":"2024-09-10T23:18:19.817490+0000","last_active":"2024-09-10T23:18:19.822090+0000","last_peered":"2024-09-10T23:18:19.822090+0000","last_clean":"2024-09-10T23:18:19.822090+0000","last_became_active":"2024-09-10T23:18:19.816959+0000","last_became_peered":"2024-09-10T23:18:19.816959+0000","last_unstale":"2024-09-10T23:18:19.822090+0000","last_undegraded":"2024-09-10T23:18:19.822090+0000","last_fullsized":"2024-09-10T23:18:19.822090+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:51.785266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837758+0000","last_change":"2024-09-10T23:18:19.833318+0000","last_active":"2024-09-10T23:18:19.837758+0000","last_peered":"2024-09-10T23:18:19.837758+0000","last_clean":"2024-09-10T23:18:19.837758+0000","last_became_active":"2024-09-10T23:18:19.832884+0000","last_became_peered":"2024-09-10T23:18:19.832884+0000","last_unstale":"2024-09-10T23:18:19.837758+0000","last_undegraded":"2024-09-10T23:18:19.837758+0000","last_fullsized":"2024-09-10T23:18:19.837758+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:54.329061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837358+0000","last_change":"2024-09-10T23:18:19.831566+0000","last_active":"2024-09-10T23:18:19.837358+0000","last_peered":"2024-09-10T23:18:19.837358+0000","last_clean":"2024-09-10T23:18:19.837358+0000","last_became_active":"2024-09-10T23:18:19.831296+0000","last_became_peered":"2024-09-10T23:18:19.831296+0000","last_unstale":"2024-09-10T23:18:19.837358+0000","last_undegraded":"2024-09-10T23:18:19.837358+0000","last_fullsized":"2024-09-10T23:18:19.837358+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:29.710906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"103'4","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.823848+0000","last_change":"2024-09-10T23:18:18.819049+0000","last_active":"2024-09-10T23:18:19.823848+0000","last_peered":"2024-09-10T23:18:19.823848+0000","last_clean":"2024-09-10T23:18:19.823848+0000","last_became_active":"2024-09-10T23:18:18.818691+0000","last_became_peered":"2024-09-10T23:18:18.818691+0000","last_unstale":"2024-09-10T23:18:19.823848+0000","last_undegraded":"2024-09-10T23:18:19.823848+0000","last_fullsized":"2024-09-10T23:18:19.823848+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:20.746593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827135+0000","last_change":"2024-09-10T23:18:19.825731+0000","last_active":"2024-09-10T23:18:19.827135+0000","last_peered":"2024-09-10T23:18:19.827135+0000","last_clean":"2024-09-10T23:18:19.827135+0000","last_became_active":"2024-09-10T23:18:19.825416+0000","last_became_peered":"2024-09-10T23:18:19.825416+0000","last_unstale":"2024-09-10T23:18:19.827135+0000","last_undegraded":"2024-09-10T23:18:19.827135+0000","last_fullsized":"2024-09-10T23:18:19.827135+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:27.842754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.831004+0000","last_change":"2024-09-10T23:18:18.820513+0000","last_active":"2024-09-10T23:18:19.831004+0000","last_peered":"2024-09-10T23:18:19.831004+0000","last_clean":"2024-09-10T23:18:19.831004+0000","last_became_active":"2024-09-10T23:18:18.820183+0000","last_became_peered":"2024-09-10T23:18:18.820183+0000","last_unstale":"2024-09-10T23:18:19.831004+0000","last_undegraded":"2024-09-10T23:18:19.831004+0000","last_fullsized":"2024-09-10T23:18:19.831004+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:08.379933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.833668+0000","last_change":"2024-09-10T23:18:19.829138+0000","last_active":"2024-09-10T23:18:19.833668+0000","last_peered":"2024-09-10T23:18:19.833668+0000","last_clean":"2024-09-10T23:18:19.833668+0000","last_became_active":"2024-09-10T23:18:19.828828+0000","last_became_peered":"2024-09-10T23:18:19.828828+0000","last_unstale":"2024-09-10T23:18:19.833668+0000","last_undegraded":"2024-09-10T23:18:19.833668+0000","last_fullsized":"2024-09-10T23:18:19.833668+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:49.941431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.829764+0000","last_change":"2024-09-10T23:18:18.821467+0000","last_active":"2024-09-10T23:18:19.829764+0000","last_peered":"2024-09-10T23:18:19.829764+0000","last_clean":"2024-09-10T23:18:19.829764+0000","last_became_active":"2024-09-10T23:18:18.821210+0000","last_became_peered":"2024-09-10T23:18:18.821210+0000","last_unstale":"2024-09-10T23:18:19.829764+0000","last_undegraded":"2024-09-10T23:18:19.829764+0000","last_fullsized":"2024-09-10T23:18:19.829764+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:29.032172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.835172+0000","last_change":"2024-09-10T23:18:19.834277+0000","last_active":"2024-09-10T23:18:19.835172+0000","last_peered":"2024-09-10T23:18:19.835172+0000","last_clean":"2024-09-10T23:18:19.835172+0000","last_became_active":"2024-09-10T23:18:19.833905+0000","last_became_peered":"2024-09-10T23:18:19.833905+0000","last_unstale":"2024-09-10T23:18:19.835172+0000","last_undegraded":"2024-09-10T23:18:19.835172+0000","last_fullsized":"2024-09-10T23:18:19.835172+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:26.841269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.830179+0000","last_change":"2024-09-10T23:18:18.821805+0000","last_active":"2024-09-10T23:18:19.830179+0000","last_peered":"2024-09-10T23:18:19.830179+0000","last_clean":"2024-09-10T23:18:19.830179+0000","last_became_active":"2024-09-10T23:18:18.821524+0000","last_became_peered":"2024-09-10T23:18:18.821524+0000","last_unstale":"2024-09-10T23:18:19.830179+0000","last_undegraded":"2024-09-10T23:18:19.830179+0000","last_fullsized":"2024-09-10T23:18:19.830179+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:20.294151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825643+0000","last_change":"2024-09-10T23:18:18.818720+0000","last_active":"2024-09-10T23:18:19.825643+0000","last_peered":"2024-09-10T23:18:19.825643+0000","last_clean":"2024-09-10T23:18:19.825643+0000","last_became_active":"2024-09-10T23:18:18.818140+0000","last_became_peered":"2024-09-10T23:18:18.818140+0000","last_unstale":"2024-09-10T23:18:19.825643+0000","last_undegraded":"2024-09-10T23:18:19.825643+0000","last_fullsized":"2024-09-10T23:18:19.825643+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:38.107563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.831715+0000","last_change":"2024-09-10T23:18:19.824091+0000","last_active":"2024-09-10T23:18:19.831715+0000","last_peered":"2024-09-10T23:18:19.831715+0000","last_clean":"2024-09-10T23:18:19.831715+0000","last_became_active":"2024-09-10T23:18:19.823753+0000","last_became_peered":"2024-09-10T23:18:19.823753+0000","last_unstale":"2024-09-10T23:18:19.831715+0000","last_undegraded":"2024-09-10T23:18:19.831715+0000","last_fullsized":"2024-09-10T23:18:19.831715+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:17.744145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834288+0000","last_change":"2024-09-10T23:18:18.823235+0000","last_active":"2024-09-10T23:18:19.834288+0000","last_peered":"2024-09-10T23:18:19.834288+0000","last_clean":"2024-09-10T23:18:19.834288+0000","last_became_active":"2024-09-10T23:18:18.822974+0000","last_became_peered":"2024-09-10T23:18:18.822974+0000","last_unstale":"2024-09-10T23:18:19.834288+0000","last_undegraded":"2024-09-10T23:18:19.834288+0000","last_fullsized":"2024-09-10T23:18:19.834288+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:17.927105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.810595+0000","last_change":"2024-09-10T23:18:18.823934+0000","last_active":"2024-09-10T23:18:19.810595+0000","last_peered":"2024-09-10T23:18:19.810595+0000","last_clean":"2024-09-10T23:18:19.810595+0000","last_became_active":"2024-09-10T23:18:18.823678+0000","last_became_peered":"2024-09-10T23:18:18.823678+0000","last_unstale":"2024-09-10T23:18:19.810595+0000","last_undegraded":"2024-09-10T23:18:19.810595+0000","last_fullsized":"2024-09-10T23:18:19.810595+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:31.791308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825779+0000","last_change":"2024-09-10T23:18:19.823606+0000","last_active":"2024-09-10T23:18:19.825779+0000","last_peered":"2024-09-10T23:18:19.825779+0000","last_clean":"2024-09-10T23:18:19.825779+0000","last_became_active":"2024-09-10T23:18:19.823330+0000","last_became_peered":"2024-09-10T23:18:19.823330+0000","last_unstale":"2024-09-10T23:18:19.825779+0000","last_undegraded":"2024-09-10T23:18:19.825779+0000","last_fullsized":"2024-09-10T23:18:19.825779+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:53.310849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.805111+0000","last_change":"2024-09-10T23:18:17.805111+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.805111+0000","last_undegraded":"2024-09-10T23:18:17.805111+0000","last_fullsized":"2024-09-10T23:18:17.805111+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.830829+0000","last_change":"2024-09-10T23:18:19.828031+0000","last_active":"2024-09-10T23:18:19.830829+0000","last_peered":"2024-09-10T23:18:19.830829+0000","last_clean":"2024-09-10T23:18:19.830829+0000","last_became_active":"2024-09-10T23:18:19.827562+0000","last_became_peered":"2024-09-10T23:18:19.827562+0000","last_unstale":"2024-09-10T23:18:19.830829+0000","last_undegraded":"2024-09-10T23:18:19.830829+0000","last_fullsized":"2024-09-10T23:18:19.830829+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:02.739126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.816397+0000","last_change":"2024-09-10T23:18:18.819315+0000","last_active":"2024-09-10T23:18:19.816397+0000","last_peered":"2024-09-10T23:18:19.816397+0000","last_clean":"2024-09-10T23:18:19.816397+0000","last_became_active":"2024-09-10T23:18:18.819056+0000","last_became_peered":"2024-09-10T23:18:18.819056+0000","last_unstale":"2024-09-10T23:18:19.816397+0000","last_undegraded":"2024-09-10T23:18:19.816397+0000","last_fullsized":"2024-09-10T23:18:19.816397+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:14.032775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.826058+0000","last_change":"2024-09-10T23:18:19.824655+0000","last_active":"2024-09-10T23:18:19.826058+0000","last_peered":"2024-09-10T23:18:19.826058+0000","last_clean":"2024-09-10T23:18:19.826058+0000","last_became_active":"2024-09-10T23:18:19.824343+0000","last_became_peered":"2024-09-10T23:18:19.824343+0000","last_unstale":"2024-09-10T23:18:19.826058+0000","last_undegraded":"2024-09-10T23:18:19.826058+0000","last_fullsized":"2024-09-10T23:18:19.826058+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:01.734594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.813716+0000","last_change":"2024-09-10T23:18:18.818757+0000","last_active":"2024-09-10T23:18:19.813716+0000","last_peered":"2024-09-10T23:18:19.813716+0000","last_clean":"2024-09-10T23:18:19.813716+0000","last_became_active":"2024-09-10T23:18:18.818481+0000","last_became_peered":"2024-09-10T23:18:18.818481+0000","last_unstale":"2024-09-10T23:18:19.813716+0000","last_undegraded":"2024-09-10T23:18:19.813716+0000","last_fullsized":"2024-09-10T23:18:19.813716+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:26.837746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827614+0000","last_change":"2024-09-10T23:18:19.822703+0000","last_active":"2024-09-10T23:18:19.827614+0000","last_peered":"2024-09-10T23:18:19.827614+0000","last_clean":"2024-09-10T23:18:19.827614+0000","last_became_active":"2024-09-10T23:18:19.822469+0000","last_became_peered":"2024-09-10T23:18:19.822469+0000","last_unstale":"2024-09-10T23:18:19.827614+0000","last_undegraded":"2024-09-10T23:18:19.827614+0000","last_fullsized":"2024-09-10T23:18:19.827614+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:41.518449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804761+0000","last_change":"2024-09-10T23:18:17.804761+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804761+0000","last_undegraded":"2024-09-10T23:18:17.804761+0000","last_fullsized":"2024-09-10T23:18:17.804761+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.831276+0000","last_change":"2024-09-10T23:18:19.828960+0000","last_active":"2024-09-10T23:18:19.831276+0000","last_peered":"2024-09-10T23:18:19.831276+0000","last_clean":"2024-09-10T23:18:19.831276+0000","last_became_active":"2024-09-10T23:18:19.828713+0000","last_became_peered":"2024-09-10T23:18:19.828713+0000","last_unstale":"2024-09-10T23:18:19.831276+0000","last_undegraded":"2024-09-10T23:18:19.831276+0000","last_fullsized":"2024-09-10T23:18:19.831276+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:57.755101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804327+0000","last_change":"2024-09-10T23:18:17.804327+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804327+0000","last_undegraded":"2024-09-10T23:18:17.804327+0000","last_fullsized":"2024-09-10T23:18:17.804327+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827862+0000","last_change":"2024-09-10T23:18:19.825366+0000","last_active":"2024-09-10T23:18:19.827862+0000","last_peered":"2024-09-10T23:18:19.827862+0000","last_clean":"2024-09-10T23:18:19.827862+0000","last_became_active":"2024-09-10T23:18:19.824770+0000","last_became_peered":"2024-09-10T23:18:19.824770+0000","last_unstale":"2024-09-10T23:18:19.827862+0000","last_undegraded":"2024-09-10T23:18:19.827862+0000","last_fullsized":"2024-09-10T23:18:19.827862+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:03.765204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.835098+0000","last_change":"2024-09-10T23:18:18.817973+0000","last_active":"2024-09-10T23:18:19.835098+0000","last_peered":"2024-09-10T23:18:19.835098+0000","last_clean":"2024-09-10T23:18:19.835098+0000","last_became_active":"2024-09-10T23:18:18.817730+0000","last_became_peered":"2024-09-10T23:18:18.817730+0000","last_unstale":"2024-09-10T23:18:19.835098+0000","last_undegraded":"2024-09-10T23:18:19.835098+0000","last_fullsized":"2024-09-10T23:18:19.835098+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:47.032035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834233+0000","last_change":"2024-09-10T23:18:19.829079+0000","last_active":"2024-09-10T23:18:19.834233+0000","last_peered":"2024-09-10T23:18:19.834233+0000","last_clean":"2024-09-10T23:18:19.834233+0000","last_became_active":"2024-09-10T23:18:19.828829+0000","last_became_peered":"2024-09-10T23:18:19.828829+0000","last_unstale":"2024-09-10T23:18:19.834233+0000","last_undegraded":"2024-09-10T23:18:19.834233+0000","last_fullsized":"2024-09-10T23:18:19.834233+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:27.114207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.816267+0000","last_change":"2024-09-10T23:18:18.826768+0000","last_active":"2024-09-10T23:18:19.816267+0000","last_peered":"2024-09-10T23:18:19.816267+0000","last_clean":"2024-09-10T23:18:19.816267+0000","last_became_active":"2024-09-10T23:18:18.826502+0000","last_became_peered":"2024-09-10T23:18:18.826502+0000","last_unstale":"2024-09-10T23:18:19.816267+0000","last_undegraded":"2024-09-10T23:18:19.816267+0000","last_fullsized":"2024-09-10T23:18:19.816267+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:48.343739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827452+0000","last_change":"2024-09-10T23:18:19.822055+0000","last_active":"2024-09-10T23:18:19.827452+0000","last_peered":"2024-09-10T23:18:19.827452+0000","last_clean":"2024-09-10T23:18:19.827452+0000","last_became_active":"2024-09-10T23:18:19.821803+0000","last_became_peered":"2024-09-10T23:18:19.821803+0000","last_unstale":"2024-09-10T23:18:19.827452+0000","last_undegraded":"2024-09-10T23:18:19.827452+0000","last_fullsized":"2024-09-10T23:18:19.827452+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:56.084094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"103'8","reported_seq":21,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.835219+0000","last_change":"2024-09-10T23:18:18.821437+0000","last_active":"2024-09-10T23:18:19.835219+0000","last_peered":"2024-09-10T23:18:19.835219+0000","last_clean":"2024-09-10T23:18:19.835219+0000","last_became_active":"2024-09-10T23:18:18.821139+0000","last_became_peered":"2024-09-10T23:18:18.821139+0000","last_unstale":"2024-09-10T23:18:19.835219+0000","last_undegraded":"2024-09-10T23:18:19.835219+0000","last_fullsized":"2024-09-10T23:18:19.835219+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:34.527204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825319+0000","last_change":"2024-09-10T23:18:19.823839+0000","last_active":"2024-09-10T23:18:19.825319+0000","last_peered":"2024-09-10T23:18:19.825319+0000","last_clean":"2024-09-10T23:18:19.825319+0000","last_became_active":"2024-09-10T23:18:19.823562+0000","last_became_peered":"2024-09-10T23:18:19.823562+0000","last_unstale":"2024-09-10T23:18:19.825319+0000","last_undegraded":"2024-09-10T23:18:19.825319+0000","last_fullsized":"2024-09-10T23:18:19.825319+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:52.644364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804322+0000","last_change":"2024-09-10T23:18:17.804322+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804322+0000","last_undegraded":"2024-09-10T23:18:17.804322+0000","last_fullsized":"2024-09-10T23:18:17.804322+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837701+0000","last_change":"2024-09-10T23:18:19.831151+0000","last_active":"2024-09-10T23:18:19.837701+0000","last_peered":"2024-09-10T23:18:19.837701+0000","last_clean":"2024-09-10T23:18:19.837701+0000","last_became_active":"2024-09-10T23:18:19.830881+0000","last_became_peered":"2024-09-10T23:18:19.830881+0000","last_unstale":"2024-09-10T23:18:19.837701+0000","last_undegraded":"2024-09-10T23:18:19.837701+0000","last_fullsized":"2024-09-10T23:18:19.837701+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:12.216598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.832483+0000","last_change":"2024-09-10T23:18:18.822172+0000","last_active":"2024-09-10T23:18:19.832483+0000","last_peered":"2024-09-10T23:18:19.832483+0000","last_clean":"2024-09-10T23:18:19.832483+0000","last_became_active":"2024-09-10T23:18:18.821867+0000","last_became_peered":"2024-09-10T23:18:18.821867+0000","last_unstale":"2024-09-10T23:18:19.832483+0000","last_undegraded":"2024-09-10T23:18:19.832483+0000","last_fullsized":"2024-09-10T23:18:19.832483+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:28.101107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.839695+0000","last_change":"2024-09-10T23:18:19.838948+0000","last_active":"2024-09-10T23:18:19.839695+0000","last_peered":"2024-09-10T23:18:19.839695+0000","last_clean":"2024-09-10T23:18:19.839695+0000","last_became_active":"2024-09-10T23:18:19.838478+0000","last_became_peered":"2024-09-10T23:18:19.838478+0000","last_unstale":"2024-09-10T23:18:19.839695+0000","last_undegraded":"2024-09-10T23:18:19.839695+0000","last_fullsized":"2024-09-10T23:18:19.839695+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:21.069271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.828742+0000","last_change":"2024-09-10T23:18:18.828797+0000","last_active":"2024-09-10T23:18:19.828742+0000","last_peered":"2024-09-10T23:18:19.828742+0000","last_clean":"2024-09-10T23:18:19.828742+0000","last_became_active":"2024-09-10T23:18:18.828538+0000","last_became_peered":"2024-09-10T23:18:18.828538+0000","last_unstale":"2024-09-10T23:18:19.828742+0000","last_undegraded":"2024-09-10T23:18:19.828742+0000","last_fullsized":"2024-09-10T23:18:19.828742+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:14.953384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834779+0000","last_change":"2024-09-10T23:18:19.832939+0000","last_active":"2024-09-10T23:18:19.834779+0000","last_peered":"2024-09-10T23:18:19.834779+0000","last_clean":"2024-09-10T23:18:19.834779+0000","last_became_active":"2024-09-10T23:18:19.832618+0000","last_became_peered":"2024-09-10T23:18:19.832618+0000","last_unstale":"2024-09-10T23:18:19.834779+0000","last_undegraded":"2024-09-10T23:18:19.834779+0000","last_fullsized":"2024-09-10T23:18:19.834779+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:09.419897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.809176+0000","last_change":"2024-09-10T23:18:18.821792+0000","last_active":"2024-09-10T23:18:19.809176+0000","last_peered":"2024-09-10T23:18:19.809176+0000","last_clean":"2024-09-10T23:18:19.809176+0000","last_became_active":"2024-09-10T23:18:18.821465+0000","last_became_peered":"2024-09-10T23:18:18.821465+0000","last_unstale":"2024-09-10T23:18:19.809176+0000","last_undegraded":"2024-09-10T23:18:19.809176+0000","last_fullsized":"2024-09-10T23:18:19.809176+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:53.324053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834680+0000","last_change":"2024-09-10T23:18:19.832542+0000","last_active":"2024-09-10T23:18:19.834680+0000","last_peered":"2024-09-10T23:18:19.834680+0000","last_clean":"2024-09-10T23:18:19.834680+0000","last_became_active":"2024-09-10T23:18:19.832208+0000","last_became_peered":"2024-09-10T23:18:19.832208+0000","last_unstale":"2024-09-10T23:18:19.834680+0000","last_undegraded":"2024-09-10T23:18:19.834680+0000","last_fullsized":"2024-09-10T23:18:19.834680+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:38.816382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.828537+0000","last_change":"2024-09-10T23:18:18.823102+0000","last_active":"2024-09-10T23:18:19.828537+0000","last_peered":"2024-09-10T23:18:19.828537+0000","last_clean":"2024-09-10T23:18:19.828537+0000","last_became_active":"2024-09-10T23:18:18.822794+0000","last_became_peered":"2024-09-10T23:18:18.822794+0000","last_unstale":"2024-09-10T23:18:19.828537+0000","last_undegraded":"2024-09-10T23:18:19.828537+0000","last_fullsized":"2024-09-10T23:18:19.828537+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:29.032172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.817130+0000","last_change":"2024-09-10T23:18:18.821285+0000","last_active":"2024-09-10T23:18:19.817130+0000","last_peered":"2024-09-10T23:18:19.817130+0000","last_clean":"2024-09-10T23:18:19.817130+0000","last_became_active":"2024-09-10T23:18:18.820993+0000","last_became_peered":"2024-09-10T23:18:18.820993+0000","last_unstale":"2024-09-10T23:18:19.817130+0000","last_undegraded":"2024-09-10T23:18:19.817130+0000","last_fullsized":"2024-09-10T23:18:19.817130+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:47.032035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837793+0000","last_change":"2024-09-10T23:18:19.836596+0000","last_active":"2024-09-10T23:18:19.837793+0000","last_peered":"2024-09-10T23:18:19.837793+0000","last_clean":"2024-09-10T23:18:19.837793+0000","last_became_active":"2024-09-10T23:18:19.836333+0000","last_became_peered":"2024-09-10T23:18:19.836333+0000","last_unstale":"2024-09-10T23:18:19.837793+0000","last_undegraded":"2024-09-10T23:18:19.837793+0000","last_fullsized":"2024-09-10T23:18:19.837793+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:53.315354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.824644+0000","last_change":"2024-09-10T23:18:18.824334+0000","last_active":"2024-09-10T23:18:19.824644+0000","last_peered":"2024-09-10T23:18:19.824644+0000","last_clean":"2024-09-10T23:18:19.824644+0000","last_became_active":"2024-09-10T23:18:18.824076+0000","last_became_peered":"2024-09-10T23:18:18.824076+0000","last_unstale":"2024-09-10T23:18:19.824644+0000","last_undegraded":"2024-09-10T23:18:19.824644+0000","last_fullsized":"2024-09-10T23:18:19.824644+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:51.639356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.835189+0000","last_change":"2024-09-10T23:18:19.832624+0000","last_active":"2024-09-10T23:18:19.835189+0000","last_peered":"2024-09-10T23:18:19.835189+0000","last_clean":"2024-09-10T23:18:19.835189+0000","last_became_active":"2024-09-10T23:18:19.832337+0000","last_became_peered":"2024-09-10T23:18:19.832337+0000","last_unstale":"2024-09-10T23:18:19.835189+0000","last_undegraded":"2024-09-10T23:18:19.835189+0000","last_fullsized":"2024-09-10T23:18:19.835189+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:01.080207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804673+0000","last_change":"2024-09-10T23:18:17.804673+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804673+0000","last_undegraded":"2024-09-10T23:18:17.804673+0000","last_fullsized":"2024-09-10T23:18:17.804673+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825173+0000","last_change":"2024-09-10T23:18:19.819937+0000","last_active":"2024-09-10T23:18:19.825173+0000","last_peered":"2024-09-10T23:18:19.825173+0000","last_clean":"2024-09-10T23:18:19.825173+0000","last_became_active":"2024-09-10T23:18:19.819609+0000","last_became_peered":"2024-09-10T23:18:19.819609+0000","last_unstale":"2024-09-10T23:18:19.825173+0000","last_undegraded":"2024-09-10T23:18:19.825173+0000","last_fullsized":"2024-09-10T23:18:19.825173+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:33:38.788016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.836909+0000","last_change":"2024-09-10T23:18:18.823508+0000","last_active":"2024-09-10T23:18:19.836909+0000","last_peered":"2024-09-10T23:18:19.836909+0000","last_clean":"2024-09-10T23:18:19.836909+0000","last_became_active":"2024-09-10T23:18:18.823163+0000","last_became_peered":"2024-09-10T23:18:18.823163+0000","last_unstale":"2024-09-10T23:18:19.836909+0000","last_undegraded":"2024-09-10T23:18:19.836909+0000","last_fullsized":"2024-09-10T23:18:19.836909+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:57.336353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.816402+0000","last_change":"2024-09-10T23:18:18.818495+0000","last_active":"2024-09-10T23:18:19.816402+0000","last_peered":"2024-09-10T23:18:19.816402+0000","last_clean":"2024-09-10T23:18:19.816402+0000","last_became_active":"2024-09-10T23:18:18.818166+0000","last_became_peered":"2024-09-10T23:18:18.818166+0000","last_unstale":"2024-09-10T23:18:19.816402+0000","last_undegraded":"2024-09-10T23:18:19.816402+0000","last_fullsized":"2024-09-10T23:18:19.816402+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:17.521005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804344+0000","last_change":"2024-09-10T23:18:17.804344+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804344+0000","last_undegraded":"2024-09-10T23:18:17.804344+0000","last_fullsized":"2024-09-10T23:18:17.804344+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825109+0000","last_change":"2024-09-10T23:18:19.819902+0000","last_active":"2024-09-10T23:18:19.825109+0000","last_peered":"2024-09-10T23:18:19.825109+0000","last_clean":"2024-09-10T23:18:19.825109+0000","last_became_active":"2024-09-10T23:18:19.819597+0000","last_became_peered":"2024-09-10T23:18:19.819597+0000","last_unstale":"2024-09-10T23:18:19.825109+0000","last_undegraded":"2024-09-10T23:18:19.825109+0000","last_fullsized":"2024-09-10T23:18:19.825109+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:24.559448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.817328+0000","last_change":"2024-09-10T23:18:18.823716+0000","last_active":"2024-09-10T23:18:19.817328+0000","last_peered":"2024-09-10T23:18:19.817328+0000","last_clean":"2024-09-10T23:18:19.817328+0000","last_became_active":"2024-09-10T23:18:18.823450+0000","last_became_peered":"2024-09-10T23:18:18.823450+0000","last_unstale":"2024-09-10T23:18:19.817328+0000","last_undegraded":"2024-09-10T23:18:19.817328+0000","last_fullsized":"2024-09-10T23:18:19.817328+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:00.834074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.820383+0000","last_change":"2024-09-10T23:18:19.813945+0000","last_active":"2024-09-10T23:18:19.820383+0000","last_peered":"2024-09-10T23:18:19.820383+0000","last_clean":"2024-09-10T23:18:19.820383+0000","last_became_active":"2024-09-10T23:18:19.813279+0000","last_became_peered":"2024-09-10T23:18:19.813279+0000","last_unstale":"2024-09-10T23:18:19.820383+0000","last_undegraded":"2024-09-10T23:18:19.820383+0000","last_fullsized":"2024-09-10T23:18:19.820383+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:05.534969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.809221+0000","last_change":"2024-09-10T23:18:18.818409+0000","last_active":"2024-09-10T23:18:19.809221+0000","last_peered":"2024-09-10T23:18:19.809221+0000","last_clean":"2024-09-10T23:18:19.809221+0000","last_became_active":"2024-09-10T23:18:18.817769+0000","last_became_peered":"2024-09-10T23:18:18.817769+0000","last_unstale":"2024-09-10T23:18:19.809221+0000","last_undegraded":"2024-09-10T23:18:19.809221+0000","last_fullsized":"2024-09-10T23:18:19.809221+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:22:24.800421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.831874+0000","last_change":"2024-09-10T23:18:19.826769+0000","last_active":"2024-09-10T23:18:19.831874+0000","last_peered":"2024-09-10T23:18:19.831874+0000","last_clean":"2024-09-10T23:18:19.831874+0000","last_became_active":"2024-09-10T23:18:19.826467+0000","last_became_peered":"2024-09-10T23:18:19.826467+0000","last_unstale":"2024-09-10T23:18:19.831874+0000","last_undegraded":"2024-09-10T23:18:19.831874+0000","last_fullsized":"2024-09-10T23:18:19.831874+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:19.420378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.811272+0000","last_change":"2024-09-10T23:18:18.820337+0000","last_active":"2024-09-10T23:18:19.811272+0000","last_peered":"2024-09-10T23:18:19.811272+0000","last_clean":"2024-09-10T23:18:19.811272+0000","last_became_active":"2024-09-10T23:18:18.820040+0000","last_became_peered":"2024-09-10T23:18:18.820040+0000","last_unstale":"2024-09-10T23:18:19.811272+0000","last_undegraded":"2024-09-10T23:18:19.811272+0000","last_fullsized":"2024-09-10T23:18:19.811272+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:12.068147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834708+0000","last_change":"2024-09-10T23:18:19.833541+0000","last_active":"2024-09-10T23:18:19.834708+0000","last_peered":"2024-09-10T23:18:19.834708+0000","last_clean":"2024-09-10T23:18:19.834708+0000","last_became_active":"2024-09-10T23:18:19.833278+0000","last_became_peered":"2024-09-10T23:18:19.833278+0000","last_unstale":"2024-09-10T23:18:19.834708+0000","last_undegraded":"2024-09-10T23:18:19.834708+0000","last_fullsized":"2024-09-10T23:18:19.834708+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:34.315019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.815852+0000","last_change":"2024-09-10T23:18:18.822619+0000","last_active":"2024-09-10T23:18:19.815852+0000","last_peered":"2024-09-10T23:18:19.815852+0000","last_clean":"2024-09-10T23:18:19.815852+0000","last_became_active":"2024-09-10T23:18:18.822363+0000","last_became_peered":"2024-09-10T23:18:18.822363+0000","last_unstale":"2024-09-10T23:18:19.815852+0000","last_undegraded":"2024-09-10T23:18:19.815852+0000","last_fullsized":"2024-09-10T23:18:19.815852+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:13.423487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.803615+0000","last_change":"2024-09-10T23:18:17.803615+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.803615+0000","last_undegraded":"2024-09-10T23:18:17.803615+0000","last_fullsized":"2024-09-10T23:18:17.803615+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834757+0000","last_change":"2024-09-10T23:18:19.829796+0000","last_active":"2024-09-10T23:18:19.834757+0000","last_peered":"2024-09-10T23:18:19.834757+0000","last_clean":"2024-09-10T23:18:19.834757+0000","last_became_active":"2024-09-10T23:18:19.829530+0000","last_became_peered":"2024-09-10T23:18:19.829530+0000","last_unstale":"2024-09-10T23:18:19.834757+0000","last_undegraded":"2024-09-10T23:18:19.834757+0000","last_fullsized":"2024-09-10T23:18:19.834757+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:56.155914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.810245+0000","last_change":"2024-09-10T23:18:18.821522+0000","last_active":"2024-09-10T23:18:19.810245+0000","last_peered":"2024-09-10T23:18:19.810245+0000","last_clean":"2024-09-10T23:18:19.810245+0000","last_became_active":"2024-09-10T23:18:18.821236+0000","last_became_peered":"2024-09-10T23:18:18.821236+0000","last_unstale":"2024-09-10T23:18:19.810245+0000","last_undegraded":"2024-09-10T23:18:19.810245+0000","last_fullsized":"2024-09-10T23:18:19.810245+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:17.910202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":255,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825975+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:18:19.825975+0000","last_peered":"2024-09-10T23:18:19.825975+0000","last_clean":"2024-09-10T23:18:19.825975+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:18:19.825975+0000","last_undegraded":"2024-09-10T23:18:19.825975+0000","last_fullsized":"2024-09-10T23:18:19.825975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28864,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342976,"statfs":{"total":96636764160,"available":96607207424,"internally_reserved":0,"allocated":1875968,"data_stored":1130931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1277952,"data_stored":540017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1282048,"data_stored":540551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1273856,"data_stored":539947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509492,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1261568,"data_stored":533172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1273856,"data_stored":539947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509492,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1282048,"data_stored":540071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32988,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338852,"statfs":{"total":96636764160,"available":96602984448,"internally_reserved":0,"allocated":1843200,"data_stored":1117265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:18:23.438 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3f is not active+clean 2024-09-10T23:18:23.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:18:18.798951+0000', 'last_change': '2024-09-10T23:18:18.798951+0000', 'last_active': '2024-09-10T23:18:18.798951+0000', 'last_peered': '2024-09-10T23:18:18.798951+0000', 'last_clean': '2024-09-10T23:18:18.798951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:18.798951+0000', 'last_undegraded': '2024-09-10T23:18:18.798951+0000', 'last_fullsized': '2024-09-10T23:18:18.798951+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:18:23.438 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3c is not active+clean 2024-09-10T23:18:23.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:18:18.798951+0000', 'last_change': '2024-09-10T23:18:18.798951+0000', 'last_active': '2024-09-10T23:18:18.798951+0000', 'last_peered': '2024-09-10T23:18:18.798951+0000', 'last_clean': '2024-09-10T23:18:18.798951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:18.798951+0000', 'last_undegraded': '2024-09-10T23:18:18.798951+0000', 'last_fullsized': '2024-09-10T23:18:18.798951+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:18:23.438 INFO:tasks.ceph.ceph_manager.ceph:PG 17.37 is not active+clean 2024-09-10T23:18:23.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:18:18.798951+0000', 'last_change': '2024-09-10T23:18:18.798951+0000', 'last_active': '2024-09-10T23:18:18.798951+0000', 'last_peered': '2024-09-10T23:18:18.798951+0000', 'last_clean': '2024-09-10T23:18:18.798951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:18.798951+0000', 'last_undegraded': '2024-09-10T23:18:18.798951+0000', 'last_fullsized': '2024-09-10T23:18:18.798951+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:18:23.438 INFO:tasks.ceph.ceph_manager.ceph:PG 17.36 is not active+clean 2024-09-10T23:18:23.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:18:18.798951+0000', 'last_change': '2024-09-10T23:18:18.798951+0000', 'last_active': '2024-09-10T23:18:18.798951+0000', 'last_peered': '2024-09-10T23:18:18.798951+0000', 'last_clean': '2024-09-10T23:18:18.798951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:18.798951+0000', 'last_undegraded': '2024-09-10T23:18:18.798951+0000', 'last_fullsized': '2024-09-10T23:18:18.798951+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:18:23.438 INFO:tasks.ceph.ceph_manager.ceph:PG 17.34 is not active+clean 2024-09-10T23:18:23.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:18:18.798951+0000', 'last_change': '2024-09-10T23:18:18.798951+0000', 'last_active': '2024-09-10T23:18:18.798951+0000', 'last_peered': '2024-09-10T23:18:18.798951+0000', 'last_clean': '2024-09-10T23:18:18.798951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:18.798951+0000', 'last_undegraded': '2024-09-10T23:18:18.798951+0000', 'last_fullsized': '2024-09-10T23:18:18.798951+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:18:23.439 INFO:tasks.ceph.ceph_manager.ceph:PG 17.30 is not active+clean 2024-09-10T23:18:23.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:18:18.798951+0000', 'last_change': '2024-09-10T23:18:18.798951+0000', 'last_active': '2024-09-10T23:18:18.798951+0000', 'last_peered': '2024-09-10T23:18:18.798951+0000', 'last_clean': '2024-09-10T23:18:18.798951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:18.798951+0000', 'last_undegraded': '2024-09-10T23:18:18.798951+0000', 'last_fullsized': '2024-09-10T23:18:18.798951+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:18:23.439 INFO:tasks.ceph.ceph_manager.ceph:PG 17.26 is not active+clean 2024-09-10T23:18:23.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:18:18.798951+0000', 'last_change': '2024-09-10T23:18:18.798951+0000', 'last_active': '2024-09-10T23:18:18.798951+0000', 'last_peered': '2024-09-10T23:18:18.798951+0000', 'last_clean': '2024-09-10T23:18:18.798951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:18.798951+0000', 'last_undegraded': '2024-09-10T23:18:18.798951+0000', 'last_fullsized': '2024-09-10T23:18:18.798951+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:18:23.439 INFO:tasks.ceph.ceph_manager.ceph:PG 17.21 is not active+clean 2024-09-10T23:18:23.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:18:18.798951+0000', 'last_change': '2024-09-10T23:18:18.798951+0000', 'last_active': '2024-09-10T23:18:18.798951+0000', 'last_peered': '2024-09-10T23:18:18.798951+0000', 'last_clean': '2024-09-10T23:18:18.798951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:18.798951+0000', 'last_undegraded': '2024-09-10T23:18:18.798951+0000', 'last_fullsized': '2024-09-10T23:18:18.798951+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:18:23.439 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1a is not active+clean 2024-09-10T23:18:23.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:18:18.798951+0000', 'last_change': '2024-09-10T23:18:18.798951+0000', 'last_active': '2024-09-10T23:18:18.798951+0000', 'last_peered': '2024-09-10T23:18:18.798951+0000', 'last_clean': '2024-09-10T23:18:18.798951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:18.798951+0000', 'last_undegraded': '2024-09-10T23:18:18.798951+0000', 'last_fullsized': '2024-09-10T23:18:18.798951+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:18:23.439 INFO:tasks.ceph.ceph_manager.ceph:PG 17.18 is not active+clean 2024-09-10T23:18:23.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:18:18.798951+0000', 'last_change': '2024-09-10T23:18:18.798951+0000', 'last_active': '2024-09-10T23:18:18.798951+0000', 'last_peered': '2024-09-10T23:18:18.798951+0000', 'last_clean': '2024-09-10T23:18:18.798951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:18.798951+0000', 'last_undegraded': '2024-09-10T23:18:18.798951+0000', 'last_fullsized': '2024-09-10T23:18:18.798951+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:18:23.440 INFO:tasks.ceph.ceph_manager.ceph:PG 16.18 is not active+clean 2024-09-10T23:18:23.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:17.805111+0000', 'last_change': '2024-09-10T23:18:17.805111+0000', 'last_active': '2024-09-10T23:18:17.793943+0000', 'last_peered': '2024-09-10T23:18:17.793943+0000', 'last_clean': '2024-09-10T23:18:17.793943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:17.805111+0000', 'last_undegraded': '2024-09-10T23:18:17.805111+0000', 'last_fullsized': '2024-09-10T23:18:17.805111+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:18:23.440 INFO:tasks.ceph.ceph_manager.ceph:PG 16.15 is not active+clean 2024-09-10T23:18:23.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:17.804761+0000', 'last_change': '2024-09-10T23:18:17.804761+0000', 'last_active': '2024-09-10T23:18:17.793943+0000', 'last_peered': '2024-09-10T23:18:17.793943+0000', 'last_clean': '2024-09-10T23:18:17.793943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:17.804761+0000', 'last_undegraded': '2024-09-10T23:18:17.804761+0000', 'last_fullsized': '2024-09-10T23:18:17.804761+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:18:23.440 INFO:tasks.ceph.ceph_manager.ceph:PG 16.14 is not active+clean 2024-09-10T23:18:23.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:17.804327+0000', 'last_change': '2024-09-10T23:18:17.804327+0000', 'last_active': '2024-09-10T23:18:17.793943+0000', 'last_peered': '2024-09-10T23:18:17.793943+0000', 'last_clean': '2024-09-10T23:18:17.793943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:17.804327+0000', 'last_undegraded': '2024-09-10T23:18:17.804327+0000', 'last_fullsized': '2024-09-10T23:18:17.804327+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:18:23.440 INFO:tasks.ceph.ceph_manager.ceph:PG 16.f is not active+clean 2024-09-10T23:18:23.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:17.804322+0000', 'last_change': '2024-09-10T23:18:17.804322+0000', 'last_active': '2024-09-10T23:18:17.793943+0000', 'last_peered': '2024-09-10T23:18:17.793943+0000', 'last_clean': '2024-09-10T23:18:17.793943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:17.804322+0000', 'last_undegraded': '2024-09-10T23:18:17.804322+0000', 'last_fullsized': '2024-09-10T23:18:17.804322+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:18:23.441 INFO:tasks.ceph.ceph_manager.ceph:PG 17.b is not active+clean 2024-09-10T23:18:23.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:18:18.798951+0000', 'last_change': '2024-09-10T23:18:18.798951+0000', 'last_active': '2024-09-10T23:18:18.798951+0000', 'last_peered': '2024-09-10T23:18:18.798951+0000', 'last_clean': '2024-09-10T23:18:18.798951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:18.798951+0000', 'last_undegraded': '2024-09-10T23:18:18.798951+0000', 'last_fullsized': '2024-09-10T23:18:18.798951+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:18:23.441 INFO:tasks.ceph.ceph_manager.ceph:PG 16.8 is not active+clean 2024-09-10T23:18:23.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:17.804673+0000', 'last_change': '2024-09-10T23:18:17.804673+0000', 'last_active': '2024-09-10T23:18:17.793943+0000', 'last_peered': '2024-09-10T23:18:17.793943+0000', 'last_clean': '2024-09-10T23:18:17.793943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:17.804673+0000', 'last_undegraded': '2024-09-10T23:18:17.804673+0000', 'last_fullsized': '2024-09-10T23:18:17.804673+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:18:23.441 INFO:tasks.ceph.ceph_manager.ceph:PG 17.7 is not active+clean 2024-09-10T23:18:23.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:18:18.798951+0000', 'last_change': '2024-09-10T23:18:18.798951+0000', 'last_active': '2024-09-10T23:18:18.798951+0000', 'last_peered': '2024-09-10T23:18:18.798951+0000', 'last_clean': '2024-09-10T23:18:18.798951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:18.798951+0000', 'last_undegraded': '2024-09-10T23:18:18.798951+0000', 'last_fullsized': '2024-09-10T23:18:18.798951+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:18:23.441 INFO:tasks.ceph.ceph_manager.ceph:PG 17.4 is not active+clean 2024-09-10T23:18:23.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:18:18.798951+0000', 'last_change': '2024-09-10T23:18:18.798951+0000', 'last_active': '2024-09-10T23:18:18.798951+0000', 'last_peered': '2024-09-10T23:18:18.798951+0000', 'last_clean': '2024-09-10T23:18:18.798951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:18.798951+0000', 'last_undegraded': '2024-09-10T23:18:18.798951+0000', 'last_fullsized': '2024-09-10T23:18:18.798951+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:18:23.441 INFO:tasks.ceph.ceph_manager.ceph:PG 16.5 is not active+clean 2024-09-10T23:18:23.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:17.804344+0000', 'last_change': '2024-09-10T23:18:17.804344+0000', 'last_active': '2024-09-10T23:18:17.793943+0000', 'last_peered': '2024-09-10T23:18:17.793943+0000', 'last_clean': '2024-09-10T23:18:17.793943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:17.804344+0000', 'last_undegraded': '2024-09-10T23:18:17.804344+0000', 'last_fullsized': '2024-09-10T23:18:17.804344+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:18:23.441 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1 is not active+clean 2024-09-10T23:18:23.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T23:18:18.798951+0000', 'last_change': '2024-09-10T23:18:18.798951+0000', 'last_active': '2024-09-10T23:18:18.798951+0000', 'last_peered': '2024-09-10T23:18:18.798951+0000', 'last_clean': '2024-09-10T23:18:18.798951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:18.798951+0000', 'last_undegraded': '2024-09-10T23:18:18.798951+0000', 'last_fullsized': '2024-09-10T23:18:18.798951+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:18.798951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T23:18:23.442 INFO:tasks.ceph.ceph_manager.ceph:PG 16.0 is not active+clean 2024-09-10T23:18:23.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:17.803615+0000', 'last_change': '2024-09-10T23:18:17.803615+0000', 'last_active': '2024-09-10T23:18:17.793943+0000', 'last_peered': '2024-09-10T23:18:17.793943+0000', 'last_clean': '2024-09-10T23:18:17.793943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:17.803615+0000', 'last_undegraded': '2024-09-10T23:18:17.803615+0000', 'last_fullsized': '2024-09-10T23:18:17.803615+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:17.793943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:18:23.442 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:18:23.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.575+0000 7f6588b9f640 1 -- 172.21.15.90:0/2526300926 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6584154680 msgr2=0x7f6584154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:23.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.575+0000 7f6588b9f640 1 --2- 172.21.15.90:0/2526300926 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6584154680 0x7f6584154b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f657c005fd0 tx=0x7f657c02a820 comp rx=0 tx=0).stop 2024-09-10T23:18:23.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.575+0000 7f6588b9f640 1 -- 172.21.15.90:0/2526300926 shutdown_connections 2024-09-10T23:18:23.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.575+0000 7f6588b9f640 1 --2- 172.21.15.90:0/2526300926 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6584154680 0x7f6584154b10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.575+0000 7f6588b9f640 1 --2- 172.21.15.90:0/2526300926 >> v2:172.21.15.171:3300/0 conn(0x7f6584072ee0 0x7f6584073300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.575+0000 7f6588b9f640 1 -- 172.21.15.90:0/2526300926 >> 172.21.15.90:0/2526300926 conn(0x7f6584069590 msgr2=0x7f658406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:23.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.575+0000 7f6588b9f640 1 -- 172.21.15.90:0/2526300926 shutdown_connections 2024-09-10T23:18:23.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.575+0000 7f6588b9f640 1 -- 172.21.15.90:0/2526300926 wait complete. 2024-09-10T23:18:23.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.576+0000 7f6588b9f640 1 Processor -- start 2024-09-10T23:18:23.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.576+0000 7f6588b9f640 1 -- start start 2024-09-10T23:18:23.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.577+0000 7f6588b9f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6584072ee0 0x7f658415a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:23.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.577+0000 7f6588b9f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65840cc990 0x7f65841f2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:23.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.577+0000 7f6588b9f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6584154680 0x7f6584149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:23.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.577+0000 7f6588b9f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f65841551d0 con 0x7f6584072ee0 2024-09-10T23:18:23.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.577+0000 7f6588b9f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6584155050 con 0x7f65840cc990 2024-09-10T23:18:23.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.577+0000 7f6588b9f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6584155350 con 0x7f6584154680 2024-09-10T23:18:23.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.577+0000 7f65837fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6584072ee0 0x7f658415a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:23.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.577+0000 7f65837fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6584072ee0 0x7f658415a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56410/0 (socket says 172.21.15.90:56410) 2024-09-10T23:18:23.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.577+0000 7f65837fe640 1 -- 172.21.15.90:0/1804277646 learned_addr learned my addr 172.21.15.90:0/1804277646 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:23.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.578+0000 7f6583fff640 1 --2- 172.21.15.90:0/1804277646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6584154680 0x7f6584149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:23.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.578+0000 7f6582ffd640 1 --2- 172.21.15.90:0/1804277646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65840cc990 0x7f65841f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:23.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.578+0000 7f65837fe640 1 -- 172.21.15.90:0/1804277646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6584154680 msgr2=0x7f6584149e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:23.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.578+0000 7f65837fe640 1 --2- 172.21.15.90:0/1804277646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6584154680 0x7f6584149e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.578+0000 7f65837fe640 1 -- 172.21.15.90:0/1804277646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65840cc990 msgr2=0x7f65841f2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:23.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.578+0000 7f65837fe640 1 --2- 172.21.15.90:0/1804277646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65840cc990 0x7f65841f2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.578+0000 7f65837fe640 1 -- 172.21.15.90:0/1804277646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65841f2c90 con 0x7f6584072ee0 2024-09-10T23:18:23.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.578+0000 7f6583fff640 1 --2- 172.21.15.90:0/1804277646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6584154680 0x7f6584149e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:23.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.578+0000 7f6582ffd640 1 --2- 172.21.15.90:0/1804277646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65840cc990 0x7f65841f2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:23.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.578+0000 7f65837fe640 1 --2- 172.21.15.90:0/1804277646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6584072ee0 0x7f658415a510 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f657400c490 tx=0x7f657400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:23.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.578+0000 7f656bfff640 1 -- 172.21.15.90:0/1804277646 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574016020 con 0x7f6584072ee0 2024-09-10T23:18:23.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.578+0000 7f656bfff640 1 -- 172.21.15.90:0/1804277646 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6574012940 con 0x7f6584072ee0 2024-09-10T23:18:23.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.578+0000 7f6588b9f640 1 -- 172.21.15.90:0/1804277646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6584159470 con 0x7f6584072ee0 2024-09-10T23:18:23.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.578+0000 7f656bfff640 1 -- 172.21.15.90:0/1804277646 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574012d90 con 0x7f6584072ee0 2024-09-10T23:18:23.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.578+0000 7f6588b9f640 1 -- 172.21.15.90:0/1804277646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6584159a30 con 0x7f6584072ee0 2024-09-10T23:18:23.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.579+0000 7f6588b9f640 1 -- 172.21.15.90:0/1804277646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6584154b10 con 0x7f6584072ee0 2024-09-10T23:18:23.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.579+0000 7f656bfff640 1 -- 172.21.15.90:0/1804277646 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f657401a3b0 con 0x7f6584072ee0 2024-09-10T23:18:23.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.580+0000 7f656bfff640 1 --2- 172.21.15.90:0/1804277646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6570077f70 0x7f657007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:23.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.580+0000 7f656bfff640 1 -- 172.21.15.90:0/1804277646 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f6574099a50 con 0x7f6584072ee0 2024-09-10T23:18:23.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.580+0000 7f6582ffd640 1 --2- 172.21.15.90:0/1804277646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6570077f70 0x7f657007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:23.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.581+0000 7f6582ffd640 1 --2- 172.21.15.90:0/1804277646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6570077f70 0x7f657007a430 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f65840b3070 tx=0x7f6578005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:23.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.584+0000 7f656bfff640 1 -- 172.21.15.90:0/1804277646 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6574020070 con 0x7f6584072ee0 2024-09-10T23:18:23.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.822+0000 7f6588b9f640 1 -- 172.21.15.90:0/1804277646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f658406dea0 con 0x7f6584072ee0 2024-09-10T23:18:23.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.823+0000 7f656bfff640 1 -- 172.21.15.90:0/1804277646 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1638 (secure 0 0 0) 0x7f6574062550 con 0x7f6584072ee0 2024-09-10T23:18:23.824 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:23.824 INFO:teuthology.orchestra.run.smithi090.stdout:{"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":251,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":104,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010065,"num_in_osds":8,"osd_in_since":1726010055,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":76},{"state_name":"unknown","count":14},{"state_name":"creating+peering","count":7}],"num_pgs":97,"num_pools":3,"num_objects":16,"data_bytes":591054,"bytes_used":262639616,"bytes_avail":772831473664,"bytes_total":773094113280,"unknown_pgs_ratio":0.14432989060878754,"inactive_pgs_ratio":0.072164945304393768,"write_bytes_sec":1965,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":57,"btime":"2024-09-10T23:18:21:823811+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":7068}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-09-10T23:17:44.479494+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:18:23.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.825+0000 7f6588b9f640 1 -- 172.21.15.90:0/1804277646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6570077f70 msgr2=0x7f657007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:23.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.825+0000 7f6588b9f640 1 --2- 172.21.15.90:0/1804277646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6570077f70 0x7f657007a430 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f65840b3070 tx=0x7f6578005f90 comp rx=0 tx=0).stop 2024-09-10T23:18:23.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.825+0000 7f6588b9f640 1 -- 172.21.15.90:0/1804277646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6584072ee0 msgr2=0x7f658415a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:23.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.825+0000 7f6588b9f640 1 --2- 172.21.15.90:0/1804277646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6584072ee0 0x7f658415a510 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f657400c490 tx=0x7f657400c950 comp rx=0 tx=0).stop 2024-09-10T23:18:23.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.825+0000 7f6588b9f640 1 -- 172.21.15.90:0/1804277646 shutdown_connections 2024-09-10T23:18:23.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.825+0000 7f6588b9f640 1 --2- 172.21.15.90:0/1804277646 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6570077f70 0x7f657007a430 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.825+0000 7f6588b9f640 1 --2- 172.21.15.90:0/1804277646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65840cc990 0x7f65841f2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.825+0000 7f6588b9f640 1 --2- 172.21.15.90:0/1804277646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6584154680 0x7f6584149e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.825+0000 7f6588b9f640 1 --2- 172.21.15.90:0/1804277646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6584072ee0 0x7f658415a510 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.825+0000 7f6588b9f640 1 -- 172.21.15.90:0/1804277646 >> 172.21.15.90:0/1804277646 conn(0x7f6584069590 msgr2=0x7f65840b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:23.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.825+0000 7f6588b9f640 1 -- 172.21.15.90:0/1804277646 shutdown_connections 2024-09-10T23:18:23.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.825+0000 7f6588b9f640 1 -- 172.21.15.90:0/1804277646 wait complete. 2024-09-10T23:18:23.837 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T23:18:23.837 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:18:23.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.937+0000 7ffbbefe2640 1 -- 172.21.15.90:0/3825540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbb80d1190 msgr2=0x7ffbb80d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:23.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.937+0000 7ffbbefe2640 1 --2- 172.21.15.90:0/3825540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbb80d1190 0x7ffbb80d28c0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80ce670 tx=0x7ffba802aa30 comp rx=0 tx=0).stop 2024-09-10T23:18:23.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.937+0000 7ffbbefe2640 1 -- 172.21.15.90:0/3825540 shutdown_connections 2024-09-10T23:18:23.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.937+0000 7ffbbefe2640 1 --2- 172.21.15.90:0/3825540 >> v2:172.21.15.171:3300/0 conn(0x7ffbb80d16f0 0x7ffbb80d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.937+0000 7ffbbefe2640 1 --2- 172.21.15.90:0/3825540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbb80d1190 0x7ffbb80d28c0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.937+0000 7ffbbefe2640 1 -- 172.21.15.90:0/3825540 >> 172.21.15.90:0/3825540 conn(0x7ffbb80d4090 msgr2=0x7ffbb80d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:23.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.937+0000 7ffbbefe2640 1 -- 172.21.15.90:0/3825540 shutdown_connections 2024-09-10T23:18:23.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.937+0000 7ffbbefe2640 1 -- 172.21.15.90:0/3825540 wait complete. 2024-09-10T23:18:23.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.938+0000 7ffbbefe2640 1 Processor -- start 2024-09-10T23:18:23.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.938+0000 7ffbbefe2640 1 -- start start 2024-09-10T23:18:23.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.939+0000 7ffbbefe2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbb80d1190 0x7ffbb81f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:23.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.939+0000 7ffbbefe2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbb80d16f0 0x7ffbb80cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:23.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.939+0000 7ffbbefe2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbb815e310 0x7ffbb80cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:23.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.939+0000 7ffbbefe2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb80d3340 con 0x7ffbb815e310 2024-09-10T23:18:23.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.939+0000 7ffbbefe2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb80d4d90 con 0x7ffbb80d1190 2024-09-10T23:18:23.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.939+0000 7ffbbefe2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffbb80d34c0 con 0x7ffbb80d16f0 2024-09-10T23:18:23.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.939+0000 7ffbbd57f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbb815e310 0x7ffbb80cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:23.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.939+0000 7ffbbd57f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbb815e310 0x7ffbb80cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56432/0 (socket says 172.21.15.90:56432) 2024-09-10T23:18:23.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.939+0000 7ffbbd57f640 1 -- 172.21.15.90:0/1301897747 learned_addr learned my addr 172.21.15.90:0/1301897747 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:23.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.940+0000 7ffbbcd7e640 1 --2- 172.21.15.90:0/1301897747 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbb80d1190 0x7ffbb81f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:23.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.940+0000 7ffbb7fff640 1 --2- 172.21.15.90:0/1301897747 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbb80d16f0 0x7ffbb80cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:23.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.940+0000 7ffbbd57f640 1 -- 172.21.15.90:0/1301897747 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbb80d16f0 msgr2=0x7ffbb80cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:23.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.940+0000 7ffbbd57f640 1 --2- 172.21.15.90:0/1301897747 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbb80d16f0 0x7ffbb80cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.940+0000 7ffbbd57f640 1 -- 172.21.15.90:0/1301897747 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbb80d1190 msgr2=0x7ffbb81f53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:23.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.940+0000 7ffbbd57f640 1 --2- 172.21.15.90:0/1301897747 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbb80d1190 0x7ffbb81f53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:23.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.940+0000 7ffbbd57f640 1 -- 172.21.15.90:0/1301897747 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb80b70d0 con 0x7ffbb815e310 2024-09-10T23:18:23.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.940+0000 7ffbb7fff640 1 --2- 172.21.15.90:0/1301897747 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbb80d16f0 0x7ffbb80cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:23.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.940+0000 7ffbbd57f640 1 --2- 172.21.15.90:0/1301897747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbb815e310 0x7ffbb80cd870 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7ffba000d740 tx=0x7ffba000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:23.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.940+0000 7ffbb57fa640 1 -- 172.21.15.90:0/1301897747 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba0017070 con 0x7ffbb815e310 2024-09-10T23:18:23.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.940+0000 7ffbb57fa640 1 -- 172.21.15.90:0/1301897747 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffba0009d20 con 0x7ffbb815e310 2024-09-10T23:18:23.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.940+0000 7ffbbefe2640 1 -- 172.21.15.90:0/1301897747 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb80b73b0 con 0x7ffbb815e310 2024-09-10T23:18:23.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.940+0000 7ffbb57fa640 1 -- 172.21.15.90:0/1301897747 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba0004280 con 0x7ffbb815e310 2024-09-10T23:18:23.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.940+0000 7ffbbefe2640 1 -- 172.21.15.90:0/1301897747 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb80b7970 con 0x7ffbb815e310 2024-09-10T23:18:23.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.941+0000 7ffbbefe2640 1 -- 172.21.15.90:0/1301897747 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbb80d3970 con 0x7ffbb815e310 2024-09-10T23:18:23.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.942+0000 7ffbb57fa640 1 -- 172.21.15.90:0/1301897747 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ffba00035f0 con 0x7ffbb815e310 2024-09-10T23:18:23.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.942+0000 7ffbb57fa640 1 --2- 172.21.15.90:0/1301897747 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb98077f70 0x7ffb9807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:23.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.942+0000 7ffbb57fa640 1 -- 172.21.15.90:0/1301897747 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7ffba0099dc0 con 0x7ffbb815e310 2024-09-10T23:18:23.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.943+0000 7ffbbcd7e640 1 --2- 172.21.15.90:0/1301897747 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb98077f70 0x7ffb9807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:23.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.943+0000 7ffbbcd7e640 1 --2- 172.21.15.90:0/1301897747 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb98077f70 0x7ffb9807a430 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0001720 tx=0x7ffbb0009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:23.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:23.946+0000 7ffbb57fa640 1 -- 172.21.15.90:0/1301897747 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ffba0062270 con 0x7ffbb815e310 2024-09-10T23:18:24.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:24.116+0000 7ffbbefe2640 1 -- 172.21.15.90:0/1301897747 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffbb8161bd0 con 0x7ffb98077f70 2024-09-10T23:18:24.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:24.121+0000 7ffbb57fa640 1 -- 172.21.15.90:0/1301897747 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249958 (secure 0 0 0) 0x7ffbb0001d00 con 0x7ffb98077f70 2024-09-10T23:18:24.124 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:24.125 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:18:24.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:24.124+0000 7ffbbefe2640 1 -- 172.21.15.90:0/1301897747 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb98077f70 msgr2=0x7ffb9807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:24.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:24.124+0000 7ffbbefe2640 1 --2- 172.21.15.90:0/1301897747 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb98077f70 0x7ffb9807a430 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0001720 tx=0x7ffbb0009040 comp rx=0 tx=0).stop 2024-09-10T23:18:24.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:24.124+0000 7ffbbefe2640 1 -- 172.21.15.90:0/1301897747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbb815e310 msgr2=0x7ffbb80cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:24.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:24.124+0000 7ffbbefe2640 1 --2- 172.21.15.90:0/1301897747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbb815e310 0x7ffbb80cd870 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7ffba000d740 tx=0x7ffba000dc00 comp rx=0 tx=0).stop 2024-09-10T23:18:24.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:24.124+0000 7ffbbefe2640 1 -- 172.21.15.90:0/1301897747 shutdown_connections 2024-09-10T23:18:24.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:24.124+0000 7ffbbefe2640 1 --2- 172.21.15.90:0/1301897747 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ffb98077f70 0x7ffb9807a430 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:24.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:24.124+0000 7ffbbefe2640 1 --2- 172.21.15.90:0/1301897747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbb815e310 0x7ffbb80cd870 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:24.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:24.124+0000 7ffbbefe2640 1 --2- 172.21.15.90:0/1301897747 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbb80d16f0 0x7ffbb80cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:24.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:24.124+0000 7ffbbefe2640 1 --2- 172.21.15.90:0/1301897747 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbb80d1190 0x7ffbb81f53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:24.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:24.124+0000 7ffbbefe2640 1 -- 172.21.15.90:0/1301897747 >> 172.21.15.90:0/1301897747 conn(0x7ffbb80d4090 msgr2=0x7ffbb80b4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:24.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:24.124+0000 7ffbbefe2640 1 -- 172.21.15.90:0/1301897747 shutdown_connections 2024-09-10T23:18:24.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:24.124+0000 7ffbbefe2640 1 -- 172.21.15.90:0/1301897747 wait complete. 2024-09-10T23:18:24.135 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-09-10T23:18:22.488411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256484,"kb_used_data":11104,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754718236,"statfs":{"total":773094113280,"available":772831473664,"internally_reserved":0,"allocated":11370496,"data_stored":5481901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.689104"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.838845+0000","last_change":"2024-09-10T23:18:19.834081+0000","last_active":"2024-09-10T23:18:19.838845+0000","last_peered":"2024-09-10T23:18:19.838845+0000","last_clean":"2024-09-10T23:18:19.838845+0000","last_became_active":"2024-09-10T23:18:19.833811+0000","last_became_peered":"2024-09-10T23:18:19.833811+0000","last_unstale":"2024-09-10T23:18:19.838845+0000","last_undegraded":"2024-09-10T23:18:19.838845+0000","last_fullsized":"2024-09-10T23:18:19.838845+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:42.460246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834642+0000","last_change":"2024-09-10T23:18:19.832637+0000","last_active":"2024-09-10T23:18:19.834642+0000","last_peered":"2024-09-10T23:18:19.834642+0000","last_clean":"2024-09-10T23:18:19.834642+0000","last_became_active":"2024-09-10T23:18:19.832256+0000","last_became_peered":"2024-09-10T23:18:19.832256+0000","last_unstale":"2024-09-10T23:18:19.834642+0000","last_undegraded":"2024-09-10T23:18:19.834642+0000","last_fullsized":"2024-09-10T23:18:19.834642+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:30:32.840023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.828014+0000","last_change":"2024-09-10T23:18:19.825136+0000","last_active":"2024-09-10T23:18:19.828014+0000","last_peered":"2024-09-10T23:18:19.828014+0000","last_clean":"2024-09-10T23:18:19.828014+0000","last_became_active":"2024-09-10T23:18:19.824888+0000","last_became_peered":"2024-09-10T23:18:19.824888+0000","last_unstale":"2024-09-10T23:18:19.828014+0000","last_undegraded":"2024-09-10T23:18:19.828014+0000","last_fullsized":"2024-09-10T23:18:19.828014+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:28.093748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.833700+0000","last_change":"2024-09-10T23:18:19.829960+0000","last_active":"2024-09-10T23:18:19.833700+0000","last_peered":"2024-09-10T23:18:19.833700+0000","last_clean":"2024-09-10T23:18:19.833700+0000","last_became_active":"2024-09-10T23:18:19.829678+0000","last_became_peered":"2024-09-10T23:18:19.829678+0000","last_unstale":"2024-09-10T23:18:19.833700+0000","last_undegraded":"2024-09-10T23:18:19.833700+0000","last_fullsized":"2024-09-10T23:18:19.833700+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:53.316251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.826013+0000","last_change":"2024-09-10T23:18:19.824702+0000","last_active":"2024-09-10T23:18:19.826013+0000","last_peered":"2024-09-10T23:18:19.826013+0000","last_clean":"2024-09-10T23:18:19.826013+0000","last_became_active":"2024-09-10T23:18:19.824418+0000","last_became_peered":"2024-09-10T23:18:19.824418+0000","last_unstale":"2024-09-10T23:18:19.826013+0000","last_undegraded":"2024-09-10T23:18:19.826013+0000","last_fullsized":"2024-09-10T23:18:19.826013+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:31.405406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.839466+0000","last_change":"2024-09-10T23:18:19.838305+0000","last_active":"2024-09-10T23:18:19.839466+0000","last_peered":"2024-09-10T23:18:19.839466+0000","last_clean":"2024-09-10T23:18:19.839466+0000","last_became_active":"2024-09-10T23:18:19.838086+0000","last_became_peered":"2024-09-10T23:18:19.838086+0000","last_unstale":"2024-09-10T23:18:19.839466+0000","last_undegraded":"2024-09-10T23:18:19.839466+0000","last_fullsized":"2024-09-10T23:18:19.839466+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:43.611606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.829125+0000","last_change":"2024-09-10T23:18:19.823321+0000","last_active":"2024-09-10T23:18:19.829125+0000","last_peered":"2024-09-10T23:18:19.829125+0000","last_clean":"2024-09-10T23:18:19.829125+0000","last_became_active":"2024-09-10T23:18:19.823022+0000","last_became_peered":"2024-09-10T23:18:19.823022+0000","last_unstale":"2024-09-10T23:18:19.829125+0000","last_undegraded":"2024-09-10T23:18:19.829125+0000","last_fullsized":"2024-09-10T23:18:19.829125+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:53.037910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834686+0000","last_change":"2024-09-10T23:18:19.832545+0000","last_active":"2024-09-10T23:18:19.834686+0000","last_peered":"2024-09-10T23:18:19.834686+0000","last_clean":"2024-09-10T23:18:19.834686+0000","last_became_active":"2024-09-10T23:18:19.832235+0000","last_became_peered":"2024-09-10T23:18:19.832235+0000","last_unstale":"2024-09-10T23:18:19.834686+0000","last_undegraded":"2024-09-10T23:18:19.834686+0000","last_fullsized":"2024-09-10T23:18:19.834686+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:41.518449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.833830+0000","last_change":"2024-09-10T23:18:19.829837+0000","last_active":"2024-09-10T23:18:19.833830+0000","last_peered":"2024-09-10T23:18:19.833830+0000","last_clean":"2024-09-10T23:18:19.833830+0000","last_became_active":"2024-09-10T23:18:19.829518+0000","last_became_peered":"2024-09-10T23:18:19.829518+0000","last_unstale":"2024-09-10T23:18:19.833830+0000","last_undegraded":"2024-09-10T23:18:19.833830+0000","last_fullsized":"2024-09-10T23:18:19.833830+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:39.632376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.833720+0000","last_change":"2024-09-10T23:18:19.828982+0000","last_active":"2024-09-10T23:18:19.833720+0000","last_peered":"2024-09-10T23:18:19.833720+0000","last_clean":"2024-09-10T23:18:19.833720+0000","last_became_active":"2024-09-10T23:18:19.828736+0000","last_became_peered":"2024-09-10T23:18:19.828736+0000","last_unstale":"2024-09-10T23:18:19.833720+0000","last_undegraded":"2024-09-10T23:18:19.833720+0000","last_fullsized":"2024-09-10T23:18:19.833720+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:28.093748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.829196+0000","last_change":"2024-09-10T23:18:19.825287+0000","last_active":"2024-09-10T23:18:19.829196+0000","last_peered":"2024-09-10T23:18:19.829196+0000","last_clean":"2024-09-10T23:18:19.829196+0000","last_became_active":"2024-09-10T23:18:19.824111+0000","last_became_peered":"2024-09-10T23:18:19.824111+0000","last_unstale":"2024-09-10T23:18:19.829196+0000","last_undegraded":"2024-09-10T23:18:19.829196+0000","last_fullsized":"2024-09-10T23:18:19.829196+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:01:08.499643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825197+0000","last_change":"2024-09-10T23:18:19.821436+0000","last_active":"2024-09-10T23:18:19.825197+0000","last_peered":"2024-09-10T23:18:19.825197+0000","last_clean":"2024-09-10T23:18:19.825197+0000","last_became_active":"2024-09-10T23:18:19.821140+0000","last_became_peered":"2024-09-10T23:18:19.821140+0000","last_unstale":"2024-09-10T23:18:19.825197+0000","last_undegraded":"2024-09-10T23:18:19.825197+0000","last_fullsized":"2024-09-10T23:18:19.825197+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:15.016694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834087+0000","last_change":"2024-09-10T23:18:19.830445+0000","last_active":"2024-09-10T23:18:19.834087+0000","last_peered":"2024-09-10T23:18:19.834087+0000","last_clean":"2024-09-10T23:18:19.834087+0000","last_became_active":"2024-09-10T23:18:19.829974+0000","last_became_peered":"2024-09-10T23:18:19.829974+0000","last_unstale":"2024-09-10T23:18:19.834087+0000","last_undegraded":"2024-09-10T23:18:19.834087+0000","last_fullsized":"2024-09-10T23:18:19.834087+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:42.460246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834787+0000","last_change":"2024-09-10T23:18:19.831066+0000","last_active":"2024-09-10T23:18:19.834787+0000","last_peered":"2024-09-10T23:18:19.834787+0000","last_clean":"2024-09-10T23:18:19.834787+0000","last_became_active":"2024-09-10T23:18:19.830803+0000","last_became_peered":"2024-09-10T23:18:19.830803+0000","last_unstale":"2024-09-10T23:18:19.834787+0000","last_undegraded":"2024-09-10T23:18:19.834787+0000","last_fullsized":"2024-09-10T23:18:19.834787+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:09.384941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.823957+0000","last_change":"2024-09-10T23:18:19.816681+0000","last_active":"2024-09-10T23:18:19.823957+0000","last_peered":"2024-09-10T23:18:19.823957+0000","last_clean":"2024-09-10T23:18:19.823957+0000","last_became_active":"2024-09-10T23:18:19.816379+0000","last_became_peered":"2024-09-10T23:18:19.816379+0000","last_unstale":"2024-09-10T23:18:19.823957+0000","last_undegraded":"2024-09-10T23:18:19.823957+0000","last_fullsized":"2024-09-10T23:18:19.823957+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:22.335062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827839+0000","last_change":"2024-09-10T23:18:19.825076+0000","last_active":"2024-09-10T23:18:19.827839+0000","last_peered":"2024-09-10T23:18:19.827839+0000","last_clean":"2024-09-10T23:18:19.827839+0000","last_became_active":"2024-09-10T23:18:19.824432+0000","last_became_peered":"2024-09-10T23:18:19.824432+0000","last_unstale":"2024-09-10T23:18:19.827839+0000","last_undegraded":"2024-09-10T23:18:19.827839+0000","last_fullsized":"2024-09-10T23:18:19.827839+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:22.800159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834640+0000","last_change":"2024-09-10T23:18:19.831432+0000","last_active":"2024-09-10T23:18:19.834640+0000","last_peered":"2024-09-10T23:18:19.834640+0000","last_clean":"2024-09-10T23:18:19.834640+0000","last_became_active":"2024-09-10T23:18:19.831085+0000","last_became_peered":"2024-09-10T23:18:19.831085+0000","last_unstale":"2024-09-10T23:18:19.834640+0000","last_undegraded":"2024-09-10T23:18:19.834640+0000","last_fullsized":"2024-09-10T23:18:19.834640+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:39.632376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834948+0000","last_change":"2024-09-10T23:18:19.832721+0000","last_active":"2024-09-10T23:18:19.834948+0000","last_peered":"2024-09-10T23:18:19.834948+0000","last_clean":"2024-09-10T23:18:19.834948+0000","last_became_active":"2024-09-10T23:18:19.829915+0000","last_became_peered":"2024-09-10T23:18:19.829915+0000","last_unstale":"2024-09-10T23:18:19.834948+0000","last_undegraded":"2024-09-10T23:18:19.834948+0000","last_fullsized":"2024-09-10T23:18:19.834948+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:03.081250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.829107+0000","last_change":"2024-09-10T23:18:19.823585+0000","last_active":"2024-09-10T23:18:19.829107+0000","last_peered":"2024-09-10T23:18:19.829107+0000","last_clean":"2024-09-10T23:18:19.829107+0000","last_became_active":"2024-09-10T23:18:19.823326+0000","last_became_peered":"2024-09-10T23:18:19.823326+0000","last_unstale":"2024-09-10T23:18:19.829107+0000","last_undegraded":"2024-09-10T23:18:19.829107+0000","last_fullsized":"2024-09-10T23:18:19.829107+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:28.564827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837339+0000","last_change":"2024-09-10T23:18:19.831579+0000","last_active":"2024-09-10T23:18:19.837339+0000","last_peered":"2024-09-10T23:18:19.837339+0000","last_clean":"2024-09-10T23:18:19.837339+0000","last_became_active":"2024-09-10T23:18:19.831291+0000","last_became_peered":"2024-09-10T23:18:19.831291+0000","last_unstale":"2024-09-10T23:18:19.837339+0000","last_undegraded":"2024-09-10T23:18:19.837339+0000","last_fullsized":"2024-09-10T23:18:19.837339+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:53.959695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834630+0000","last_change":"2024-09-10T23:18:19.830865+0000","last_active":"2024-09-10T23:18:19.834630+0000","last_peered":"2024-09-10T23:18:19.834630+0000","last_clean":"2024-09-10T23:18:19.834630+0000","last_became_active":"2024-09-10T23:18:19.830151+0000","last_became_peered":"2024-09-10T23:18:19.830151+0000","last_unstale":"2024-09-10T23:18:19.834630+0000","last_undegraded":"2024-09-10T23:18:19.834630+0000","last_fullsized":"2024-09-10T23:18:19.834630+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:37.851110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834629+0000","last_change":"2024-09-10T23:18:19.830220+0000","last_active":"2024-09-10T23:18:19.834629+0000","last_peered":"2024-09-10T23:18:19.834629+0000","last_clean":"2024-09-10T23:18:19.834629+0000","last_became_active":"2024-09-10T23:18:19.829950+0000","last_became_peered":"2024-09-10T23:18:19.829950+0000","last_unstale":"2024-09-10T23:18:19.834629+0000","last_undegraded":"2024-09-10T23:18:19.834629+0000","last_fullsized":"2024-09-10T23:18:19.834629+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:43.624550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.822090+0000","last_change":"2024-09-10T23:18:19.817490+0000","last_active":"2024-09-10T23:18:19.822090+0000","last_peered":"2024-09-10T23:18:19.822090+0000","last_clean":"2024-09-10T23:18:19.822090+0000","last_became_active":"2024-09-10T23:18:19.816959+0000","last_became_peered":"2024-09-10T23:18:19.816959+0000","last_unstale":"2024-09-10T23:18:19.822090+0000","last_undegraded":"2024-09-10T23:18:19.822090+0000","last_fullsized":"2024-09-10T23:18:19.822090+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:51.785266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837758+0000","last_change":"2024-09-10T23:18:19.833318+0000","last_active":"2024-09-10T23:18:19.837758+0000","last_peered":"2024-09-10T23:18:19.837758+0000","last_clean":"2024-09-10T23:18:19.837758+0000","last_became_active":"2024-09-10T23:18:19.832884+0000","last_became_peered":"2024-09-10T23:18:19.832884+0000","last_unstale":"2024-09-10T23:18:19.837758+0000","last_undegraded":"2024-09-10T23:18:19.837758+0000","last_fullsized":"2024-09-10T23:18:19.837758+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:54.329061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837358+0000","last_change":"2024-09-10T23:18:19.831566+0000","last_active":"2024-09-10T23:18:19.837358+0000","last_peered":"2024-09-10T23:18:19.837358+0000","last_clean":"2024-09-10T23:18:19.837358+0000","last_became_active":"2024-09-10T23:18:19.831296+0000","last_became_peered":"2024-09-10T23:18:19.831296+0000","last_unstale":"2024-09-10T23:18:19.837358+0000","last_undegraded":"2024-09-10T23:18:19.837358+0000","last_fullsized":"2024-09-10T23:18:19.837358+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:29.710906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"103'4","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.823848+0000","last_change":"2024-09-10T23:18:18.819049+0000","last_active":"2024-09-10T23:18:19.823848+0000","last_peered":"2024-09-10T23:18:19.823848+0000","last_clean":"2024-09-10T23:18:19.823848+0000","last_became_active":"2024-09-10T23:18:18.818691+0000","last_became_peered":"2024-09-10T23:18:18.818691+0000","last_unstale":"2024-09-10T23:18:19.823848+0000","last_undegraded":"2024-09-10T23:18:19.823848+0000","last_fullsized":"2024-09-10T23:18:19.823848+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:20.746593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827135+0000","last_change":"2024-09-10T23:18:19.825731+0000","last_active":"2024-09-10T23:18:19.827135+0000","last_peered":"2024-09-10T23:18:19.827135+0000","last_clean":"2024-09-10T23:18:19.827135+0000","last_became_active":"2024-09-10T23:18:19.825416+0000","last_became_peered":"2024-09-10T23:18:19.825416+0000","last_unstale":"2024-09-10T23:18:19.827135+0000","last_undegraded":"2024-09-10T23:18:19.827135+0000","last_fullsized":"2024-09-10T23:18:19.827135+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:27.842754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.831004+0000","last_change":"2024-09-10T23:18:18.820513+0000","last_active":"2024-09-10T23:18:19.831004+0000","last_peered":"2024-09-10T23:18:19.831004+0000","last_clean":"2024-09-10T23:18:19.831004+0000","last_became_active":"2024-09-10T23:18:18.820183+0000","last_became_peered":"2024-09-10T23:18:18.820183+0000","last_unstale":"2024-09-10T23:18:19.831004+0000","last_undegraded":"2024-09-10T23:18:19.831004+0000","last_fullsized":"2024-09-10T23:18:19.831004+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:08.379933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.833668+0000","last_change":"2024-09-10T23:18:19.829138+0000","last_active":"2024-09-10T23:18:19.833668+0000","last_peered":"2024-09-10T23:18:19.833668+0000","last_clean":"2024-09-10T23:18:19.833668+0000","last_became_active":"2024-09-10T23:18:19.828828+0000","last_became_peered":"2024-09-10T23:18:19.828828+0000","last_unstale":"2024-09-10T23:18:19.833668+0000","last_undegraded":"2024-09-10T23:18:19.833668+0000","last_fullsized":"2024-09-10T23:18:19.833668+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:49.941431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.829764+0000","last_change":"2024-09-10T23:18:18.821467+0000","last_active":"2024-09-10T23:18:19.829764+0000","last_peered":"2024-09-10T23:18:19.829764+0000","last_clean":"2024-09-10T23:18:19.829764+0000","last_became_active":"2024-09-10T23:18:18.821210+0000","last_became_peered":"2024-09-10T23:18:18.821210+0000","last_unstale":"2024-09-10T23:18:19.829764+0000","last_undegraded":"2024-09-10T23:18:19.829764+0000","last_fullsized":"2024-09-10T23:18:19.829764+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:29.032172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.835172+0000","last_change":"2024-09-10T23:18:19.834277+0000","last_active":"2024-09-10T23:18:19.835172+0000","last_peered":"2024-09-10T23:18:19.835172+0000","last_clean":"2024-09-10T23:18:19.835172+0000","last_became_active":"2024-09-10T23:18:19.833905+0000","last_became_peered":"2024-09-10T23:18:19.833905+0000","last_unstale":"2024-09-10T23:18:19.835172+0000","last_undegraded":"2024-09-10T23:18:19.835172+0000","last_fullsized":"2024-09-10T23:18:19.835172+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:26.841269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.830179+0000","last_change":"2024-09-10T23:18:18.821805+0000","last_active":"2024-09-10T23:18:19.830179+0000","last_peered":"2024-09-10T23:18:19.830179+0000","last_clean":"2024-09-10T23:18:19.830179+0000","last_became_active":"2024-09-10T23:18:18.821524+0000","last_became_peered":"2024-09-10T23:18:18.821524+0000","last_unstale":"2024-09-10T23:18:19.830179+0000","last_undegraded":"2024-09-10T23:18:19.830179+0000","last_fullsized":"2024-09-10T23:18:19.830179+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:20.294151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825643+0000","last_change":"2024-09-10T23:18:18.818720+0000","last_active":"2024-09-10T23:18:19.825643+0000","last_peered":"2024-09-10T23:18:19.825643+0000","last_clean":"2024-09-10T23:18:19.825643+0000","last_became_active":"2024-09-10T23:18:18.818140+0000","last_became_peered":"2024-09-10T23:18:18.818140+0000","last_unstale":"2024-09-10T23:18:19.825643+0000","last_undegraded":"2024-09-10T23:18:19.825643+0000","last_fullsized":"2024-09-10T23:18:19.825643+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:38.107563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.831715+0000","last_change":"2024-09-10T23:18:19.824091+0000","last_active":"2024-09-10T23:18:19.831715+0000","last_peered":"2024-09-10T23:18:19.831715+0000","last_clean":"2024-09-10T23:18:19.831715+0000","last_became_active":"2024-09-10T23:18:19.823753+0000","last_became_peered":"2024-09-10T23:18:19.823753+0000","last_unstale":"2024-09-10T23:18:19.831715+0000","last_undegraded":"2024-09-10T23:18:19.831715+0000","last_fullsized":"2024-09-10T23:18:19.831715+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:17.744145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834288+0000","last_change":"2024-09-10T23:18:18.823235+0000","last_active":"2024-09-10T23:18:19.834288+0000","last_peered":"2024-09-10T23:18:19.834288+0000","last_clean":"2024-09-10T23:18:19.834288+0000","last_became_active":"2024-09-10T23:18:18.822974+0000","last_became_peered":"2024-09-10T23:18:18.822974+0000","last_unstale":"2024-09-10T23:18:19.834288+0000","last_undegraded":"2024-09-10T23:18:19.834288+0000","last_fullsized":"2024-09-10T23:18:19.834288+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:17.927105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.810595+0000","last_change":"2024-09-10T23:18:18.823934+0000","last_active":"2024-09-10T23:18:19.810595+0000","last_peered":"2024-09-10T23:18:19.810595+0000","last_clean":"2024-09-10T23:18:19.810595+0000","last_became_active":"2024-09-10T23:18:18.823678+0000","last_became_peered":"2024-09-10T23:18:18.823678+0000","last_unstale":"2024-09-10T23:18:19.810595+0000","last_undegraded":"2024-09-10T23:18:19.810595+0000","last_fullsized":"2024-09-10T23:18:19.810595+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:31.791308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825779+0000","last_change":"2024-09-10T23:18:19.823606+0000","last_active":"2024-09-10T23:18:19.825779+0000","last_peered":"2024-09-10T23:18:19.825779+0000","last_clean":"2024-09-10T23:18:19.825779+0000","last_became_active":"2024-09-10T23:18:19.823330+0000","last_became_peered":"2024-09-10T23:18:19.823330+0000","last_unstale":"2024-09-10T23:18:19.825779+0000","last_undegraded":"2024-09-10T23:18:19.825779+0000","last_fullsized":"2024-09-10T23:18:19.825779+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:53.310849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.805111+0000","last_change":"2024-09-10T23:18:17.805111+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.805111+0000","last_undegraded":"2024-09-10T23:18:17.805111+0000","last_fullsized":"2024-09-10T23:18:17.805111+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.830829+0000","last_change":"2024-09-10T23:18:19.828031+0000","last_active":"2024-09-10T23:18:19.830829+0000","last_peered":"2024-09-10T23:18:19.830829+0000","last_clean":"2024-09-10T23:18:19.830829+0000","last_became_active":"2024-09-10T23:18:19.827562+0000","last_became_peered":"2024-09-10T23:18:19.827562+0000","last_unstale":"2024-09-10T23:18:19.830829+0000","last_undegraded":"2024-09-10T23:18:19.830829+0000","last_fullsized":"2024-09-10T23:18:19.830829+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:02.739126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.816397+0000","last_change":"2024-09-10T23:18:18.819315+0000","last_active":"2024-09-10T23:18:19.816397+0000","last_peered":"2024-09-10T23:18:19.816397+0000","last_clean":"2024-09-10T23:18:19.816397+0000","last_became_active":"2024-09-10T23:18:18.819056+0000","last_became_peered":"2024-09-10T23:18:18.819056+0000","last_unstale":"2024-09-10T23:18:19.816397+0000","last_undegraded":"2024-09-10T23:18:19.816397+0000","last_fullsized":"2024-09-10T23:18:19.816397+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:14.032775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.826058+0000","last_change":"2024-09-10T23:18:19.824655+0000","last_active":"2024-09-10T23:18:19.826058+0000","last_peered":"2024-09-10T23:18:19.826058+0000","last_clean":"2024-09-10T23:18:19.826058+0000","last_became_active":"2024-09-10T23:18:19.824343+0000","last_became_peered":"2024-09-10T23:18:19.824343+0000","last_unstale":"2024-09-10T23:18:19.826058+0000","last_undegraded":"2024-09-10T23:18:19.826058+0000","last_fullsized":"2024-09-10T23:18:19.826058+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:01.734594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.813716+0000","last_change":"2024-09-10T23:18:18.818757+0000","last_active":"2024-09-10T23:18:19.813716+0000","last_peered":"2024-09-10T23:18:19.813716+0000","last_clean":"2024-09-10T23:18:19.813716+0000","last_became_active":"2024-09-10T23:18:18.818481+0000","last_became_peered":"2024-09-10T23:18:18.818481+0000","last_unstale":"2024-09-10T23:18:19.813716+0000","last_undegraded":"2024-09-10T23:18:19.813716+0000","last_fullsized":"2024-09-10T23:18:19.813716+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:26.837746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827614+0000","last_change":"2024-09-10T23:18:19.822703+0000","last_active":"2024-09-10T23:18:19.827614+0000","last_peered":"2024-09-10T23:18:19.827614+0000","last_clean":"2024-09-10T23:18:19.827614+0000","last_became_active":"2024-09-10T23:18:19.822469+0000","last_became_peered":"2024-09-10T23:18:19.822469+0000","last_unstale":"2024-09-10T23:18:19.827614+0000","last_undegraded":"2024-09-10T23:18:19.827614+0000","last_fullsized":"2024-09-10T23:18:19.827614+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:41.518449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804761+0000","last_change":"2024-09-10T23:18:17.804761+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804761+0000","last_undegraded":"2024-09-10T23:18:17.804761+0000","last_fullsized":"2024-09-10T23:18:17.804761+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.831276+0000","last_change":"2024-09-10T23:18:19.828960+0000","last_active":"2024-09-10T23:18:19.831276+0000","last_peered":"2024-09-10T23:18:19.831276+0000","last_clean":"2024-09-10T23:18:19.831276+0000","last_became_active":"2024-09-10T23:18:19.828713+0000","last_became_peered":"2024-09-10T23:18:19.828713+0000","last_unstale":"2024-09-10T23:18:19.831276+0000","last_undegraded":"2024-09-10T23:18:19.831276+0000","last_fullsized":"2024-09-10T23:18:19.831276+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:57.755101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804327+0000","last_change":"2024-09-10T23:18:17.804327+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804327+0000","last_undegraded":"2024-09-10T23:18:17.804327+0000","last_fullsized":"2024-09-10T23:18:17.804327+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827862+0000","last_change":"2024-09-10T23:18:19.825366+0000","last_active":"2024-09-10T23:18:19.827862+0000","last_peered":"2024-09-10T23:18:19.827862+0000","last_clean":"2024-09-10T23:18:19.827862+0000","last_became_active":"2024-09-10T23:18:19.824770+0000","last_became_peered":"2024-09-10T23:18:19.824770+0000","last_unstale":"2024-09-10T23:18:19.827862+0000","last_undegraded":"2024-09-10T23:18:19.827862+0000","last_fullsized":"2024-09-10T23:18:19.827862+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:03.765204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.835098+0000","last_change":"2024-09-10T23:18:18.817973+0000","last_active":"2024-09-10T23:18:19.835098+0000","last_peered":"2024-09-10T23:18:19.835098+0000","last_clean":"2024-09-10T23:18:19.835098+0000","last_became_active":"2024-09-10T23:18:18.817730+0000","last_became_peered":"2024-09-10T23:18:18.817730+0000","last_unstale":"2024-09-10T23:18:19.835098+0000","last_undegraded":"2024-09-10T23:18:19.835098+0000","last_fullsized":"2024-09-10T23:18:19.835098+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:47.032035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834233+0000","last_change":"2024-09-10T23:18:19.829079+0000","last_active":"2024-09-10T23:18:19.834233+0000","last_peered":"2024-09-10T23:18:19.834233+0000","last_clean":"2024-09-10T23:18:19.834233+0000","last_became_active":"2024-09-10T23:18:19.828829+0000","last_became_peered":"2024-09-10T23:18:19.828829+0000","last_unstale":"2024-09-10T23:18:19.834233+0000","last_undegraded":"2024-09-10T23:18:19.834233+0000","last_fullsized":"2024-09-10T23:18:19.834233+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:27.114207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.816267+0000","last_change":"2024-09-10T23:18:18.826768+0000","last_active":"2024-09-10T23:18:19.816267+0000","last_peered":"2024-09-10T23:18:19.816267+0000","last_clean":"2024-09-10T23:18:19.816267+0000","last_became_active":"2024-09-10T23:18:18.826502+0000","last_became_peered":"2024-09-10T23:18:18.826502+0000","last_unstale":"2024-09-10T23:18:19.816267+0000","last_undegraded":"2024-09-10T23:18:19.816267+0000","last_fullsized":"2024-09-10T23:18:19.816267+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:48.343739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.827452+0000","last_change":"2024-09-10T23:18:19.822055+0000","last_active":"2024-09-10T23:18:19.827452+0000","last_peered":"2024-09-10T23:18:19.827452+0000","last_clean":"2024-09-10T23:18:19.827452+0000","last_became_active":"2024-09-10T23:18:19.821803+0000","last_became_peered":"2024-09-10T23:18:19.821803+0000","last_unstale":"2024-09-10T23:18:19.827452+0000","last_undegraded":"2024-09-10T23:18:19.827452+0000","last_fullsized":"2024-09-10T23:18:19.827452+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:56.084094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"103'8","reported_seq":21,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.835219+0000","last_change":"2024-09-10T23:18:18.821437+0000","last_active":"2024-09-10T23:18:19.835219+0000","last_peered":"2024-09-10T23:18:19.835219+0000","last_clean":"2024-09-10T23:18:19.835219+0000","last_became_active":"2024-09-10T23:18:18.821139+0000","last_became_peered":"2024-09-10T23:18:18.821139+0000","last_unstale":"2024-09-10T23:18:19.835219+0000","last_undegraded":"2024-09-10T23:18:19.835219+0000","last_fullsized":"2024-09-10T23:18:19.835219+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:34.527204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825319+0000","last_change":"2024-09-10T23:18:19.823839+0000","last_active":"2024-09-10T23:18:19.825319+0000","last_peered":"2024-09-10T23:18:19.825319+0000","last_clean":"2024-09-10T23:18:19.825319+0000","last_became_active":"2024-09-10T23:18:19.823562+0000","last_became_peered":"2024-09-10T23:18:19.823562+0000","last_unstale":"2024-09-10T23:18:19.825319+0000","last_undegraded":"2024-09-10T23:18:19.825319+0000","last_fullsized":"2024-09-10T23:18:19.825319+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:52.644364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804322+0000","last_change":"2024-09-10T23:18:17.804322+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804322+0000","last_undegraded":"2024-09-10T23:18:17.804322+0000","last_fullsized":"2024-09-10T23:18:17.804322+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837701+0000","last_change":"2024-09-10T23:18:19.831151+0000","last_active":"2024-09-10T23:18:19.837701+0000","last_peered":"2024-09-10T23:18:19.837701+0000","last_clean":"2024-09-10T23:18:19.837701+0000","last_became_active":"2024-09-10T23:18:19.830881+0000","last_became_peered":"2024-09-10T23:18:19.830881+0000","last_unstale":"2024-09-10T23:18:19.837701+0000","last_undegraded":"2024-09-10T23:18:19.837701+0000","last_fullsized":"2024-09-10T23:18:19.837701+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:12.216598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.832483+0000","last_change":"2024-09-10T23:18:18.822172+0000","last_active":"2024-09-10T23:18:19.832483+0000","last_peered":"2024-09-10T23:18:19.832483+0000","last_clean":"2024-09-10T23:18:19.832483+0000","last_became_active":"2024-09-10T23:18:18.821867+0000","last_became_peered":"2024-09-10T23:18:18.821867+0000","last_unstale":"2024-09-10T23:18:19.832483+0000","last_undegraded":"2024-09-10T23:18:19.832483+0000","last_fullsized":"2024-09-10T23:18:19.832483+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:28.101107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.839695+0000","last_change":"2024-09-10T23:18:19.838948+0000","last_active":"2024-09-10T23:18:19.839695+0000","last_peered":"2024-09-10T23:18:19.839695+0000","last_clean":"2024-09-10T23:18:19.839695+0000","last_became_active":"2024-09-10T23:18:19.838478+0000","last_became_peered":"2024-09-10T23:18:19.838478+0000","last_unstale":"2024-09-10T23:18:19.839695+0000","last_undegraded":"2024-09-10T23:18:19.839695+0000","last_fullsized":"2024-09-10T23:18:19.839695+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:21.069271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.828742+0000","last_change":"2024-09-10T23:18:18.828797+0000","last_active":"2024-09-10T23:18:19.828742+0000","last_peered":"2024-09-10T23:18:19.828742+0000","last_clean":"2024-09-10T23:18:19.828742+0000","last_became_active":"2024-09-10T23:18:18.828538+0000","last_became_peered":"2024-09-10T23:18:18.828538+0000","last_unstale":"2024-09-10T23:18:19.828742+0000","last_undegraded":"2024-09-10T23:18:19.828742+0000","last_fullsized":"2024-09-10T23:18:19.828742+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:14.953384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834779+0000","last_change":"2024-09-10T23:18:19.832939+0000","last_active":"2024-09-10T23:18:19.834779+0000","last_peered":"2024-09-10T23:18:19.834779+0000","last_clean":"2024-09-10T23:18:19.834779+0000","last_became_active":"2024-09-10T23:18:19.832618+0000","last_became_peered":"2024-09-10T23:18:19.832618+0000","last_unstale":"2024-09-10T23:18:19.834779+0000","last_undegraded":"2024-09-10T23:18:19.834779+0000","last_fullsized":"2024-09-10T23:18:19.834779+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:09.419897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.809176+0000","last_change":"2024-09-10T23:18:18.821792+0000","last_active":"2024-09-10T23:18:19.809176+0000","last_peered":"2024-09-10T23:18:19.809176+0000","last_clean":"2024-09-10T23:18:19.809176+0000","last_became_active":"2024-09-10T23:18:18.821465+0000","last_became_peered":"2024-09-10T23:18:18.821465+0000","last_unstale":"2024-09-10T23:18:19.809176+0000","last_undegraded":"2024-09-10T23:18:19.809176+0000","last_fullsized":"2024-09-10T23:18:19.809176+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:53.324053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834680+0000","last_change":"2024-09-10T23:18:19.832542+0000","last_active":"2024-09-10T23:18:19.834680+0000","last_peered":"2024-09-10T23:18:19.834680+0000","last_clean":"2024-09-10T23:18:19.834680+0000","last_became_active":"2024-09-10T23:18:19.832208+0000","last_became_peered":"2024-09-10T23:18:19.832208+0000","last_unstale":"2024-09-10T23:18:19.834680+0000","last_undegraded":"2024-09-10T23:18:19.834680+0000","last_fullsized":"2024-09-10T23:18:19.834680+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:38.816382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.828537+0000","last_change":"2024-09-10T23:18:18.823102+0000","last_active":"2024-09-10T23:18:19.828537+0000","last_peered":"2024-09-10T23:18:19.828537+0000","last_clean":"2024-09-10T23:18:19.828537+0000","last_became_active":"2024-09-10T23:18:18.822794+0000","last_became_peered":"2024-09-10T23:18:18.822794+0000","last_unstale":"2024-09-10T23:18:19.828537+0000","last_undegraded":"2024-09-10T23:18:19.828537+0000","last_fullsized":"2024-09-10T23:18:19.828537+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:29.032172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.817130+0000","last_change":"2024-09-10T23:18:18.821285+0000","last_active":"2024-09-10T23:18:19.817130+0000","last_peered":"2024-09-10T23:18:19.817130+0000","last_clean":"2024-09-10T23:18:19.817130+0000","last_became_active":"2024-09-10T23:18:18.820993+0000","last_became_peered":"2024-09-10T23:18:18.820993+0000","last_unstale":"2024-09-10T23:18:19.817130+0000","last_undegraded":"2024-09-10T23:18:19.817130+0000","last_fullsized":"2024-09-10T23:18:19.817130+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:47.032035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.837793+0000","last_change":"2024-09-10T23:18:19.836596+0000","last_active":"2024-09-10T23:18:19.837793+0000","last_peered":"2024-09-10T23:18:19.837793+0000","last_clean":"2024-09-10T23:18:19.837793+0000","last_became_active":"2024-09-10T23:18:19.836333+0000","last_became_peered":"2024-09-10T23:18:19.836333+0000","last_unstale":"2024-09-10T23:18:19.837793+0000","last_undegraded":"2024-09-10T23:18:19.837793+0000","last_fullsized":"2024-09-10T23:18:19.837793+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:53.315354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.824644+0000","last_change":"2024-09-10T23:18:18.824334+0000","last_active":"2024-09-10T23:18:19.824644+0000","last_peered":"2024-09-10T23:18:19.824644+0000","last_clean":"2024-09-10T23:18:19.824644+0000","last_became_active":"2024-09-10T23:18:18.824076+0000","last_became_peered":"2024-09-10T23:18:18.824076+0000","last_unstale":"2024-09-10T23:18:19.824644+0000","last_undegraded":"2024-09-10T23:18:19.824644+0000","last_fullsized":"2024-09-10T23:18:19.824644+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:51.639356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.835189+0000","last_change":"2024-09-10T23:18:19.832624+0000","last_active":"2024-09-10T23:18:19.835189+0000","last_peered":"2024-09-10T23:18:19.835189+0000","last_clean":"2024-09-10T23:18:19.835189+0000","last_became_active":"2024-09-10T23:18:19.832337+0000","last_became_peered":"2024-09-10T23:18:19.832337+0000","last_unstale":"2024-09-10T23:18:19.835189+0000","last_undegraded":"2024-09-10T23:18:19.835189+0000","last_fullsized":"2024-09-10T23:18:19.835189+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:01.080207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804673+0000","last_change":"2024-09-10T23:18:17.804673+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804673+0000","last_undegraded":"2024-09-10T23:18:17.804673+0000","last_fullsized":"2024-09-10T23:18:17.804673+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825173+0000","last_change":"2024-09-10T23:18:19.819937+0000","last_active":"2024-09-10T23:18:19.825173+0000","last_peered":"2024-09-10T23:18:19.825173+0000","last_clean":"2024-09-10T23:18:19.825173+0000","last_became_active":"2024-09-10T23:18:19.819609+0000","last_became_peered":"2024-09-10T23:18:19.819609+0000","last_unstale":"2024-09-10T23:18:19.825173+0000","last_undegraded":"2024-09-10T23:18:19.825173+0000","last_fullsized":"2024-09-10T23:18:19.825173+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:33:38.788016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.836909+0000","last_change":"2024-09-10T23:18:18.823508+0000","last_active":"2024-09-10T23:18:19.836909+0000","last_peered":"2024-09-10T23:18:19.836909+0000","last_clean":"2024-09-10T23:18:19.836909+0000","last_became_active":"2024-09-10T23:18:18.823163+0000","last_became_peered":"2024-09-10T23:18:18.823163+0000","last_unstale":"2024-09-10T23:18:19.836909+0000","last_undegraded":"2024-09-10T23:18:19.836909+0000","last_fullsized":"2024-09-10T23:18:19.836909+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:57.336353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.816402+0000","last_change":"2024-09-10T23:18:18.818495+0000","last_active":"2024-09-10T23:18:19.816402+0000","last_peered":"2024-09-10T23:18:19.816402+0000","last_clean":"2024-09-10T23:18:19.816402+0000","last_became_active":"2024-09-10T23:18:18.818166+0000","last_became_peered":"2024-09-10T23:18:18.818166+0000","last_unstale":"2024-09-10T23:18:19.816402+0000","last_undegraded":"2024-09-10T23:18:19.816402+0000","last_fullsized":"2024-09-10T23:18:19.816402+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:17.521005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.804344+0000","last_change":"2024-09-10T23:18:17.804344+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.804344+0000","last_undegraded":"2024-09-10T23:18:17.804344+0000","last_fullsized":"2024-09-10T23:18:17.804344+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825109+0000","last_change":"2024-09-10T23:18:19.819902+0000","last_active":"2024-09-10T23:18:19.825109+0000","last_peered":"2024-09-10T23:18:19.825109+0000","last_clean":"2024-09-10T23:18:19.825109+0000","last_became_active":"2024-09-10T23:18:19.819597+0000","last_became_peered":"2024-09-10T23:18:19.819597+0000","last_unstale":"2024-09-10T23:18:19.825109+0000","last_undegraded":"2024-09-10T23:18:19.825109+0000","last_fullsized":"2024-09-10T23:18:19.825109+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:24.559448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.817328+0000","last_change":"2024-09-10T23:18:18.823716+0000","last_active":"2024-09-10T23:18:19.817328+0000","last_peered":"2024-09-10T23:18:19.817328+0000","last_clean":"2024-09-10T23:18:19.817328+0000","last_became_active":"2024-09-10T23:18:18.823450+0000","last_became_peered":"2024-09-10T23:18:18.823450+0000","last_unstale":"2024-09-10T23:18:19.817328+0000","last_undegraded":"2024-09-10T23:18:19.817328+0000","last_fullsized":"2024-09-10T23:18:19.817328+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:00.834074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.820383+0000","last_change":"2024-09-10T23:18:19.813945+0000","last_active":"2024-09-10T23:18:19.820383+0000","last_peered":"2024-09-10T23:18:19.820383+0000","last_clean":"2024-09-10T23:18:19.820383+0000","last_became_active":"2024-09-10T23:18:19.813279+0000","last_became_peered":"2024-09-10T23:18:19.813279+0000","last_unstale":"2024-09-10T23:18:19.820383+0000","last_undegraded":"2024-09-10T23:18:19.820383+0000","last_fullsized":"2024-09-10T23:18:19.820383+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:05.534969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.809221+0000","last_change":"2024-09-10T23:18:18.818409+0000","last_active":"2024-09-10T23:18:19.809221+0000","last_peered":"2024-09-10T23:18:19.809221+0000","last_clean":"2024-09-10T23:18:19.809221+0000","last_became_active":"2024-09-10T23:18:18.817769+0000","last_became_peered":"2024-09-10T23:18:18.817769+0000","last_unstale":"2024-09-10T23:18:19.809221+0000","last_undegraded":"2024-09-10T23:18:19.809221+0000","last_fullsized":"2024-09-10T23:18:19.809221+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:22:24.800421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.831874+0000","last_change":"2024-09-10T23:18:19.826769+0000","last_active":"2024-09-10T23:18:19.831874+0000","last_peered":"2024-09-10T23:18:19.831874+0000","last_clean":"2024-09-10T23:18:19.831874+0000","last_became_active":"2024-09-10T23:18:19.826467+0000","last_became_peered":"2024-09-10T23:18:19.826467+0000","last_unstale":"2024-09-10T23:18:19.831874+0000","last_undegraded":"2024-09-10T23:18:19.831874+0000","last_fullsized":"2024-09-10T23:18:19.831874+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:19.420378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.811272+0000","last_change":"2024-09-10T23:18:18.820337+0000","last_active":"2024-09-10T23:18:19.811272+0000","last_peered":"2024-09-10T23:18:19.811272+0000","last_clean":"2024-09-10T23:18:19.811272+0000","last_became_active":"2024-09-10T23:18:18.820040+0000","last_became_peered":"2024-09-10T23:18:18.820040+0000","last_unstale":"2024-09-10T23:18:19.811272+0000","last_undegraded":"2024-09-10T23:18:19.811272+0000","last_fullsized":"2024-09-10T23:18:19.811272+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:12.068147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834708+0000","last_change":"2024-09-10T23:18:19.833541+0000","last_active":"2024-09-10T23:18:19.834708+0000","last_peered":"2024-09-10T23:18:19.834708+0000","last_clean":"2024-09-10T23:18:19.834708+0000","last_became_active":"2024-09-10T23:18:19.833278+0000","last_became_peered":"2024-09-10T23:18:19.833278+0000","last_unstale":"2024-09-10T23:18:19.834708+0000","last_undegraded":"2024-09-10T23:18:19.834708+0000","last_fullsized":"2024-09-10T23:18:19.834708+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:34.315019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.815852+0000","last_change":"2024-09-10T23:18:18.822619+0000","last_active":"2024-09-10T23:18:19.815852+0000","last_peered":"2024-09-10T23:18:19.815852+0000","last_clean":"2024-09-10T23:18:19.815852+0000","last_became_active":"2024-09-10T23:18:18.822363+0000","last_became_peered":"2024-09-10T23:18:18.822363+0000","last_unstale":"2024-09-10T23:18:19.815852+0000","last_undegraded":"2024-09-10T23:18:19.815852+0000","last_fullsized":"2024-09-10T23:18:19.815852+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:13.423487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:18.798951+0000","last_change":"2024-09-10T23:18:18.798951+0000","last_active":"2024-09-10T23:18:18.798951+0000","last_peered":"2024-09-10T23:18:18.798951+0000","last_clean":"2024-09-10T23:18:18.798951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:18.798951+0000","last_undegraded":"2024-09-10T23:18:18.798951+0000","last_fullsized":"2024-09-10T23:18:18.798951+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-10T23:18:17.803615+0000","last_change":"2024-09-10T23:18:17.803615+0000","last_active":"2024-09-10T23:18:17.793943+0000","last_peered":"2024-09-10T23:18:17.793943+0000","last_clean":"2024-09-10T23:18:17.793943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:17.803615+0000","last_undegraded":"2024-09-10T23:18:17.803615+0000","last_fullsized":"2024-09-10T23:18:17.803615+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.834757+0000","last_change":"2024-09-10T23:18:19.829796+0000","last_active":"2024-09-10T23:18:19.834757+0000","last_peered":"2024-09-10T23:18:19.834757+0000","last_clean":"2024-09-10T23:18:19.834757+0000","last_became_active":"2024-09-10T23:18:19.829530+0000","last_became_peered":"2024-09-10T23:18:19.829530+0000","last_unstale":"2024-09-10T23:18:19.834757+0000","last_undegraded":"2024-09-10T23:18:19.834757+0000","last_fullsized":"2024-09-10T23:18:19.834757+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:56.155914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.810245+0000","last_change":"2024-09-10T23:18:18.821522+0000","last_active":"2024-09-10T23:18:19.810245+0000","last_peered":"2024-09-10T23:18:19.810245+0000","last_clean":"2024-09-10T23:18:19.810245+0000","last_became_active":"2024-09-10T23:18:18.821236+0000","last_became_peered":"2024-09-10T23:18:18.821236+0000","last_unstale":"2024-09-10T23:18:19.810245+0000","last_undegraded":"2024-09-10T23:18:19.810245+0000","last_fullsized":"2024-09-10T23:18:19.810245+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:17.910202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":255,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:18:19.825975+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:18:19.825975+0000","last_peered":"2024-09-10T23:18:19.825975+0000","last_clean":"2024-09-10T23:18:19.825975+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:18:19.825975+0000","last_undegraded":"2024-09-10T23:18:19.825975+0000","last_fullsized":"2024-09-10T23:18:19.825975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28864,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342976,"statfs":{"total":96636764160,"available":96607207424,"internally_reserved":0,"allocated":1875968,"data_stored":1130931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1277952,"data_stored":540017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1282048,"data_stored":540551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1273856,"data_stored":539947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509492,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1261568,"data_stored":533172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1273856,"data_stored":539947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509492,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1282048,"data_stored":540071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32988,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338852,"statfs":{"total":96636764160,"available":96602984448,"internally_reserved":0,"allocated":1843200,"data_stored":1117265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:18:25.296 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:18:25.299 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:18:25.797 INFO:tasks.ceph.mds.d.smithi171.stderr:2024-09-10T23:18:25.796+0000 7fc455d55640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:18:27.140 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:18:27.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.253+0000 7f7db9895640 1 -- 172.21.15.90:0/3201688239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7db40d0aa0 msgr2=0x7f7db40d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:27.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.253+0000 7f7db9895640 1 --2- 172.21.15.90:0/3201688239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7db40d0aa0 0x7f7db40d0f30 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f7dac005fd0 tx=0x7f7dac02ab20 comp rx=0 tx=0).stop 2024-09-10T23:18:27.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.253+0000 7f7db9895640 1 -- 172.21.15.90:0/3201688239 shutdown_connections 2024-09-10T23:18:27.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.253+0000 7f7db9895640 1 --2- 172.21.15.90:0/3201688239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7db40d0aa0 0x7f7db40d0f30 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.253+0000 7f7db9895640 1 --2- 172.21.15.90:0/3201688239 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7db40d4c20 0x7f7db40cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.253+0000 7f7db9895640 1 -- 172.21.15.90:0/3201688239 >> 172.21.15.90:0/3201688239 conn(0x7f7db40d4090 msgr2=0x7f7db40d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:27.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.253+0000 7f7db9895640 1 -- 172.21.15.90:0/3201688239 shutdown_connections 2024-09-10T23:18:27.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.253+0000 7f7db9895640 1 -- 172.21.15.90:0/3201688239 wait complete. 2024-09-10T23:18:27.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.254+0000 7f7db9895640 1 Processor -- start 2024-09-10T23:18:27.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.254+0000 7f7db9895640 1 -- start start 2024-09-10T23:18:27.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.255+0000 7f7db9895640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7db40d0aa0 0x7f7db41f4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:27.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.255+0000 7f7db9895640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7db40d4c20 0x7f7db40b8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:27.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.255+0000 7f7db9895640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7db415e180 0x7f7db40b8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:27.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.255+0000 7f7db9895640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7db40d2320 con 0x7f7db415e180 2024-09-10T23:18:27.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.255+0000 7f7db9895640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7db40d21a0 con 0x7f7db40d4c20 2024-09-10T23:18:27.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.255+0000 7f7db9895640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7db40d24a0 con 0x7f7db40d0aa0 2024-09-10T23:18:27.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.255+0000 7f7db37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7db415e180 0x7f7db40b8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:27.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.255+0000 7f7db37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7db415e180 0x7f7db40b8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56460/0 (socket says 172.21.15.90:56460) 2024-09-10T23:18:27.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.255+0000 7f7db37fe640 1 -- 172.21.15.90:0/896987444 learned_addr learned my addr 172.21.15.90:0/896987444 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:27.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.255+0000 7f7db2ffd640 1 --2- 172.21.15.90:0/896987444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7db40d0aa0 0x7f7db41f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:27.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.255+0000 7f7db37fe640 1 -- 172.21.15.90:0/896987444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7db40d0aa0 msgr2=0x7f7db41f4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:27.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.255+0000 7f7db37fe640 1 --2- 172.21.15.90:0/896987444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7db40d0aa0 0x7f7db41f4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.255+0000 7f7daa7fc640 1 --2- 172.21.15.90:0/896987444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7db40d4c20 0x7f7db40b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:27.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.255+0000 7f7db37fe640 1 -- 172.21.15.90:0/896987444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7db40d4c20 msgr2=0x7f7db40b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:27.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.255+0000 7f7db37fe640 1 --2- 172.21.15.90:0/896987444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7db40d4c20 0x7f7db40b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.255+0000 7f7db37fe640 1 -- 172.21.15.90:0/896987444 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db40cac90 con 0x7f7db415e180 2024-09-10T23:18:27.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.255+0000 7f7daa7fc640 1 --2- 172.21.15.90:0/896987444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7db40d4c20 0x7f7db40b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:27.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.256+0000 7f7db37fe640 1 --2- 172.21.15.90:0/896987444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7db415e180 0x7f7db40b8940 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f7dac006010 tx=0x7f7dac003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:27.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.256+0000 7f7db0ff9640 1 -- 172.21.15.90:0/896987444 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac044070 con 0x7f7db415e180 2024-09-10T23:18:27.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.256+0000 7f7db0ff9640 1 -- 172.21.15.90:0/896987444 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7dac02c820 con 0x7f7db415e180 2024-09-10T23:18:27.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.256+0000 7f7db0ff9640 1 -- 172.21.15.90:0/896987444 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac0044b0 con 0x7f7db415e180 2024-09-10T23:18:27.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.256+0000 7f7db9895640 1 -- 172.21.15.90:0/896987444 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db415f1a0 con 0x7f7db415e180 2024-09-10T23:18:27.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.256+0000 7f7db9895640 1 -- 172.21.15.90:0/896987444 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db4150d70 con 0x7f7db415e180 2024-09-10T23:18:27.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.257+0000 7f7db9895640 1 -- 172.21.15.90:0/896987444 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7db40d0f30 con 0x7f7db415e180 2024-09-10T23:18:27.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.258+0000 7f7db0ff9640 1 -- 172.21.15.90:0/896987444 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7dac004650 con 0x7f7db415e180 2024-09-10T23:18:27.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.258+0000 7f7db0ff9640 1 --2- 172.21.15.90:0/896987444 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7d94077f70 0x7f7d9407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:27.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.258+0000 7f7db0ff9640 1 -- 172.21.15.90:0/896987444 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f7dac0ba430 con 0x7f7db415e180 2024-09-10T23:18:27.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.258+0000 7f7db2ffd640 1 --2- 172.21.15.90:0/896987444 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7d94077f70 0x7f7d9407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:27.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.259+0000 7f7db2ffd640 1 --2- 172.21.15.90:0/896987444 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7d94077f70 0x7f7d9407a430 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7da40015a0 tx=0x7f7da4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:27.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.262+0000 7f7db0ff9640 1 -- 172.21.15.90:0/896987444 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7dac032030 con 0x7f7db415e180 2024-09-10T23:18:27.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.438+0000 7f7db9895640 1 -- 172.21.15.90:0/896987444 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7db408e130 con 0x7f7d94077f70 2024-09-10T23:18:27.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.443+0000 7f7db0ff9640 1 -- 172.21.15.90:0/896987444 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252407 (secure 0 0 0) 0x7f7db408e130 con 0x7f7d94077f70 2024-09-10T23:18:27.446 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:27.447 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:18:27.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.446+0000 7f7db9895640 1 -- 172.21.15.90:0/896987444 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7d94077f70 msgr2=0x7f7d9407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:27.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.446+0000 7f7db9895640 1 --2- 172.21.15.90:0/896987444 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7d94077f70 0x7f7d9407a430 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7da40015a0 tx=0x7f7da4009040 comp rx=0 tx=0).stop 2024-09-10T23:18:27.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.446+0000 7f7db9895640 1 -- 172.21.15.90:0/896987444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7db415e180 msgr2=0x7f7db40b8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:27.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.446+0000 7f7db9895640 1 --2- 172.21.15.90:0/896987444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7db415e180 0x7f7db40b8940 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f7dac006010 tx=0x7f7dac003f10 comp rx=0 tx=0).stop 2024-09-10T23:18:27.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.446+0000 7f7db9895640 1 -- 172.21.15.90:0/896987444 shutdown_connections 2024-09-10T23:18:27.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.446+0000 7f7db9895640 1 --2- 172.21.15.90:0/896987444 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7d94077f70 0x7f7d9407a430 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.446+0000 7f7db9895640 1 --2- 172.21.15.90:0/896987444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7db40d4c20 0x7f7db40b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.446+0000 7f7db9895640 1 --2- 172.21.15.90:0/896987444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7db415e180 0x7f7db40b8940 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.446+0000 7f7db9895640 1 --2- 172.21.15.90:0/896987444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7db40d0aa0 0x7f7db41f4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.446+0000 7f7db9895640 1 -- 172.21.15.90:0/896987444 >> 172.21.15.90:0/896987444 conn(0x7f7db40d4090 msgr2=0x7f7db40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:27.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.446+0000 7f7db9895640 1 -- 172.21.15.90:0/896987444 shutdown_connections 2024-09-10T23:18:27.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.446+0000 7f7db9895640 1 -- 172.21.15.90:0/896987444 wait complete. 2024-09-10T23:18:27.459 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2024-09-10T23:18:26.489267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256624,"kb_used_data":11272,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754718096,"statfs":{"total":773094113280,"available":772831330304,"internally_reserved":0,"allocated":11542528,"data_stored":5555532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.684484"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.826480+0000","last_change":"2024-09-10T23:18:19.825698+0000","last_active":"2024-09-10T23:18:20.826480+0000","last_peered":"2024-09-10T23:18:20.826480+0000","last_clean":"2024-09-10T23:18:20.826480+0000","last_became_active":"2024-09-10T23:18:19.824299+0000","last_became_peered":"2024-09-10T23:18:19.824299+0000","last_unstale":"2024-09-10T23:18:20.826480+0000","last_undegraded":"2024-09-10T23:18:20.826480+0000","last_fullsized":"2024-09-10T23:18:20.826480+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:40.125598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.832780+0000","last_change":"2024-09-10T23:18:19.834081+0000","last_active":"2024-09-10T23:18:20.832780+0000","last_peered":"2024-09-10T23:18:20.832780+0000","last_clean":"2024-09-10T23:18:20.832780+0000","last_became_active":"2024-09-10T23:18:19.833811+0000","last_became_peered":"2024-09-10T23:18:19.833811+0000","last_unstale":"2024-09-10T23:18:20.832780+0000","last_undegraded":"2024-09-10T23:18:20.832780+0000","last_fullsized":"2024-09-10T23:18:20.832780+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:53.315354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780965+0000","last_change":"2024-09-10T23:18:19.832637+0000","last_active":"2024-09-10T23:18:21.780965+0000","last_peered":"2024-09-10T23:18:21.780965+0000","last_clean":"2024-09-10T23:18:21.780965+0000","last_became_active":"2024-09-10T23:18:19.832256+0000","last_became_peered":"2024-09-10T23:18:19.832256+0000","last_unstale":"2024-09-10T23:18:21.780965+0000","last_undegraded":"2024-09-10T23:18:21.780965+0000","last_fullsized":"2024-09-10T23:18:21.780965+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:02.684389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.826135+0000","last_change":"2024-09-10T23:18:19.819021+0000","last_active":"2024-09-10T23:18:20.826135+0000","last_peered":"2024-09-10T23:18:20.826135+0000","last_clean":"2024-09-10T23:18:20.826135+0000","last_became_active":"2024-09-10T23:18:19.818737+0000","last_became_peered":"2024-09-10T23:18:19.818737+0000","last_unstale":"2024-09-10T23:18:20.826135+0000","last_undegraded":"2024-09-10T23:18:20.826135+0000","last_fullsized":"2024-09-10T23:18:20.826135+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:49.269578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.781078+0000","last_change":"2024-09-10T23:18:19.825136+0000","last_active":"2024-09-10T23:18:21.781078+0000","last_peered":"2024-09-10T23:18:21.781078+0000","last_clean":"2024-09-10T23:18:21.781078+0000","last_became_active":"2024-09-10T23:18:19.824888+0000","last_became_peered":"2024-09-10T23:18:19.824888+0000","last_unstale":"2024-09-10T23:18:21.781078+0000","last_undegraded":"2024-09-10T23:18:21.781078+0000","last_fullsized":"2024-09-10T23:18:21.781078+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:49.941431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780732+0000","last_change":"2024-09-10T23:18:19.829960+0000","last_active":"2024-09-10T23:18:21.780732+0000","last_peered":"2024-09-10T23:18:21.780732+0000","last_clean":"2024-09-10T23:18:21.780732+0000","last_became_active":"2024-09-10T23:18:19.829678+0000","last_became_peered":"2024-09-10T23:18:19.829678+0000","last_unstale":"2024-09-10T23:18:21.780732+0000","last_undegraded":"2024-09-10T23:18:21.780732+0000","last_fullsized":"2024-09-10T23:18:21.780732+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:21.023337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.831482+0000","last_change":"2024-09-10T23:18:19.824702+0000","last_active":"2024-09-10T23:18:20.831482+0000","last_peered":"2024-09-10T23:18:20.831482+0000","last_clean":"2024-09-10T23:18:20.831482+0000","last_became_active":"2024-09-10T23:18:19.824418+0000","last_became_peered":"2024-09-10T23:18:19.824418+0000","last_unstale":"2024-09-10T23:18:20.831482+0000","last_undegraded":"2024-09-10T23:18:20.831482+0000","last_fullsized":"2024-09-10T23:18:20.831482+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:00.341118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.781210+0000","last_change":"2024-09-10T23:18:19.838305+0000","last_active":"2024-09-10T23:18:21.781210+0000","last_peered":"2024-09-10T23:18:21.781210+0000","last_clean":"2024-09-10T23:18:21.781210+0000","last_became_active":"2024-09-10T23:18:19.838086+0000","last_became_peered":"2024-09-10T23:18:19.838086+0000","last_unstale":"2024-09-10T23:18:21.781210+0000","last_undegraded":"2024-09-10T23:18:21.781210+0000","last_fullsized":"2024-09-10T23:18:21.781210+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:26.703006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.826487+0000","last_change":"2024-09-10T23:18:19.829301+0000","last_active":"2024-09-10T23:18:20.826487+0000","last_peered":"2024-09-10T23:18:20.826487+0000","last_clean":"2024-09-10T23:18:20.826487+0000","last_became_active":"2024-09-10T23:18:19.828854+0000","last_became_peered":"2024-09-10T23:18:19.828854+0000","last_unstale":"2024-09-10T23:18:20.826487+0000","last_undegraded":"2024-09-10T23:18:20.826487+0000","last_fullsized":"2024-09-10T23:18:20.826487+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:24.637559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.826035+0000","last_change":"2024-09-10T23:18:19.831418+0000","last_active":"2024-09-10T23:18:20.826035+0000","last_peered":"2024-09-10T23:18:20.826035+0000","last_clean":"2024-09-10T23:18:20.826035+0000","last_became_active":"2024-09-10T23:18:19.831175+0000","last_became_peered":"2024-09-10T23:18:19.831175+0000","last_unstale":"2024-09-10T23:18:20.826035+0000","last_undegraded":"2024-09-10T23:18:20.826035+0000","last_fullsized":"2024-09-10T23:18:20.826035+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:12.778337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.832532+0000","last_change":"2024-09-10T23:18:19.823321+0000","last_active":"2024-09-10T23:18:20.832532+0000","last_peered":"2024-09-10T23:18:20.832532+0000","last_clean":"2024-09-10T23:18:20.832532+0000","last_became_active":"2024-09-10T23:18:19.823022+0000","last_became_peered":"2024-09-10T23:18:19.823022+0000","last_unstale":"2024-09-10T23:18:20.832532+0000","last_undegraded":"2024-09-10T23:18:20.832532+0000","last_fullsized":"2024-09-10T23:18:20.832532+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:09.419897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.826059+0000","last_change":"2024-09-10T23:18:19.827019+0000","last_active":"2024-09-10T23:18:20.826059+0000","last_peered":"2024-09-10T23:18:20.826059+0000","last_clean":"2024-09-10T23:18:20.826059+0000","last_became_active":"2024-09-10T23:18:19.826750+0000","last_became_peered":"2024-09-10T23:18:19.826750+0000","last_unstale":"2024-09-10T23:18:20.826059+0000","last_undegraded":"2024-09-10T23:18:20.826059+0000","last_fullsized":"2024-09-10T23:18:20.826059+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:59.057948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780739+0000","last_change":"2024-09-10T23:18:19.832545+0000","last_active":"2024-09-10T23:18:21.780739+0000","last_peered":"2024-09-10T23:18:21.780739+0000","last_clean":"2024-09-10T23:18:21.780739+0000","last_became_active":"2024-09-10T23:18:19.832235+0000","last_became_peered":"2024-09-10T23:18:19.832235+0000","last_unstale":"2024-09-10T23:18:21.780739+0000","last_undegraded":"2024-09-10T23:18:21.780739+0000","last_fullsized":"2024-09-10T23:18:21.780739+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:39.462810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780620+0000","last_change":"2024-09-10T23:18:19.829837+0000","last_active":"2024-09-10T23:18:21.780620+0000","last_peered":"2024-09-10T23:18:21.780620+0000","last_clean":"2024-09-10T23:18:21.780620+0000","last_became_active":"2024-09-10T23:18:19.829518+0000","last_became_peered":"2024-09-10T23:18:19.829518+0000","last_unstale":"2024-09-10T23:18:21.780620+0000","last_undegraded":"2024-09-10T23:18:21.780620+0000","last_fullsized":"2024-09-10T23:18:21.780620+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:59.298973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780254+0000","last_change":"2024-09-10T23:18:19.828982+0000","last_active":"2024-09-10T23:18:21.780254+0000","last_peered":"2024-09-10T23:18:21.780254+0000","last_clean":"2024-09-10T23:18:21.780254+0000","last_became_active":"2024-09-10T23:18:19.828736+0000","last_became_peered":"2024-09-10T23:18:19.828736+0000","last_unstale":"2024-09-10T23:18:21.780254+0000","last_undegraded":"2024-09-10T23:18:21.780254+0000","last_fullsized":"2024-09-10T23:18:21.780254+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:11.062302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.825574+0000","last_change":"2024-09-10T23:18:19.835672+0000","last_active":"2024-09-10T23:18:20.825574+0000","last_peered":"2024-09-10T23:18:20.825574+0000","last_clean":"2024-09-10T23:18:20.825574+0000","last_became_active":"2024-09-10T23:18:19.835340+0000","last_became_peered":"2024-09-10T23:18:19.835340+0000","last_unstale":"2024-09-10T23:18:20.825574+0000","last_undegraded":"2024-09-10T23:18:20.825574+0000","last_fullsized":"2024-09-10T23:18:20.825574+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:32.334044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.832795+0000","last_change":"2024-09-10T23:18:19.825287+0000","last_active":"2024-09-10T23:18:20.832795+0000","last_peered":"2024-09-10T23:18:20.832795+0000","last_clean":"2024-09-10T23:18:20.832795+0000","last_became_active":"2024-09-10T23:18:19.824111+0000","last_became_peered":"2024-09-10T23:18:19.824111+0000","last_unstale":"2024-09-10T23:18:20.832795+0000","last_undegraded":"2024-09-10T23:18:20.832795+0000","last_fullsized":"2024-09-10T23:18:20.832795+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:43.611606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.781117+0000","last_change":"2024-09-10T23:18:19.821436+0000","last_active":"2024-09-10T23:18:21.781117+0000","last_peered":"2024-09-10T23:18:21.781117+0000","last_clean":"2024-09-10T23:18:21.781117+0000","last_became_active":"2024-09-10T23:18:19.821140+0000","last_became_peered":"2024-09-10T23:18:19.821140+0000","last_unstale":"2024-09-10T23:18:21.781117+0000","last_undegraded":"2024-09-10T23:18:21.781117+0000","last_fullsized":"2024-09-10T23:18:21.781117+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:18.932113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780960+0000","last_change":"2024-09-10T23:18:19.830445+0000","last_active":"2024-09-10T23:18:21.780960+0000","last_peered":"2024-09-10T23:18:21.780960+0000","last_clean":"2024-09-10T23:18:21.780960+0000","last_became_active":"2024-09-10T23:18:19.829974+0000","last_became_peered":"2024-09-10T23:18:19.829974+0000","last_unstale":"2024-09-10T23:18:21.780960+0000","last_undegraded":"2024-09-10T23:18:21.780960+0000","last_fullsized":"2024-09-10T23:18:21.780960+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:41.206680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.833051+0000","last_change":"2024-09-10T23:18:19.831066+0000","last_active":"2024-09-10T23:18:20.833051+0000","last_peered":"2024-09-10T23:18:20.833051+0000","last_clean":"2024-09-10T23:18:20.833051+0000","last_became_active":"2024-09-10T23:18:19.830803+0000","last_became_peered":"2024-09-10T23:18:19.830803+0000","last_unstale":"2024-09-10T23:18:20.833051+0000","last_undegraded":"2024-09-10T23:18:20.833051+0000","last_fullsized":"2024-09-10T23:18:20.833051+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:16.247919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.832853+0000","last_change":"2024-09-10T23:18:19.816681+0000","last_active":"2024-09-10T23:18:20.832853+0000","last_peered":"2024-09-10T23:18:20.832853+0000","last_clean":"2024-09-10T23:18:20.832853+0000","last_became_active":"2024-09-10T23:18:19.816379+0000","last_became_peered":"2024-09-10T23:18:19.816379+0000","last_unstale":"2024-09-10T23:18:20.832853+0000","last_undegraded":"2024-09-10T23:18:20.832853+0000","last_fullsized":"2024-09-10T23:18:20.832853+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:21.069271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.512992+0000","last_change":"2024-09-10T23:18:19.825076+0000","last_active":"2024-09-10T23:18:21.512992+0000","last_peered":"2024-09-10T23:18:21.512992+0000","last_clean":"2024-09-10T23:18:21.512992+0000","last_became_active":"2024-09-10T23:18:19.824432+0000","last_became_peered":"2024-09-10T23:18:19.824432+0000","last_unstale":"2024-09-10T23:18:21.512992+0000","last_undegraded":"2024-09-10T23:18:21.512992+0000","last_fullsized":"2024-09-10T23:18:21.512992+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:00.296215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.832236+0000","last_change":"2024-09-10T23:18:19.831432+0000","last_active":"2024-09-10T23:18:20.832236+0000","last_peered":"2024-09-10T23:18:20.832236+0000","last_clean":"2024-09-10T23:18:20.832236+0000","last_became_active":"2024-09-10T23:18:19.831085+0000","last_became_peered":"2024-09-10T23:18:19.831085+0000","last_unstale":"2024-09-10T23:18:20.832236+0000","last_undegraded":"2024-09-10T23:18:20.832236+0000","last_fullsized":"2024-09-10T23:18:20.832236+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:38.816382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.512777+0000","last_change":"2024-09-10T23:18:19.832721+0000","last_active":"2024-09-10T23:18:21.512777+0000","last_peered":"2024-09-10T23:18:21.512777+0000","last_clean":"2024-09-10T23:18:21.512777+0000","last_became_active":"2024-09-10T23:18:19.829915+0000","last_became_peered":"2024-09-10T23:18:19.829915+0000","last_unstale":"2024-09-10T23:18:21.512777+0000","last_undegraded":"2024-09-10T23:18:21.512777+0000","last_fullsized":"2024-09-10T23:18:21.512777+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:20.014465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.832995+0000","last_change":"2024-09-10T23:18:19.823585+0000","last_active":"2024-09-10T23:18:20.832995+0000","last_peered":"2024-09-10T23:18:20.832995+0000","last_clean":"2024-09-10T23:18:20.832995+0000","last_became_active":"2024-09-10T23:18:19.823326+0000","last_became_peered":"2024-09-10T23:18:19.823326+0000","last_unstale":"2024-09-10T23:18:20.832995+0000","last_undegraded":"2024-09-10T23:18:20.832995+0000","last_fullsized":"2024-09-10T23:18:20.832995+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:59.298973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.826017+0000","last_change":"2024-09-10T23:18:19.815898+0000","last_active":"2024-09-10T23:18:20.826017+0000","last_peered":"2024-09-10T23:18:20.826017+0000","last_clean":"2024-09-10T23:18:20.826017+0000","last_became_active":"2024-09-10T23:18:19.815140+0000","last_became_peered":"2024-09-10T23:18:19.815140+0000","last_unstale":"2024-09-10T23:18:20.826017+0000","last_undegraded":"2024-09-10T23:18:20.826017+0000","last_fullsized":"2024-09-10T23:18:20.826017+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:29.545629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780643+0000","last_change":"2024-09-10T23:18:19.831579+0000","last_active":"2024-09-10T23:18:21.780643+0000","last_peered":"2024-09-10T23:18:21.780643+0000","last_clean":"2024-09-10T23:18:21.780643+0000","last_became_active":"2024-09-10T23:18:19.831291+0000","last_became_peered":"2024-09-10T23:18:19.831291+0000","last_unstale":"2024-09-10T23:18:21.780643+0000","last_undegraded":"2024-09-10T23:18:21.780643+0000","last_fullsized":"2024-09-10T23:18:21.780643+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:51.785266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.513012+0000","last_change":"2024-09-10T23:18:19.830865+0000","last_active":"2024-09-10T23:18:21.513012+0000","last_peered":"2024-09-10T23:18:21.513012+0000","last_clean":"2024-09-10T23:18:21.513012+0000","last_became_active":"2024-09-10T23:18:19.830151+0000","last_became_peered":"2024-09-10T23:18:19.830151+0000","last_unstale":"2024-09-10T23:18:21.513012+0000","last_undegraded":"2024-09-10T23:18:21.513012+0000","last_fullsized":"2024-09-10T23:18:21.513012+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:02.684389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.832413+0000","last_change":"2024-09-10T23:18:19.830220+0000","last_active":"2024-09-10T23:18:20.832413+0000","last_peered":"2024-09-10T23:18:20.832413+0000","last_clean":"2024-09-10T23:18:20.832413+0000","last_became_active":"2024-09-10T23:18:19.829950+0000","last_became_peered":"2024-09-10T23:18:19.829950+0000","last_unstale":"2024-09-10T23:18:20.832413+0000","last_undegraded":"2024-09-10T23:18:20.832413+0000","last_fullsized":"2024-09-10T23:18:20.832413+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:30:32.840023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.831840+0000","last_change":"2024-09-10T23:18:19.817490+0000","last_active":"2024-09-10T23:18:20.831840+0000","last_peered":"2024-09-10T23:18:20.831840+0000","last_clean":"2024-09-10T23:18:20.831840+0000","last_became_active":"2024-09-10T23:18:19.816959+0000","last_became_peered":"2024-09-10T23:18:19.816959+0000","last_unstale":"2024-09-10T23:18:20.831840+0000","last_undegraded":"2024-09-10T23:18:20.831840+0000","last_fullsized":"2024-09-10T23:18:20.831840+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:42.327085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.825619+0000","last_change":"2024-09-10T23:18:19.815376+0000","last_active":"2024-09-10T23:18:20.825619+0000","last_peered":"2024-09-10T23:18:20.825619+0000","last_clean":"2024-09-10T23:18:20.825619+0000","last_became_active":"2024-09-10T23:18:19.815090+0000","last_became_peered":"2024-09-10T23:18:19.815090+0000","last_unstale":"2024-09-10T23:18:20.825619+0000","last_undegraded":"2024-09-10T23:18:20.825619+0000","last_fullsized":"2024-09-10T23:18:20.825619+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:27.984521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780632+0000","last_change":"2024-09-10T23:18:19.833318+0000","last_active":"2024-09-10T23:18:21.780632+0000","last_peered":"2024-09-10T23:18:21.780632+0000","last_clean":"2024-09-10T23:18:21.780632+0000","last_became_active":"2024-09-10T23:18:19.832884+0000","last_became_peered":"2024-09-10T23:18:19.832884+0000","last_unstale":"2024-09-10T23:18:21.780632+0000","last_undegraded":"2024-09-10T23:18:21.780632+0000","last_fullsized":"2024-09-10T23:18:21.780632+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:24.251809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780505+0000","last_change":"2024-09-10T23:18:19.831566+0000","last_active":"2024-09-10T23:18:21.780505+0000","last_peered":"2024-09-10T23:18:21.780505+0000","last_clean":"2024-09-10T23:18:21.780505+0000","last_became_active":"2024-09-10T23:18:19.831296+0000","last_became_peered":"2024-09-10T23:18:19.831296+0000","last_unstale":"2024-09-10T23:18:21.780505+0000","last_undegraded":"2024-09-10T23:18:21.780505+0000","last_fullsized":"2024-09-10T23:18:21.780505+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:35.351382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"103'4","reported_seq":19,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.831798+0000","last_change":"2024-09-10T23:18:18.819049+0000","last_active":"2024-09-10T23:18:20.831798+0000","last_peered":"2024-09-10T23:18:20.831798+0000","last_clean":"2024-09-10T23:18:20.831798+0000","last_became_active":"2024-09-10T23:18:18.818691+0000","last_became_peered":"2024-09-10T23:18:18.818691+0000","last_unstale":"2024-09-10T23:18:20.831798+0000","last_undegraded":"2024-09-10T23:18:20.831798+0000","last_fullsized":"2024-09-10T23:18:20.831798+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:20.746593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.781452+0000","last_change":"2024-09-10T23:18:19.825731+0000","last_active":"2024-09-10T23:18:21.781452+0000","last_peered":"2024-09-10T23:18:21.781452+0000","last_clean":"2024-09-10T23:18:21.781452+0000","last_became_active":"2024-09-10T23:18:19.825416+0000","last_became_peered":"2024-09-10T23:18:19.825416+0000","last_unstale":"2024-09-10T23:18:21.781452+0000","last_undegraded":"2024-09-10T23:18:21.781452+0000","last_fullsized":"2024-09-10T23:18:21.781452+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:56.084094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780855+0000","last_change":"2024-09-10T23:18:18.820513+0000","last_active":"2024-09-10T23:18:21.780855+0000","last_peered":"2024-09-10T23:18:21.780855+0000","last_clean":"2024-09-10T23:18:21.780855+0000","last_became_active":"2024-09-10T23:18:18.820183+0000","last_became_peered":"2024-09-10T23:18:18.820183+0000","last_unstale":"2024-09-10T23:18:21.780855+0000","last_undegraded":"2024-09-10T23:18:21.780855+0000","last_fullsized":"2024-09-10T23:18:21.780855+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:08.379933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780343+0000","last_change":"2024-09-10T23:18:19.829138+0000","last_active":"2024-09-10T23:18:21.780343+0000","last_peered":"2024-09-10T23:18:21.780343+0000","last_clean":"2024-09-10T23:18:21.780343+0000","last_became_active":"2024-09-10T23:18:19.828828+0000","last_became_peered":"2024-09-10T23:18:19.828828+0000","last_unstale":"2024-09-10T23:18:21.780343+0000","last_undegraded":"2024-09-10T23:18:21.780343+0000","last_fullsized":"2024-09-10T23:18:21.780343+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:21.434952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.781040+0000","last_change":"2024-09-10T23:18:18.821467+0000","last_active":"2024-09-10T23:18:21.781040+0000","last_peered":"2024-09-10T23:18:21.781040+0000","last_clean":"2024-09-10T23:18:21.781040+0000","last_became_active":"2024-09-10T23:18:18.821210+0000","last_became_peered":"2024-09-10T23:18:18.821210+0000","last_unstale":"2024-09-10T23:18:21.781040+0000","last_undegraded":"2024-09-10T23:18:21.781040+0000","last_fullsized":"2024-09-10T23:18:21.781040+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:29.032172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.781190+0000","last_change":"2024-09-10T23:18:19.834277+0000","last_active":"2024-09-10T23:18:21.781190+0000","last_peered":"2024-09-10T23:18:21.781190+0000","last_clean":"2024-09-10T23:18:21.781190+0000","last_became_active":"2024-09-10T23:18:19.833905+0000","last_became_peered":"2024-09-10T23:18:19.833905+0000","last_unstale":"2024-09-10T23:18:21.781190+0000","last_undegraded":"2024-09-10T23:18:21.781190+0000","last_fullsized":"2024-09-10T23:18:21.781190+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:37.581357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780781+0000","last_change":"2024-09-10T23:18:18.821805+0000","last_active":"2024-09-10T23:18:21.780781+0000","last_peered":"2024-09-10T23:18:21.780781+0000","last_clean":"2024-09-10T23:18:21.780781+0000","last_became_active":"2024-09-10T23:18:18.821524+0000","last_became_peered":"2024-09-10T23:18:18.821524+0000","last_unstale":"2024-09-10T23:18:21.780781+0000","last_undegraded":"2024-09-10T23:18:21.780781+0000","last_fullsized":"2024-09-10T23:18:21.780781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:20.294151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.826195+0000","last_change":"2024-09-10T23:18:19.829224+0000","last_active":"2024-09-10T23:18:20.826195+0000","last_peered":"2024-09-10T23:18:20.826195+0000","last_clean":"2024-09-10T23:18:20.826195+0000","last_became_active":"2024-09-10T23:18:19.828966+0000","last_became_peered":"2024-09-10T23:18:19.828966+0000","last_unstale":"2024-09-10T23:18:20.826195+0000","last_undegraded":"2024-09-10T23:18:20.826195+0000","last_fullsized":"2024-09-10T23:18:20.826195+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:07.822713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.831287+0000","last_change":"2024-09-10T23:18:18.818720+0000","last_active":"2024-09-10T23:18:20.831287+0000","last_peered":"2024-09-10T23:18:20.831287+0000","last_clean":"2024-09-10T23:18:20.831287+0000","last_became_active":"2024-09-10T23:18:18.818140+0000","last_became_peered":"2024-09-10T23:18:18.818140+0000","last_unstale":"2024-09-10T23:18:20.831287+0000","last_undegraded":"2024-09-10T23:18:20.831287+0000","last_fullsized":"2024-09-10T23:18:20.831287+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:38.107563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.832561+0000","last_change":"2024-09-10T23:18:19.824091+0000","last_active":"2024-09-10T23:18:20.832561+0000","last_peered":"2024-09-10T23:18:20.832561+0000","last_clean":"2024-09-10T23:18:20.832561+0000","last_became_active":"2024-09-10T23:18:19.823753+0000","last_became_peered":"2024-09-10T23:18:19.823753+0000","last_unstale":"2024-09-10T23:18:20.832561+0000","last_undegraded":"2024-09-10T23:18:20.832561+0000","last_fullsized":"2024-09-10T23:18:20.832561+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:34.315019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.513262+0000","last_change":"2024-09-10T23:18:18.823235+0000","last_active":"2024-09-10T23:18:21.513262+0000","last_peered":"2024-09-10T23:18:21.513262+0000","last_clean":"2024-09-10T23:18:21.513262+0000","last_became_active":"2024-09-10T23:18:18.822974+0000","last_became_peered":"2024-09-10T23:18:18.822974+0000","last_unstale":"2024-09-10T23:18:21.513262+0000","last_undegraded":"2024-09-10T23:18:21.513262+0000","last_fullsized":"2024-09-10T23:18:21.513262+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:17.927105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.825576+0000","last_change":"2024-09-10T23:18:19.836420+0000","last_active":"2024-09-10T23:18:20.825576+0000","last_peered":"2024-09-10T23:18:20.825576+0000","last_clean":"2024-09-10T23:18:20.825576+0000","last_became_active":"2024-09-10T23:18:19.835685+0000","last_became_peered":"2024-09-10T23:18:19.835685+0000","last_unstale":"2024-09-10T23:18:20.825576+0000","last_undegraded":"2024-09-10T23:18:20.825576+0000","last_fullsized":"2024-09-10T23:18:20.825576+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:42.673474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.832249+0000","last_change":"2024-09-10T23:18:18.823934+0000","last_active":"2024-09-10T23:18:20.832249+0000","last_peered":"2024-09-10T23:18:20.832249+0000","last_clean":"2024-09-10T23:18:20.832249+0000","last_became_active":"2024-09-10T23:18:18.823678+0000","last_became_peered":"2024-09-10T23:18:18.823678+0000","last_unstale":"2024-09-10T23:18:20.832249+0000","last_undegraded":"2024-09-10T23:18:20.832249+0000","last_fullsized":"2024-09-10T23:18:20.832249+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:31.791308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.831149+0000","last_change":"2024-09-10T23:18:19.823606+0000","last_active":"2024-09-10T23:18:20.831149+0000","last_peered":"2024-09-10T23:18:20.831149+0000","last_clean":"2024-09-10T23:18:20.831149+0000","last_became_active":"2024-09-10T23:18:19.823330+0000","last_became_peered":"2024-09-10T23:18:19.823330+0000","last_unstale":"2024-09-10T23:18:20.831149+0000","last_undegraded":"2024-09-10T23:18:20.831149+0000","last_fullsized":"2024-09-10T23:18:20.831149+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:23.202635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.825710+0000","last_change":"2024-09-10T23:18:18.826326+0000","last_active":"2024-09-10T23:18:20.825710+0000","last_peered":"2024-09-10T23:18:20.825710+0000","last_clean":"2024-09-10T23:18:20.825710+0000","last_became_active":"2024-09-10T23:18:18.826057+0000","last_became_peered":"2024-09-10T23:18:18.826057+0000","last_unstale":"2024-09-10T23:18:20.825710+0000","last_undegraded":"2024-09-10T23:18:20.825710+0000","last_fullsized":"2024-09-10T23:18:20.825710+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:49.440105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.831557+0000","last_change":"2024-09-10T23:18:19.828031+0000","last_active":"2024-09-10T23:18:20.831557+0000","last_peered":"2024-09-10T23:18:20.831557+0000","last_clean":"2024-09-10T23:18:20.831557+0000","last_became_active":"2024-09-10T23:18:19.827562+0000","last_became_peered":"2024-09-10T23:18:19.827562+0000","last_unstale":"2024-09-10T23:18:20.831557+0000","last_undegraded":"2024-09-10T23:18:20.831557+0000","last_fullsized":"2024-09-10T23:18:20.831557+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:00.089946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.781140+0000","last_change":"2024-09-10T23:18:18.819315+0000","last_active":"2024-09-10T23:18:21.781140+0000","last_peered":"2024-09-10T23:18:21.781140+0000","last_clean":"2024-09-10T23:18:21.781140+0000","last_became_active":"2024-09-10T23:18:18.819056+0000","last_became_peered":"2024-09-10T23:18:18.819056+0000","last_unstale":"2024-09-10T23:18:21.781140+0000","last_undegraded":"2024-09-10T23:18:21.781140+0000","last_fullsized":"2024-09-10T23:18:21.781140+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:14.032775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.781468+0000","last_change":"2024-09-10T23:18:19.824655+0000","last_active":"2024-09-10T23:18:21.781468+0000","last_peered":"2024-09-10T23:18:21.781468+0000","last_clean":"2024-09-10T23:18:21.781468+0000","last_became_active":"2024-09-10T23:18:19.824343+0000","last_became_peered":"2024-09-10T23:18:19.824343+0000","last_unstale":"2024-09-10T23:18:21.781468+0000","last_undegraded":"2024-09-10T23:18:21.781468+0000","last_fullsized":"2024-09-10T23:18:21.781468+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:41.518449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.513042+0000","last_change":"2024-09-10T23:18:18.818757+0000","last_active":"2024-09-10T23:18:21.513042+0000","last_peered":"2024-09-10T23:18:21.513042+0000","last_clean":"2024-09-10T23:18:21.513042+0000","last_became_active":"2024-09-10T23:18:18.818481+0000","last_became_peered":"2024-09-10T23:18:18.818481+0000","last_unstale":"2024-09-10T23:18:21.513042+0000","last_undegraded":"2024-09-10T23:18:21.513042+0000","last_fullsized":"2024-09-10T23:18:21.513042+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:26.837746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.513169+0000","last_change":"2024-09-10T23:18:19.822703+0000","last_active":"2024-09-10T23:18:21.513169+0000","last_peered":"2024-09-10T23:18:21.513169+0000","last_clean":"2024-09-10T23:18:21.513169+0000","last_became_active":"2024-09-10T23:18:19.822469+0000","last_became_peered":"2024-09-10T23:18:19.822469+0000","last_unstale":"2024-09-10T23:18:21.513169+0000","last_undegraded":"2024-09-10T23:18:21.513169+0000","last_fullsized":"2024-09-10T23:18:21.513169+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:08.550265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"103'3","reported_seq":18,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.825854+0000","last_change":"2024-09-10T23:18:18.816027+0000","last_active":"2024-09-10T23:18:20.825854+0000","last_peered":"2024-09-10T23:18:20.825854+0000","last_clean":"2024-09-10T23:18:20.825854+0000","last_became_active":"2024-09-10T23:18:18.815747+0000","last_became_peered":"2024-09-10T23:18:18.815747+0000","last_unstale":"2024-09-10T23:18:20.825854+0000","last_undegraded":"2024-09-10T23:18:20.825854+0000","last_fullsized":"2024-09-10T23:18:20.825854+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:31.262956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.831297+0000","last_change":"2024-09-10T23:18:19.828960+0000","last_active":"2024-09-10T23:18:20.831297+0000","last_peered":"2024-09-10T23:18:20.831297+0000","last_clean":"2024-09-10T23:18:20.831297+0000","last_became_active":"2024-09-10T23:18:19.828713+0000","last_became_peered":"2024-09-10T23:18:19.828713+0000","last_unstale":"2024-09-10T23:18:20.831297+0000","last_undegraded":"2024-09-10T23:18:20.831297+0000","last_fullsized":"2024-09-10T23:18:20.831297+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:00.688888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"103'6","reported_seq":21,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.826241+0000","last_change":"2024-09-10T23:18:18.826294+0000","last_active":"2024-09-10T23:18:20.826241+0000","last_peered":"2024-09-10T23:18:20.826241+0000","last_clean":"2024-09-10T23:18:20.826241+0000","last_became_active":"2024-09-10T23:18:18.826025+0000","last_became_peered":"2024-09-10T23:18:18.826025+0000","last_unstale":"2024-09-10T23:18:20.826241+0000","last_undegraded":"2024-09-10T23:18:20.826241+0000","last_fullsized":"2024-09-10T23:18:20.826241+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:31.085108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.513161+0000","last_change":"2024-09-10T23:18:19.825366+0000","last_active":"2024-09-10T23:18:21.513161+0000","last_peered":"2024-09-10T23:18:21.513161+0000","last_clean":"2024-09-10T23:18:21.513161+0000","last_became_active":"2024-09-10T23:18:19.824770+0000","last_became_peered":"2024-09-10T23:18:19.824770+0000","last_unstale":"2024-09-10T23:18:21.513161+0000","last_undegraded":"2024-09-10T23:18:21.513161+0000","last_fullsized":"2024-09-10T23:18:21.513161+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:41.628524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780373+0000","last_change":"2024-09-10T23:18:18.817973+0000","last_active":"2024-09-10T23:18:21.780373+0000","last_peered":"2024-09-10T23:18:21.780373+0000","last_clean":"2024-09-10T23:18:21.780373+0000","last_became_active":"2024-09-10T23:18:18.817730+0000","last_became_peered":"2024-09-10T23:18:18.817730+0000","last_unstale":"2024-09-10T23:18:21.780373+0000","last_undegraded":"2024-09-10T23:18:21.780373+0000","last_fullsized":"2024-09-10T23:18:21.780373+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:47.032035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.513129+0000","last_change":"2024-09-10T23:18:19.829079+0000","last_active":"2024-09-10T23:18:21.513129+0000","last_peered":"2024-09-10T23:18:21.513129+0000","last_clean":"2024-09-10T23:18:21.513129+0000","last_became_active":"2024-09-10T23:18:19.828829+0000","last_became_peered":"2024-09-10T23:18:19.828829+0000","last_unstale":"2024-09-10T23:18:21.513129+0000","last_undegraded":"2024-09-10T23:18:21.513129+0000","last_fullsized":"2024-09-10T23:18:21.513129+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:50:22.701799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780505+0000","last_change":"2024-09-10T23:18:18.826768+0000","last_active":"2024-09-10T23:18:21.780505+0000","last_peered":"2024-09-10T23:18:21.780505+0000","last_clean":"2024-09-10T23:18:21.780505+0000","last_became_active":"2024-09-10T23:18:18.826502+0000","last_became_peered":"2024-09-10T23:18:18.826502+0000","last_unstale":"2024-09-10T23:18:21.780505+0000","last_undegraded":"2024-09-10T23:18:21.780505+0000","last_fullsized":"2024-09-10T23:18:21.780505+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:48.343739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.512885+0000","last_change":"2024-09-10T23:18:19.822055+0000","last_active":"2024-09-10T23:18:21.512885+0000","last_peered":"2024-09-10T23:18:21.512885+0000","last_clean":"2024-09-10T23:18:21.512885+0000","last_became_active":"2024-09-10T23:18:19.821803+0000","last_became_peered":"2024-09-10T23:18:19.821803+0000","last_unstale":"2024-09-10T23:18:21.512885+0000","last_undegraded":"2024-09-10T23:18:21.512885+0000","last_fullsized":"2024-09-10T23:18:21.512885+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:41.073498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"103'8","reported_seq":23,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780426+0000","last_change":"2024-09-10T23:18:18.821437+0000","last_active":"2024-09-10T23:18:21.780426+0000","last_peered":"2024-09-10T23:18:21.780426+0000","last_clean":"2024-09-10T23:18:21.780426+0000","last_became_active":"2024-09-10T23:18:18.821139+0000","last_became_peered":"2024-09-10T23:18:18.821139+0000","last_unstale":"2024-09-10T23:18:21.780426+0000","last_undegraded":"2024-09-10T23:18:21.780426+0000","last_fullsized":"2024-09-10T23:18:21.780426+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:34.527204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.781408+0000","last_change":"2024-09-10T23:18:19.823839+0000","last_active":"2024-09-10T23:18:21.781408+0000","last_peered":"2024-09-10T23:18:21.781408+0000","last_clean":"2024-09-10T23:18:21.781408+0000","last_became_active":"2024-09-10T23:18:19.823562+0000","last_became_peered":"2024-09-10T23:18:19.823562+0000","last_unstale":"2024-09-10T23:18:21.781408+0000","last_undegraded":"2024-09-10T23:18:21.781408+0000","last_fullsized":"2024-09-10T23:18:21.781408+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:53.316251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.826600+0000","last_change":"2024-09-10T23:18:18.820001+0000","last_active":"2024-09-10T23:18:20.826600+0000","last_peered":"2024-09-10T23:18:20.826600+0000","last_clean":"2024-09-10T23:18:20.826600+0000","last_became_active":"2024-09-10T23:18:18.819684+0000","last_became_peered":"2024-09-10T23:18:18.819684+0000","last_unstale":"2024-09-10T23:18:20.826600+0000","last_undegraded":"2024-09-10T23:18:20.826600+0000","last_fullsized":"2024-09-10T23:18:20.826600+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:23.365609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780859+0000","last_change":"2024-09-10T23:18:19.831151+0000","last_active":"2024-09-10T23:18:21.780859+0000","last_peered":"2024-09-10T23:18:21.780859+0000","last_clean":"2024-09-10T23:18:21.780859+0000","last_became_active":"2024-09-10T23:18:19.830881+0000","last_became_peered":"2024-09-10T23:18:19.830881+0000","last_unstale":"2024-09-10T23:18:21.780859+0000","last_undegraded":"2024-09-10T23:18:21.780859+0000","last_fullsized":"2024-09-10T23:18:21.780859+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:20:04.549077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.781451+0000","last_change":"2024-09-10T23:18:18.822172+0000","last_active":"2024-09-10T23:18:21.781451+0000","last_peered":"2024-09-10T23:18:21.781451+0000","last_clean":"2024-09-10T23:18:21.781451+0000","last_became_active":"2024-09-10T23:18:18.821867+0000","last_became_peered":"2024-09-10T23:18:18.821867+0000","last_unstale":"2024-09-10T23:18:21.781451+0000","last_undegraded":"2024-09-10T23:18:21.781451+0000","last_fullsized":"2024-09-10T23:18:21.781451+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:28.101107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780704+0000","last_change":"2024-09-10T23:18:19.838948+0000","last_active":"2024-09-10T23:18:21.780704+0000","last_peered":"2024-09-10T23:18:21.780704+0000","last_clean":"2024-09-10T23:18:21.780704+0000","last_became_active":"2024-09-10T23:18:19.838478+0000","last_became_peered":"2024-09-10T23:18:19.838478+0000","last_unstale":"2024-09-10T23:18:21.780704+0000","last_undegraded":"2024-09-10T23:18:21.780704+0000","last_fullsized":"2024-09-10T23:18:21.780704+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:29.058288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780823+0000","last_change":"2024-09-10T23:18:18.828797+0000","last_active":"2024-09-10T23:18:21.780823+0000","last_peered":"2024-09-10T23:18:21.780823+0000","last_clean":"2024-09-10T23:18:21.780823+0000","last_became_active":"2024-09-10T23:18:18.828538+0000","last_became_peered":"2024-09-10T23:18:18.828538+0000","last_unstale":"2024-09-10T23:18:21.780823+0000","last_undegraded":"2024-09-10T23:18:21.780823+0000","last_fullsized":"2024-09-10T23:18:21.780823+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:14.953384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.781192+0000","last_change":"2024-09-10T23:18:19.832939+0000","last_active":"2024-09-10T23:18:21.781192+0000","last_peered":"2024-09-10T23:18:21.781192+0000","last_clean":"2024-09-10T23:18:21.781192+0000","last_became_active":"2024-09-10T23:18:19.832618+0000","last_became_peered":"2024-09-10T23:18:19.832618+0000","last_unstale":"2024-09-10T23:18:21.781192+0000","last_undegraded":"2024-09-10T23:18:21.781192+0000","last_fullsized":"2024-09-10T23:18:21.781192+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:50:22.701799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.831659+0000","last_change":"2024-09-10T23:18:18.821792+0000","last_active":"2024-09-10T23:18:20.831659+0000","last_peered":"2024-09-10T23:18:20.831659+0000","last_clean":"2024-09-10T23:18:20.831659+0000","last_became_active":"2024-09-10T23:18:18.821465+0000","last_became_peered":"2024-09-10T23:18:18.821465+0000","last_unstale":"2024-09-10T23:18:20.831659+0000","last_undegraded":"2024-09-10T23:18:20.831659+0000","last_fullsized":"2024-09-10T23:18:20.831659+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:53.324053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780649+0000","last_change":"2024-09-10T23:18:19.832542+0000","last_active":"2024-09-10T23:18:21.780649+0000","last_peered":"2024-09-10T23:18:21.780649+0000","last_clean":"2024-09-10T23:18:21.780649+0000","last_became_active":"2024-09-10T23:18:19.832208+0000","last_became_peered":"2024-09-10T23:18:19.832208+0000","last_unstale":"2024-09-10T23:18:21.780649+0000","last_undegraded":"2024-09-10T23:18:21.780649+0000","last_fullsized":"2024-09-10T23:18:21.780649+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:16.247919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780368+0000","last_change":"2024-09-10T23:18:18.823102+0000","last_active":"2024-09-10T23:18:21.780368+0000","last_peered":"2024-09-10T23:18:21.780368+0000","last_clean":"2024-09-10T23:18:21.780368+0000","last_became_active":"2024-09-10T23:18:18.822794+0000","last_became_peered":"2024-09-10T23:18:18.822794+0000","last_unstale":"2024-09-10T23:18:21.780368+0000","last_undegraded":"2024-09-10T23:18:21.780368+0000","last_fullsized":"2024-09-10T23:18:21.780368+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:29.032172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.826124+0000","last_change":"2024-09-10T23:18:19.834729+0000","last_active":"2024-09-10T23:18:20.826124+0000","last_peered":"2024-09-10T23:18:20.826124+0000","last_clean":"2024-09-10T23:18:20.826124+0000","last_became_active":"2024-09-10T23:18:19.834136+0000","last_became_peered":"2024-09-10T23:18:19.834136+0000","last_unstale":"2024-09-10T23:18:20.826124+0000","last_undegraded":"2024-09-10T23:18:20.826124+0000","last_fullsized":"2024-09-10T23:18:20.826124+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:15.221303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780574+0000","last_change":"2024-09-10T23:18:18.821285+0000","last_active":"2024-09-10T23:18:21.780574+0000","last_peered":"2024-09-10T23:18:21.780574+0000","last_clean":"2024-09-10T23:18:21.780574+0000","last_became_active":"2024-09-10T23:18:18.820993+0000","last_became_peered":"2024-09-10T23:18:18.820993+0000","last_unstale":"2024-09-10T23:18:21.780574+0000","last_undegraded":"2024-09-10T23:18:21.780574+0000","last_fullsized":"2024-09-10T23:18:21.780574+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:47.032035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.781453+0000","last_change":"2024-09-10T23:18:19.836596+0000","last_active":"2024-09-10T23:18:21.781453+0000","last_peered":"2024-09-10T23:18:21.781453+0000","last_clean":"2024-09-10T23:18:21.781453+0000","last_became_active":"2024-09-10T23:18:19.836333+0000","last_became_peered":"2024-09-10T23:18:19.836333+0000","last_unstale":"2024-09-10T23:18:21.781453+0000","last_undegraded":"2024-09-10T23:18:21.781453+0000","last_fullsized":"2024-09-10T23:18:21.781453+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:53.516518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780254+0000","last_change":"2024-09-10T23:18:18.824334+0000","last_active":"2024-09-10T23:18:21.780254+0000","last_peered":"2024-09-10T23:18:21.780254+0000","last_clean":"2024-09-10T23:18:21.780254+0000","last_became_active":"2024-09-10T23:18:18.824076+0000","last_became_peered":"2024-09-10T23:18:18.824076+0000","last_unstale":"2024-09-10T23:18:21.780254+0000","last_undegraded":"2024-09-10T23:18:21.780254+0000","last_fullsized":"2024-09-10T23:18:21.780254+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:51.639356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.512896+0000","last_change":"2024-09-10T23:18:19.832624+0000","last_active":"2024-09-10T23:18:21.512896+0000","last_peered":"2024-09-10T23:18:21.512896+0000","last_clean":"2024-09-10T23:18:21.512896+0000","last_became_active":"2024-09-10T23:18:19.832337+0000","last_became_peered":"2024-09-10T23:18:19.832337+0000","last_unstale":"2024-09-10T23:18:21.512896+0000","last_undegraded":"2024-09-10T23:18:21.512896+0000","last_fullsized":"2024-09-10T23:18:21.512896+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:39.462810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.825801+0000","last_change":"2024-09-10T23:18:18.817276+0000","last_active":"2024-09-10T23:18:20.825801+0000","last_peered":"2024-09-10T23:18:20.825801+0000","last_clean":"2024-09-10T23:18:20.825801+0000","last_became_active":"2024-09-10T23:18:18.816667+0000","last_became_peered":"2024-09-10T23:18:18.816667+0000","last_unstale":"2024-09-10T23:18:20.825801+0000","last_undegraded":"2024-09-10T23:18:20.825801+0000","last_fullsized":"2024-09-10T23:18:20.825801+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:24.584421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.781193+0000","last_change":"2024-09-10T23:18:19.819937+0000","last_active":"2024-09-10T23:18:21.781193+0000","last_peered":"2024-09-10T23:18:21.781193+0000","last_clean":"2024-09-10T23:18:21.781193+0000","last_became_active":"2024-09-10T23:18:19.819609+0000","last_became_peered":"2024-09-10T23:18:19.819609+0000","last_unstale":"2024-09-10T23:18:21.781193+0000","last_undegraded":"2024-09-10T23:18:21.781193+0000","last_fullsized":"2024-09-10T23:18:21.781193+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:01.839082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.513002+0000","last_change":"2024-09-10T23:18:18.823508+0000","last_active":"2024-09-10T23:18:21.513002+0000","last_peered":"2024-09-10T23:18:21.513002+0000","last_clean":"2024-09-10T23:18:21.513002+0000","last_became_active":"2024-09-10T23:18:18.823163+0000","last_became_peered":"2024-09-10T23:18:18.823163+0000","last_unstale":"2024-09-10T23:18:21.513002+0000","last_undegraded":"2024-09-10T23:18:21.513002+0000","last_fullsized":"2024-09-10T23:18:21.513002+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:57.336353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.826662+0000","last_change":"2024-09-10T23:18:19.821135+0000","last_active":"2024-09-10T23:18:20.826662+0000","last_peered":"2024-09-10T23:18:20.826662+0000","last_clean":"2024-09-10T23:18:20.826662+0000","last_became_active":"2024-09-10T23:18:19.820836+0000","last_became_peered":"2024-09-10T23:18:19.820836+0000","last_unstale":"2024-09-10T23:18:20.826662+0000","last_undegraded":"2024-09-10T23:18:20.826662+0000","last_fullsized":"2024-09-10T23:18:20.826662+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:23.713456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"104'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.781317+0000","last_change":"2024-09-10T23:18:18.818495+0000","last_active":"2024-09-10T23:18:21.781317+0000","last_peered":"2024-09-10T23:18:21.781317+0000","last_clean":"2024-09-10T23:18:21.781317+0000","last_became_active":"2024-09-10T23:18:18.818166+0000","last_became_peered":"2024-09-10T23:18:18.818166+0000","last_unstale":"2024-09-10T23:18:21.781317+0000","last_undegraded":"2024-09-10T23:18:21.781317+0000","last_fullsized":"2024-09-10T23:18:21.781317+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:17.521005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.826248+0000","last_change":"2024-09-10T23:18:19.825403+0000","last_active":"2024-09-10T23:18:20.826248+0000","last_peered":"2024-09-10T23:18:20.826248+0000","last_clean":"2024-09-10T23:18:20.826248+0000","last_became_active":"2024-09-10T23:18:19.824358+0000","last_became_peered":"2024-09-10T23:18:19.824358+0000","last_unstale":"2024-09-10T23:18:20.826248+0000","last_undegraded":"2024-09-10T23:18:20.826248+0000","last_fullsized":"2024-09-10T23:18:20.826248+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:10:54.455494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.825957+0000","last_change":"2024-09-10T23:18:18.817175+0000","last_active":"2024-09-10T23:18:20.825957+0000","last_peered":"2024-09-10T23:18:20.825957+0000","last_clean":"2024-09-10T23:18:20.825957+0000","last_became_active":"2024-09-10T23:18:18.816918+0000","last_became_peered":"2024-09-10T23:18:18.816918+0000","last_unstale":"2024-09-10T23:18:20.825957+0000","last_undegraded":"2024-09-10T23:18:20.825957+0000","last_fullsized":"2024-09-10T23:18:20.825957+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:00.772523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780645+0000","last_change":"2024-09-10T23:18:19.819902+0000","last_active":"2024-09-10T23:18:21.780645+0000","last_peered":"2024-09-10T23:18:21.780645+0000","last_clean":"2024-09-10T23:18:21.780645+0000","last_became_active":"2024-09-10T23:18:19.819597+0000","last_became_peered":"2024-09-10T23:18:19.819597+0000","last_unstale":"2024-09-10T23:18:21.780645+0000","last_undegraded":"2024-09-10T23:18:21.780645+0000","last_fullsized":"2024-09-10T23:18:21.780645+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:58.341362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.513268+0000","last_change":"2024-09-10T23:18:18.823716+0000","last_active":"2024-09-10T23:18:21.513268+0000","last_peered":"2024-09-10T23:18:21.513268+0000","last_clean":"2024-09-10T23:18:21.513268+0000","last_became_active":"2024-09-10T23:18:18.823450+0000","last_became_peered":"2024-09-10T23:18:18.823450+0000","last_unstale":"2024-09-10T23:18:21.513268+0000","last_undegraded":"2024-09-10T23:18:21.513268+0000","last_fullsized":"2024-09-10T23:18:21.513268+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:00.834074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.832297+0000","last_change":"2024-09-10T23:18:19.813945+0000","last_active":"2024-09-10T23:18:20.832297+0000","last_peered":"2024-09-10T23:18:20.832297+0000","last_clean":"2024-09-10T23:18:20.832297+0000","last_became_active":"2024-09-10T23:18:19.813279+0000","last_became_peered":"2024-09-10T23:18:19.813279+0000","last_unstale":"2024-09-10T23:18:20.832297+0000","last_undegraded":"2024-09-10T23:18:20.832297+0000","last_fullsized":"2024-09-10T23:18:20.832297+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:49.767859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.831406+0000","last_change":"2024-09-10T23:18:18.818409+0000","last_active":"2024-09-10T23:18:20.831406+0000","last_peered":"2024-09-10T23:18:20.831406+0000","last_clean":"2024-09-10T23:18:20.831406+0000","last_became_active":"2024-09-10T23:18:18.817769+0000","last_became_peered":"2024-09-10T23:18:18.817769+0000","last_unstale":"2024-09-10T23:18:20.831406+0000","last_undegraded":"2024-09-10T23:18:20.831406+0000","last_fullsized":"2024-09-10T23:18:20.831406+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:22:24.800421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.832645+0000","last_change":"2024-09-10T23:18:19.826769+0000","last_active":"2024-09-10T23:18:20.832645+0000","last_peered":"2024-09-10T23:18:20.832645+0000","last_clean":"2024-09-10T23:18:20.832645+0000","last_became_active":"2024-09-10T23:18:19.826467+0000","last_became_peered":"2024-09-10T23:18:19.826467+0000","last_unstale":"2024-09-10T23:18:20.832645+0000","last_undegraded":"2024-09-10T23:18:20.832645+0000","last_fullsized":"2024-09-10T23:18:20.832645+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:26.841269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.832286+0000","last_change":"2024-09-10T23:18:18.820337+0000","last_active":"2024-09-10T23:18:20.832286+0000","last_peered":"2024-09-10T23:18:20.832286+0000","last_clean":"2024-09-10T23:18:20.832286+0000","last_became_active":"2024-09-10T23:18:18.820040+0000","last_became_peered":"2024-09-10T23:18:18.820040+0000","last_unstale":"2024-09-10T23:18:20.832286+0000","last_undegraded":"2024-09-10T23:18:20.832286+0000","last_fullsized":"2024-09-10T23:18:20.832286+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:12.068147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.781572+0000","last_change":"2024-09-10T23:18:19.833541+0000","last_active":"2024-09-10T23:18:21.781572+0000","last_peered":"2024-09-10T23:18:21.781572+0000","last_clean":"2024-09-10T23:18:21.781572+0000","last_became_active":"2024-09-10T23:18:19.833278+0000","last_became_peered":"2024-09-10T23:18:19.833278+0000","last_unstale":"2024-09-10T23:18:21.781572+0000","last_undegraded":"2024-09-10T23:18:21.781572+0000","last_fullsized":"2024-09-10T23:18:21.781572+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:49.943799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.780567+0000","last_change":"2024-09-10T23:18:18.822619+0000","last_active":"2024-09-10T23:18:21.780567+0000","last_peered":"2024-09-10T23:18:21.780567+0000","last_clean":"2024-09-10T23:18:21.780567+0000","last_became_active":"2024-09-10T23:18:18.822363+0000","last_became_peered":"2024-09-10T23:18:18.822363+0000","last_unstale":"2024-09-10T23:18:21.780567+0000","last_undegraded":"2024-09-10T23:18:21.780567+0000","last_fullsized":"2024-09-10T23:18:21.780567+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:13.423487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.826304+0000","last_change":"2024-09-10T23:18:19.834678+0000","last_active":"2024-09-10T23:18:20.826304+0000","last_peered":"2024-09-10T23:18:20.826304+0000","last_clean":"2024-09-10T23:18:20.826304+0000","last_became_active":"2024-09-10T23:18:19.834419+0000","last_became_peered":"2024-09-10T23:18:19.834419+0000","last_unstale":"2024-09-10T23:18:20.826304+0000","last_undegraded":"2024-09-10T23:18:20.826304+0000","last_fullsized":"2024-09-10T23:18:20.826304+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:08.540221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.825894+0000","last_change":"2024-09-10T23:18:18.817547+0000","last_active":"2024-09-10T23:18:20.825894+0000","last_peered":"2024-09-10T23:18:20.825894+0000","last_clean":"2024-09-10T23:18:20.825894+0000","last_became_active":"2024-09-10T23:18:18.817017+0000","last_became_peered":"2024-09-10T23:18:18.817017+0000","last_unstale":"2024-09-10T23:18:20.825894+0000","last_undegraded":"2024-09-10T23:18:20.825894+0000","last_fullsized":"2024-09-10T23:18:20.825894+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:43.765100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.512852+0000","last_change":"2024-09-10T23:18:19.829796+0000","last_active":"2024-09-10T23:18:21.512852+0000","last_peered":"2024-09-10T23:18:21.512852+0000","last_clean":"2024-09-10T23:18:21.512852+0000","last_became_active":"2024-09-10T23:18:19.829530+0000","last_became_peered":"2024-09-10T23:18:19.829530+0000","last_unstale":"2024-09-10T23:18:21.512852+0000","last_undegraded":"2024-09-10T23:18:21.512852+0000","last_fullsized":"2024-09-10T23:18:21.512852+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:18.798951+0000","last_clean_scrub_stamp":"2024-09-10T23:18:18.798951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:59.920400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:20.831323+0000","last_change":"2024-09-10T23:18:18.821522+0000","last_active":"2024-09-10T23:18:20.831323+0000","last_peered":"2024-09-10T23:18:20.831323+0000","last_clean":"2024-09-10T23:18:20.831323+0000","last_became_active":"2024-09-10T23:18:18.821236+0000","last_became_peered":"2024-09-10T23:18:18.821236+0000","last_unstale":"2024-09-10T23:18:20.831323+0000","last_undegraded":"2024-09-10T23:18:20.831323+0000","last_fullsized":"2024-09-10T23:18:20.831323+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:17.793943+0000","last_clean_scrub_stamp":"2024-09-10T23:18:17.793943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:17.910202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":257,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T23:18:21.781688+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:18:21.781688+0000","last_peered":"2024-09-10T23:18:21.781688+0000","last_clean":"2024-09-10T23:18:21.781688+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:18:21.781688+0000","last_undegraded":"2024-09-10T23:18:21.781688+0000","last_fullsized":"2024-09-10T23:18:21.781688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509492,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28872,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342968,"statfs":{"total":96636764160,"available":96607199232,"internally_reserved":0,"allocated":1888256,"data_stored":1137231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509491,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1290240,"data_stored":546317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1294336,"data_stored":546851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509491,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1286144,"data_stored":546247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1302528,"data_stored":547929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509492,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1286144,"data_stored":546247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1294336,"data_stored":546371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1900544,"data_stored":1138339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:18:27.463 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:18:27.463 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:18:27.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.608+0000 7fb200847640 1 -- 172.21.15.90:0/3361077626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1e4004b40 msgr2=0x7fb1e4004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:27.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.608+0000 7fb200847640 1 --2- 172.21.15.90:0/3361077626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1e4004b40 0x7fb1e4004f40 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec0043e0 tx=0x7fb1e4006940 comp rx=0 tx=0).stop 2024-09-10T23:18:27.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.609+0000 7fb1fad9d640 1 -- 172.21.15.90:0/3361077626 reap_dead start 2024-09-10T23:18:27.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.609+0000 7fb200847640 1 -- 172.21.15.90:0/3361077626 shutdown_connections 2024-09-10T23:18:27.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.609+0000 7fb200847640 1 -- 172.21.15.90:0/3361077626 >> 172.21.15.90:0/3361077626 conn(0x7fb1fc0b19c0 msgr2=0x7fb1fc0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:27.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.609+0000 7fb200847640 1 -- 172.21.15.90:0/3361077626 shutdown_connections 2024-09-10T23:18:27.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.609+0000 7fb200847640 1 -- 172.21.15.90:0/3361077626 wait complete. 2024-09-10T23:18:27.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.610+0000 7fb200847640 1 Processor -- start 2024-09-10T23:18:27.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.610+0000 7fb200847640 1 -- start start 2024-09-10T23:18:27.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb200847640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1e4004b40 0x7fb1fc0cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:27.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb200847640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1fc149840 0x7fb1fc1e52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:27.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb200847640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1fc1e57f0 0x7fb1fc0c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:27.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb200847640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb1fc06e830 con 0x7fb1fc149840 2024-09-10T23:18:27.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb200847640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb1fc15aad0 con 0x7fb1e4004b40 2024-09-10T23:18:27.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb200847640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb1fc0cdb90 con 0x7fb1fc1e57f0 2024-09-10T23:18:27.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb1f9d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1fc149840 0x7fb1fc1e52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:27.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb1f9d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1fc149840 0x7fb1fc1e52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56466/0 (socket says 172.21.15.90:56466) 2024-09-10T23:18:27.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb1f9d9b640 1 -- 172.21.15.90:0/1012334135 learned_addr learned my addr 172.21.15.90:0/1012334135 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:27.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb1fa59c640 1 --2- 172.21.15.90:0/1012334135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1e4004b40 0x7fb1fc0cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:27.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb1fad9d640 1 --2- 172.21.15.90:0/1012334135 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1fc1e57f0 0x7fb1fc0c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:27.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb1f9d9b640 1 -- 172.21.15.90:0/1012334135 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1fc1e57f0 msgr2=0x7fb1fc0c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:27.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb1f9d9b640 1 --2- 172.21.15.90:0/1012334135 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1fc1e57f0 0x7fb1fc0c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb1f9d9b640 1 -- 172.21.15.90:0/1012334135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1e4004b40 msgr2=0x7fb1fc0cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:27.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb1f9d9b640 1 --2- 172.21.15.90:0/1012334135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1e4004b40 0x7fb1fc0cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb1f9d9b640 1 -- 172.21.15.90:0/1012334135 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1fc0caae0 con 0x7fb1fc149840 2024-09-10T23:18:27.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb1f9d9b640 1 --2- 172.21.15.90:0/1012334135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1fc149840 0x7fb1fc1e52b0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000f820 tx=0x7fb1f000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:27.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.611+0000 7fb1eaffd640 1 -- 172.21.15.90:0/1012334135 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0015070 con 0x7fb1fc149840 2024-09-10T23:18:27.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.612+0000 7fb1eaffd640 1 -- 172.21.15.90:0/1012334135 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1f000b8a0 con 0x7fb1fc149840 2024-09-10T23:18:27.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.612+0000 7fb1eaffd640 1 -- 172.21.15.90:0/1012334135 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f000bcd0 con 0x7fb1fc149840 2024-09-10T23:18:27.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.612+0000 7fb200847640 1 -- 172.21.15.90:0/1012334135 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1fc0cadc0 con 0x7fb1fc149840 2024-09-10T23:18:27.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.612+0000 7fb200847640 1 -- 172.21.15.90:0/1012334135 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1fc0cb380 con 0x7fb1fc149840 2024-09-10T23:18:27.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.612+0000 7fb200847640 1 -- 172.21.15.90:0/1012334135 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1fc0ce830 con 0x7fb1fc149840 2024-09-10T23:18:27.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.613+0000 7fb1eaffd640 1 -- 172.21.15.90:0/1012334135 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb1f0022030 con 0x7fb1fc149840 2024-09-10T23:18:27.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.614+0000 7fb1eaffd640 1 --2- 172.21.15.90:0/1012334135 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb1dc077f70 0x7fb1dc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:27.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.614+0000 7fb1eaffd640 1 -- 172.21.15.90:0/1012334135 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fb1f009a420 con 0x7fb1fc149840 2024-09-10T23:18:27.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.614+0000 7fb1fa59c640 1 --2- 172.21.15.90:0/1012334135 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb1dc077f70 0x7fb1dc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:27.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.615+0000 7fb1fa59c640 1 --2- 172.21.15.90:0/1012334135 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb1dc077f70 0x7fb1dc07a430 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec032000 tx=0x7fb1ec003ae0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:27.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.618+0000 7fb1eaffd640 1 -- 172.21.15.90:0/1012334135 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb1f0062960 con 0x7fb1fc149840 2024-09-10T23:18:27.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.865+0000 7fb200847640 1 -- 172.21.15.90:0/1012334135 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fb1fc0ccc40 con 0x7fb1fc149840 2024-09-10T23:18:27.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.867+0000 7fb1eaffd640 1 -- 172.21.15.90:0/1012334135 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v31) ==== 190+0+147 (secure 0 0 0) 0x7fb1f0067390 con 0x7fb1fc149840 2024-09-10T23:18:27.868 INFO:teuthology.orchestra.run.smithi090.stdout:[client.0] 2024-09-10T23:18:27.868 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQCX0uBmiYBwBhAABMV9erpQ+KZlTmf0kDZ0gw== 2024-09-10T23:18:27.868 INFO:teuthology.orchestra.run.smithi090.stdout: caps mds = "allow" 2024-09-10T23:18:27.868 INFO:teuthology.orchestra.run.smithi090.stdout: caps mon = "allow r" 2024-09-10T23:18:27.869 INFO:teuthology.orchestra.run.smithi090.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:18:27.869 INFO:teuthology.orchestra.run.smithi090.stderr:updated caps for client.0 2024-09-10T23:18:27.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.869+0000 7fb200847640 1 -- 172.21.15.90:0/1012334135 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb1dc077f70 msgr2=0x7fb1dc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:27.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.869+0000 7fb200847640 1 --2- 172.21.15.90:0/1012334135 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb1dc077f70 0x7fb1dc07a430 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec032000 tx=0x7fb1ec003ae0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.869+0000 7fb200847640 1 -- 172.21.15.90:0/1012334135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1fc149840 msgr2=0x7fb1fc1e52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:27.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.869+0000 7fb200847640 1 --2- 172.21.15.90:0/1012334135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1fc149840 0x7fb1fc1e52b0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000f820 tx=0x7fb1f000fce0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.869+0000 7fb200847640 1 -- 172.21.15.90:0/1012334135 shutdown_connections 2024-09-10T23:18:27.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.869+0000 7fb200847640 1 --2- 172.21.15.90:0/1012334135 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb1dc077f70 0x7fb1dc07a430 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.869+0000 7fb200847640 1 --2- 172.21.15.90:0/1012334135 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1fc1e57f0 0x7fb1fc0c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.869+0000 7fb200847640 1 --2- 172.21.15.90:0/1012334135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1fc149840 0x7fb1fc1e52b0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.870+0000 7fb200847640 1 --2- 172.21.15.90:0/1012334135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1e4004b40 0x7fb1fc0cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.870+0000 7fb200847640 1 -- 172.21.15.90:0/1012334135 >> 172.21.15.90:0/1012334135 conn(0x7fb1fc0b19c0 msgr2=0x7fb1fc073630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:27.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.870+0000 7fb200847640 1 -- 172.21.15.90:0/1012334135 shutdown_connections 2024-09-10T23:18:27.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.870+0000 7fb200847640 1 -- 172.21.15.90:0/1012334135 wait complete. 2024-09-10T23:18:27.881 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:27.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.981+0000 7fe7827f3640 1 -- 172.21.15.90:0/1626188365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe77c0b44a0 msgr2=0x7fe77c0b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:27.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.981+0000 7fe7827f3640 1 --2- 172.21.15.90:0/1626188365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe77c0b44a0 0x7fe77c0b4880 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fe76c005fd0 tx=0x7fe76c02a540 comp rx=0 tx=0).stop 2024-09-10T23:18:27.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.981+0000 7fe7827f3640 1 -- 172.21.15.90:0/1626188365 shutdown_connections 2024-09-10T23:18:27.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.981+0000 7fe7827f3640 1 --2- 172.21.15.90:0/1626188365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe77c0cd470 0x7fe77c15e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.981+0000 7fe7827f3640 1 --2- 172.21.15.90:0/1626188365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe77c0b44a0 0x7fe77c0b4880 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.981+0000 7fe7827f3640 1 -- 172.21.15.90:0/1626188365 >> 172.21.15.90:0/1626188365 conn(0x7fe77c0b19c0 msgr2=0x7fe77c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:27.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.981+0000 7fe7827f3640 1 -- 172.21.15.90:0/1626188365 shutdown_connections 2024-09-10T23:18:27.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.981+0000 7fe7827f3640 1 -- 172.21.15.90:0/1626188365 wait complete. 2024-09-10T23:18:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.982+0000 7fe7827f3640 1 Processor -- start 2024-09-10T23:18:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.982+0000 7fe7827f3640 1 -- start start 2024-09-10T23:18:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.983+0000 7fe7827f3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe77c0b44a0 0x7fe77c1f9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.983+0000 7fe7827f3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe77c0cd470 0x7fe77c0cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.983+0000 7fe7827f3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe77c0cf860 0x7fe77c0d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.983+0000 7fe7827f3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c0ceba0 con 0x7fe77c0cf860 2024-09-10T23:18:27.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.983+0000 7fe7827f3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c06f6d0 con 0x7fe77c0cd470 2024-09-10T23:18:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.983+0000 7fe7827f3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe77c0ced20 con 0x7fe77c0b44a0 2024-09-10T23:18:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.983+0000 7fe780d90640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe77c0cf860 0x7fe77c0d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.983+0000 7fe780d90640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe77c0cf860 0x7fe77c0d01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56478/0 (socket says 172.21.15.90:56478) 2024-09-10T23:18:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.983+0000 7fe780d90640 1 -- 172.21.15.90:0/325471471 learned_addr learned my addr 172.21.15.90:0/325471471 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.983+0000 7fe780d90640 1 -- 172.21.15.90:0/325471471 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe77c0b44a0 msgr2=0x7fe77c1f9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.983+0000 7fe780d90640 1 --2- 172.21.15.90:0/325471471 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe77c0b44a0 0x7fe77c1f9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.983+0000 7fe780d90640 1 -- 172.21.15.90:0/325471471 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe77c0cd470 msgr2=0x7fe77c0cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.983+0000 7fe780d90640 1 --2- 172.21.15.90:0/325471471 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe77c0cd470 0x7fe77c0cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.983+0000 7fe780d90640 1 -- 172.21.15.90:0/325471471 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77c1f6120 con 0x7fe77c0cf860 2024-09-10T23:18:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.984+0000 7fe780d90640 1 --2- 172.21.15.90:0/325471471 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe77c0cf860 0x7fe77c0d01a0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fe77400ead0 tx=0x7fe77400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.984+0000 7fe778ff9640 1 -- 172.21.15.90:0/325471471 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77400cde0 con 0x7fe77c0cf860 2024-09-10T23:18:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.984+0000 7fe778ff9640 1 -- 172.21.15.90:0/325471471 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe774004c10 con 0x7fe77c0cf860 2024-09-10T23:18:27.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.984+0000 7fe7827f3640 1 -- 172.21.15.90:0/325471471 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe77c1f9670 con 0x7fe77c0cf860 2024-09-10T23:18:27.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.984+0000 7fe778ff9640 1 -- 172.21.15.90:0/325471471 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774005020 con 0x7fe77c0cf860 2024-09-10T23:18:27.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.984+0000 7fe7827f3640 1 -- 172.21.15.90:0/325471471 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe77c1f5640 con 0x7fe77c0cf860 2024-09-10T23:18:27.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.985+0000 7fe7827f3640 1 -- 172.21.15.90:0/325471471 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe77c0b4880 con 0x7fe77c0cf860 2024-09-10T23:18:27.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.985+0000 7fe778ff9640 1 -- 172.21.15.90:0/325471471 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe77400f040 con 0x7fe77c0cf860 2024-09-10T23:18:27.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.986+0000 7fe778ff9640 1 --2- 172.21.15.90:0/325471471 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe768077f70 0x7fe76807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:27.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.986+0000 7fe778ff9640 1 -- 172.21.15.90:0/325471471 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fe77409a490 con 0x7fe77c0cf860 2024-09-10T23:18:27.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.986+0000 7fe77bfff640 1 --2- 172.21.15.90:0/325471471 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe768077f70 0x7fe76807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:27.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.987+0000 7fe77bfff640 1 --2- 172.21.15.90:0/325471471 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe768077f70 0x7fe76807a430 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe76c033000 tx=0x7fe76c0046c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:27.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:27.990+0000 7fe778ff9640 1 -- 172.21.15.90:0/325471471 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe774016030 con 0x7fe77c0cf860 2024-09-10T23:18:28.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.198+0000 7fe7827f3640 1 -- 172.21.15.90:0/325471471 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe77c0cc480 con 0x7fe77c0cf860 2024-09-10T23:18:28.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.198+0000 7fe778ff9640 1 -- 172.21.15.90:0/325471471 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5228 (secure 0 0 0) 0x7fe774062f90 con 0x7fe77c0cf860 2024-09-10T23:18:28.199 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:28.200 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":57,"btime":"2024-09-10T23:18:21:823811+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1514360394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1514360394},{"type":"v1","addr":"172.21.15.171:6836","nonce":1514360394}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":7050,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6834/539487330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":539487330},{"type":"v1","addr":"172.21.15.90:6834","nonce":539487330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":7053,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4002726882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":4002726882},{"type":"v1","addr":"172.21.15.90:6835","nonce":4002726882}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:19.149613+0000","modified":"2024-09-10T23:18:21.159397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"d","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/3083996658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3083996658},{"type":"v1","addr":"172.21.15.171:6837","nonce":3083996658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7068,"qdb_cluster":[7068]},"id":8}]} 2024-09-10T23:18:28.200 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 57 2024-09-10T23:18:28.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.200+0000 7fe7827f3640 1 -- 172.21.15.90:0/325471471 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe768077f70 msgr2=0x7fe76807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:28.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.200+0000 7fe7827f3640 1 --2- 172.21.15.90:0/325471471 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe768077f70 0x7fe76807a430 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe76c033000 tx=0x7fe76c0046c0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.200+0000 7fe7827f3640 1 -- 172.21.15.90:0/325471471 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe77c0cf860 msgr2=0x7fe77c0d01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:28.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.200+0000 7fe7827f3640 1 --2- 172.21.15.90:0/325471471 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe77c0cf860 0x7fe77c0d01a0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fe77400ead0 tx=0x7fe77400ef90 comp rx=0 tx=0).stop 2024-09-10T23:18:28.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.201+0000 7fe7827f3640 1 -- 172.21.15.90:0/325471471 shutdown_connections 2024-09-10T23:18:28.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.201+0000 7fe7827f3640 1 --2- 172.21.15.90:0/325471471 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe768077f70 0x7fe76807a430 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.201+0000 7fe7827f3640 1 --2- 172.21.15.90:0/325471471 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe77c0cd470 0x7fe77c0cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.201+0000 7fe7827f3640 1 --2- 172.21.15.90:0/325471471 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe77c0cf860 0x7fe77c0d01a0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.201+0000 7fe7827f3640 1 --2- 172.21.15.90:0/325471471 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe77c0b44a0 0x7fe77c1f9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.201+0000 7fe7827f3640 1 -- 172.21.15.90:0/325471471 >> 172.21.15.90:0/325471471 conn(0x7fe77c0b19c0 msgr2=0x7fe77c072eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:28.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.201+0000 7fe7827f3640 1 -- 172.21.15.90:0/325471471 shutdown_connections 2024-09-10T23:18:28.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.201+0000 7fe7827f3640 1 -- 172.21.15.90:0/325471471 wait complete. 2024-09-10T23:18:28.615 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:18:19.149613+0000', 'modified': '2024-09-10T23:18:21.159397+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7068}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7068': {'gid': 7068, 'name': 'd', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.171:6837/3083996658', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6835', 'nonce': 3083996658}, {'type': 'v1', 'addr': '172.21.15.171:6837', 'nonce': 3083996658}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7068, 'qdb_cluster': [7068]} 2024-09-10T23:18:28.615 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:18:28.615 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T23:18:28.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.717+0000 7fbfeb6f6640 1 -- 172.21.15.90:0/3225064352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbfe415e310 msgr2=0x7fbfe40d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:28.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.717+0000 7fbfeb6f6640 1 --2- 172.21.15.90:0/3225064352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbfe415e310 0x7fbfe40d0a80 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fbfe408e4a0 tx=0x7fbfd802a4d0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.717+0000 7fbfeb6f6640 1 -- 172.21.15.90:0/3225064352 shutdown_connections 2024-09-10T23:18:28.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.717+0000 7fbfeb6f6640 1 --2- 172.21.15.90:0/3225064352 >> v2:172.21.15.171:3300/0 conn(0x7fbfe40d16f0 0x7fbfe40d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.717+0000 7fbfeb6f6640 1 --2- 172.21.15.90:0/3225064352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbfe415e310 0x7fbfe40d0a80 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.717+0000 7fbfeb6f6640 1 -- 172.21.15.90:0/3225064352 >> 172.21.15.90:0/3225064352 conn(0x7fbfe40d4090 msgr2=0x7fbfe40d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:28.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.717+0000 7fbfeb6f6640 1 -- 172.21.15.90:0/3225064352 shutdown_connections 2024-09-10T23:18:28.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.717+0000 7fbfeb6f6640 1 -- 172.21.15.90:0/3225064352 wait complete. 2024-09-10T23:18:28.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.718+0000 7fbfeb6f6640 1 Processor -- start 2024-09-10T23:18:28.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.719+0000 7fbfeb6f6640 1 -- start start 2024-09-10T23:18:28.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.719+0000 7fbfeb6f6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbfe40d16f0 0x7fbfe41f8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.719+0000 7fbfeb6f6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfe40d4b80 0x7fbfe4160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.719+0000 7fbfeb6f6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfe415e310 0x7fbfe41f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.719+0000 7fbfeb6f6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe40cf7f0 con 0x7fbfe40d16f0 2024-09-10T23:18:28.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.719+0000 7fbfeb6f6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe40d3ae0 con 0x7fbfe40d4b80 2024-09-10T23:18:28.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.719+0000 7fbfeb6f6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe406de00 con 0x7fbfe415e310 2024-09-10T23:18:28.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.719+0000 7fbfe9492640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbfe40d16f0 0x7fbfe41f8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.719+0000 7fbfe9492640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbfe40d16f0 0x7fbfe41f8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34326/0 (socket says 172.21.15.90:34326) 2024-09-10T23:18:28.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.719+0000 7fbfe9492640 1 -- 172.21.15.90:0/1081126587 learned_addr learned my addr 172.21.15.90:0/1081126587 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:28.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.720+0000 7fbfe9c93640 1 --2- 172.21.15.90:0/1081126587 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfe415e310 0x7fbfe41f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.720+0000 7fbfe8c91640 1 --2- 172.21.15.90:0/1081126587 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfe40d4b80 0x7fbfe4160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.720+0000 7fbfe9492640 1 -- 172.21.15.90:0/1081126587 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfe415e310 msgr2=0x7fbfe41f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:28.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.720+0000 7fbfe9492640 1 --2- 172.21.15.90:0/1081126587 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfe415e310 0x7fbfe41f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.720+0000 7fbfe9492640 1 -- 172.21.15.90:0/1081126587 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfe40d4b80 msgr2=0x7fbfe4160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:28.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.720+0000 7fbfe9492640 1 --2- 172.21.15.90:0/1081126587 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfe40d4b80 0x7fbfe4160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.720+0000 7fbfe9492640 1 -- 172.21.15.90:0/1081126587 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe41f50c0 con 0x7fbfe40d16f0 2024-09-10T23:18:28.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.720+0000 7fbfe9492640 1 --2- 172.21.15.90:0/1081126587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbfe40d16f0 0x7fbfe41f8640 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8034040 tx=0x7fbfd80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:28.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.720+0000 7fbfd5ffb640 1 -- 172.21.15.90:0/1081126587 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd803e030 con 0x7fbfe40d16f0 2024-09-10T23:18:28.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.720+0000 7fbfd5ffb640 1 -- 172.21.15.90:0/1081126587 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfd80047a0 con 0x7fbfe40d16f0 2024-09-10T23:18:28.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.720+0000 7fbfd5ffb640 1 -- 172.21.15.90:0/1081126587 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8035040 con 0x7fbfe40d16f0 2024-09-10T23:18:28.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.720+0000 7fbfeb6f6640 1 -- 172.21.15.90:0/1081126587 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe41f8e90 con 0x7fbfe40d16f0 2024-09-10T23:18:28.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.720+0000 7fbfeb6f6640 1 -- 172.21.15.90:0/1081126587 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe41f9450 con 0x7fbfe40d16f0 2024-09-10T23:18:28.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.722+0000 7fbfd5ffb640 1 -- 172.21.15.90:0/1081126587 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbfd8004b70 con 0x7fbfe40d16f0 2024-09-10T23:18:28.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.722+0000 7fbfd5ffb640 1 --2- 172.21.15.90:0/1081126587 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbfc8077fa0 0x7fbfc807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.722+0000 7fbfd5ffb640 1 -- 172.21.15.90:0/1081126587 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fbfd80ba6f0 con 0x7fbfe40d16f0 2024-09-10T23:18:28.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.723+0000 7fbfe8c91640 1 --2- 172.21.15.90:0/1081126587 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbfc8077fa0 0x7fbfc807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.723+0000 7fbfe8c91640 1 --2- 172.21.15.90:0/1081126587 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbfc8077fa0 0x7fbfc807a460 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbfe41ec140 tx=0x7fbfe0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:28.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.723+0000 7fbfee4c9740 1 Processor -- start 2024-09-10T23:18:28.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.723+0000 7fbfee4c9740 1 -- start start 2024-09-10T23:18:28.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.724+0000 7fbfee4c9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f7f1b0 0x561245f56b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.724+0000 7fbfee4c9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f9f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.724+0000 7fbfee4c9740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f545f0 0x561245f54a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.724+0000 7fbfee4c9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561245ecb820 con 0x561245f9edf0 2024-09-10T23:18:28.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.724+0000 7fbfee4c9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561245ebac50 con 0x561245f7f1b0 2024-09-10T23:18:28.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.724+0000 7fbfee4c9740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x561245ebea60 con 0x561245f545f0 2024-09-10T23:18:28.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.724+0000 7fbfe8c91640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f9f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.724+0000 7fbfe8c91640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f9f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34332/0 (socket says 172.21.15.90:34332) 2024-09-10T23:18:28.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.724+0000 7fbfe8c91640 1 -- 172.21.15.90:0/4038975542 learned_addr learned my addr 172.21.15.90:0/4038975542 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:28.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.724+0000 7fbfe9c93640 1 --2- 172.21.15.90:0/4038975542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f545f0 0x561245f54a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.724+0000 7fbfe9492640 1 --2- 172.21.15.90:0/4038975542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f7f1b0 0x561245f56b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.724+0000 7fbfe8c91640 1 -- 172.21.15.90:0/4038975542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f545f0 msgr2=0x561245f54a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:28.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.724+0000 7fbfe8c91640 1 --2- 172.21.15.90:0/4038975542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f545f0 0x561245f54a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.724+0000 7fbfe8c91640 1 -- 172.21.15.90:0/4038975542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f7f1b0 msgr2=0x561245f56b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:28.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.724+0000 7fbfe8c91640 1 --2- 172.21.15.90:0/4038975542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f7f1b0 0x561245f56b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.724+0000 7fbfe8c91640 1 -- 172.21.15.90:0/4038975542 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561245c1c850 con 0x561245f9edf0 2024-09-10T23:18:28.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.724+0000 7fbfe8c91640 1 --2- 172.21.15.90:0/4038975542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f9f1f0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000d7e0 tx=0x7fbfe0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9abf63bdab5f7933 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:28.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.725+0000 7fbfc6ffd640 1 -- 172.21.15.90:0/4038975542 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0024070 con 0x561245f9edf0 2024-09-10T23:18:28.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.725+0000 7fbfc6ffd640 1 -- 172.21.15.90:0/4038975542 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfe0014aa0 con 0x561245f9edf0 2024-09-10T23:18:28.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.725+0000 7fbfc6ffd640 1 -- 172.21.15.90:0/4038975542 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0014e50 con 0x561245f9edf0 2024-09-10T23:18:28.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.725+0000 7fbfee4c9740 1 -- 172.21.15.90:0/4038975542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 msgr2=0x561245f9f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:28.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.725+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/4038975542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f9f1f0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000d7e0 tx=0x7fbfe0010000 comp rx=0 tx=0).stop 2024-09-10T23:18:28.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.725+0000 7fbfee4c9740 1 -- 172.21.15.90:0/4038975542 shutdown_connections 2024-09-10T23:18:28.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.725+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/4038975542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f545f0 0x561245f54a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.725+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/4038975542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f9f1f0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.725+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/4038975542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f7f1b0 0x561245f56b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.725+0000 7fbfee4c9740 1 -- 172.21.15.90:0/4038975542 >> 172.21.15.90:0/4038975542 conn(0x561245f556a0 msgr2=0x561245f590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:28.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.725+0000 7fbfee4c9740 1 -- 172.21.15.90:0/4038975542 shutdown_connections 2024-09-10T23:18:28.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.725+0000 7fbfee4c9740 1 -- 172.21.15.90:0/4038975542 wait complete. 2024-09-10T23:18:28.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.726+0000 7fbfee4c9740 1 -- start start 2024-09-10T23:18:28.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.726+0000 7fbfee4c9740 1 Processor -- start 2024-09-10T23:18:28.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfee4c9740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f7f1b0 0x561245f97450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfee4c9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f77330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfee4c9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f999d0 0x561245f99e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfee4c9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561245c2b620 con 0x561245f9edf0 2024-09-10T23:18:28.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfee4c9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561245e605f0 con 0x561245f999d0 2024-09-10T23:18:28.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfee4c9740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x561245f53b30 con 0x561245f7f1b0 2024-09-10T23:18:28.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfee4c9740 10 client.0 _ll_register_callbacks cb 0x561245e640a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:28.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfe8c91640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f77330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfe8c91640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f77330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34348/0 (socket says 172.21.15.90:34348) 2024-09-10T23:18:28.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfe8c91640 1 -- 172.21.15.90:0/2629638734 learned_addr learned my addr 172.21.15.90:0/2629638734 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:28.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfe8c91640 1 -- 172.21.15.90:0/2629638734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f7f1b0 msgr2=0x561245f97450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:28.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfe9492640 1 --2- 172.21.15.90:0/2629638734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f7f1b0 0x561245f97450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfe9c93640 1 --2- 172.21.15.90:0/2629638734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f999d0 0x561245f99e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfe8c91640 1 --2- 172.21.15.90:0/2629638734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f7f1b0 0x561245f97450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfe8c91640 1 -- 172.21.15.90:0/2629638734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f999d0 msgr2=0x561245f99e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:28.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfe8c91640 1 --2- 172.21.15.90:0/2629638734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f999d0 0x561245f99e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfe8c91640 1 -- 172.21.15.90:0/2629638734 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561245c936b0 con 0x561245f9edf0 2024-09-10T23:18:28.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfe9492640 1 --2- 172.21.15.90:0/2629638734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f7f1b0 0x561245f97450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:28.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfe9c93640 1 --2- 172.21.15.90:0/2629638734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f999d0 0x561245f99e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:28.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfe8c91640 1 --2- 172.21.15.90:0/2629638734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f77330 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x561245f9fc30 tx=0x7fbfe001f6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82085b04dcffedb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:28.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfbffff640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:18:28.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.727+0000 7fbfbffff640 1 -- 172.21.15.90:0/2629638734 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0024040 con 0x561245f9edf0 2024-09-10T23:18:28.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.728+0000 7fbfbffff640 1 -- 172.21.15.90:0/2629638734 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fbfe001faa0 con 0x561245f9edf0 2024-09-10T23:18:28.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.728+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2629638734 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfe0014aa0 con 0x561245f9edf0 2024-09-10T23:18:28.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.728+0000 7fbfbffff640 1 -- 172.21.15.90:0/2629638734 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fbfe001fca0 con 0x561245f9edf0 2024-09-10T23:18:28.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.728+0000 7fbfee4c9740 10 client.7218 fetch_fsmap learned FSMap version 57 2024-09-10T23:18:28.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.728+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2629638734 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) -- 0x561245f949f0 con 0x561245f9edf0 2024-09-10T23:18:28.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.728+0000 7fbfbffff640 1 -- 172.21.15.90:0/2629638734 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfe0014aa0 con 0x561245f9edf0 2024-09-10T23:18:28.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.728+0000 7fbfbffff640 1 -- 172.21.15.90:0/2629638734 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 57) ==== 3502+0+0 (secure 0 0 0) 0x7fbfe0037080 con 0x561245f9edf0 2024-09-10T23:18:28.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.728+0000 7fbfee4c9740 10 client.7218 fetch_fsmap finished waiting for FSMap version 57 2024-09-10T23:18:28.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.728+0000 7fbfee4c9740 10 client.7218 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:18:28.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.728+0000 7fbfee4c9740 20 client.7218 populate_metadata read hostname 'smithi090' 2024-09-10T23:18:28.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.728+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/2629638734 >> [v2:172.21.15.171:6835/3083996658,v1:172.21.15.171:6837/3083996658] conn(0x561245f95780 0x561245f95b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.728+0000 7fbfee4c9740 4 client.7218 mds_command: new command op to 7068 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:18:28.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.728+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2629638734 --> [v2:172.21.15.171:6835/3083996658,v1:172.21.15.171:6837/3083996658] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561245ecd770 con 0x561245f95780 2024-09-10T23:18:28.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.728+0000 7fbfe9492640 1 --2- 172.21.15.90:0/2629638734 >> [v2:172.21.15.171:6835/3083996658,v1:172.21.15.171:6837/3083996658] conn(0x561245f95780 0x561245f95b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.729+0000 7fbfbffff640 10 client.7218 ms_handle_connect on v2:172.21.15.171:6835/3083996658 2024-09-10T23:18:28.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.729+0000 7fbfe9492640 1 --2- 172.21.15.90:0/2629638734 >> [v2:172.21.15.171:6835/3083996658,v1:172.21.15.171:6837/3083996658] conn(0x561245f95780 0x561245f95b60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=388b76b7b611367d server_cookie=33f00bd8d974304d in_seq=0 out_seq=0 2024-09-10T23:18:28.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.729+0000 7fbfbffff640 1 -- 172.21.15.90:0/2629638734 <== mds.0 v2:172.21.15.171:6835/3083996658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561245ecd770 con 0x561245f95780 2024-09-10T23:18:28.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.730+0000 7fbfbffff640 10 client.7218 handle_command_reply: tid=0 2024-09-10T23:18:28.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.730+0000 7fbfee4c9740 1 client.7218 shutdown 2024-09-10T23:18:28.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.730+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2629638734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 msgr2=0x561245f77330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:28.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.730+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/2629638734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f77330 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x561245f9fc30 tx=0x7fbfe001f6b0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.730+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2629638734 shutdown_connections 2024-09-10T23:18:28.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.730+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/2629638734 >> [v2:172.21.15.171:6835/3083996658,v1:172.21.15.171:6837/3083996658] conn(0x561245f95780 0x561245f95b60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.730+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/2629638734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f999d0 0x561245f99e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.730+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/2629638734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f77330 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.730+0000 7fbfbffff640 0 client.7218 ms_handle_reset on v2:172.21.15.171:6835/3083996658 2024-09-10T23:18:28.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.730+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/2629638734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f7f1b0 0x561245f97450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.730+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2629638734 >> 172.21.15.90:0/2629638734 conn(0x561245f545f0 msgr2=0x561245f7f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:28.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.730+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2629638734 shutdown_connections 2024-09-10T23:18:28.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.730+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2629638734 wait complete. 2024-09-10T23:18:28.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.730+0000 7fbfee4c9740 20 client.7218 trim_cache size 0 max 16384 2024-09-10T23:18:28.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.748+0000 7fbfee4c9740 1 Processor -- start 2024-09-10T23:18:28.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.748+0000 7fbfee4c9740 1 -- start start 2024-09-10T23:18:28.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.748+0000 7fbfee4c9740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f7f1b0 0x561245f525d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.748+0000 7fbfee4c9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f999d0 0x561245f52b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.748+0000 7fbfee4c9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f9edf0 0x561245fc1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.748+0000 7fbfee4c9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe40cdff0 con 0x561245f999d0 2024-09-10T23:18:28.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.748+0000 7fbfee4c9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe40b77a0 con 0x561245f9edf0 2024-09-10T23:18:28.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.748+0000 7fbfee4c9740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe40cd9a0 con 0x561245f7f1b0 2024-09-10T23:18:28.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.749+0000 7fbfe8c91640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f999d0 0x561245f52b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.749+0000 7fbfe8c91640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f999d0 0x561245f52b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34364/0 (socket says 172.21.15.90:34364) 2024-09-10T23:18:28.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.749+0000 7fbfe8c91640 1 -- 172.21.15.90:0/2849662147 learned_addr learned my addr 172.21.15.90:0/2849662147 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:28.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.749+0000 7fbfe9c93640 1 --2- 172.21.15.90:0/2849662147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f9edf0 0x561245fc1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.749+0000 7fbfe9492640 1 --2- 172.21.15.90:0/2849662147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f7f1b0 0x561245f525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.749+0000 7fbfe8c91640 1 -- 172.21.15.90:0/2849662147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f7f1b0 msgr2=0x561245f525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:28.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.749+0000 7fbfe8c91640 1 --2- 172.21.15.90:0/2849662147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f7f1b0 0x561245f525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.749+0000 7fbfe8c91640 1 -- 172.21.15.90:0/2849662147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f9edf0 msgr2=0x561245fc1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:28.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.749+0000 7fbfe8c91640 1 --2- 172.21.15.90:0/2849662147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f9edf0 0x561245fc1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.749+0000 7fbfe8c91640 1 -- 172.21.15.90:0/2849662147 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561245f9aec0 con 0x561245f999d0 2024-09-10T23:18:28.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.749+0000 7fbfe8c91640 1 --2- 172.21.15.90:0/2849662147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f999d0 0x561245f52b10 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000a010 tx=0x7fbfe0009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ebe430ebf6577c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:28.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.749+0000 7fbfc67fc640 1 -- 172.21.15.90:0/2849662147 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0024040 con 0x561245f999d0 2024-09-10T23:18:28.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.749+0000 7fbfc67fc640 1 -- 172.21.15.90:0/2849662147 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfe001f720 con 0x561245f999d0 2024-09-10T23:18:28.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.749+0000 7fbfc67fc640 1 -- 172.21.15.90:0/2849662147 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe002a7b0 con 0x561245f999d0 2024-09-10T23:18:28.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.750+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2849662147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f999d0 msgr2=0x561245f52b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:28.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.750+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/2849662147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f999d0 0x561245f52b10 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000a010 tx=0x7fbfe0009f10 comp rx=0 tx=0).stop 2024-09-10T23:18:28.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.750+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2849662147 shutdown_connections 2024-09-10T23:18:28.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.750+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/2849662147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f9edf0 0x561245fc1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.750+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/2849662147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f999d0 0x561245f52b10 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.750+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/2849662147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f7f1b0 0x561245f525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.750+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2849662147 >> 172.21.15.90:0/2849662147 conn(0x561245f545f0 msgr2=0x561245f97e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:28.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.750+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2849662147 shutdown_connections 2024-09-10T23:18:28.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.750+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2849662147 wait complete. 2024-09-10T23:18:28.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.750+0000 7fbfee4c9740 1 -- start start 2024-09-10T23:18:28.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.750+0000 7fbfee4c9740 1 Processor -- start 2024-09-10T23:18:28.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.751+0000 7fbfee4c9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f7f1b0 0x561245faf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.751+0000 7fbfee4c9740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f999d0 0x561245f77050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.751+0000 7fbfee4c9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f527c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.751+0000 7fbfee4c9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561245f77870 con 0x561245f9edf0 2024-09-10T23:18:28.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.751+0000 7fbfee4c9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561245f94d30 con 0x561245f7f1b0 2024-09-10T23:18:28.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.751+0000 7fbfee4c9740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x561245fb1800 con 0x561245f999d0 2024-09-10T23:18:28.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.751+0000 7fbfee4c9740 10 client.0 _ll_register_callbacks cb 0x7fbfe0022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:28.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.751+0000 7fbfe9c93640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.751+0000 7fbfe9c93640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34366/0 (socket says 172.21.15.90:34366) 2024-09-10T23:18:28.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.751+0000 7fbfe9c93640 1 -- 172.21.15.90:0/2619316946 learned_addr learned my addr 172.21.15.90:0/2619316946 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:28.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.751+0000 7fbfe9492640 1 --2- 172.21.15.90:0/2619316946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f7f1b0 0x561245faf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.751+0000 7fbfe8c91640 1 --2- 172.21.15.90:0/2619316946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f999d0 0x561245f77050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfe9c93640 1 -- 172.21.15.90:0/2619316946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f999d0 msgr2=0x561245f77050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:28.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfe9c93640 1 --2- 172.21.15.90:0/2619316946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f999d0 0x561245f77050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfe9c93640 1 -- 172.21.15.90:0/2619316946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f7f1b0 msgr2=0x561245faf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:28.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfe9c93640 1 --2- 172.21.15.90:0/2619316946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f7f1b0 0x561245faf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfe9c93640 1 -- 172.21.15.90:0/2619316946 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561245f57d60 con 0x561245f9edf0 2024-09-10T23:18:28.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfe9492640 1 --2- 172.21.15.90:0/2619316946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f7f1b0 0x561245faf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:28.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfe9c93640 1 --2- 172.21.15.90:0/2619316946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f527c0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0052d0 tx=0x7fbfdc005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b31587bdca9457 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:28.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfbffff640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:18:28.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfbffff640 1 -- 172.21.15.90:0/2619316946 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc002010 con 0x561245f9edf0 2024-09-10T23:18:28.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfbffff640 1 -- 172.21.15.90:0/2619316946 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fbfdc017460 con 0x561245f9edf0 2024-09-10T23:18:28.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2619316946 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfe001f720 con 0x561245f9edf0 2024-09-10T23:18:28.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfbffff640 1 -- 172.21.15.90:0/2619316946 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fbfdc024050 con 0x561245f9edf0 2024-09-10T23:18:28.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfee4c9740 10 client.7224 fetch_fsmap learned FSMap version 57 2024-09-10T23:18:28.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2619316946 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) -- 0x561245f77590 con 0x561245f9edf0 2024-09-10T23:18:28.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfbffff640 1 -- 172.21.15.90:0/2619316946 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfe001f720 con 0x561245f9edf0 2024-09-10T23:18:28.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfbffff640 1 -- 172.21.15.90:0/2619316946 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 57) ==== 3502+0+0 (secure 0 0 0) 0x7fbfdc027020 con 0x561245f9edf0 2024-09-10T23:18:28.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfee4c9740 10 client.7224 fetch_fsmap finished waiting for FSMap version 57 2024-09-10T23:18:28.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfee4c9740 10 client.7224 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:18:28.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfee4c9740 20 client.7224 populate_metadata read hostname 'smithi090' 2024-09-10T23:18:28.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/2619316946 >> [v2:172.21.15.171:6835/3083996658,v1:172.21.15.171:6837/3083996658] conn(0x5612460078d0 0x561245f82650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfee4c9740 4 client.7224 mds_command: new command op to 7068 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:18:28.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.752+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2619316946 --> [v2:172.21.15.171:6835/3083996658,v1:172.21.15.171:6837/3083996658] -- command(tid 0: {"prefix": "status"}) -- 0x561245ec9220 con 0x5612460078d0 2024-09-10T23:18:28.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.753+0000 7fbfe9492640 1 --2- 172.21.15.90:0/2619316946 >> [v2:172.21.15.171:6835/3083996658,v1:172.21.15.171:6837/3083996658] conn(0x5612460078d0 0x561245f82650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.753+0000 7fbfe9492640 1 --2- 172.21.15.90:0/2619316946 >> [v2:172.21.15.171:6835/3083996658,v1:172.21.15.171:6837/3083996658] conn(0x5612460078d0 0x561245f82650 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=caf4ab945e89f719 server_cookie=6e8513fe0bb47b08 in_seq=0 out_seq=0 2024-09-10T23:18:28.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.753+0000 7fbfbffff640 10 client.7224 ms_handle_connect on v2:172.21.15.171:6835/3083996658 2024-09-10T23:18:28.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.753+0000 7fbfbffff640 1 -- 172.21.15.90:0/2619316946 <== mds.0 v2:172.21.15.171:6835/3083996658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x561245ec9220 con 0x5612460078d0 2024-09-10T23:18:28.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.753+0000 7fbfbffff640 10 client.7224 handle_command_reply: tid=0 2024-09-10T23:18:28.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.753+0000 7fbfee4c9740 1 client.7224 shutdown 2024-09-10T23:18:28.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.753+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2619316946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 msgr2=0x561245f527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:28.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.753+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/2619316946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f527c0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0052d0 tx=0x7fbfdc005790 comp rx=0 tx=0).stop 2024-09-10T23:18:28.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.753+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2619316946 shutdown_connections 2024-09-10T23:18:28.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.753+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/2619316946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561245f9edf0 0x561245f527c0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.753+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/2619316946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x561245f999d0 0x561245f77050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.753+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/2619316946 >> [v2:172.21.15.171:6835/3083996658,v1:172.21.15.171:6837/3083996658] conn(0x5612460078d0 0x561245f82650 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.753+0000 7fbfee4c9740 1 --2- 172.21.15.90:0/2619316946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561245f7f1b0 0x561245faf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.753+0000 7fbfbffff640 0 client.7224 ms_handle_reset on v2:172.21.15.171:6835/3083996658 2024-09-10T23:18:28.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.753+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2619316946 >> 172.21.15.90:0/2619316946 conn(0x561245f545f0 msgr2=0x561245f54db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:28.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.753+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2619316946 shutdown_connections 2024-09-10T23:18:28.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.753+0000 7fbfee4c9740 1 -- 172.21.15.90:0/2619316946 wait complete. 2024-09-10T23:18:28.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.754+0000 7fbfee4c9740 20 client.7224 trim_cache size 0 max 16384 2024-09-10T23:18:28.761 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:18:28.761 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd", 2024-09-10T23:18:28.761 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2024-09-10T23:18:28.761 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 7068, 2024-09-10T23:18:28.761 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-09-10T23:18:28.762 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-09-10T23:18:28.762 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2024-09-10T23:18:28.762 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 8.948564052, 2024-09-10T23:18:28.762 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 57, 2024-09-10T23:18:28.762 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 104, 2024-09-10T23:18:28.762 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 104, 2024-09-10T23:18:28.762 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 13.648935271999999 2024-09-10T23:18:28.762 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:18:28.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.754+0000 7fbfeb6f6640 1 -- 172.21.15.90:0/1081126587 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbfc8077fa0 msgr2=0x7fbfc807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:28.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.754+0000 7fbfeb6f6640 1 --2- 172.21.15.90:0/1081126587 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbfc8077fa0 0x7fbfc807a460 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbfe41ec140 tx=0x7fbfe0008040 comp rx=0 tx=0).stop 2024-09-10T23:18:28.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.754+0000 7fbfeb6f6640 1 -- 172.21.15.90:0/1081126587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbfe40d16f0 msgr2=0x7fbfe41f8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:28.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.754+0000 7fbfeb6f6640 1 --2- 172.21.15.90:0/1081126587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbfe40d16f0 0x7fbfe41f8640 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8034040 tx=0x7fbfd80039e0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.754+0000 7fbfeb6f6640 1 -- 172.21.15.90:0/1081126587 shutdown_connections 2024-09-10T23:18:28.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.754+0000 7fbfeb6f6640 1 --2- 172.21.15.90:0/1081126587 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbfc8077fa0 0x7fbfc807a460 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.754+0000 7fbfeb6f6640 1 --2- 172.21.15.90:0/1081126587 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfe40d4b80 0x7fbfe4160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.754+0000 7fbfeb6f6640 1 --2- 172.21.15.90:0/1081126587 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfe415e310 0x7fbfe41f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.754+0000 7fbfeb6f6640 1 --2- 172.21.15.90:0/1081126587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbfe40d16f0 0x7fbfe41f8640 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.754+0000 7fbfeb6f6640 1 -- 172.21.15.90:0/1081126587 >> 172.21.15.90:0/1081126587 conn(0x7fbfe40d4090 msgr2=0x7fbfe40d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:28.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.754+0000 7fbfeb6f6640 1 -- 172.21.15.90:0/1081126587 shutdown_connections 2024-09-10T23:18:28.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.754+0000 7fbfeb6f6640 1 -- 172.21.15.90:0/1081126587 wait complete. 2024-09-10T23:18:28.766 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:18:28.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.867+0000 7f02878ef640 1 -- 172.21.15.90:0/3237999689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02800d1190 msgr2=0x7f02800d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:28.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.867+0000 7f02878ef640 1 --2- 172.21.15.90:0/3237999689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02800d1190 0x7f02800d28c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0274009830 tx=0x7f027402a480 comp rx=0 tx=0).stop 2024-09-10T23:18:28.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.867+0000 7f02878ef640 1 -- 172.21.15.90:0/3237999689 shutdown_connections 2024-09-10T23:18:28.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.867+0000 7f02878ef640 1 --2- 172.21.15.90:0/3237999689 >> v2:172.21.15.171:3300/0 conn(0x7f02800d16f0 0x7f02800d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.867+0000 7f02878ef640 1 --2- 172.21.15.90:0/3237999689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02800d1190 0x7f02800d28c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.867+0000 7f02878ef640 1 -- 172.21.15.90:0/3237999689 >> 172.21.15.90:0/3237999689 conn(0x7f02800d4090 msgr2=0x7f02800d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:28.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.867+0000 7f02878ef640 1 -- 172.21.15.90:0/3237999689 shutdown_connections 2024-09-10T23:18:28.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.867+0000 7f02878ef640 1 -- 172.21.15.90:0/3237999689 wait complete. 2024-09-10T23:18:28.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.869+0000 7f02878ef640 1 Processor -- start 2024-09-10T23:18:28.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.869+0000 7f02878ef640 1 -- start start 2024-09-10T23:18:28.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.869+0000 7f02878ef640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02800d1190 0x7f0280161260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.869+0000 7f02878ef640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02800d16f0 0x7f028015eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.869+0000 7f02878ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f028015e310 0x7f0280154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.869+0000 7f02878ef640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f02800d3340 con 0x7f028015e310 2024-09-10T23:18:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.869+0000 7f02878ef640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f02800d4d90 con 0x7f02800d1190 2024-09-10T23:18:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.869+0000 7f02878ef640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f02800d34c0 con 0x7f02800d16f0 2024-09-10T23:18:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.870+0000 7f0285e8c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f028015e310 0x7f0280154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.870+0000 7f0285e8c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f028015e310 0x7f0280154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34368/0 (socket says 172.21.15.90:34368) 2024-09-10T23:18:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.870+0000 7f0285e8c640 1 -- 172.21.15.90:0/3689826088 learned_addr learned my addr 172.21.15.90:0/3689826088 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.870+0000 7f028568b640 1 --2- 172.21.15.90:0/3689826088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02800d1190 0x7f0280161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.870+0000 7f0284e8a640 1 --2- 172.21.15.90:0/3689826088 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02800d16f0 0x7f028015eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.870+0000 7f0285e8c640 1 -- 172.21.15.90:0/3689826088 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02800d16f0 msgr2=0x7f028015eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.870+0000 7f0285e8c640 1 --2- 172.21.15.90:0/3689826088 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02800d16f0 0x7f028015eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.870+0000 7f0285e8c640 1 -- 172.21.15.90:0/3689826088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02800d1190 msgr2=0x7f0280161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:28.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.870+0000 7f0285e8c640 1 --2- 172.21.15.90:0/3689826088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02800d1190 0x7f0280161260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:28.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.870+0000 7f0285e8c640 1 -- 172.21.15.90:0/3689826088 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02801f7d20 con 0x7f028015e310 2024-09-10T23:18:28.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.870+0000 7f0285e8c640 1 --2- 172.21.15.90:0/3689826088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f028015e310 0x7f0280154200 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f027800e940 tx=0x7f027800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:28.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.870+0000 7f027dffb640 1 -- 172.21.15.90:0/3689826088 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027800cd80 con 0x7f028015e310 2024-09-10T23:18:28.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.870+0000 7f02878ef640 1 -- 172.21.15.90:0/3689826088 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02801f8000 con 0x7f028015e310 2024-09-10T23:18:28.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.870+0000 7f027dffb640 1 -- 172.21.15.90:0/3689826088 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0278004030 con 0x7f028015e310 2024-09-10T23:18:28.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.870+0000 7f027dffb640 1 -- 172.21.15.90:0/3689826088 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0278004480 con 0x7f028015e310 2024-09-10T23:18:28.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.870+0000 7f02878ef640 1 -- 172.21.15.90:0/3689826088 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02801f85c0 con 0x7f028015e310 2024-09-10T23:18:28.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.871+0000 7f02878ef640 1 -- 172.21.15.90:0/3689826088 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02800d39a0 con 0x7f028015e310 2024-09-10T23:18:28.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.872+0000 7f027dffb640 1 -- 172.21.15.90:0/3689826088 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f02780035f0 con 0x7f028015e310 2024-09-10T23:18:28.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.872+0000 7f027dffb640 1 --2- 172.21.15.90:0/3689826088 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f026c077f70 0x7f026c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:28.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.872+0000 7f027dffb640 1 -- 172.21.15.90:0/3689826088 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f027809a610 con 0x7f028015e310 2024-09-10T23:18:28.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.873+0000 7f028568b640 1 --2- 172.21.15.90:0/3689826088 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f026c077f70 0x7f026c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:28.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.873+0000 7f028568b640 1 --2- 172.21.15.90:0/3689826088 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f026c077f70 0x7f026c07a430 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0270001e60 tx=0x7f0270009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:28.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:28.876+0000 7f027dffb640 1 -- 172.21.15.90:0/3689826088 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0278062ad0 con 0x7f028015e310 2024-09-10T23:18:29.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.085+0000 7f02878ef640 1 -- 172.21.15.90:0/3689826088 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f02800d4610 con 0x7f028015e310 2024-09-10T23:18:29.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.085+0000 7f027dffb640 1 -- 172.21.15.90:0/3689826088 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v57) ==== 53+0+73 (secure 0 0 0) 0x7f0278067500 con 0x7f028015e310 2024-09-10T23:18:29.087 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:18:29.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.087+0000 7f02878ef640 1 -- 172.21.15.90:0/3689826088 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f026c077f70 msgr2=0x7f026c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:29.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.087+0000 7f02878ef640 1 --2- 172.21.15.90:0/3689826088 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f026c077f70 0x7f026c07a430 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0270001e60 tx=0x7f0270009040 comp rx=0 tx=0).stop 2024-09-10T23:18:29.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.087+0000 7f02878ef640 1 -- 172.21.15.90:0/3689826088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f028015e310 msgr2=0x7f0280154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:29.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.087+0000 7f02878ef640 1 --2- 172.21.15.90:0/3689826088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f028015e310 0x7f0280154200 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f027800e940 tx=0x7f027800ee00 comp rx=0 tx=0).stop 2024-09-10T23:18:29.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.088+0000 7f02878ef640 1 -- 172.21.15.90:0/3689826088 shutdown_connections 2024-09-10T23:18:29.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.088+0000 7f02878ef640 1 --2- 172.21.15.90:0/3689826088 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f026c077f70 0x7f026c07a430 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:29.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.088+0000 7f02878ef640 1 --2- 172.21.15.90:0/3689826088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f028015e310 0x7f0280154200 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:29.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.088+0000 7f02878ef640 1 --2- 172.21.15.90:0/3689826088 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02800d16f0 0x7f028015eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:29.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.088+0000 7f02878ef640 1 --2- 172.21.15.90:0/3689826088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02800d1190 0x7f0280161260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:29.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.088+0000 7f02878ef640 1 -- 172.21.15.90:0/3689826088 >> 172.21.15.90:0/3689826088 conn(0x7f02800d4090 msgr2=0x7f028006d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:29.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.088+0000 7f02878ef640 1 -- 172.21.15.90:0/3689826088 shutdown_connections 2024-09-10T23:18:29.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.088+0000 7f02878ef640 1 -- 172.21.15.90:0/3689826088 wait complete. 2024-09-10T23:18:29.099 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:18:29.099 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:18:29.100 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2024-09-10T23:18:29.100 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:18:29.100 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:18:29.100 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:18:29.100 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:18:29.100 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:18:29.100 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:18:29.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:29.100 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2024-09-10T23:18:29.116 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:18:29.116 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:18:29.116 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:18:29.116 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:29.116 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-10T23:18:29.116 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:29.116 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:29.116 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:29.116 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2024-09-10T23:18:29.116 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:29.117 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:29.117 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2024-09-10T23:18:29.117 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:29.117 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:29.117 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:18:29.117 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:29.117 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:18:29.117 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42539sec preferred_lft 42539sec 2024-09-10T23:18:29.117 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link noprefixroute 2024-09-10T23:18:29.117 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:29.117 INFO:teuthology.orchestra.run.smithi090.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:18:29.117 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:29.117 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:18:29.118 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:29.118 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::882a:a9ff:fefc:893f/64 scope link 2024-09-10T23:18:29.118 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:29.118 INFO:teuthology.orchestra.run.smithi090.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:18:29.118 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 76:ad:51:1a:2a:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:18:29.118 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::74ad:51ff:fe1a:2a60/64 scope link 2024-09-10T23:18:29.118 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:29.118 INFO:teuthology.orchestra.run.smithi090.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:18:29.118 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:18:29.118 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::3414:abff:fe49:366c/64 scope link 2024-09-10T23:18:29.118 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:29.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:29.120 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:18:29.180 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-09-10T23:18:29.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:29.181 DEBUG:teuthology.orchestra.run.smithi090:> route 2024-09-10T23:18:29.237 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2024-09-10T23:18:29.238 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:18:29.238 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:18:29.238 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:18:29.238 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:18:29.238 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:18:29.239 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:18:29.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:18:29.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:18:29.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:18:29.239 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:18:29.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:18:29.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:18:29.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:29.363 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-10T23:18:29.378 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:18:29.378 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:18:29.379 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:18:29.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:29.379 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2024-09-10T23:18:29.444 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:18:29.444 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:18:29.499 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:18:29.499 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:18:29.499 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:18:29.554 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:18:29.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:29.554 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:18:29.637 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:18:29.637 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:18:29.637 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:18:29.646 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:18:29.646 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:18:29.646 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:18:29.646 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:18:29.646 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:18:29.664 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:18:29.664 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:18:29.664 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:18:29.664 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:18:29.664 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:18:29.665 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:18:29.665 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:18:29.665 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:18:29.665 INFO:teuthology.orchestra.run.smithi090.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T23:18:29.665 INFO:teuthology.orchestra.run.smithi090.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:18:29.665 INFO:teuthology.orchestra.run.smithi090.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:18:29.665 INFO:teuthology.orchestra.run.smithi090.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:18:29.665 INFO:teuthology.orchestra.run.smithi090.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:18:29.666 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:18:29.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:29.667 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:18:29.733 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:18:29.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:18:29.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:18:29.840 INFO:teuthology.orchestra.run.smithi090.stdout:client6403 2024-09-10T23:18:29.841 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:18:29.841 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:29.856 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:18:29.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.996+0000 7f7f97aef640 1 -- 172.21.15.90:0/791435510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f900cdb90 msgr2=0x7f7f900cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:29.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.996+0000 7f7f97aef640 1 --2- 172.21.15.90:0/791435510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f900cdb90 0x7f7f900cdfd0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009830 tx=0x7f7f8402a510 comp rx=0 tx=0).stop 2024-09-10T23:18:29.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.996+0000 7f7f97aef640 1 -- 172.21.15.90:0/791435510 shutdown_connections 2024-09-10T23:18:29.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.996+0000 7f7f97aef640 1 --2- 172.21.15.90:0/791435510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f900cdb90 0x7f7f900cdfd0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:29.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.996+0000 7f7f97aef640 1 --2- 172.21.15.90:0/791435510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f9015f750 0x7f7f90073de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:29.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.996+0000 7f7f97aef640 1 -- 172.21.15.90:0/791435510 >> 172.21.15.90:0/791435510 conn(0x7f7f900b19c0 msgr2=0x7f7f900b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:29.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.997+0000 7f7f97aef640 1 -- 172.21.15.90:0/791435510 shutdown_connections 2024-09-10T23:18:29.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.997+0000 7f7f97aef640 1 -- 172.21.15.90:0/791435510 wait complete. 2024-09-10T23:18:30.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.998+0000 7f7f97aef640 1 Processor -- start 2024-09-10T23:18:30.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.998+0000 7f7f97aef640 1 -- start start 2024-09-10T23:18:30.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.998+0000 7f7f97aef640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f9006f550 0x7f7f900c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:30.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.998+0000 7f7f97aef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f900cdb90 0x7f7f901491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:30.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.998+0000 7f7f97aef640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f9015f750 0x7f7f900ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:30.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.998+0000 7f7f97aef640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9006fe40 con 0x7f7f900cdb90 2024-09-10T23:18:30.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.998+0000 7f7f97aef640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9006fcc0 con 0x7f7f9015f750 2024-09-10T23:18:30.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.998+0000 7f7f97aef640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7f901602e0 con 0x7f7f9006f550 2024-09-10T23:18:30.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.999+0000 7f7f9508a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f900cdb90 0x7f7f901491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:30.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.999+0000 7f7f9508a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f900cdb90 0x7f7f901491b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34382/0 (socket says 172.21.15.90:34382) 2024-09-10T23:18:30.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.999+0000 7f7f9508a640 1 -- 172.21.15.90:0/4191170678 learned_addr learned my addr 172.21.15.90:0/4191170678 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:30.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.999+0000 7f7f9588b640 1 --2- 172.21.15.90:0/4191170678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f9006f550 0x7f7f900c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:30.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.999+0000 7f7f9608c640 1 --2- 172.21.15.90:0/4191170678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f9015f750 0x7f7f900ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.999+0000 7f7f9508a640 1 -- 172.21.15.90:0/4191170678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f9006f550 msgr2=0x7f7f900c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.999+0000 7f7f9508a640 1 --2- 172.21.15.90:0/4191170678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f9006f550 0x7f7f900c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.999+0000 7f7f9508a640 1 -- 172.21.15.90:0/4191170678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f9015f750 msgr2=0x7f7f900ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.999+0000 7f7f9508a640 1 --2- 172.21.15.90:0/4191170678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f9015f750 0x7f7f900ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.999+0000 7f7f9508a640 1 -- 172.21.15.90:0/4191170678 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9009cc00 con 0x7f7f900cdb90 2024-09-10T23:18:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.999+0000 7f7f9508a640 1 --2- 172.21.15.90:0/4191170678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f900cdb90 0x7f7f901491b0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009950 tx=0x7f7f84032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.999+0000 7f7f8e7fc640 1 -- 172.21.15.90:0/4191170678 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84040070 con 0x7f7f900cdb90 2024-09-10T23:18:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.999+0000 7f7f8e7fc640 1 -- 172.21.15.90:0/4191170678 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f84032e70 con 0x7f7f900cdb90 2024-09-10T23:18:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.999+0000 7f7f97aef640 1 -- 172.21.15.90:0/4191170678 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f9009cee0 con 0x7f7f900cdb90 2024-09-10T23:18:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.999+0000 7f7f8e7fc640 1 -- 172.21.15.90:0/4191170678 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84003d90 con 0x7f7f900cdb90 2024-09-10T23:18:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:29.999+0000 7f7f97aef640 1 -- 172.21.15.90:0/4191170678 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f9009d4a0 con 0x7f7f900cdb90 2024-09-10T23:18:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.000+0000 7f7f97aef640 1 -- 172.21.15.90:0/4191170678 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f90160870 con 0x7f7f900cdb90 2024-09-10T23:18:30.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.001+0000 7f7f8e7fc640 1 -- 172.21.15.90:0/4191170678 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7f8404d030 con 0x7f7f900cdb90 2024-09-10T23:18:30.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.001+0000 7f7f8e7fc640 1 --2- 172.21.15.90:0/4191170678 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7f7c077f70 0x7f7f7c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:30.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.001+0000 7f7f8e7fc640 1 -- 172.21.15.90:0/4191170678 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f7f840bb1f0 con 0x7f7f900cdb90 2024-09-10T23:18:30.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.001+0000 7f7f9588b640 1 --2- 172.21.15.90:0/4191170678 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7f7c077f70 0x7f7f7c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:30.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.002+0000 7f7f9588b640 1 --2- 172.21.15.90:0/4191170678 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7f7c077f70 0x7f7f7c07a430 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800bb50 tx=0x7f7f8800b2e0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:30.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.005+0000 7f7f8e7fc640 1 -- 172.21.15.90:0/4191170678 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7f840836a0 con 0x7f7f900cdb90 2024-09-10T23:18:30.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.218+0000 7f7f97aef640 1 -- 172.21.15.90:0/4191170678 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7f900af160 con 0x7f7f900cdb90 2024-09-10T23:18:30.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.218+0000 7f7f8e7fc640 1 -- 172.21.15.90:0/4191170678 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v57) ==== 53+0+73 (secure 0 0 0) 0x7f7f840880d0 con 0x7f7f900cdb90 2024-09-10T23:18:30.219 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:18:30.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.220+0000 7f7f97aef640 1 -- 172.21.15.90:0/4191170678 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7f7c077f70 msgr2=0x7f7f7c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:30.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.220+0000 7f7f97aef640 1 --2- 172.21.15.90:0/4191170678 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7f7c077f70 0x7f7f7c07a430 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800bb50 tx=0x7f7f8800b2e0 comp rx=0 tx=0).stop 2024-09-10T23:18:30.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.220+0000 7f7f97aef640 1 -- 172.21.15.90:0/4191170678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f900cdb90 msgr2=0x7f7f901491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:30.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.220+0000 7f7f97aef640 1 --2- 172.21.15.90:0/4191170678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f900cdb90 0x7f7f901491b0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009950 tx=0x7f7f84032c80 comp rx=0 tx=0).stop 2024-09-10T23:18:30.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.220+0000 7f7f97aef640 1 -- 172.21.15.90:0/4191170678 shutdown_connections 2024-09-10T23:18:30.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.220+0000 7f7f97aef640 1 --2- 172.21.15.90:0/4191170678 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7f7c077f70 0x7f7f7c07a430 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:30.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.220+0000 7f7f97aef640 1 --2- 172.21.15.90:0/4191170678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f9015f750 0x7f7f900ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:30.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.220+0000 7f7f97aef640 1 --2- 172.21.15.90:0/4191170678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f900cdb90 0x7f7f901491b0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:30.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.220+0000 7f7f97aef640 1 --2- 172.21.15.90:0/4191170678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f9006f550 0x7f7f900c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:30.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.220+0000 7f7f97aef640 1 -- 172.21.15.90:0/4191170678 >> 172.21.15.90:0/4191170678 conn(0x7f7f900b19c0 msgr2=0x7f7f900cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:30.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.220+0000 7f7f97aef640 1 -- 172.21.15.90:0/4191170678 shutdown_connections 2024-09-10T23:18:30.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:30.220+0000 7f7f97aef640 1 -- 172.21.15.90:0/4191170678 wait complete. 2024-09-10T23:18:30.232 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:18:30.232 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:18:30.232 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-09-10T23:18:30.232 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T23:18:30.232 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T23:18:30.232 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:18:30.232 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:18:30.232 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:18:30.232 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:18:30.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:30.233 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-09-10T23:18:30.252 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:18:30.253 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:18:30.253 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:18:30.253 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:30.253 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-09-10T23:18:30.253 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:30.253 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:30.253 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:30.253 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-09-10T23:18:30.253 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:30.253 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:30.253 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-09-10T23:18:30.254 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:30.254 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:30.254 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:18:30.254 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:30.254 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:18:30.254 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42520sec preferred_lft 42520sec 2024-09-10T23:18:30.254 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link noprefixroute 2024-09-10T23:18:30.254 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:30.254 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:18:30.254 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:30.255 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:18:30.255 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:30.255 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::c18:12ff:fe41:788b/64 scope link 2024-09-10T23:18:30.255 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:30.255 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:18:30.255 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:18:30.255 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a0e4:c6ff:fe48:8d44/64 scope link 2024-09-10T23:18:30.255 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:30.255 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:18:30.255 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a6:c9:8b:0f:78:86 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:18:30.255 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a4c9:8bff:fe0f:7886/64 scope link 2024-09-10T23:18:30.256 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:30.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:30.256 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:18:30.321 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-09-10T23:18:30.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:30.323 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-09-10T23:18:30.382 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-09-10T23:18:30.382 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:18:30.382 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:18:30.382 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:18:30.382 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:18:30.383 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:18:30.383 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:18:30.383 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:18:30.383 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:18:30.383 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:18:30.383 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:18:30.476 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:18:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:18:30.510 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:18:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:18:30.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:30.517 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-09-10T23:18:30.533 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T23:18:30.533 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T23:18:30.533 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:18:30.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:30.533 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-09-10T23:18:30.599 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:18:30.599 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T23:18:30.655 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:18:30.655 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:18:30.655 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:18:30.710 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:18:30.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:30.710 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:18:30.794 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:18:30.794 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:18:30.794 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:18:30.803 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:18:30.803 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:18:30.803 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:18:30.803 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:18:30.803 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:18:30.807 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:18:30.807 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:18:30.808 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:18:30.808 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:18:30.808 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:18:30.808 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:18:30.808 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:18:30.808 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:18:30.808 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T23:18:30.808 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:18:30.809 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:18:30.809 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:18:30.809 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:18:30.810 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:18:30.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:30.810 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:18:30.876 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:18:30.965 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:18:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:18:30.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:18:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:18:30.972 INFO:teuthology.orchestra.run.smithi171.stdout:client6409 2024-09-10T23:18:30.972 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:18:30.973 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:30.988 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:18:30.988 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:31.006 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:18:31.006 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:31.063 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:18:31.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.207+0000 7f08d4233640 1 -- 172.21.15.90:0/3134627394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08cc06d6d0 msgr2=0x7f08cc06e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:31.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.207+0000 7f08d4233640 1 --2- 172.21.15.90:0/3134627394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08cc06d6d0 0x7f08cc06e040 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f08bc005fd0 tx=0x7f08bc02a5c0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.207+0000 7f08d4233640 1 -- 172.21.15.90:0/3134627394 shutdown_connections 2024-09-10T23:18:31.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.207+0000 7f08d4233640 1 --2- 172.21.15.90:0/3134627394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08cc06d6d0 0x7f08cc06e040 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.207+0000 7f08d4233640 1 --2- 172.21.15.90:0/3134627394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08cc15e180 0x7f08cc0d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.207+0000 7f08d4233640 1 -- 172.21.15.90:0/3134627394 >> 172.21.15.90:0/3134627394 conn(0x7f08cc0d4090 msgr2=0x7f08cc0d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:31.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.207+0000 7f08d4233640 1 -- 172.21.15.90:0/3134627394 shutdown_connections 2024-09-10T23:18:31.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.207+0000 7f08d4233640 1 -- 172.21.15.90:0/3134627394 wait complete. 2024-09-10T23:18:31.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.208+0000 7f08d4233640 1 Processor -- start 2024-09-10T23:18:31.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.208+0000 7f08d4233640 1 -- start start 2024-09-10T23:18:31.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.209+0000 7f08d4233640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08cc06d6d0 0x7f08cc15e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:31.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.209+0000 7f08d4233640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08cc06e580 0x7f08cc1505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:31.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.209+0000 7f08d4233640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08cc15e180 0x7f08cc150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:31.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.209+0000 7f08d4233640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc0d2110 con 0x7f08cc06e580 2024-09-10T23:18:31.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.209+0000 7f08d4233640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc0d1f90 con 0x7f08cc15e180 2024-09-10T23:18:31.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.209+0000 7f08d4233640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f08cc162400 con 0x7f08cc06d6d0 2024-09-10T23:18:31.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.209+0000 7f08d17ce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08cc06e580 0x7f08cc1505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:31.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.209+0000 7f08d17ce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08cc06e580 0x7f08cc1505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34412/0 (socket says 172.21.15.90:34412) 2024-09-10T23:18:31.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.209+0000 7f08d17ce640 1 -- 172.21.15.90:0/2485600007 learned_addr learned my addr 172.21.15.90:0/2485600007 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:31.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.209+0000 7f08d27d0640 1 --2- 172.21.15.90:0/2485600007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08cc15e180 0x7f08cc150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:31.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.209+0000 7f08d1fcf640 1 --2- 172.21.15.90:0/2485600007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08cc06d6d0 0x7f08cc15e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:31.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.209+0000 7f08d17ce640 1 -- 172.21.15.90:0/2485600007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08cc06d6d0 msgr2=0x7f08cc15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:31.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.209+0000 7f08d17ce640 1 --2- 172.21.15.90:0/2485600007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08cc06d6d0 0x7f08cc15e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.209+0000 7f08d17ce640 1 -- 172.21.15.90:0/2485600007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08cc15e180 msgr2=0x7f08cc150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:31.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.209+0000 7f08d17ce640 1 --2- 172.21.15.90:0/2485600007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08cc15e180 0x7f08cc150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.209+0000 7f08d17ce640 1 -- 172.21.15.90:0/2485600007 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08cc160160 con 0x7f08cc06e580 2024-09-10T23:18:31.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.209+0000 7f08d17ce640 1 --2- 172.21.15.90:0/2485600007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08cc06e580 0x7f08cc1505e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f08bc006010 tx=0x7f08bc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:31.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.210+0000 7f08c27fc640 1 -- 172.21.15.90:0/2485600007 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc03f070 con 0x7f08cc06e580 2024-09-10T23:18:31.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.210+0000 7f08c27fc640 1 -- 172.21.15.90:0/2485600007 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08bc004890 con 0x7f08cc06e580 2024-09-10T23:18:31.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.210+0000 7f08d4233640 1 -- 172.21.15.90:0/2485600007 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08cc0b6620 con 0x7f08cc06e580 2024-09-10T23:18:31.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.210+0000 7f08c27fc640 1 -- 172.21.15.90:0/2485600007 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc035030 con 0x7f08cc06e580 2024-09-10T23:18:31.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.210+0000 7f08d4233640 1 -- 172.21.15.90:0/2485600007 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08cc1606e0 con 0x7f08cc06e580 2024-09-10T23:18:31.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.211+0000 7f08d4233640 1 -- 172.21.15.90:0/2485600007 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08cc0b6960 con 0x7f08cc06e580 2024-09-10T23:18:31.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.211+0000 7f08c27fc640 1 -- 172.21.15.90:0/2485600007 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f08bc004c80 con 0x7f08cc06e580 2024-09-10T23:18:31.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.212+0000 7f08c27fc640 1 --2- 172.21.15.90:0/2485600007 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f08b0077f70 0x7f08b007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:31.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.212+0000 7f08c27fc640 1 -- 172.21.15.90:0/2485600007 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f08bc0baf80 con 0x7f08cc06e580 2024-09-10T23:18:31.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.212+0000 7f08d1fcf640 1 --2- 172.21.15.90:0/2485600007 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f08b0077f70 0x7f08b007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:31.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.212+0000 7f08d1fcf640 1 --2- 172.21.15.90:0/2485600007 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f08b0077f70 0x7f08b007a430 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f08cc06e0f0 tx=0x7f08c8009060 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:31.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.216+0000 7f08c27fc640 1 -- 172.21.15.90:0/2485600007 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f08bc083430 con 0x7f08cc06e580 2024-09-10T23:18:31.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.402+0000 7f08d4233640 1 -- 172.21.15.90:0/2485600007 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f08cc1629f0 con 0x7f08cc06e580 2024-09-10T23:18:31.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.402+0000 7f08c27fc640 1 -- 172.21.15.90:0/2485600007 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v104) ==== 80+0+0 (secure 0 0 0) 0x7f08bc08c1a0 con 0x7f08cc06e580 2024-09-10T23:18:31.404 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:18:31.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.404+0000 7f08d4233640 1 -- 172.21.15.90:0/2485600007 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f08b0077f70 msgr2=0x7f08b007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:31.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.404+0000 7f08d4233640 1 --2- 172.21.15.90:0/2485600007 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f08b0077f70 0x7f08b007a430 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f08cc06e0f0 tx=0x7f08c8009060 comp rx=0 tx=0).stop 2024-09-10T23:18:31.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.404+0000 7f08d4233640 1 -- 172.21.15.90:0/2485600007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08cc06e580 msgr2=0x7f08cc1505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:31.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.404+0000 7f08d4233640 1 --2- 172.21.15.90:0/2485600007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08cc06e580 0x7f08cc1505e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f08bc006010 tx=0x7f08bc0039e0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.404+0000 7f08d4233640 1 -- 172.21.15.90:0/2485600007 shutdown_connections 2024-09-10T23:18:31.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.404+0000 7f08d4233640 1 --2- 172.21.15.90:0/2485600007 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f08b0077f70 0x7f08b007a430 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.404+0000 7f08d4233640 1 --2- 172.21.15.90:0/2485600007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08cc15e180 0x7f08cc150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.404+0000 7f08d4233640 1 --2- 172.21.15.90:0/2485600007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08cc06e580 0x7f08cc1505e0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.404+0000 7f08d4233640 1 --2- 172.21.15.90:0/2485600007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08cc06d6d0 0x7f08cc15e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.404+0000 7f08d4233640 1 -- 172.21.15.90:0/2485600007 >> 172.21.15.90:0/2485600007 conn(0x7f08cc0d4090 msgr2=0x7f08cc0b6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:31.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.405+0000 7f08d4233640 1 -- 172.21.15.90:0/2485600007 shutdown_connections 2024-09-10T23:18:31.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.405+0000 7f08d4233640 1 -- 172.21.15.90:0/2485600007 wait complete. 2024-09-10T23:18:31.416 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T23:18:31.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:31.416 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T23:18:31.444 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:18:31.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:31.444 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:18:31.499 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:18:31.499 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:31.516 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:18:31.516 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:31.572 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:18:31.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.673+0000 7f6dd9033640 1 -- 172.21.15.90:0/1974420755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd40d1190 msgr2=0x7f6dd40d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:31.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.673+0000 7f6dd9033640 1 --2- 172.21.15.90:0/1974420755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd40d1190 0x7f6dd40d28c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc005fd0 tx=0x7f6dbc02a540 comp rx=0 tx=0).stop 2024-09-10T23:18:31.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.673+0000 7f6dd9033640 1 -- 172.21.15.90:0/1974420755 shutdown_connections 2024-09-10T23:18:31.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.673+0000 7f6dd9033640 1 --2- 172.21.15.90:0/1974420755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dd40d16f0 0x7f6dd40d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.673+0000 7f6dd9033640 1 --2- 172.21.15.90:0/1974420755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd40d1190 0x7f6dd40d28c0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.673+0000 7f6dd9033640 1 -- 172.21.15.90:0/1974420755 >> 172.21.15.90:0/1974420755 conn(0x7f6dd40d4090 msgr2=0x7f6dd40d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:31.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.673+0000 7f6dd9033640 1 -- 172.21.15.90:0/1974420755 shutdown_connections 2024-09-10T23:18:31.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.673+0000 7f6dd9033640 1 -- 172.21.15.90:0/1974420755 wait complete. 2024-09-10T23:18:31.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.674+0000 7f6dd9033640 1 Processor -- start 2024-09-10T23:18:31.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.674+0000 7f6dd9033640 1 -- start start 2024-09-10T23:18:31.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.675+0000 7f6dd9033640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dd40d1190 0x7f6dd4158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:31.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.675+0000 7f6dd9033640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dd40d16f0 0x7f6dd4160d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.675+0000 7f6dd9033640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd415e310 0x7f6dd4161290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.675+0000 7f6dd9033640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd40d3340 con 0x7f6dd415e310 2024-09-10T23:18:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.675+0000 7f6dd9033640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd40d4d90 con 0x7f6dd40d16f0 2024-09-10T23:18:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.675+0000 7f6dd9033640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd40d34c0 con 0x7f6dd40d1190 2024-09-10T23:18:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.675+0000 7f6dd359e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd415e310 0x7f6dd4161290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.675+0000 7f6dd359e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd415e310 0x7f6dd4161290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34440/0 (socket says 172.21.15.90:34440) 2024-09-10T23:18:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.675+0000 7f6dd359e640 1 -- 172.21.15.90:0/4144402636 learned_addr learned my addr 172.21.15.90:0/4144402636 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.675+0000 7f6dd259c640 1 --2- 172.21.15.90:0/4144402636 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dd40d16f0 0x7f6dd4160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.675+0000 7f6dd2d9d640 1 --2- 172.21.15.90:0/4144402636 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dd40d1190 0x7f6dd4158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.676+0000 7f6dd359e640 1 -- 172.21.15.90:0/4144402636 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dd40d1190 msgr2=0x7f6dd4158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.676+0000 7f6dd359e640 1 --2- 172.21.15.90:0/4144402636 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dd40d1190 0x7f6dd4158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.676+0000 7f6dd359e640 1 -- 172.21.15.90:0/4144402636 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dd40d16f0 msgr2=0x7f6dd4160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.676+0000 7f6dd359e640 1 --2- 172.21.15.90:0/4144402636 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dd40d16f0 0x7f6dd4160d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.676+0000 7f6dd359e640 1 -- 172.21.15.90:0/4144402636 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd40b70d0 con 0x7f6dd415e310 2024-09-10T23:18:31.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.676+0000 7f6dd2d9d640 1 --2- 172.21.15.90:0/4144402636 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dd40d1190 0x7f6dd4158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:31.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.676+0000 7f6dd359e640 1 --2- 172.21.15.90:0/4144402636 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd415e310 0x7f6dd4161290 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00d780 tx=0x7f6dcc00dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:31.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.676+0000 7f6dcb7fe640 1 -- 172.21.15.90:0/4144402636 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc017070 con 0x7f6dd415e310 2024-09-10T23:18:31.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.676+0000 7f6dcb7fe640 1 -- 172.21.15.90:0/4144402636 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dcc00de90 con 0x7f6dd415e310 2024-09-10T23:18:31.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.676+0000 7f6dd9033640 1 -- 172.21.15.90:0/4144402636 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd40b73b0 con 0x7f6dd415e310 2024-09-10T23:18:31.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.676+0000 7f6dcb7fe640 1 -- 172.21.15.90:0/4144402636 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc005020 con 0x7f6dd415e310 2024-09-10T23:18:31.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.676+0000 7f6dd9033640 1 -- 172.21.15.90:0/4144402636 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd40b7970 con 0x7f6dd415e310 2024-09-10T23:18:31.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.677+0000 7f6dd9033640 1 -- 172.21.15.90:0/4144402636 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd40d3910 con 0x7f6dd415e310 2024-09-10T23:18:31.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.677+0000 7f6dcb7fe640 1 -- 172.21.15.90:0/4144402636 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6dcc0051c0 con 0x7f6dd415e310 2024-09-10T23:18:31.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.678+0000 7f6dcb7fe640 1 --2- 172.21.15.90:0/4144402636 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6db4077fa0 0x7f6db407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:31.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.678+0000 7f6dcb7fe640 1 -- 172.21.15.90:0/4144402636 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f6dcc099d90 con 0x7f6dd415e310 2024-09-10T23:18:31.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.678+0000 7f6dd2d9d640 1 --2- 172.21.15.90:0/4144402636 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6db4077fa0 0x7f6db407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:31.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.679+0000 7f6dd2d9d640 1 --2- 172.21.15.90:0/4144402636 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6db4077fa0 0x7f6db407a460 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40b60a0 tx=0x7f6dc4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:31.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.682+0000 7f6dcb7fe640 1 -- 172.21.15.90:0/4144402636 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6dcc062240 con 0x7f6dd415e310 2024-09-10T23:18:31.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.866+0000 7f6dd9033640 1 -- 172.21.15.90:0/4144402636 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6dd40b5df0 con 0x7f6dd415e310 2024-09-10T23:18:31.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.867+0000 7f6dcb7fe640 1 -- 172.21.15.90:0/4144402636 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v104) ==== 80+0+0 (secure 0 0 0) 0x7f6dcc066c70 con 0x7f6dd415e310 2024-09-10T23:18:31.868 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-09-10T23:18:31.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.868+0000 7f6dd9033640 1 -- 172.21.15.90:0/4144402636 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6db4077fa0 msgr2=0x7f6db407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:31.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.869+0000 7f6dd9033640 1 --2- 172.21.15.90:0/4144402636 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6db4077fa0 0x7f6db407a460 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40b60a0 tx=0x7f6dc4009040 comp rx=0 tx=0).stop 2024-09-10T23:18:31.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.869+0000 7f6dd9033640 1 -- 172.21.15.90:0/4144402636 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd415e310 msgr2=0x7f6dd4161290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:31.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.869+0000 7f6dd9033640 1 --2- 172.21.15.90:0/4144402636 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd415e310 0x7f6dd4161290 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00d780 tx=0x7f6dcc00dc40 comp rx=0 tx=0).stop 2024-09-10T23:18:31.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.869+0000 7f6dd9033640 1 -- 172.21.15.90:0/4144402636 shutdown_connections 2024-09-10T23:18:31.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.869+0000 7f6dd9033640 1 --2- 172.21.15.90:0/4144402636 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6db4077fa0 0x7f6db407a460 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.869+0000 7f6dd9033640 1 --2- 172.21.15.90:0/4144402636 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dd40d16f0 0x7f6dd4160d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.869+0000 7f6dd9033640 1 --2- 172.21.15.90:0/4144402636 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dd415e310 0x7f6dd4161290 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.869+0000 7f6dd9033640 1 --2- 172.21.15.90:0/4144402636 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dd40d1190 0x7f6dd4158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:31.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.869+0000 7f6dd9033640 1 -- 172.21.15.90:0/4144402636 >> 172.21.15.90:0/4144402636 conn(0x7f6dd40d4090 msgr2=0x7f6dd40b5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:31.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.869+0000 7f6dd9033640 1 -- 172.21.15.90:0/4144402636 shutdown_connections 2024-09-10T23:18:31.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:31.869+0000 7f6dd9033640 1 -- 172.21.15.90:0/4144402636 wait complete. 2024-09-10T23:18:31.880 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T23:18:31.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:31.881 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T23:18:31.909 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:18:31.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:31.910 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T23:18:31.966 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:18:31.969 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:18:32.010 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2024-09-10T23:18:32.010 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2024-09-10T23:18:32.010 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:18:32.010 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2024-09-10T23:18:32.010 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.010 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2024-09-10T23:18:32.010 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.010 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2024-09-10T23:18:32.010 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.010 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2024-09-10T23:18:32.010 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2024-09-10T23:18:32.010 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.011 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2024-09-10T23:18:32.011 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2024-09-10T23:18:32.011 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.011 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:18:32.011 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2024-09-10T23:18:32.011 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.011 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:18:32.011 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:18:32.011 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.011 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2024-09-10T23:18:32.011 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.011 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2024-09-10T23:18:32.011 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2024-09-10T23:18:32.011 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:18:32.012 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:18:32.012 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2024-09-10T23:18:32.012 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:18:32.012 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2024-09-10T23:18:32.012 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:18:32.012 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:18:32.012 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2024-09-10T23:18:32.012 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.012 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:18:32.012 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.012 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2024-09-10T23:18:32.012 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.012 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2024-09-10T23:18:32.012 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.013 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2024-09-10T23:18:32.013 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2024-09-10T23:18:32.013 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2024-09-10T23:18:32.013 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.90,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-09-10T23:18:32.013 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on skipped message = False 2024-09-10T23:18:32.013 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = 1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd 2024-09-10T23:18:32.013 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.013 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2024-09-10T23:18:32.013 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2024-09-10T23:18:32.013 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.013 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2024-09-10T23:18:32.013 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2024-09-10T23:18:32.013 INFO:teuthology.orchestra.run.smithi090.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:18:32.013 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.013 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2024-09-10T23:18:32.014 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2024-09-10T23:18:32.014 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.014 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2024-09-10T23:18:32.014 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2024-09-10T23:18:32.014 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2024-09-10T23:18:32.014 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug trim objects = true 2024-09-10T23:18:32.014 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.014 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2024-09-10T23:18:32.014 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2024-09-10T23:18:32.014 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.014 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:18:32.014 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.014 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2024-09-10T23:18:32.015 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.015 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2024-09-10T23:18:32.015 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.015 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:18:32.015 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2024-09-10T23:18:32.015 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.015 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2024-09-10T23:18:32.015 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2024-09-10T23:18:32.015 INFO:teuthology.orchestra.run.smithi090.stdout: bdev async discard = True 2024-09-10T23:18:32.015 INFO:teuthology.orchestra.run.smithi090.stdout: bdev enable discard = True 2024-09-10T23:18:32.016 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore allocator = bitmap 2024-09-10T23:18:32.016 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2024-09-10T23:18:32.016 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2024-09-10T23:18:32.016 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 1/20 2024-09-10T23:18:32.016 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 1/20 2024-09-10T23:18:32.016 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-10T23:18:32.016 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2024-09-10T23:18:32.016 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 4/10 2024-09-10T23:18:32.016 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:18:32.016 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2024-09-10T23:18:32.016 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:18:32.016 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:18:32.016 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2024-09-10T23:18:32.017 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.017 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2024-09-10T23:18:32.017 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-10T23:18:32.017 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2024-09-10T23:18:32.017 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-10T23:18:32.017 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-10T23:18:32.017 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:18:32.017 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:18:32.017 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2024-09-10T23:18:32.017 INFO:teuthology.orchestra.run.smithi090.stdout: client mount timeout = 30 2024-09-10T23:18:32.017 INFO:teuthology.orchestra.run.smithi090.stdout: debug client = 20 2024-09-10T23:18:32.017 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.017 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2024-09-10T23:18:32.018 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-10T23:18:32.018 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-10T23:18:32.018 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2024-09-10T23:18:32.018 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-10T23:18:32.018 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2024-09-10T23:18:32.018 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2024-09-10T23:18:32.018 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:18:32.018 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2024-09-10T23:18:32.018 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2024-09-10T23:18:32.018 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:18:32.018 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.018 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:18:32.018 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:18:32.018 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:18:32.019 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.019 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:18:32.019 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:18:32.019 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:18:32.019 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.019 INFO:teuthology.orchestra.run.smithi090.stdout: # 1m isn't quite enough 2024-09-10T23:18:32.019 INFO:teuthology.orchestra.run.smithi090.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:18:32.019 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.019 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:18:32.019 INFO:teuthology.orchestra.run.smithi090.stdout: mon down mkfs grace = 300 2024-09-10T23:18:32.019 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:32.019 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2024-09-10T23:18:32.019 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2024-09-10T23:18:32.020 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2024-09-10T23:18:32.020 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2024-09-10T23:18:32.020 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:18:32.020 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:18:32.020 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = "" 2024-09-10T23:18:32.020 INFO:teuthology.orchestra.run.smithi090.stdout: client reconnect stale = True 2024-09-10T23:18:32.020 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2024-09-10T23:18:32.020 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2024-09-10T23:18:32.020 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2024-09-10T23:18:32.020 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-09-10T23:18:32.020 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2024-09-10T23:18:32.020 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2024-09-10T23:18:32.020 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2024-09-10T23:18:32.020 INFO:teuthology.orchestra.run.smithi090.stdout:[mds] 2024-09-10T23:18:32.021 INFO:teuthology.orchestra.run.smithi090.stdout: mds_sessionmap_keys_per_op = 1 2024-09-10T23:18:32.049 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2024-09-10T23:18:32.050 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2024-09-10T23:18:32.050 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:18:32.050 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2024-09-10T23:18:32.050 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.050 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2024-09-10T23:18:32.050 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.050 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2024-09-10T23:18:32.050 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.050 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2024-09-10T23:18:32.050 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2024-09-10T23:18:32.050 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.050 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2024-09-10T23:18:32.050 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2024-09-10T23:18:32.050 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.051 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:18:32.051 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2024-09-10T23:18:32.051 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.051 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:18:32.051 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:18:32.051 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.051 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2024-09-10T23:18:32.051 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.051 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2024-09-10T23:18:32.051 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2024-09-10T23:18:32.051 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:18:32.051 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:18:32.051 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2024-09-10T23:18:32.051 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:18:32.052 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2024-09-10T23:18:32.052 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:18:32.052 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:18:32.052 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2024-09-10T23:18:32.052 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.052 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:18:32.052 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.052 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2024-09-10T23:18:32.052 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.052 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2024-09-10T23:18:32.052 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.052 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2024-09-10T23:18:32.052 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2024-09-10T23:18:32.053 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2024-09-10T23:18:32.053 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = "172.21.15.90,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-09-10T23:18:32.053 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on skipped message = False 2024-09-10T23:18:32.053 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = 1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd 2024-09-10T23:18:32.053 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.053 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2024-09-10T23:18:32.053 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2024-09-10T23:18:32.053 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.053 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2024-09-10T23:18:32.054 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2024-09-10T23:18:32.054 INFO:teuthology.orchestra.run.smithi171.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:18:32.054 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.054 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2024-09-10T23:18:32.054 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2024-09-10T23:18:32.054 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.054 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2024-09-10T23:18:32.054 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2024-09-10T23:18:32.054 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2024-09-10T23:18:32.054 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug trim objects = true 2024-09-10T23:18:32.054 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.054 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2024-09-10T23:18:32.054 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2024-09-10T23:18:32.054 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.054 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:18:32.055 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.055 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2024-09-10T23:18:32.055 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.055 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2024-09-10T23:18:32.055 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.055 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:18:32.055 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2024-09-10T23:18:32.055 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.055 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2024-09-10T23:18:32.055 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2024-09-10T23:18:32.055 INFO:teuthology.orchestra.run.smithi171.stdout: bdev async discard = True 2024-09-10T23:18:32.055 INFO:teuthology.orchestra.run.smithi171.stdout: bdev enable discard = True 2024-09-10T23:18:32.055 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore allocator = bitmap 2024-09-10T23:18:32.055 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2024-09-10T23:18:32.055 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2024-09-10T23:18:32.056 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 1/20 2024-09-10T23:18:32.056 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 1/20 2024-09-10T23:18:32.056 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-10T23:18:32.056 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2024-09-10T23:18:32.056 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 4/10 2024-09-10T23:18:32.056 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:18:32.056 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2024-09-10T23:18:32.056 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:18:32.056 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:18:32.056 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2024-09-10T23:18:32.056 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.056 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2024-09-10T23:18:32.056 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-10T23:18:32.056 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2024-09-10T23:18:32.056 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-09-10T23:18:32.057 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-09-10T23:18:32.057 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:18:32.057 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:18:32.057 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2024-09-10T23:18:32.057 INFO:teuthology.orchestra.run.smithi171.stdout: client mount timeout = 30 2024-09-10T23:18:32.057 INFO:teuthology.orchestra.run.smithi171.stdout: debug client = 20 2024-09-10T23:18:32.057 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.057 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2024-09-10T23:18:32.057 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-10T23:18:32.057 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-09-10T23:18:32.057 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2024-09-10T23:18:32.057 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-09-10T23:18:32.057 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2024-09-10T23:18:32.057 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2024-09-10T23:18:32.058 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:18:32.058 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2024-09-10T23:18:32.058 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2024-09-10T23:18:32.058 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:18:32.058 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.058 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:18:32.058 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:18:32.058 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:18:32.058 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.058 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:18:32.058 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:18:32.058 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:18:32.058 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.058 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2024-09-10T23:18:32.058 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:18:32.058 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.059 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:18:32.059 INFO:teuthology.orchestra.run.smithi171.stdout: mon down mkfs grace = 300 2024-09-10T23:18:32.059 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:18:32.059 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2024-09-10T23:18:32.059 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2024-09-10T23:18:32.059 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = true 2024-09-10T23:18:32.059 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2024-09-10T23:18:32.059 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:18:32.059 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:18:32.059 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = "" 2024-09-10T23:18:32.059 INFO:teuthology.orchestra.run.smithi171.stdout: client reconnect stale = True 2024-09-10T23:18:32.059 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2024-09-10T23:18:32.059 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b] 2024-09-10T23:18:32.059 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c] 2024-09-10T23:18:32.059 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2024-09-10T23:18:32.060 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2024-09-10T23:18:32.060 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2024-09-10T23:18:32.060 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.d] 2024-09-10T23:18:32.060 INFO:teuthology.orchestra.run.smithi171.stdout:[mds] 2024-09-10T23:18:32.060 INFO:teuthology.orchestra.run.smithi171.stdout: mds_sessionmap_keys_per_op = 1 2024-09-10T23:18:32.061 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:18:32.062 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:18:32.062 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:18:32.063 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:18:32.063 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:18:32.063 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:18:32.063 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:18:32.063 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:18:32.072 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:18:32.072 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-10T23:18:32.073 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:18:32.073 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-10T23:18:32.113 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:18:32.114 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-10T23:18:32.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f781e5b4640 1 -- 172.21.15.90:0/3150112177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7818161640 msgr2=0x7f78180d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:32.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f781e5b4640 1 --2- 172.21.15.90:0/3150112177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7818161640 0x7f78180d0da0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f7808009830 tx=0x7f780802a4d0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f781e5b4640 1 -- 172.21.15.90:0/3150112177 shutdown_connections 2024-09-10T23:18:32.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f781e5b4640 1 --2- 172.21.15.90:0/3150112177 >> v2:172.21.15.171:3300/0 conn(0x7f78180d3b60 0x7f78180d12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f781e5b4640 1 --2- 172.21.15.90:0/3150112177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7818161640 0x7f78180d0da0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f781e5b4640 1 -- 172.21.15.90:0/3150112177 >> 172.21.15.90:0/3150112177 conn(0x7f78180690c0 msgr2=0x7f781806db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:32.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f781e5b4640 1 -- 172.21.15.90:0/3150112177 shutdown_connections 2024-09-10T23:18:32.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f781e5b4640 1 -- 172.21.15.90:0/3150112177 wait complete. 2024-09-10T23:18:32.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f2fc12c6640 1 -- 172.21.15.90:0/284735092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fbc156450 msgr2=0x7f2fbc160730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:32.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f2fc12c6640 1 --2- 172.21.15.90:0/284735092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fbc156450 0x7f2fbc160730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2fac005fd0 tx=0x7f2fac02a5d0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f6dcfb89640 1 -- 172.21.15.90:0/623669885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db4004800 msgr2=0x7f6db4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:32.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f6dcfb89640 1 --2- 172.21.15.90:0/623669885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db4004800 0x7f6db4004c80 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80b6370 tx=0x7f6db4005830 comp rx=0 tx=0).stop 2024-09-10T23:18:32.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f6dce126640 1 -- 172.21.15.90:0/623669885 reap_dead start 2024-09-10T23:18:32.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f2fc12c6640 1 -- 172.21.15.90:0/284735092 shutdown_connections 2024-09-10T23:18:32.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f2fc12c6640 1 --2- 172.21.15.90:0/284735092 >> v2:172.21.15.171:3300/0 conn(0x7f2fbc15c570 0x7f2fbc070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f6dcfb89640 1 -- 172.21.15.90:0/623669885 shutdown_connections 2024-09-10T23:18:32.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f6dcfb89640 1 -- 172.21.15.90:0/623669885 >> 172.21.15.90:0/623669885 conn(0x7f6dc80b2eb0 msgr2=0x7f6dc80b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:32.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f2fc12c6640 1 --2- 172.21.15.90:0/284735092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fbc156450 0x7f2fbc160730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.219+0000 7f2fc12c6640 1 -- 172.21.15.90:0/284735092 >> 172.21.15.90:0/284735092 conn(0x7f2fbc06d220 msgr2=0x7f2fbc0b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:32.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.220+0000 7f2fc12c6640 1 -- 172.21.15.90:0/284735092 shutdown_connections 2024-09-10T23:18:32.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.220+0000 7f2fc12c6640 1 -- 172.21.15.90:0/284735092 wait complete. 2024-09-10T23:18:32.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.220+0000 7f6dcfb89640 1 -- 172.21.15.90:0/623669885 shutdown_connections 2024-09-10T23:18:32.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.220+0000 7f6dcfb89640 1 -- 172.21.15.90:0/623669885 wait complete. 2024-09-10T23:18:32.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.220+0000 7f781e5b4640 1 Processor -- start 2024-09-10T23:18:32.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.220+0000 7f781e5b4640 1 -- start start 2024-09-10T23:18:32.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.221+0000 7f781e5b4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78180b3780 0x7f78181532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:32.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.221+0000 7f781e5b4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78180d3b60 0x7f78180cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:32.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.221+0000 7f781e5b4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7818161640 0x7f78180b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:32.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.221+0000 7f781e5b4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7818161fb0 con 0x7f78180b3780 2024-09-10T23:18:32.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.221+0000 7f781e5b4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f78180b6520 con 0x7f7818161640 2024-09-10T23:18:32.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.221+0000 7f781e5b4640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f78180cc9f0 con 0x7f78180d3b60 2024-09-10T23:18:32.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.221+0000 7f7817fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78180b3780 0x7f78181532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:32.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.221+0000 7f7817fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78180b3780 0x7f78181532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34464/0 (socket says 172.21.15.90:34464) 2024-09-10T23:18:32.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.221+0000 7f7817fff640 1 -- 172.21.15.90:0/1472137374 learned_addr learned my addr 172.21.15.90:0/1472137374 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:32.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.221+0000 7f781cb51640 1 --2- 172.21.15.90:0/1472137374 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7818161640 0x7f78180b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:32.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.221+0000 7f78177fe640 1 --2- 172.21.15.90:0/1472137374 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78180d3b60 0x7f78180cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:32.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.222+0000 7f2fc12c6640 1 Processor -- start 2024-09-10T23:18:32.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.222+0000 7f7817fff640 1 -- 172.21.15.90:0/1472137374 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78180d3b60 msgr2=0x7f78180cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:32.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.222+0000 7f7817fff640 1 --2- 172.21.15.90:0/1472137374 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78180d3b60 0x7f78180cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.222+0000 7f7817fff640 1 -- 172.21.15.90:0/1472137374 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7818161640 msgr2=0x7f78180b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:32.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.222+0000 7f7817fff640 1 --2- 172.21.15.90:0/1472137374 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7818161640 0x7f78180b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.222+0000 7f7817fff640 1 -- 172.21.15.90:0/1472137374 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78180ccc50 con 0x7f78180b3780 2024-09-10T23:18:32.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.222+0000 7f781cb51640 1 --2- 172.21.15.90:0/1472137374 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7818161640 0x7f78180b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:18:32.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.222+0000 7f2fc12c6640 1 -- start start 2024-09-10T23:18:32.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.222+0000 7f7817fff640 1 --2- 172.21.15.90:0/1472137374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78180b3780 0x7f78181532d0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f7808009950 tx=0x7f7808033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:32.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.222+0000 7f6dcfb89640 1 Processor -- start 2024-09-10T23:18:32.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.222+0000 7f6dcfb89640 1 -- start start 2024-09-10T23:18:32.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.222+0000 7f7814ff9640 1 -- 172.21.15.90:0/1472137374 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7808031d60 con 0x7f78180b3780 2024-09-10T23:18:32.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.222+0000 7f7814ff9640 1 -- 172.21.15.90:0/1472137374 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7808033070 con 0x7f78180b3780 2024-09-10T23:18:32.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.222+0000 7f781e5b4640 1 -- 172.21.15.90:0/1472137374 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78180ccf30 con 0x7f78180b3780 2024-09-10T23:18:32.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.222+0000 7f7814ff9640 1 -- 172.21.15.90:0/1472137374 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78080334c0 con 0x7f78180b3780 2024-09-10T23:18:32.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.222+0000 7f781e5b4640 1 -- 172.21.15.90:0/1472137374 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78180cd4f0 con 0x7f78180b3780 2024-09-10T23:18:32.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.223+0000 7f2fc12c6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fbc156450 0x7f2fbc15b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:32.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.223+0000 7f2fc12c6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fbc156830 0x7f2fbc15b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:32.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.223+0000 7f2fc12c6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fbc15c570 0x7f2fbc0b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:32.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.223+0000 7f2fb27fc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fbc156830 0x7f2fbc15b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:32.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.223+0000 7f2fb27fc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fbc156830 0x7f2fbc15b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.90:35830/0 (socket says 172.21.15.90:35830) 2024-09-10T23:18:32.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.223+0000 7f2fb27fc640 1 -- 172.21.15.90:0/2475760503 learned_addr learned my addr 172.21.15.90:0/2475760503 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:32.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.223+0000 7f6dcfb89640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db4004800 0x7f6dc80c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:32.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.223+0000 7f2fc12c6640 1 -- 172.21.15.90:0/2475760503 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc0d1550 con 0x7f2fbc15c570 2024-09-10T23:18:32.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.223+0000 7f6dcfb89640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dc8151bf0 0x7f6dc806cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:32.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.223+0000 7f2fc12c6640 1 -- 172.21.15.90:0/2475760503 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc0d13d0 con 0x7f2fbc156450 2024-09-10T23:18:32.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.223+0000 7f6dcfb89640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dc806d0b0 0x7f6dc8158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:32.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.223+0000 7f2fc12c6640 1 -- 172.21.15.90:0/2475760503 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2fbc0d16d0 con 0x7f2fbc156830 2024-09-10T23:18:32.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.223+0000 7f2fbaffd640 1 --2- 172.21.15.90:0/2475760503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fbc156450 0x7f2fbc15b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:32.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.223+0000 7f6dcfb89640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8074b60 con 0x7f6db4004800 2024-09-10T23:18:32.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.223+0000 7f6dcfb89640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc80749e0 con 0x7f6dc8151bf0 2024-09-10T23:18:32.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.223+0000 7f6dcfb89640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc80b48c0 con 0x7f6dc806d0b0 2024-09-10T23:18:32.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.223+0000 7f781e5b4640 1 -- 172.21.15.90:0/1472137374 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78180b6a40 con 0x7f78180b3780 2024-09-10T23:18:32.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f6dcd124640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dc8151bf0 0x7f6dc806cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:32.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f6dcd124640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dc8151bf0 0x7f6dc806cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.90:49428/0 (socket says 172.21.15.90:49428) 2024-09-10T23:18:32.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f6dcd124640 1 -- 172.21.15.90:0/1761558967 learned_addr learned my addr 172.21.15.90:0/1761558967 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:32.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f6dce126640 1 --2- 172.21.15.90:0/1761558967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dc806d0b0 0x7f6dc8158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:32.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f6dcd925640 1 --2- 172.21.15.90:0/1761558967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db4004800 0x7f6dc80c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:32.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f6dcd124640 1 -- 172.21.15.90:0/1761558967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dc806d0b0 msgr2=0x7f6dc8158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:32.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f2fbb7fe640 1 --2- 172.21.15.90:0/2475760503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fbc15c570 0x7f2fbc0b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:32.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f2fbaffd640 1 -- 172.21.15.90:0/2475760503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fbc156830 msgr2=0x7f2fbc15b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:32.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f2fbaffd640 1 --2- 172.21.15.90:0/2475760503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fbc156830 0x7f2fbc15b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f2fbaffd640 1 -- 172.21.15.90:0/2475760503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fbc15c570 msgr2=0x7f2fbc0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:32.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f2fbaffd640 1 --2- 172.21.15.90:0/2475760503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fbc15c570 0x7f2fbc0b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f2fbaffd640 1 -- 172.21.15.90:0/2475760503 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fbc1f60b0 con 0x7f2fbc156450 2024-09-10T23:18:32.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f6dcd124640 1 --2- 172.21.15.90:0/1761558967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dc806d0b0 0x7f6dc8158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f6dcd124640 1 -- 172.21.15.90:0/1761558967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db4004800 msgr2=0x7f6dc80c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:32.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f6dcd124640 1 --2- 172.21.15.90:0/1761558967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db4004800 0x7f6dc80c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f6dcd124640 1 -- 172.21.15.90:0/1761558967 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc81f6460 con 0x7f6dc8151bf0 2024-09-10T23:18:32.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f6dce126640 1 --2- 172.21.15.90:0/1761558967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dc806d0b0 0x7f6dc8158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:18:32.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f2fbaffd640 1 --2- 172.21.15.90:0/2475760503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fbc156450 0x7f2fbc15b440 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2fac031000 tx=0x7f2fac005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:32.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f6dcd124640 1 --2- 172.21.15.90:0/1761558967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dc8151bf0 0x7f6dc806cb70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6db802b0a0 tx=0x7f6db8001d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:32.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f2fb3fff640 1 -- 172.21.15.90:0/2475760503 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac035040 con 0x7f2fbc156450 2024-09-10T23:18:32.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f2fb3fff640 1 -- 172.21.15.90:0/2475760503 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2fac040cf0 con 0x7f2fbc156450 2024-09-10T23:18:32.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f2fc12c6640 1 -- 172.21.15.90:0/2475760503 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fbc1f6390 con 0x7f2fbc156450 2024-09-10T23:18:32.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f2fb3fff640 1 -- 172.21.15.90:0/2475760503 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac003950 con 0x7f2fbc156450 2024-09-10T23:18:32.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.224+0000 7f6dbe7fc640 1 -- 172.21.15.90:0/1761558967 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db80037f0 con 0x7f6dc8151bf0 2024-09-10T23:18:32.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.225+0000 7f2fc12c6640 1 -- 172.21.15.90:0/2475760503 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fbc1f6c30 con 0x7f2fbc156450 2024-09-10T23:18:32.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.225+0000 7f6dbe7fc640 1 -- 172.21.15.90:0/1761558967 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6db8003a80 con 0x7f6dc8151bf0 2024-09-10T23:18:32.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.225+0000 7f6dbe7fc640 1 -- 172.21.15.90:0/1761558967 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db802e480 con 0x7f6dc8151bf0 2024-09-10T23:18:32.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.225+0000 7f7814ff9640 1 -- 172.21.15.90:0/1472137374 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f780804b030 con 0x7f78180b3780 2024-09-10T23:18:32.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.225+0000 7f6dcfb89640 1 -- 172.21.15.90:0/1761558967 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc81f6740 con 0x7f6dc8151bf0 2024-09-10T23:18:32.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.225+0000 7f6dcfb89640 1 -- 172.21.15.90:0/1761558967 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc81f6d00 con 0x7f6dc8151bf0 2024-09-10T23:18:32.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.225+0000 7f7814ff9640 1 --2- 172.21.15.90:0/1472137374 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7804077fa0 0x7f780407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:32.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.226+0000 7f7814ff9640 1 -- 172.21.15.90:0/1472137374 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f78080bac70 con 0x7f78180b3780 2024-09-10T23:18:32.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.226+0000 7f6dcfb89640 1 -- 172.21.15.90:0/1761558967 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc806d4c0 con 0x7f6dc8151bf0 2024-09-10T23:18:32.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.226+0000 7f78177fe640 1 --2- 172.21.15.90:0/1472137374 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7804077fa0 0x7f780407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:32.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.226+0000 7f2fc12c6640 1 -- 172.21.15.90:0/2475760503 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fbc160730 con 0x7f2fbc156450 2024-09-10T23:18:32.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.226+0000 7f78177fe640 1 --2- 172.21.15.90:0/1472137374 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7804077fa0 0x7f780407a460 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f780c007fd0 tx=0x7f780c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:32.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.227+0000 7f6dbe7fc640 1 -- 172.21.15.90:0/1761558967 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6db8040020 con 0x7f6dc8151bf0 2024-09-10T23:18:32.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.227+0000 7f2fb3fff640 1 -- 172.21.15.90:0/2475760503 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2fac003af0 con 0x7f2fbc156450 2024-09-10T23:18:32.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.227+0000 7f6dbe7fc640 1 --2- 172.21.15.90:0/1761558967 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6dac077f70 0x7f6dac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:32.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.227+0000 7f6dbe7fc640 1 -- 172.21.15.90:0/1761558967 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f6db80ba660 con 0x7f6dc8151bf0 2024-09-10T23:18:32.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.227+0000 7f6dcd925640 1 --2- 172.21.15.90:0/1761558967 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6dac077f70 0x7f6dac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:32.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.227+0000 7f2fb3fff640 1 --2- 172.21.15.90:0/2475760503 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2f9c077f70 0x7f2f9c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:32.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.228+0000 7f2fb3fff640 1 -- 172.21.15.90:0/2475760503 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f2fac0c2830 con 0x7f2fbc156450 2024-09-10T23:18:32.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.228+0000 7f2fb27fc640 1 --2- 172.21.15.90:0/2475760503 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2f9c077f70 0x7f2f9c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:32.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.228+0000 7f6dcd925640 1 --2- 172.21.15.90:0/1761558967 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6dac077f70 0x7f6dac07a430 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6dc806dc30 tx=0x7f6dc4005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:32.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.228+0000 7f2fb27fc640 1 --2- 172.21.15.90:0/2475760503 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2f9c077f70 0x7f2f9c07a430 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc15ebe0 tx=0x7f2fa4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:32.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.231+0000 7f7814ff9640 1 -- 172.21.15.90:0/1472137374 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f780803f030 con 0x7f78180b3780 2024-09-10T23:18:32.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.231+0000 7f6dbe7fc640 1 -- 172.21.15.90:0/1761558967 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6dc806d4c0 con 0x7f6dc8151bf0 2024-09-10T23:18:32.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.235+0000 7f2fb3fff640 1 -- 172.21.15.90:0/2475760503 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2fac08b3c0 con 0x7f2fbc156450 2024-09-10T23:18:32.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.485+0000 7f6dcfb89640 1 -- 172.21.15.90:0/1761558967 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f6dc8159f20 con 0x7f6dc8151bf0 2024-09-10T23:18:32.487 INFO:tasks.ceph.mon.a.smithi090.stderr:2024-09-10T23:18:32.486+0000 7f1a0c84c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:18:32.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.491+0000 7f6dbe7fc640 1 -- 172.21.15.90:0/1761558967 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 7068 v58) ==== 95+0+0 (secure 0 0 0) 0x7f6db8082bf0 con 0x7f6dc8151bf0 2024-09-10T23:18:32.492 INFO:teuthology.orchestra.run.smithi090.stderr:failed mds gid 7068 2024-09-10T23:18:32.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.493+0000 7f2fc12c6640 1 -- 172.21.15.90:0/2475760503 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f2fbc1f6560 con 0x7f2fbc156450 2024-09-10T23:18:32.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.494+0000 7f6dcfb89640 1 -- 172.21.15.90:0/1761558967 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6dac077f70 msgr2=0x7f6dac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:32.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.494+0000 7f6dcfb89640 1 --2- 172.21.15.90:0/1761558967 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6dac077f70 0x7f6dac07a430 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6dc806dc30 tx=0x7f6dc4005f90 comp rx=0 tx=0).stop 2024-09-10T23:18:32.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.494+0000 7f6dcfb89640 1 -- 172.21.15.90:0/1761558967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dc8151bf0 msgr2=0x7f6dc806cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:32.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.494+0000 7f6dcfb89640 1 --2- 172.21.15.90:0/1761558967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dc8151bf0 0x7f6dc806cb70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6db802b0a0 tx=0x7f6db8001d30 comp rx=0 tx=0).stop 2024-09-10T23:18:32.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.494+0000 7f6dcfb89640 1 -- 172.21.15.90:0/1761558967 shutdown_connections 2024-09-10T23:18:32.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.494+0000 7f6dcfb89640 1 --2- 172.21.15.90:0/1761558967 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6dac077f70 0x7f6dac07a430 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.494+0000 7f6dcfb89640 1 --2- 172.21.15.90:0/1761558967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dc8151bf0 0x7f6dc806cb70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.494+0000 7f6dcfb89640 1 --2- 172.21.15.90:0/1761558967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dc806d0b0 0x7f6dc8158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.494+0000 7f6dcfb89640 1 --2- 172.21.15.90:0/1761558967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db4004800 0x7f6dc80c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.494+0000 7f6dcfb89640 1 -- 172.21.15.90:0/1761558967 >> 172.21.15.90:0/1761558967 conn(0x7f6dc80b2eb0 msgr2=0x7f6dc80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:32.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.494+0000 7f6dcfb89640 1 -- 172.21.15.90:0/1761558967 shutdown_connections 2024-09-10T23:18:32.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.494+0000 7f6dcfb89640 1 -- 172.21.15.90:0/1761558967 wait complete. 2024-09-10T23:18:32.496 INFO:tasks.ceph.mon.a.smithi090.stderr:2024-09-10T23:18:32.495+0000 7f1a0c84c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:18:32.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.496+0000 7f781e5b4640 1 -- 172.21.15.90:0/1472137374 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f78180ba310 con 0x7f78180b3780 2024-09-10T23:18:32.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.500+0000 7f2fb3fff640 1 -- 172.21.15.90:0/2475760503 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7053 v60) ==== 95+0+0 (secure 0 0 0) 0x7f2fac08acc0 con 0x7f2fbc156450 2024-09-10T23:18:32.501 INFO:teuthology.orchestra.run.smithi090.stderr:failed mds gid 7053 2024-09-10T23:18:32.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.501+0000 7f7814ff9640 1 -- 172.21.15.90:0/1472137374 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7050 v61) ==== 95+0+0 (secure 0 0 0) 0x7f78080831b0 con 0x7f78180b3780 2024-09-10T23:18:32.502 INFO:teuthology.orchestra.run.smithi090.stderr:failed mds gid 7050 2024-09-10T23:18:32.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.504+0000 7f2fc12c6640 1 -- 172.21.15.90:0/2475760503 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2f9c077f70 msgr2=0x7f2f9c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:32.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.504+0000 7f2fc12c6640 1 --2- 172.21.15.90:0/2475760503 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2f9c077f70 0x7f2f9c07a430 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc15ebe0 tx=0x7f2fa4009040 comp rx=0 tx=0).stop 2024-09-10T23:18:32.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.504+0000 7f2fc12c6640 1 -- 172.21.15.90:0/2475760503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fbc156450 msgr2=0x7f2fbc15b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:32.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.504+0000 7f2fc12c6640 1 --2- 172.21.15.90:0/2475760503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fbc156450 0x7f2fbc15b440 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2fac031000 tx=0x7f2fac005770 comp rx=0 tx=0).stop 2024-09-10T23:18:32.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f2fc12c6640 1 -- 172.21.15.90:0/2475760503 shutdown_connections 2024-09-10T23:18:32.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f2fc12c6640 1 --2- 172.21.15.90:0/2475760503 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2f9c077f70 0x7f2f9c07a430 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f2fc12c6640 1 --2- 172.21.15.90:0/2475760503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fbc15c570 0x7f2fbc0b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f2fc12c6640 1 --2- 172.21.15.90:0/2475760503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fbc156830 0x7f2fbc15b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f2fc12c6640 1 --2- 172.21.15.90:0/2475760503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fbc156450 0x7f2fbc15b440 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f2fc12c6640 1 -- 172.21.15.90:0/2475760503 >> 172.21.15.90:0/2475760503 conn(0x7f2fbc06d220 msgr2=0x7f2fbc15a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:32.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f781e5b4640 1 -- 172.21.15.90:0/1472137374 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7804077fa0 msgr2=0x7f780407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:32.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f781e5b4640 1 --2- 172.21.15.90:0/1472137374 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7804077fa0 0x7f780407a460 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f780c007fd0 tx=0x7f780c009040 comp rx=0 tx=0).stop 2024-09-10T23:18:32.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f781e5b4640 1 -- 172.21.15.90:0/1472137374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78180b3780 msgr2=0x7f78181532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:32.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f781e5b4640 1 --2- 172.21.15.90:0/1472137374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78180b3780 0x7f78181532d0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f7808009950 tx=0x7f7808033d60 comp rx=0 tx=0).stop 2024-09-10T23:18:32.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f781e5b4640 1 -- 172.21.15.90:0/1472137374 shutdown_connections 2024-09-10T23:18:32.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f781e5b4640 1 --2- 172.21.15.90:0/1472137374 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7804077fa0 0x7f780407a460 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f781e5b4640 1 --2- 172.21.15.90:0/1472137374 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7818161640 0x7f78180b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f781e5b4640 1 --2- 172.21.15.90:0/1472137374 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78180d3b60 0x7f78180cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f781e5b4640 1 --2- 172.21.15.90:0/1472137374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78180b3780 0x7f78181532d0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:32.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f781e5b4640 1 -- 172.21.15.90:0/1472137374 >> 172.21.15.90:0/1472137374 conn(0x7f78180690c0 msgr2=0x7f78180ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:32.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f2fc12c6640 1 -- 172.21.15.90:0/2475760503 shutdown_connections 2024-09-10T23:18:32.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f781e5b4640 1 -- 172.21.15.90:0/1472137374 shutdown_connections 2024-09-10T23:18:32.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f781e5b4640 1 -- 172.21.15.90:0/1472137374 wait complete. 2024-09-10T23:18:32.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:32.505+0000 7f2fc12c6640 1 -- 172.21.15.90:0/2475760503 wait complete. 2024-09-10T23:18:32.509 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:18:32.509 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:18:32.511 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:18:32.512 DEBUG:teuthology.parallel:result is None 2024-09-10T23:18:32.519 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:18:32.519 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:18:32.520 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:18:32.520 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:18:32.561 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:18:32.561 DEBUG:teuthology.parallel:result is None 2024-09-10T23:18:32.562 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:18:32.562 DEBUG:teuthology.parallel:result is None 2024-09-10T23:18:32.584 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-09-10T23:18:32.636 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-09-10T23:18:32.636 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-09-10T23:18:34.779 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-10T23:18:38.114 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:18:38.114 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-10T23:18:38.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.229+0000 7f2dddf32640 1 -- 172.21.15.90:0/4090701874 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd80cf2b0 msgr2=0x7f2dd806ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:38.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.229+0000 7f2dddf32640 1 --2- 172.21.15.90:0/4090701874 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd80cf2b0 0x7f2dd806ea40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2dd815cf20 tx=0x7f2dd002a890 comp rx=0 tx=0).stop 2024-09-10T23:18:38.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.229+0000 7f2dddf32640 1 -- 172.21.15.90:0/4090701874 shutdown_connections 2024-09-10T23:18:38.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.229+0000 7f2dddf32640 1 --2- 172.21.15.90:0/4090701874 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd80cf2b0 0x7f2dd806ea40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:38.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.229+0000 7f2dddf32640 1 --2- 172.21.15.90:0/4090701874 >> v2:172.21.15.171:3300/0 conn(0x7f2dd815d230 0x7f2dd80ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:38.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.229+0000 7f2dddf32640 1 -- 172.21.15.90:0/4090701874 >> 172.21.15.90:0/4090701874 conn(0x7f2dd806cb70 msgr2=0x7f2dd806cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:38.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.229+0000 7f2dddf32640 1 -- 172.21.15.90:0/4090701874 shutdown_connections 2024-09-10T23:18:38.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.229+0000 7f2dddf32640 1 -- 172.21.15.90:0/4090701874 wait complete. 2024-09-10T23:18:38.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.231+0000 7f2dddf32640 1 Processor -- start 2024-09-10T23:18:38.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.231+0000 7f2dddf32640 1 -- start start 2024-09-10T23:18:38.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dddf32640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd80cf2b0 0x7f2dd814a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:38.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dddf32640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd8156650 0x7f2dd8151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:38.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dddf32640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd815d230 0x7f2dd8138390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:38.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dddf32640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd806f100 con 0x7f2dd80cf2b0 2024-09-10T23:18:38.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dddf32640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd806ef80 con 0x7f2dd8156650 2024-09-10T23:18:38.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dddf32640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd806f280 con 0x7f2dd815d230 2024-09-10T23:18:38.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dd77fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd80cf2b0 0x7f2dd814a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:38.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dd77fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd80cf2b0 0x7f2dd814a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34402/0 (socket says 172.21.15.90:34402) 2024-09-10T23:18:38.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dd77fe640 1 -- 172.21.15.90:0/1121052441 learned_addr learned my addr 172.21.15.90:0/1121052441 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:38.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dd6ffd640 1 --2- 172.21.15.90:0/1121052441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd8156650 0x7f2dd8151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:38.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dd7fff640 1 --2- 172.21.15.90:0/1121052441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd815d230 0x7f2dd8138390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:38.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dd77fe640 1 -- 172.21.15.90:0/1121052441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd815d230 msgr2=0x7f2dd8138390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:38.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dd77fe640 1 --2- 172.21.15.90:0/1121052441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd815d230 0x7f2dd8138390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:38.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dd77fe640 1 -- 172.21.15.90:0/1121052441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd8156650 msgr2=0x7f2dd8151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:38.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dd77fe640 1 --2- 172.21.15.90:0/1121052441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd8156650 0x7f2dd8151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:38.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dd77fe640 1 -- 172.21.15.90:0/1121052441 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd814ffe0 con 0x7f2dd80cf2b0 2024-09-10T23:18:38.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dd77fe640 1 --2- 172.21.15.90:0/1121052441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd80cf2b0 0x7f2dd814a460 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800c450 tx=0x7f2dc800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:38.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dbffff640 1 -- 172.21.15.90:0/1121052441 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8017070 con 0x7f2dd80cf2b0 2024-09-10T23:18:38.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dbffff640 1 -- 172.21.15.90:0/1121052441 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2dc80053c0 con 0x7f2dd80cf2b0 2024-09-10T23:18:38.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dddf32640 1 -- 172.21.15.90:0/1121052441 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd81502c0 con 0x7f2dd80cf2b0 2024-09-10T23:18:38.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dbffff640 1 -- 172.21.15.90:0/1121052441 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8003850 con 0x7f2dd80cf2b0 2024-09-10T23:18:38.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.232+0000 7f2dddf32640 1 -- 172.21.15.90:0/1121052441 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd8150880 con 0x7f2dd80cf2b0 2024-09-10T23:18:38.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.234+0000 7f2dddf32640 1 -- 172.21.15.90:0/1121052441 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd806f7c0 con 0x7f2dd80cf2b0 2024-09-10T23:18:38.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.234+0000 7f2dbffff640 1 -- 172.21.15.90:0/1121052441 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2dc80039f0 con 0x7f2dd80cf2b0 2024-09-10T23:18:38.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.235+0000 7f2dbffff640 1 --2- 172.21.15.90:0/1121052441 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2dc4077f70 0x7f2dc407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:38.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.235+0000 7f2dbffff640 1 -- 172.21.15.90:0/1121052441 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5881+0+0 (secure 0 0 0) 0x7f2dc8099440 con 0x7f2dd80cf2b0 2024-09-10T23:18:38.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.235+0000 7f2dd6ffd640 1 --2- 172.21.15.90:0/1121052441 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2dc4077f70 0x7f2dc407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:38.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.235+0000 7f2dd6ffd640 1 --2- 172.21.15.90:0/1121052441 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2dc4077f70 0x7f2dc407a430 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2dd81560f0 tx=0x7f2dcc009260 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:38.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.239+0000 7f2dbffff640 1 -- 172.21.15.90:0/1121052441 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2dc8061f20 con 0x7f2dd80cf2b0 2024-09-10T23:18:38.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.484+0000 7f2dddf32640 1 -- 172.21.15.90:0/1121052441 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f2dd8069d80 con 0x7f2dd80cf2b0 2024-09-10T23:18:38.485 INFO:tasks.ceph.mon.a.smithi090.stderr:2024-09-10T23:18:38.484+0000 7f1a0c84c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:18:38.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.486+0000 7f2dbffff640 1 -- 172.21.15.90:0/1121052441 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5948 v63) ==== 95+0+0 (secure 0 0 0) 0x7f2dc8061820 con 0x7f2dd80cf2b0 2024-09-10T23:18:38.486 INFO:teuthology.orchestra.run.smithi090.stderr:failed mds gid 5948 2024-09-10T23:18:38.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.488+0000 7f2dddf32640 1 -- 172.21.15.90:0/1121052441 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2dc4077f70 msgr2=0x7f2dc407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:38.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.488+0000 7f2dddf32640 1 --2- 172.21.15.90:0/1121052441 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2dc4077f70 0x7f2dc407a430 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2dd81560f0 tx=0x7f2dcc009260 comp rx=0 tx=0).stop 2024-09-10T23:18:38.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.488+0000 7f2dddf32640 1 -- 172.21.15.90:0/1121052441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd80cf2b0 msgr2=0x7f2dd814a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:38.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.488+0000 7f2dddf32640 1 --2- 172.21.15.90:0/1121052441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd80cf2b0 0x7f2dd814a460 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800c450 tx=0x7f2dc800c910 comp rx=0 tx=0).stop 2024-09-10T23:18:38.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.488+0000 7f2dddf32640 1 -- 172.21.15.90:0/1121052441 shutdown_connections 2024-09-10T23:18:38.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.488+0000 7f2dddf32640 1 --2- 172.21.15.90:0/1121052441 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2dc4077f70 0x7f2dc407a430 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:38.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.488+0000 7f2dddf32640 1 --2- 172.21.15.90:0/1121052441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dd8156650 0x7f2dd8151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:38.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.488+0000 7f2dddf32640 1 --2- 172.21.15.90:0/1121052441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dd815d230 0x7f2dd8138390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:38.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.488+0000 7f2dddf32640 1 --2- 172.21.15.90:0/1121052441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dd80cf2b0 0x7f2dd814a460 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:38.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.488+0000 7f2dddf32640 1 -- 172.21.15.90:0/1121052441 >> 172.21.15.90:0/1121052441 conn(0x7f2dd806cb70 msgr2=0x7f2dd80cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:38.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.488+0000 7f2dddf32640 1 -- 172.21.15.90:0/1121052441 shutdown_connections 2024-09-10T23:18:38.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.488+0000 7f2dddf32640 1 -- 172.21.15.90:0/1121052441 wait complete. 2024-09-10T23:18:38.502 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:18:38.503 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:18:38.505 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:18:38.505 DEBUG:teuthology.parallel:result is None 2024-09-10T23:18:38.505 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:38.583 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-09-10T23:18:38.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.607+0000 7f5762132640 1 -- 172.21.15.90:0/1383668756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f575c074070 msgr2=0x7f575c0b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:38.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.607+0000 7f5762132640 1 --2- 172.21.15.90:0/1383668756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f575c074070 0x7f575c0b3a30 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f574c005fd0 tx=0x7f574c02a5d0 comp rx=0 tx=0).stop 2024-09-10T23:18:38.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.607+0000 7f5762132640 1 -- 172.21.15.90:0/1383668756 shutdown_connections 2024-09-10T23:18:38.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.607+0000 7f5762132640 1 --2- 172.21.15.90:0/1383668756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f575c074070 0x7f575c0b3a30 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:38.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.607+0000 7f5762132640 1 -- 172.21.15.90:0/1383668756 >> 172.21.15.90:0/1383668756 conn(0x7f575c06cb70 msgr2=0x7f575c06cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:38.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.607+0000 7f5762132640 1 -- 172.21.15.90:0/1383668756 shutdown_connections 2024-09-10T23:18:38.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.607+0000 7f5762132640 1 -- 172.21.15.90:0/1383668756 wait complete. 2024-09-10T23:18:38.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.608+0000 7f5762132640 1 Processor -- start 2024-09-10T23:18:38.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.608+0000 7f5762132640 1 -- start start 2024-09-10T23:18:38.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.609+0000 7f5762132640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f575c074070 0x7f575c1558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.609+0000 7f5762132640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f575c074450 0x7f575c14cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.609+0000 7f5762132640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f575c15e920 0x7f575c1f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.609+0000 7f5762132640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f575c0cea90 con 0x7f575c074070 2024-09-10T23:18:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.609+0000 7f5762132640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f575c0ce910 con 0x7f575c15e920 2024-09-10T23:18:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.609+0000 7f5762132640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f575c0cec10 con 0x7f575c074450 2024-09-10T23:18:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.609+0000 7f575b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f575c074070 0x7f575c1558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.609+0000 7f575b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f575c074070 0x7f575c1558b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34426/0 (socket says 172.21.15.90:34426) 2024-09-10T23:18:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.609+0000 7f575b7fe640 1 -- 172.21.15.90:0/3457676970 learned_addr learned my addr 172.21.15.90:0/3457676970 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.609+0000 7f575bfff640 1 --2- 172.21.15.90:0/3457676970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f575c15e920 0x7f575c1f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.609+0000 7f575affd640 1 --2- 172.21.15.90:0/3457676970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f575c074450 0x7f575c14cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.609+0000 7f575b7fe640 1 -- 172.21.15.90:0/3457676970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f575c074450 msgr2=0x7f575c14cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:38.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.609+0000 7f575b7fe640 1 --2- 172.21.15.90:0/3457676970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f575c074450 0x7f575c14cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:38.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.609+0000 7f575b7fe640 1 -- 172.21.15.90:0/3457676970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f575c15e920 msgr2=0x7f575c1f3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:38.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.610+0000 7f575b7fe640 1 --2- 172.21.15.90:0/3457676970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f575c15e920 0x7f575c1f3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:38.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.610+0000 7f575b7fe640 1 -- 172.21.15.90:0/3457676970 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c1f40c0 con 0x7f575c074070 2024-09-10T23:18:38.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.610+0000 7f575bfff640 1 --2- 172.21.15.90:0/3457676970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f575c15e920 0x7f575c1f3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:38.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.610+0000 7f575b7fe640 1 --2- 172.21.15.90:0/3457676970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f575c074070 0x7f575c1558b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f574c000c00 tx=0x7f574c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:38.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.610+0000 7f5743fff640 1 -- 172.21.15.90:0/3457676970 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c03f070 con 0x7f575c074070 2024-09-10T23:18:38.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.610+0000 7f5743fff640 1 -- 172.21.15.90:0/3457676970 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f574c0047a0 con 0x7f575c074070 2024-09-10T23:18:38.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.610+0000 7f5762132640 1 -- 172.21.15.90:0/3457676970 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575c155f30 con 0x7f575c074070 2024-09-10T23:18:38.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.610+0000 7f5743fff640 1 -- 172.21.15.90:0/3457676970 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c035030 con 0x7f575c074070 2024-09-10T23:18:38.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.610+0000 7f5762132640 1 -- 172.21.15.90:0/3457676970 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f575c1f3380 con 0x7f575c074070 2024-09-10T23:18:38.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.611+0000 7f5762132640 1 -- 172.21.15.90:0/3457676970 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f575c0cf0e0 con 0x7f575c074070 2024-09-10T23:18:38.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.612+0000 7f5743fff640 1 -- 172.21.15.90:0/3457676970 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f574c004bf0 con 0x7f575c074070 2024-09-10T23:18:38.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.612+0000 7f5743fff640 1 --2- 172.21.15.90:0/3457676970 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5748077f70 0x7f574807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:38.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.612+0000 7f5743fff640 1 -- 172.21.15.90:0/3457676970 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7f574c0baeb0 con 0x7f575c074070 2024-09-10T23:18:38.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.612+0000 7f575affd640 1 --2- 172.21.15.90:0/3457676970 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5748077f70 0x7f574807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:38.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.613+0000 7f575affd640 1 --2- 172.21.15.90:0/3457676970 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5748077f70 0x7f574807a430 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f575c152770 tx=0x7f5750009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:38.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.617+0000 7f5743fff640 1 -- 172.21.15.90:0/3457676970 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f574c0838b0 con 0x7f575c074070 2024-09-10T23:18:38.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.829+0000 7f5762132640 1 -- 172.21.15.90:0/3457676970 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f575c1f3140 con 0x7f575c074070 2024-09-10T23:18:38.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.829+0000 7f5743fff640 1 -- 172.21.15.90:0/3457676970 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+4395 (secure 0 0 0) 0x7f574c088e20 con 0x7f575c074070 2024-09-10T23:18:38.830 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:38.830 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":64,"btime":"2024-09-10T23:18:38:489387+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6083,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1271856183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1271856183},{"type":"v1","addr":"172.21.15.171:6835","nonce":1271856183}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6451,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2723277392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":2723277392},{"type":"v1","addr":"172.21.15.90:6835","nonce":2723277392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:19.149613+0000","modified":"2024-09-10T23:18:38.489377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7281":{"gid":7281,"name":"c","rank":0,"incarnation":64,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6834/638480774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":638480774},{"type":"v1","addr":"172.21.15.90:6834","nonce":638480774}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-09-10T23:18:38.831 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 64 2024-09-10T23:18:38.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.831+0000 7f5762132640 1 -- 172.21.15.90:0/3457676970 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5748077f70 msgr2=0x7f574807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:38.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.831+0000 7f5762132640 1 --2- 172.21.15.90:0/3457676970 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5748077f70 0x7f574807a430 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f575c152770 tx=0x7f5750009040 comp rx=0 tx=0).stop 2024-09-10T23:18:38.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.831+0000 7f5762132640 1 -- 172.21.15.90:0/3457676970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f575c074070 msgr2=0x7f575c1558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:38.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.831+0000 7f5762132640 1 --2- 172.21.15.90:0/3457676970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f575c074070 0x7f575c1558b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f574c000c00 tx=0x7f574c0038a0 comp rx=0 tx=0).stop 2024-09-10T23:18:38.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.831+0000 7f5762132640 1 -- 172.21.15.90:0/3457676970 shutdown_connections 2024-09-10T23:18:38.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.831+0000 7f5762132640 1 --2- 172.21.15.90:0/3457676970 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5748077f70 0x7f574807a430 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:38.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.831+0000 7f5762132640 1 --2- 172.21.15.90:0/3457676970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f575c15e920 0x7f575c1f3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:38.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.831+0000 7f5762132640 1 --2- 172.21.15.90:0/3457676970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f575c074450 0x7f575c14cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:38.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.831+0000 7f5762132640 1 --2- 172.21.15.90:0/3457676970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f575c074070 0x7f575c1558b0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:38.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.831+0000 7f5762132640 1 -- 172.21.15.90:0/3457676970 >> 172.21.15.90:0/3457676970 conn(0x7f575c06cb70 msgr2=0x7f575c075920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:38.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.832+0000 7f5762132640 1 -- 172.21.15.90:0/3457676970 shutdown_connections 2024-09-10T23:18:38.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:38.832+0000 7f5762132640 1 -- 172.21.15.90:0/3457676970 wait complete. 2024-09-10T23:18:39.246 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:18:19.149613+0000', 'modified': '2024-09-10T23:18:38.489377+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 108, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7281': {'gid': 7281, 'name': 'c', 'rank': 0, 'incarnation': 64, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.90:6834/638480774', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6832', 'nonce': 638480774}, {'type': 'v1', 'addr': '172.21.15.90:6834', 'nonce': 638480774}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T23:18:39.246 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7281:up:replay 2024-09-10T23:18:40.247 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:40.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.359+0000 7fc1db73d640 1 -- 172.21.15.90:0/4032290579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d4151a60 msgr2=0x7fc1d4151e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.359+0000 7fc1db73d640 1 --2- 172.21.15.90:0/4032290579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d4151a60 0x7fc1d4151e40 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fc1d406ec00 tx=0x7fc1c402aa30 comp rx=0 tx=0).stop 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.359+0000 7fc1db73d640 1 -- 172.21.15.90:0/4032290579 shutdown_connections 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.359+0000 7fc1db73d640 1 --2- 172.21.15.90:0/4032290579 >> v2:172.21.15.171:3300/0 conn(0x7fc1d40b3d60 0x7fc1d40b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.359+0000 7fc1db73d640 1 --2- 172.21.15.90:0/4032290579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d4151a60 0x7fc1d4151e40 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.359+0000 7fc1db73d640 1 -- 172.21.15.90:0/4032290579 >> 172.21.15.90:0/4032290579 conn(0x7fc1d40b25c0 msgr2=0x7fc1d40b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.359+0000 7fc1db73d640 1 -- 172.21.15.90:0/4032290579 shutdown_connections 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.359+0000 7fc1db73d640 1 -- 172.21.15.90:0/4032290579 wait complete. 2024-09-10T23:18:40.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.360+0000 7fc1db73d640 1 Processor -- start 2024-09-10T23:18:40.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.360+0000 7fc1db73d640 1 -- start start 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.361+0000 7fc1db73d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d4073320 0x7fc1d415a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.361+0000 7fc1db73d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1d40b3d60 0x7fc1d4155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.361+0000 7fc1db73d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1d4151a60 0x7fc1d406f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.361+0000 7fc1db73d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d415be00 con 0x7fc1d4073320 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.361+0000 7fc1db73d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d415bf80 con 0x7fc1d40b3d60 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.361+0000 7fc1db73d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc1d415c100 con 0x7fc1d4151a60 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.361+0000 7fc1d94d9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d4073320 0x7fc1d415a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.361+0000 7fc1d94d9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d4073320 0x7fc1d415a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34444/0 (socket says 172.21.15.90:34444) 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.361+0000 7fc1d94d9640 1 -- 172.21.15.90:0/2280688234 learned_addr learned my addr 172.21.15.90:0/2280688234 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.361+0000 7fc1d8cd8640 1 --2- 172.21.15.90:0/2280688234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1d40b3d60 0x7fc1d4155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.361+0000 7fc1d9cda640 1 --2- 172.21.15.90:0/2280688234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1d4151a60 0x7fc1d406f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.362+0000 7fc1d94d9640 1 -- 172.21.15.90:0/2280688234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1d4151a60 msgr2=0x7fc1d406f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.362+0000 7fc1d94d9640 1 --2- 172.21.15.90:0/2280688234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1d4151a60 0x7fc1d406f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.362+0000 7fc1d94d9640 1 -- 172.21.15.90:0/2280688234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1d40b3d60 msgr2=0x7fc1d4155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.362+0000 7fc1d94d9640 1 --2- 172.21.15.90:0/2280688234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1d40b3d60 0x7fc1d4155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.362+0000 7fc1d94d9640 1 -- 172.21.15.90:0/2280688234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d41f60e0 con 0x7fc1d4073320 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.362+0000 7fc1d94d9640 1 --2- 172.21.15.90:0/2280688234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d4073320 0x7fc1d415a750 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009d60 tx=0x7fc1c4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.362+0000 7fc1d1ffb640 1 -- 172.21.15.90:0/2280688234 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4047070 con 0x7fc1d4073320 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.362+0000 7fc1d1ffb640 1 -- 172.21.15.90:0/2280688234 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1c4004250 con 0x7fc1d4073320 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.362+0000 7fc1d1ffb640 1 -- 172.21.15.90:0/2280688234 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4033050 con 0x7fc1d4073320 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.362+0000 7fc1db73d640 1 -- 172.21.15.90:0/2280688234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d41f63c0 con 0x7fc1d4073320 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.362+0000 7fc1db73d640 1 -- 172.21.15.90:0/2280688234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d41f6980 con 0x7fc1d4073320 2024-09-10T23:18:40.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.363+0000 7fc1db73d640 1 -- 172.21.15.90:0/2280688234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1d40b41d0 con 0x7fc1d4073320 2024-09-10T23:18:40.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.364+0000 7fc1d1ffb640 1 -- 172.21.15.90:0/2280688234 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc1c4004680 con 0x7fc1d4073320 2024-09-10T23:18:40.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.364+0000 7fc1d1ffb640 1 --2- 172.21.15.90:0/2280688234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc1c0077f70 0x7fc1c007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.364+0000 7fc1d1ffb640 1 -- 172.21.15.90:0/2280688234 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7fc1c40bb390 con 0x7fc1d4073320 2024-09-10T23:18:40.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.365+0000 7fc1d8cd8640 1 --2- 172.21.15.90:0/2280688234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc1c0077f70 0x7fc1c007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.365+0000 7fc1d8cd8640 1 --2- 172.21.15.90:0/2280688234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc1c0077f70 0x7fc1c007a430 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc1d41f5ec0 tx=0x7fc1c800b390 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:40.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.368+0000 7fc1d1ffb640 1 -- 172.21.15.90:0/2280688234 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc1c40837d0 con 0x7fc1d4073320 2024-09-10T23:18:40.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.583+0000 7fc1db73d640 1 -- 172.21.15.90:0/2280688234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1d4070a20 con 0x7fc1d4073320 2024-09-10T23:18:40.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.584+0000 7fc1d1ffb640 1 -- 172.21.15.90:0/2280688234 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5220 (secure 0 0 0) 0x7fc1c4088200 con 0x7fc1d4073320 2024-09-10T23:18:40.585 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:40.585 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":66,"btime":"2024-09-10T23:18:40:498438+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6083,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1271856183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1271856183},{"type":"v1","addr":"172.21.15.171:6835","nonce":1271856183}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/622220525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":622220525},{"type":"v1","addr":"172.21.15.171:6837","nonce":622220525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6451,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2723277392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":2723277392},{"type":"v1","addr":"172.21.15.90:6835","nonce":2723277392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:19.149613+0000","modified":"2024-09-10T23:18:39.499946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7281":{"gid":7281,"name":"c","rank":0,"incarnation":64,"state":"up:rejoin","state_seq":4,"addr":"172.21.15.90:6834/638480774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":638480774},{"type":"v1","addr":"172.21.15.90:6834","nonce":638480774}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-09-10T23:18:40.585 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 66 2024-09-10T23:18:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.586+0000 7fc1db73d640 1 -- 172.21.15.90:0/2280688234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc1c0077f70 msgr2=0x7fc1c007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.586+0000 7fc1db73d640 1 --2- 172.21.15.90:0/2280688234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc1c0077f70 0x7fc1c007a430 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc1d41f5ec0 tx=0x7fc1c800b390 comp rx=0 tx=0).stop 2024-09-10T23:18:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.586+0000 7fc1db73d640 1 -- 172.21.15.90:0/2280688234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d4073320 msgr2=0x7fc1d415a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.586+0000 7fc1db73d640 1 --2- 172.21.15.90:0/2280688234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d4073320 0x7fc1d415a750 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009d60 tx=0x7fc1c4003f10 comp rx=0 tx=0).stop 2024-09-10T23:18:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.586+0000 7fc1db73d640 1 -- 172.21.15.90:0/2280688234 shutdown_connections 2024-09-10T23:18:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.586+0000 7fc1db73d640 1 --2- 172.21.15.90:0/2280688234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc1c0077f70 0x7fc1c007a430 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.586+0000 7fc1db73d640 1 --2- 172.21.15.90:0/2280688234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1d40b3d60 0x7fc1d4155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.586+0000 7fc1db73d640 1 --2- 172.21.15.90:0/2280688234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1d4151a60 0x7fc1d406f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.586+0000 7fc1db73d640 1 --2- 172.21.15.90:0/2280688234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1d4073320 0x7fc1d415a750 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.586+0000 7fc1db73d640 1 -- 172.21.15.90:0/2280688234 >> 172.21.15.90:0/2280688234 conn(0x7fc1d40b25c0 msgr2=0x7fc1d40b29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:40.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.586+0000 7fc1db73d640 1 -- 172.21.15.90:0/2280688234 shutdown_connections 2024-09-10T23:18:40.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:40.586+0000 7fc1db73d640 1 -- 172.21.15.90:0/2280688234 wait complete. 2024-09-10T23:18:41.001 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:18:19.149613+0000', 'modified': '2024-09-10T23:18:39.499946+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 108, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7281': {'gid': 7281, 'name': 'c', 'rank': 0, 'incarnation': 64, 'state': 'up:rejoin', 'state_seq': 4, 'addr': '172.21.15.90:6834/638480774', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6832', 'nonce': 638480774}, {'type': 'v1', 'addr': '172.21.15.90:6834', 'nonce': 638480774}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T23:18:41.001 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7281:up:rejoin 2024-09-10T23:18:41.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-10T23:18:42.002 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:42.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.115+0000 7ff40d6bf640 1 -- 172.21.15.90:0/907309451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4080b3500 msgr2=0x7ff4080b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.115+0000 7ff40d6bf640 1 --2- 172.21.15.90:0/907309451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4080b3500 0x7ff4080b73d0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7ff40806ea70 tx=0x7ff3f002a560 comp rx=0 tx=0).stop 2024-09-10T23:18:42.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.115+0000 7ff40d6bf640 1 -- 172.21.15.90:0/907309451 shutdown_connections 2024-09-10T23:18:42.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.115+0000 7ff40d6bf640 1 --2- 172.21.15.90:0/907309451 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4080cf0e0 0x7ff4080d37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.115+0000 7ff40d6bf640 1 --2- 172.21.15.90:0/907309451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4080b3500 0x7ff4080b73d0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.115+0000 7ff40d6bf640 1 --2- 172.21.15.90:0/907309451 >> v2:172.21.15.171:3300/0 conn(0x7ff40815e1c0 0x7ff4080ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.115+0000 7ff40d6bf640 1 -- 172.21.15.90:0/907309451 >> 172.21.15.90:0/907309451 conn(0x7ff40806db50 msgr2=0x7ff40806df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:42.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.115+0000 7ff40d6bf640 1 -- 172.21.15.90:0/907309451 shutdown_connections 2024-09-10T23:18:42.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.115+0000 7ff40d6bf640 1 -- 172.21.15.90:0/907309451 wait complete. 2024-09-10T23:18:42.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.116+0000 7ff40d6bf640 1 Processor -- start 2024-09-10T23:18:42.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.116+0000 7ff40d6bf640 1 -- start start 2024-09-10T23:18:42.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff40d6bf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4080b3500 0x7ff4080ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff40d6bf640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4080cf0e0 0x7ff4081f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff40d6bf640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff40815e1c0 0x7ff40815a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff40d6bf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff4080d40c0 con 0x7ff4080b3500 2024-09-10T23:18:42.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff40d6bf640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff4080d3f40 con 0x7ff40815e1c0 2024-09-10T23:18:42.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff40d6bf640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff4080d29f0 con 0x7ff4080cf0e0 2024-09-10T23:18:42.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff406ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4080b3500 0x7ff4080ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff406ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4080b3500 0x7ff4080ca5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34460/0 (socket says 172.21.15.90:34460) 2024-09-10T23:18:42.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff406ffd640 1 -- 172.21.15.90:0/3311941778 learned_addr learned my addr 172.21.15.90:0/3311941778 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:42.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff4077fe640 1 --2- 172.21.15.90:0/3311941778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff40815e1c0 0x7ff40815a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff3fe7fc640 1 --2- 172.21.15.90:0/3311941778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4080cf0e0 0x7ff4081f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff406ffd640 1 -- 172.21.15.90:0/3311941778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4080cf0e0 msgr2=0x7ff4081f4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff406ffd640 1 --2- 172.21.15.90:0/3311941778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4080cf0e0 0x7ff4081f4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff406ffd640 1 -- 172.21.15.90:0/3311941778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff40815e1c0 msgr2=0x7ff40815a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff406ffd640 1 --2- 172.21.15.90:0/3311941778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff40815e1c0 0x7ff40815a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff406ffd640 1 -- 172.21.15.90:0/3311941778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4080cac90 con 0x7ff4080b3500 2024-09-10T23:18:42.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff3fe7fc640 1 --2- 172.21.15.90:0/3311941778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4080cf0e0 0x7ff4081f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:42.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.117+0000 7ff406ffd640 1 --2- 172.21.15.90:0/3311941778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4080b3500 0x7ff4080ca5d0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800d950 tx=0x7ff3f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:42.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.118+0000 7ff3fffff640 1 -- 172.21.15.90:0/3311941778 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8017070 con 0x7ff4080b3500 2024-09-10T23:18:42.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.118+0000 7ff3fffff640 1 -- 172.21.15.90:0/3311941778 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3f8009d20 con 0x7ff4080b3500 2024-09-10T23:18:42.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.118+0000 7ff40d6bf640 1 -- 172.21.15.90:0/3311941778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4080c8e80 con 0x7ff4080b3500 2024-09-10T23:18:42.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.118+0000 7ff3fffff640 1 -- 172.21.15.90:0/3311941778 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f80106c0 con 0x7ff4080b3500 2024-09-10T23:18:42.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.118+0000 7ff40d6bf640 1 -- 172.21.15.90:0/3311941778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4080c9440 con 0x7ff4080b3500 2024-09-10T23:18:42.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.119+0000 7ff40d6bf640 1 -- 172.21.15.90:0/3311941778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4080d37f0 con 0x7ff4080b3500 2024-09-10T23:18:42.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.119+0000 7ff3fffff640 1 -- 172.21.15.90:0/3311941778 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff3f8010860 con 0x7ff4080b3500 2024-09-10T23:18:42.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.120+0000 7ff3fffff640 1 --2- 172.21.15.90:0/3311941778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff3e8077f70 0x7ff3e807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.120+0000 7ff3fffff640 1 -- 172.21.15.90:0/3311941778 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7ff3f809a0b0 con 0x7ff4080b3500 2024-09-10T23:18:42.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.120+0000 7ff3fe7fc640 1 --2- 172.21.15.90:0/3311941778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff3e8077f70 0x7ff3e807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.121+0000 7ff3fe7fc640 1 --2- 172.21.15.90:0/3311941778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff3e8077f70 0x7ff3e807a430 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0033000 tx=0x7ff3f0004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:42.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.124+0000 7ff3fffff640 1 -- 172.21.15.90:0/3311941778 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff3f80624f0 con 0x7ff4080b3500 2024-09-10T23:18:42.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.332+0000 7ff40d6bf640 1 -- 172.21.15.90:0/3311941778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff40806cb70 con 0x7ff4080b3500 2024-09-10T23:18:42.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.333+0000 7ff3fffff640 1 -- 172.21.15.90:0/3311941778 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5227 (secure 0 0 0) 0x7ff3f8066f20 con 0x7ff4080b3500 2024-09-10T23:18:42.334 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:42.334 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":67,"btime":"2024-09-10T23:18:41:499949+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6083,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1271856183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1271856183},{"type":"v1","addr":"172.21.15.171:6835","nonce":1271856183}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/622220525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":622220525},{"type":"v1","addr":"172.21.15.171:6837","nonce":622220525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6451,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2723277392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":2723277392},{"type":"v1","addr":"172.21.15.90:6835","nonce":2723277392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:19.149613+0000","modified":"2024-09-10T23:18:41.499942+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7281":{"gid":7281,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6834/638480774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":638480774},{"type":"v1","addr":"172.21.15.90:6834","nonce":638480774}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7281,"qdb_cluster":[7281]},"id":8}]} 2024-09-10T23:18:42.334 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 67 2024-09-10T23:18:42.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.334+0000 7ff40d6bf640 1 -- 172.21.15.90:0/3311941778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff3e8077f70 msgr2=0x7ff3e807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.334+0000 7ff40d6bf640 1 --2- 172.21.15.90:0/3311941778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff3e8077f70 0x7ff3e807a430 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0033000 tx=0x7ff3f0004730 comp rx=0 tx=0).stop 2024-09-10T23:18:42.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.334+0000 7ff40d6bf640 1 -- 172.21.15.90:0/3311941778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4080b3500 msgr2=0x7ff4080ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.334+0000 7ff40d6bf640 1 --2- 172.21.15.90:0/3311941778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4080b3500 0x7ff4080ca5d0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800d950 tx=0x7ff3f800de10 comp rx=0 tx=0).stop 2024-09-10T23:18:42.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.335+0000 7ff40d6bf640 1 -- 172.21.15.90:0/3311941778 shutdown_connections 2024-09-10T23:18:42.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.335+0000 7ff40d6bf640 1 --2- 172.21.15.90:0/3311941778 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff3e8077f70 0x7ff3e807a430 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.335+0000 7ff40d6bf640 1 --2- 172.21.15.90:0/3311941778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff40815e1c0 0x7ff40815a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.335+0000 7ff40d6bf640 1 --2- 172.21.15.90:0/3311941778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4080cf0e0 0x7ff4081f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.335+0000 7ff40d6bf640 1 --2- 172.21.15.90:0/3311941778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4080b3500 0x7ff4080ca5d0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.335+0000 7ff40d6bf640 1 -- 172.21.15.90:0/3311941778 >> 172.21.15.90:0/3311941778 conn(0x7ff40806db50 msgr2=0x7ff408161600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:42.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.335+0000 7ff40d6bf640 1 -- 172.21.15.90:0/3311941778 shutdown_connections 2024-09-10T23:18:42.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.335+0000 7ff40d6bf640 1 -- 172.21.15.90:0/3311941778 wait complete. 2024-09-10T23:18:42.750 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:18:19.149613+0000', 'modified': '2024-09-10T23:18:41.499942+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 108, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7281': {'gid': 7281, 'name': 'c', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.90:6834/638480774', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6832', 'nonce': 638480774}, {'type': 'v1', 'addr': '172.21.15.90:6834', 'nonce': 638480774}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7281, 'qdb_cluster': [7281]} 2024-09-10T23:18:42.751 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:18:42.751 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T23:18:42.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.856+0000 7fdf065f3640 1 -- 172.21.15.90:0/2465464059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf0006ecb0 msgr2=0x7fdf000ce860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.856+0000 7fdf065f3640 1 --2- 172.21.15.90:0/2465464059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf0006ecb0 0x7fdf000ce860 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fdef000a970 tx=0x7fdef002b880 comp rx=0 tx=0).stop 2024-09-10T23:18:42.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.856+0000 7fdf065f3640 1 -- 172.21.15.90:0/2465464059 shutdown_connections 2024-09-10T23:18:42.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.856+0000 7fdf065f3640 1 --2- 172.21.15.90:0/2465464059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf0006ecb0 0x7fdf000ce860 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.856+0000 7fdf065f3640 1 -- 172.21.15.90:0/2465464059 >> 172.21.15.90:0/2465464059 conn(0x7fdf0006cb70 msgr2=0x7fdf0006cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:42.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.856+0000 7fdf065f3640 1 -- 172.21.15.90:0/2465464059 shutdown_connections 2024-09-10T23:18:42.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.856+0000 7fdf065f3640 1 -- 172.21.15.90:0/2465464059 wait complete. 2024-09-10T23:18:42.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.857+0000 7fdf065f3640 1 Processor -- start 2024-09-10T23:18:42.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.857+0000 7fdf065f3640 1 -- start start 2024-09-10T23:18:42.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdf065f3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf0006ecb0 0x7fdf0014ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdf065f3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf0006f090 0x7fdf001f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdf065f3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf0015a960 0x7fdf001e5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdf065f3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdf000b2090 con 0x7fdf0015a960 2024-09-10T23:18:42.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdf065f3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdf000b1f10 con 0x7fdf0006f090 2024-09-10T23:18:42.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdf065f3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdf000b2210 con 0x7fdf0006ecb0 2024-09-10T23:18:42.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdf04b90640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf0015a960 0x7fdf001e5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdf04b90640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf0015a960 0x7fdf001e5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34490/0 (socket says 172.21.15.90:34490) 2024-09-10T23:18:42.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdf04b90640 1 -- 172.21.15.90:0/846438076 learned_addr learned my addr 172.21.15.90:0/846438076 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:42.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdf04b90640 1 -- 172.21.15.90:0/846438076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf0006ecb0 msgr2=0x7fdf0014ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdefffff640 1 --2- 172.21.15.90:0/846438076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf0006ecb0 0x7fdf0014ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdf04b90640 1 --2- 172.21.15.90:0/846438076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf0006ecb0 0x7fdf0014ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdf04b90640 1 -- 172.21.15.90:0/846438076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf0006f090 msgr2=0x7fdf001f2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdeff7fe640 1 --2- 172.21.15.90:0/846438076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf0006f090 0x7fdf001f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdf04b90640 1 --2- 172.21.15.90:0/846438076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf0006f090 0x7fdf001f2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdf04b90640 1 -- 172.21.15.90:0/846438076 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf00072ac0 con 0x7fdf0015a960 2024-09-10T23:18:42.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdf04b90640 1 --2- 172.21.15.90:0/846438076 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf0015a960 0x7fdf001e5220 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fdef800c760 tx=0x7fdef800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:42.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdefcff9640 1 -- 172.21.15.90:0/846438076 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8003b70 con 0x7fdf0015a960 2024-09-10T23:18:42.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.858+0000 7fdefcff9640 1 -- 172.21.15.90:0/846438076 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdef8003d10 con 0x7fdf0015a960 2024-09-10T23:18:42.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.859+0000 7fdf065f3640 1 -- 172.21.15.90:0/846438076 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf00072da0 con 0x7fdf0015a960 2024-09-10T23:18:42.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.859+0000 7fdefcff9640 1 -- 172.21.15.90:0/846438076 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef80052d0 con 0x7fdf0015a960 2024-09-10T23:18:42.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.859+0000 7fdf065f3640 1 -- 172.21.15.90:0/846438076 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf00073360 con 0x7fdf0015a960 2024-09-10T23:18:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.860+0000 7fdefcff9640 1 -- 172.21.15.90:0/846438076 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdef8005470 con 0x7fdf0015a960 2024-09-10T23:18:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.861+0000 7fdefcff9640 1 --2- 172.21.15.90:0/846438076 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdeec077f70 0x7fdeec07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.861+0000 7fdefcff9640 1 -- 172.21.15.90:0/846438076 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7fdef8099b80 con 0x7fdf0015a960 2024-09-10T23:18:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.861+0000 7fdefffff640 1 --2- 172.21.15.90:0/846438076 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdeec077f70 0x7fdeec07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.861+0000 7fdf093c0740 1 Processor -- start 2024-09-10T23:18:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.862+0000 7fdefffff640 1 --2- 172.21.15.90:0/846438076 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdeec077f70 0x7fdeec07a430 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdef0036000 tx=0x7fdef0004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.862+0000 7fdf093c0740 1 -- start start 2024-09-10T23:18:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.862+0000 7fdf093c0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 0x564eab1c5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.862+0000 7fdf093c0740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab1cb310 0x564eab1ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.862+0000 7fdf093c0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab20fdf0 0x564eab210260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.862+0000 7fdf093c0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564eab13c820 con 0x564eab20fdf0 2024-09-10T23:18:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.862+0000 7fdf093c0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564eab12bc50 con 0x564eab1ecef0 2024-09-10T23:18:42.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.862+0000 7fdf093c0740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x564eab12fa60 con 0x564eab1cb310 2024-09-10T23:18:42.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.862+0000 7fdf04b90640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab20fdf0 0x564eab210260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.862+0000 7fdf04b90640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab20fdf0 0x564eab210260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34500/0 (socket says 172.21.15.90:34500) 2024-09-10T23:18:42.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.862+0000 7fdf04b90640 1 -- 172.21.15.90:0/2008381116 learned_addr learned my addr 172.21.15.90:0/2008381116 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:42.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.862+0000 7fdefffff640 1 --2- 172.21.15.90:0/2008381116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 0x564eab1c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.863+0000 7fdeff7fe640 1 --2- 172.21.15.90:0/2008381116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab1cb310 0x564eab1ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.863+0000 7fdf04b90640 1 -- 172.21.15.90:0/2008381116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab1cb310 msgr2=0x564eab1ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:42.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.863+0000 7fdf04b90640 1 --2- 172.21.15.90:0/2008381116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab1cb310 0x564eab1ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.863+0000 7fdf04b90640 1 -- 172.21.15.90:0/2008381116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 msgr2=0x564eab1c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:42.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.863+0000 7fdf04b90640 1 --2- 172.21.15.90:0/2008381116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 0x564eab1c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.863+0000 7fdf04b90640 1 -- 172.21.15.90:0/2008381116 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eaae8d850 con 0x564eab20fdf0 2024-09-10T23:18:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.863+0000 7fdeff7fe640 1 --2- 172.21.15.90:0/2008381116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab1cb310 0x564eab1ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.863+0000 7fdefffff640 1 --2- 172.21.15.90:0/2008381116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 0x564eab1c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.863+0000 7fdf04b90640 1 --2- 172.21.15.90:0/2008381116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab20fdf0 0x564eab210260 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fdef8097fb0 tx=0x7fdef8061680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7efda83a826a5aea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.863+0000 7fdee5ffb640 1 -- 172.21.15.90:0/2008381116 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8062610 con 0x564eab20fdf0 2024-09-10T23:18:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.863+0000 7fdee5ffb640 1 -- 172.21.15.90:0/2008381116 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdef8061f10 con 0x564eab20fdf0 2024-09-10T23:18:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.863+0000 7fdee5ffb640 1 -- 172.21.15.90:0/2008381116 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef80669f0 con 0x564eab20fdf0 2024-09-10T23:18:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.864+0000 7fdf093c0740 1 -- 172.21.15.90:0/2008381116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab20fdf0 msgr2=0x564eab210260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.864+0000 7fdf093c0740 1 --2- 172.21.15.90:0/2008381116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab20fdf0 0x564eab210260 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fdef8097fb0 tx=0x7fdef8061680 comp rx=0 tx=0).stop 2024-09-10T23:18:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.864+0000 7fdf093c0740 1 -- 172.21.15.90:0/2008381116 shutdown_connections 2024-09-10T23:18:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.864+0000 7fdf093c0740 1 --2- 172.21.15.90:0/2008381116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab20fdf0 0x564eab210260 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.864+0000 7fdf093c0740 1 --2- 172.21.15.90:0/2008381116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab1cb310 0x564eab1ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.864+0000 7fdf093c0740 1 --2- 172.21.15.90:0/2008381116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 0x564eab1c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.864+0000 7fdf093c0740 1 -- 172.21.15.90:0/2008381116 >> 172.21.15.90:0/2008381116 conn(0x564eab1c66a0 msgr2=0x564eab1ca0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.864+0000 7fdf093c0740 1 -- 172.21.15.90:0/2008381116 shutdown_connections 2024-09-10T23:18:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.864+0000 7fdf093c0740 1 -- 172.21.15.90:0/2008381116 wait complete. 2024-09-10T23:18:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.864+0000 7fdf093c0740 1 -- start start 2024-09-10T23:18:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.864+0000 7fdf093c0740 1 Processor -- start 2024-09-10T23:18:42.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.865+0000 7fdf093c0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 0x564eab226230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.865+0000 7fdf093c0740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab20fdf0 0x564eab1e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.865+0000 7fdf093c0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab1f19b0 0x564eab1ec3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.865+0000 7fdf093c0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564eaae9c620 con 0x564eab1f19b0 2024-09-10T23:18:42.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.865+0000 7fdf093c0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564eab0d15f0 con 0x564eab1ecef0 2024-09-10T23:18:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.865+0000 7fdf093c0740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x564eab1c55d0 con 0x564eab20fdf0 2024-09-10T23:18:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.865+0000 7fdf093c0740 10 client.0 _ll_register_callbacks cb 0x564eab0d50a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.865+0000 7fdf04b90640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab1f19b0 0x564eab1ec3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.865+0000 7fdf04b90640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab1f19b0 0x564eab1ec3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34514/0 (socket says 172.21.15.90:34514) 2024-09-10T23:18:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.865+0000 7fdf04b90640 1 -- 172.21.15.90:0/3580125605 learned_addr learned my addr 172.21.15.90:0/3580125605 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.865+0000 7fdeff7fe640 1 --2- 172.21.15.90:0/3580125605 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab20fdf0 0x564eab1e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdefffff640 1 --2- 172.21.15.90:0/3580125605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 0x564eab226230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdf04b90640 1 -- 172.21.15.90:0/3580125605 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab20fdf0 msgr2=0x564eab1e94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdf04b90640 1 --2- 172.21.15.90:0/3580125605 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab20fdf0 0x564eab1e94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdf04b90640 1 -- 172.21.15.90:0/3580125605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 msgr2=0x564eab226230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdf04b90640 1 --2- 172.21.15.90:0/3580125605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 0x564eab226230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdf04b90640 1 -- 172.21.15.90:0/3580125605 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eaaf046b0 con 0x564eab1f19b0 2024-09-10T23:18:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdefffff640 1 --2- 172.21.15.90:0/3580125605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 0x564eab226230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdf04b90640 1 --2- 172.21.15.90:0/3580125605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab1f19b0 0x564eab1ec3c0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fdef800a430 tx=0x7fdef806b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5dba44b36aefc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdedeffd640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:18:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdedeffd640 1 -- 172.21.15.90:0/3580125605 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8067d80 con 0x564eab1f19b0 2024-09-10T23:18:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdf093c0740 1 -- 172.21.15.90:0/3580125605 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdef8061f10 con 0x564eab1f19b0 2024-09-10T23:18:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdedeffd640 1 -- 172.21.15.90:0/3580125605 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7fdef8061170 con 0x564eab1f19b0 2024-09-10T23:18:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdedeffd640 1 -- 172.21.15.90:0/3580125605 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7fdef80613b0 con 0x564eab1f19b0 2024-09-10T23:18:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdf093c0740 10 client.7329 fetch_fsmap learned FSMap version 67 2024-09-10T23:18:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdf093c0740 1 -- 172.21.15.90:0/3580125605 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x564eab1e9cd0 con 0x564eab1f19b0 2024-09-10T23:18:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdedeffd640 1 -- 172.21.15.90:0/3580125605 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdef8061f10 con 0x564eab1f19b0 2024-09-10T23:18:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdedeffd640 1 -- 172.21.15.90:0/3580125605 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 67) ==== 3502+0+0 (secure 0 0 0) 0x7fdef8069ce0 con 0x564eab1f19b0 2024-09-10T23:18:42.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdf093c0740 10 client.7329 fetch_fsmap finished waiting for FSMap version 67 2024-09-10T23:18:42.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdf093c0740 10 client.7329 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:18:42.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdf093c0740 20 client.7329 populate_metadata read hostname 'smithi090' 2024-09-10T23:18:42.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdf093c0740 1 --2- 172.21.15.90:0/3580125605 >> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] conn(0x564eab2091d0 0x564eab2095b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdf093c0740 4 client.7329 mds_command: new command op to 7281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:18:42.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdf093c0740 1 -- 172.21.15.90:0/3580125605 --> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564eab13e770 con 0x564eab2091d0 2024-09-10T23:18:42.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.866+0000 7fdefffff640 1 --2- 172.21.15.90:0/3580125605 >> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] conn(0x564eab2091d0 0x564eab2095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.867+0000 7fdefffff640 1 --2- 172.21.15.90:0/3580125605 >> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] conn(0x564eab2091d0 0x564eab2095b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aee6683175ee3367 server_cookie=557adf5e95d3098 in_seq=0 out_seq=0 2024-09-10T23:18:42.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.867+0000 7fdedeffd640 10 client.7329 ms_handle_connect on v2:172.21.15.90:6832/638480774 2024-09-10T23:18:42.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.867+0000 7fdedeffd640 1 -- 172.21.15.90:0/3580125605 <== mds.0 v2:172.21.15.90:6832/638480774 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564eab13e770 con 0x564eab2091d0 2024-09-10T23:18:42.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.867+0000 7fdedeffd640 10 client.7329 handle_command_reply: tid=0 2024-09-10T23:18:42.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.867+0000 7fdf093c0740 1 client.7329 shutdown 2024-09-10T23:18:42.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.868+0000 7fdf093c0740 1 -- 172.21.15.90:0/3580125605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab1f19b0 msgr2=0x564eab1ec3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.868+0000 7fdf093c0740 1 --2- 172.21.15.90:0/3580125605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab1f19b0 0x564eab1ec3c0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fdef800a430 tx=0x7fdef806b480 comp rx=0 tx=0).stop 2024-09-10T23:18:42.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.868+0000 7fdf093c0740 1 -- 172.21.15.90:0/3580125605 shutdown_connections 2024-09-10T23:18:42.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.868+0000 7fdf093c0740 1 --2- 172.21.15.90:0/3580125605 >> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] conn(0x564eab2091d0 0x564eab2095b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.868+0000 7fdf093c0740 1 --2- 172.21.15.90:0/3580125605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab1f19b0 0x564eab1ec3c0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.868+0000 7fdedeffd640 0 client.7329 ms_handle_reset on v2:172.21.15.90:6832/638480774 2024-09-10T23:18:42.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.868+0000 7fdf093c0740 1 --2- 172.21.15.90:0/3580125605 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab20fdf0 0x564eab1e94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.868+0000 7fdf093c0740 1 --2- 172.21.15.90:0/3580125605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 0x564eab226230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.868+0000 7fdf093c0740 1 -- 172.21.15.90:0/3580125605 >> 172.21.15.90:0/3580125605 conn(0x564eab1cb310 msgr2=0x564eab1f6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:42.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.868+0000 7fdf093c0740 1 -- 172.21.15.90:0/3580125605 shutdown_connections 2024-09-10T23:18:42.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.868+0000 7fdf093c0740 1 -- 172.21.15.90:0/3580125605 wait complete. 2024-09-10T23:18:42.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.868+0000 7fdf093c0740 20 client.7329 trim_cache size 0 max 16384 2024-09-10T23:18:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.885+0000 7fdf093c0740 1 Processor -- start 2024-09-10T23:18:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.885+0000 7fdf093c0740 1 -- start start 2024-09-10T23:18:42.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.886+0000 7fdf093c0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab1ecef0 0x564eab1ebf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.886+0000 7fdf093c0740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab1f19b0 0x564eab1c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.886+0000 7fdf093c0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab20fdf0 0x564eab1c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.886+0000 7fdf093c0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdf001e3cb0 con 0x564eab1ecef0 2024-09-10T23:18:42.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.886+0000 7fdf093c0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdf001e3010 con 0x564eab20fdf0 2024-09-10T23:18:42.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.886+0000 7fdf093c0740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdf001e3660 con 0x564eab1f19b0 2024-09-10T23:18:42.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.886+0000 7fdefffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab1ecef0 0x564eab1ebf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.886+0000 7fdefffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab1ecef0 0x564eab1ebf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34524/0 (socket says 172.21.15.90:34524) 2024-09-10T23:18:42.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.886+0000 7fdefffff640 1 -- 172.21.15.90:0/1998520077 learned_addr learned my addr 172.21.15.90:0/1998520077 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:42.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdefffff640 1 -- 172.21.15.90:0/1998520077 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab1f19b0 msgr2=0x564eab1c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:42.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdefffff640 1 --2- 172.21.15.90:0/1998520077 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab1f19b0 0x564eab1c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdefffff640 1 -- 172.21.15.90:0/1998520077 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab20fdf0 msgr2=0x564eab1c3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:42.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdefffff640 1 --2- 172.21.15.90:0/1998520077 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab20fdf0 0x564eab1c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdefffff640 1 -- 172.21.15.90:0/1998520077 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eab1c5400 con 0x564eab1ecef0 2024-09-10T23:18:42.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdefffff640 1 --2- 172.21.15.90:0/1998520077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab1ecef0 0x564eab1ebf70 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fdef000a700 tx=0x7fdef003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4bbd563bc80912 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:42.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdee57fa640 1 -- 172.21.15.90:0/1998520077 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0059070 con 0x564eab1ecef0 2024-09-10T23:18:42.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdee57fa640 1 -- 172.21.15.90:0/1998520077 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdef0044040 con 0x564eab1ecef0 2024-09-10T23:18:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdee57fa640 1 -- 172.21.15.90:0/1998520077 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0031850 con 0x564eab1ecef0 2024-09-10T23:18:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdf093c0740 1 -- 172.21.15.90:0/1998520077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab1ecef0 msgr2=0x564eab1ebf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdf093c0740 1 --2- 172.21.15.90:0/1998520077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab1ecef0 0x564eab1ebf70 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fdef000a700 tx=0x7fdef003d000 comp rx=0 tx=0).stop 2024-09-10T23:18:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdf093c0740 1 -- 172.21.15.90:0/1998520077 shutdown_connections 2024-09-10T23:18:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdf093c0740 1 --2- 172.21.15.90:0/1998520077 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab20fdf0 0x564eab1c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdf093c0740 1 --2- 172.21.15.90:0/1998520077 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab1f19b0 0x564eab1c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdf093c0740 1 --2- 172.21.15.90:0/1998520077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab1ecef0 0x564eab1ebf70 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdf093c0740 1 -- 172.21.15.90:0/1998520077 >> 172.21.15.90:0/1998520077 conn(0x564eab1cb310 msgr2=0x564eab1bfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdf093c0740 1 -- 172.21.15.90:0/1998520077 shutdown_connections 2024-09-10T23:18:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.887+0000 7fdf093c0740 1 -- 172.21.15.90:0/1998520077 wait complete. 2024-09-10T23:18:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.888+0000 7fdf093c0740 1 -- start start 2024-09-10T23:18:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.888+0000 7fdf093c0740 1 Processor -- start 2024-09-10T23:18:42.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdf093c0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 0x564eab22cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdf093c0740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab1f19b0 0x564eab1f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdf093c0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab20fdf0 0x564eab1c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdf093c0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564eaae9c620 con 0x564eab20fdf0 2024-09-10T23:18:42.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdf093c0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564eab0d15f0 con 0x564eab1ecef0 2024-09-10T23:18:42.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdf093c0740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x564eab223b20 con 0x564eab1f19b0 2024-09-10T23:18:42.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdf093c0740 10 client.0 _ll_register_callbacks cb 0x7fdef8061db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:42.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdf04b90640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab20fdf0 0x564eab1c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdf04b90640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab20fdf0 0x564eab1c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34538/0 (socket says 172.21.15.90:34538) 2024-09-10T23:18:42.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdf04b90640 1 -- 172.21.15.90:0/17981610 learned_addr learned my addr 172.21.15.90:0/17981610 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:42.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdeff7fe640 1 --2- 172.21.15.90:0/17981610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab1f19b0 0x564eab1f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdefffff640 1 --2- 172.21.15.90:0/17981610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 0x564eab22cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdf04b90640 1 -- 172.21.15.90:0/17981610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab1f19b0 msgr2=0x564eab1f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:42.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdf04b90640 1 --2- 172.21.15.90:0/17981610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab1f19b0 0x564eab1f3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdf04b90640 1 -- 172.21.15.90:0/17981610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 msgr2=0x564eab22cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:42.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdf04b90640 1 --2- 172.21.15.90:0/17981610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 0x564eab22cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdf04b90640 1 -- 172.21.15.90:0/17981610 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eab2981d0 con 0x564eab20fdf0 2024-09-10T23:18:42.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdeff7fe640 1 --2- 172.21.15.90:0/17981610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab1f19b0 0x564eab1f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:42.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.889+0000 7fdefffff640 1 --2- 172.21.15.90:0/17981610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 0x564eab22cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:42.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.890+0000 7fdf04b90640 1 --2- 172.21.15.90:0/17981610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab20fdf0 0x564eab1c9bf0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fdef800c730 tx=0x7fdef80016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cfaa245817dce26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:42.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.890+0000 7fdedeffd640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:18:42.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.890+0000 7fdedeffd640 1 -- 172.21.15.90:0/17981610 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8081030 con 0x564eab20fdf0 2024-09-10T23:18:42.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.890+0000 7fdedeffd640 1 -- 172.21.15.90:0/17981610 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7fdef805d860 con 0x564eab20fdf0 2024-09-10T23:18:42.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.890+0000 7fdf093c0740 1 -- 172.21.15.90:0/17981610 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdef0044040 con 0x564eab20fdf0 2024-09-10T23:18:42.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.890+0000 7fdedeffd640 1 -- 172.21.15.90:0/17981610 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7fdef808e050 con 0x564eab20fdf0 2024-09-10T23:18:42.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.890+0000 7fdf093c0740 10 client.7335 fetch_fsmap learned FSMap version 67 2024-09-10T23:18:42.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.890+0000 7fdf093c0740 1 -- 172.21.15.90:0/17981610 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x564eab1ca550 con 0x564eab20fdf0 2024-09-10T23:18:42.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.890+0000 7fdedeffd640 1 -- 172.21.15.90:0/17981610 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdef0044040 con 0x564eab20fdf0 2024-09-10T23:18:42.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.890+0000 7fdedeffd640 1 -- 172.21.15.90:0/17981610 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 67) ==== 3502+0+0 (secure 0 0 0) 0x7fdef8069ce0 con 0x564eab20fdf0 2024-09-10T23:18:42.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.890+0000 7fdf093c0740 10 client.7335 fetch_fsmap finished waiting for FSMap version 67 2024-09-10T23:18:42.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.890+0000 7fdf093c0740 10 client.7335 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:18:42.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.890+0000 7fdf093c0740 20 client.7335 populate_metadata read hostname 'smithi090' 2024-09-10T23:18:42.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.890+0000 7fdf093c0740 1 --2- 172.21.15.90:0/17981610 >> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] conn(0x564eab221c60 0x564eab1c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.890+0000 7fdf093c0740 4 client.7335 mds_command: new command op to 7281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:18:42.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.890+0000 7fdf093c0740 1 -- 172.21.15.90:0/17981610 --> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] -- command(tid 0: {"prefix": "status"}) -- 0x564eab1cb160 con 0x564eab221c60 2024-09-10T23:18:42.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.890+0000 7fdefffff640 1 --2- 172.21.15.90:0/17981610 >> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] conn(0x564eab221c60 0x564eab1c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.891+0000 7fdedeffd640 10 client.7335 ms_handle_connect on v2:172.21.15.90:6832/638480774 2024-09-10T23:18:42.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.891+0000 7fdefffff640 1 --2- 172.21.15.90:0/17981610 >> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] conn(0x564eab221c60 0x564eab1c35d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e06b0823a423e16 server_cookie=cf172a89b77a0d28 in_seq=0 out_seq=0 2024-09-10T23:18:42.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.891+0000 7fdedeffd640 1 -- 172.21.15.90:0/17981610 <== mds.0 v2:172.21.15.90:6832/638480774 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x564eab1cb160 con 0x564eab221c60 2024-09-10T23:18:42.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.891+0000 7fdedeffd640 10 client.7335 handle_command_reply: tid=0 2024-09-10T23:18:42.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.891+0000 7fdf093c0740 1 client.7335 shutdown 2024-09-10T23:18:42.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.891+0000 7fdf093c0740 1 -- 172.21.15.90:0/17981610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab20fdf0 msgr2=0x564eab1c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.891+0000 7fdf093c0740 1 --2- 172.21.15.90:0/17981610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab20fdf0 0x564eab1c9bf0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fdef800c730 tx=0x7fdef80016b0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.891+0000 7fdf093c0740 1 -- 172.21.15.90:0/17981610 shutdown_connections 2024-09-10T23:18:42.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.891+0000 7fdf093c0740 1 --2- 172.21.15.90:0/17981610 >> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] conn(0x564eab221c60 0x564eab1c35d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.891+0000 7fdf093c0740 1 --2- 172.21.15.90:0/17981610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564eab20fdf0 0x564eab1c9bf0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.891+0000 7fdf093c0740 1 --2- 172.21.15.90:0/17981610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564eab1f19b0 0x564eab1f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.891+0000 7fdedeffd640 0 client.7335 ms_handle_reset on v2:172.21.15.90:6832/638480774 2024-09-10T23:18:42.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.891+0000 7fdf093c0740 1 --2- 172.21.15.90:0/17981610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564eab1ecef0 0x564eab22cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.891+0000 7fdf093c0740 1 -- 172.21.15.90:0/17981610 >> 172.21.15.90:0/17981610 conn(0x564eab1cb310 msgr2=0x564eab236db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:42.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.891+0000 7fdf093c0740 1 -- 172.21.15.90:0/17981610 shutdown_connections 2024-09-10T23:18:42.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.891+0000 7fdf093c0740 1 -- 172.21.15.90:0/17981610 wait complete. 2024-09-10T23:18:42.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.891+0000 7fdf093c0740 20 client.7335 trim_cache size 0 max 16384 2024-09-10T23:18:42.900 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:18:42.900 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd", 2024-09-10T23:18:42.900 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2024-09-10T23:18:42.900 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 7281, 2024-09-10T23:18:42.900 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-09-10T23:18:42.901 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-09-10T23:18:42.901 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2024-09-10T23:18:42.901 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 4.400087364, 2024-09-10T23:18:42.901 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 67, 2024-09-10T23:18:42.901 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 108, 2024-09-10T23:18:42.901 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 108, 2024-09-10T23:18:42.901 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 10.254685714000001 2024-09-10T23:18:42.901 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:18:42.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.892+0000 7fdf065f3640 1 -- 172.21.15.90:0/846438076 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdeec077f70 msgr2=0x7fdeec07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.892+0000 7fdf065f3640 1 --2- 172.21.15.90:0/846438076 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdeec077f70 0x7fdeec07a430 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdef0036000 tx=0x7fdef0004730 comp rx=0 tx=0).stop 2024-09-10T23:18:42.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.892+0000 7fdf065f3640 1 -- 172.21.15.90:0/846438076 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf0015a960 msgr2=0x7fdf001e5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.892+0000 7fdf065f3640 1 --2- 172.21.15.90:0/846438076 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf0015a960 0x7fdf001e5220 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fdef800c760 tx=0x7fdef800cb60 comp rx=0 tx=0).stop 2024-09-10T23:18:42.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.892+0000 7fdf065f3640 1 -- 172.21.15.90:0/846438076 shutdown_connections 2024-09-10T23:18:42.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.892+0000 7fdf065f3640 1 --2- 172.21.15.90:0/846438076 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdeec077f70 0x7fdeec07a430 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.892+0000 7fdf065f3640 1 --2- 172.21.15.90:0/846438076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf0006f090 0x7fdf001f2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.892+0000 7fdf065f3640 1 --2- 172.21.15.90:0/846438076 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf0015a960 0x7fdf001e5220 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.892+0000 7fdf065f3640 1 --2- 172.21.15.90:0/846438076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf0006ecb0 0x7fdf0014ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.892+0000 7fdf065f3640 1 -- 172.21.15.90:0/846438076 >> 172.21.15.90:0/846438076 conn(0x7fdf0006cb70 msgr2=0x7fdf001e61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:42.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.892+0000 7fdf065f3640 1 -- 172.21.15.90:0/846438076 shutdown_connections 2024-09-10T23:18:42.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:42.892+0000 7fdf065f3640 1 -- 172.21.15.90:0/846438076 wait complete. 2024-09-10T23:18:42.904 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:18:43.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.004+0000 7f471fee6640 1 -- 172.21.15.90:0/227001209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47181545c0 msgr2=0x7f471806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.004+0000 7f471fee6640 1 --2- 172.21.15.90:0/227001209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47181545c0 0x7f471806e920 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f47140092b0 tx=0x7f471402a420 comp rx=0 tx=0).stop 2024-09-10T23:18:43.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.004+0000 7f471fee6640 1 -- 172.21.15.90:0/227001209 shutdown_connections 2024-09-10T23:18:43.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.004+0000 7f471fee6640 1 --2- 172.21.15.90:0/227001209 >> v2:172.21.15.171:3300/0 conn(0x7f47181549a0 0x7f471806ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.004+0000 7f471fee6640 1 --2- 172.21.15.90:0/227001209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47181545c0 0x7f471806e920 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.004+0000 7f471fee6640 1 -- 172.21.15.90:0/227001209 >> 172.21.15.90:0/227001209 conn(0x7f471806cb70 msgr2=0x7f471806cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:43.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.004+0000 7f471fee6640 1 -- 172.21.15.90:0/227001209 shutdown_connections 2024-09-10T23:18:43.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.004+0000 7f471fee6640 1 -- 172.21.15.90:0/227001209 wait complete. 2024-09-10T23:18:43.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.005+0000 7f471fee6640 1 Processor -- start 2024-09-10T23:18:43.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.005+0000 7f471fee6640 1 -- start start 2024-09-10T23:18:43.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471fee6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47181545c0 0x7f471814fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:43.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471fee6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f471815a820 0x7f4718151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:43.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471fee6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47180cb520 0x7f47180b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:43.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471fee6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f47180cefe0 con 0x7f471815a820 2024-09-10T23:18:43.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471fee6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f47180cee60 con 0x7f47181545c0 2024-09-10T23:18:43.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471fee6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f47180cf160 con 0x7f47180cb520 2024-09-10T23:18:43.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471d481640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f471815a820 0x7f4718151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:43.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471d481640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f471815a820 0x7f4718151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34556/0 (socket says 172.21.15.90:34556) 2024-09-10T23:18:43.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471d481640 1 -- 172.21.15.90:0/4100623798 learned_addr learned my addr 172.21.15.90:0/4100623798 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:43.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471dc82640 1 --2- 172.21.15.90:0/4100623798 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47181545c0 0x7f471814fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:43.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471e483640 1 --2- 172.21.15.90:0/4100623798 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47180cb520 0x7f47180b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:43.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471d481640 1 -- 172.21.15.90:0/4100623798 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47180cb520 msgr2=0x7f47180b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471d481640 1 --2- 172.21.15.90:0/4100623798 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47180cb520 0x7f47180b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471d481640 1 -- 172.21.15.90:0/4100623798 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47181545c0 msgr2=0x7f471814fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471d481640 1 --2- 172.21.15.90:0/4100623798 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47181545c0 0x7f471814fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471d481640 1 -- 172.21.15.90:0/4100623798 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47181516c0 con 0x7f471815a820 2024-09-10T23:18:43.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471e483640 1 --2- 172.21.15.90:0/4100623798 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47180cb520 0x7f47180b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:43.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.006+0000 7f471d481640 1 --2- 172.21.15.90:0/4100623798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f471815a820 0x7f4718151180 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f470800dbc0 tx=0x7f470800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:43.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.007+0000 7f470e7fc640 1 -- 172.21.15.90:0/4100623798 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4708005220 con 0x7f471815a820 2024-09-10T23:18:43.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.007+0000 7f470e7fc640 1 -- 172.21.15.90:0/4100623798 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f470800ae50 con 0x7f471815a820 2024-09-10T23:18:43.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.007+0000 7f471fee6640 1 -- 172.21.15.90:0/4100623798 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47181f4d10 con 0x7f471815a820 2024-09-10T23:18:43.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.007+0000 7f470e7fc640 1 -- 172.21.15.90:0/4100623798 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47080047a0 con 0x7f471815a820 2024-09-10T23:18:43.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.007+0000 7f471fee6640 1 -- 172.21.15.90:0/4100623798 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47181f52d0 con 0x7f471815a820 2024-09-10T23:18:43.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.008+0000 7f471fee6640 1 -- 172.21.15.90:0/4100623798 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f471815acb0 con 0x7f471815a820 2024-09-10T23:18:43.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.008+0000 7f470e7fc640 1 -- 172.21.15.90:0/4100623798 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f470800b040 con 0x7f471815a820 2024-09-10T23:18:43.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.009+0000 7f470e7fc640 1 --2- 172.21.15.90:0/4100623798 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f46fc077f70 0x7f46fc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:43.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.009+0000 7f470e7fc640 1 -- 172.21.15.90:0/4100623798 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7f470809a230 con 0x7f471815a820 2024-09-10T23:18:43.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.009+0000 7f471dc82640 1 --2- 172.21.15.90:0/4100623798 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f46fc077f70 0x7f46fc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:43.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.009+0000 7f471dc82640 1 --2- 172.21.15.90:0/4100623798 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f46fc077f70 0x7f46fc07a430 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4714034000 tx=0x7f4714004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:43.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.013+0000 7f470e7fc640 1 -- 172.21.15.90:0/4100623798 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f47181516c0 con 0x7f471815a820 2024-09-10T23:18:43.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.225+0000 7f471fee6640 1 -- 172.21.15.90:0/4100623798 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f471815c8f0 con 0x7f471815a820 2024-09-10T23:18:43.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.225+0000 7f470e7fc640 1 -- 172.21.15.90:0/4100623798 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) ==== 53+0+73 (secure 0 0 0) 0x7f4708062c30 con 0x7f471815a820 2024-09-10T23:18:43.227 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:18:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.228+0000 7f471fee6640 1 -- 172.21.15.90:0/4100623798 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f46fc077f70 msgr2=0x7f46fc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.228+0000 7f471fee6640 1 --2- 172.21.15.90:0/4100623798 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f46fc077f70 0x7f46fc07a430 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4714034000 tx=0x7f4714004730 comp rx=0 tx=0).stop 2024-09-10T23:18:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.228+0000 7f471fee6640 1 -- 172.21.15.90:0/4100623798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f471815a820 msgr2=0x7f4718151180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.228+0000 7f471fee6640 1 --2- 172.21.15.90:0/4100623798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f471815a820 0x7f4718151180 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f470800dbc0 tx=0x7f470800a620 comp rx=0 tx=0).stop 2024-09-10T23:18:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.228+0000 7f471fee6640 1 -- 172.21.15.90:0/4100623798 shutdown_connections 2024-09-10T23:18:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.228+0000 7f471fee6640 1 --2- 172.21.15.90:0/4100623798 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f46fc077f70 0x7f46fc07a430 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.228+0000 7f471fee6640 1 --2- 172.21.15.90:0/4100623798 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47180cb520 0x7f47180b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.228+0000 7f471fee6640 1 --2- 172.21.15.90:0/4100623798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f471815a820 0x7f4718151180 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.228+0000 7f471fee6640 1 --2- 172.21.15.90:0/4100623798 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47181545c0 0x7f471814fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.228+0000 7f471fee6640 1 -- 172.21.15.90:0/4100623798 >> 172.21.15.90:0/4100623798 conn(0x7f471806cb70 msgr2=0x7f4718158380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:43.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.228+0000 7f471fee6640 1 -- 172.21.15.90:0/4100623798 shutdown_connections 2024-09-10T23:18:43.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43.228+0000 7f471fee6640 1 -- 172.21.15.90:0/4100623798 wait complete. 2024-09-10T23:18:43.240 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:18:43.241 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:18:43.241 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2024-09-10T23:18:43.241 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:18:43.241 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:18:43.241 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:18:43.241 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:18:43.241 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:18:43.241 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:18:43.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:43.242 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2024-09-10T23:18:43.257 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:18:43.257 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:18:43.258 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:18:43.258 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:43.258 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-09-10T23:18:43.258 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:43.258 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:43.258 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:43.258 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2024-09-10T23:18:43.258 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:43.258 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:43.258 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2024-09-10T23:18:43.258 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:43.258 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:43.259 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:18:43.259 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:43.259 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:18:43.259 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42525sec preferred_lft 42525sec 2024-09-10T23:18:43.259 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link noprefixroute 2024-09-10T23:18:43.259 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:43.259 INFO:teuthology.orchestra.run.smithi090.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:18:43.259 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:43.259 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:18:43.259 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:43.259 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::882a:a9ff:fefc:893f/64 scope link 2024-09-10T23:18:43.259 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:43.259 INFO:teuthology.orchestra.run.smithi090.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:18:43.259 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 76:ad:51:1a:2a:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:18:43.260 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::74ad:51ff:fe1a:2a60/64 scope link 2024-09-10T23:18:43.260 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:43.260 INFO:teuthology.orchestra.run.smithi090.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:18:43.260 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 36:14:ab:49:36:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:18:43.260 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::3414:abff:fe49:366c/64 scope link 2024-09-10T23:18:43.260 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:43.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:43.260 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:18:43.321 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-09-10T23:18:43.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:43.323 DEBUG:teuthology.orchestra.run.smithi090:> route 2024-09-10T23:18:43.378 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2024-09-10T23:18:43.378 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:18:43.378 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:18:43.378 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:18:43.379 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:18:43.379 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:18:43.379 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-09-10T23:18:43.379 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:18:43.379 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:18:43.379 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:18:43.379 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-09-10T23:18:43.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:18:43.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:18:43.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:43.504 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-10T23:18:43.508 INFO:tasks.ceph.mds.c.smithi090.stderr:2024-09-10T23:18:43.508+0000 7f12789fb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:18:43.520 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:18:43.520 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:18:43.521 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:18:43.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:43.521 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2024-09-10T23:18:43.585 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:18:43.585 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:18:43.641 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:18:43.641 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:18:43.641 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:18:43.697 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:18:43.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:43.698 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:18:43.781 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:18:43.781 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:18:43.781 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:18:43.789 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:18:43.790 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:18:43.790 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:18:43.790 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:18:43.790 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:18:43.794 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T23:18:43.795 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T23:18:43.795 INFO:teuthology.orchestra.run.smithi090.stdout:invalid new device string format 2024-09-10T23:18:43.795 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:18:43.795 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:18:43.795 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:18:43.795 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:18:43.795 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:18:43.795 INFO:teuthology.orchestra.run.smithi090.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T23:18:43.796 INFO:teuthology.orchestra.run.smithi090.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:18:43.796 INFO:teuthology.orchestra.run.smithi090.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:18:43.796 INFO:teuthology.orchestra.run.smithi090.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:18:43.796 INFO:teuthology.orchestra.run.smithi090.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:18:43.797 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:18:43.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:43.798 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:18:43.862 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:18:43.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:18:43.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:18:43.958 INFO:teuthology.orchestra.run.smithi090.stdout:client6493 2024-09-10T23:18:43.958 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:18:43.958 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:43.974 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:18:44.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.114+0000 7f622d662640 1 -- 172.21.15.90:0/3826185640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62280cec90 msgr2=0x7f622815f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:44.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.114+0000 7f622d662640 1 --2- 172.21.15.90:0/3826185640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62280cec90 0x7f622815f5a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6210009830 tx=0x7f621002a480 comp rx=0 tx=0).stop 2024-09-10T23:18:44.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.114+0000 7f622d662640 1 -- 172.21.15.90:0/3826185640 shutdown_connections 2024-09-10T23:18:44.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.114+0000 7f622d662640 1 --2- 172.21.15.90:0/3826185640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f622815e6e0 0x7f62280d0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.114+0000 7f622d662640 1 --2- 172.21.15.90:0/3826185640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62280cec90 0x7f622815f5a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.114+0000 7f622d662640 1 -- 172.21.15.90:0/3826185640 >> 172.21.15.90:0/3826185640 conn(0x7f6228069120 msgr2=0x7f622806dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:44.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.114+0000 7f622d662640 1 -- 172.21.15.90:0/3826185640 shutdown_connections 2024-09-10T23:18:44.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.114+0000 7f622d662640 1 -- 172.21.15.90:0/3826185640 wait complete. 2024-09-10T23:18:44.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.115+0000 7f622d662640 1 Processor -- start 2024-09-10T23:18:44.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.115+0000 7f622d662640 1 -- start start 2024-09-10T23:18:44.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.116+0000 7f622d662640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62280cec90 0x7f62280d2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:44.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.116+0000 7f622d662640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f622815e300 0x7f62280d3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:44.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.116+0000 7f622d662640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f622815e6e0 0x7f62280ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:44.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.116+0000 7f622d662640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f62280d2710 con 0x7f62280cec90 2024-09-10T23:18:44.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.116+0000 7f622d662640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f62280d2590 con 0x7f622815e300 2024-09-10T23:18:44.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.116+0000 7f622d662640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f62280d2890 con 0x7f622815e6e0 2024-09-10T23:18:44.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.116+0000 7f6226ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62280cec90 0x7f62280d2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:44.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.116+0000 7f6226ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62280cec90 0x7f62280d2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34560/0 (socket says 172.21.15.90:34560) 2024-09-10T23:18:44.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.116+0000 7f6226ffd640 1 -- 172.21.15.90:0/50237045 learned_addr learned my addr 172.21.15.90:0/50237045 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:44.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.116+0000 7f6226ffd640 1 -- 172.21.15.90:0/50237045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f622815e6e0 msgr2=0x7f62280ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:44.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.116+0000 7f6226ffd640 1 --2- 172.21.15.90:0/50237045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f622815e6e0 0x7f62280ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.116+0000 7f6226ffd640 1 -- 172.21.15.90:0/50237045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f622815e300 msgr2=0x7f62280d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:44.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.116+0000 7f6226ffd640 1 --2- 172.21.15.90:0/50237045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f622815e300 0x7f62280d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.116+0000 7f6226ffd640 1 -- 172.21.15.90:0/50237045 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62280cd810 con 0x7f62280cec90 2024-09-10T23:18:44.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.117+0000 7f6226ffd640 1 --2- 172.21.15.90:0/50237045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62280cec90 0x7f62280d2cf0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f621800c490 tx=0x7f621800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:44.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.117+0000 7f621f7fe640 1 -- 172.21.15.90:0/50237045 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62180052d0 con 0x7f62280cec90 2024-09-10T23:18:44.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.117+0000 7f621f7fe640 1 -- 172.21.15.90:0/50237045 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6218005490 con 0x7f62280cec90 2024-09-10T23:18:44.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.117+0000 7f622d662640 1 -- 172.21.15.90:0/50237045 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62281f8680 con 0x7f62280cec90 2024-09-10T23:18:44.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.117+0000 7f621f7fe640 1 -- 172.21.15.90:0/50237045 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6218012870 con 0x7f62280cec90 2024-09-10T23:18:44.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.117+0000 7f622d662640 1 -- 172.21.15.90:0/50237045 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62281f8c40 con 0x7f62280cec90 2024-09-10T23:18:44.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.118+0000 7f622d662640 1 -- 172.21.15.90:0/50237045 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62281f8470 con 0x7f62280cec90 2024-09-10T23:18:44.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.119+0000 7f621f7fe640 1 -- 172.21.15.90:0/50237045 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6218012a10 con 0x7f62280cec90 2024-09-10T23:18:44.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.119+0000 7f621f7fe640 1 --2- 172.21.15.90:0/50237045 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6208077f70 0x7f620807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:44.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.119+0000 7f621f7fe640 1 -- 172.21.15.90:0/50237045 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7f6218099950 con 0x7f62280cec90 2024-09-10T23:18:44.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.119+0000 7f621ffff640 1 --2- 172.21.15.90:0/50237045 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6208077f70 0x7f620807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:44.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.120+0000 7f621ffff640 1 --2- 172.21.15.90:0/50237045 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6208077f70 0x7f620807a430 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6210034000 tx=0x7f62100046c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:44.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.123+0000 7f621f7fe640 1 -- 172.21.15.90:0/50237045 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f62180623e0 con 0x7f62280cec90 2024-09-10T23:18:44.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.337+0000 7f622d662640 1 -- 172.21.15.90:0/50237045 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f622815f5a0 con 0x7f62280cec90 2024-09-10T23:18:44.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.338+0000 7f621f7fe640 1 -- 172.21.15.90:0/50237045 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) ==== 53+0+73 (secure 0 0 0) 0x7f6218061ce0 con 0x7f62280cec90 2024-09-10T23:18:44.340 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:18:44.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.340+0000 7f622d662640 1 -- 172.21.15.90:0/50237045 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6208077f70 msgr2=0x7f620807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:44.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.340+0000 7f622d662640 1 --2- 172.21.15.90:0/50237045 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6208077f70 0x7f620807a430 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6210034000 tx=0x7f62100046c0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.340+0000 7f622d662640 1 -- 172.21.15.90:0/50237045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62280cec90 msgr2=0x7f62280d2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:44.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.340+0000 7f622d662640 1 --2- 172.21.15.90:0/50237045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62280cec90 0x7f62280d2cf0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f621800c490 tx=0x7f621800c950 comp rx=0 tx=0).stop 2024-09-10T23:18:44.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.340+0000 7f622d662640 1 -- 172.21.15.90:0/50237045 shutdown_connections 2024-09-10T23:18:44.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.340+0000 7f622d662640 1 --2- 172.21.15.90:0/50237045 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f6208077f70 0x7f620807a430 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.340+0000 7f622d662640 1 --2- 172.21.15.90:0/50237045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f622815e300 0x7f62280d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.340+0000 7f622d662640 1 --2- 172.21.15.90:0/50237045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f622815e6e0 0x7f62280ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.340+0000 7f622d662640 1 --2- 172.21.15.90:0/50237045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62280cec90 0x7f62280d2cf0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.340+0000 7f622d662640 1 -- 172.21.15.90:0/50237045 >> 172.21.15.90:0/50237045 conn(0x7f6228069120 msgr2=0x7f62280b88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:44.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.340+0000 7f622d662640 1 -- 172.21.15.90:0/50237045 shutdown_connections 2024-09-10T23:18:44.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:44.340+0000 7f622d662640 1 -- 172.21.15.90:0/50237045 wait complete. 2024-09-10T23:18:44.352 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:18:44.352 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:18:44.352 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-09-10T23:18:44.352 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T23:18:44.352 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T23:18:44.352 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:18:44.353 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T23:18:44.353 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:18:44.353 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:18:44.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:44.353 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-09-10T23:18:44.373 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:18:44.373 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:18:44.373 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:18:44.373 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:44.373 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-09-10T23:18:44.373 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:44.373 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:44.373 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:44.374 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-09-10T23:18:44.374 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:44.374 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:44.374 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-09-10T23:18:44.374 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:18:44.374 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:44.374 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:18:44.374 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:44.374 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T23:18:44.374 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42506sec preferred_lft 42506sec 2024-09-10T23:18:44.374 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link noprefixroute 2024-09-10T23:18:44.374 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:44.375 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:18:44.375 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:18:44.375 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:18:44.375 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:44.375 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::c18:12ff:fe41:788b/64 scope link 2024-09-10T23:18:44.375 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:44.375 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:18:44.375 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a2:e4:c6:48:8d:44 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:18:44.375 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a0e4:c6ff:fe48:8d44/64 scope link 2024-09-10T23:18:44.375 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:44.375 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:18:44.376 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether a6:c9:8b:0f:78:86 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:18:44.376 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::a4c9:8bff:fe0f:7886/64 scope link 2024-09-10T23:18:44.376 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:18:44.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:44.376 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:18:44.441 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-09-10T23:18:44.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:44.443 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-09-10T23:18:44.502 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-09-10T23:18:44.502 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:18:44.502 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:18:44.502 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:18:44.502 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:18:44.502 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:18:44.503 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-09-10T23:18:44.503 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:18:44.503 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:18:44.503 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:18:44.503 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-09-10T23:18:44.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:18:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:18:44.629 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:18:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:18:44.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:44.636 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-09-10T23:18:44.651 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T23:18:44.652 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T23:18:44.652 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:18:44.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:44.652 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-09-10T23:18:44.716 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:18:44.717 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T23:18:44.772 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:18:44.772 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:18:44.772 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:18:44.827 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T23:18:44.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:44.828 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:18:44.911 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:18:44.911 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:18:44.911 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:18:44.919 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:18:44.919 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:18:44.920 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:18:44.920 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:18:44.920 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:18:44.925 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T23:18:44.925 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T23:18:44.925 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2024-09-10T23:18:44.925 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-09-10T23:18:44.925 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T23:18:44.926 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790" 2024-09-10T23:18:44.926 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.90:6789,172.21.15.171:6789,172.21.15.171:6790:/ 2024-09-10T23:18:44.926 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd" will pass to kernel 2024-09-10T23:18:44.926 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T23:18:44.926 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:18:44.926 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:18:44.926 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:18:44.926 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:18:44.927 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:18:44.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:44.928 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:18:44.992 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:18:45.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:18:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:18:45.082 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-10T23:18:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:18:45.088 INFO:teuthology.orchestra.run.smithi171.stdout:client6128 2024-09-10T23:18:45.088 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:18:45.088 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:45.104 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-10T23:18:45.221 INFO:teuthology.orchestra.run.smithi090.stdout:[{"id":6128,"entity":{"name":{"type":"client","num":6128},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":683587795}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":0.288995434,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.99933481055605222,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6128 v1:192.168.0.1:0/683587795","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi171","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":6493,"entity":{"name":{"type":"client","num":6493},"addr":{"type":"v1","addr":"172.21.15.90:0","nonce":2562624497}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":1.419977563,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.9967268341669735,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6493 v1:172.21.15.90:0/2562624497","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi090","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-10T23:18:45.222 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 683587795, "type": "v1" }, "name": { "num": 6128, "type": "client" } }, "id": 6128, "inst": "client.6128 v1:192.168.0.1:0/683587795", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9993348105560522 }, "state": "open", "uptime": 0.288995434 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi090", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.90:0", "nonce": 2562624497, "type": "v1" }, "name": { "num": 6493, "type": "client" } }, "id": 6493, "inst": "client.6493 v1:172.21.15.90:0/2562624497", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9967268341669735 }, "state": "open", "uptime": 1.419977563 } ] 2024-09-10T23:18:45.222 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-10T23:18:45.349 INFO:teuthology.orchestra.run.smithi090.stdout:{"message":"","return_code":0} 2024-09-10T23:18:45.350 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T23:18:45.350 DEBUG:teuthology.orchestra.run.smithi090:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show session 2024-09-10T23:18:45.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.389+0000 7ff59b356280 1 -- start start 2024-09-10T23:18:45.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.390+0000 7ff59b356280 1 Processor -- start 2024-09-10T23:18:45.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.390+0000 7ff59b356280 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b89fe0c400 0x55b89fded600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.390+0000 7ff59b356280 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b89f011c00 0x55b89fdecb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.390+0000 7ff59b356280 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89fe0c800 0x55b89fdedb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.390+0000 7ff59b356280 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b89fe12480 con 0x55b89fe0c800 2024-09-10T23:18:45.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.390+0000 7ff59b356280 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b89fe12600 con 0x55b89fe0c400 2024-09-10T23:18:45.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.390+0000 7ff59b356280 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55b89fe12780 con 0x55b89f011c00 2024-09-10T23:18:45.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.390+0000 7ff59a2fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89fe0c800 0x55b89fdedb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.390+0000 7ff59a2fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89fe0c800 0x55b89fdedb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34578/0 (socket says 172.21.15.90:34578) 2024-09-10T23:18:45.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.390+0000 7ff59a2fc640 1 -- 172.21.15.90:0/1593922244 learned_addr learned my addr 172.21.15.90:0/1593922244 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:45.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.390+0000 7ff5992fa640 1 --2- 172.21.15.90:0/1593922244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b89f011c00 0x55b89fdecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.390+0000 7ff599afb640 1 --2- 172.21.15.90:0/1593922244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b89fe0c400 0x55b89fded600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.391+0000 7ff59a2fc640 1 -- 172.21.15.90:0/1593922244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b89f011c00 msgr2=0x55b89fdecb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:45.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.391+0000 7ff59a2fc640 1 --2- 172.21.15.90:0/1593922244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b89f011c00 0x55b89fdecb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.391+0000 7ff59a2fc640 1 -- 172.21.15.90:0/1593922244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b89fe0c400 msgr2=0x55b89fded600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:45.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.391+0000 7ff59a2fc640 1 --2- 172.21.15.90:0/1593922244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b89fe0c400 0x55b89fded600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.391+0000 7ff59a2fc640 1 -- 172.21.15.90:0/1593922244 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b89f04e780 con 0x55b89fe0c800 2024-09-10T23:18:45.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.391+0000 7ff59a2fc640 1 --2- 172.21.15.90:0/1593922244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89fe0c800 0x55b89fdedb80 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x55b89fe4f890 tx=0x55b89fd82c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac93352936c4170f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:45.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.391+0000 7ff5972f6640 1 -- 172.21.15.90:0/1593922244 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b89f036b60 con 0x55b89fe0c800 2024-09-10T23:18:45.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.391+0000 7ff5972f6640 1 -- 172.21.15.90:0/1593922244 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b89f03d180 con 0x55b89fe0c800 2024-09-10T23:18:45.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.391+0000 7ff5972f6640 1 -- 172.21.15.90:0/1593922244 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b89f036ea0 con 0x55b89fe0c800 2024-09-10T23:18:45.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.391+0000 7ff59b356280 1 -- 172.21.15.90:0/1593922244 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b89f04e000 con 0x55b89fe0c800 2024-09-10T23:18:45.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.391+0000 7ff59b356280 1 -- 172.21.15.90:0/1593922244 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55b89f04f680 con 0x55b89fe0c800 2024-09-10T23:18:45.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.391+0000 7ff59b356280 4 waiting for MDS map... 2024-09-10T23:18:45.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.391+0000 7ff5972f6640 1 -- 172.21.15.90:0/1593922244 <== mon.0 v2:172.21.15.90:3300/0 4 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x55b89ff00600 con 0x55b89fe0c800 2024-09-10T23:18:45.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.391+0000 7ff5972f6640 1 -- 172.21.15.90:0/1593922244 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 67) ==== 3502+0+0 (secure 0 0 0) 0x55b89f06b180 con 0x55b89fe0c800 2024-09-10T23:18:45.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.391+0000 7ff59b356280 4 Got MDS map 67 2024-09-10T23:18:45.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.391+0000 7ff59b356280 10 main: main 2024-09-10T23:18:45.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.391+0000 7ff59b356280 4 main: connecting to RADOS... 2024-09-10T23:18:45.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.392+0000 7ff59b356280 1 Processor -- start 2024-09-10T23:18:45.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.392+0000 7ff59b356280 1 -- start start 2024-09-10T23:18:45.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.392+0000 7ff59b356280 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b89ff04c00 0x55b89fded080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.392+0000 7ff59b356280 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b89ff05000 0x55b89fdec580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.392+0000 7ff59b356280 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89ff05400 0x55b89fdee100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.392+0000 7ff59b356280 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b89f073980 con 0x55b89ff05400 2024-09-10T23:18:45.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.392+0000 7ff59b356280 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b89fe13680 con 0x55b89ff04c00 2024-09-10T23:18:45.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.392+0000 7ff59b356280 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55b89fe13500 con 0x55b89ff05000 2024-09-10T23:18:45.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff5992fa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89ff05400 0x55b89fdee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff5992fa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89ff05400 0x55b89fdee100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34580/0 (socket says 172.21.15.90:34580) 2024-09-10T23:18:45.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff5992fa640 1 -- 172.21.15.90:0/424811865 learned_addr learned my addr 172.21.15.90:0/424811865 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:45.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff599afb640 1 --2- 172.21.15.90:0/424811865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b89ff05000 0x55b89fdec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff5992fa640 1 --2- 172.21.15.90:0/424811865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b89ff04c00 0x55b89fded080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff5992fa640 1 -- 172.21.15.90:0/424811865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b89ff05000 msgr2=0x55b89fdec580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:45.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff5992fa640 1 --2- 172.21.15.90:0/424811865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b89ff05000 0x55b89fdec580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff5992fa640 1 -- 172.21.15.90:0/424811865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b89ff04c00 msgr2=0x55b89fded080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:45.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff5992fa640 1 --2- 172.21.15.90:0/424811865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b89ff04c00 0x55b89fded080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff5992fa640 1 -- 172.21.15.90:0/424811865 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b89f04f860 con 0x55b89ff05400 2024-09-10T23:18:45.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff5992fa640 1 --2- 172.21.15.90:0/424811865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89ff05400 0x55b89fdee100 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x55b89fe4f3b0 tx=0x55b89ff1ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557619b1234a5e6c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:45.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff5952f2640 1 -- 172.21.15.90:0/424811865 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b89f036b60 con 0x55b89ff05400 2024-09-10T23:18:45.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff5952f2640 1 -- 172.21.15.90:0/424811865 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b89f03c540 con 0x55b89ff05400 2024-09-10T23:18:45.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff5952f2640 1 -- 172.21.15.90:0/424811865 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b89f036ea0 con 0x55b89ff05400 2024-09-10T23:18:45.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff59b356280 1 -- 172.21.15.90:0/424811865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89ff05400 msgr2=0x55b89fdee100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:45.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff59b356280 1 --2- 172.21.15.90:0/424811865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89ff05400 0x55b89fdee100 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x55b89fe4f3b0 tx=0x55b89ff1ccc0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff59b356280 1 -- 172.21.15.90:0/424811865 shutdown_connections 2024-09-10T23:18:45.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff59b356280 1 --2- 172.21.15.90:0/424811865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89ff05400 0x55b89fdee100 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff59b356280 1 --2- 172.21.15.90:0/424811865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b89ff05000 0x55b89fdec580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff59b356280 1 --2- 172.21.15.90:0/424811865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b89ff04c00 0x55b89fded080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.393+0000 7ff59b356280 1 -- 172.21.15.90:0/424811865 >> 172.21.15.90:0/424811865 conn(0x55b89fe0c000 msgr2=0x55b89f121800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:45.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.394+0000 7ff59b356280 1 -- 172.21.15.90:0/424811865 shutdown_connections 2024-09-10T23:18:45.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.394+0000 7ff59b356280 1 -- 172.21.15.90:0/424811865 wait complete. 2024-09-10T23:18:45.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.394+0000 7ff59b356280 1 Processor -- start 2024-09-10T23:18:45.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.394+0000 7ff59b356280 1 -- start start 2024-09-10T23:18:45.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff59b356280 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b89ff04c00 0x55b89fdef180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff59b356280 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89ff05000 0x55b89fdeec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff59b356280 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b89ff05400 0x55b89fdee680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff59b356280 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b89fe12900 con 0x55b89ff05000 2024-09-10T23:18:45.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff59b356280 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b89fe12a80 con 0x55b89ff05400 2024-09-10T23:18:45.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff59b356280 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55b89fe12180 con 0x55b89ff04c00 2024-09-10T23:18:45.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff599afb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89ff05000 0x55b89fdeec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff599afb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89ff05000 0x55b89fdeec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34586/0 (socket says 172.21.15.90:34586) 2024-09-10T23:18:45.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff599afb640 1 -- 172.21.15.90:0/2797588734 learned_addr learned my addr 172.21.15.90:0/2797588734 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:45.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff5992fa640 1 --2- 172.21.15.90:0/2797588734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b89ff05400 0x55b89fdee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff5992fa640 1 --2- 172.21.15.90:0/2797588734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b89ff04c00 0x55b89fdef180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff599afb640 1 -- 172.21.15.90:0/2797588734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b89ff04c00 msgr2=0x55b89fdef180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:45.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff599afb640 1 --2- 172.21.15.90:0/2797588734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b89ff04c00 0x55b89fdef180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff599afb640 1 -- 172.21.15.90:0/2797588734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b89ff05400 msgr2=0x55b89fdee680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:45.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff599afb640 1 --2- 172.21.15.90:0/2797588734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b89ff05400 0x55b89fdee680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff599afb640 1 -- 172.21.15.90:0/2797588734 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b89f04f4a0 con 0x55b89ff05000 2024-09-10T23:18:45.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff599afb640 1 --2- 172.21.15.90:0/2797588734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89ff05000 0x55b89fdeec00 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x55b89ff15590 tx=0x55b89ff1d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:45.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff593aef640 1 -- 172.21.15.90:0/2797588734 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b89f036b60 con 0x55b89ff05000 2024-09-10T23:18:45.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff593aef640 1 -- 172.21.15.90:0/2797588734 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b89f03cfc0 con 0x55b89ff05000 2024-09-10T23:18:45.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff59b356280 1 -- 172.21.15.90:0/2797588734 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b89f04e960 con 0x55b89ff05000 2024-09-10T23:18:45.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff593aef640 1 -- 172.21.15.90:0/2797588734 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b89f036ea0 con 0x55b89ff05000 2024-09-10T23:18:45.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff59b356280 1 -- 172.21.15.90:0/2797588734 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b89f04e3c0 con 0x55b89ff05000 2024-09-10T23:18:45.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.395+0000 7ff59b356280 4 main: resolving pool 16 2024-09-10T23:18:45.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.397+0000 7ff593aef640 1 -- 172.21.15.90:0/2797588734 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x55b89f06b500 con 0x55b89ff05000 2024-09-10T23:18:45.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.397+0000 7ff593aef640 1 --2- 172.21.15.90:0/2797588734 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x55b89fe36c00 0x55b89fdef700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.397+0000 7ff593aef640 1 -- 172.21.15.90:0/2797588734 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x55b89ff70a00 con 0x55b89ff05000 2024-09-10T23:18:45.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.397+0000 7ff59b356280 4 main: creating IoCtx.. 2024-09-10T23:18:45.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.397+0000 7ff59b356280 1 --2- 172.21.15.90:0/2797588734 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x55b89ff05800 0x55b89fdee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.397+0000 7ff59b356280 1 -- 172.21.15.90:0/2797588734 --> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] -- osd_op(unknown.0.0:1 16.b 16:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108) -- 0x55b89ff05c00 con 0x55b89ff05800 2024-09-10T23:18:45.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.397+0000 7ff5992fa640 1 --2- 172.21.15.90:0/2797588734 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x55b89fe36c00 0x55b89fdef700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.397+0000 7ff5992fa640 1 --2- 172.21.15.90:0/2797588734 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x55b89ff05800 0x55b89fdee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.397+0000 7ff5992fa640 1 --2- 172.21.15.90:0/2797588734 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x55b89ff05800 0x55b89fdee100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:45.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.397+0000 7ff5992fa640 1 --2- 172.21.15.90:0/2797588734 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x55b89fe36c00 0x55b89fdef700 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x55b89fe4f5c0 tx=0x55b89ff1d380 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:45.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.398+0000 7ff5992fa640 1 -- 172.21.15.90:0/2797588734 <== osd.1 v2:172.21.15.90:6824/165329743 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv5 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x55b89f192000 con 0x55b89ff05800 2024-09-10T23:18:45.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.398+0000 7ff59b356280 1 -- 172.21.15.90:0/2797588734 --> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] -- osd_op(unknown.0.0:2 16.b 16:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108) -- 0x55b89fe37000 con 0x55b89ff05800 2024-09-10T23:18:45.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.398+0000 7ff5992fa640 1 -- 172.21.15.90:0/2797588734 <== osd.1 v2:172.21.15.90:6824/165329743 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=471b] v0'0 uv5 ondisk = 0) ==== 159+0+471 (crc 0 0 0) 0x55b89f192000 con 0x55b89ff05800 2024-09-10T23:18:45.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.398+0000 7ff59b356280 1 -- 172.21.15.90:0/2797588734 --> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] -- osd_op(unknown.0.0:3 16.b 16:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108) -- 0x55b89fe37400 con 0x55b89ff05800 2024-09-10T23:18:45.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.398+0000 7ff5992fa640 1 -- 172.21.15.90:0/2797588734 <== osd.1 v2:172.21.15.90:6824/165329743 3 ==== osd_op_reply(3 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x55b89f192000 con 0x55b89ff05800 2024-09-10T23:18:45.408 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:18:45.408 INFO:teuthology.orchestra.run.smithi090.stdout: "0": { 2024-09-10T23:18:45.408 INFO:teuthology.orchestra.run.smithi090.stdout: "data": { 2024-09-10T23:18:45.408 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions": [ 2024-09-10T23:18:45.408 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:45.408 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 6493, 2024-09-10T23:18:45.408 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": { 2024-09-10T23:18:45.408 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2024-09-10T23:18:45.408 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2024-09-10T23:18:45.408 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6493 2024-09-10T23:18:45.408 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.408 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2024-09-10T23:18:45.409 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-10T23:18:45.409 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "172.21.15.90:0", 2024-09-10T23:18:45.409 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 2562624497 2024-09-10T23:18:45.409 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:45.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.409 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "open", 2024-09-10T23:18:45.409 INFO:teuthology.orchestra.run.smithi090.stdout: "num_leases": 0, 2024-09-10T23:18:45.409 INFO:teuthology.orchestra.run.smithi090.stdout: "num_caps": 0, 2024-09-10T23:18:45.409 INFO:teuthology.orchestra.run.smithi090.stdout: "request_load_avg": 0, 2024-09-10T23:18:45.409 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 0, 2024-09-10T23:18:45.409 INFO:teuthology.orchestra.run.smithi090.stdout: "requests_in_flight": 0, 2024-09-10T23:18:45.409 INFO:teuthology.orchestra.run.smithi090.stdout: "num_completed_requests": 0, 2024-09-10T23:18:45.409 INFO:teuthology.orchestra.run.smithi090.stdout: "num_completed_flushes": 0, 2024-09-10T23:18:45.410 INFO:teuthology.orchestra.run.smithi090.stdout: "reconnecting": false, 2024-09-10T23:18:45.410 INFO:teuthology.orchestra.run.smithi090.stdout: "recall_caps": { 2024-09-10T23:18:45.410 INFO:teuthology.orchestra.run.smithi090.stdout: "value": 0, 2024-09-10T23:18:45.410 INFO:teuthology.orchestra.run.smithi090.stdout: "halflife": 60 2024-09-10T23:18:45.410 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.410 INFO:teuthology.orchestra.run.smithi090.stdout: "release_caps": { 2024-09-10T23:18:45.410 INFO:teuthology.orchestra.run.smithi090.stdout: "value": 0, 2024-09-10T23:18:45.410 INFO:teuthology.orchestra.run.smithi090.stdout: "halflife": 60 2024-09-10T23:18:45.410 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.410 INFO:teuthology.orchestra.run.smithi090.stdout: "recall_caps_throttle": { 2024-09-10T23:18:45.410 INFO:teuthology.orchestra.run.smithi090.stdout: "value": 0, 2024-09-10T23:18:45.410 INFO:teuthology.orchestra.run.smithi090.stdout: "halflife": 1.5 2024-09-10T23:18:45.410 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.410 INFO:teuthology.orchestra.run.smithi090.stdout: "recall_caps_throttle2o": { 2024-09-10T23:18:45.410 INFO:teuthology.orchestra.run.smithi090.stdout: "value": 0, 2024-09-10T23:18:45.411 INFO:teuthology.orchestra.run.smithi090.stdout: "halflife": 0.5 2024-09-10T23:18:45.411 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.411 INFO:teuthology.orchestra.run.smithi090.stdout: "session_cache_liveness": { 2024-09-10T23:18:45.411 INFO:teuthology.orchestra.run.smithi090.stdout: "value": 0, 2024-09-10T23:18:45.411 INFO:teuthology.orchestra.run.smithi090.stdout: "halflife": 300 2024-09-10T23:18:45.411 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.411 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_acquisition": { 2024-09-10T23:18:45.411 INFO:teuthology.orchestra.run.smithi090.stdout: "value": 0, 2024-09-10T23:18:45.411 INFO:teuthology.orchestra.run.smithi090.stdout: "halflife": 30 2024-09-10T23:18:45.411 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.411 INFO:teuthology.orchestra.run.smithi090.stdout: "last_trim_completed_requests_tid": 0, 2024-09-10T23:18:45.411 INFO:teuthology.orchestra.run.smithi090.stdout: "last_trim_completed_flushes_tid": 0, 2024-09-10T23:18:45.412 INFO:teuthology.orchestra.run.smithi090.stdout: "delegated_inos": [], 2024-09-10T23:18:45.412 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": "client.6493 v1:172.21.15.90:0/2562624497", 2024-09-10T23:18:45.412 INFO:teuthology.orchestra.run.smithi090.stdout: "completed_requests": [], 2024-09-10T23:18:45.412 INFO:teuthology.orchestra.run.smithi090.stdout: "prealloc_inos": [], 2024-09-10T23:18:45.412 INFO:teuthology.orchestra.run.smithi090.stdout: "client_metadata": { 2024-09-10T23:18:45.412 INFO:teuthology.orchestra.run.smithi090.stdout: "client_features": { 2024-09-10T23:18:45.412 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_bits": "0x000000000003fbff" 2024-09-10T23:18:45.412 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.412 INFO:teuthology.orchestra.run.smithi090.stdout: "metric_spec": { 2024-09-10T23:18:45.412 INFO:teuthology.orchestra.run.smithi090.stdout: "metric_flags": { 2024-09-10T23:18:45.412 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_bits": "0x000000000080ffff" 2024-09-10T23:18:45.412 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:45.412 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.413 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "0", 2024-09-10T23:18:45.413 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2024-09-10T23:18:45.413 INFO:teuthology.orchestra.run.smithi090.stdout: "kernel_version": "5.14.0-505.el9.x86_64", 2024-09-10T23:18:45.413 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2024-09-10T23:18:45.413 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:45.413 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-10T23:18:45.413 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 6128, 2024-09-10T23:18:45.413 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": { 2024-09-10T23:18:45.413 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2024-09-10T23:18:45.413 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2024-09-10T23:18:45.413 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 6128 2024-09-10T23:18:45.414 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.414 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2024-09-10T23:18:45.414 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2024-09-10T23:18:45.414 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:18:45.414 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 683587795 2024-09-10T23:18:45.414 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:45.414 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.414 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "open", 2024-09-10T23:18:45.414 INFO:teuthology.orchestra.run.smithi090.stdout: "num_leases": 0, 2024-09-10T23:18:45.414 INFO:teuthology.orchestra.run.smithi090.stdout: "num_caps": 0, 2024-09-10T23:18:45.414 INFO:teuthology.orchestra.run.smithi090.stdout: "request_load_avg": 0, 2024-09-10T23:18:45.414 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 0, 2024-09-10T23:18:45.414 INFO:teuthology.orchestra.run.smithi090.stdout: "requests_in_flight": 0, 2024-09-10T23:18:45.414 INFO:teuthology.orchestra.run.smithi090.stdout: "num_completed_requests": 0, 2024-09-10T23:18:45.415 INFO:teuthology.orchestra.run.smithi090.stdout: "num_completed_flushes": 0, 2024-09-10T23:18:45.415 INFO:teuthology.orchestra.run.smithi090.stdout: "reconnecting": false, 2024-09-10T23:18:45.415 INFO:teuthology.orchestra.run.smithi090.stdout: "recall_caps": { 2024-09-10T23:18:45.415 INFO:teuthology.orchestra.run.smithi090.stdout: "value": 0, 2024-09-10T23:18:45.415 INFO:teuthology.orchestra.run.smithi090.stdout: "halflife": 60 2024-09-10T23:18:45.415 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.415 INFO:teuthology.orchestra.run.smithi090.stdout: "release_caps": { 2024-09-10T23:18:45.415 INFO:teuthology.orchestra.run.smithi090.stdout: "value": 0, 2024-09-10T23:18:45.415 INFO:teuthology.orchestra.run.smithi090.stdout: "halflife": 60 2024-09-10T23:18:45.415 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.415 INFO:teuthology.orchestra.run.smithi090.stdout: "recall_caps_throttle": { 2024-09-10T23:18:45.415 INFO:teuthology.orchestra.run.smithi090.stdout: "value": 0, 2024-09-10T23:18:45.416 INFO:teuthology.orchestra.run.smithi090.stdout: "halflife": 1.5 2024-09-10T23:18:45.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.416 INFO:teuthology.orchestra.run.smithi090.stdout: "recall_caps_throttle2o": { 2024-09-10T23:18:45.416 INFO:teuthology.orchestra.run.smithi090.stdout: "value": 0, 2024-09-10T23:18:45.416 INFO:teuthology.orchestra.run.smithi090.stdout: "halflife": 0.5 2024-09-10T23:18:45.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.416 INFO:teuthology.orchestra.run.smithi090.stdout: "session_cache_liveness": { 2024-09-10T23:18:45.416 INFO:teuthology.orchestra.run.smithi090.stdout: "value": 0, 2024-09-10T23:18:45.416 INFO:teuthology.orchestra.run.smithi090.stdout: "halflife": 300 2024-09-10T23:18:45.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.416 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_acquisition": { 2024-09-10T23:18:45.416 INFO:teuthology.orchestra.run.smithi090.stdout: "value": 0, 2024-09-10T23:18:45.416 INFO:teuthology.orchestra.run.smithi090.stdout: "halflife": 30 2024-09-10T23:18:45.417 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.417 INFO:teuthology.orchestra.run.smithi090.stdout: "last_trim_completed_requests_tid": 0, 2024-09-10T23:18:45.417 INFO:teuthology.orchestra.run.smithi090.stdout: "last_trim_completed_flushes_tid": 0, 2024-09-10T23:18:45.417 INFO:teuthology.orchestra.run.smithi090.stdout: "delegated_inos": [], 2024-09-10T23:18:45.417 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": "client.6128 v1:192.168.0.1:0/683587795", 2024-09-10T23:18:45.417 INFO:teuthology.orchestra.run.smithi090.stdout: "completed_requests": [], 2024-09-10T23:18:45.417 INFO:teuthology.orchestra.run.smithi090.stdout: "prealloc_inos": [], 2024-09-10T23:18:45.417 INFO:teuthology.orchestra.run.smithi090.stdout: "client_metadata": { 2024-09-10T23:18:45.417 INFO:teuthology.orchestra.run.smithi090.stdout: "client_features": { 2024-09-10T23:18:45.417 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_bits": "0x000000000003fbff" 2024-09-10T23:18:45.417 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.417 INFO:teuthology.orchestra.run.smithi090.stdout: "metric_spec": { 2024-09-10T23:18:45.417 INFO:teuthology.orchestra.run.smithi090.stdout: "metric_flags": { 2024-09-10T23:18:45.417 INFO:teuthology.orchestra.run.smithi090.stdout: "feature_bits": "0x000000000080ffff" 2024-09-10T23:18:45.418 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:45.418 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.418 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "1", 2024-09-10T23:18:45.418 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi171", 2024-09-10T23:18:45.418 INFO:teuthology.orchestra.run.smithi090.stdout: "kernel_version": "5.14.0-505.el9.x86_64", 2024-09-10T23:18:45.418 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2024-09-10T23:18:45.418 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:45.418 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:45.418 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-10T23:18:45.418 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:45.418 INFO:teuthology.orchestra.run.smithi090.stdout: "result": 0 2024-09-10T23:18:45.418 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:45.418 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:18:45.418 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:45.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.398+0000 7ff59b356280 1 -- 172.21.15.90:0/2797588734 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x55b89ff05800 msgr2=0x55b89fdee100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:45.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.398+0000 7ff59b356280 1 --2- 172.21.15.90:0/2797588734 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x55b89ff05800 0x55b89fdee100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.398+0000 7ff59b356280 1 -- 172.21.15.90:0/2797588734 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x55b89fe36c00 msgr2=0x55b89fdef700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.398+0000 7ff59b356280 1 --2- 172.21.15.90:0/2797588734 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x55b89fe36c00 0x55b89fdef700 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x55b89fe4f5c0 tx=0x55b89ff1d380 comp rx=0 tx=0).stop 2024-09-10T23:18:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.398+0000 7ff59b356280 1 -- 172.21.15.90:0/2797588734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89ff05000 msgr2=0x55b89fdeec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.398+0000 7ff59b356280 1 --2- 172.21.15.90:0/2797588734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89ff05000 0x55b89fdeec00 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x55b89ff15590 tx=0x55b89ff1d200 comp rx=0 tx=0).stop 2024-09-10T23:18:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.398+0000 7ff599afb640 1 -- 172.21.15.90:0/2797588734 reap_dead start 2024-09-10T23:18:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.398+0000 7ff59b356280 1 -- 172.21.15.90:0/2797588734 shutdown_connections 2024-09-10T23:18:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.398+0000 7ff59b356280 1 -- 172.21.15.90:0/2797588734 >> 172.21.15.90:0/2797588734 conn(0x55b89fe0c000 msgr2=0x55b89f121800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.399+0000 7ff59b356280 1 -- 172.21.15.90:0/2797588734 shutdown_connections 2024-09-10T23:18:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.399+0000 7ff59b356280 1 -- 172.21.15.90:0/2797588734 wait complete. 2024-09-10T23:18:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.399+0000 7ff59b356280 1 -- 172.21.15.90:0/1593922244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89fe0c800 msgr2=0x55b89fdedb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.399+0000 7ff59b356280 1 --2- 172.21.15.90:0/1593922244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89fe0c800 0x55b89fdedb80 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x55b89fe4f890 tx=0x55b89fd82c00 comp rx=0 tx=0).stop 2024-09-10T23:18:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.399+0000 7ff59b356280 1 -- 172.21.15.90:0/1593922244 shutdown_connections 2024-09-10T23:18:45.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.399+0000 7ff59b356280 1 --2- 172.21.15.90:0/1593922244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b89fe0c800 0x55b89fdedb80 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.399+0000 7ff59b356280 1 --2- 172.21.15.90:0/1593922244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55b89f011c00 0x55b89fdecb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.399+0000 7ff59b356280 1 --2- 172.21.15.90:0/1593922244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b89fe0c400 0x55b89fded600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.399+0000 7ff59b356280 1 -- 172.21.15.90:0/1593922244 >> 172.21.15.90:0/1593922244 conn(0x55b89f011000 msgr2=0x55b89f121000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:45.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.399+0000 7ff59b356280 1 -- 172.21.15.90:0/1593922244 shutdown_connections 2024-09-10T23:18:45.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.399+0000 7ff59b356280 1 -- 172.21.15.90:0/1593922244 wait complete. 2024-09-10T23:18:45.422 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'session'] in time 0:00:00.072152, result: { "0": { "data": { "sessions": [ { "id": 6493, "entity": { "name": { "type": "client", "num": 6493 }, "addr": { "type": "v1", "addr": "172.21.15.90:0", "nonce": 2562624497 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.6493 v1:172.21.15.90:0/2562624497", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "0", "hostname": "smithi090", "kernel_version": "5.14.0-505.el9.x86_64", "root": "/" } }, { "id": 6128, "entity": { "name": { "type": "client", "num": 6128 }, "addr": { "type": "v1", "addr": "192.168.0.1:0", "nonce": 683587795 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.6128 v1:192.168.0.1:0/683587795", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-505.el9.x86_64", "root": "/" } } ] }, "result": 0 } } 2024-09-10T23:18:45.423 INFO:tasks.cephfs.test_sessionmap:SessionMap: { "0": { "data": { "sessions": [ { "id": 6493, "entity": { "name": { "type": "client", "num": 6493 }, "addr": { "type": "v1", "addr": "172.21.15.90:0", "nonce": 2562624497 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.6493 v1:172.21.15.90:0/2562624497", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "0", "hostname": "smithi090", "kernel_version": "5.14.0-505.el9.x86_64", "root": "/" } }, { "id": 6128, "entity": { "name": { "type": "client", "num": 6128 }, "addr": { "type": "v1", "addr": "192.168.0.1:0", "nonce": 683587795 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.6128 v1:192.168.0.1:0/683587795", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-505.el9.x86_64", "root": "/" } } ] }, "result": 0 } } 2024-09-10T23:18:45.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:45.423 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir bravo) 2024-09-10T23:18:45.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:45.479 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch bravo/file_a) 2024-09-10T23:18:45.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:45.537 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch bravo/file_b) 2024-09-10T23:18:45.557 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-09-10T23:18:45.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.680+0000 7fb7bea7f640 1 -- 172.21.15.90:0/3345859470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7a40052e0 msgr2=0x7fb7a400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:45.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.680+0000 7fb7bea7f640 1 --2- 172.21.15.90:0/3345859470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7a40052e0 0x7fb7a400b9c0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0009b20 tx=0x7fb7a4005830 comp rx=0 tx=0).stop 2024-09-10T23:18:45.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.680+0000 7fb7bea7f640 1 -- 172.21.15.90:0/3345859470 shutdown_connections 2024-09-10T23:18:45.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.680+0000 7fb7bea7f640 1 --2- 172.21.15.90:0/3345859470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7a40052e0 0x7fb7a400b9c0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.680+0000 7fb7bea7f640 1 -- 172.21.15.90:0/3345859470 >> 172.21.15.90:0/3345859470 conn(0x7fb7b80690c0 msgr2=0x7fb7b806db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:45.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.680+0000 7fb7bea7f640 1 -- 172.21.15.90:0/3345859470 shutdown_connections 2024-09-10T23:18:45.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.680+0000 7fb7bea7f640 1 -- 172.21.15.90:0/3345859470 wait complete. 2024-09-10T23:18:45.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.681+0000 7fb7bea7f640 1 Processor -- start 2024-09-10T23:18:45.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.681+0000 7fb7bea7f640 1 -- start start 2024-09-10T23:18:45.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.682+0000 7fb7bea7f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7a40052e0 0x7fb7b8159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.682+0000 7fb7bea7f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7b8159680 0x7fb7b80ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.682+0000 7fb7bea7f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7b815d3d0 0x7fb7b81502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.682+0000 7fb7bea7f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b8161fb0 con 0x7fb7a40052e0 2024-09-10T23:18:45.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.682+0000 7fb7bea7f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b80d0da0 con 0x7fb7b815d3d0 2024-09-10T23:18:45.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.682+0000 7fb7bea7f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb7b80ca240 con 0x7fb7b8159680 2024-09-10T23:18:45.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.682+0000 7fb7bc81b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7a40052e0 0x7fb7b8159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.682+0000 7fb7bc81b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7a40052e0 0x7fb7b8159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34610/0 (socket says 172.21.15.90:34610) 2024-09-10T23:18:45.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.682+0000 7fb7bc81b640 1 -- 172.21.15.90:0/1105037705 learned_addr learned my addr 172.21.15.90:0/1105037705 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:45.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.682+0000 7fb7b7fff640 1 --2- 172.21.15.90:0/1105037705 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7b8159680 0x7fb7b80ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.682+0000 7fb7bd01c640 1 --2- 172.21.15.90:0/1105037705 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7b815d3d0 0x7fb7b81502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.682+0000 7fb7bc81b640 1 -- 172.21.15.90:0/1105037705 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7b8159680 msgr2=0x7fb7b80ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:45.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.682+0000 7fb7bc81b640 1 --2- 172.21.15.90:0/1105037705 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7b8159680 0x7fb7b80ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.682+0000 7fb7bc81b640 1 -- 172.21.15.90:0/1105037705 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7b815d3d0 msgr2=0x7fb7b81502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:45.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.682+0000 7fb7bc81b640 1 --2- 172.21.15.90:0/1105037705 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7b815d3d0 0x7fb7b81502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.682+0000 7fb7bc81b640 1 -- 172.21.15.90:0/1105037705 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b80c9f10 con 0x7fb7a40052e0 2024-09-10T23:18:45.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.683+0000 7fb7bc81b640 1 --2- 172.21.15.90:0/1105037705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7a40052e0 0x7fb7b8159bd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8003fd0 tx=0x7fb7a80064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:45.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.683+0000 7fb7b57fa640 1 -- 172.21.15.90:0/1105037705 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8015070 con 0x7fb7a40052e0 2024-09-10T23:18:45.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.683+0000 7fb7b57fa640 1 -- 172.21.15.90:0/1105037705 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7a800fa60 con 0x7fb7a40052e0 2024-09-10T23:18:45.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.683+0000 7fb7bea7f640 1 -- 172.21.15.90:0/1105037705 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b815b590 con 0x7fb7a40052e0 2024-09-10T23:18:45.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.683+0000 7fb7b57fa640 1 -- 172.21.15.90:0/1105037705 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8011430 con 0x7fb7a40052e0 2024-09-10T23:18:45.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.683+0000 7fb7bea7f640 1 -- 172.21.15.90:0/1105037705 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b815bb50 con 0x7fb7a40052e0 2024-09-10T23:18:45.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.684+0000 7fb7bea7f640 1 -- 172.21.15.90:0/1105037705 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7b80b5e10 con 0x7fb7a40052e0 2024-09-10T23:18:45.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.684+0000 7fb7b57fa640 1 -- 172.21.15.90:0/1105037705 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb7a80115d0 con 0x7fb7a40052e0 2024-09-10T23:18:45.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.685+0000 7fb7b57fa640 1 --2- 172.21.15.90:0/1105037705 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb798077f70 0x7fb79807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.685+0000 7fb7b57fa640 1 -- 172.21.15.90:0/1105037705 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7fb7a809ab90 con 0x7fb7a40052e0 2024-09-10T23:18:45.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.685+0000 7fb7b7fff640 1 --2- 172.21.15.90:0/1105037705 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb798077f70 0x7fb79807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.686+0000 7fb7b7fff640 1 --2- 172.21.15.90:0/1105037705 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb798077f70 0x7fb79807a430 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80b36d0 tx=0x7fb7a00067a0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:45.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.689+0000 7fb7b57fa640 1 -- 172.21.15.90:0/1105037705 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb7a8062fd0 con 0x7fb7a40052e0 2024-09-10T23:18:45.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:45.899+0000 7fb7bea7f640 1 -- 172.21.15.90:0/1105037705 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) -- 0x7fb7b80ba310 con 0x7fb7a40052e0 2024-09-10T23:18:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.519+0000 7fb7b57fa640 1 -- 172.21.15.90:0/1105037705 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v68) ==== 105+0+0 (secure 0 0 0) 0x7fb7a8067a00 con 0x7fb7a40052e0 2024-09-10T23:18:46.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.522+0000 7fb7bea7f640 1 -- 172.21.15.90:0/1105037705 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb798077f70 msgr2=0x7fb79807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:46.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.522+0000 7fb7bea7f640 1 --2- 172.21.15.90:0/1105037705 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb798077f70 0x7fb79807a430 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80b36d0 tx=0x7fb7a00067a0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.522+0000 7fb7bea7f640 1 -- 172.21.15.90:0/1105037705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7a40052e0 msgr2=0x7fb7b8159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:46.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.522+0000 7fb7bea7f640 1 --2- 172.21.15.90:0/1105037705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7a40052e0 0x7fb7b8159bd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8003fd0 tx=0x7fb7a80064f0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.522+0000 7fb7bea7f640 1 -- 172.21.15.90:0/1105037705 shutdown_connections 2024-09-10T23:18:46.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.522+0000 7fb7bea7f640 1 --2- 172.21.15.90:0/1105037705 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb798077f70 0x7fb79807a430 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.522+0000 7fb7bea7f640 1 --2- 172.21.15.90:0/1105037705 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7b815d3d0 0x7fb7b81502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.522+0000 7fb7bea7f640 1 --2- 172.21.15.90:0/1105037705 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7b8159680 0x7fb7b80ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.522+0000 7fb7bea7f640 1 --2- 172.21.15.90:0/1105037705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7a40052e0 0x7fb7b8159bd0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.522+0000 7fb7bea7f640 1 -- 172.21.15.90:0/1105037705 >> 172.21.15.90:0/1105037705 conn(0x7fb7b80690c0 msgr2=0x7fb7b80b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:46.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.522+0000 7fb7bea7f640 1 -- 172.21.15.90:0/1105037705 shutdown_connections 2024-09-10T23:18:46.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.522+0000 7fb7bea7f640 1 -- 172.21.15.90:0/1105037705 wait complete. 2024-09-10T23:18:46.541 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:46.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.644+0000 7f316d2b8640 1 -- 172.21.15.90:0/4063449427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31680cf280 msgr2=0x7f31680cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:46.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.644+0000 7f316d2b8640 1 --2- 172.21.15.90:0/4063449427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31680cf280 0x7f31680cf710 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f31680cd660 tx=0x7f316002a560 comp rx=0 tx=0).stop 2024-09-10T23:18:46.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.644+0000 7f316d2b8640 1 -- 172.21.15.90:0/4063449427 shutdown_connections 2024-09-10T23:18:46.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.644+0000 7f316d2b8640 1 --2- 172.21.15.90:0/4063449427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31680cf280 0x7f31680cf710 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.644+0000 7f316d2b8640 1 --2- 172.21.15.90:0/4063449427 >> v2:172.21.15.171:3300/0 conn(0x7f316806ed00 0x7f31680ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.644+0000 7f316d2b8640 1 -- 172.21.15.90:0/4063449427 >> 172.21.15.90:0/4063449427 conn(0x7f316806cb70 msgr2=0x7f316806cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:46.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.644+0000 7f316d2b8640 1 -- 172.21.15.90:0/4063449427 shutdown_connections 2024-09-10T23:18:46.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.644+0000 7f316d2b8640 1 -- 172.21.15.90:0/4063449427 wait complete. 2024-09-10T23:18:46.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.646+0000 7f316d2b8640 1 Processor -- start 2024-09-10T23:18:46.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.646+0000 7f316d2b8640 1 -- start start 2024-09-10T23:18:46.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.646+0000 7f316d2b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f316806e920 0x7f31681f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:46.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.646+0000 7f316d2b8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f316806ed00 0x7f3168158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:46.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.646+0000 7f316d2b8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31680cf280 0x7f316815a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:46.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.646+0000 7f316d2b8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f316813f970 con 0x7f31680cf280 2024-09-10T23:18:46.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.646+0000 7f316d2b8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f316813f7f0 con 0x7f316806ed00 2024-09-10T23:18:46.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.646+0000 7f316d2b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f316813faf0 con 0x7f316806e920 2024-09-10T23:18:46.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.647+0000 7f31677fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31680cf280 0x7f316815a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:46.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.647+0000 7f31677fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31680cf280 0x7f316815a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34622/0 (socket says 172.21.15.90:34622) 2024-09-10T23:18:46.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.647+0000 7f31677fe640 1 -- 172.21.15.90:0/3101598357 learned_addr learned my addr 172.21.15.90:0/3101598357 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:46.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.647+0000 7f3166ffd640 1 --2- 172.21.15.90:0/3101598357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f316806e920 0x7f31681f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:46.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.647+0000 7f31667fc640 1 --2- 172.21.15.90:0/3101598357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f316806ed00 0x7f3168158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:46.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.647+0000 7f31677fe640 1 -- 172.21.15.90:0/3101598357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f316806e920 msgr2=0x7f31681f2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:46.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.647+0000 7f31677fe640 1 --2- 172.21.15.90:0/3101598357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f316806e920 0x7f31681f2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.647+0000 7f31677fe640 1 -- 172.21.15.90:0/3101598357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f316806ed00 msgr2=0x7f3168158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:46.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.647+0000 7f31677fe640 1 --2- 172.21.15.90:0/3101598357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f316806ed00 0x7f3168158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.647+0000 7f31677fe640 1 -- 172.21.15.90:0/3101598357 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31681f2860 con 0x7f31680cf280 2024-09-10T23:18:46.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.647+0000 7f3166ffd640 1 --2- 172.21.15.90:0/3101598357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f316806e920 0x7f31681f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:46.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.647+0000 7f31677fe640 1 --2- 172.21.15.90:0/3101598357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31680cf280 0x7f316815a6b0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f31600099c0 tx=0x7f3160003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:46.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.647+0000 7f314f7fe640 1 -- 172.21.15.90:0/3101598357 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3160035030 con 0x7f31680cf280 2024-09-10T23:18:46.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.647+0000 7f314f7fe640 1 -- 172.21.15.90:0/3101598357 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f316003f070 con 0x7f31680cf280 2024-09-10T23:18:46.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.647+0000 7f316d2b8640 1 -- 172.21.15.90:0/3101598357 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31680b0c70 con 0x7f31680cf280 2024-09-10T23:18:46.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.647+0000 7f314f7fe640 1 -- 172.21.15.90:0/3101598357 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3160004a00 con 0x7f31680cf280 2024-09-10T23:18:46.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.647+0000 7f316d2b8640 1 -- 172.21.15.90:0/3101598357 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31680b1510 con 0x7f31680cf280 2024-09-10T23:18:46.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.648+0000 7f316d2b8640 1 -- 172.21.15.90:0/3101598357 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31680b1060 con 0x7f31680cf280 2024-09-10T23:18:46.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.649+0000 7f314f7fe640 1 -- 172.21.15.90:0/3101598357 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3160004ba0 con 0x7f31680cf280 2024-09-10T23:18:46.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.649+0000 7f314f7fe640 1 --2- 172.21.15.90:0/3101598357 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3154077f70 0x7f315407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:46.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.649+0000 7f314f7fe640 1 -- 172.21.15.90:0/3101598357 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7f31600bcd10 con 0x7f31680cf280 2024-09-10T23:18:46.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.650+0000 7f3166ffd640 1 --2- 172.21.15.90:0/3101598357 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3154077f70 0x7f315407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:46.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.650+0000 7f3166ffd640 1 --2- 172.21.15.90:0/3101598357 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3154077f70 0x7f315407a430 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f31580012e0 tx=0x7f3158009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:46.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.653+0000 7f314f7fe640 1 -- 172.21.15.90:0/3101598357 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3160085710 con 0x7f31680cf280 2024-09-10T23:18:46.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.863+0000 7f316d2b8640 1 -- 172.21.15.90:0/3101598357 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31680ced40 con 0x7f31680cf280 2024-09-10T23:18:46.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.863+0000 7f314f7fe640 1 -- 172.21.15.90:0/3101598357 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5243 (secure 0 0 0) 0x7f3160085010 con 0x7f31680cf280 2024-09-10T23:18:46.864 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:46.865 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":69,"btime":"2024-09-10T23:18:46:522629+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6083,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1271856183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1271856183},{"type":"v1","addr":"172.21.15.171:6835","nonce":1271856183}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/622220525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":622220525},{"type":"v1","addr":"172.21.15.171:6837","nonce":622220525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:19.149613+0000","modified":"2024-09-10T23:18:46.522616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7281,"mds_1":6451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"a","rank":1,"incarnation":69,"state":"up:creating","state_seq":1,"addr":"172.21.15.90:6835/2723277392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":2723277392},{"type":"v1","addr":"172.21.15.90:6835","nonce":2723277392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7281":{"gid":7281,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6834/638480774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":638480774},{"type":"v1","addr":"172.21.15.90:6834","nonce":638480774}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7281,"qdb_cluster":[7281]},"id":8}]} 2024-09-10T23:18:46.865 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 69 2024-09-10T23:18:46.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.865+0000 7f316d2b8640 1 -- 172.21.15.90:0/3101598357 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3154077f70 msgr2=0x7f315407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:46.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.865+0000 7f316d2b8640 1 --2- 172.21.15.90:0/3101598357 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3154077f70 0x7f315407a430 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f31580012e0 tx=0x7f3158009040 comp rx=0 tx=0).stop 2024-09-10T23:18:46.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.866+0000 7f316d2b8640 1 -- 172.21.15.90:0/3101598357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31680cf280 msgr2=0x7f316815a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:46.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.866+0000 7f316d2b8640 1 --2- 172.21.15.90:0/3101598357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31680cf280 0x7f316815a6b0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f31600099c0 tx=0x7f3160003910 comp rx=0 tx=0).stop 2024-09-10T23:18:46.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.866+0000 7f316d2b8640 1 -- 172.21.15.90:0/3101598357 shutdown_connections 2024-09-10T23:18:46.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.866+0000 7f316d2b8640 1 --2- 172.21.15.90:0/3101598357 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f3154077f70 0x7f315407a430 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.866+0000 7f316d2b8640 1 --2- 172.21.15.90:0/3101598357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f316806ed00 0x7f3168158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.866+0000 7f316d2b8640 1 --2- 172.21.15.90:0/3101598357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31680cf280 0x7f316815a6b0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.866+0000 7f316d2b8640 1 --2- 172.21.15.90:0/3101598357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f316806e920 0x7f31681f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.866+0000 7f316d2b8640 1 -- 172.21.15.90:0/3101598357 >> 172.21.15.90:0/3101598357 conn(0x7f316806cb70 msgr2=0x7f31680b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:46.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.866+0000 7f316d2b8640 1 -- 172.21.15.90:0/3101598357 shutdown_connections 2024-09-10T23:18:46.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:46.866+0000 7f316d2b8640 1 -- 172.21.15.90:0/3101598357 wait complete. 2024-09-10T23:18:47.280 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:18:19.149613+0000', 'modified': '2024-09-10T23:18:46.522616+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 108, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7281, 'mds_1': 6451}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6451': {'gid': 6451, 'name': 'a', 'rank': 1, 'incarnation': 69, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.90:6835/2723277392', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6833', 'nonce': 2723277392}, {'type': 'v1', 'addr': '172.21.15.90:6835', 'nonce': 2723277392}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_7281': {'gid': 7281, 'name': 'c', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.90:6834/638480774', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6832', 'nonce': 638480774}, {'type': 'v1', 'addr': '172.21.15.90:6834', 'nonce': 638480774}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7281, 'qdb_cluster': [7281]} 2024-09-10T23:18:47.281 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6451:up:creating 2024-09-10T23:18:48.281 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:48.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.395+0000 7efdfb152640 1 -- 172.21.15.90:0/2059070857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efde4003a00 msgr2=0x7efde4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.395+0000 7efdfb152640 1 --2- 172.21.15.90:0/2059070857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efde4003a00 0x7efde4003e20 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7efde8009b50 tx=0x7efde4005830 comp rx=0 tx=0).stop 2024-09-10T23:18:48.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.395+0000 7efdf96ef640 1 -- 172.21.15.90:0/2059070857 reap_dead start 2024-09-10T23:18:48.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.395+0000 7efdfb152640 1 -- 172.21.15.90:0/2059070857 shutdown_connections 2024-09-10T23:18:48.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.395+0000 7efdfb152640 1 -- 172.21.15.90:0/2059070857 >> 172.21.15.90:0/2059070857 conn(0x7efdf4068eb0 msgr2=0x7efdf40692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:48.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.395+0000 7efdfb152640 1 -- 172.21.15.90:0/2059070857 shutdown_connections 2024-09-10T23:18:48.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.395+0000 7efdfb152640 1 -- 172.21.15.90:0/2059070857 wait complete. 2024-09-10T23:18:48.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.396+0000 7efdfb152640 1 Processor -- start 2024-09-10T23:18:48.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.396+0000 7efdfb152640 1 -- start start 2024-09-10T23:18:48.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.397+0000 7efdfb152640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efde4003a00 0x7efdf40cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:48.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.397+0000 7efdfb152640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdf41f5ab0 0x7efdf40aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:48.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.397+0000 7efdfb152640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdf4159f20 0x7efdf40b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:48.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.397+0000 7efdfb152640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efdf40d31e0 con 0x7efdf41f5ab0 2024-09-10T23:18:48.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.397+0000 7efdfb152640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efdf40d3360 con 0x7efdf4159f20 2024-09-10T23:18:48.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.397+0000 7efdfb152640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efdf40d34e0 con 0x7efde4003a00 2024-09-10T23:18:48.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.397+0000 7efdf3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdf41f5ab0 0x7efdf40aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:48.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.397+0000 7efdf3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdf41f5ab0 0x7efdf40aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50806/0 (socket says 172.21.15.90:50806) 2024-09-10T23:18:48.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.397+0000 7efdf3fff640 1 -- 172.21.15.90:0/3848841014 learned_addr learned my addr 172.21.15.90:0/3848841014 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:48.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.397+0000 7efdf8eee640 1 --2- 172.21.15.90:0/3848841014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efde4003a00 0x7efdf40cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:48.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.397+0000 7efdf96ef640 1 --2- 172.21.15.90:0/3848841014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdf4159f20 0x7efdf40b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:48.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.398+0000 7efdf3fff640 1 -- 172.21.15.90:0/3848841014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efde4003a00 msgr2=0x7efdf40cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.398+0000 7efdf3fff640 1 --2- 172.21.15.90:0/3848841014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efde4003a00 0x7efdf40cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.398+0000 7efdf3fff640 1 -- 172.21.15.90:0/3848841014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdf4159f20 msgr2=0x7efdf40b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.398+0000 7efdf3fff640 1 --2- 172.21.15.90:0/3848841014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdf4159f20 0x7efdf40b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.398+0000 7efdf3fff640 1 -- 172.21.15.90:0/3848841014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf415f960 con 0x7efdf41f5ab0 2024-09-10T23:18:48.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.398+0000 7efdf96ef640 1 --2- 172.21.15.90:0/3848841014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdf4159f20 0x7efdf40b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:48.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.398+0000 7efdf3fff640 1 --2- 172.21.15.90:0/3848841014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdf41f5ab0 0x7efdf40aac80 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7efde000e5e0 tx=0x7efde000eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:48.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.398+0000 7efdf17fa640 1 -- 172.21.15.90:0/3848841014 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde0015070 con 0x7efdf41f5ab0 2024-09-10T23:18:48.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.398+0000 7efdf17fa640 1 -- 172.21.15.90:0/3848841014 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efde000ca60 con 0x7efdf41f5ab0 2024-09-10T23:18:48.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.398+0000 7efdfb152640 1 -- 172.21.15.90:0/3848841014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf40ab5d0 con 0x7efdf41f5ab0 2024-09-10T23:18:48.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.398+0000 7efdf17fa640 1 -- 172.21.15.90:0/3848841014 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde000ce30 con 0x7efdf41f5ab0 2024-09-10T23:18:48.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.398+0000 7efdfb152640 1 -- 172.21.15.90:0/3848841014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf415fee0 con 0x7efdf41f5ab0 2024-09-10T23:18:48.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.399+0000 7efdfb152640 1 -- 172.21.15.90:0/3848841014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf40ab970 con 0x7efdf41f5ab0 2024-09-10T23:18:48.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.400+0000 7efdf17fa640 1 -- 172.21.15.90:0/3848841014 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7efde0011460 con 0x7efdf41f5ab0 2024-09-10T23:18:48.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.400+0000 7efdf17fa640 1 --2- 172.21.15.90:0/3848841014 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efdd8077f70 0x7efdd807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:48.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.400+0000 7efdf17fa640 1 -- 172.21.15.90:0/3848841014 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7efde009a860 con 0x7efdf41f5ab0 2024-09-10T23:18:48.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.400+0000 7efdf8eee640 1 --2- 172.21.15.90:0/3848841014 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efdd8077f70 0x7efdd807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:48.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.401+0000 7efdf8eee640 1 --2- 172.21.15.90:0/3848841014 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efdd8077f70 0x7efdd807a430 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7efde8035000 tx=0x7efde802d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:48.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.404+0000 7efdf17fa640 1 -- 172.21.15.90:0/3848841014 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7efde0062ca0 con 0x7efdf41f5ab0 2024-09-10T23:18:48.509 INFO:tasks.ceph.mds.c.smithi090.stderr:2024-09-10T23:18:48.508+0000 7f12789fb640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-10T23:18:48.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.616+0000 7efdfb152640 1 -- 172.21.15.90:0/3848841014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdf40b7380 con 0x7efdf41f5ab0 2024-09-10T23:18:48.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.617+0000 7efdf17fa640 1 -- 172.21.15.90:0/3848841014 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5246 (secure 0 0 0) 0x7efde00676d0 con 0x7efdf41f5ab0 2024-09-10T23:18:48.618 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:48.618 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":70,"btime":"2024-09-10T23:18:47:524101+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6083,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1271856183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1271856183},{"type":"v1","addr":"172.21.15.171:6835","nonce":1271856183}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/622220525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":622220525},{"type":"v1","addr":"172.21.15.171:6837","nonce":622220525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:19.149613+0000","modified":"2024-09-10T23:18:47.524096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7281,"mds_1":6451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"a","rank":1,"incarnation":69,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6835/2723277392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":2723277392},{"type":"v1","addr":"172.21.15.90:6835","nonce":2723277392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7281":{"gid":7281,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6834/638480774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":638480774},{"type":"v1","addr":"172.21.15.90:6834","nonce":638480774}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7281,"qdb_cluster":[6451,7281]},"id":8}]} 2024-09-10T23:18:48.619 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 70 2024-09-10T23:18:48.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.619+0000 7efdfb152640 1 -- 172.21.15.90:0/3848841014 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efdd8077f70 msgr2=0x7efdd807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.619+0000 7efdfb152640 1 --2- 172.21.15.90:0/3848841014 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efdd8077f70 0x7efdd807a430 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7efde8035000 tx=0x7efde802d040 comp rx=0 tx=0).stop 2024-09-10T23:18:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.619+0000 7efdfb152640 1 -- 172.21.15.90:0/3848841014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdf41f5ab0 msgr2=0x7efdf40aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.619+0000 7efdfb152640 1 --2- 172.21.15.90:0/3848841014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdf41f5ab0 0x7efdf40aac80 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7efde000e5e0 tx=0x7efde000eaa0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.619+0000 7efdfb152640 1 -- 172.21.15.90:0/3848841014 shutdown_connections 2024-09-10T23:18:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.619+0000 7efdfb152640 1 --2- 172.21.15.90:0/3848841014 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7efdd8077f70 0x7efdd807a430 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.619+0000 7efdfb152640 1 --2- 172.21.15.90:0/3848841014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdf4159f20 0x7efdf40b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.619+0000 7efdfb152640 1 --2- 172.21.15.90:0/3848841014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdf41f5ab0 0x7efdf40aac80 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.619+0000 7efdfb152640 1 --2- 172.21.15.90:0/3848841014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efde4003a00 0x7efdf40cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.619+0000 7efdfb152640 1 -- 172.21.15.90:0/3848841014 >> 172.21.15.90:0/3848841014 conn(0x7efdf4068eb0 msgr2=0x7efdf4161e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:48.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.619+0000 7efdfb152640 1 -- 172.21.15.90:0/3848841014 shutdown_connections 2024-09-10T23:18:48.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:48.620+0000 7efdfb152640 1 -- 172.21.15.90:0/3848841014 wait complete. 2024-09-10T23:18:49.033 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:18:19.149613+0000', 'modified': '2024-09-10T23:18:47.524096+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 108, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7281, 'mds_1': 6451}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6451': {'gid': 6451, 'name': 'a', 'rank': 1, 'incarnation': 69, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.90:6835/2723277392', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6833', 'nonce': 2723277392}, {'type': 'v1', 'addr': '172.21.15.90:6835', 'nonce': 2723277392}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_7281': {'gid': 7281, 'name': 'c', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.90:6834/638480774', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6832', 'nonce': 638480774}, {'type': 'v1', 'addr': '172.21.15.90:6834', 'nonce': 638480774}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7281, 'qdb_cluster': [6451, 7281]} 2024-09-10T23:18:49.033 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2024-09-10T23:18:49.034 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T23:18:49.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.138+0000 7fb95a3ca640 1 -- 172.21.15.90:0/3076725535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9540d14b0 msgr2=0x7fb9540d2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.138+0000 7fb95a3ca640 1 --2- 172.21.15.90:0/3076725535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9540d14b0 0x7fb9540d2b50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb948009830 tx=0x7fb94802a530 comp rx=0 tx=0).stop 2024-09-10T23:18:49.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.138+0000 7fb95a3ca640 1 -- 172.21.15.90:0/3076725535 shutdown_connections 2024-09-10T23:18:49.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.138+0000 7fb95a3ca640 1 --2- 172.21.15.90:0/3076725535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9540d14b0 0x7fb9540d2b50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.138+0000 7fb95a3ca640 1 -- 172.21.15.90:0/3076725535 >> 172.21.15.90:0/3076725535 conn(0x7fb9540690c0 msgr2=0x7fb95406db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:49.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.138+0000 7fb95a3ca640 1 -- 172.21.15.90:0/3076725535 shutdown_connections 2024-09-10T23:18:49.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.138+0000 7fb95a3ca640 1 -- 172.21.15.90:0/3076725535 wait complete. 2024-09-10T23:18:49.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.139+0000 7fb95a3ca640 1 Processor -- start 2024-09-10T23:18:49.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.139+0000 7fb95a3ca640 1 -- start start 2024-09-10T23:18:49.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb95a3ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9540b3780 0x7fb95415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb95a3ca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9540d14b0 0x7fb954158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb95a3ca640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb954161640 0x7fb95415b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb95a3ca640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb9540d37a0 con 0x7fb954161640 2024-09-10T23:18:49.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb95a3ca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb954162090 con 0x7fb9540d14b0 2024-09-10T23:18:49.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb95a3ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb9540d3920 con 0x7fb9540b3780 2024-09-10T23:18:49.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb958967640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb954161640 0x7fb95415b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb958967640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb954161640 0x7fb95415b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50822/0 (socket says 172.21.15.90:50822) 2024-09-10T23:18:49.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb958967640 1 -- 172.21.15.90:0/3468245313 learned_addr learned my addr 172.21.15.90:0/3468245313 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:49.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb9537fe640 1 --2- 172.21.15.90:0/3468245313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9540d14b0 0x7fb954158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb953fff640 1 --2- 172.21.15.90:0/3468245313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9540b3780 0x7fb95415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb958967640 1 -- 172.21.15.90:0/3468245313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9540b3780 msgr2=0x7fb95415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb958967640 1 --2- 172.21.15.90:0/3468245313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9540b3780 0x7fb95415a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb958967640 1 -- 172.21.15.90:0/3468245313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9540d14b0 msgr2=0x7fb954158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb958967640 1 --2- 172.21.15.90:0/3468245313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9540d14b0 0x7fb954158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb958967640 1 -- 172.21.15.90:0/3468245313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95415b9d0 con 0x7fb954161640 2024-09-10T23:18:49.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb9537fe640 1 --2- 172.21.15.90:0/3468245313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9540d14b0 0x7fb954158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:49.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb953fff640 1 --2- 172.21.15.90:0/3468245313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9540b3780 0x7fb95415a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:49.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.140+0000 7fb958967640 1 --2- 172.21.15.90:0/3468245313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb954161640 0x7fb95415b490 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00c7a0 tx=0x7fb94c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:49.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.141+0000 7fb950ff9640 1 -- 172.21.15.90:0/3468245313 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c003b70 con 0x7fb954161640 2024-09-10T23:18:49.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.141+0000 7fb950ff9640 1 -- 172.21.15.90:0/3468245313 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb94c003d10 con 0x7fb954161640 2024-09-10T23:18:49.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.141+0000 7fb950ff9640 1 -- 172.21.15.90:0/3468245313 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c00aab0 con 0x7fb954161640 2024-09-10T23:18:49.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.141+0000 7fb95a3ca640 1 -- 172.21.15.90:0/3468245313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9540b4140 con 0x7fb954161640 2024-09-10T23:18:49.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.141+0000 7fb95a3ca640 1 -- 172.21.15.90:0/3468245313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9540b4700 con 0x7fb954161640 2024-09-10T23:18:49.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.142+0000 7fb950ff9640 1 -- 172.21.15.90:0/3468245313 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb94c00ac50 con 0x7fb954161640 2024-09-10T23:18:49.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.143+0000 7fb950ff9640 1 --2- 172.21.15.90:0/3468245313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb940077f70 0x7fb94007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.143+0000 7fb950ff9640 1 -- 172.21.15.90:0/3468245313 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7fb94c099c60 con 0x7fb954161640 2024-09-10T23:18:49.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.143+0000 7fb953fff640 1 --2- 172.21.15.90:0/3468245313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb940077f70 0x7fb94007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.143+0000 7fb95d277740 1 Processor -- start 2024-09-10T23:18:49.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.144+0000 7fb95d277740 1 -- start start 2024-09-10T23:18:49.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.144+0000 7fb953fff640 1 --2- 172.21.15.90:0/3468245313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb940077f70 0x7fb94007a430 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb9440046b0 tx=0x7fb944009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:49.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.144+0000 7fb95d277740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd829c1b0 0x556bd8273b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.144+0000 7fb95d277740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd82bbdf0 0x556bd82bc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.144+0000 7fb95d277740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd82715f0 0x556bd8271a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.144+0000 7fb95d277740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556bd81e8820 con 0x556bd82715f0 2024-09-10T23:18:49.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.144+0000 7fb95d277740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556bd81d7c50 con 0x556bd829c1b0 2024-09-10T23:18:49.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.144+0000 7fb95d277740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x556bd81dba60 con 0x556bd82bbdf0 2024-09-10T23:18:49.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.144+0000 7fb958967640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd82715f0 0x556bd8271a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.144+0000 7fb958967640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd82715f0 0x556bd8271a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50832/0 (socket says 172.21.15.90:50832) 2024-09-10T23:18:49.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.144+0000 7fb958967640 1 -- 172.21.15.90:0/1692651517 learned_addr learned my addr 172.21.15.90:0/1692651517 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:49.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.144+0000 7fb953fff640 1 --2- 172.21.15.90:0/1692651517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd829c1b0 0x556bd8273b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.144+0000 7fb9537fe640 1 --2- 172.21.15.90:0/1692651517 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd82bbdf0 0x556bd82bc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb958967640 1 -- 172.21.15.90:0/1692651517 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd82bbdf0 msgr2=0x556bd82bc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:49.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb958967640 1 --2- 172.21.15.90:0/1692651517 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd82bbdf0 0x556bd82bc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb958967640 1 -- 172.21.15.90:0/1692651517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd829c1b0 msgr2=0x556bd8273b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:49.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb958967640 1 --2- 172.21.15.90:0/1692651517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd829c1b0 0x556bd8273b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb958967640 1 -- 172.21.15.90:0/1692651517 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bd7f39850 con 0x556bd82715f0 2024-09-10T23:18:49.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb953fff640 1 --2- 172.21.15.90:0/1692651517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd829c1b0 0x556bd8273b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:49.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb958967640 1 --2- 172.21.15.90:0/1692651517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd82715f0 0x556bd8271a40 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fb94c098140 tx=0x7fb94c061dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fead8f526ea22ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:49.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb939ffb640 1 -- 172.21.15.90:0/1692651517 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c061b00 con 0x556bd82715f0 2024-09-10T23:18:49.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb939ffb640 1 -- 172.21.15.90:0/1692651517 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb94c0626f0 con 0x556bd82715f0 2024-09-10T23:18:49.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb939ffb640 1 -- 172.21.15.90:0/1692651517 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c061490 con 0x556bd82715f0 2024-09-10T23:18:49.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb95d277740 1 -- 172.21.15.90:0/1692651517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd82715f0 msgr2=0x556bd8271a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb95d277740 1 --2- 172.21.15.90:0/1692651517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd82715f0 0x556bd8271a40 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fb94c098140 tx=0x7fb94c061dc0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb95d277740 1 -- 172.21.15.90:0/1692651517 shutdown_connections 2024-09-10T23:18:49.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb95d277740 1 --2- 172.21.15.90:0/1692651517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd82715f0 0x556bd8271a40 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb95d277740 1 --2- 172.21.15.90:0/1692651517 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd82bbdf0 0x556bd82bc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb95d277740 1 --2- 172.21.15.90:0/1692651517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd829c1b0 0x556bd8273b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb95d277740 1 -- 172.21.15.90:0/1692651517 >> 172.21.15.90:0/1692651517 conn(0x556bd82726a0 msgr2=0x556bd82760c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:49.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb95d277740 1 -- 172.21.15.90:0/1692651517 shutdown_connections 2024-09-10T23:18:49.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.145+0000 7fb95d277740 1 -- 172.21.15.90:0/1692651517 wait complete. 2024-09-10T23:18:49.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.146+0000 7fb95d277740 1 -- start start 2024-09-10T23:18:49.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.146+0000 7fb95d277740 1 Processor -- start 2024-09-10T23:18:49.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.147+0000 7fb95d277740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd829c1b0 0x556bd8296e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.147+0000 7fb95d277740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd82bbdf0 0x556bd82b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.147+0000 7fb95d277740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd8274b70 0x556bd8274ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.147+0000 7fb95d277740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556bd7f48620 con 0x556bd82bbdf0 2024-09-10T23:18:49.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.147+0000 7fb95d277740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556bd817d5f0 con 0x556bd829c1b0 2024-09-10T23:18:49.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.147+0000 7fb95d277740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x556bd8270b30 con 0x556bd8274b70 2024-09-10T23:18:49.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.147+0000 7fb95d277740 10 client.0 _ll_register_callbacks cb 0x556bd81810a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:49.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.147+0000 7fb9537fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd82bbdf0 0x556bd82b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.147+0000 7fb9537fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd82bbdf0 0x556bd82b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50838/0 (socket says 172.21.15.90:50838) 2024-09-10T23:18:49.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.147+0000 7fb9537fe640 1 -- 172.21.15.90:0/2862734934 learned_addr learned my addr 172.21.15.90:0/2862734934 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:49.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.147+0000 7fb953fff640 1 --2- 172.21.15.90:0/2862734934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd829c1b0 0x556bd8296e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.147+0000 7fb958967640 1 --2- 172.21.15.90:0/2862734934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd8274b70 0x556bd8274ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.147+0000 7fb9537fe640 1 -- 172.21.15.90:0/2862734934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd8274b70 msgr2=0x556bd8274ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:49.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.147+0000 7fb9537fe640 1 --2- 172.21.15.90:0/2862734934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd8274b70 0x556bd8274ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.147+0000 7fb9537fe640 1 -- 172.21.15.90:0/2862734934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd829c1b0 msgr2=0x556bd8296e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:49.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.147+0000 7fb9537fe640 1 --2- 172.21.15.90:0/2862734934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd829c1b0 0x556bd8296e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.147+0000 7fb9537fe640 1 -- 172.21.15.90:0/2862734934 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bd7fb06b0 con 0x556bd82bbdf0 2024-09-10T23:18:49.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.148+0000 7fb9537fe640 1 --2- 172.21.15.90:0/2862734934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd82bbdf0 0x556bd82b4530 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fb948000c00 tx=0x7fb9480038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605a406a090e87b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:49.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.148+0000 7fb932ffd640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:18:49.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.148+0000 7fb932ffd640 1 -- 172.21.15.90:0/2862734934 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948003c90 con 0x556bd82bbdf0 2024-09-10T23:18:49.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.148+0000 7fb932ffd640 1 -- 172.21.15.90:0/2862734934 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7fb948047c30 con 0x556bd82bbdf0 2024-09-10T23:18:49.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.148+0000 7fb95d277740 1 -- 172.21.15.90:0/2862734934 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb94c0626f0 con 0x556bd82bbdf0 2024-09-10T23:18:49.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.148+0000 7fb932ffd640 1 -- 172.21.15.90:0/2862734934 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fb948009450 con 0x556bd82bbdf0 2024-09-10T23:18:49.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.148+0000 7fb95d277740 10 client.7392 fetch_fsmap learned FSMap version 70 2024-09-10T23:18:49.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.148+0000 7fb95d277740 1 -- 172.21.15.90:0/2862734934 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x556bd82cac50 con 0x556bd82bbdf0 2024-09-10T23:18:49.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.148+0000 7fb932ffd640 1 -- 172.21.15.90:0/2862734934 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb94c0626f0 con 0x556bd82bbdf0 2024-09-10T23:18:49.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.148+0000 7fb932ffd640 1 -- 172.21.15.90:0/2862734934 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 70) ==== 3522+0+0 (secure 0 0 0) 0x7fb948005020 con 0x556bd82bbdf0 2024-09-10T23:18:49.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.148+0000 7fb95d277740 10 client.7392 fetch_fsmap finished waiting for FSMap version 70 2024-09-10T23:18:49.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.148+0000 7fb95d277740 10 client.7392 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:18:49.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.148+0000 7fb95d277740 20 client.7392 populate_metadata read hostname 'smithi090' 2024-09-10T23:18:49.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.148+0000 7fb95d277740 1 --2- 172.21.15.90:0/2862734934 >> [v2:172.21.15.90:6833/2723277392,v1:172.21.15.90:6835/2723277392] conn(0x556bd8298a10 0x556bd8298df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.148+0000 7fb95d277740 4 client.7392 mds_command: new command op to 6451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:18:49.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.148+0000 7fb95d277740 1 -- 172.21.15.90:0/2862734934 --> [v2:172.21.15.90:6833/2723277392,v1:172.21.15.90:6835/2723277392] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556bd81ea770 con 0x556bd8298a10 2024-09-10T23:18:49.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.148+0000 7fb953fff640 1 --2- 172.21.15.90:0/2862734934 >> [v2:172.21.15.90:6833/2723277392,v1:172.21.15.90:6835/2723277392] conn(0x556bd8298a10 0x556bd8298df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.149+0000 7fb932ffd640 10 client.7392 ms_handle_connect on v2:172.21.15.90:6833/2723277392 2024-09-10T23:18:49.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.149+0000 7fb953fff640 1 --2- 172.21.15.90:0/2862734934 >> [v2:172.21.15.90:6833/2723277392,v1:172.21.15.90:6835/2723277392] conn(0x556bd8298a10 0x556bd8298df0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e703bff532539aeb server_cookie=5fd23a33c68ed7eb in_seq=0 out_seq=0 2024-09-10T23:18:49.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.149+0000 7fb932ffd640 1 -- 172.21.15.90:0/2862734934 <== mds.1 v2:172.21.15.90:6833/2723277392 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556bd81ea770 con 0x556bd8298a10 2024-09-10T23:18:49.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.149+0000 7fb932ffd640 10 client.7392 handle_command_reply: tid=0 2024-09-10T23:18:49.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.149+0000 7fb95d277740 1 client.7392 shutdown 2024-09-10T23:18:49.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.149+0000 7fb95d277740 1 -- 172.21.15.90:0/2862734934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd82bbdf0 msgr2=0x556bd82b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.149+0000 7fb95d277740 1 --2- 172.21.15.90:0/2862734934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd82bbdf0 0x556bd82b4530 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fb948000c00 tx=0x7fb9480038a0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.149+0000 7fb95d277740 1 -- 172.21.15.90:0/2862734934 shutdown_connections 2024-09-10T23:18:49.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.149+0000 7fb95d277740 1 --2- 172.21.15.90:0/2862734934 >> [v2:172.21.15.90:6833/2723277392,v1:172.21.15.90:6835/2723277392] conn(0x556bd8298a10 0x556bd8298df0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.149+0000 7fb95d277740 1 --2- 172.21.15.90:0/2862734934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd8274b70 0x556bd8274ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.149+0000 7fb95d277740 1 --2- 172.21.15.90:0/2862734934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd82bbdf0 0x556bd82b4530 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.149+0000 7fb932ffd640 0 client.7392 ms_handle_reset on v2:172.21.15.90:6833/2723277392 2024-09-10T23:18:49.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.149+0000 7fb95d277740 1 --2- 172.21.15.90:0/2862734934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd829c1b0 0x556bd8296e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.149+0000 7fb95d277740 1 -- 172.21.15.90:0/2862734934 >> 172.21.15.90:0/2862734934 conn(0x556bd82715f0 msgr2=0x556bd826f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:49.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.150+0000 7fb95d277740 1 -- 172.21.15.90:0/2862734934 shutdown_connections 2024-09-10T23:18:49.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.150+0000 7fb95d277740 1 -- 172.21.15.90:0/2862734934 wait complete. 2024-09-10T23:18:49.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.150+0000 7fb95d277740 20 client.7392 trim_cache size 0 max 16384 2024-09-10T23:18:49.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.168+0000 7fb95d277740 1 Processor -- start 2024-09-10T23:18:49.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.168+0000 7fb95d277740 1 -- start start 2024-09-10T23:18:49.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.168+0000 7fb95d277740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd8274b70 0x556bd8276300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.168+0000 7fb95d277740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd829c1b0 0x556bd826f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.168+0000 7fb95d277740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd82bbdf0 0x556bd826faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.168+0000 7fb95d277740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb954201600 con 0x556bd8274b70 2024-09-10T23:18:49.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.168+0000 7fb95d277740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb9541f8740 con 0x556bd82bbdf0 2024-09-10T23:18:49.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.168+0000 7fb95d277740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb9541f8d90 con 0x556bd829c1b0 2024-09-10T23:18:49.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.169+0000 7fb953fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd8274b70 0x556bd8276300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.169+0000 7fb953fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd8274b70 0x556bd8276300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50854/0 (socket says 172.21.15.90:50854) 2024-09-10T23:18:49.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.169+0000 7fb953fff640 1 -- 172.21.15.90:0/1257507743 learned_addr learned my addr 172.21.15.90:0/1257507743 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:49.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.169+0000 7fb953fff640 1 -- 172.21.15.90:0/1257507743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd829c1b0 msgr2=0x556bd826f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:49.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.169+0000 7fb9537fe640 1 --2- 172.21.15.90:0/1257507743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd829c1b0 0x556bd826f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.169+0000 7fb958967640 1 --2- 172.21.15.90:0/1257507743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd82bbdf0 0x556bd826faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.169+0000 7fb953fff640 1 --2- 172.21.15.90:0/1257507743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd829c1b0 0x556bd826f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.169+0000 7fb953fff640 1 -- 172.21.15.90:0/1257507743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd82bbdf0 msgr2=0x556bd826faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:49.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.169+0000 7fb953fff640 1 --2- 172.21.15.90:0/1257507743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd82bbdf0 0x556bd826faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.169+0000 7fb953fff640 1 -- 172.21.15.90:0/1257507743 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bd82a0be0 con 0x556bd8274b70 2024-09-10T23:18:49.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.169+0000 7fb958967640 1 --2- 172.21.15.90:0/1257507743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd82bbdf0 0x556bd826faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:49.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.169+0000 7fb9537fe640 1 --2- 172.21.15.90:0/1257507743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd829c1b0 0x556bd826f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:49.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.169+0000 7fb953fff640 1 --2- 172.21.15.90:0/1257507743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd8274b70 0x556bd8276300 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x556bd8296700 tx=0x7fb944013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd7dbb3f5d4fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:49.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.169+0000 7fb9397fa640 1 -- 172.21.15.90:0/1257507743 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944031070 con 0x556bd8274b70 2024-09-10T23:18:49.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.169+0000 7fb9397fa640 1 -- 172.21.15.90:0/1257507743 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb944022410 con 0x556bd8274b70 2024-09-10T23:18:49.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.169+0000 7fb9397fa640 1 -- 172.21.15.90:0/1257507743 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944022640 con 0x556bd8274b70 2024-09-10T23:18:49.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.170+0000 7fb95d277740 1 -- 172.21.15.90:0/1257507743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd8274b70 msgr2=0x556bd8276300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.170+0000 7fb95d277740 1 --2- 172.21.15.90:0/1257507743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd8274b70 0x556bd8276300 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x556bd8296700 tx=0x7fb944013000 comp rx=0 tx=0).stop 2024-09-10T23:18:49.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.170+0000 7fb95d277740 1 -- 172.21.15.90:0/1257507743 shutdown_connections 2024-09-10T23:18:49.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.170+0000 7fb95d277740 1 --2- 172.21.15.90:0/1257507743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd82bbdf0 0x556bd826faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.170+0000 7fb95d277740 1 --2- 172.21.15.90:0/1257507743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd829c1b0 0x556bd826f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.170+0000 7fb95d277740 1 --2- 172.21.15.90:0/1257507743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd8274b70 0x556bd8276300 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.170+0000 7fb95d277740 1 -- 172.21.15.90:0/1257507743 >> 172.21.15.90:0/1257507743 conn(0x556bd82715f0 msgr2=0x556bd8274f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:49.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.170+0000 7fb95d277740 1 -- 172.21.15.90:0/1257507743 shutdown_connections 2024-09-10T23:18:49.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.170+0000 7fb95d277740 1 -- 172.21.15.90:0/1257507743 wait complete. 2024-09-10T23:18:49.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.170+0000 7fb95d277740 1 -- start start 2024-09-10T23:18:49.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.170+0000 7fb95d277740 1 Processor -- start 2024-09-10T23:18:49.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.171+0000 7fb95d277740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd8274b70 0x556bd833ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.171+0000 7fb95d277740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd829c1b0 0x556bd833b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.171+0000 7fb95d277740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd82bbdf0 0x556bd826f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.171+0000 7fb95d277740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556bd8294620 con 0x556bd8274b70 2024-09-10T23:18:49.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.171+0000 7fb95d277740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556bd82ca970 con 0x556bd82bbdf0 2024-09-10T23:18:49.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.171+0000 7fb95d277740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x556bd82b4b90 con 0x556bd829c1b0 2024-09-10T23:18:49.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.171+0000 7fb95d277740 10 client.0 _ll_register_callbacks cb 0x7fb93c0036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:49.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.171+0000 7fb953fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd8274b70 0x556bd833ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.171+0000 7fb953fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd8274b70 0x556bd833ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50862/0 (socket says 172.21.15.90:50862) 2024-09-10T23:18:49.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.171+0000 7fb953fff640 1 -- 172.21.15.90:0/3771434025 learned_addr learned my addr 172.21.15.90:0/3771434025 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:49.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.171+0000 7fb958967640 1 --2- 172.21.15.90:0/3771434025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd82bbdf0 0x556bd826f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.171+0000 7fb9537fe640 1 --2- 172.21.15.90:0/3771434025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd829c1b0 0x556bd833b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb953fff640 1 -- 172.21.15.90:0/3771434025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd829c1b0 msgr2=0x556bd833b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:49.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb953fff640 1 --2- 172.21.15.90:0/3771434025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd829c1b0 0x556bd833b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb953fff640 1 -- 172.21.15.90:0/3771434025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd82bbdf0 msgr2=0x556bd826f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:49.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb953fff640 1 --2- 172.21.15.90:0/3771434025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd82bbdf0 0x556bd826f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb953fff640 1 -- 172.21.15.90:0/3771434025 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bd829a390 con 0x556bd8274b70 2024-09-10T23:18:49.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb953fff640 1 --2- 172.21.15.90:0/3771434025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd8274b70 0x556bd833ae60 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fb94402f040 tx=0x7fb944022a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df919ba8a2c1efab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:49.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb932ffd640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:18:49.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb932ffd640 1 -- 172.21.15.90:0/3771434025 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944031020 con 0x556bd8274b70 2024-09-10T23:18:49.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb932ffd640 1 -- 172.21.15.90:0/3771434025 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7fb94402c410 con 0x556bd8274b70 2024-09-10T23:18:49.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb95d277740 1 -- 172.21.15.90:0/3771434025 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb944022410 con 0x556bd8274b70 2024-09-10T23:18:49.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb932ffd640 1 -- 172.21.15.90:0/3771434025 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fb94402c650 con 0x556bd8274b70 2024-09-10T23:18:49.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb95d277740 10 client.7398 fetch_fsmap learned FSMap version 70 2024-09-10T23:18:49.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb95d277740 1 -- 172.21.15.90:0/3771434025 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x556bd833b960 con 0x556bd8274b70 2024-09-10T23:18:49.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb932ffd640 1 -- 172.21.15.90:0/3771434025 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb944022410 con 0x556bd8274b70 2024-09-10T23:18:49.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb932ffd640 1 -- 172.21.15.90:0/3771434025 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 70) ==== 3522+0+0 (secure 0 0 0) 0x7fb94402c7f0 con 0x556bd8274b70 2024-09-10T23:18:49.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb95d277740 10 client.7398 fetch_fsmap finished waiting for FSMap version 70 2024-09-10T23:18:49.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb95d277740 10 client.7398 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:18:49.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb95d277740 20 client.7398 populate_metadata read hostname 'smithi090' 2024-09-10T23:18:49.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb95d277740 1 --2- 172.21.15.90:0/3771434025 >> [v2:172.21.15.90:6833/2723277392,v1:172.21.15.90:6835/2723277392] conn(0x556bd82b3ac0 0x556bd82deff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb95d277740 4 client.7398 mds_command: new command op to 6451 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:18:49.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb95d277740 1 -- 172.21.15.90:0/3771434025 --> [v2:172.21.15.90:6833/2723277392,v1:172.21.15.90:6835/2723277392] -- command(tid 0: {"prefix": "status"}) -- 0x556bd81e6220 con 0x556bd82b3ac0 2024-09-10T23:18:49.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.172+0000 7fb9537fe640 1 --2- 172.21.15.90:0/3771434025 >> [v2:172.21.15.90:6833/2723277392,v1:172.21.15.90:6835/2723277392] conn(0x556bd82b3ac0 0x556bd82deff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.173+0000 7fb932ffd640 10 client.7398 ms_handle_connect on v2:172.21.15.90:6833/2723277392 2024-09-10T23:18:49.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.173+0000 7fb9537fe640 1 --2- 172.21.15.90:0/3771434025 >> [v2:172.21.15.90:6833/2723277392,v1:172.21.15.90:6835/2723277392] conn(0x556bd82b3ac0 0x556bd82deff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5626f56c56dad5d5 server_cookie=dd50cb5c516e91be in_seq=0 out_seq=0 2024-09-10T23:18:49.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.173+0000 7fb932ffd640 1 -- 172.21.15.90:0/3771434025 <== mds.1 v2:172.21.15.90:6833/2723277392 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x556bd81e6220 con 0x556bd82b3ac0 2024-09-10T23:18:49.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.173+0000 7fb932ffd640 10 client.7398 handle_command_reply: tid=0 2024-09-10T23:18:49.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.173+0000 7fb95d277740 1 client.7398 shutdown 2024-09-10T23:18:49.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.173+0000 7fb95d277740 1 -- 172.21.15.90:0/3771434025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd8274b70 msgr2=0x556bd833ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.173+0000 7fb95d277740 1 --2- 172.21.15.90:0/3771434025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd8274b70 0x556bd833ae60 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fb94402f040 tx=0x7fb944022a70 comp rx=0 tx=0).stop 2024-09-10T23:18:49.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.173+0000 7fb95d277740 1 -- 172.21.15.90:0/3771434025 shutdown_connections 2024-09-10T23:18:49.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.173+0000 7fb95d277740 1 --2- 172.21.15.90:0/3771434025 >> [v2:172.21.15.90:6833/2723277392,v1:172.21.15.90:6835/2723277392] conn(0x556bd82b3ac0 0x556bd82deff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.173+0000 7fb95d277740 1 --2- 172.21.15.90:0/3771434025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bd82bbdf0 0x556bd826f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.173+0000 7fb932ffd640 0 client.7398 ms_handle_reset on v2:172.21.15.90:6833/2723277392 2024-09-10T23:18:49.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.173+0000 7fb95d277740 1 --2- 172.21.15.90:0/3771434025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556bd829c1b0 0x556bd833b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.173+0000 7fb95d277740 1 --2- 172.21.15.90:0/3771434025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556bd8274b70 0x556bd833ae60 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.173+0000 7fb95d277740 1 -- 172.21.15.90:0/3771434025 >> 172.21.15.90:0/3771434025 conn(0x556bd82715f0 msgr2=0x556bd8276300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:49.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.173+0000 7fb95d277740 1 -- 172.21.15.90:0/3771434025 shutdown_connections 2024-09-10T23:18:49.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.173+0000 7fb95d277740 1 -- 172.21.15.90:0/3771434025 wait complete. 2024-09-10T23:18:49.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.173+0000 7fb95d277740 20 client.7398 trim_cache size 0 max 16384 2024-09-10T23:18:49.181 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:18:49.181 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd", 2024-09-10T23:18:49.181 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 1, 2024-09-10T23:18:49.181 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 6451, 2024-09-10T23:18:49.182 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-09-10T23:18:49.182 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-09-10T23:18:49.182 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2024-09-10T23:18:49.182 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 2.6470252580000002, 2024-09-10T23:18:49.182 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 70, 2024-09-10T23:18:49.182 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 108, 2024-09-10T23:18:49.182 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 108, 2024-09-10T23:18:49.182 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 16.536524641 2024-09-10T23:18:49.182 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:18:49.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.174+0000 7fb95a3ca640 1 -- 172.21.15.90:0/3468245313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb940077f70 msgr2=0x7fb94007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.174+0000 7fb95a3ca640 1 --2- 172.21.15.90:0/3468245313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb940077f70 0x7fb94007a430 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb9440046b0 tx=0x7fb944009040 comp rx=0 tx=0).stop 2024-09-10T23:18:49.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.174+0000 7fb95a3ca640 1 -- 172.21.15.90:0/3468245313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb954161640 msgr2=0x7fb95415b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.174+0000 7fb95a3ca640 1 --2- 172.21.15.90:0/3468245313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb954161640 0x7fb95415b490 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00c7a0 tx=0x7fb94c00cc60 comp rx=0 tx=0).stop 2024-09-10T23:18:49.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.174+0000 7fb95a3ca640 1 -- 172.21.15.90:0/3468245313 shutdown_connections 2024-09-10T23:18:49.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.174+0000 7fb95a3ca640 1 --2- 172.21.15.90:0/3468245313 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb940077f70 0x7fb94007a430 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.174+0000 7fb95a3ca640 1 --2- 172.21.15.90:0/3468245313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9540d14b0 0x7fb954158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.174+0000 7fb95a3ca640 1 --2- 172.21.15.90:0/3468245313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb954161640 0x7fb95415b490 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.174+0000 7fb95a3ca640 1 --2- 172.21.15.90:0/3468245313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9540b3780 0x7fb95415a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.174+0000 7fb95a3ca640 1 -- 172.21.15.90:0/3468245313 >> 172.21.15.90:0/3468245313 conn(0x7fb9540690c0 msgr2=0x7fb9540c87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:49.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.174+0000 7fb95a3ca640 1 -- 172.21.15.90:0/3468245313 shutdown_connections 2024-09-10T23:18:49.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.174+0000 7fb95a3ca640 1 -- 172.21.15.90:0/3468245313 wait complete. 2024-09-10T23:18:49.186 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T23:18:49.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.286+0000 7fe1464dd640 1 -- 172.21.15.90:0/393228529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1400b3780 msgr2=0x7fe1400d12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.286+0000 7fe1464dd640 1 --2- 172.21.15.90:0/393228529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1400b3780 0x7fe1400d12e0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fe134009830 tx=0x7fe13402a510 comp rx=0 tx=0).stop 2024-09-10T23:18:49.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.286+0000 7fe1464dd640 1 -- 172.21.15.90:0/393228529 shutdown_connections 2024-09-10T23:18:49.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.286+0000 7fe1464dd640 1 --2- 172.21.15.90:0/393228529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1400b3780 0x7fe1400d12e0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.286+0000 7fe1464dd640 1 --2- 172.21.15.90:0/393228529 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe140161640 0x7fe1400d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.286+0000 7fe1464dd640 1 -- 172.21.15.90:0/393228529 >> 172.21.15.90:0/393228529 conn(0x7fe1400690c0 msgr2=0x7fe14006db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:49.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.286+0000 7fe1464dd640 1 -- 172.21.15.90:0/393228529 shutdown_connections 2024-09-10T23:18:49.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.286+0000 7fe1464dd640 1 -- 172.21.15.90:0/393228529 wait complete. 2024-09-10T23:18:49.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.288+0000 7fe1464dd640 1 Processor -- start 2024-09-10T23:18:49.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.288+0000 7fe1464dd640 1 -- start start 2024-09-10T23:18:49.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.288+0000 7fe1464dd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1400b3780 0x7fe140152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.288+0000 7fe1464dd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe140161640 0x7fe1400cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.288+0000 7fe1464dd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe140161da0 0x7fe1401f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe1464dd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe1400b6520 con 0x7fe140161da0 2024-09-10T23:18:49.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe1464dd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe1400d3d70 con 0x7fe140161640 2024-09-10T23:18:49.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe1464dd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe1400b66a0 con 0x7fe1400b3780 2024-09-10T23:18:49.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe144a7a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe140161da0 0x7fe1401f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe144a7a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe140161da0 0x7fe1401f5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50884/0 (socket says 172.21.15.90:50884) 2024-09-10T23:18:49.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe144a7a640 1 -- 172.21.15.90:0/865747044 learned_addr learned my addr 172.21.15.90:0/865747044 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:49.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe13ffff640 1 --2- 172.21.15.90:0/865747044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1400b3780 0x7fe140152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe13f7fe640 1 --2- 172.21.15.90:0/865747044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe140161640 0x7fe1400cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe144a7a640 1 -- 172.21.15.90:0/865747044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1400b3780 msgr2=0x7fe140152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe144a7a640 1 --2- 172.21.15.90:0/865747044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1400b3780 0x7fe140152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe144a7a640 1 -- 172.21.15.90:0/865747044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe140161640 msgr2=0x7fe1400cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe144a7a640 1 --2- 172.21.15.90:0/865747044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe140161640 0x7fe1400cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe144a7a640 1 -- 172.21.15.90:0/865747044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe140152d50 con 0x7fe140161da0 2024-09-10T23:18:49.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe13ffff640 1 --2- 172.21.15.90:0/865747044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1400b3780 0x7fe140152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:49.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe144a7a640 1 --2- 172.21.15.90:0/865747044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe140161da0 0x7fe1401f5050 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fe13800c6c0 tx=0x7fe13800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:49.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe13cff9640 1 -- 172.21.15.90:0/865747044 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe138017070 con 0x7fe140161da0 2024-09-10T23:18:49.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe13cff9640 1 -- 172.21.15.90:0/865747044 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe138003c60 con 0x7fe140161da0 2024-09-10T23:18:49.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe13cff9640 1 -- 172.21.15.90:0/865747044 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1380052d0 con 0x7fe140161da0 2024-09-10T23:18:49.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe1464dd640 1 -- 172.21.15.90:0/865747044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1400cdd40 con 0x7fe140161da0 2024-09-10T23:18:49.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.289+0000 7fe1464dd640 1 -- 172.21.15.90:0/865747044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1400cb990 con 0x7fe140161da0 2024-09-10T23:18:49.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.291+0000 7fe13cff9640 1 -- 172.21.15.90:0/865747044 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe138005470 con 0x7fe140161da0 2024-09-10T23:18:49.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.292+0000 7fe13cff9640 1 --2- 172.21.15.90:0/865747044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe12c077f70 0x7fe12c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.292+0000 7fe13cff9640 1 -- 172.21.15.90:0/865747044 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7fe1380997b0 con 0x7fe140161da0 2024-09-10T23:18:49.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.292+0000 7fe13ffff640 1 --2- 172.21.15.90:0/865747044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe12c077f70 0x7fe12c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.292+0000 7fe1492a9740 1 Processor -- start 2024-09-10T23:18:49.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.292+0000 7fe1492a9740 1 -- start start 2024-09-10T23:18:49.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.293+0000 7fe13ffff640 1 --2- 172.21.15.90:0/865747044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe12c077f70 0x7fe12c07a430 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe130009c20 tx=0x7fe130005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:49.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.293+0000 7fe1492a9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f08499b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.293+0000 7fe1492a9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084e1df0 0x556f084e21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.293+0000 7fe1492a9740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084975f0 0x556f08497a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.293+0000 7fe1492a9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556f0840e820 con 0x556f084c21b0 2024-09-10T23:18:49.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.293+0000 7fe1492a9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556f083fdc50 con 0x556f084e1df0 2024-09-10T23:18:49.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.293+0000 7fe1492a9740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x556f08401a60 con 0x556f084975f0 2024-09-10T23:18:49.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.293+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f08499b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.293+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f08499b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50894/0 (socket says 172.21.15.90:50894) 2024-09-10T23:18:49.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.293+0000 7fe13ffff640 1 -- 172.21.15.90:0/4230777313 learned_addr learned my addr 172.21.15.90:0/4230777313 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:49.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.293+0000 7fe13ffff640 1 -- 172.21.15.90:0/4230777313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084975f0 msgr2=0x556f08497a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:49.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.293+0000 7fe13ffff640 1 --2- 172.21.15.90:0/4230777313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084975f0 0x556f08497a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.293+0000 7fe13ffff640 1 -- 172.21.15.90:0/4230777313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084e1df0 msgr2=0x556f084e21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:49.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.293+0000 7fe13ffff640 1 --2- 172.21.15.90:0/4230777313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084e1df0 0x556f084e21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.293+0000 7fe13ffff640 1 -- 172.21.15.90:0/4230777313 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0815f850 con 0x556f084c21b0 2024-09-10T23:18:49.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.294+0000 7fe13ffff640 1 --2- 172.21.15.90:0/4230777313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f08499b20 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fe130004160 tx=0x7fe130014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8154178b6b063e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:49.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.294+0000 7fe125ffb640 1 -- 172.21.15.90:0/4230777313 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130003e30 con 0x556f084c21b0 2024-09-10T23:18:49.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.294+0000 7fe125ffb640 1 -- 172.21.15.90:0/4230777313 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe130025070 con 0x556f084c21b0 2024-09-10T23:18:49.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.294+0000 7fe125ffb640 1 -- 172.21.15.90:0/4230777313 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1300127e0 con 0x556f084c21b0 2024-09-10T23:18:49.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.294+0000 7fe1492a9740 1 -- 172.21.15.90:0/4230777313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 msgr2=0x556f08499b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.294+0000 7fe1492a9740 1 --2- 172.21.15.90:0/4230777313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f08499b20 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fe130004160 tx=0x7fe130014000 comp rx=0 tx=0).stop 2024-09-10T23:18:49.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.294+0000 7fe1492a9740 1 -- 172.21.15.90:0/4230777313 shutdown_connections 2024-09-10T23:18:49.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.294+0000 7fe1492a9740 1 --2- 172.21.15.90:0/4230777313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084e1df0 0x556f084e21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.294+0000 7fe1492a9740 1 --2- 172.21.15.90:0/4230777313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084975f0 0x556f08497a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.294+0000 7fe1492a9740 1 --2- 172.21.15.90:0/4230777313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f08499b20 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.294+0000 7fe1492a9740 1 -- 172.21.15.90:0/4230777313 >> 172.21.15.90:0/4230777313 conn(0x556f084986a0 msgr2=0x556f0849c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:49.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.294+0000 7fe1492a9740 1 -- 172.21.15.90:0/4230777313 shutdown_connections 2024-09-10T23:18:49.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.294+0000 7fe1492a9740 1 -- 172.21.15.90:0/4230777313 wait complete. 2024-09-10T23:18:49.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.295+0000 7fe1492a9740 1 -- start start 2024-09-10T23:18:49.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.295+0000 7fe1492a9740 1 Processor -- start 2024-09-10T23:18:49.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.296+0000 7fe1492a9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f084a8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.296+0000 7fe1492a9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084e1df0 0x556f084c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.296+0000 7fe1492a9740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084c4df0 0x556f084bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.296+0000 7fe1492a9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556f0816e620 con 0x556f084c21b0 2024-09-10T23:18:49.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.296+0000 7fe1492a9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556f083a35f0 con 0x556f084e1df0 2024-09-10T23:18:49.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.296+0000 7fe1492a9740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x556f08496b30 con 0x556f084c4df0 2024-09-10T23:18:49.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.296+0000 7fe1492a9740 10 client.0 _ll_register_callbacks cb 0x556f083a70a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:49.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.296+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f084a8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.296+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f084a8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50910/0 (socket says 172.21.15.90:50910) 2024-09-10T23:18:49.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.296+0000 7fe13ffff640 1 -- 172.21.15.90:0/3034702335 learned_addr learned my addr 172.21.15.90:0/3034702335 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:49.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.296+0000 7fe13f7fe640 1 --2- 172.21.15.90:0/3034702335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084e1df0 0x556f084c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.296+0000 7fe144a7a640 1 --2- 172.21.15.90:0/3034702335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084c4df0 0x556f084bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.296+0000 7fe13ffff640 1 -- 172.21.15.90:0/3034702335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084c4df0 msgr2=0x556f084bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:49.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.296+0000 7fe13ffff640 1 --2- 172.21.15.90:0/3034702335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084c4df0 0x556f084bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.296+0000 7fe13ffff640 1 -- 172.21.15.90:0/3034702335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084e1df0 msgr2=0x556f084c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:49.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.296+0000 7fe13ffff640 1 --2- 172.21.15.90:0/3034702335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084e1df0 0x556f084c48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.296+0000 7fe13ffff640 1 -- 172.21.15.90:0/3034702335 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f081d66b0 con 0x556f084c21b0 2024-09-10T23:18:49.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.297+0000 7fe13ffff640 1 --2- 172.21.15.90:0/3034702335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f084a8f10 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fe130011c40 tx=0x7fe1300127f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767542903ef9819 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:49.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.297+0000 7fe11effd640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:18:49.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.297+0000 7fe11effd640 1 -- 172.21.15.90:0/3034702335 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130012df0 con 0x556f084c21b0 2024-09-10T23:18:49.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.297+0000 7fe11effd640 1 -- 172.21.15.90:0/3034702335 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7fe130035440 con 0x556f084c21b0 2024-09-10T23:18:49.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.297+0000 7fe1492a9740 1 -- 172.21.15.90:0/3034702335 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe130025070 con 0x556f084c21b0 2024-09-10T23:18:49.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.297+0000 7fe11effd640 1 -- 172.21.15.90:0/3034702335 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fe130035640 con 0x556f084c21b0 2024-09-10T23:18:49.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.297+0000 7fe1492a9740 10 client.7413 fetch_fsmap learned FSMap version 70 2024-09-10T23:18:49.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.297+0000 7fe1492a9740 1 -- 172.21.15.90:0/3034702335 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x556f084c61a0 con 0x556f084c21b0 2024-09-10T23:18:49.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.297+0000 7fe11effd640 1 -- 172.21.15.90:0/3034702335 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe130025070 con 0x556f084c21b0 2024-09-10T23:18:49.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.297+0000 7fe11effd640 1 -- 172.21.15.90:0/3034702335 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 70) ==== 3522+0+0 (secure 0 0 0) 0x7fe130033020 con 0x556f084c21b0 2024-09-10T23:18:49.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.297+0000 7fe1492a9740 10 client.7413 fetch_fsmap finished waiting for FSMap version 70 2024-09-10T23:18:49.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.297+0000 7fe1492a9740 10 client.7413 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:18:49.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.297+0000 7fe1492a9740 20 client.7413 populate_metadata read hostname 'smithi090' 2024-09-10T23:18:49.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.297+0000 7fe1492a9740 1 --2- 172.21.15.90:0/3034702335 >> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] conn(0x556f084ab9f0 0x556f084a9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.297+0000 7fe1492a9740 4 client.7413 mds_command: new command op to 7281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:18:49.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.297+0000 7fe1492a9740 1 -- 172.21.15.90:0/3034702335 --> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f08410770 con 0x556f084ab9f0 2024-09-10T23:18:49.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.297+0000 7fe13f7fe640 1 --2- 172.21.15.90:0/3034702335 >> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] conn(0x556f084ab9f0 0x556f084a9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.298+0000 7fe11effd640 10 client.7413 ms_handle_connect on v2:172.21.15.90:6832/638480774 2024-09-10T23:18:49.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.298+0000 7fe13f7fe640 1 --2- 172.21.15.90:0/3034702335 >> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] conn(0x556f084ab9f0 0x556f084a9bc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d3ebc500e810704 server_cookie=1392db7acec3b849 in_seq=0 out_seq=0 2024-09-10T23:18:49.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.298+0000 7fe11effd640 1 -- 172.21.15.90:0/3034702335 <== mds.0 v2:172.21.15.90:6832/638480774 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556f08410770 con 0x556f084ab9f0 2024-09-10T23:18:49.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.298+0000 7fe11effd640 10 client.7413 handle_command_reply: tid=0 2024-09-10T23:18:49.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.298+0000 7fe1492a9740 1 client.7413 shutdown 2024-09-10T23:18:49.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.298+0000 7fe1492a9740 1 -- 172.21.15.90:0/3034702335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 msgr2=0x556f084a8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.298+0000 7fe1492a9740 1 --2- 172.21.15.90:0/3034702335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f084a8f10 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fe130011c40 tx=0x7fe1300127f0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.298+0000 7fe1492a9740 1 -- 172.21.15.90:0/3034702335 shutdown_connections 2024-09-10T23:18:49.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.298+0000 7fe1492a9740 1 --2- 172.21.15.90:0/3034702335 >> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] conn(0x556f084ab9f0 0x556f084a9bc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.298+0000 7fe1492a9740 1 --2- 172.21.15.90:0/3034702335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084e1df0 0x556f084c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.298+0000 7fe1492a9740 1 --2- 172.21.15.90:0/3034702335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084c4df0 0x556f084bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.298+0000 7fe11effd640 0 client.7413 ms_handle_reset on v2:172.21.15.90:6832/638480774 2024-09-10T23:18:49.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.298+0000 7fe1492a9740 1 --2- 172.21.15.90:0/3034702335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f084a8f10 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.298+0000 7fe1492a9740 1 -- 172.21.15.90:0/3034702335 >> 172.21.15.90:0/3034702335 conn(0x556f084975f0 msgr2=0x556f0849bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:49.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.299+0000 7fe1492a9740 1 -- 172.21.15.90:0/3034702335 shutdown_connections 2024-09-10T23:18:49.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.299+0000 7fe1492a9740 1 -- 172.21.15.90:0/3034702335 wait complete. 2024-09-10T23:18:49.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.299+0000 7fe1492a9740 20 client.7413 trim_cache size 0 max 16384 2024-09-10T23:18:49.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.317+0000 7fe1492a9740 1 Processor -- start 2024-09-10T23:18:49.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.317+0000 7fe1492a9740 1 -- start start 2024-09-10T23:18:49.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.317+0000 7fe1492a9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f08505240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.317+0000 7fe1492a9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084c4df0 0x556f084bd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.317+0000 7fe1492a9740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084e1df0 0x556f084dad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.317+0000 7fe1492a9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe140201610 con 0x556f084c21b0 2024-09-10T23:18:49.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.317+0000 7fe1492a9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe1400c9a40 con 0x556f084c4df0 2024-09-10T23:18:49.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.317+0000 7fe1492a9740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe14015ce20 con 0x556f084e1df0 2024-09-10T23:18:49.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.318+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f08505240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.318+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f08505240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50922/0 (socket says 172.21.15.90:50922) 2024-09-10T23:18:49.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.318+0000 7fe13ffff640 1 -- 172.21.15.90:0/3395758722 learned_addr learned my addr 172.21.15.90:0/3395758722 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:49.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.318+0000 7fe13f7fe640 1 --2- 172.21.15.90:0/3395758722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084c4df0 0x556f084bd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.318+0000 7fe144a7a640 1 --2- 172.21.15.90:0/3395758722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084e1df0 0x556f084dad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.318+0000 7fe13ffff640 1 -- 172.21.15.90:0/3395758722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084e1df0 msgr2=0x556f084dad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:49.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.318+0000 7fe13ffff640 1 --2- 172.21.15.90:0/3395758722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084e1df0 0x556f084dad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.318+0000 7fe13ffff640 1 -- 172.21.15.90:0/3395758722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084c4df0 msgr2=0x556f084bd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:49.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.318+0000 7fe13ffff640 1 --2- 172.21.15.90:0/3395758722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084c4df0 0x556f084bd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.318+0000 7fe13ffff640 1 -- 172.21.15.90:0/3395758722 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f084ba8f0 con 0x556f084c21b0 2024-09-10T23:18:49.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.318+0000 7fe13f7fe640 1 --2- 172.21.15.90:0/3395758722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084c4df0 0x556f084bd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:49.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.318+0000 7fe13ffff640 1 --2- 172.21.15.90:0/3395758722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f08505240 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fe130011e90 tx=0x7fe1300355d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd175430190734 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:49.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.318+0000 7fe1257fa640 1 -- 172.21.15.90:0/3395758722 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130012bf0 con 0x556f084c21b0 2024-09-10T23:18:49.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.318+0000 7fe1257fa640 1 -- 172.21.15.90:0/3395758722 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe130025070 con 0x556f084c21b0 2024-09-10T23:18:49.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.318+0000 7fe1257fa640 1 -- 172.21.15.90:0/3395758722 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130035d70 con 0x556f084c21b0 2024-09-10T23:18:49.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.319+0000 7fe1492a9740 1 -- 172.21.15.90:0/3395758722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 msgr2=0x556f08505240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.319+0000 7fe1492a9740 1 --2- 172.21.15.90:0/3395758722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f08505240 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fe130011e90 tx=0x7fe1300355d0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.319+0000 7fe1492a9740 1 -- 172.21.15.90:0/3395758722 shutdown_connections 2024-09-10T23:18:49.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.319+0000 7fe1492a9740 1 --2- 172.21.15.90:0/3395758722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084c4df0 0x556f084bd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.319+0000 7fe1492a9740 1 --2- 172.21.15.90:0/3395758722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084e1df0 0x556f084dad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.319+0000 7fe1492a9740 1 --2- 172.21.15.90:0/3395758722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c21b0 0x556f08505240 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.319+0000 7fe1492a9740 1 -- 172.21.15.90:0/3395758722 >> 172.21.15.90:0/3395758722 conn(0x556f084975f0 msgr2=0x556f084e21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:49.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.319+0000 7fe1492a9740 1 -- 172.21.15.90:0/3395758722 shutdown_connections 2024-09-10T23:18:49.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.319+0000 7fe1492a9740 1 -- 172.21.15.90:0/3395758722 wait complete. 2024-09-10T23:18:49.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.319+0000 7fe1492a9740 1 -- start start 2024-09-10T23:18:49.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.320+0000 7fe1492a9740 1 Processor -- start 2024-09-10T23:18:49.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.320+0000 7fe1492a9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084c21b0 0x556f08561dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.320+0000 7fe1492a9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c4df0 0x556f084e0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.320+0000 7fe1492a9740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084e1df0 0x556f084e0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.320+0000 7fe1492a9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556f084ab870 con 0x556f084c4df0 2024-09-10T23:18:49.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.320+0000 7fe1492a9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556f084a94b0 con 0x556f084c21b0 2024-09-10T23:18:49.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.320+0000 7fe1492a9740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x556f084abe90 con 0x556f084e1df0 2024-09-10T23:18:49.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.320+0000 7fe1492a9740 10 client.0 _ll_register_callbacks cb 0x7fe130004030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:49.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.320+0000 7fe13f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c4df0 0x556f084e0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.320+0000 7fe13f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c4df0 0x556f084e0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50936/0 (socket says 172.21.15.90:50936) 2024-09-10T23:18:49.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.320+0000 7fe13f7fe640 1 -- 172.21.15.90:0/2456118098 learned_addr learned my addr 172.21.15.90:0/2456118098 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:49.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe144a7a640 1 --2- 172.21.15.90:0/2456118098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084e1df0 0x556f084e0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe13ffff640 1 --2- 172.21.15.90:0/2456118098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084c21b0 0x556f08561dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe13f7fe640 1 -- 172.21.15.90:0/2456118098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084e1df0 msgr2=0x556f084e0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:49.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe13f7fe640 1 --2- 172.21.15.90:0/2456118098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084e1df0 0x556f084e0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe13f7fe640 1 -- 172.21.15.90:0/2456118098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084c21b0 msgr2=0x556f08561dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:49.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe13f7fe640 1 --2- 172.21.15.90:0/2456118098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084c21b0 0x556f08561dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe13f7fe640 1 -- 172.21.15.90:0/2456118098 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f084aa810 con 0x556f084c4df0 2024-09-10T23:18:49.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe13ffff640 1 --2- 172.21.15.90:0/2456118098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084c21b0 0x556f08561dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:49.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe144a7a640 1 --2- 172.21.15.90:0/2456118098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084e1df0 0x556f084e0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:49.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe13f7fe640 1 --2- 172.21.15.90:0/2456118098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c4df0 0x556f084e0710 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fe134009780 tx=0x7fe134004370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89bb18f30ddbe810 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:49.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe11effd640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-10T23:18:49.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe11effd640 1 -- 172.21.15.90:0/2456118098 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe134049070 con 0x556f084c4df0 2024-09-10T23:18:49.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe11effd640 1 -- 172.21.15.90:0/2456118098 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7fe134003a00 con 0x556f084c4df0 2024-09-10T23:18:49.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe1492a9740 1 -- 172.21.15.90:0/2456118098 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe130025070 con 0x556f084c4df0 2024-09-10T23:18:49.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe11effd640 1 -- 172.21.15.90:0/2456118098 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fe134054050 con 0x556f084c4df0 2024-09-10T23:18:49.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe1492a9740 10 client.7419 fetch_fsmap learned FSMap version 70 2024-09-10T23:18:49.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe1492a9740 1 -- 172.21.15.90:0/2456118098 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x556f084aab10 con 0x556f084c4df0 2024-09-10T23:18:49.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe11effd640 1 -- 172.21.15.90:0/2456118098 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe130025070 con 0x556f084c4df0 2024-09-10T23:18:49.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe11effd640 1 -- 172.21.15.90:0/2456118098 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 70) ==== 3522+0+0 (secure 0 0 0) 0x7fe134057020 con 0x556f084c4df0 2024-09-10T23:18:49.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe1492a9740 10 client.7419 fetch_fsmap finished waiting for FSMap version 70 2024-09-10T23:18:49.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe1492a9740 10 client.7419 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:18:49.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe1492a9740 20 client.7419 populate_metadata read hostname 'smithi090' 2024-09-10T23:18:49.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe1492a9740 1 --2- 172.21.15.90:0/2456118098 >> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] conn(0x556f08566410 0x556f084db190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:49.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe1492a9740 4 client.7419 mds_command: new command op to 7281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:18:49.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.321+0000 7fe1492a9740 1 -- 172.21.15.90:0/2456118098 --> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] -- command(tid 0: {"prefix": "status"}) -- 0x556f084ab6c0 con 0x556f08566410 2024-09-10T23:18:49.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe13ffff640 1 --2- 172.21.15.90:0/2456118098 >> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] conn(0x556f08566410 0x556f084db190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:49.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe11effd640 10 client.7419 ms_handle_connect on v2:172.21.15.90:6832/638480774 2024-09-10T23:18:49.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe13ffff640 1 --2- 172.21.15.90:0/2456118098 >> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] conn(0x556f08566410 0x556f084db190 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f3a796e930c5fc7 server_cookie=c705c0a9f9440bc7 in_seq=0 out_seq=0 2024-09-10T23:18:49.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe11effd640 1 -- 172.21.15.90:0/2456118098 <== mds.0 v2:172.21.15.90:6832/638480774 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x556f084ab6c0 con 0x556f08566410 2024-09-10T23:18:49.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe11effd640 10 client.7419 handle_command_reply: tid=0 2024-09-10T23:18:49.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe1492a9740 1 client.7419 shutdown 2024-09-10T23:18:49.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe1492a9740 1 -- 172.21.15.90:0/2456118098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c4df0 msgr2=0x556f084e0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe1492a9740 1 --2- 172.21.15.90:0/2456118098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c4df0 0x556f084e0710 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fe134009780 tx=0x7fe134004370 comp rx=0 tx=0).stop 2024-09-10T23:18:49.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe1492a9740 1 -- 172.21.15.90:0/2456118098 shutdown_connections 2024-09-10T23:18:49.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe1492a9740 1 --2- 172.21.15.90:0/2456118098 >> [v2:172.21.15.90:6832/638480774,v1:172.21.15.90:6834/638480774] conn(0x556f08566410 0x556f084db190 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe1492a9740 1 --2- 172.21.15.90:0/2456118098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556f084e1df0 0x556f084e0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe1492a9740 1 --2- 172.21.15.90:0/2456118098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f084c4df0 0x556f084e0710 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe1492a9740 1 --2- 172.21.15.90:0/2456118098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f084c21b0 0x556f08561dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe11effd640 0 client.7419 ms_handle_reset on v2:172.21.15.90:6832/638480774 2024-09-10T23:18:49.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe1492a9740 1 -- 172.21.15.90:0/2456118098 >> 172.21.15.90:0/2456118098 conn(0x556f084975f0 msgr2=0x556f084a8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:49.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe1492a9740 1 -- 172.21.15.90:0/2456118098 shutdown_connections 2024-09-10T23:18:49.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe1492a9740 1 -- 172.21.15.90:0/2456118098 wait complete. 2024-09-10T23:18:49.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.322+0000 7fe1492a9740 20 client.7419 trim_cache size 0 max 16384 2024-09-10T23:18:49.331 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:18:49.331 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd", 2024-09-10T23:18:49.331 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2024-09-10T23:18:49.331 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 7281, 2024-09-10T23:18:49.331 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-09-10T23:18:49.331 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-09-10T23:18:49.331 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2024-09-10T23:18:49.331 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 10.831371581999999, 2024-09-10T23:18:49.331 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 70, 2024-09-10T23:18:49.331 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 108, 2024-09-10T23:18:49.331 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 108, 2024-09-10T23:18:49.331 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 16.685971511000002 2024-09-10T23:18:49.331 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:18:49.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.323+0000 7fe1464dd640 1 -- 172.21.15.90:0/865747044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe12c077f70 msgr2=0x7fe12c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.323+0000 7fe1464dd640 1 --2- 172.21.15.90:0/865747044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe12c077f70 0x7fe12c07a430 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe130009c20 tx=0x7fe130005f90 comp rx=0 tx=0).stop 2024-09-10T23:18:49.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.323+0000 7fe1464dd640 1 -- 172.21.15.90:0/865747044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe140161da0 msgr2=0x7fe1401f5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:49.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.323+0000 7fe1464dd640 1 --2- 172.21.15.90:0/865747044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe140161da0 0x7fe1401f5050 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fe13800c6c0 tx=0x7fe13800cb80 comp rx=0 tx=0).stop 2024-09-10T23:18:49.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.323+0000 7fe1464dd640 1 -- 172.21.15.90:0/865747044 shutdown_connections 2024-09-10T23:18:49.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.323+0000 7fe1464dd640 1 --2- 172.21.15.90:0/865747044 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe12c077f70 0x7fe12c07a430 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.323+0000 7fe1464dd640 1 --2- 172.21.15.90:0/865747044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe140161640 0x7fe1400cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.323+0000 7fe1464dd640 1 --2- 172.21.15.90:0/865747044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe140161da0 0x7fe1401f5050 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.323+0000 7fe1464dd640 1 --2- 172.21.15.90:0/865747044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1400b3780 0x7fe140152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:49.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.323+0000 7fe1464dd640 1 -- 172.21.15.90:0/865747044 >> 172.21.15.90:0/865747044 conn(0x7fe1400690c0 msgr2=0x7fe1400b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:49.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.323+0000 7fe1464dd640 1 -- 172.21.15.90:0/865747044 shutdown_connections 2024-09-10T23:18:49.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:49.323+0000 7fe1464dd640 1 -- 172.21.15.90:0/865747044 wait complete. 2024-09-10T23:18:49.335 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-10T23:18:49.453 INFO:teuthology.orchestra.run.smithi090.stdout:{"message":"","return_code":0} 2024-09-10T23:18:49.453 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T23:18:49.453 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump objecter 2024-09-10T23:18:49.567 INFO:teuthology.orchestra.run.smithi090.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":40,"op_send_bytes":11562,"op_resend":33,"op_reply":40,"op_latency":{"avgcount":40,"sum":0.277995606,"avgtime":0.006949890},"op_inflight":0,"oplen_avg":{"avgcount":40,"sum":62},"op":40,"op_r":0,"op_w":40,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":2,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":6,"osd_session_open":6,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1}} 2024-09-10T23:18:49.568 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 40, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 40, "avgtime": 0.00694989, "sum": 0.277995606 }, "op_pg": 0, "op_r": 0, "op_reply": 40, "op_resend": 33, "op_rmw": 0, "op_send": 40, "op_send_bytes": 11562, "op_w": 40, "oplen_avg": { "avgcount": 40, "sum": 62 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 6, "osd_sessions": 6, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-09-10T23:18:49.568 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json export dir /bravo 1 2024-09-10T23:18:49.682 INFO:teuthology.orchestra.run.smithi090.stdout:{"return_code":0} 2024-09-10T23:18:49.683 DEBUG:tasks.cephfs.filesystem:_json_asok output { "return_code": 0 } 2024-09-10T23:18:49.683 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump objecter 2024-09-10T23:18:49.798 INFO:teuthology.orchestra.run.smithi090.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":40,"op_send_bytes":11562,"op_resend":33,"op_reply":40,"op_latency":{"avgcount":40,"sum":0.277995606,"avgtime":0.006949890},"op_inflight":0,"oplen_avg":{"avgcount":40,"sum":62},"op":40,"op_r":0,"op_w":40,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":2,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":6,"osd_session_open":6,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1}} 2024-09-10T23:18:49.798 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 40, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 40, "avgtime": 0.00694989, "sum": 0.277995606 }, "op_pg": 0, "op_r": 0, "op_reply": 40, "op_resend": 33, "op_rmw": 0, "op_send": 40, "op_send_bytes": 11562, "op_w": 40, "oplen_avg": { "avgcount": 40, "sum": 62 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 6, "osd_sessions": 6, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-09-10T23:18:49.799 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-10T23:18:54.800 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump objecter 2024-09-10T23:18:54.927 INFO:teuthology.orchestra.run.smithi090.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":43,"op_send_bytes":15148,"op_resend":33,"op_reply":43,"op_latency":{"avgcount":43,"sum":0.282995526,"avgtime":0.006581291},"op_inflight":0,"oplen_avg":{"avgcount":43,"sum":67},"op":43,"op_r":0,"op_w":43,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":3,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":6,"osd_session_open":6,"osd_session_close":0,"osd_laggy":0,"omap_wr":19,"omap_rd":0,"omap_del":1}} 2024-09-10T23:18:54.927 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 19, "op": 43, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 43, "avgtime": 0.006581291, "sum": 0.282995526 }, "op_pg": 0, "op_r": 0, "op_reply": 43, "op_resend": 33, "op_rmw": 0, "op_send": 43, "op_send_bytes": 15148, "op_w": 43, "oplen_avg": { "avgcount": 43, "sum": 67 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 6, "osd_sessions": 6, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 3, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-09-10T23:18:54.928 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-10T23:18:54.928 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:18:54.928 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:54.944 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:18:54.944 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:54.999 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:18:55.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.141+0000 7f6516cdd640 1 -- 172.21.15.90:0/104605463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65100ce390 msgr2=0x7f65100ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:55.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.141+0000 7f6516cdd640 1 --2- 172.21.15.90:0/104605463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65100ce390 0x7f65100ced70 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f6510072680 tx=0x7f650002a580 comp rx=0 tx=0).stop 2024-09-10T23:18:55.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.141+0000 7f6516cdd640 1 -- 172.21.15.90:0/104605463 shutdown_connections 2024-09-10T23:18:55.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.141+0000 7f6516cdd640 1 --2- 172.21.15.90:0/104605463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65100ce390 0x7f65100ced70 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.141+0000 7f6516cdd640 1 --2- 172.21.15.90:0/104605463 >> v2:172.21.15.171:3300/0 conn(0x7f6510156650 0x7f65100cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.141+0000 7f6516cdd640 1 -- 172.21.15.90:0/104605463 >> 172.21.15.90:0/104605463 conn(0x7f651006cb70 msgr2=0x7f651006cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:55.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.141+0000 7f6516cdd640 1 -- 172.21.15.90:0/104605463 shutdown_connections 2024-09-10T23:18:55.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.141+0000 7f6516cdd640 1 -- 172.21.15.90:0/104605463 wait complete. 2024-09-10T23:18:55.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.142+0000 7f6516cdd640 1 Processor -- start 2024-09-10T23:18:55.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.142+0000 7f6516cdd640 1 -- start start 2024-09-10T23:18:55.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.143+0000 7f6516cdd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65100ce390 0x7f65101511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:55.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.143+0000 7f6516cdd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6510156650 0x7f65101e6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:55.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.143+0000 7f6516cdd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f651015d230 0x7f651015b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:55.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.143+0000 7f6516cdd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6510160280 con 0x7f651015d230 2024-09-10T23:18:55.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.143+0000 7f6516cdd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f65100cf610 con 0x7f65100ce390 2024-09-10T23:18:55.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.143+0000 7f6516cdd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6510160400 con 0x7f6510156650 2024-09-10T23:18:55.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.143+0000 7f651527a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f651015d230 0x7f651015b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:55.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.143+0000 7f651527a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f651015d230 0x7f651015b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50948/0 (socket says 172.21.15.90:50948) 2024-09-10T23:18:55.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.143+0000 7f651527a640 1 -- 172.21.15.90:0/2136748641 learned_addr learned my addr 172.21.15.90:0/2136748641 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:55.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.143+0000 7f651527a640 1 -- 172.21.15.90:0/2136748641 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6510156650 msgr2=0x7f65101e6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:55.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.143+0000 7f651527a640 1 --2- 172.21.15.90:0/2136748641 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6510156650 0x7f65101e6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.143+0000 7f651527a640 1 -- 172.21.15.90:0/2136748641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65100ce390 msgr2=0x7f65101511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:55.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.143+0000 7f651527a640 1 --2- 172.21.15.90:0/2136748641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65100ce390 0x7f65101511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.143+0000 7f651527a640 1 -- 172.21.15.90:0/2136748641 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65101e63c0 con 0x7f651015d230 2024-09-10T23:18:55.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.143+0000 7f651527a640 1 --2- 172.21.15.90:0/2136748641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f651015d230 0x7f651015b840 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f650800b990 tx=0x7f650800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:55.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.143+0000 7f65057fa640 1 -- 172.21.15.90:0/2136748641 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508019070 con 0x7f651015d230 2024-09-10T23:18:55.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.143+0000 7f65057fa640 1 -- 172.21.15.90:0/2136748641 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f650800cc90 con 0x7f651015d230 2024-09-10T23:18:55.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.144+0000 7f6516cdd640 1 -- 172.21.15.90:0/2136748641 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65101e8a50 con 0x7f651015d230 2024-09-10T23:18:55.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.144+0000 7f65057fa640 1 -- 172.21.15.90:0/2136748641 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65080146a0 con 0x7f651015d230 2024-09-10T23:18:55.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.144+0000 7f6516cdd640 1 -- 172.21.15.90:0/2136748641 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65101e6680 con 0x7f651015d230 2024-09-10T23:18:55.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.144+0000 7f6516cdd640 1 -- 172.21.15.90:0/2136748641 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65100ced70 con 0x7f651015d230 2024-09-10T23:18:55.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.145+0000 7f65057fa640 1 -- 172.21.15.90:0/2136748641 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f650801d3b0 con 0x7f651015d230 2024-09-10T23:18:55.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.146+0000 7f65057fa640 1 --2- 172.21.15.90:0/2136748641 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64fc077f70 0x7f64fc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:55.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.146+0000 7f65057fa640 1 -- 172.21.15.90:0/2136748641 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7f6508099f30 con 0x7f651015d230 2024-09-10T23:18:55.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.146+0000 7f6514a79640 1 --2- 172.21.15.90:0/2136748641 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64fc077f70 0x7f64fc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:55.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.147+0000 7f6514a79640 1 --2- 172.21.15.90:0/2136748641 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64fc077f70 0x7f64fc07a430 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f650c009710 tx=0x7f650c006c90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:55.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.150+0000 7f65057fa640 1 -- 172.21.15.90:0/2136748641 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6508062930 con 0x7f651015d230 2024-09-10T23:18:55.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.335+0000 7f6516cdd640 1 -- 172.21.15.90:0/2136748641 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f651006d1a0 con 0x7f651015d230 2024-09-10T23:18:55.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.335+0000 7f65057fa640 1 -- 172.21.15.90:0/2136748641 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v108) ==== 80+0+370 (secure 0 0 0) 0x7f6508062230 con 0x7f651015d230 2024-09-10T23:18:55.336 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.171:6836/1514360394 2024-09-11T23:18:38.485249+0000 2024-09-10T23:18:55.337 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.171:6834/1514360394 2024-09-11T23:18:38.485249+0000 2024-09-10T23:18:55.337 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6833/4002726882 2024-09-11T23:18:32.496674+0000 2024-09-10T23:18:55.337 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.171:6837/3083996658 2024-09-11T23:18:32.487388+0000 2024-09-10T23:18:55.337 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6835/4002726882 2024-09-11T23:18:32.496674+0000 2024-09-10T23:18:55.337 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.171:6835/3083996658 2024-09-11T23:18:32.487388+0000 2024-09-10T23:18:55.337 INFO:teuthology.orchestra.run.smithi090.stderr:listed 6 entries 2024-09-10T23:18:55.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.337+0000 7f6516cdd640 1 -- 172.21.15.90:0/2136748641 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64fc077f70 msgr2=0x7f64fc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:55.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.337+0000 7f6516cdd640 1 --2- 172.21.15.90:0/2136748641 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64fc077f70 0x7f64fc07a430 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f650c009710 tx=0x7f650c006c90 comp rx=0 tx=0).stop 2024-09-10T23:18:55.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.337+0000 7f6516cdd640 1 -- 172.21.15.90:0/2136748641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f651015d230 msgr2=0x7f651015b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:55.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.337+0000 7f6516cdd640 1 --2- 172.21.15.90:0/2136748641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f651015d230 0x7f651015b840 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f650800b990 tx=0x7f650800be50 comp rx=0 tx=0).stop 2024-09-10T23:18:55.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.337+0000 7f6516cdd640 1 -- 172.21.15.90:0/2136748641 shutdown_connections 2024-09-10T23:18:55.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.337+0000 7f6516cdd640 1 --2- 172.21.15.90:0/2136748641 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f64fc077f70 0x7f64fc07a430 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.337+0000 7f6516cdd640 1 --2- 172.21.15.90:0/2136748641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f651015d230 0x7f651015b840 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.337+0000 7f6516cdd640 1 --2- 172.21.15.90:0/2136748641 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6510156650 0x7f65101e6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.337+0000 7f6516cdd640 1 --2- 172.21.15.90:0/2136748641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65100ce390 0x7f65101511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.337+0000 7f6516cdd640 1 -- 172.21.15.90:0/2136748641 >> 172.21.15.90:0/2136748641 conn(0x7f651006cb70 msgr2=0x7f651015e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:55.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.337+0000 7f6516cdd640 1 -- 172.21.15.90:0/2136748641 shutdown_connections 2024-09-10T23:18:55.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.337+0000 7f6516cdd640 1 -- 172.21.15.90:0/2136748641 wait complete. 2024-09-10T23:18:55.349 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T23:18:55.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:55.350 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T23:18:55.378 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:18:55.396 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:18:55.403 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:18:55.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:55.403 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:18:55.459 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:18:55.459 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:55.476 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:18:55.476 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:55.537 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:18:55.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.639+0000 7fdf3808c640 1 -- 172.21.15.90:0/3098134981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf1c004800 msgr2=0x7fdf1c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:55.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.639+0000 7fdf3808c640 1 --2- 172.21.15.90:0/3098134981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf1c004800 0x7fdf1c004c80 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fdf24009b20 tx=0x7fdf1c005830 comp rx=0 tx=0).stop 2024-09-10T23:18:55.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.639+0000 7fdf3808c640 1 -- 172.21.15.90:0/3098134981 shutdown_connections 2024-09-10T23:18:55.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.639+0000 7fdf3808c640 1 --2- 172.21.15.90:0/3098134981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf1c004800 0x7fdf1c004c80 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.639+0000 7fdf3808c640 1 -- 172.21.15.90:0/3098134981 >> 172.21.15.90:0/3098134981 conn(0x7fdf300690c0 msgr2=0x7fdf3006db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:55.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.639+0000 7fdf3808c640 1 -- 172.21.15.90:0/3098134981 shutdown_connections 2024-09-10T23:18:55.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.639+0000 7fdf3808c640 1 -- 172.21.15.90:0/3098134981 wait complete. 2024-09-10T23:18:55.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.640+0000 7fdf3808c640 1 Processor -- start 2024-09-10T23:18:55.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.640+0000 7fdf3808c640 1 -- start start 2024-09-10T23:18:55.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf3808c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf1c004800 0x7fdf300b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:55.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf3808c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf300c98e0 0x7fdf300c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:55.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf3808c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf300ad4e0 0x7fdf300ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:55.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf3808c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdf300d0da0 con 0x7fdf300ad4e0 2024-09-10T23:18:55.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf3808c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdf30162000 con 0x7fdf300c98e0 2024-09-10T23:18:55.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf3808c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdf300d0f20 con 0x7fdf1c004800 2024-09-10T23:18:55.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf36629640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf300ad4e0 0x7fdf300ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:55.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf36629640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf300ad4e0 0x7fdf300ad960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50972/0 (socket says 172.21.15.90:50972) 2024-09-10T23:18:55.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf36629640 1 -- 172.21.15.90:0/2599635483 learned_addr learned my addr 172.21.15.90:0/2599635483 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:55.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf35e28640 1 --2- 172.21.15.90:0/2599635483 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf1c004800 0x7fdf300b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:55.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf35627640 1 --2- 172.21.15.90:0/2599635483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf300c98e0 0x7fdf300c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:55.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf36629640 1 -- 172.21.15.90:0/2599635483 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf1c004800 msgr2=0x7fdf300b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:55.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf36629640 1 --2- 172.21.15.90:0/2599635483 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf1c004800 0x7fdf300b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf36629640 1 -- 172.21.15.90:0/2599635483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf300c98e0 msgr2=0x7fdf300c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:55.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf36629640 1 --2- 172.21.15.90:0/2599635483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf300c98e0 0x7fdf300c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf36629640 1 -- 172.21.15.90:0/2599635483 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf300adea0 con 0x7fdf300ad4e0 2024-09-10T23:18:55.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf35627640 1 --2- 172.21.15.90:0/2599635483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf300c98e0 0x7fdf300c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:55.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf36629640 1 --2- 172.21.15.90:0/2599635483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf300ad4e0 0x7fdf300ad960 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fdf300cfde0 tx=0x7fdf280019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:55.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.641+0000 7fdf227fc640 1 -- 172.21.15.90:0/2599635483 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf28017070 con 0x7fdf300ad4e0 2024-09-10T23:18:55.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.642+0000 7fdf227fc640 1 -- 172.21.15.90:0/2599635483 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf280108c0 con 0x7fdf300ad4e0 2024-09-10T23:18:55.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.642+0000 7fdf227fc640 1 -- 172.21.15.90:0/2599635483 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf28010cd0 con 0x7fdf300ad4e0 2024-09-10T23:18:55.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.642+0000 7fdf3808c640 1 -- 172.21.15.90:0/2599635483 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf300ca330 con 0x7fdf300ad4e0 2024-09-10T23:18:55.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.642+0000 7fdf3808c640 1 -- 172.21.15.90:0/2599635483 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf301506f0 con 0x7fdf300ad4e0 2024-09-10T23:18:55.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.642+0000 7fdf3808c640 1 -- 172.21.15.90:0/2599635483 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf300b5e10 con 0x7fdf300ad4e0 2024-09-10T23:18:55.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.643+0000 7fdf227fc640 1 -- 172.21.15.90:0/2599635483 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdf2801b3b0 con 0x7fdf300ad4e0 2024-09-10T23:18:55.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.644+0000 7fdf227fc640 1 --2- 172.21.15.90:0/2599635483 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdf14077fa0 0x7fdf1407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:55.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.644+0000 7fdf227fc640 1 -- 172.21.15.90:0/2599635483 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7fdf28099f20 con 0x7fdf300ad4e0 2024-09-10T23:18:55.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.644+0000 7fdf35e28640 1 --2- 172.21.15.90:0/2599635483 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdf14077fa0 0x7fdf1407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:55.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.644+0000 7fdf35e28640 1 --2- 172.21.15.90:0/2599635483 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdf14077fa0 0x7fdf1407a460 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c001240 tx=0x7fdf2c006040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:55.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.648+0000 7fdf227fc640 1 -- 172.21.15.90:0/2599635483 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdf28062240 con 0x7fdf300ad4e0 2024-09-10T23:18:55.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.833+0000 7fdf3808c640 1 -- 172.21.15.90:0/2599635483 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdf300ba310 con 0x7fdf300ad4e0 2024-09-10T23:18:55.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.833+0000 7fdf227fc640 1 -- 172.21.15.90:0/2599635483 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v108) ==== 80+0+370 (secure 0 0 0) 0x7fdf28066c70 con 0x7fdf300ad4e0 2024-09-10T23:18:55.834 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.171:6836/1514360394 2024-09-11T23:18:38.485249+0000 2024-09-10T23:18:55.834 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.171:6834/1514360394 2024-09-11T23:18:38.485249+0000 2024-09-10T23:18:55.834 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6833/4002726882 2024-09-11T23:18:32.496674+0000 2024-09-10T23:18:55.834 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.171:6837/3083996658 2024-09-11T23:18:32.487388+0000 2024-09-10T23:18:55.835 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6835/4002726882 2024-09-11T23:18:32.496674+0000 2024-09-10T23:18:55.835 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.171:6835/3083996658 2024-09-11T23:18:32.487388+0000 2024-09-10T23:18:55.835 INFO:teuthology.orchestra.run.smithi090.stderr:listed 6 entries 2024-09-10T23:18:55.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.835+0000 7fdf3808c640 1 -- 172.21.15.90:0/2599635483 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdf14077fa0 msgr2=0x7fdf1407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:55.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.835+0000 7fdf3808c640 1 --2- 172.21.15.90:0/2599635483 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdf14077fa0 0x7fdf1407a460 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c001240 tx=0x7fdf2c006040 comp rx=0 tx=0).stop 2024-09-10T23:18:55.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.835+0000 7fdf3808c640 1 -- 172.21.15.90:0/2599635483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf300ad4e0 msgr2=0x7fdf300ad960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:55.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.835+0000 7fdf3808c640 1 --2- 172.21.15.90:0/2599635483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf300ad4e0 0x7fdf300ad960 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fdf300cfde0 tx=0x7fdf280019b0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.835+0000 7fdf3808c640 1 -- 172.21.15.90:0/2599635483 shutdown_connections 2024-09-10T23:18:55.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.835+0000 7fdf3808c640 1 --2- 172.21.15.90:0/2599635483 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fdf14077fa0 0x7fdf1407a460 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.835+0000 7fdf3808c640 1 --2- 172.21.15.90:0/2599635483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf300c98e0 0x7fdf300c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.835+0000 7fdf3808c640 1 --2- 172.21.15.90:0/2599635483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf300ad4e0 0x7fdf300ad960 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.835+0000 7fdf3808c640 1 --2- 172.21.15.90:0/2599635483 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf1c004800 0x7fdf300b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.835+0000 7fdf3808c640 1 -- 172.21.15.90:0/2599635483 >> 172.21.15.90:0/2599635483 conn(0x7fdf300690c0 msgr2=0x7fdf300b7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:55.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.835+0000 7fdf3808c640 1 -- 172.21.15.90:0/2599635483 shutdown_connections 2024-09-10T23:18:55.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:55.835+0000 7fdf3808c640 1 -- 172.21.15.90:0/2599635483 wait complete. 2024-09-10T23:18:55.847 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T23:18:55.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:55.847 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T23:18:55.882 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:18:55.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:55.883 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T23:18:55.940 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-10T23:18:56.057 INFO:teuthology.orchestra.run.smithi090.stdout:[] 2024-09-10T23:18:56.058 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-10T23:18:56.058 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-10T23:18:56.178 INFO:teuthology.orchestra.run.smithi090.stdout:{"message":"","return_code":0} 2024-09-10T23:18:56.179 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T23:18:56.179 DEBUG:teuthology.orchestra.run.smithi090:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show session 2024-09-10T23:18:56.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.218+0000 7f21069ef280 1 -- start start 2024-09-10T23:18:56.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.218+0000 7f21069ef280 1 Processor -- start 2024-09-10T23:18:56.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f21069ef280 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d3e26f0000 0x55d3e271b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f21069ef280 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e1947c00 0x55d3e271ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f21069ef280 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e26f0800 0x55d3e271bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f21069ef280 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d3e2740480 con 0x55d3e1947c00 2024-09-10T23:18:56.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f21069ef280 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d3e2740600 con 0x55d3e26f0800 2024-09-10T23:18:56.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f21069ef280 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55d3e2740780 con 0x55d3e26f0000 2024-09-10T23:18:56.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f2104993640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e1947c00 0x55d3e271ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f2104993640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e1947c00 0x55d3e271ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51004/0 (socket says 172.21.15.90:51004) 2024-09-10T23:18:56.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f2104993640 1 -- 172.21.15.90:0/2483015931 learned_addr learned my addr 172.21.15.90:0/2483015931 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:56.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f2104993640 1 -- 172.21.15.90:0/2483015931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d3e26f0000 msgr2=0x55d3e271b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f2104993640 1 --2- 172.21.15.90:0/2483015931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d3e26f0000 0x55d3e271b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f2104993640 1 -- 172.21.15.90:0/2483015931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e26f0800 msgr2=0x55d3e271bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f2104993640 1 --2- 172.21.15.90:0/2483015931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e26f0800 0x55d3e271bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f2104993640 1 -- 172.21.15.90:0/2483015931 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3e1984780 con 0x55d3e1947c00 2024-09-10T23:18:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f2104993640 1 --2- 172.21.15.90:0/2483015931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e1947c00 0x55d3e271ab00 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x55d3e2773560 tx=0x55d3e272cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304a44c376a89fd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f210298f640 1 -- 172.21.15.90:0/2483015931 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d3e196c340 con 0x55d3e1947c00 2024-09-10T23:18:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f210298f640 1 -- 172.21.15.90:0/2483015931 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d3e1972540 con 0x55d3e1947c00 2024-09-10T23:18:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f210298f640 1 -- 172.21.15.90:0/2483015931 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d3e196d380 con 0x55d3e1947c00 2024-09-10T23:18:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f21069ef280 1 -- 172.21.15.90:0/2483015931 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3e1984000 con 0x55d3e1947c00 2024-09-10T23:18:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f21069ef280 1 -- 172.21.15.90:0/2483015931 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55d3e1985a40 con 0x55d3e1947c00 2024-09-10T23:18:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.219+0000 7f21069ef280 4 waiting for MDS map... 2024-09-10T23:18:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.220+0000 7f210298f640 1 -- 172.21.15.90:0/2483015931 <== mon.0 v2:172.21.15.90:3300/0 4 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x55d3e282a600 con 0x55d3e1947c00 2024-09-10T23:18:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.220+0000 7f210298f640 1 -- 172.21.15.90:0/2483015931 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 71) ==== 3526+0+0 (secure 0 0 0) 0x55d3e19a1180 con 0x55d3e1947c00 2024-09-10T23:18:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.220+0000 7f21069ef280 4 Got MDS map 71 2024-09-10T23:18:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.220+0000 7f21069ef280 10 main: main 2024-09-10T23:18:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.220+0000 7f21069ef280 4 main: connecting to RADOS... 2024-09-10T23:18:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.220+0000 7f21069ef280 1 Processor -- start 2024-09-10T23:18:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.220+0000 7f21069ef280 1 -- start start 2024-09-10T23:18:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.221+0000 7f21069ef280 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e2829c00 0x55d3e271b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.221+0000 7f21069ef280 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e288e000 0x55d3e271a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.221+0000 7f21069ef280 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d3e288e400 0x55d3e271c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.221+0000 7f21069ef280 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d3e19a9980 con 0x55d3e288e000 2024-09-10T23:18:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.221+0000 7f21069ef280 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d3e2741680 con 0x55d3e2829c00 2024-09-10T23:18:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.221+0000 7f21069ef280 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55d3e2741500 con 0x55d3e288e400 2024-09-10T23:18:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.221+0000 7f2105194640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e288e000 0x55d3e271a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.221+0000 7f2105194640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e288e000 0x55d3e271a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51020/0 (socket says 172.21.15.90:51020) 2024-09-10T23:18:56.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.221+0000 7f2105194640 1 -- 172.21.15.90:0/578571058 learned_addr learned my addr 172.21.15.90:0/578571058 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:56.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.221+0000 7f2105995640 1 --2- 172.21.15.90:0/578571058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e2829c00 0x55d3e271b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.221+0000 7f2104993640 1 --2- 172.21.15.90:0/578571058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d3e288e400 0x55d3e271c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.221+0000 7f2105194640 1 -- 172.21.15.90:0/578571058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d3e288e400 msgr2=0x55d3e271c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:56.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.221+0000 7f2105194640 1 --2- 172.21.15.90:0/578571058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d3e288e400 0x55d3e271c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.221+0000 7f2105194640 1 -- 172.21.15.90:0/578571058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e2829c00 msgr2=0x55d3e271b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:56.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.221+0000 7f2105194640 1 --2- 172.21.15.90:0/578571058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e2829c00 0x55d3e271b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.221+0000 7f2105194640 1 -- 172.21.15.90:0/578571058 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3e1985860 con 0x55d3e288e000 2024-09-10T23:18:56.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.221+0000 7f2105194640 1 --2- 172.21.15.90:0/578571058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e288e000 0x55d3e271a580 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x55d3e28469f0 tx=0x55d3e284ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716d7644cd2b3b8a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:56.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.222+0000 7f210098b640 1 -- 172.21.15.90:0/578571058 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d3e196cea0 con 0x55d3e288e000 2024-09-10T23:18:56.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.222+0000 7f210098b640 1 -- 172.21.15.90:0/578571058 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d3e1973180 con 0x55d3e288e000 2024-09-10T23:18:56.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.222+0000 7f210098b640 1 -- 172.21.15.90:0/578571058 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d3e196c340 con 0x55d3e288e000 2024-09-10T23:18:56.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.222+0000 7f21069ef280 1 -- 172.21.15.90:0/578571058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e288e000 msgr2=0x55d3e271a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.222+0000 7f21069ef280 1 --2- 172.21.15.90:0/578571058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e288e000 0x55d3e271a580 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x55d3e28469f0 tx=0x55d3e284ac00 comp rx=0 tx=0).stop 2024-09-10T23:18:56.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.222+0000 7f21069ef280 1 -- 172.21.15.90:0/578571058 shutdown_connections 2024-09-10T23:18:56.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.222+0000 7f21069ef280 1 --2- 172.21.15.90:0/578571058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d3e288e400 0x55d3e271c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.222+0000 7f21069ef280 1 --2- 172.21.15.90:0/578571058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e288e000 0x55d3e271a580 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.222+0000 7f21069ef280 1 --2- 172.21.15.90:0/578571058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e2829c00 0x55d3e271b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.222+0000 7f21069ef280 1 -- 172.21.15.90:0/578571058 >> 172.21.15.90:0/578571058 conn(0x55d3e26f0400 msgr2=0x55d3e26dd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:56.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.222+0000 7f21069ef280 1 -- 172.21.15.90:0/578571058 shutdown_connections 2024-09-10T23:18:56.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.222+0000 7f21069ef280 1 -- 172.21.15.90:0/578571058 wait complete. 2024-09-10T23:18:56.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.222+0000 7f21069ef280 1 Processor -- start 2024-09-10T23:18:56.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f21069ef280 1 -- start start 2024-09-10T23:18:56.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f21069ef280 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d3e2829c00 0x55d3e271d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f21069ef280 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e2756000 0x55d3e271cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f21069ef280 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e2756400 0x55d3e271c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f21069ef280 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d3e2740900 con 0x55d3e2756400 2024-09-10T23:18:56.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f21069ef280 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d3e2740a80 con 0x55d3e2756000 2024-09-10T23:18:56.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f21069ef280 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55d3e2740180 con 0x55d3e2829c00 2024-09-10T23:18:56.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f2104993640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e2756400 0x55d3e271c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f2104993640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e2756400 0x55d3e271c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51026/0 (socket says 172.21.15.90:51026) 2024-09-10T23:18:56.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f2104993640 1 -- 172.21.15.90:0/770369868 learned_addr learned my addr 172.21.15.90:0/770369868 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:56.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f2105995640 1 --2- 172.21.15.90:0/770369868 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d3e2829c00 0x55d3e271d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f2105194640 1 --2- 172.21.15.90:0/770369868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e2756000 0x55d3e271cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f2104993640 1 -- 172.21.15.90:0/770369868 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d3e2829c00 msgr2=0x55d3e271d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f2104993640 1 --2- 172.21.15.90:0/770369868 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d3e2829c00 0x55d3e271d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f2104993640 1 -- 172.21.15.90:0/770369868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e2756000 msgr2=0x55d3e271cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f2104993640 1 --2- 172.21.15.90:0/770369868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e2756000 0x55d3e271cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f2104993640 1 -- 172.21.15.90:0/770369868 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3e1984780 con 0x55d3e2756400 2024-09-10T23:18:56.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.223+0000 7f2105194640 1 --2- 172.21.15.90:0/770369868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e2756000 0x55d3e271cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:56.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.224+0000 7f2104993640 1 --2- 172.21.15.90:0/770369868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e2756400 0x55d3e271c680 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x55d3e2846900 tx=0x55d3e272d020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:56.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.224+0000 7f20ff188640 1 -- 172.21.15.90:0/770369868 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d3e196d1e0 con 0x55d3e2756400 2024-09-10T23:18:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.224+0000 7f20ff188640 1 -- 172.21.15.90:0/770369868 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d3e1972e00 con 0x55d3e2756400 2024-09-10T23:18:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.224+0000 7f20ff188640 1 -- 172.21.15.90:0/770369868 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d3e196cea0 con 0x55d3e2756400 2024-09-10T23:18:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.224+0000 7f21069ef280 1 -- 172.21.15.90:0/770369868 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d3e1984000 con 0x55d3e2756400 2024-09-10T23:18:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.224+0000 7f21069ef280 1 -- 172.21.15.90:0/770369868 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3e1985680 con 0x55d3e2756400 2024-09-10T23:18:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.224+0000 7f21069ef280 4 main: resolving pool 16 2024-09-10T23:18:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.225+0000 7f20ff188640 1 -- 172.21.15.90:0/770369868 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x55d3e19a1500 con 0x55d3e2756400 2024-09-10T23:18:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.225+0000 7f20ff188640 1 --2- 172.21.15.90:0/770369868 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x55d3e28a3000 0x55d3e271d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.226+0000 7f20ff188640 1 -- 172.21.15.90:0/770369868 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x55d3e28a0600 con 0x55d3e2756400 2024-09-10T23:18:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.226+0000 7f21069ef280 4 main: creating IoCtx.. 2024-09-10T23:18:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.226+0000 7f21069ef280 1 --2- 172.21.15.90:0/770369868 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x55d3e2756800 0x55d3e271c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.226+0000 7f21069ef280 1 -- 172.21.15.90:0/770369868 --> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] -- osd_op(unknown.0.0:1 16.b 16:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108) -- 0x55d3e2756c00 con 0x55d3e2756800 2024-09-10T23:18:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.226+0000 7f2105995640 1 --2- 172.21.15.90:0/770369868 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x55d3e28a3000 0x55d3e271d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.226+0000 7f2105194640 1 --2- 172.21.15.90:0/770369868 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x55d3e2756800 0x55d3e271c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.226+0000 7f2105194640 1 --2- 172.21.15.90:0/770369868 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x55d3e2756800 0x55d3e271c100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:56.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.226+0000 7f2105995640 1 --2- 172.21.15.90:0/770369868 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x55d3e28a3000 0x55d3e271d700 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x55d3e1a0dfb0 tx=0x55d3e284b320 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:56.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.226+0000 7f2105194640 1 -- 172.21.15.90:0/770369868 <== osd.1 v2:172.21.15.90:6824/165329743 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv10 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x55d3e1a4a000 con 0x55d3e2756800 2024-09-10T23:18:56.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.226+0000 7f21069ef280 1 -- 172.21.15.90:0/770369868 --> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] -- osd_op(unknown.0.0:2 16.b 16:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108) -- 0x55d3e2757000 con 0x55d3e2756800 2024-09-10T23:18:56.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f2105194640 1 -- 172.21.15.90:0/770369868 <== osd.1 v2:172.21.15.90:6824/165329743 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv10 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x55d3e1a4a000 con 0x55d3e2756800 2024-09-10T23:18:56.235 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:18:56.235 INFO:teuthology.orchestra.run.smithi090.stdout: "0": { 2024-09-10T23:18:56.235 INFO:teuthology.orchestra.run.smithi090.stdout: "data": { 2024-09-10T23:18:56.235 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions": [] 2024-09-10T23:18:56.235 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-10T23:18:56.236 INFO:teuthology.orchestra.run.smithi090.stdout: "result": 0 2024-09-10T23:18:56.236 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-10T23:18:56.236 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:18:56.236 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 -- 172.21.15.90:0/770369868 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x55d3e2756800 msgr2=0x55d3e271c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 --2- 172.21.15.90:0/770369868 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x55d3e2756800 0x55d3e271c100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 -- 172.21.15.90:0/770369868 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x55d3e28a3000 msgr2=0x55d3e271d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 --2- 172.21.15.90:0/770369868 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x55d3e28a3000 0x55d3e271d700 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x55d3e1a0dfb0 tx=0x55d3e284b320 comp rx=0 tx=0).stop 2024-09-10T23:18:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 -- 172.21.15.90:0/770369868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e2756400 msgr2=0x55d3e271c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 --2- 172.21.15.90:0/770369868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e2756400 0x55d3e271c680 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x55d3e2846900 tx=0x55d3e272d020 comp rx=0 tx=0).stop 2024-09-10T23:18:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f2105194640 1 -- 172.21.15.90:0/770369868 reap_dead start 2024-09-10T23:18:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 -- 172.21.15.90:0/770369868 shutdown_connections 2024-09-10T23:18:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 -- 172.21.15.90:0/770369868 >> 172.21.15.90:0/770369868 conn(0x55d3e26f0400 msgr2=0x55d3e26dd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 -- 172.21.15.90:0/770369868 shutdown_connections 2024-09-10T23:18:56.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 -- 172.21.15.90:0/770369868 wait complete. 2024-09-10T23:18:56.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 -- 172.21.15.90:0/2483015931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e1947c00 msgr2=0x55d3e271ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 --2- 172.21.15.90:0/2483015931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e1947c00 0x55d3e271ab00 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x55d3e2773560 tx=0x55d3e272cc00 comp rx=0 tx=0).stop 2024-09-10T23:18:56.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 -- 172.21.15.90:0/2483015931 shutdown_connections 2024-09-10T23:18:56.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 --2- 172.21.15.90:0/2483015931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e26f0800 0x55d3e271bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 --2- 172.21.15.90:0/2483015931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d3e1947c00 0x55d3e271ab00 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 --2- 172.21.15.90:0/2483015931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d3e26f0000 0x55d3e271b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 -- 172.21.15.90:0/2483015931 >> 172.21.15.90:0/2483015931 conn(0x55d3e1947000 msgr2=0x55d3e26dd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:56.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 -- 172.21.15.90:0/2483015931 shutdown_connections 2024-09-10T23:18:56.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.227+0000 7f21069ef280 1 -- 172.21.15.90:0/2483015931 wait complete. 2024-09-10T23:18:56.239 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'session'] in time 0:00:00.060398, result: { "0": { "data": { "sessions": [] }, "result": 0 } } 2024-09-10T23:18:56.240 INFO:tasks.cephfs.test_sessionmap:SessionMap: { "0": { "data": { "sessions": [] }, "result": 0 } } 2024-09-10T23:18:56.240 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:18:56.240 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:18:56.320 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:18:56.364 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:18:56.365 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:18:56.365 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:18:56.365 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:56.381 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:18:56.381 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:18:56.381 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:18:56.381 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:56.422 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:18:56.423 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:18:56.423 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:18:56.423 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:56.438 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:18:56.438 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:18:56.438 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:18:56.438 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:56.480 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:18:56.480 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:56.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.581+0000 7f8509060640 1 -- 172.21.15.90:0/620267758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85040cf450 msgr2=0x7f85040cf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.581+0000 7f8509060640 1 --2- 172.21.15.90:0/620267758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85040cf450 0x7f85040cf8e0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f84f4005fd0 tx=0x7f84f402a540 comp rx=0 tx=0).stop 2024-09-10T23:18:56.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.581+0000 7f8509060640 1 -- 172.21.15.90:0/620267758 shutdown_connections 2024-09-10T23:18:56.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.581+0000 7f8509060640 1 --2- 172.21.15.90:0/620267758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85040cf450 0x7f85040cf8e0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.581+0000 7f8509060640 1 -- 172.21.15.90:0/620267758 >> 172.21.15.90:0/620267758 conn(0x7f850406cb70 msgr2=0x7f850406cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:56.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.581+0000 7f8509060640 1 -- 172.21.15.90:0/620267758 shutdown_connections 2024-09-10T23:18:56.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.581+0000 7f8509060640 1 -- 172.21.15.90:0/620267758 wait complete. 2024-09-10T23:18:56.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.583+0000 7f8509060640 1 Processor -- start 2024-09-10T23:18:56.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.583+0000 7f8509060640 1 -- start start 2024-09-10T23:18:56.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.583+0000 7f8509060640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f850406e920 0x7f85041f15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.583+0000 7f8509060640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850406ed00 0x7f85041e40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.583+0000 7f8509060640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85040cf450 0x7f85041f42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.583+0000 7f8509060640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8504140b90 con 0x7f850406e920 2024-09-10T23:18:56.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.583+0000 7f8509060640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8504140a10 con 0x7f85040cf450 2024-09-10T23:18:56.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.583+0000 7f8509060640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8504140d10 con 0x7f850406ed00 2024-09-10T23:18:56.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.584+0000 7f8502d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f850406e920 0x7f85041f15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.584+0000 7f8502d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f850406e920 0x7f85041f15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51038/0 (socket says 172.21.15.90:51038) 2024-09-10T23:18:56.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.584+0000 7f8502d9d640 1 -- 172.21.15.90:0/2953167068 learned_addr learned my addr 172.21.15.90:0/2953167068 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:56.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.584+0000 7f850359e640 1 --2- 172.21.15.90:0/2953167068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85040cf450 0x7f85041f42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.584+0000 7f850259c640 1 --2- 172.21.15.90:0/2953167068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850406ed00 0x7f85041e40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.584+0000 7f8502d9d640 1 -- 172.21.15.90:0/2953167068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850406ed00 msgr2=0x7f85041e40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.584+0000 7f8502d9d640 1 --2- 172.21.15.90:0/2953167068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850406ed00 0x7f85041e40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.584+0000 7f8502d9d640 1 -- 172.21.15.90:0/2953167068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85040cf450 msgr2=0x7f85041f42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.584+0000 7f8502d9d640 1 --2- 172.21.15.90:0/2953167068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85040cf450 0x7f85041f42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.584+0000 7f8502d9d640 1 -- 172.21.15.90:0/2953167068 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85041e4820 con 0x7f850406e920 2024-09-10T23:18:56.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.584+0000 7f8502d9d640 1 --2- 172.21.15.90:0/2953167068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f850406e920 0x7f85041f15d0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00b3f0 tx=0x7f84fc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:56.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.584+0000 7f84eb7fe640 1 -- 172.21.15.90:0/2953167068 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc015020 con 0x7f850406e920 2024-09-10T23:18:56.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.584+0000 7f84eb7fe640 1 -- 172.21.15.90:0/2953167068 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84fc011920 con 0x7f850406e920 2024-09-10T23:18:56.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.584+0000 7f8509060640 1 -- 172.21.15.90:0/2953167068 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85041e4b00 con 0x7f850406e920 2024-09-10T23:18:56.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.584+0000 7f84eb7fe640 1 -- 172.21.15.90:0/2953167068 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc011d70 con 0x7f850406e920 2024-09-10T23:18:56.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.584+0000 7f8509060640 1 -- 172.21.15.90:0/2953167068 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85041e50c0 con 0x7f850406e920 2024-09-10T23:18:56.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.585+0000 7f8509060640 1 -- 172.21.15.90:0/2953167068 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8504141180 con 0x7f850406e920 2024-09-10T23:18:56.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.586+0000 7f84eb7fe640 1 -- 172.21.15.90:0/2953167068 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f84fc01a400 con 0x7f850406e920 2024-09-10T23:18:56.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.586+0000 7f84eb7fe640 1 --2- 172.21.15.90:0/2953167068 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f84f0077f70 0x7f84f007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.586+0000 7f84eb7fe640 1 -- 172.21.15.90:0/2953167068 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7f84fc099c50 con 0x7f850406e920 2024-09-10T23:18:56.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.587+0000 7f850259c640 1 --2- 172.21.15.90:0/2953167068 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f84f0077f70 0x7f84f007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.587+0000 7f850259c640 1 --2- 172.21.15.90:0/2953167068 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f84f0077f70 0x7f84f007a430 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f850415f180 tx=0x7f84f8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:56.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.590+0000 7f84eb7fe640 1 -- 172.21.15.90:0/2953167068 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f84fc09f020 con 0x7f850406e920 2024-09-10T23:18:56.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.801+0000 7f8509060640 1 -- 172.21.15.90:0/2953167068 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f850406f760 con 0x7f850406e920 2024-09-10T23:18:56.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.801+0000 7f84eb7fe640 1 -- 172.21.15.90:0/2953167068 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5247 (secure 0 0 0) 0x7f84fc01f030 con 0x7f850406e920 2024-09-10T23:18:56.803 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:56.803 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":71,"btime":"2024-09-10T23:18:53:535985+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6083,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1271856183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1271856183},{"type":"v1","addr":"172.21.15.171:6835","nonce":1271856183}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/622220525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":622220525},{"type":"v1","addr":"172.21.15.171:6837","nonce":622220525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:19.149613+0000","modified":"2024-09-10T23:18:52.639872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7281,"mds_1":6451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"a","rank":1,"incarnation":69,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6835/2723277392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":2723277392},{"type":"v1","addr":"172.21.15.90:6835","nonce":2723277392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7281":{"gid":7281,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6834/638480774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":638480774},{"type":"v1","addr":"172.21.15.90:6834","nonce":638480774}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7281,"qdb_cluster":[7281,6451]},"id":8}]} 2024-09-10T23:18:56.803 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 71 2024-09-10T23:18:56.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.804+0000 7f8509060640 1 -- 172.21.15.90:0/2953167068 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f84f0077f70 msgr2=0x7f84f007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.804+0000 7f8509060640 1 --2- 172.21.15.90:0/2953167068 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f84f0077f70 0x7f84f007a430 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f850415f180 tx=0x7f84f8009040 comp rx=0 tx=0).stop 2024-09-10T23:18:56.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.804+0000 7f8509060640 1 -- 172.21.15.90:0/2953167068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f850406e920 msgr2=0x7f85041f15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.804+0000 7f8509060640 1 --2- 172.21.15.90:0/2953167068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f850406e920 0x7f85041f15d0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00b3f0 tx=0x7f84fc00b8b0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.804+0000 7f8509060640 1 -- 172.21.15.90:0/2953167068 shutdown_connections 2024-09-10T23:18:56.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.804+0000 7f8509060640 1 --2- 172.21.15.90:0/2953167068 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f84f0077f70 0x7f84f007a430 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.804+0000 7f8509060640 1 --2- 172.21.15.90:0/2953167068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85040cf450 0x7f85041f42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.804+0000 7f8509060640 1 --2- 172.21.15.90:0/2953167068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850406ed00 0x7f85041e40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.804+0000 7f8509060640 1 --2- 172.21.15.90:0/2953167068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f850406e920 0x7f85041f15d0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.804+0000 7f8509060640 1 -- 172.21.15.90:0/2953167068 >> 172.21.15.90:0/2953167068 conn(0x7f850406cb70 msgr2=0x7f850413d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:56.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.804+0000 7f8509060640 1 -- 172.21.15.90:0/2953167068 shutdown_connections 2024-09-10T23:18:56.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.804+0000 7f8509060640 1 -- 172.21.15.90:0/2953167068 wait complete. 2024-09-10T23:18:56.816 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:56.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.916+0000 7feb6a5b4640 1 -- 172.21.15.90:0/3081205067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb50003a00 msgr2=0x7feb50003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.916+0000 7feb6a5b4640 1 --2- 172.21.15.90:0/3081205067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb50003a00 0x7feb50003e20 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7feb5400c290 tx=0x7feb50005830 comp rx=0 tx=0).stop 2024-09-10T23:18:56.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.916+0000 7feb68b51640 1 -- 172.21.15.90:0/3081205067 reap_dead start 2024-09-10T23:18:56.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.916+0000 7feb6a5b4640 1 -- 172.21.15.90:0/3081205067 shutdown_connections 2024-09-10T23:18:56.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.916+0000 7feb6a5b4640 1 -- 172.21.15.90:0/3081205067 >> 172.21.15.90:0/3081205067 conn(0x7feb64068eb0 msgr2=0x7feb640692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:56.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.916+0000 7feb6a5b4640 1 -- 172.21.15.90:0/3081205067 shutdown_connections 2024-09-10T23:18:56.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.916+0000 7feb6a5b4640 1 -- 172.21.15.90:0/3081205067 wait complete. 2024-09-10T23:18:56.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.917+0000 7feb6a5b4640 1 Processor -- start 2024-09-10T23:18:56.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.917+0000 7feb6a5b4640 1 -- start start 2024-09-10T23:18:56.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.918+0000 7feb6a5b4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb50003a00 0x7feb640aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.918+0000 7feb6a5b4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb641f3d10 0x7feb641f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.918+0000 7feb6a5b4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb641f81c0 0x7feb641f8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.918+0000 7feb6a5b4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feb640d31e0 con 0x7feb641f3d10 2024-09-10T23:18:56.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.918+0000 7feb6a5b4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feb640d3360 con 0x7feb641f81c0 2024-09-10T23:18:56.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.918+0000 7feb6a5b4640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7feb640d34e0 con 0x7feb50003a00 2024-09-10T23:18:56.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.918+0000 7feb637fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb641f3d10 0x7feb641f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.918+0000 7feb637fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb641f3d10 0x7feb641f4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51060/0 (socket says 172.21.15.90:51060) 2024-09-10T23:18:56.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.918+0000 7feb637fe640 1 -- 172.21.15.90:0/3686364234 learned_addr learned my addr 172.21.15.90:0/3686364234 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:56.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.918+0000 7feb63fff640 1 --2- 172.21.15.90:0/3686364234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb50003a00 0x7feb640aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.918+0000 7feb68b51640 1 --2- 172.21.15.90:0/3686364234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb641f81c0 0x7feb641f8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.918+0000 7feb637fe640 1 -- 172.21.15.90:0/3686364234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb50003a00 msgr2=0x7feb640aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.918+0000 7feb637fe640 1 --2- 172.21.15.90:0/3686364234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb50003a00 0x7feb640aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.918+0000 7feb637fe640 1 -- 172.21.15.90:0/3686364234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb641f81c0 msgr2=0x7feb641f8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.918+0000 7feb637fe640 1 --2- 172.21.15.90:0/3686364234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb641f81c0 0x7feb641f8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.918+0000 7feb637fe640 1 -- 172.21.15.90:0/3686364234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb640ccd40 con 0x7feb641f3d10 2024-09-10T23:18:56.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.918+0000 7feb68b51640 1 --2- 172.21.15.90:0/3686364234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb641f81c0 0x7feb641f8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:56.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.919+0000 7feb637fe640 1 --2- 172.21.15.90:0/3686364234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb641f3d10 0x7feb641f4190 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7feb4c011a80 tx=0x7feb4c011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:56.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.919+0000 7feb60ff9640 1 -- 172.21.15.90:0/3686364234 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c00fe10 con 0x7feb641f3d10 2024-09-10T23:18:56.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.919+0000 7feb60ff9640 1 -- 172.21.15.90:0/3686364234 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb4c016070 con 0x7feb641f3d10 2024-09-10T23:18:56.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.919+0000 7feb6a5b4640 1 -- 172.21.15.90:0/3686364234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb640ccfc0 con 0x7feb641f3d10 2024-09-10T23:18:56.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.919+0000 7feb60ff9640 1 -- 172.21.15.90:0/3686364234 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c012780 con 0x7feb641f3d10 2024-09-10T23:18:56.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.919+0000 7feb6a5b4640 1 -- 172.21.15.90:0/3686364234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb640cd580 con 0x7feb641f3d10 2024-09-10T23:18:56.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.920+0000 7feb6a5b4640 1 -- 172.21.15.90:0/3686364234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb640b8500 con 0x7feb641f3d10 2024-09-10T23:18:56.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.920+0000 7feb60ff9640 1 -- 172.21.15.90:0/3686364234 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7feb4c012920 con 0x7feb641f3d10 2024-09-10T23:18:56.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.921+0000 7feb60ff9640 1 --2- 172.21.15.90:0/3686364234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb44077fa0 0x7feb4407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.921+0000 7feb60ff9640 1 -- 172.21.15.90:0/3686364234 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7feb4c09a930 con 0x7feb641f3d10 2024-09-10T23:18:56.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.921+0000 7feb63fff640 1 --2- 172.21.15.90:0/3686364234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb44077fa0 0x7feb4407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.921+0000 7feb63fff640 1 --2- 172.21.15.90:0/3686364234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb44077fa0 0x7feb4407a460 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7feb54033000 tx=0x7feb5402d000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:56.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:56.925+0000 7feb60ff9640 1 -- 172.21.15.90:0/3686364234 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7feb640ccd40 con 0x7feb641f3d10 2024-09-10T23:18:57.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.132+0000 7feb6a5b4640 1 -- 172.21.15.90:0/3686364234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb640d5020 con 0x7feb641f3d10 2024-09-10T23:18:57.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.133+0000 7feb60ff9640 1 -- 172.21.15.90:0/3686364234 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5247 (secure 0 0 0) 0x7feb4c063330 con 0x7feb641f3d10 2024-09-10T23:18:57.134 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:57.134 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":71,"btime":"2024-09-10T23:18:53:535985+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6083,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1271856183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1271856183},{"type":"v1","addr":"172.21.15.171:6835","nonce":1271856183}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/622220525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":622220525},{"type":"v1","addr":"172.21.15.171:6837","nonce":622220525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:19.149613+0000","modified":"2024-09-10T23:18:52.639872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7281,"mds_1":6451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"a","rank":1,"incarnation":69,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6835/2723277392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":2723277392},{"type":"v1","addr":"172.21.15.90:6835","nonce":2723277392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7281":{"gid":7281,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6834/638480774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":638480774},{"type":"v1","addr":"172.21.15.90:6834","nonce":638480774}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7281,"qdb_cluster":[7281,6451]},"id":8}]} 2024-09-10T23:18:57.134 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 71 2024-09-10T23:18:57.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.135+0000 7feb6a5b4640 1 -- 172.21.15.90:0/3686364234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb44077fa0 msgr2=0x7feb4407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:57.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.135+0000 7feb6a5b4640 1 --2- 172.21.15.90:0/3686364234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb44077fa0 0x7feb4407a460 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7feb54033000 tx=0x7feb5402d000 comp rx=0 tx=0).stop 2024-09-10T23:18:57.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.135+0000 7feb6a5b4640 1 -- 172.21.15.90:0/3686364234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb641f3d10 msgr2=0x7feb641f4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:57.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.135+0000 7feb6a5b4640 1 --2- 172.21.15.90:0/3686364234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb641f3d10 0x7feb641f4190 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7feb4c011a80 tx=0x7feb4c011f40 comp rx=0 tx=0).stop 2024-09-10T23:18:57.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.135+0000 7feb6a5b4640 1 -- 172.21.15.90:0/3686364234 shutdown_connections 2024-09-10T23:18:57.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.135+0000 7feb6a5b4640 1 --2- 172.21.15.90:0/3686364234 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feb44077fa0 0x7feb4407a460 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.135+0000 7feb6a5b4640 1 --2- 172.21.15.90:0/3686364234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb641f81c0 0x7feb641f8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.135+0000 7feb6a5b4640 1 --2- 172.21.15.90:0/3686364234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb641f3d10 0x7feb641f4190 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.135+0000 7feb6a5b4640 1 --2- 172.21.15.90:0/3686364234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb50003a00 0x7feb640aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.135+0000 7feb6a5b4640 1 -- 172.21.15.90:0/3686364234 >> 172.21.15.90:0/3686364234 conn(0x7feb64068eb0 msgr2=0x7feb640b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:57.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.135+0000 7feb6a5b4640 1 -- 172.21.15.90:0/3686364234 shutdown_connections 2024-09-10T23:18:57.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.135+0000 7feb6a5b4640 1 -- 172.21.15.90:0/3686364234 wait complete. 2024-09-10T23:18:57.147 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:18:57.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.247+0000 7f7df71b4640 1 -- 172.21.15.90:0/4012048980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df006e920 msgr2=0x7f7df015f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:57.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.247+0000 7f7df71b4640 1 --2- 172.21.15.90:0/4012048980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df006e920 0x7f7df015f430 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f7de0005fd0 tx=0x7f7de002aa00 comp rx=0 tx=0).stop 2024-09-10T23:18:57.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.247+0000 7f7df71b4640 1 -- 172.21.15.90:0/4012048980 shutdown_connections 2024-09-10T23:18:57.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.247+0000 7f7df71b4640 1 --2- 172.21.15.90:0/4012048980 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7df0074270 0x7f7df013f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.247+0000 7f7df71b4640 1 --2- 172.21.15.90:0/4012048980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df006e920 0x7f7df015f430 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.247+0000 7f7df71b4640 1 -- 172.21.15.90:0/4012048980 >> 172.21.15.90:0/4012048980 conn(0x7f7df006cb70 msgr2=0x7f7df006cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:57.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.247+0000 7f7df71b4640 1 -- 172.21.15.90:0/4012048980 shutdown_connections 2024-09-10T23:18:57.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.247+0000 7f7df71b4640 1 -- 172.21.15.90:0/4012048980 wait complete. 2024-09-10T23:18:57.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.248+0000 7f7df71b4640 1 Processor -- start 2024-09-10T23:18:57.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.248+0000 7f7df71b4640 1 -- start start 2024-09-10T23:18:57.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.249+0000 7f7df71b4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7df006e920 0x7f7df01e4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:57.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.249+0000 7f7df71b4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df006ed00 0x7f7df0151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:57.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.249+0000 7f7df71b4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7df0074270 0x7f7df01510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:57.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.249+0000 7f7df71b4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7df0074880 con 0x7f7df006ed00 2024-09-10T23:18:57.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.249+0000 7f7df71b4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7df0074700 con 0x7f7df0074270 2024-09-10T23:18:57.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.249+0000 7f7df71b4640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7df013fd30 con 0x7f7df006e920 2024-09-10T23:18:57.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.249+0000 7f7deffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df006ed00 0x7f7df0151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:57.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.249+0000 7f7deffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df006ed00 0x7f7df0151830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51080/0 (socket says 172.21.15.90:51080) 2024-09-10T23:18:57.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.249+0000 7f7deffff640 1 -- 172.21.15.90:0/370941584 learned_addr learned my addr 172.21.15.90:0/370941584 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:57.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.249+0000 7f7df5751640 1 --2- 172.21.15.90:0/370941584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7df0074270 0x7f7df01510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:57.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.249+0000 7f7df4f50640 1 --2- 172.21.15.90:0/370941584 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7df006e920 0x7f7df01e4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:57.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.249+0000 7f7deffff640 1 -- 172.21.15.90:0/370941584 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7df006e920 msgr2=0x7f7df01e4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:57.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.249+0000 7f7deffff640 1 --2- 172.21.15.90:0/370941584 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7df006e920 0x7f7df01e4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.249+0000 7f7deffff640 1 -- 172.21.15.90:0/370941584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7df0074270 msgr2=0x7f7df01510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:57.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.249+0000 7f7deffff640 1 --2- 172.21.15.90:0/370941584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7df0074270 0x7f7df01510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.250+0000 7f7deffff640 1 -- 172.21.15.90:0/370941584 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df0136580 con 0x7f7df006ed00 2024-09-10T23:18:57.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.250+0000 7f7deffff640 1 --2- 172.21.15.90:0/370941584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df006ed00 0x7f7df0151830 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800c410 tx=0x7f7dd800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:57.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.250+0000 7f7ded7fa640 1 -- 172.21.15.90:0/370941584 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8017070 con 0x7f7df006ed00 2024-09-10T23:18:57.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.250+0000 7f7ded7fa640 1 -- 172.21.15.90:0/370941584 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7dd80035f0 con 0x7f7df006ed00 2024-09-10T23:18:57.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.250+0000 7f7ded7fa640 1 -- 172.21.15.90:0/370941584 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8003a80 con 0x7f7df006ed00 2024-09-10T23:18:57.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.250+0000 7f7df71b4640 1 -- 172.21.15.90:0/370941584 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df0151620 con 0x7f7df006ed00 2024-09-10T23:18:57.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.250+0000 7f7df71b4640 1 -- 172.21.15.90:0/370941584 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df0136800 con 0x7f7df006ed00 2024-09-10T23:18:57.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.251+0000 7f7df71b4640 1 -- 172.21.15.90:0/370941584 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7df0152360 con 0x7f7df006ed00 2024-09-10T23:18:57.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.251+0000 7f7ded7fa640 1 -- 172.21.15.90:0/370941584 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7dd8003c20 con 0x7f7df006ed00 2024-09-10T23:18:57.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.252+0000 7f7ded7fa640 1 --2- 172.21.15.90:0/370941584 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7dd0077f70 0x7f7dd007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:57.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.252+0000 7f7ded7fa640 1 -- 172.21.15.90:0/370941584 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7f7dd80994f0 con 0x7f7df006ed00 2024-09-10T23:18:57.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.252+0000 7f7df4f50640 1 --2- 172.21.15.90:0/370941584 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7dd0077f70 0x7f7dd007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:57.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.253+0000 7f7df4f50640 1 --2- 172.21.15.90:0/370941584 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7dd0077f70 0x7f7dd007a430 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7de0035000 tx=0x7f7de0004ab0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:57.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.256+0000 7f7ded7fa640 1 -- 172.21.15.90:0/370941584 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7df0136580 con 0x7f7df006ed00 2024-09-10T23:18:57.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.433+0000 7f7df71b4640 1 -- 172.21.15.90:0/370941584 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7df015f430 con 0x7f7df006ed00 2024-09-10T23:18:57.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.434+0000 7f7ded7fa640 1 -- 172.21.15.90:0/370941584 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) ==== 74+0+17080 (secure 0 0 0) 0x7f7dd8061f80 con 0x7f7df006ed00 2024-09-10T23:18:57.435 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:57.435 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":108,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:18:38.485270+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:18:17.397925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-10T23:18:18.113855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.171:6836/1514360394":"2024-09-11T23:18:38.485249+0000","172.21.15.171:6834/1514360394":"2024-09-11T23:18:38.485249+0000","172.21.15.90:6833/4002726882":"2024-09-11T23:18:32.496674+0000","172.21.15.171:6837/3083996658":"2024-09-11T23:18:32.487388+0000","172.21.15.90:6835/4002726882":"2024-09-11T23:18:32.496674+0000","172.21.15.171:6835/3083996658":"2024-09-11T23:18:32.487388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:18:57.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.436+0000 7f7df71b4640 1 -- 172.21.15.90:0/370941584 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7dd0077f70 msgr2=0x7f7dd007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:57.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.436+0000 7f7df71b4640 1 --2- 172.21.15.90:0/370941584 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7dd0077f70 0x7f7dd007a430 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7de0035000 tx=0x7f7de0004ab0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.436+0000 7f7df71b4640 1 -- 172.21.15.90:0/370941584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df006ed00 msgr2=0x7f7df0151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:57.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.436+0000 7f7df71b4640 1 --2- 172.21.15.90:0/370941584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df006ed00 0x7f7df0151830 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800c410 tx=0x7f7dd800c8d0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.436+0000 7f7df71b4640 1 -- 172.21.15.90:0/370941584 shutdown_connections 2024-09-10T23:18:57.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.436+0000 7f7df71b4640 1 --2- 172.21.15.90:0/370941584 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f7dd0077f70 0x7f7dd007a430 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.436+0000 7f7df71b4640 1 --2- 172.21.15.90:0/370941584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7df0074270 0x7f7df01510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.436+0000 7f7df71b4640 1 --2- 172.21.15.90:0/370941584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7df006ed00 0x7f7df0151830 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.436+0000 7f7df71b4640 1 --2- 172.21.15.90:0/370941584 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7df006e920 0x7f7df01e4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.436+0000 7f7df71b4640 1 -- 172.21.15.90:0/370941584 >> 172.21.15.90:0/370941584 conn(0x7f7df006cb70 msgr2=0x7f7df015c570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:57.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.436+0000 7f7df71b4640 1 -- 172.21.15.90:0/370941584 shutdown_connections 2024-09-10T23:18:57.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.436+0000 7f7df71b4640 1 -- 172.21.15.90:0/370941584 wait complete. 2024-09-10T23:18:57.448 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:18:57.449 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:57.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.549+0000 7fb7baeed640 1 -- 172.21.15.90:0/1915216206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7b406ed00 msgr2=0x7fb7b4073b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:57.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.549+0000 7fb7baeed640 1 --2- 172.21.15.90:0/1915216206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7b406ed00 0x7fb7b4073b60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4005fd0 tx=0x7fb7a402aa90 comp rx=0 tx=0).stop 2024-09-10T23:18:57.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.549+0000 7fb7baeed640 1 -- 172.21.15.90:0/1915216206 shutdown_connections 2024-09-10T23:18:57.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.549+0000 7fb7baeed640 1 --2- 172.21.15.90:0/1915216206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7b406ed00 0x7fb7b4073b60 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.549+0000 7fb7baeed640 1 --2- 172.21.15.90:0/1915216206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7b406e920 0x7fb7b415f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.549+0000 7fb7baeed640 1 -- 172.21.15.90:0/1915216206 >> 172.21.15.90:0/1915216206 conn(0x7fb7b406cb70 msgr2=0x7fb7b406cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:57.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.549+0000 7fb7baeed640 1 -- 172.21.15.90:0/1915216206 shutdown_connections 2024-09-10T23:18:57.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.549+0000 7fb7baeed640 1 -- 172.21.15.90:0/1915216206 wait complete. 2024-09-10T23:18:57.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.550+0000 7fb7baeed640 1 Processor -- start 2024-09-10T23:18:57.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.550+0000 7fb7baeed640 1 -- start start 2024-09-10T23:18:57.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.551+0000 7fb7baeed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7b406e920 0x7fb7b415a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:57.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.551+0000 7fb7baeed640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7b406ed00 0x7fb7b41f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:57.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.551+0000 7fb7baeed640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7b40740a0 0x7fb7b4157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:57.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.551+0000 7fb7baeed640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b40748c0 con 0x7fb7b406e920 2024-09-10T23:18:57.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.551+0000 7fb7baeed640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b4074740 con 0x7fb7b406ed00 2024-09-10T23:18:57.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.551+0000 7fb7baeed640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb7b40cf450 con 0x7fb7b40740a0 2024-09-10T23:18:57.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.551+0000 7fb7b8c89640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7b406e920 0x7fb7b415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:57.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.551+0000 7fb7b8c89640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7b406e920 0x7fb7b415a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51088/0 (socket says 172.21.15.90:51088) 2024-09-10T23:18:57.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.551+0000 7fb7b8c89640 1 -- 172.21.15.90:0/1925366170 learned_addr learned my addr 172.21.15.90:0/1925366170 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:57.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.551+0000 7fb7b3fff640 1 --2- 172.21.15.90:0/1925366170 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7b406ed00 0x7fb7b41f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:57.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.551+0000 7fb7b948a640 1 --2- 172.21.15.90:0/1925366170 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7b40740a0 0x7fb7b4157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:57.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.551+0000 7fb7b8c89640 1 -- 172.21.15.90:0/1925366170 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7b40740a0 msgr2=0x7fb7b4157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:57.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.551+0000 7fb7b8c89640 1 --2- 172.21.15.90:0/1925366170 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7b40740a0 0x7fb7b4157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.551+0000 7fb7b8c89640 1 -- 172.21.15.90:0/1925366170 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7b406ed00 msgr2=0x7fb7b41f36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:57.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.551+0000 7fb7b8c89640 1 --2- 172.21.15.90:0/1925366170 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7b406ed00 0x7fb7b41f36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.551+0000 7fb7b8c89640 1 -- 172.21.15.90:0/1925366170 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b41f3bf0 con 0x7fb7b406e920 2024-09-10T23:18:57.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.552+0000 7fb7b8c89640 1 --2- 172.21.15.90:0/1925366170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7b406e920 0x7fb7b415a440 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00e790 tx=0x7fb79c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:57.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.552+0000 7fb7b17fa640 1 -- 172.21.15.90:0/1925366170 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c00eea0 con 0x7fb7b406e920 2024-09-10T23:18:57.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.552+0000 7fb7b17fa640 1 -- 172.21.15.90:0/1925366170 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb79c00cdb0 con 0x7fb7b406e920 2024-09-10T23:18:57.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.552+0000 7fb7baeed640 1 -- 172.21.15.90:0/1925366170 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b41593a0 con 0x7fb7b406e920 2024-09-10T23:18:57.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.552+0000 7fb7b17fa640 1 -- 172.21.15.90:0/1925366170 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c010690 con 0x7fb7b406e920 2024-09-10T23:18:57.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.552+0000 7fb7baeed640 1 -- 172.21.15.90:0/1925366170 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b4159960 con 0x7fb7b406e920 2024-09-10T23:18:57.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.553+0000 7fb7baeed640 1 -- 172.21.15.90:0/1925366170 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7b4076140 con 0x7fb7b406e920 2024-09-10T23:18:57.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.553+0000 7fb7b17fa640 1 -- 172.21.15.90:0/1925366170 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb79c010830 con 0x7fb7b406e920 2024-09-10T23:18:57.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.554+0000 7fb7b17fa640 1 --2- 172.21.15.90:0/1925366170 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb794077f70 0x7fb79407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:57.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.554+0000 7fb7b17fa640 1 -- 172.21.15.90:0/1925366170 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7fb79c09a880 con 0x7fb7b406e920 2024-09-10T23:18:57.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.554+0000 7fb7b3fff640 1 --2- 172.21.15.90:0/1925366170 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb794077f70 0x7fb79407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:57.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.555+0000 7fb7b3fff640 1 --2- 172.21.15.90:0/1925366170 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb794077f70 0x7fb79407a430 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4035000 tx=0x7fb7a4039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:57.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.562+0000 7fb7b17fa640 1 -- 172.21.15.90:0/1925366170 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb7b4076140 con 0x7fb7b406e920 2024-09-10T23:18:57.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.772+0000 7fb7baeed640 1 -- 172.21.15.90:0/1925366170 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7b406f760 con 0x7fb7b406e920 2024-09-10T23:18:57.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.772+0000 7fb7b17fa640 1 -- 172.21.15.90:0/1925366170 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5247 (secure 0 0 0) 0x7fb79c062bb0 con 0x7fb7b406e920 2024-09-10T23:18:57.773 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:57.773 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":71,"btime":"2024-09-10T23:18:53:535985+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6083,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1271856183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1271856183},{"type":"v1","addr":"172.21.15.171:6835","nonce":1271856183}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/622220525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":622220525},{"type":"v1","addr":"172.21.15.171:6837","nonce":622220525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:19.149613+0000","modified":"2024-09-10T23:18:52.639872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7281,"mds_1":6451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"a","rank":1,"incarnation":69,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6835/2723277392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":2723277392},{"type":"v1","addr":"172.21.15.90:6835","nonce":2723277392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7281":{"gid":7281,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6834/638480774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":638480774},{"type":"v1","addr":"172.21.15.90:6834","nonce":638480774}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7281,"qdb_cluster":[7281,6451]},"id":8}]} 2024-09-10T23:18:57.774 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 71 2024-09-10T23:18:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.774+0000 7fb7baeed640 1 -- 172.21.15.90:0/1925366170 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb794077f70 msgr2=0x7fb79407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.774+0000 7fb7baeed640 1 --2- 172.21.15.90:0/1925366170 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb794077f70 0x7fb79407a430 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4035000 tx=0x7fb7a4039040 comp rx=0 tx=0).stop 2024-09-10T23:18:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.774+0000 7fb7baeed640 1 -- 172.21.15.90:0/1925366170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7b406e920 msgr2=0x7fb7b415a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.774+0000 7fb7baeed640 1 --2- 172.21.15.90:0/1925366170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7b406e920 0x7fb7b415a440 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00e790 tx=0x7fb79c00ec50 comp rx=0 tx=0).stop 2024-09-10T23:18:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.774+0000 7fb7baeed640 1 -- 172.21.15.90:0/1925366170 shutdown_connections 2024-09-10T23:18:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.774+0000 7fb7baeed640 1 --2- 172.21.15.90:0/1925366170 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb794077f70 0x7fb79407a430 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.774+0000 7fb7baeed640 1 --2- 172.21.15.90:0/1925366170 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7b406ed00 0x7fb7b41f36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.774+0000 7fb7baeed640 1 --2- 172.21.15.90:0/1925366170 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7b40740a0 0x7fb7b4157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.774+0000 7fb7baeed640 1 --2- 172.21.15.90:0/1925366170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7b406e920 0x7fb7b415a440 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.774+0000 7fb7baeed640 1 -- 172.21.15.90:0/1925366170 >> 172.21.15.90:0/1925366170 conn(0x7fb7b406cb70 msgr2=0x7fb7b4154be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.774+0000 7fb7baeed640 1 -- 172.21.15.90:0/1925366170 shutdown_connections 2024-09-10T23:18:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.774+0000 7fb7baeed640 1 -- 172.21.15.90:0/1925366170 wait complete. 2024-09-10T23:18:57.786 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:57.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.885+0000 7fd19333a640 1 -- 172.21.15.90:0/4165699404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18c0cea00 msgr2=0x7fd18c0cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:57.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.885+0000 7fd19333a640 1 --2- 172.21.15.90:0/4165699404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18c0cea00 0x7fd18c0cee70 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fd184005fd0 tx=0x7fd18402aa00 comp rx=0 tx=0).stop 2024-09-10T23:18:57.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.886+0000 7fd19333a640 1 -- 172.21.15.90:0/4165699404 shutdown_connections 2024-09-10T23:18:57.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.886+0000 7fd19333a640 1 --2- 172.21.15.90:0/4165699404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18c0cea00 0x7fd18c0cee70 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.886+0000 7fd19333a640 1 --2- 172.21.15.90:0/4165699404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd18c070b40 0x7fd18c1545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.886+0000 7fd19333a640 1 -- 172.21.15.90:0/4165699404 >> 172.21.15.90:0/4165699404 conn(0x7fd18c06cb70 msgr2=0x7fd18c06cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:57.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.886+0000 7fd19333a640 1 -- 172.21.15.90:0/4165699404 shutdown_connections 2024-09-10T23:18:57.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.886+0000 7fd19333a640 1 -- 172.21.15.90:0/4165699404 wait complete. 2024-09-10T23:18:57.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.887+0000 7fd19333a640 1 Processor -- start 2024-09-10T23:18:57.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.887+0000 7fd19333a640 1 -- start start 2024-09-10T23:18:57.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.887+0000 7fd19333a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd18c070b40 0x7fd18c14a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:57.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd19333a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18c0cea00 0x7fd18c0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:57.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd19333a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd18c15a820 0x7fd18c1591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:57.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd19333a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c0cf770 con 0x7fd18c0cea00 2024-09-10T23:18:57.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd19333a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c0cf5f0 con 0x7fd18c15a820 2024-09-10T23:18:57.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd19333a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd18c0cf8f0 con 0x7fd18c070b40 2024-09-10T23:18:57.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd1908d5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18c0cea00 0x7fd18c0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:57.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd1908d5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18c0cea00 0x7fd18c0b1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51112/0 (socket says 172.21.15.90:51112) 2024-09-10T23:18:57.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd1908d5640 1 -- 172.21.15.90:0/557946365 learned_addr learned my addr 172.21.15.90:0/557946365 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:57.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd1910d6640 1 --2- 172.21.15.90:0/557946365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd18c070b40 0x7fd18c14a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:57.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd1908d5640 1 -- 172.21.15.90:0/557946365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd18c070b40 msgr2=0x7fd18c14a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:57.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd1908d5640 1 --2- 172.21.15.90:0/557946365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd18c070b40 0x7fd18c14a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd1908d5640 1 -- 172.21.15.90:0/557946365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd18c15a820 msgr2=0x7fd18c1591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:57.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd1918d7640 1 --2- 172.21.15.90:0/557946365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd18c15a820 0x7fd18c1591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:57.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd1908d5640 1 --2- 172.21.15.90:0/557946365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd18c15a820 0x7fd18c1591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:57.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd1908d5640 1 -- 172.21.15.90:0/557946365 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18c1f60d0 con 0x7fd18c0cea00 2024-09-10T23:18:57.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd1910d6640 1 --2- 172.21.15.90:0/557946365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd18c070b40 0x7fd18c14a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:57.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd1918d7640 1 --2- 172.21.15.90:0/557946365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd18c15a820 0x7fd18c1591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:57.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd1908d5640 1 --2- 172.21.15.90:0/557946365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18c0cea00 0x7fd18c0b1e80 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00b3e0 tx=0x7fd17c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:57.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd181ffb640 1 -- 172.21.15.90:0/557946365 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17c015020 con 0x7fd18c0cea00 2024-09-10T23:18:57.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd181ffb640 1 -- 172.21.15.90:0/557946365 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd17c011940 con 0x7fd18c0cea00 2024-09-10T23:18:57.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd19333a640 1 -- 172.21.15.90:0/557946365 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd18c1f63b0 con 0x7fd18c0cea00 2024-09-10T23:18:57.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.888+0000 7fd181ffb640 1 -- 172.21.15.90:0/557946365 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17c011d90 con 0x7fd18c0cea00 2024-09-10T23:18:57.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.889+0000 7fd19333a640 1 -- 172.21.15.90:0/557946365 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd18c0b23c0 con 0x7fd18c0cea00 2024-09-10T23:18:57.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.890+0000 7fd19333a640 1 -- 172.21.15.90:0/557946365 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd18c1545c0 con 0x7fd18c0cea00 2024-09-10T23:18:57.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.890+0000 7fd181ffb640 1 -- 172.21.15.90:0/557946365 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd17c01a400 con 0x7fd18c0cea00 2024-09-10T23:18:57.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.890+0000 7fd181ffb640 1 --2- 172.21.15.90:0/557946365 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd170077f70 0x7fd17007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:57.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.890+0000 7fd181ffb640 1 -- 172.21.15.90:0/557946365 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7fd17c09a000 con 0x7fd18c0cea00 2024-09-10T23:18:57.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.891+0000 7fd1910d6640 1 --2- 172.21.15.90:0/557946365 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd170077f70 0x7fd17007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:57.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.891+0000 7fd1910d6640 1 --2- 172.21.15.90:0/557946365 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd170077f70 0x7fd17007a430 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd188006fd0 tx=0x7fd188008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:57.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:57.894+0000 7fd181ffb640 1 -- 172.21.15.90:0/557946365 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd17c01f020 con 0x7fd18c0cea00 2024-09-10T23:18:58.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.103+0000 7fd19333a640 1 -- 172.21.15.90:0/557946365 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd18c0b5140 con 0x7fd18c0cea00 2024-09-10T23:18:58.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.104+0000 7fd181ffb640 1 -- 172.21.15.90:0/557946365 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5247 (secure 0 0 0) 0x7fd17c062a90 con 0x7fd18c0cea00 2024-09-10T23:18:58.105 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:58.105 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":71,"btime":"2024-09-10T23:18:53:535985+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6083,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1271856183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1271856183},{"type":"v1","addr":"172.21.15.171:6835","nonce":1271856183}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/622220525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":622220525},{"type":"v1","addr":"172.21.15.171:6837","nonce":622220525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:19.149613+0000","modified":"2024-09-10T23:18:52.639872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7281,"mds_1":6451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6451":{"gid":6451,"name":"a","rank":1,"incarnation":69,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6835/2723277392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6833","nonce":2723277392},{"type":"v1","addr":"172.21.15.90:6835","nonce":2723277392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7281":{"gid":7281,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6834/638480774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":638480774},{"type":"v1","addr":"172.21.15.90:6834","nonce":638480774}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7281,"qdb_cluster":[7281,6451]},"id":8}]} 2024-09-10T23:18:58.105 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 71 2024-09-10T23:18:58.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.106+0000 7fd19333a640 1 -- 172.21.15.90:0/557946365 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd170077f70 msgr2=0x7fd17007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.106+0000 7fd19333a640 1 --2- 172.21.15.90:0/557946365 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd170077f70 0x7fd17007a430 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd188006fd0 tx=0x7fd188008040 comp rx=0 tx=0).stop 2024-09-10T23:18:58.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.106+0000 7fd19333a640 1 -- 172.21.15.90:0/557946365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18c0cea00 msgr2=0x7fd18c0b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.106+0000 7fd19333a640 1 --2- 172.21.15.90:0/557946365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18c0cea00 0x7fd18c0b1e80 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00b3e0 tx=0x7fd17c00b8a0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.106+0000 7fd19333a640 1 -- 172.21.15.90:0/557946365 shutdown_connections 2024-09-10T23:18:58.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.106+0000 7fd19333a640 1 --2- 172.21.15.90:0/557946365 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fd170077f70 0x7fd17007a430 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.106+0000 7fd19333a640 1 --2- 172.21.15.90:0/557946365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd18c15a820 0x7fd18c1591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.106+0000 7fd19333a640 1 --2- 172.21.15.90:0/557946365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18c0cea00 0x7fd18c0b1e80 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.106+0000 7fd19333a640 1 --2- 172.21.15.90:0/557946365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd18c070b40 0x7fd18c14a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.106+0000 7fd19333a640 1 -- 172.21.15.90:0/557946365 >> 172.21.15.90:0/557946365 conn(0x7fd18c06cb70 msgr2=0x7fd18c158350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:58.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.106+0000 7fd19333a640 1 -- 172.21.15.90:0/557946365 shutdown_connections 2024-09-10T23:18:58.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.106+0000 7fd19333a640 1 -- 172.21.15.90:0/557946365 wait complete. 2024-09-10T23:18:58.118 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:18:58.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.218+0000 7fce3a36b640 1 -- 172.21.15.90:0/314178056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce340cdf70 msgr2=0x7fce340cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.218+0000 7fce3a36b640 1 --2- 172.21.15.90:0/314178056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce340cdf70 0x7fce340cf900 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fce24005fd0 tx=0x7fce2402a5d0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.218+0000 7fce3a36b640 1 -- 172.21.15.90:0/314178056 shutdown_connections 2024-09-10T23:18:58.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.218+0000 7fce3a36b640 1 --2- 172.21.15.90:0/314178056 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce3406f030 0x7fce34072da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.218+0000 7fce3a36b640 1 --2- 172.21.15.90:0/314178056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce340cdf70 0x7fce340cf900 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.218+0000 7fce3a36b640 1 -- 172.21.15.90:0/314178056 >> 172.21.15.90:0/314178056 conn(0x7fce3406cb70 msgr2=0x7fce3406cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:58.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.218+0000 7fce3a36b640 1 -- 172.21.15.90:0/314178056 shutdown_connections 2024-09-10T23:18:58.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.218+0000 7fce3a36b640 1 -- 172.21.15.90:0/314178056 wait complete. 2024-09-10T23:18:58.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.219+0000 7fce3a36b640 1 Processor -- start 2024-09-10T23:18:58.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.219+0000 7fce3a36b640 1 -- start start 2024-09-10T23:18:58.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.220+0000 7fce3a36b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce3406f030 0x7fce341f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.220+0000 7fce3a36b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce34070b40 0x7fce3414d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.220+0000 7fce3a36b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce340cdf70 0x7fce3415e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.220+0000 7fce3a36b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce34073920 con 0x7fce3406f030 2024-09-10T23:18:58.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.220+0000 7fce3a36b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fce340737a0 con 0x7fce340cdf70 2024-09-10T23:18:58.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.220+0000 7fce3a36b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fce34073aa0 con 0x7fce34070b40 2024-09-10T23:18:58.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.220+0000 7fce33fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce3406f030 0x7fce341f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.220+0000 7fce33fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce3406f030 0x7fce341f6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36086/0 (socket says 172.21.15.90:36086) 2024-09-10T23:18:58.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.220+0000 7fce33fff640 1 -- 172.21.15.90:0/3547674520 learned_addr learned my addr 172.21.15.90:0/3547674520 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:58.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.220+0000 7fce337fe640 1 --2- 172.21.15.90:0/3547674520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce34070b40 0x7fce3414d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.220+0000 7fce38908640 1 --2- 172.21.15.90:0/3547674520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce340cdf70 0x7fce3415e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.220+0000 7fce33fff640 1 -- 172.21.15.90:0/3547674520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce34070b40 msgr2=0x7fce3414d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.220+0000 7fce33fff640 1 --2- 172.21.15.90:0/3547674520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce34070b40 0x7fce3414d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.220+0000 7fce33fff640 1 -- 172.21.15.90:0/3547674520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce340cdf70 msgr2=0x7fce3415e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.220+0000 7fce33fff640 1 --2- 172.21.15.90:0/3547674520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce340cdf70 0x7fce3415e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.220+0000 7fce33fff640 1 -- 172.21.15.90:0/3547674520 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce341553d0 con 0x7fce3406f030 2024-09-10T23:18:58.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.220+0000 7fce38908640 1 --2- 172.21.15.90:0/3547674520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce340cdf70 0x7fce3415e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:58.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.221+0000 7fce33fff640 1 --2- 172.21.15.90:0/3547674520 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce3406f030 0x7fce341f6c90 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fce24034040 tx=0x7fce240038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:58.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.221+0000 7fce30ff9640 1 -- 172.21.15.90:0/3547674520 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2403e030 con 0x7fce3406f030 2024-09-10T23:18:58.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.221+0000 7fce30ff9640 1 -- 172.21.15.90:0/3547674520 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce24003ca0 con 0x7fce3406f030 2024-09-10T23:18:58.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.221+0000 7fce3a36b640 1 -- 172.21.15.90:0/3547674520 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce340cc3e0 con 0x7fce3406f030 2024-09-10T23:18:58.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.221+0000 7fce30ff9640 1 -- 172.21.15.90:0/3547674520 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce24035040 con 0x7fce3406f030 2024-09-10T23:18:58.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.221+0000 7fce3a36b640 1 -- 172.21.15.90:0/3547674520 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3414dee0 con 0x7fce3406f030 2024-09-10T23:18:58.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.222+0000 7fce3a36b640 1 -- 172.21.15.90:0/3547674520 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce34073fc0 con 0x7fce3406f030 2024-09-10T23:18:58.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.223+0000 7fce30ff9640 1 -- 172.21.15.90:0/3547674520 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fce240049e0 con 0x7fce3406f030 2024-09-10T23:18:58.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.223+0000 7fce30ff9640 1 --2- 172.21.15.90:0/3547674520 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce20077f70 0x7fce2007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.223+0000 7fce30ff9640 1 -- 172.21.15.90:0/3547674520 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7fce240ba5e0 con 0x7fce3406f030 2024-09-10T23:18:58.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.223+0000 7fce337fe640 1 --2- 172.21.15.90:0/3547674520 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce20077f70 0x7fce2007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.224+0000 7fce337fe640 1 --2- 172.21.15.90:0/3547674520 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce20077f70 0x7fce2007a430 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fce3414e4c0 tx=0x7fce28009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:58.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.227+0000 7fce30ff9640 1 -- 172.21.15.90:0/3547674520 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fce24082990 con 0x7fce3406f030 2024-09-10T23:18:58.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.402+0000 7fce3a36b640 1 -- 172.21.15.90:0/3547674520 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce340cd570 con 0x7fce3406f030 2024-09-10T23:18:58.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.403+0000 7fce30ff9640 1 -- 172.21.15.90:0/3547674520 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) ==== 74+0+17080 (secure 0 0 0) 0x7fce240873c0 con 0x7fce3406f030 2024-09-10T23:18:58.404 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:18:58.405 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":108,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:18:38.485270+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:18:17.397925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-10T23:18:18.113855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.171:6836/1514360394":"2024-09-11T23:18:38.485249+0000","172.21.15.171:6834/1514360394":"2024-09-11T23:18:38.485249+0000","172.21.15.90:6833/4002726882":"2024-09-11T23:18:32.496674+0000","172.21.15.171:6837/3083996658":"2024-09-11T23:18:32.487388+0000","172.21.15.90:6835/4002726882":"2024-09-11T23:18:32.496674+0000","172.21.15.171:6835/3083996658":"2024-09-11T23:18:32.487388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:18:58.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.406+0000 7fce3a36b640 1 -- 172.21.15.90:0/3547674520 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce20077f70 msgr2=0x7fce2007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.406+0000 7fce3a36b640 1 --2- 172.21.15.90:0/3547674520 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce20077f70 0x7fce2007a430 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fce3414e4c0 tx=0x7fce28009040 comp rx=0 tx=0).stop 2024-09-10T23:18:58.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.406+0000 7fce3a36b640 1 -- 172.21.15.90:0/3547674520 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce3406f030 msgr2=0x7fce341f6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.406+0000 7fce3a36b640 1 --2- 172.21.15.90:0/3547674520 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce3406f030 0x7fce341f6c90 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fce24034040 tx=0x7fce240038a0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.406+0000 7fce3a36b640 1 -- 172.21.15.90:0/3547674520 shutdown_connections 2024-09-10T23:18:58.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.406+0000 7fce3a36b640 1 --2- 172.21.15.90:0/3547674520 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fce20077f70 0x7fce2007a430 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.406+0000 7fce3a36b640 1 --2- 172.21.15.90:0/3547674520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce340cdf70 0x7fce3415e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.406+0000 7fce3a36b640 1 --2- 172.21.15.90:0/3547674520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce34070b40 0x7fce3414d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.406+0000 7fce3a36b640 1 --2- 172.21.15.90:0/3547674520 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce3406f030 0x7fce341f6c90 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.406+0000 7fce3a36b640 1 -- 172.21.15.90:0/3547674520 >> 172.21.15.90:0/3547674520 conn(0x7fce3406cb70 msgr2=0x7fce34151fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:58.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.406+0000 7fce3a36b640 1 -- 172.21.15.90:0/3547674520 shutdown_connections 2024-09-10T23:18:58.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.406+0000 7fce3a36b640 1 -- 172.21.15.90:0/3547674520 wait complete. 2024-09-10T23:18:58.418 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:18:58.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.519+0000 7fa011885640 1 -- 172.21.15.90:0/1040654722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa00c0d29a0 msgr2=0x7fa00c06db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.519+0000 7fa011885640 1 --2- 172.21.15.90:0/1040654722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa00c0d29a0 0x7fa00c06db90 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fa00c08e5f0 tx=0x7f9ffc02a5f0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.519+0000 7fa011885640 1 -- 172.21.15.90:0/1040654722 shutdown_connections 2024-09-10T23:18:58.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.519+0000 7fa011885640 1 --2- 172.21.15.90:0/1040654722 >> v2:172.21.15.171:3300/0 conn(0x7fa00c0d4d00 0x7fa00c162230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.519+0000 7fa011885640 1 --2- 172.21.15.90:0/1040654722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa00c0b3180 0x7fa00c06e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.519+0000 7fa011885640 1 --2- 172.21.15.90:0/1040654722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa00c0d29a0 0x7fa00c06db90 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.519+0000 7fa011885640 1 -- 172.21.15.90:0/1040654722 >> 172.21.15.90:0/1040654722 conn(0x7fa00c09d650 msgr2=0x7fa00c0d43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:58.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.519+0000 7fa011885640 1 -- 172.21.15.90:0/1040654722 shutdown_connections 2024-09-10T23:18:58.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.519+0000 7fa011885640 1 -- 172.21.15.90:0/1040654722 wait complete. 2024-09-10T23:18:58.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.521+0000 7fa011885640 1 Processor -- start 2024-09-10T23:18:58.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.521+0000 7fa011885640 1 -- start start 2024-09-10T23:18:58.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.521+0000 7fa011885640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa00c0b3180 0x7fa00c0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.521+0000 7fa011885640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa00c0d29a0 0x7fa00c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.521+0000 7fa011885640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa00c0d4d00 0x7fa00c0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.521+0000 7fa011885640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c0d2f90 con 0x7fa00c0d4d00 2024-09-10T23:18:58.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.521+0000 7fa011885640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c162770 con 0x7fa00c0d29a0 2024-09-10T23:18:58.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.521+0000 7fa011885640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa00c0cb9f0 con 0x7fa00c0b3180 2024-09-10T23:18:58.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.522+0000 7fa00b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa00c0d4d00 0x7fa00c0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.522+0000 7fa00b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa00c0d4d00 0x7fa00c0cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36104/0 (socket says 172.21.15.90:36104) 2024-09-10T23:18:58.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.522+0000 7fa00affd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa00c0b3180 0x7fa00c0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.522+0000 7fa00b7fe640 1 -- 172.21.15.90:0/4197341640 learned_addr learned my addr 172.21.15.90:0/4197341640 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:58.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.522+0000 7fa0027fc640 1 --2- 172.21.15.90:0/4197341640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa00c0d29a0 0x7fa00c0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.522+0000 7fa00b7fe640 1 -- 172.21.15.90:0/4197341640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa00c0b3180 msgr2=0x7fa00c0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.522+0000 7fa00b7fe640 1 --2- 172.21.15.90:0/4197341640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa00c0b3180 0x7fa00c0cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.522+0000 7fa00b7fe640 1 -- 172.21.15.90:0/4197341640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa00c0d29a0 msgr2=0x7fa00c0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.522+0000 7fa00b7fe640 1 --2- 172.21.15.90:0/4197341640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa00c0d29a0 0x7fa00c0cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.522+0000 7fa00b7fe640 1 -- 172.21.15.90:0/4197341640 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00c0b69f0 con 0x7fa00c0d4d00 2024-09-10T23:18:58.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.522+0000 7fa00b7fe640 1 --2- 172.21.15.90:0/4197341640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa00c0d4d00 0x7fa00c0cd6c0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fa00400cab0 tx=0x7fa00400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:58.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.522+0000 7fa008ff9640 1 -- 172.21.15.90:0/4197341640 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004007cd0 con 0x7fa00c0d4d00 2024-09-10T23:18:58.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.522+0000 7fa008ff9640 1 -- 172.21.15.90:0/4197341640 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa00400f450 con 0x7fa00c0d4d00 2024-09-10T23:18:58.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.522+0000 7fa008ff9640 1 -- 172.21.15.90:0/4197341640 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00400f8a0 con 0x7fa00c0d4d00 2024-09-10T23:18:58.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.522+0000 7fa011885640 1 -- 172.21.15.90:0/4197341640 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa00c0c8c70 con 0x7fa00c0d4d00 2024-09-10T23:18:58.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.522+0000 7fa011885640 1 -- 172.21.15.90:0/4197341640 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa00c0c9230 con 0x7fa00c0d4d00 2024-09-10T23:18:58.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.523+0000 7fa011885640 1 -- 172.21.15.90:0/4197341640 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa00c0c9430 con 0x7fa00c0d4d00 2024-09-10T23:18:58.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.524+0000 7fa008ff9640 1 -- 172.21.15.90:0/4197341640 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa00400fa40 con 0x7fa00c0d4d00 2024-09-10T23:18:58.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.524+0000 7fa008ff9640 1 --2- 172.21.15.90:0/4197341640 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9fec077fa0 0x7f9fec07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.525+0000 7fa008ff9640 1 -- 172.21.15.90:0/4197341640 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5967+0+0 (secure 0 0 0) 0x7fa00409a690 con 0x7fa00c0d4d00 2024-09-10T23:18:58.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.525+0000 7fa00affd640 1 --2- 172.21.15.90:0/4197341640 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9fec077fa0 0x7f9fec07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.525+0000 7fa00affd640 1 --2- 172.21.15.90:0/4197341640 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9fec077fa0 0x7f9fec07a460 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc033000 tx=0x7f9ffc004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:58.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.529+0000 7fa008ff9640 1 -- 172.21.15.90:0/4197341640 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa00c0c9430 con 0x7fa00c0d4d00 2024-09-10T23:18:58.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.739+0000 7fa011885640 1 -- 172.21.15.90:0/4197341640 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa00c162230 con 0x7fa00c0d4d00 2024-09-10T23:18:58.740 INFO:tasks.ceph.mon.a.smithi090.stderr:2024-09-10T23:18:58.739+0000 7f1a0c84c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:18:58.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.741+0000 7fa008ff9640 1 -- 172.21.15.90:0/4197341640 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v72) ==== 161+0+0 (secure 0 0 0) 0x7fa004014070 con 0x7fa00c0d4d00 2024-09-10T23:18:58.742 INFO:teuthology.orchestra.run.smithi090.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:18:58.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.743+0000 7fa011885640 1 -- 172.21.15.90:0/4197341640 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9fec077fa0 msgr2=0x7f9fec07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.743+0000 7fa011885640 1 --2- 172.21.15.90:0/4197341640 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9fec077fa0 0x7f9fec07a460 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc033000 tx=0x7f9ffc004730 comp rx=0 tx=0).stop 2024-09-10T23:18:58.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.743+0000 7fa011885640 1 -- 172.21.15.90:0/4197341640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa00c0d4d00 msgr2=0x7fa00c0cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.743+0000 7fa011885640 1 --2- 172.21.15.90:0/4197341640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa00c0d4d00 0x7fa00c0cd6c0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fa00400cab0 tx=0x7fa00400cf70 comp rx=0 tx=0).stop 2024-09-10T23:18:58.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.744+0000 7fa011885640 1 -- 172.21.15.90:0/4197341640 shutdown_connections 2024-09-10T23:18:58.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.744+0000 7fa011885640 1 --2- 172.21.15.90:0/4197341640 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f9fec077fa0 0x7f9fec07a460 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.744+0000 7fa011885640 1 --2- 172.21.15.90:0/4197341640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa00c0d29a0 0x7fa00c0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.744+0000 7fa011885640 1 --2- 172.21.15.90:0/4197341640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa00c0d4d00 0x7fa00c0cd6c0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.744+0000 7fa011885640 1 --2- 172.21.15.90:0/4197341640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa00c0b3180 0x7fa00c0cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.744+0000 7fa011885640 1 -- 172.21.15.90:0/4197341640 >> 172.21.15.90:0/4197341640 conn(0x7fa00c09d650 msgr2=0x7fa00c0b7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:58.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.744+0000 7fa011885640 1 -- 172.21.15.90:0/4197341640 shutdown_connections 2024-09-10T23:18:58.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.744+0000 7fa011885640 1 -- 172.21.15.90:0/4197341640 wait complete. 2024-09-10T23:18:58.747 INFO:tasks.ceph.mds.c.smithi090.stderr: -5157> 2024-09-10T23:18:43.508+0000 7f12789fb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:18:58.750 INFO:tasks.ceph.mds.c.smithi090.stderr: -2880> 2024-09-10T23:18:48.508+0000 7f12789fb640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-10T23:18:58.757 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:18:58.773 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-09-10T23:18:58.778 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-09-10T23:18:58.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.862+0000 7f8b4f952640 1 -- 172.21.15.90:0/68947077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b48161640 msgr2=0x7f8b480d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.862+0000 7f8b4f952640 1 --2- 172.21.15.90:0/68947077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b48161640 0x7f8b480d0da0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f8b44005fd0 tx=0x7f8b4402a580 comp rx=0 tx=0).stop 2024-09-10T23:18:58.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.862+0000 7f8b4f952640 1 -- 172.21.15.90:0/68947077 shutdown_connections 2024-09-10T23:18:58.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.862+0000 7f8b4f952640 1 --2- 172.21.15.90:0/68947077 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b48161da0 0x7f8b480b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.862+0000 7f8b4f952640 1 --2- 172.21.15.90:0/68947077 >> v2:172.21.15.171:3300/0 conn(0x7f8b480b3780 0x7f8b480d12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.862+0000 7f8b4f952640 1 --2- 172.21.15.90:0/68947077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b48161640 0x7f8b480d0da0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.862+0000 7f8b4f952640 1 -- 172.21.15.90:0/68947077 >> 172.21.15.90:0/68947077 conn(0x7f8b480690c0 msgr2=0x7f8b4806db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:58.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.862+0000 7f8b4f952640 1 -- 172.21.15.90:0/68947077 shutdown_connections 2024-09-10T23:18:58.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.862+0000 7f8b4f952640 1 -- 172.21.15.90:0/68947077 wait complete. 2024-09-10T23:18:58.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.863+0000 7f8b4f952640 1 Processor -- start 2024-09-10T23:18:58.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.863+0000 7f8b4f952640 1 -- start start 2024-09-10T23:18:58.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.864+0000 7f8b4f952640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b480b3780 0x7f8b4815d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.864+0000 7f8b4f952640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b48161640 0x7f8b481f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.864+0000 7f8b4f952640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b48161da0 0x7f8b480ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.864+0000 7f8b4f952640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8b480b66e0 con 0x7f8b48161da0 2024-09-10T23:18:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.864+0000 7f8b4f952640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8b480b6560 con 0x7f8b480b3780 2024-09-10T23:18:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.864+0000 7f8b4f952640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8b480b6860 con 0x7f8b48161640 2024-09-10T23:18:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.864+0000 7f8b4deef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b48161da0 0x7f8b480ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.864+0000 7f8b4deef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b48161da0 0x7f8b480ab4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36176/0 (socket says 172.21.15.90:36176) 2024-09-10T23:18:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.864+0000 7f8b4deef640 1 -- 172.21.15.90:0/3859798707 learned_addr learned my addr 172.21.15.90:0/3859798707 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.864+0000 7f8b4ceed640 1 --2- 172.21.15.90:0/3859798707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b48161640 0x7f8b481f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.864+0000 7f8b4d6ee640 1 --2- 172.21.15.90:0/3859798707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b480b3780 0x7f8b4815d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.865+0000 7f8b4deef640 1 -- 172.21.15.90:0/3859798707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b48161640 msgr2=0x7f8b481f58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.865+0000 7f8b4deef640 1 --2- 172.21.15.90:0/3859798707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b48161640 0x7f8b481f58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.865+0000 7f8b4deef640 1 -- 172.21.15.90:0/3859798707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b480b3780 msgr2=0x7f8b4815d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.865+0000 7f8b4deef640 1 --2- 172.21.15.90:0/3859798707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b480b3780 0x7f8b4815d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.865+0000 7f8b4deef640 1 -- 172.21.15.90:0/3859798707 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b481f5e00 con 0x7f8b48161da0 2024-09-10T23:18:58.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.865+0000 7f8b4deef640 1 --2- 172.21.15.90:0/3859798707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b48161da0 0x7f8b480ab4c0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000e960 tx=0x7f8b4000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:58.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.865+0000 7f8b3dffb640 1 -- 172.21.15.90:0/3859798707 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b40004d20 con 0x7f8b48161da0 2024-09-10T23:18:58.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.865+0000 7f8b3dffb640 1 -- 172.21.15.90:0/3859798707 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b4000cb20 con 0x7f8b48161da0 2024-09-10T23:18:58.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.865+0000 7f8b4f952640 1 -- 172.21.15.90:0/3859798707 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b481f6360 con 0x7f8b48161da0 2024-09-10T23:18:58.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.865+0000 7f8b3dffb640 1 -- 172.21.15.90:0/3859798707 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b40005020 con 0x7f8b48161da0 2024-09-10T23:18:58.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.865+0000 7f8b4f952640 1 -- 172.21.15.90:0/3859798707 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b481f6920 con 0x7f8b48161da0 2024-09-10T23:18:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.866+0000 7f8b4f952640 1 -- 172.21.15.90:0/3859798707 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b480b5e10 con 0x7f8b48161da0 2024-09-10T23:18:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.867+0000 7f8b3dffb640 1 -- 172.21.15.90:0/3859798707 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8b4000f040 con 0x7f8b48161da0 2024-09-10T23:18:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.867+0000 7f8b3dffb640 1 --2- 172.21.15.90:0/3859798707 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8b2c077f70 0x7f8b2c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.867+0000 7f8b3dffb640 1 -- 172.21.15.90:0/3859798707 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 6139+0+0 (secure 0 0 0) 0x7f8b4009a440 con 0x7f8b48161da0 2024-09-10T23:18:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.867+0000 7f8b4d6ee640 1 --2- 172.21.15.90:0/3859798707 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8b2c077f70 0x7f8b2c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.868+0000 7f8b4d6ee640 1 --2- 172.21.15.90:0/3859798707 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8b2c077f70 0x7f8b2c07a430 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8b44033000 tx=0x7f8b44004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:58.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:58.871+0000 7f8b3dffb640 1 -- 172.21.15.90:0/3859798707 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8b40016030 con 0x7f8b48161da0 2024-09-10T23:18:59.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.083+0000 7f8b4f952640 1 -- 172.21.15.90:0/3859798707 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8b480ba310 con 0x7f8b48161da0 2024-09-10T23:18:59.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.742+0000 7f8b3dffb640 1 -- 172.21.15.90:0/3859798707 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v73) ==== 104+0+0 (secure 0 0 0) 0x7f8b40062750 con 0x7f8b48161da0 2024-09-10T23:18:59.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.745+0000 7f8b4f952640 1 -- 172.21.15.90:0/3859798707 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8b2c077f70 msgr2=0x7f8b2c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:59.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.745+0000 7f8b4f952640 1 --2- 172.21.15.90:0/3859798707 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8b2c077f70 0x7f8b2c07a430 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8b44033000 tx=0x7f8b44004730 comp rx=0 tx=0).stop 2024-09-10T23:18:59.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.745+0000 7f8b4f952640 1 -- 172.21.15.90:0/3859798707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b48161da0 msgr2=0x7f8b480ab4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:59.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.745+0000 7f8b4f952640 1 --2- 172.21.15.90:0/3859798707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b48161da0 0x7f8b480ab4c0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000e960 tx=0x7f8b4000ee20 comp rx=0 tx=0).stop 2024-09-10T23:18:59.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.745+0000 7f8b4f952640 1 -- 172.21.15.90:0/3859798707 shutdown_connections 2024-09-10T23:18:59.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.745+0000 7f8b4f952640 1 --2- 172.21.15.90:0/3859798707 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8b2c077f70 0x7f8b2c07a430 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.745+0000 7f8b4f952640 1 --2- 172.21.15.90:0/3859798707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b48161da0 0x7f8b480ab4c0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.745+0000 7f8b4f952640 1 --2- 172.21.15.90:0/3859798707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b48161640 0x7f8b481f58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.745+0000 7f8b4f952640 1 --2- 172.21.15.90:0/3859798707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b480b3780 0x7f8b4815d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.745+0000 7f8b4f952640 1 -- 172.21.15.90:0/3859798707 >> 172.21.15.90:0/3859798707 conn(0x7f8b480690c0 msgr2=0x7f8b480cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:59.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.745+0000 7f8b4f952640 1 -- 172.21.15.90:0/3859798707 shutdown_connections 2024-09-10T23:18:59.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.745+0000 7f8b4f952640 1 -- 172.21.15.90:0/3859798707 wait complete. 2024-09-10T23:18:59.759 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:18:59.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.907+0000 7f63c0f0e640 1 -- 172.21.15.90:0/4131001826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63bc0b38c0 msgr2=0x7f63bc0b3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:59.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.907+0000 7f63c0f0e640 1 --2- 172.21.15.90:0/4131001826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63bc0b38c0 0x7f63bc0b3d70 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f63b4005fd0 tx=0x7f63b402bbc0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.907+0000 7f63c0f0e640 1 -- 172.21.15.90:0/4131001826 shutdown_connections 2024-09-10T23:18:59.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.907+0000 7f63c0f0e640 1 --2- 172.21.15.90:0/4131001826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63bc0b38c0 0x7f63bc0b3d70 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.907+0000 7f63c0f0e640 1 --2- 172.21.15.90:0/4131001826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63bc06eb90 0x7f63bc073fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.907+0000 7f63c0f0e640 1 -- 172.21.15.90:0/4131001826 >> 172.21.15.90:0/4131001826 conn(0x7f63bc070280 msgr2=0x7f63bc06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:59.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.907+0000 7f63c0f0e640 1 -- 172.21.15.90:0/4131001826 shutdown_connections 2024-09-10T23:18:59.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.908+0000 7f63c0f0e640 1 -- 172.21.15.90:0/4131001826 wait complete. 2024-09-10T23:18:59.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.909+0000 7f63c0f0e640 1 Processor -- start 2024-09-10T23:18:59.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.909+0000 7f63c0f0e640 1 -- start start 2024-09-10T23:18:59.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63c0f0e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63bc06eb90 0x7f63bc15a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:59.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63c0f0e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63bc06ef70 0x7f63bc0afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:59.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63c0f0e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63bc0b38c0 0x7f63bc0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:59.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63c0f0e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f63bc0729c0 con 0x7f63bc06ef70 2024-09-10T23:18:59.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63c0f0e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f63bc06d820 con 0x7f63bc06eb90 2024-09-10T23:18:59.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63c0f0e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f63bc072b40 con 0x7f63bc0b38c0 2024-09-10T23:18:59.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63b1d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63bc06ef70 0x7f63bc0afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:59.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63b1d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63bc06ef70 0x7f63bc0afc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36202/0 (socket says 172.21.15.90:36202) 2024-09-10T23:18:59.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63b1d9b640 1 -- 172.21.15.90:0/3030833974 learned_addr learned my addr 172.21.15.90:0/3030833974 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:18:59.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63bad9d640 1 --2- 172.21.15.90:0/3030833974 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63bc0b38c0 0x7f63bc0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:59.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63b1d9b640 1 -- 172.21.15.90:0/3030833974 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63bc0b38c0 msgr2=0x7f63bc0b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:59.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63b1d9b640 1 --2- 172.21.15.90:0/3030833974 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63bc0b38c0 0x7f63bc0b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63b1d9b640 1 -- 172.21.15.90:0/3030833974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63bc06eb90 msgr2=0x7f63bc15a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:59.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63b1d9b640 1 --2- 172.21.15.90:0/3030833974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63bc06eb90 0x7f63bc15a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63b1d9b640 1 -- 172.21.15.90:0/3030833974 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63bc0b01b0 con 0x7f63bc06ef70 2024-09-10T23:18:59.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63b1d9b640 1 --2- 172.21.15.90:0/3030833974 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63bc06ef70 0x7f63bc0afc70 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c460 tx=0x7f63a400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:59.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63b37fe640 1 -- 172.21.15.90:0/3030833974 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a4017070 con 0x7f63bc06ef70 2024-09-10T23:18:59.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63c0f0e640 1 -- 172.21.15.90:0/3030833974 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63bc1f8510 con 0x7f63bc06ef70 2024-09-10T23:18:59.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63b37fe640 1 -- 172.21.15.90:0/3030833974 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63a40035f0 con 0x7f63bc06ef70 2024-09-10T23:18:59.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63b37fe640 1 -- 172.21.15.90:0/3030833974 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a4003a40 con 0x7f63bc06ef70 2024-09-10T23:18:59.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.910+0000 7f63c0f0e640 1 -- 172.21.15.90:0/3030833974 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63bc1f8ad0 con 0x7f63bc06ef70 2024-09-10T23:18:59.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.911+0000 7f63c0f0e640 1 -- 172.21.15.90:0/3030833974 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63bc072ff0 con 0x7f63bc06ef70 2024-09-10T23:18:59.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.912+0000 7f63b37fe640 1 -- 172.21.15.90:0/3030833974 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f63a4003be0 con 0x7f63bc06ef70 2024-09-10T23:18:59.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.912+0000 7f63b37fe640 1 --2- 172.21.15.90:0/3030833974 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f639c077fa0 0x7f639c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:59.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.913+0000 7f63b37fe640 1 -- 172.21.15.90:0/3030833974 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 6139+0+0 (secure 0 0 0) 0x7f63a4099450 con 0x7f63bc06ef70 2024-09-10T23:18:59.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.913+0000 7f63ba59c640 1 --2- 172.21.15.90:0/3030833974 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f639c077fa0 0x7f639c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:59.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.913+0000 7f63ba59c640 1 --2- 172.21.15.90:0/3030833974 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f639c077fa0 0x7f639c07a460 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00a8f0 tx=0x7f63ac005bf0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:59.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:18:59.917+0000 7f63b37fe640 1 -- 172.21.15.90:0/3030833974 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f63a4061760 con 0x7f63bc06ef70 2024-09-10T23:19:00.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.091+0000 7f63c0f0e640 1 -- 172.21.15.90:0/3030833974 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f63bc0b51b0 con 0x7f63bc06ef70 2024-09-10T23:19:00.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.748+0000 7f63b37fe640 1 -- 172.21.15.90:0/3030833974 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v110) ==== 181+0+0 (secure 0 0 0) 0x7f63a4066190 con 0x7f63bc06ef70 2024-09-10T23:19:00.749 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:19:00.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.751+0000 7f63c0f0e640 1 -- 172.21.15.90:0/3030833974 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f639c077fa0 msgr2=0x7f639c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.751+0000 7f63c0f0e640 1 --2- 172.21.15.90:0/3030833974 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f639c077fa0 0x7f639c07a460 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00a8f0 tx=0x7f63ac005bf0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.751+0000 7f63c0f0e640 1 -- 172.21.15.90:0/3030833974 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63bc06ef70 msgr2=0x7f63bc0afc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.751+0000 7f63c0f0e640 1 --2- 172.21.15.90:0/3030833974 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63bc06ef70 0x7f63bc0afc70 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c460 tx=0x7f63a400c920 comp rx=0 tx=0).stop 2024-09-10T23:19:00.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.751+0000 7f63c0f0e640 1 -- 172.21.15.90:0/3030833974 shutdown_connections 2024-09-10T23:19:00.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.751+0000 7f63c0f0e640 1 --2- 172.21.15.90:0/3030833974 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f639c077fa0 0x7f639c07a460 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.751+0000 7f63c0f0e640 1 --2- 172.21.15.90:0/3030833974 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63bc0b38c0 0x7f63bc0b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.751+0000 7f63c0f0e640 1 --2- 172.21.15.90:0/3030833974 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63bc06ef70 0x7f63bc0afc70 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.751+0000 7f63c0f0e640 1 --2- 172.21.15.90:0/3030833974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63bc06eb90 0x7f63bc15a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.751+0000 7f63c0f0e640 1 -- 172.21.15.90:0/3030833974 >> 172.21.15.90:0/3030833974 conn(0x7f63bc070280 msgr2=0x7f63bc074790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:00.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.751+0000 7f63c0f0e640 1 -- 172.21.15.90:0/3030833974 shutdown_connections 2024-09-10T23:19:00.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.751+0000 7f63c0f0e640 1 -- 172.21.15.90:0/3030833974 wait complete. 2024-09-10T23:19:00.766 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:19:00.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.872+0000 7fee6cc62640 1 -- 172.21.15.90:0/1164026742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee680b50a0 msgr2=0x7fee680af660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.872+0000 7fee6cc62640 1 --2- 172.21.15.90:0/1164026742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee680b50a0 0x7fee680af660 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fee50009830 tx=0x7fee5002a510 comp rx=0 tx=0).stop 2024-09-10T23:19:00.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.872+0000 7fee6cc62640 1 -- 172.21.15.90:0/1164026742 shutdown_connections 2024-09-10T23:19:00.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.872+0000 7fee6cc62640 1 --2- 172.21.15.90:0/1164026742 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee6815e8c0 0x7fee6815ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.872+0000 7fee6cc62640 1 --2- 172.21.15.90:0/1164026742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee680b50a0 0x7fee680af660 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.872+0000 7fee6cc62640 1 -- 172.21.15.90:0/1164026742 >> 172.21.15.90:0/1164026742 conn(0x7fee68070280 msgr2=0x7fee6806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:00.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.872+0000 7fee6cc62640 1 -- 172.21.15.90:0/1164026742 shutdown_connections 2024-09-10T23:19:00.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.872+0000 7fee6cc62640 1 -- 172.21.15.90:0/1164026742 wait complete. 2024-09-10T23:19:00.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.873+0000 7fee6cc62640 1 Processor -- start 2024-09-10T23:19:00.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.874+0000 7fee6cc62640 1 -- start start 2024-09-10T23:19:00.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.874+0000 7fee6cc62640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee680b50a0 0x7fee681f8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:00.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.874+0000 7fee6cc62640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee6815aba0 0x7fee68135fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:00.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.874+0000 7fee6cc62640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee6815e8c0 0x7fee6806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:00.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.874+0000 7fee6cc62640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fee680729c0 con 0x7fee680b50a0 2024-09-10T23:19:00.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.874+0000 7fee6cc62640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fee6815b190 con 0x7fee6815e8c0 2024-09-10T23:19:00.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.874+0000 7fee6cc62640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fee68072b40 con 0x7fee6815aba0 2024-09-10T23:19:00.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.874+0000 7fee6659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee680b50a0 0x7fee681f8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:00.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.874+0000 7fee6659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee680b50a0 0x7fee681f8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36220/0 (socket says 172.21.15.90:36220) 2024-09-10T23:19:00.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.874+0000 7fee6659c640 1 -- 172.21.15.90:0/1882251375 learned_addr learned my addr 172.21.15.90:0/1882251375 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:00.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.875+0000 7fee65d9b640 1 --2- 172.21.15.90:0/1882251375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee6815aba0 0x7fee68135fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:00.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.875+0000 7fee66d9d640 1 --2- 172.21.15.90:0/1882251375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee6815e8c0 0x7fee6806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:00.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.875+0000 7fee6659c640 1 -- 172.21.15.90:0/1882251375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee6815aba0 msgr2=0x7fee68135fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.875+0000 7fee6659c640 1 --2- 172.21.15.90:0/1882251375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee6815aba0 0x7fee68135fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.875+0000 7fee6659c640 1 -- 172.21.15.90:0/1882251375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee6815e8c0 msgr2=0x7fee6806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.875+0000 7fee6659c640 1 --2- 172.21.15.90:0/1882251375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee6815e8c0 0x7fee6806e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.875+0000 7fee6659c640 1 -- 172.21.15.90:0/1882251375 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6806f300 con 0x7fee680b50a0 2024-09-10T23:19:00.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.875+0000 7fee66d9d640 1 --2- 172.21.15.90:0/1882251375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee6815e8c0 0x7fee6806e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:00.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.875+0000 7fee6659c640 1 --2- 172.21.15.90:0/1882251375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee680b50a0 0x7fee681f8e40 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fee5800cc50 tx=0x7fee5800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:00.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.875+0000 7fee5effd640 1 -- 172.21.15.90:0/1882251375 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5800ce60 con 0x7fee680b50a0 2024-09-10T23:19:00.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.875+0000 7fee5effd640 1 -- 172.21.15.90:0/1882251375 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee58017070 con 0x7fee680b50a0 2024-09-10T23:19:00.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.875+0000 7fee6cc62640 1 -- 172.21.15.90:0/1882251375 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6806f5e0 con 0x7fee680b50a0 2024-09-10T23:19:00.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.875+0000 7fee5effd640 1 -- 172.21.15.90:0/1882251375 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58012660 con 0x7fee680b50a0 2024-09-10T23:19:00.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.875+0000 7fee6cc62640 1 -- 172.21.15.90:0/1882251375 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee681f8920 con 0x7fee680b50a0 2024-09-10T23:19:00.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.876+0000 7fee6cc62640 1 -- 172.21.15.90:0/1882251375 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee681f8b20 con 0x7fee680b50a0 2024-09-10T23:19:00.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.877+0000 7fee5effd640 1 -- 172.21.15.90:0/1882251375 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fee58012800 con 0x7fee680b50a0 2024-09-10T23:19:00.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.877+0000 7fee5effd640 1 --2- 172.21.15.90:0/1882251375 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fee48077f70 0x7fee4807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:00.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.877+0000 7fee5effd640 1 -- 172.21.15.90:0/1882251375 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5701+0+0 (secure 0 0 0) 0x7fee5809a290 con 0x7fee680b50a0 2024-09-10T23:19:00.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.877+0000 7fee65d9b640 1 --2- 172.21.15.90:0/1882251375 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fee48077f70 0x7fee4807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:00.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.878+0000 7fee65d9b640 1 --2- 172.21.15.90:0/1882251375 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fee48077f70 0x7fee4807a430 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fee50034000 tx=0x7fee50004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:00.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:00.881+0000 7fee5effd640 1 -- 172.21.15.90:0/1882251375 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fee681f8b20 con 0x7fee680b50a0 2024-09-10T23:19:01.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.056+0000 7fee6cc62640 1 -- 172.21.15.90:0/1882251375 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fee680b3ca0 con 0x7fee680b50a0 2024-09-10T23:19:01.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.756+0000 7fee5effd640 1 -- 172.21.15.90:0/1882251375 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v111) ==== 169+0+0 (secure 0 0 0) 0x7fee68074990 con 0x7fee680b50a0 2024-09-10T23:19:01.757 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' removed 2024-09-10T23:19:01.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.758+0000 7fee6cc62640 1 -- 172.21.15.90:0/1882251375 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fee48077f70 msgr2=0x7fee4807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:01.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.758+0000 7fee6cc62640 1 --2- 172.21.15.90:0/1882251375 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fee48077f70 0x7fee4807a430 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fee50034000 tx=0x7fee50004730 comp rx=0 tx=0).stop 2024-09-10T23:19:01.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.758+0000 7fee6cc62640 1 -- 172.21.15.90:0/1882251375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee680b50a0 msgr2=0x7fee681f8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:01.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.758+0000 7fee6cc62640 1 --2- 172.21.15.90:0/1882251375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee680b50a0 0x7fee681f8e40 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fee5800cc50 tx=0x7fee5800a430 comp rx=0 tx=0).stop 2024-09-10T23:19:01.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.759+0000 7fee6cc62640 1 -- 172.21.15.90:0/1882251375 shutdown_connections 2024-09-10T23:19:01.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.759+0000 7fee6cc62640 1 --2- 172.21.15.90:0/1882251375 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fee48077f70 0x7fee4807a430 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.759+0000 7fee6cc62640 1 --2- 172.21.15.90:0/1882251375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee6815e8c0 0x7fee6806e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.759+0000 7fee6cc62640 1 --2- 172.21.15.90:0/1882251375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee6815aba0 0x7fee68135fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.759+0000 7fee6cc62640 1 --2- 172.21.15.90:0/1882251375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee680b50a0 0x7fee681f8e40 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.759+0000 7fee6cc62640 1 -- 172.21.15.90:0/1882251375 >> 172.21.15.90:0/1882251375 conn(0x7fee68070280 msgr2=0x7fee680b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:01.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.759+0000 7fee6cc62640 1 -- 172.21.15.90:0/1882251375 shutdown_connections 2024-09-10T23:19:01.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.759+0000 7fee6cc62640 1 -- 172.21.15.90:0/1882251375 wait complete. 2024-09-10T23:19:01.775 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:19:01.778 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:19:01.819 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2024-09-10T23:19:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2024-09-10T23:19:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:19:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2024-09-10T23:19:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2024-09-10T23:19:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2024-09-10T23:19:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2024-09-10T23:19:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2024-09-10T23:19:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2024-09-10T23:19:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2024-09-10T23:19:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:19:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2024-09-10T23:19:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:19:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:19:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2024-09-10T23:19:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2024-09-10T23:19:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2024-09-10T23:19:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:19:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:19:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2024-09-10T23:19:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:19:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2024-09-10T23:19:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:19:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:19:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2024-09-10T23:19:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:19:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2024-09-10T23:19:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2024-09-10T23:19:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2024-09-10T23:19:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2024-09-10T23:19:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2024-09-10T23:19:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.90,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-09-10T23:19:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on skipped message = False 2024-09-10T23:19:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = 1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd 2024-09-10T23:19:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.823 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2024-09-10T23:19:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2024-09-10T23:19:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2024-09-10T23:19:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2024-09-10T23:19:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:19:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2024-09-10T23:19:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2024-09-10T23:19:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2024-09-10T23:19:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2024-09-10T23:19:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2024-09-10T23:19:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug trim objects = true 2024-09-10T23:19:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2024-09-10T23:19:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2024-09-10T23:19:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:19:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2024-09-10T23:19:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2024-09-10T23:19:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:19:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2024-09-10T23:19:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2024-09-10T23:19:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2024-09-10T23:19:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: bdev async discard = True 2024-09-10T23:19:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: bdev enable discard = True 2024-09-10T23:19:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore allocator = bitmap 2024-09-10T23:19:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2024-09-10T23:19:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2024-09-10T23:19:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 1/20 2024-09-10T23:19:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 1/20 2024-09-10T23:19:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-10T23:19:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2024-09-10T23:19:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 4/10 2024-09-10T23:19:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:19:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2024-09-10T23:19:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:19:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:19:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2024-09-10T23:19:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.827 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2024-09-10T23:19:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: client mount timeout = 30 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: debug client = 20 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-10T23:19:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2024-09-10T23:19:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2024-09-10T23:19:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:19:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2024-09-10T23:19:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2024-09-10T23:19:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:19:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:19:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:19:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:19:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:19:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:19:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:19:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: # 1m isn't quite enough 2024-09-10T23:19:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:19:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:19:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: mon down mkfs grace = 300 2024-09-10T23:19:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:01.830 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2024-09-10T23:19:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2024-09-10T23:19:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2024-09-10T23:19:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2024-09-10T23:19:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:19:01.831 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:19:01.831 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = "" 2024-09-10T23:19:01.831 INFO:teuthology.orchestra.run.smithi090.stdout: client reconnect stale = True 2024-09-10T23:19:01.831 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2024-09-10T23:19:01.831 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2024-09-10T23:19:01.831 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2024-09-10T23:19:01.831 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-09-10T23:19:01.831 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2024-09-10T23:19:01.831 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2024-09-10T23:19:01.831 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2024-09-10T23:19:01.831 INFO:teuthology.orchestra.run.smithi090.stdout:[mds] 2024-09-10T23:19:01.832 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2024-09-10T23:19:01.832 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2024-09-10T23:19:01.832 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:19:01.832 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2024-09-10T23:19:01.832 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.832 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2024-09-10T23:19:01.832 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.833 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2024-09-10T23:19:01.833 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.833 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2024-09-10T23:19:01.833 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2024-09-10T23:19:01.833 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.833 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2024-09-10T23:19:01.833 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2024-09-10T23:19:01.833 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.833 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:19:01.833 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2024-09-10T23:19:01.833 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.833 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:19:01.833 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:19:01.833 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.833 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2024-09-10T23:19:01.834 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.834 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2024-09-10T23:19:01.834 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2024-09-10T23:19:01.834 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:19:01.834 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:19:01.834 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2024-09-10T23:19:01.834 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:19:01.834 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2024-09-10T23:19:01.834 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:19:01.834 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:19:01.834 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2024-09-10T23:19:01.834 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.834 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:19:01.834 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.835 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2024-09-10T23:19:01.835 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.835 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2024-09-10T23:19:01.835 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.835 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2024-09-10T23:19:01.835 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2024-09-10T23:19:01.835 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2024-09-10T23:19:01.835 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = "172.21.15.90,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-09-10T23:19:01.835 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on skipped message = False 2024-09-10T23:19:01.835 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = 1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd 2024-09-10T23:19:01.835 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.835 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2024-09-10T23:19:01.835 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2024-09-10T23:19:01.836 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.836 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2024-09-10T23:19:01.836 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2024-09-10T23:19:01.836 INFO:teuthology.orchestra.run.smithi171.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:19:01.836 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.836 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2024-09-10T23:19:01.836 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2024-09-10T23:19:01.836 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.836 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2024-09-10T23:19:01.836 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2024-09-10T23:19:01.836 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2024-09-10T23:19:01.836 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug trim objects = true 2024-09-10T23:19:01.836 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.836 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2024-09-10T23:19:01.837 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2024-09-10T23:19:01.837 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.837 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:19:01.837 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.837 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2024-09-10T23:19:01.837 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.837 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2024-09-10T23:19:01.837 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.837 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:19:01.837 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2024-09-10T23:19:01.837 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.837 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2024-09-10T23:19:01.837 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2024-09-10T23:19:01.837 INFO:teuthology.orchestra.run.smithi171.stdout: bdev async discard = True 2024-09-10T23:19:01.838 INFO:teuthology.orchestra.run.smithi171.stdout: bdev enable discard = True 2024-09-10T23:19:01.838 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore allocator = bitmap 2024-09-10T23:19:01.838 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2024-09-10T23:19:01.838 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2024-09-10T23:19:01.838 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 1/20 2024-09-10T23:19:01.838 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 1/20 2024-09-10T23:19:01.838 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-10T23:19:01.838 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2024-09-10T23:19:01.838 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 4/10 2024-09-10T23:19:01.838 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:19:01.838 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2024-09-10T23:19:01.838 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:19:01.838 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:19:01.838 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2024-09-10T23:19:01.839 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.839 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2024-09-10T23:19:01.839 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-10T23:19:01.839 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2024-09-10T23:19:01.839 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-09-10T23:19:01.839 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-09-10T23:19:01.839 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:19:01.839 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:19:01.839 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2024-09-10T23:19:01.839 INFO:teuthology.orchestra.run.smithi171.stdout: client mount timeout = 30 2024-09-10T23:19:01.839 INFO:teuthology.orchestra.run.smithi171.stdout: debug client = 20 2024-09-10T23:19:01.839 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.839 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2024-09-10T23:19:01.839 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-10T23:19:01.839 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-09-10T23:19:01.840 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2024-09-10T23:19:01.840 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-09-10T23:19:01.840 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2024-09-10T23:19:01.840 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2024-09-10T23:19:01.840 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:19:01.840 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2024-09-10T23:19:01.840 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2024-09-10T23:19:01.840 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:19:01.840 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.840 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:19:01.840 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:19:01.840 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:19:01.840 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.840 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:19:01.841 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:19:01.841 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:19:01.841 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.841 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2024-09-10T23:19:01.841 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:19:01.841 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.841 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:19:01.841 INFO:teuthology.orchestra.run.smithi171.stdout: mon down mkfs grace = 300 2024-09-10T23:19:01.841 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-10T23:19:01.841 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2024-09-10T23:19:01.841 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2024-09-10T23:19:01.841 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = true 2024-09-10T23:19:01.841 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2024-09-10T23:19:01.841 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:19:01.842 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:19:01.842 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = "" 2024-09-10T23:19:01.842 INFO:teuthology.orchestra.run.smithi171.stdout: client reconnect stale = True 2024-09-10T23:19:01.842 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2024-09-10T23:19:01.842 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b] 2024-09-10T23:19:01.842 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c] 2024-09-10T23:19:01.842 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2024-09-10T23:19:01.842 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2024-09-10T23:19:01.842 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2024-09-10T23:19:01.842 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.d] 2024-09-10T23:19:01.842 INFO:teuthology.orchestra.run.smithi171.stdout:[mds] 2024-09-10T23:19:01.844 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:19:01.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.985+0000 7f4aa2885640 1 -- 172.21.15.90:0/4290518505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c0d4d00 msgr2=0x7f4a9c0b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:01.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.985+0000 7f4aa2885640 1 --2- 172.21.15.90:0/4290518505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c0d4d00 0x7f4a9c0b13f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0ba290 tx=0x7f4a9402a9e0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.985+0000 7f4aa2885640 1 -- 172.21.15.90:0/4290518505 shutdown_connections 2024-09-10T23:19:01.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.985+0000 7f4aa2885640 1 --2- 172.21.15.90:0/4290518505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c0d4d00 0x7f4a9c0b13f0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.985+0000 7f4aa2885640 1 --2- 172.21.15.90:0/4290518505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a9c0d2960 0x7f4a9c0b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.985+0000 7f4aa2885640 1 -- 172.21.15.90:0/4290518505 >> 172.21.15.90:0/4290518505 conn(0x7f4a9c0d41e0 msgr2=0x7f4a9c0d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:01.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.985+0000 7f4aa2885640 1 -- 172.21.15.90:0/4290518505 shutdown_connections 2024-09-10T23:19:01.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.985+0000 7f4aa2885640 1 -- 172.21.15.90:0/4290518505 wait complete. 2024-09-10T23:19:01.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.986+0000 7f4aa2885640 1 Processor -- start 2024-09-10T23:19:01.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.987+0000 7f4aa2885640 1 -- start start 2024-09-10T23:19:01.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.987+0000 7f4aa2885640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c0d2960 0x7f4a9c1516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:01.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.987+0000 7f4aa2885640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a9c0d4d00 0x7f4a9c0cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:01.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.987+0000 7f4aa2885640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a9c1616c0 0x7f4a9c0b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:01.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.987+0000 7f4aa2885640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c06e8f0 con 0x7f4a9c0d2960 2024-09-10T23:19:01.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.987+0000 7f4aa2885640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c06e770 con 0x7f4a9c0d4d00 2024-09-10T23:19:01.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.987+0000 7f4aa2885640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4a9c06ea70 con 0x7f4a9c1616c0 2024-09-10T23:19:01.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.987+0000 7f4a9bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c0d2960 0x7f4a9c1516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:01.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.987+0000 7f4a9bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c0d2960 0x7f4a9c1516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36238/0 (socket says 172.21.15.90:36238) 2024-09-10T23:19:01.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.987+0000 7f4a9bfff640 1 -- 172.21.15.90:0/2239006701 learned_addr learned my addr 172.21.15.90:0/2239006701 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:01.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.987+0000 7f4aa0e22640 1 --2- 172.21.15.90:0/2239006701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a9c1616c0 0x7f4a9c0b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:01.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.988+0000 7f4a93fff640 1 --2- 172.21.15.90:0/2239006701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a9c0d4d00 0x7f4a9c0cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:01.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.988+0000 7f4a9bfff640 1 -- 172.21.15.90:0/2239006701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a9c1616c0 msgr2=0x7f4a9c0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:01.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.988+0000 7f4a9bfff640 1 --2- 172.21.15.90:0/2239006701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a9c1616c0 0x7f4a9c0b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.988+0000 7f4a9bfff640 1 -- 172.21.15.90:0/2239006701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a9c0d4d00 msgr2=0x7f4a9c0cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:01.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.988+0000 7f4a9bfff640 1 --2- 172.21.15.90:0/2239006701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a9c0d4d00 0x7f4a9c0cc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.988+0000 7f4a9bfff640 1 -- 172.21.15.90:0/2239006701 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9c0ccb50 con 0x7f4a9c0d2960 2024-09-10T23:19:01.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.988+0000 7f4a9bfff640 1 --2- 172.21.15.90:0/2239006701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c0d2960 0x7f4a9c1516e0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00b3f0 tx=0x7f4a8c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:01.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.988+0000 7f4a997fa640 1 -- 172.21.15.90:0/2239006701 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c015020 con 0x7f4a9c0d2960 2024-09-10T23:19:01.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.988+0000 7f4a997fa640 1 -- 172.21.15.90:0/2239006701 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a8c011920 con 0x7f4a9c0d2960 2024-09-10T23:19:01.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.988+0000 7f4aa2885640 1 -- 172.21.15.90:0/2239006701 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9c0cce30 con 0x7f4a9c0d2960 2024-09-10T23:19:01.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.988+0000 7f4a997fa640 1 -- 172.21.15.90:0/2239006701 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c011d70 con 0x7f4a9c0d2960 2024-09-10T23:19:01.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.988+0000 7f4aa2885640 1 -- 172.21.15.90:0/2239006701 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a9c0cd3f0 con 0x7f4a9c0d2960 2024-09-10T23:19:01.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.989+0000 7f4aa2885640 1 -- 172.21.15.90:0/2239006701 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a9c0d2250 con 0x7f4a9c0d2960 2024-09-10T23:19:01.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.990+0000 7f4a997fa640 1 -- 172.21.15.90:0/2239006701 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4a8c01a400 con 0x7f4a9c0d2960 2024-09-10T23:19:01.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.990+0000 7f4a997fa640 1 --2- 172.21.15.90:0/2239006701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a7c077f70 0x7f4a7c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:01.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.990+0000 7f4a997fa640 1 -- 172.21.15.90:0/2239006701 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7f4a8c0999c0 con 0x7f4a9c0d2960 2024-09-10T23:19:01.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.990+0000 7f4a93fff640 1 --2- 172.21.15.90:0/2239006701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a7c077f70 0x7f4a7c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:01.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.991+0000 7f4a93fff640 1 --2- 172.21.15.90:0/2239006701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a7c077f70 0x7f4a7c07a430 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0b6cb0 tx=0x7f4a8400b390 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:02.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:01.994+0000 7f4a997fa640 1 -- 172.21.15.90:0/2239006701 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4a8c09be20 con 0x7f4a9c0d2960 2024-09-10T23:19:02.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.176+0000 7f4aa2885640 1 -- 172.21.15.90:0/2239006701 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f4a9c0b3030 con 0x7f4a9c0d2960 2024-09-10T23:19:02.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.180+0000 7f4a997fa640 1 -- 172.21.15.90:0/2239006701 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v44) ==== 71+0+0 (secure 0 0 0) 0x7f4a8c01f030 con 0x7f4a9c0d2960 2024-09-10T23:19:02.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.182+0000 7f4aa2885640 1 -- 172.21.15.90:0/2239006701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a7c077f70 msgr2=0x7f4a7c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:02.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.182+0000 7f4aa2885640 1 --2- 172.21.15.90:0/2239006701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a7c077f70 0x7f4a7c07a430 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0b6cb0 tx=0x7f4a8400b390 comp rx=0 tx=0).stop 2024-09-10T23:19:02.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.182+0000 7f4aa2885640 1 -- 172.21.15.90:0/2239006701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c0d2960 msgr2=0x7f4a9c1516e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:02.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.182+0000 7f4aa2885640 1 --2- 172.21.15.90:0/2239006701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c0d2960 0x7f4a9c1516e0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00b3f0 tx=0x7f4a8c00b8b0 comp rx=0 tx=0).stop 2024-09-10T23:19:02.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.182+0000 7f4aa2885640 1 -- 172.21.15.90:0/2239006701 shutdown_connections 2024-09-10T23:19:02.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.182+0000 7f4aa2885640 1 --2- 172.21.15.90:0/2239006701 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f4a7c077f70 0x7f4a7c07a430 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:02.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.182+0000 7f4aa2885640 1 --2- 172.21.15.90:0/2239006701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a9c0d4d00 0x7f4a9c0cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:02.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.182+0000 7f4aa2885640 1 --2- 172.21.15.90:0/2239006701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a9c1616c0 0x7f4a9c0b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:02.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.182+0000 7f4aa2885640 1 --2- 172.21.15.90:0/2239006701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c0d2960 0x7f4a9c1516e0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:02.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.182+0000 7f4aa2885640 1 -- 172.21.15.90:0/2239006701 >> 172.21.15.90:0/2239006701 conn(0x7f4a9c0d41e0 msgr2=0x7f4a9c15b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:02.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.182+0000 7f4aa2885640 1 -- 172.21.15.90:0/2239006701 shutdown_connections 2024-09-10T23:19:02.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.182+0000 7f4aa2885640 1 -- 172.21.15.90:0/2239006701 wait complete. 2024-09-10T23:19:02.194 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting' 2024-09-10T23:19:02.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.294+0000 7f96d0616640 1 -- 172.21.15.90:0/3012365718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96c80708c0 msgr2=0x7f96c806ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:02.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.294+0000 7f96d0616640 1 --2- 172.21.15.90:0/3012365718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96c80708c0 0x7f96c806ecf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f96c0005fd0 tx=0x7f96c002a8b0 comp rx=0 tx=0).stop 2024-09-10T23:19:02.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.294+0000 7f96d0616640 1 -- 172.21.15.90:0/3012365718 shutdown_connections 2024-09-10T23:19:02.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.294+0000 7f96d0616640 1 --2- 172.21.15.90:0/3012365718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96c80708c0 0x7f96c806ecf0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:02.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.294+0000 7f96d0616640 1 --2- 172.21.15.90:0/3012365718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96c8159b30 0x7f96c815cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:02.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.294+0000 7f96d0616640 1 -- 172.21.15.90:0/3012365718 >> 172.21.15.90:0/3012365718 conn(0x7f96c806d1a0 msgr2=0x7f96c80b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:02.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.294+0000 7f96d0616640 1 -- 172.21.15.90:0/3012365718 shutdown_connections 2024-09-10T23:19:02.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.295+0000 7f96d0616640 1 -- 172.21.15.90:0/3012365718 wait complete. 2024-09-10T23:19:02.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.296+0000 7f96d0616640 1 Processor -- start 2024-09-10T23:19:02.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.296+0000 7f96d0616640 1 -- start start 2024-09-10T23:19:02.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.296+0000 7f96d0616640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96c80708c0 0x7f96c8142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:02.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.296+0000 7f96d0616640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c80728a0 0x7f96c8150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:02.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.296+0000 7f96d0616640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96c8159b30 0x7f96c8144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:02.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.296+0000 7f96d0616640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f96c806f3b0 con 0x7f96c80728a0 2024-09-10T23:19:02.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.296+0000 7f96d0616640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f96c806f230 con 0x7f96c80708c0 2024-09-10T23:19:02.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.296+0000 7f96d0616640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f96c806f530 con 0x7f96c8159b30 2024-09-10T23:19:02.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.297+0000 7f96cdbb1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c80728a0 0x7f96c8150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:02.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.297+0000 7f96ce3b2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96c80708c0 0x7f96c8142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:02.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.297+0000 7f96cdbb1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c80728a0 0x7f96c8150c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36240/0 (socket says 172.21.15.90:36240) 2024-09-10T23:19:02.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.297+0000 7f96cdbb1640 1 -- 172.21.15.90:0/1399829995 learned_addr learned my addr 172.21.15.90:0/1399829995 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:02.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.297+0000 7f96cebb3640 1 --2- 172.21.15.90:0/1399829995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96c8159b30 0x7f96c8144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:02.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.297+0000 7f96cdbb1640 1 -- 172.21.15.90:0/1399829995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96c8159b30 msgr2=0x7f96c8144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:02.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.297+0000 7f96cdbb1640 1 --2- 172.21.15.90:0/1399829995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96c8159b30 0x7f96c8144570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:02.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.297+0000 7f96cdbb1640 1 -- 172.21.15.90:0/1399829995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96c80708c0 msgr2=0x7f96c8142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:02.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.297+0000 7f96cdbb1640 1 --2- 172.21.15.90:0/1399829995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96c80708c0 0x7f96c8142300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:02.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.297+0000 7f96cdbb1640 1 -- 172.21.15.90:0/1399829995 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c8150660 con 0x7f96c80728a0 2024-09-10T23:19:02.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.297+0000 7f96cdbb1640 1 --2- 172.21.15.90:0/1399829995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c80728a0 0x7f96c8150c30 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f96b800c730 tx=0x7f96b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:02.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.297+0000 7f96beffd640 1 -- 172.21.15.90:0/1399829995 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8006a90 con 0x7f96c80728a0 2024-09-10T23:19:02.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.297+0000 7f96beffd640 1 -- 172.21.15.90:0/1399829995 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96b8006c30 con 0x7f96c80728a0 2024-09-10T23:19:02.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.297+0000 7f96beffd640 1 -- 172.21.15.90:0/1399829995 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8007030 con 0x7f96c80728a0 2024-09-10T23:19:02.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.297+0000 7f96d0616640 1 -- 172.21.15.90:0/1399829995 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c809bbb0 con 0x7f96c80728a0 2024-09-10T23:19:02.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.297+0000 7f96d0616640 1 -- 172.21.15.90:0/1399829995 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c809c170 con 0x7f96c80728a0 2024-09-10T23:19:02.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.298+0000 7f96d0616640 1 -- 172.21.15.90:0/1399829995 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c806f9c0 con 0x7f96c80728a0 2024-09-10T23:19:02.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.299+0000 7f96beffd640 1 -- 172.21.15.90:0/1399829995 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f96b80071d0 con 0x7f96c80728a0 2024-09-10T23:19:02.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.299+0000 7f96beffd640 1 --2- 172.21.15.90:0/1399829995 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f96ac077fa0 0x7f96ac07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:02.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.300+0000 7f96beffd640 1 -- 172.21.15.90:0/1399829995 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7f96b8099510 con 0x7f96c80728a0 2024-09-10T23:19:02.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.300+0000 7f96ce3b2640 1 --2- 172.21.15.90:0/1399829995 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f96ac077fa0 0x7f96ac07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:02.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.300+0000 7f96ce3b2640 1 --2- 172.21.15.90:0/1399829995 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f96ac077fa0 0x7f96ac07a460 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f96c40095f0 tx=0x7f96c4005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:02.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.304+0000 7f96beffd640 1 -- 172.21.15.90:0/1399829995 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f96c815d460 con 0x7f96c80728a0 2024-09-10T23:19:02.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.546+0000 7f96d0616640 1 -- 172.21.15.90:0/1399829995 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]} v 0) -- 0x7f96c8073a50 con 0x7f96c80728a0 2024-09-10T23:19:02.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.757+0000 7f96beffd640 1 -- 172.21.15.90:0/1399829995 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]}]=0 v260) ==== 145+0+0 (secure 0 0 0) 0x7f96b8061b60 con 0x7f96c80728a0 2024-09-10T23:19:02.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.760+0000 7f96d0616640 1 -- 172.21.15.90:0/1399829995 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f96ac077fa0 msgr2=0x7f96ac07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:02.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.760+0000 7f96d0616640 1 --2- 172.21.15.90:0/1399829995 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f96ac077fa0 0x7f96ac07a460 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f96c40095f0 tx=0x7f96c4005f90 comp rx=0 tx=0).stop 2024-09-10T23:19:02.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.760+0000 7f96d0616640 1 -- 172.21.15.90:0/1399829995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c80728a0 msgr2=0x7f96c8150c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:02.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.760+0000 7f96d0616640 1 --2- 172.21.15.90:0/1399829995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c80728a0 0x7f96c8150c30 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f96b800c730 tx=0x7f96b800cbf0 comp rx=0 tx=0).stop 2024-09-10T23:19:02.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.760+0000 7f96d0616640 1 -- 172.21.15.90:0/1399829995 shutdown_connections 2024-09-10T23:19:02.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.760+0000 7f96d0616640 1 --2- 172.21.15.90:0/1399829995 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f96ac077fa0 0x7f96ac07a460 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:02.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.760+0000 7f96d0616640 1 --2- 172.21.15.90:0/1399829995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96c8159b30 0x7f96c8144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:02.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.760+0000 7f96d0616640 1 --2- 172.21.15.90:0/1399829995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c80728a0 0x7f96c8150c30 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:02.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.760+0000 7f96d0616640 1 --2- 172.21.15.90:0/1399829995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96c80708c0 0x7f96c8142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:02.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.760+0000 7f96d0616640 1 -- 172.21.15.90:0/1399829995 >> 172.21.15.90:0/1399829995 conn(0x7f96c806d1a0 msgr2=0x7f96c80b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:02.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.760+0000 7f96d0616640 1 -- 172.21.15.90:0/1399829995 shutdown_connections 2024-09-10T23:19:02.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:02.760+0000 7f96d0616640 1 -- 172.21.15.90:0/1399829995 wait complete. 2024-09-10T23:19:02.772 INFO:tasks.cephfs_test_runner:That when many sessions are updated, they are correctly ... ok 2024-09-10T23:19:02.773 INFO:tasks.cephfs_test_runner: 2024-09-10T23:19:02.773 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-10T23:19:02.773 INFO:tasks.cephfs_test_runner:Ran 7 tests in 244.874s 2024-09-10T23:19:02.773 INFO:tasks.cephfs_test_runner: 2024-09-10T23:19:02.773 INFO:tasks.cephfs_test_runner:OK (skipped=2) 2024-09-10T23:19:02.773 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-10T23:19:02.783 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T23:19:02.798 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T23:19:02.798 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:19:02.798 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:19:02.814 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:19:02.814 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-10T23:19:02.814 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:19:02.870 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3302 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:19:02.870 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:19:02.871 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:19:02.890 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:19:02.890 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-10T23:19:02.890 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:19:02.949 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9503 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:19:02.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:02.950 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-10T23:19:02.966 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:19:02.966 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:19:02.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:02.967 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:19:03.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:03.033 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:19:03.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:03.099 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link delete ceph-brx 2024-09-10T23:19:03.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:03.199 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-09-10T23:19:03.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:03.214 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link delete ceph-brx 2024-09-10T23:19:03.282 INFO:teuthology.orchestra.run.smithi090.stderr:Cannot find device "ceph-brx" 2024-09-10T23:19:03.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:19:03.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:03.283 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-09-10T23:19:03.302 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T23:19:03.302 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T23:19:03.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:03.303 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:19:03.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:03.373 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:19:03.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:03.442 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link delete ceph-brx 2024-09-10T23:19:03.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:03.544 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-09-10T23:19:03.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:03.562 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link delete ceph-brx 2024-09-10T23:19:03.631 INFO:teuthology.orchestra.run.smithi171.stderr:Cannot find device "ceph-brx" 2024-09-10T23:19:03.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:19:03.632 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T23:19:03.641 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:19:03.641 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:19:03.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.744+0000 7f88ff208640 1 -- 172.21.15.90:0/1688906853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88f8159b30 msgr2=0x7f88f815cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:03.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.744+0000 7f88ff208640 1 --2- 172.21.15.90:0/1688906853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88f8159b30 0x7f88f815cf20 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f88f809dc10 tx=0x7f88e802a530 comp rx=0 tx=0).stop 2024-09-10T23:19:03.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.744+0000 7f88ff208640 1 -- 172.21.15.90:0/1688906853 shutdown_connections 2024-09-10T23:19:03.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.744+0000 7f88ff208640 1 --2- 172.21.15.90:0/1688906853 >> v2:172.21.15.171:3300/0 conn(0x7f88f80708c0 0x7f88f806ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:03.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.744+0000 7f88ff208640 1 --2- 172.21.15.90:0/1688906853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88f8159b30 0x7f88f815cf20 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:03.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.744+0000 7f88ff208640 1 -- 172.21.15.90:0/1688906853 >> 172.21.15.90:0/1688906853 conn(0x7f88f806d1a0 msgr2=0x7f88f80b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:03.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.744+0000 7f88ff208640 1 -- 172.21.15.90:0/1688906853 shutdown_connections 2024-09-10T23:19:03.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.744+0000 7f88ff208640 1 -- 172.21.15.90:0/1688906853 wait complete. 2024-09-10T23:19:03.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.745+0000 7f88ff208640 1 Processor -- start 2024-09-10T23:19:03.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.746+0000 7f88ff208640 1 -- start start 2024-09-10T23:19:03.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.746+0000 7f88ff208640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88f80708c0 0x7f88f8154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:03.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.746+0000 7f88ff208640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88f80728a0 0x7f88f80b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:03.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.746+0000 7f88ff208640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88f8159b30 0x7f88f81f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:03.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.746+0000 7f88ff208640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f88f806f3b0 con 0x7f88f8159b30 2024-09-10T23:19:03.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.746+0000 7f88ff208640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f88f806f230 con 0x7f88f80708c0 2024-09-10T23:19:03.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.746+0000 7f88ff208640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f88f806f530 con 0x7f88f80728a0 2024-09-10T23:19:03.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.747+0000 7f88fd7a5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88f8159b30 0x7f88f81f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:03.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.747+0000 7f88fd7a5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88f8159b30 0x7f88f81f4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36256/0 (socket says 172.21.15.90:36256) 2024-09-10T23:19:03.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.747+0000 7f88fd7a5640 1 -- 172.21.15.90:0/1044058141 learned_addr learned my addr 172.21.15.90:0/1044058141 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.747+0000 7f88fcfa4640 1 --2- 172.21.15.90:0/1044058141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88f80708c0 0x7f88f8154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.747+0000 7f88f7fff640 1 --2- 172.21.15.90:0/1044058141 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88f80728a0 0x7f88f80b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.747+0000 7f88fd7a5640 1 -- 172.21.15.90:0/1044058141 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88f80728a0 msgr2=0x7f88f80b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.747+0000 7f88fd7a5640 1 --2- 172.21.15.90:0/1044058141 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88f80728a0 0x7f88f80b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.747+0000 7f88fd7a5640 1 -- 172.21.15.90:0/1044058141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88f80708c0 msgr2=0x7f88f8154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.747+0000 7f88fd7a5640 1 --2- 172.21.15.90:0/1044058141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88f80708c0 0x7f88f8154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.747+0000 7f88fd7a5640 1 -- 172.21.15.90:0/1044058141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f80b4e70 con 0x7f88f8159b30 2024-09-10T23:19:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.747+0000 7f88fd7a5640 1 --2- 172.21.15.90:0/1044058141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88f8159b30 0x7f88f81f4920 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f88f000eaa0 tx=0x7f88f000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.747+0000 7f88f57fa640 1 -- 172.21.15.90:0/1044058141 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f000cdb0 con 0x7f88f8159b30 2024-09-10T23:19:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.747+0000 7f88f57fa640 1 -- 172.21.15.90:0/1044058141 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88f0004c10 con 0x7f88f8159b30 2024-09-10T23:19:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.747+0000 7f88ff208640 1 -- 172.21.15.90:0/1044058141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f81f4e60 con 0x7f88f8159b30 2024-09-10T23:19:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.747+0000 7f88f57fa640 1 -- 172.21.15.90:0/1044058141 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0005020 con 0x7f88f8159b30 2024-09-10T23:19:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.747+0000 7f88ff208640 1 -- 172.21.15.90:0/1044058141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f81f53e0 con 0x7f88f8159b30 2024-09-10T23:19:03.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.748+0000 7f88ff208640 1 -- 172.21.15.90:0/1044058141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88f806fac0 con 0x7f88f8159b30 2024-09-10T23:19:03.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.749+0000 7f88f57fa640 1 -- 172.21.15.90:0/1044058141 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f88f000f040 con 0x7f88f8159b30 2024-09-10T23:19:03.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.749+0000 7f88f57fa640 1 --2- 172.21.15.90:0/1044058141 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f88e4077fa0 0x7f88e407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:03.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.749+0000 7f88f57fa640 1 -- 172.21.15.90:0/1044058141 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7f88f009a200 con 0x7f88f8159b30 2024-09-10T23:19:03.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.749+0000 7f88fcfa4640 1 --2- 172.21.15.90:0/1044058141 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f88e4077fa0 0x7f88e407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:03.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.750+0000 7f88fcfa4640 1 --2- 172.21.15.90:0/1044058141 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f88e4077fa0 0x7f88e407a460 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f88e8034000 tx=0x7f88e8004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:03.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.753+0000 7f88f57fa640 1 -- 172.21.15.90:0/1044058141 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f88f0016030 con 0x7f88f8159b30 2024-09-10T23:19:03.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.925+0000 7f88ff208640 1 -- 172.21.15.90:0/1044058141 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f88f80aec80 con 0x7f88e4077fa0 2024-09-10T23:19:03.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.926+0000 7f88f57fa640 1 -- 172.21.15.90:0/1044058141 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13436 (secure 0 0 0) 0x7f88f80aec80 con 0x7f88e4077fa0 2024-09-10T23:19:03.927 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:03.927 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:19:03.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.928+0000 7f88ff208640 1 -- 172.21.15.90:0/1044058141 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f88e4077fa0 msgr2=0x7f88e407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:03.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.928+0000 7f88ff208640 1 --2- 172.21.15.90:0/1044058141 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f88e4077fa0 0x7f88e407a460 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f88e8034000 tx=0x7f88e8004730 comp rx=0 tx=0).stop 2024-09-10T23:19:03.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.928+0000 7f88ff208640 1 -- 172.21.15.90:0/1044058141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88f8159b30 msgr2=0x7f88f81f4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:03.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.928+0000 7f88ff208640 1 --2- 172.21.15.90:0/1044058141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88f8159b30 0x7f88f81f4920 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f88f000eaa0 tx=0x7f88f000ef60 comp rx=0 tx=0).stop 2024-09-10T23:19:03.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.928+0000 7f88ff208640 1 -- 172.21.15.90:0/1044058141 shutdown_connections 2024-09-10T23:19:03.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.928+0000 7f88ff208640 1 --2- 172.21.15.90:0/1044058141 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f88e4077fa0 0x7f88e407a460 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:03.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.928+0000 7f88ff208640 1 --2- 172.21.15.90:0/1044058141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88f8159b30 0x7f88f81f4920 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:03.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.928+0000 7f88ff208640 1 --2- 172.21.15.90:0/1044058141 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88f80728a0 0x7f88f80b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:03.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.928+0000 7f88ff208640 1 --2- 172.21.15.90:0/1044058141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88f80708c0 0x7f88f8154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:03.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.928+0000 7f88ff208640 1 -- 172.21.15.90:0/1044058141 >> 172.21.15.90:0/1044058141 conn(0x7f88f806d1a0 msgr2=0x7f88f81575e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:03.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.928+0000 7f88ff208640 1 -- 172.21.15.90:0/1044058141 shutdown_connections 2024-09-10T23:19:03.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:03.928+0000 7f88ff208640 1 -- 172.21.15.90:0/1044058141 wait complete. 2024-09-10T23:19:03.940 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-09-10T23:19:02.498543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257160,"kb_used_data":11820,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754717560,"statfs":{"total":773094113280,"available":772830781440,"internally_reserved":0,"allocated":12103680,"data_stored":5842191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19679,"num_objects":-41,"num_object_clones":0,"num_object_copies":-82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-41,"num_whiteouts":0,"num_read":-92,"num_read_kb":-87,"num_write":-145,"num_write_kb":-70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001677"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":267,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T23:18:59.266114+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:18:59.266114+0000","last_peered":"2024-09-10T23:18:59.266114+0000","last_clean":"2024-09-10T23:18:59.266114+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:18:59.266114+0000","last_undegraded":"2024-09-10T23:18:59.266114+0000","last_fullsized":"2024-09-10T23:18:59.266114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28932,"kb_used_data":1904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342908,"statfs":{"total":96636764160,"available":96607137792,"internally_reserved":0,"allocated":1949696,"data_stored":1168340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509498,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32512,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1355776,"data_stored":577432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1368064,"data_stored":584790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1347584,"data_stored":577340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509500,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1376256,"data_stored":593589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32512,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1355776,"data_stored":577520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509500,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1380352,"data_stored":585088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33108,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338732,"statfs":{"total":96636764160,"available":96602861568,"internally_reserved":0,"allocated":1970176,"data_stored":1178092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:19:03.940 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:19:04.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.041+0000 7f062169b640 1 -- 172.21.15.90:0/2033480583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0608004800 msgr2=0x7f0608004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:04.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.041+0000 7f062169b640 1 --2- 172.21.15.90:0/2033480583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0608004800 0x7f0608004c80 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f0604001050 tx=0x7f0608005830 comp rx=0 tx=0).stop 2024-09-10T23:19:04.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.041+0000 7f062169b640 1 -- 172.21.15.90:0/2033480583 shutdown_connections 2024-09-10T23:19:04.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.041+0000 7f062169b640 1 --2- 172.21.15.90:0/2033480583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0608004800 0x7f0608004c80 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.041+0000 7f062169b640 1 -- 172.21.15.90:0/2033480583 >> 172.21.15.90:0/2033480583 conn(0x7f061c0d41e0 msgr2=0x7f061c0d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:04.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.041+0000 7f062169b640 1 -- 172.21.15.90:0/2033480583 shutdown_connections 2024-09-10T23:19:04.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.041+0000 7f062169b640 1 -- 172.21.15.90:0/2033480583 wait complete. 2024-09-10T23:19:04.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.042+0000 7f062169b640 1 Processor -- start 2024-09-10T23:19:04.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.042+0000 7f062169b640 1 -- start start 2024-09-10T23:19:04.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f062169b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0608004800 0x7f061c0b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:04.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f062169b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f061c0b4c50 0x7f061c1f4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:04.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f062169b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f061c0b7830 0x7f061c0b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:04.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f062169b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f061c06eb00 con 0x7f0608004800 2024-09-10T23:19:04.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f062169b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f061c06e980 con 0x7f061c0b4c50 2024-09-10T23:19:04.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f062169b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f061c161d70 con 0x7f061c0b7830 2024-09-10T23:19:04.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f061affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0608004800 0x7f061c0b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:04.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f061affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0608004800 0x7f061c0b63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36280/0 (socket says 172.21.15.90:36280) 2024-09-10T23:19:04.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f061affd640 1 -- 172.21.15.90:0/1778638390 learned_addr learned my addr 172.21.15.90:0/1778638390 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:04.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f0613fff640 1 --2- 172.21.15.90:0/1778638390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f061c0b4c50 0x7f061c1f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:04.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f061b7fe640 1 --2- 172.21.15.90:0/1778638390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f061c0b7830 0x7f061c0b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:04.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f061affd640 1 -- 172.21.15.90:0/1778638390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f061c0b7830 msgr2=0x7f061c0b7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:04.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f061affd640 1 --2- 172.21.15.90:0/1778638390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f061c0b7830 0x7f061c0b7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f061affd640 1 -- 172.21.15.90:0/1778638390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f061c0b4c50 msgr2=0x7f061c1f4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:04.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f061affd640 1 --2- 172.21.15.90:0/1778638390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f061c0b4c50 0x7f061c1f4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f061affd640 1 -- 172.21.15.90:0/1778638390 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f061c1f87a0 con 0x7f0608004800 2024-09-10T23:19:04.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f0613fff640 1 --2- 172.21.15.90:0/1778638390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f061c0b4c50 0x7f061c1f4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:04.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.043+0000 7f061b7fe640 1 --2- 172.21.15.90:0/1778638390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f061c0b7830 0x7f061c0b7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:04.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.044+0000 7f061affd640 1 --2- 172.21.15.90:0/1778638390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0608004800 0x7f061c0b63f0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f060c004ee0 tx=0x7f060c001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:04.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.044+0000 7f06137fe640 1 -- 172.21.15.90:0/1778638390 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c015020 con 0x7f0608004800 2024-09-10T23:19:04.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.044+0000 7f06137fe640 1 -- 172.21.15.90:0/1778638390 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f060c011960 con 0x7f0608004800 2024-09-10T23:19:04.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.044+0000 7f062169b640 1 -- 172.21.15.90:0/1778638390 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f061c1f8a80 con 0x7f0608004800 2024-09-10T23:19:04.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.044+0000 7f06137fe640 1 -- 172.21.15.90:0/1778638390 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c011d30 con 0x7f0608004800 2024-09-10T23:19:04.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.044+0000 7f062169b640 1 -- 172.21.15.90:0/1778638390 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f061c1f9040 con 0x7f0608004800 2024-09-10T23:19:04.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.045+0000 7f062169b640 1 -- 172.21.15.90:0/1778638390 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f061c0d25d0 con 0x7f0608004800 2024-09-10T23:19:04.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.045+0000 7f06137fe640 1 -- 172.21.15.90:0/1778638390 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f060c01a400 con 0x7f0608004800 2024-09-10T23:19:04.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.046+0000 7f06137fe640 1 --2- 172.21.15.90:0/1778638390 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05fc077f70 0x7f05fc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:04.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.046+0000 7f06137fe640 1 -- 172.21.15.90:0/1778638390 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7f060c09aa30 con 0x7f0608004800 2024-09-10T23:19:04.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.046+0000 7f0613fff640 1 --2- 172.21.15.90:0/1778638390 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05fc077f70 0x7f05fc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:04.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.046+0000 7f0613fff640 1 --2- 172.21.15.90:0/1778638390 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05fc077f70 0x7f05fc07a430 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0604033000 tx=0x7f0604000fe0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:04.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.050+0000 7f06137fe640 1 -- 172.21.15.90:0/1778638390 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f060c01f020 con 0x7f0608004800 2024-09-10T23:19:04.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.223+0000 7f062169b640 1 -- 172.21.15.90:0/1778638390 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f061c1f9280 con 0x7f05fc077f70 2024-09-10T23:19:04.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.224+0000 7f06137fe640 1 -- 172.21.15.90:0/1778638390 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13436 (secure 0 0 0) 0x7f061c1f9280 con 0x7f05fc077f70 2024-09-10T23:19:04.225 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:04.226 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:19:04.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.226+0000 7f062169b640 1 -- 172.21.15.90:0/1778638390 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05fc077f70 msgr2=0x7f05fc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:04.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.226+0000 7f062169b640 1 --2- 172.21.15.90:0/1778638390 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05fc077f70 0x7f05fc07a430 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0604033000 tx=0x7f0604000fe0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.226+0000 7f062169b640 1 -- 172.21.15.90:0/1778638390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0608004800 msgr2=0x7f061c0b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:04.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.226+0000 7f062169b640 1 --2- 172.21.15.90:0/1778638390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0608004800 0x7f061c0b63f0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f060c004ee0 tx=0x7f060c001630 comp rx=0 tx=0).stop 2024-09-10T23:19:04.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.226+0000 7f062169b640 1 -- 172.21.15.90:0/1778638390 shutdown_connections 2024-09-10T23:19:04.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.226+0000 7f062169b640 1 --2- 172.21.15.90:0/1778638390 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f05fc077f70 0x7f05fc07a430 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.226+0000 7f062169b640 1 --2- 172.21.15.90:0/1778638390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f061c0b4c50 0x7f061c1f4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.226+0000 7f062169b640 1 --2- 172.21.15.90:0/1778638390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f061c0b7830 0x7f061c0b7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.226+0000 7f062169b640 1 --2- 172.21.15.90:0/1778638390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0608004800 0x7f061c0b63f0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.226+0000 7f062169b640 1 -- 172.21.15.90:0/1778638390 >> 172.21.15.90:0/1778638390 conn(0x7f061c0d41e0 msgr2=0x7f061c156da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:04.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.226+0000 7f062169b640 1 -- 172.21.15.90:0/1778638390 shutdown_connections 2024-09-10T23:19:04.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.226+0000 7f062169b640 1 -- 172.21.15.90:0/1778638390 wait complete. 2024-09-10T23:19:04.238 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-09-10T23:19:02.498543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257160,"kb_used_data":11820,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754717560,"statfs":{"total":773094113280,"available":772830781440,"internally_reserved":0,"allocated":12103680,"data_stored":5842191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19679,"num_objects":-41,"num_object_clones":0,"num_object_copies":-82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-41,"num_whiteouts":0,"num_read":-92,"num_read_kb":-87,"num_write":-145,"num_write_kb":-70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001677"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":267,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T23:18:59.266114+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:18:59.266114+0000","last_peered":"2024-09-10T23:18:59.266114+0000","last_clean":"2024-09-10T23:18:59.266114+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:18:59.266114+0000","last_undegraded":"2024-09-10T23:18:59.266114+0000","last_fullsized":"2024-09-10T23:18:59.266114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28932,"kb_used_data":1904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342908,"statfs":{"total":96636764160,"available":96607137792,"internally_reserved":0,"allocated":1949696,"data_stored":1168340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509498,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32512,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1355776,"data_stored":577432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1368064,"data_stored":584790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1347584,"data_stored":577340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509500,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1376256,"data_stored":593589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32512,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1355776,"data_stored":577520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509500,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1380352,"data_stored":585088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33108,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338732,"statfs":{"total":96636764160,"available":96602861568,"internally_reserved":0,"allocated":1970176,"data_stored":1178092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:19:04.238 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:19:04.238 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:19:04.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.338+0000 7ff6d3872640 1 -- 172.21.15.90:0/3806048694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6cc072e50 msgr2=0x7ff6cc073300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:04.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.338+0000 7ff6d3872640 1 --2- 172.21.15.90:0/3806048694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6cc072e50 0x7ff6cc073300 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4005fd0 tx=0x7ff6c402aa00 comp rx=0 tx=0).stop 2024-09-10T23:19:04.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.338+0000 7ff6d3872640 1 -- 172.21.15.90:0/3806048694 shutdown_connections 2024-09-10T23:19:04.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.338+0000 7ff6d3872640 1 --2- 172.21.15.90:0/3806048694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6cc072e50 0x7ff6cc073300 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.338+0000 7ff6d3872640 1 --2- 172.21.15.90:0/3806048694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6cc0b3110 0x7ff6cc06f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.338+0000 7ff6d3872640 1 -- 172.21.15.90:0/3806048694 >> 172.21.15.90:0/3806048694 conn(0x7ff6cc06d1a0 msgr2=0x7ff6cc0b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:04.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.338+0000 7ff6d3872640 1 -- 172.21.15.90:0/3806048694 shutdown_connections 2024-09-10T23:19:04.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.338+0000 7ff6d3872640 1 -- 172.21.15.90:0/3806048694 wait complete. 2024-09-10T23:19:04.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.339+0000 7ff6d3872640 1 Processor -- start 2024-09-10T23:19:04.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.339+0000 7ff6d3872640 1 -- start start 2024-09-10T23:19:04.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.340+0000 7ff6d3872640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6cc072e50 0x7ff6cc15cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:04.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.340+0000 7ff6d3872640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6cc0b2d30 0x7ff6cc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:04.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.340+0000 7ff6d3872640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6cc0b3110 0x7ff6cc09d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:04.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.340+0000 7ff6d3872640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff6cc072be0 con 0x7ff6cc0b2d30 2024-09-10T23:19:04.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.340+0000 7ff6d3872640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff6cc072a60 con 0x7ff6cc072e50 2024-09-10T23:19:04.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.340+0000 7ff6d3872640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff6cc073840 con 0x7ff6cc0b3110 2024-09-10T23:19:04.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.340+0000 7ff6d0e0d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6cc0b2d30 0x7ff6cc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:04.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.340+0000 7ff6d0e0d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6cc0b2d30 0x7ff6cc09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36306/0 (socket says 172.21.15.90:36306) 2024-09-10T23:19:04.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.340+0000 7ff6d0e0d640 1 -- 172.21.15.90:0/972894844 learned_addr learned my addr 172.21.15.90:0/972894844 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:04.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.340+0000 7ff6d1e0f640 1 --2- 172.21.15.90:0/972894844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6cc0b3110 0x7ff6cc09d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:04.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.340+0000 7ff6d160e640 1 --2- 172.21.15.90:0/972894844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6cc072e50 0x7ff6cc15cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:04.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.340+0000 7ff6d0e0d640 1 -- 172.21.15.90:0/972894844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6cc0b3110 msgr2=0x7ff6cc09d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:04.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.340+0000 7ff6d0e0d640 1 --2- 172.21.15.90:0/972894844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6cc0b3110 0x7ff6cc09d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.340+0000 7ff6d0e0d640 1 -- 172.21.15.90:0/972894844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6cc072e50 msgr2=0x7ff6cc15cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:04.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.340+0000 7ff6d0e0d640 1 --2- 172.21.15.90:0/972894844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6cc072e50 0x7ff6cc15cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.340+0000 7ff6d0e0d640 1 -- 172.21.15.90:0/972894844 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6cc0cbf30 con 0x7ff6cc0b2d30 2024-09-10T23:19:04.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.340+0000 7ff6d0e0d640 1 --2- 172.21.15.90:0/972894844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6cc0b2d30 0x7ff6cc09cf00 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc00d780 tx=0x7ff6bc00dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:04.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.341+0000 7ff6c1ffb640 1 -- 172.21.15.90:0/972894844 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc017070 con 0x7ff6cc0b2d30 2024-09-10T23:19:04.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.341+0000 7ff6c1ffb640 1 -- 172.21.15.90:0/972894844 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6bc009b10 con 0x7ff6cc0b2d30 2024-09-10T23:19:04.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.341+0000 7ff6c1ffb640 1 -- 172.21.15.90:0/972894844 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc010460 con 0x7ff6cc0b2d30 2024-09-10T23:19:04.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.341+0000 7ff6d3872640 1 -- 172.21.15.90:0/972894844 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6cc15a5c0 con 0x7ff6cc0b2d30 2024-09-10T23:19:04.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.341+0000 7ff6d3872640 1 -- 172.21.15.90:0/972894844 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6cc15ab80 con 0x7ff6cc0b2d30 2024-09-10T23:19:04.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.342+0000 7ff6d3872640 1 -- 172.21.15.90:0/972894844 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6cc070990 con 0x7ff6cc0b2d30 2024-09-10T23:19:04.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.342+0000 7ff6c1ffb640 1 -- 172.21.15.90:0/972894844 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff6bc010600 con 0x7ff6cc0b2d30 2024-09-10T23:19:04.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.343+0000 7ff6c1ffb640 1 --2- 172.21.15.90:0/972894844 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff6b0077f70 0x7ff6b007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:04.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.343+0000 7ff6c1ffb640 1 -- 172.21.15.90:0/972894844 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7ff6bc09a010 con 0x7ff6cc0b2d30 2024-09-10T23:19:04.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.343+0000 7ff6d160e640 1 --2- 172.21.15.90:0/972894844 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff6b0077f70 0x7ff6b007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:04.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.344+0000 7ff6d160e640 1 --2- 172.21.15.90:0/972894844 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff6b0077f70 0x7ff6b007a430 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8004ea0 tx=0x7ff6c8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:04.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.347+0000 7ff6c1ffb640 1 -- 172.21.15.90:0/972894844 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff6bc062cb0 con 0x7ff6cc0b2d30 2024-09-10T23:19:04.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.518+0000 7ff6d3872640 1 -- 172.21.15.90:0/972894844 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff6cc0b3c20 con 0x7ff6b0077f70 2024-09-10T23:19:04.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.519+0000 7ff6c1ffb640 1 -- 172.21.15.90:0/972894844 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13435 (secure 0 0 0) 0x7ff6cc0b3c20 con 0x7ff6b0077f70 2024-09-10T23:19:04.520 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:04.520 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:19:04.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.521+0000 7ff6d3872640 1 -- 172.21.15.90:0/972894844 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff6b0077f70 msgr2=0x7ff6b007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:04.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.521+0000 7ff6d3872640 1 --2- 172.21.15.90:0/972894844 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff6b0077f70 0x7ff6b007a430 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8004ea0 tx=0x7ff6c8009040 comp rx=0 tx=0).stop 2024-09-10T23:19:04.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.521+0000 7ff6d3872640 1 -- 172.21.15.90:0/972894844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6cc0b2d30 msgr2=0x7ff6cc09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:04.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.521+0000 7ff6d3872640 1 --2- 172.21.15.90:0/972894844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6cc0b2d30 0x7ff6cc09cf00 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc00d780 tx=0x7ff6bc00dc40 comp rx=0 tx=0).stop 2024-09-10T23:19:04.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.521+0000 7ff6d3872640 1 -- 172.21.15.90:0/972894844 shutdown_connections 2024-09-10T23:19:04.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.521+0000 7ff6d3872640 1 --2- 172.21.15.90:0/972894844 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7ff6b0077f70 0x7ff6b007a430 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.521+0000 7ff6d3872640 1 --2- 172.21.15.90:0/972894844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6cc0b3110 0x7ff6cc09d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.521+0000 7ff6d3872640 1 --2- 172.21.15.90:0/972894844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6cc0b2d30 0x7ff6cc09cf00 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.521+0000 7ff6d3872640 1 --2- 172.21.15.90:0/972894844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6cc072e50 0x7ff6cc15cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.521+0000 7ff6d3872640 1 -- 172.21.15.90:0/972894844 >> 172.21.15.90:0/972894844 conn(0x7ff6cc06d1a0 msgr2=0x7ff6cc0ae010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:04.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.521+0000 7ff6d3872640 1 -- 172.21.15.90:0/972894844 shutdown_connections 2024-09-10T23:19:04.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.522+0000 7ff6d3872640 1 -- 172.21.15.90:0/972894844 wait complete. 2024-09-10T23:19:04.533 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-09-10T23:19:04.498891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257172,"kb_used_data":11824,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754717548,"statfs":{"total":773094113280,"available":772830769152,"internally_reserved":0,"allocated":12107776,"data_stored":5844063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23327,"num_objects":-41,"num_object_clones":0,"num_object_copies":-82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-41,"num_whiteouts":0,"num_read":-92,"num_read_kb":-87,"num_write":-153,"num_write_kb":-80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001466"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":267,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T23:18:59.266114+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:18:59.266114+0000","last_peered":"2024-09-10T23:18:59.266114+0000","last_clean":"2024-09-10T23:18:59.266114+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:18:59.266114+0000","last_undegraded":"2024-09-10T23:18:59.266114+0000","last_fullsized":"2024-09-10T23:18:59.266114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28932,"kb_used_data":1904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342908,"statfs":{"total":96636764160,"available":96607137792,"internally_reserved":0,"allocated":1949696,"data_stored":1168340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509498,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32512,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1355776,"data_stored":577432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1368064,"data_stored":584790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1347584,"data_stored":577340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509500,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1376256,"data_stored":593589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32512,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1355776,"data_stored":577520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509500,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1380352,"data_stored":585088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33120,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338720,"statfs":{"total":96636764160,"available":96602849280,"internally_reserved":0,"allocated":1974272,"data_stored":1179964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:19:04.534 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:19:04.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.634+0000 7fbc37bad640 1 -- 172.21.15.90:0/62976905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc300cd990 msgr2=0x7fbc300d0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:04.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.634+0000 7fbc37bad640 1 --2- 172.21.15.90:0/62976905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc300cd990 0x7fbc300d0560 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fbc28005fd0 tx=0x7fbc2802a940 comp rx=0 tx=0).stop 2024-09-10T23:19:04.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.634+0000 7fbc37bad640 1 -- 172.21.15.90:0/62976905 shutdown_connections 2024-09-10T23:19:04.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.634+0000 7fbc37bad640 1 --2- 172.21.15.90:0/62976905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc300cd990 0x7fbc300d0560 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.634+0000 7fbc37bad640 1 --2- 172.21.15.90:0/62976905 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc300ce960 0x7fbc300ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.634+0000 7fbc37bad640 1 -- 172.21.15.90:0/62976905 >> 172.21.15.90:0/62976905 conn(0x7fbc300d1f50 msgr2=0x7fbc300d2360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:04.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.634+0000 7fbc37bad640 1 -- 172.21.15.90:0/62976905 shutdown_connections 2024-09-10T23:19:04.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.634+0000 7fbc37bad640 1 -- 172.21.15.90:0/62976905 wait complete. 2024-09-10T23:19:04.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.635+0000 7fbc37bad640 1 Processor -- start 2024-09-10T23:19:04.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.635+0000 7fbc37bad640 1 -- start start 2024-09-10T23:19:04.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc37bad640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc300cd990 0x7fbc300cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:04.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc37bad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc300ce960 0x7fbc30157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:04.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc37bad640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc300d2a70 0x7fbc3015c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:04.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc37bad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3006e300 con 0x7fbc300ce960 2024-09-10T23:19:04.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc37bad640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3006e180 con 0x7fbc300d2a70 2024-09-10T23:19:04.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc37bad640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbc3006e480 con 0x7fbc300cd990 2024-09-10T23:19:04.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc35148640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc300ce960 0x7fbc30157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:04.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc35148640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc300ce960 0x7fbc30157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36322/0 (socket says 172.21.15.90:36322) 2024-09-10T23:19:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc35148640 1 -- 172.21.15.90:0/3850273048 learned_addr learned my addr 172.21.15.90:0/3850273048 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc3614a640 1 --2- 172.21.15.90:0/3850273048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc300d2a70 0x7fbc3015c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc35949640 1 --2- 172.21.15.90:0/3850273048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc300cd990 0x7fbc300cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc35148640 1 -- 172.21.15.90:0/3850273048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc300cd990 msgr2=0x7fbc300cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc35148640 1 --2- 172.21.15.90:0/3850273048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc300cd990 0x7fbc300cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc35148640 1 -- 172.21.15.90:0/3850273048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc300d2a70 msgr2=0x7fbc3015c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc35148640 1 --2- 172.21.15.90:0/3850273048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc300d2a70 0x7fbc3015c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc35148640 1 -- 172.21.15.90:0/3850273048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc301f5110 con 0x7fbc300ce960 2024-09-10T23:19:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc3614a640 1 --2- 172.21.15.90:0/3850273048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc300d2a70 0x7fbc3015c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc35148640 1 --2- 172.21.15.90:0/3850273048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc300ce960 0x7fbc30157b60 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000c430 tx=0x7fbc2000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc267fc640 1 -- 172.21.15.90:0/3850273048 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc20017070 con 0x7fbc300ce960 2024-09-10T23:19:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc267fc640 1 -- 172.21.15.90:0/3850273048 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc200035f0 con 0x7fbc300ce960 2024-09-10T23:19:04.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc37bad640 1 -- 172.21.15.90:0/3850273048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc301f53f0 con 0x7fbc300ce960 2024-09-10T23:19:04.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc267fc640 1 -- 172.21.15.90:0/3850273048 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc20003ac0 con 0x7fbc300ce960 2024-09-10T23:19:04.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.636+0000 7fbc37bad640 1 -- 172.21.15.90:0/3850273048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc301f59b0 con 0x7fbc300ce960 2024-09-10T23:19:04.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.637+0000 7fbc37bad640 1 -- 172.21.15.90:0/3850273048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc301f5d80 con 0x7fbc300ce960 2024-09-10T23:19:04.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.638+0000 7fbc267fc640 1 -- 172.21.15.90:0/3850273048 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbc20003c60 con 0x7fbc300ce960 2024-09-10T23:19:04.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.639+0000 7fbc267fc640 1 --2- 172.21.15.90:0/3850273048 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbc14077f70 0x7fbc1407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:04.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.639+0000 7fbc267fc640 1 -- 172.21.15.90:0/3850273048 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7fbc200991f0 con 0x7fbc300ce960 2024-09-10T23:19:04.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.639+0000 7fbc35949640 1 --2- 172.21.15.90:0/3850273048 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbc14077f70 0x7fbc1407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:04.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.639+0000 7fbc35949640 1 --2- 172.21.15.90:0/3850273048 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbc14077f70 0x7fbc1407a430 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c005fd0 tx=0x7fbc2c005850 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:04.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.643+0000 7fbc267fc640 1 -- 172.21.15.90:0/3850273048 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbc301f5d80 con 0x7fbc300ce960 2024-09-10T23:19:04.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.820+0000 7fbc37bad640 1 -- 172.21.15.90:0/3850273048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc300ced40 con 0x7fbc300ce960 2024-09-10T23:19:04.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.821+0000 7fbc267fc640 1 -- 172.21.15.90:0/3850273048 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) ==== 74+0+13564 (secure 0 0 0) 0x7fbc20061f20 con 0x7fbc300ce960 2024-09-10T23:19:04.822 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:04.822 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":111,"fsid":"1c1b9adc-7aab-4ed5-9f9b-48034f5db1dd","created":"2024-09-10T23:14:12.110415+0000","modified":"2024-09-10T23:19:01.749810+0000","last_up_change":"2024-09-10T23:14:25.072810+0000","last_in_change":"2024-09-10T23:14:15.178045+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:14:26.449950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f95b4d0-67bd-402b-b841-f8494438702f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6801","nonce":1564469617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6803","nonce":1564469617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6807","nonce":1564469617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1564469617},{"type":"v1","addr":"172.21.15.90:6805","nonce":1564469617}]},"public_addr":"172.21.15.90:6801/1564469617","cluster_addr":"172.21.15.90:6803/1564469617","heartbeat_back_addr":"172.21.15.90:6807/1564469617","heartbeat_front_addr":"172.21.15.90:6805/1564469617","state":["exists","up"]},{"osd":1,"uuid":"96120cd4-0cf2-4ae9-9b61-eb6699bb6e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6825","nonce":165329743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6827","nonce":165329743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6831","nonce":165329743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":165329743},{"type":"v1","addr":"172.21.15.90:6829","nonce":165329743}]},"public_addr":"172.21.15.90:6825/165329743","cluster_addr":"172.21.15.90:6827/165329743","heartbeat_back_addr":"172.21.15.90:6831/165329743","heartbeat_front_addr":"172.21.15.90:6829/165329743","state":["exists","up"]},{"osd":2,"uuid":"7d152a62-8819-4391-a6a2-b300959aaf24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6817","nonce":2119406419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6819","nonce":2119406419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6823","nonce":2119406419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2119406419},{"type":"v1","addr":"172.21.15.90:6821","nonce":2119406419}]},"public_addr":"172.21.15.90:6817/2119406419","cluster_addr":"172.21.15.90:6819/2119406419","heartbeat_back_addr":"172.21.15.90:6823/2119406419","heartbeat_front_addr":"172.21.15.90:6821/2119406419","state":["exists","up"]},{"osd":3,"uuid":"2892bb8d-dca8-4c77-bc7b-a42090eef419","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6809","nonce":2857408980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6811","nonce":2857408980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6815","nonce":2857408980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2857408980},{"type":"v1","addr":"172.21.15.90:6813","nonce":2857408980}]},"public_addr":"172.21.15.90:6809/2857408980","cluster_addr":"172.21.15.90:6811/2857408980","heartbeat_back_addr":"172.21.15.90:6815/2857408980","heartbeat_front_addr":"172.21.15.90:6813/2857408980","state":["exists","up"]},{"osd":4,"uuid":"9cd0b021-6803-4c1f-ab6a-04ea69f550ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6811","nonce":1503898082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6813","nonce":1503898082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6817","nonce":1503898082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":1503898082},{"type":"v1","addr":"172.21.15.171:6815","nonce":1503898082}]},"public_addr":"172.21.15.171:6811/1503898082","cluster_addr":"172.21.15.171:6813/1503898082","heartbeat_back_addr":"172.21.15.171:6817/1503898082","heartbeat_front_addr":"172.21.15.171:6815/1503898082","state":["exists","up"]},{"osd":5,"uuid":"dd31ec4a-108e-4946-b822-51df539a9218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6819","nonce":2053754805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6821","nonce":2053754805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6825","nonce":2053754805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2053754805},{"type":"v1","addr":"172.21.15.171:6823","nonce":2053754805}]},"public_addr":"172.21.15.171:6819/2053754805","cluster_addr":"172.21.15.171:6821/2053754805","heartbeat_back_addr":"172.21.15.171:6825/2053754805","heartbeat_front_addr":"172.21.15.171:6823/2053754805","state":["exists","up"]},{"osd":6,"uuid":"44f5c9f5-f58d-4587-a645-1a7cd2b3ec43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6827","nonce":126573870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6829","nonce":126573870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6833","nonce":126573870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":126573870},{"type":"v1","addr":"172.21.15.171:6831","nonce":126573870}]},"public_addr":"172.21.15.171:6827/126573870","cluster_addr":"172.21.15.171:6829/126573870","heartbeat_back_addr":"172.21.15.171:6833/126573870","heartbeat_front_addr":"172.21.15.171:6831/126573870","state":["exists","up"]},{"osd":7,"uuid":"82ad74e4-f7ff-4ce3-baf4-d67b438a8876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6803","nonce":3756038245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6805","nonce":3756038245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6809","nonce":3756038245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3756038245},{"type":"v1","addr":"172.21.15.171:6807","nonce":3756038245}]},"public_addr":"172.21.15.171:6803/3756038245","cluster_addr":"172.21.15.171:6805/3756038245","heartbeat_back_addr":"172.21.15.171:6809/3756038245","heartbeat_front_addr":"172.21.15.171:6807/3756038245","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.245153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.739538+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.021136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.744095+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.943647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.072090+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:22.247817+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:14:21.804440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6834/638480774":"2024-09-11T23:18:58.740457+0000","172.21.15.90:6832/638480774":"2024-09-11T23:18:58.740457+0000","172.21.15.90:6833/2723277392":"2024-09-11T23:18:58.740445+0000","172.21.15.171:6836/1514360394":"2024-09-11T23:18:38.485249+0000","172.21.15.171:6834/1514360394":"2024-09-11T23:18:38.485249+0000","172.21.15.90:6833/4002726882":"2024-09-11T23:18:32.496674+0000","172.21.15.90:6835/2723277392":"2024-09-11T23:18:58.740445+0000","172.21.15.171:6837/3083996658":"2024-09-11T23:18:32.487388+0000","172.21.15.90:6835/4002726882":"2024-09-11T23:18:32.496674+0000","172.21.15.171:6835/3083996658":"2024-09-11T23:18:32.487388+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:19:04.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.823+0000 7fbc37bad640 1 -- 172.21.15.90:0/3850273048 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbc14077f70 msgr2=0x7fbc1407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:04.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.823+0000 7fbc37bad640 1 --2- 172.21.15.90:0/3850273048 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbc14077f70 0x7fbc1407a430 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c005fd0 tx=0x7fbc2c005850 comp rx=0 tx=0).stop 2024-09-10T23:19:04.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.823+0000 7fbc37bad640 1 -- 172.21.15.90:0/3850273048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc300ce960 msgr2=0x7fbc30157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:04.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.823+0000 7fbc37bad640 1 --2- 172.21.15.90:0/3850273048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc300ce960 0x7fbc30157b60 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000c430 tx=0x7fbc2000c8f0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.823+0000 7fbc37bad640 1 -- 172.21.15.90:0/3850273048 shutdown_connections 2024-09-10T23:19:04.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.823+0000 7fbc37bad640 1 --2- 172.21.15.90:0/3850273048 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fbc14077f70 0x7fbc1407a430 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.823+0000 7fbc37bad640 1 --2- 172.21.15.90:0/3850273048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc300d2a70 0x7fbc3015c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.823+0000 7fbc37bad640 1 --2- 172.21.15.90:0/3850273048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc300ce960 0x7fbc30157b60 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.823+0000 7fbc37bad640 1 --2- 172.21.15.90:0/3850273048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc300cd990 0x7fbc300cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:04.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.823+0000 7fbc37bad640 1 -- 172.21.15.90:0/3850273048 >> 172.21.15.90:0/3850273048 conn(0x7fbc300d1f50 msgr2=0x7fbc300b58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:04.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.823+0000 7fbc37bad640 1 -- 172.21.15.90:0/3850273048 shutdown_connections 2024-09-10T23:19:04.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:04.823+0000 7fbc37bad640 1 -- 172.21.15.90:0/3850273048 wait complete. 2024-09-10T23:19:05.836 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T23:19:05.836 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T23:19:05.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.955+0000 7f60b916b640 1 -- 172.21.15.90:0/395210385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60b40b2f40 msgr2=0x7f60b40d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.955+0000 7f60b916b640 1 --2- 172.21.15.90:0/395210385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60b40b2f40 0x7f60b40d0630 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f60b406d830 tx=0x7f60a402a560 comp rx=0 tx=0).stop 2024-09-10T23:19:05.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.955+0000 7f60b916b640 1 -- 172.21.15.90:0/395210385 shutdown_connections 2024-09-10T23:19:05.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.955+0000 7f60b916b640 1 --2- 172.21.15.90:0/395210385 >> v2:172.21.15.171:3300/0 conn(0x7f60b40b3320 0x7f60b40ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.955+0000 7f60b916b640 1 --2- 172.21.15.90:0/395210385 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60b40b2f40 0x7f60b40d0630 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.955+0000 7f60b916b640 1 -- 172.21.15.90:0/395210385 >> 172.21.15.90:0/395210385 conn(0x7f60b40b3b40 msgr2=0x7f60b40b3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:05.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.955+0000 7f60b916b640 1 -- 172.21.15.90:0/395210385 shutdown_connections 2024-09-10T23:19:05.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.955+0000 7f60b916b640 1 -- 172.21.15.90:0/395210385 wait complete. 2024-09-10T23:19:05.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.956+0000 7f60b916b640 1 Processor -- start 2024-09-10T23:19:05.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.956+0000 7f60b916b640 1 -- start start 2024-09-10T23:19:05.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.957+0000 7f60b916b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60b40b0f00 0x7f60b41f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:05.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.957+0000 7f60b916b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60b40b2f40 0x7f60b41f8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:05.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.957+0000 7f60b916b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60b40b3320 0x7f60b4156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:05.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.957+0000 7f60b916b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f60b40d0c60 con 0x7f60b40b2f40 2024-09-10T23:19:05.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.957+0000 7f60b916b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f60b40b1660 con 0x7f60b40b0f00 2024-09-10T23:19:05.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.957+0000 7f60b916b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f60b415ff30 con 0x7f60b40b3320 2024-09-10T23:19:05.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.957+0000 7f60b259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60b40b2f40 0x7f60b41f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:05.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.957+0000 7f60b259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60b40b2f40 0x7f60b41f8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36336/0 (socket says 172.21.15.90:36336) 2024-09-10T23:19:05.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.957+0000 7f60b259c640 1 -- 172.21.15.90:0/3825822624 learned_addr learned my addr 172.21.15.90:0/3825822624 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:05.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.957+0000 7f60b2d9d640 1 --2- 172.21.15.90:0/3825822624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60b40b0f00 0x7f60b41f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:05.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.957+0000 7f60b359e640 1 --2- 172.21.15.90:0/3825822624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60b40b3320 0x7f60b4156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:05.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.958+0000 7f60b259c640 1 -- 172.21.15.90:0/3825822624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60b40b3320 msgr2=0x7f60b4156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.958+0000 7f60b259c640 1 --2- 172.21.15.90:0/3825822624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60b40b3320 0x7f60b4156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.958+0000 7f60b259c640 1 -- 172.21.15.90:0/3825822624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60b40b0f00 msgr2=0x7f60b41f58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.958+0000 7f60b259c640 1 --2- 172.21.15.90:0/3825822624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60b40b0f00 0x7f60b41f58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.958+0000 7f60b259c640 1 -- 172.21.15.90:0/3825822624 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b406e210 con 0x7f60b40b2f40 2024-09-10T23:19:05.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.958+0000 7f60b2d9d640 1 --2- 172.21.15.90:0/3825822624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60b40b0f00 0x7f60b41f58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:05.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.958+0000 7f60b359e640 1 --2- 172.21.15.90:0/3825822624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60b40b3320 0x7f60b4156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:05.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.958+0000 7f60b259c640 1 --2- 172.21.15.90:0/3825822624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60b40b2f40 0x7f60b41f8bf0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f60a800c430 tx=0x7f60a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:05.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.958+0000 7f609b7fe640 1 -- 172.21.15.90:0/3825822624 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8017070 con 0x7f60b40b2f40 2024-09-10T23:19:05.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.958+0000 7f609b7fe640 1 -- 172.21.15.90:0/3825822624 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60a80035f0 con 0x7f60b40b2f40 2024-09-10T23:19:05.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.958+0000 7f60b916b640 1 -- 172.21.15.90:0/3825822624 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b406e4f0 con 0x7f60b40b2f40 2024-09-10T23:19:05.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.958+0000 7f609b7fe640 1 -- 172.21.15.90:0/3825822624 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8003a40 con 0x7f60b40b2f40 2024-09-10T23:19:05.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.958+0000 7f60b916b640 1 -- 172.21.15.90:0/3825822624 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b41f8410 con 0x7f60b40b2f40 2024-09-10T23:19:05.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.959+0000 7f60b916b640 1 -- 172.21.15.90:0/3825822624 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f60b40d0630 con 0x7f60b40b2f40 2024-09-10T23:19:05.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.960+0000 7f609b7fe640 1 -- 172.21.15.90:0/3825822624 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f60a8003be0 con 0x7f60b40b2f40 2024-09-10T23:19:05.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.960+0000 7f609b7fe640 1 --2- 172.21.15.90:0/3825822624 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f60a0077f70 0x7f60a007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:05.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.961+0000 7f609b7fe640 1 -- 172.21.15.90:0/3825822624 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7f60a8099cb0 con 0x7f60b40b2f40 2024-09-10T23:19:05.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.961+0000 7f609b7fe640 1 --2- 172.21.15.90:0/3825822624 >> [v2:172.21.15.90:6800/1564469617,v1:172.21.15.90:6801/1564469617] conn(0x7f60a007e0b0 0x7f60a00804d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:05.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.961+0000 7f609b7fe640 1 -- 172.21.15.90:0/3825822624 --> [v2:172.21.15.90:6800/1564469617,v1:172.21.15.90:6801/1564469617] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f60a8016ec0 con 0x7f60a007e0b0 2024-09-10T23:19:05.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.961+0000 7f609b7fe640 1 -- 172.21.15.90:0/3825822624 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) ==== 24+0+0 (secure 0 0 0) 0x7f60a809a140 con 0x7f60b40b2f40 2024-09-10T23:19:05.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.961+0000 7f60b2d9d640 1 --2- 172.21.15.90:0/3825822624 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f60a0077f70 0x7f60a007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:05.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.961+0000 7f60b359e640 1 --2- 172.21.15.90:0/3825822624 >> [v2:172.21.15.90:6800/1564469617,v1:172.21.15.90:6801/1564469617] conn(0x7f60a007e0b0 0x7f60a00804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:05.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.961+0000 7f60b359e640 1 --2- 172.21.15.90:0/3825822624 >> [v2:172.21.15.90:6800/1564469617,v1:172.21.15.90:6801/1564469617] conn(0x7f60a007e0b0 0x7f60a00804d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:05.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.961+0000 7f60b2d9d640 1 --2- 172.21.15.90:0/3825822624 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f60a0077f70 0x7f60a007a430 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f60a4033000 tx=0x7f60a4004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:05.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.962+0000 7f609b7fe640 1 -- 172.21.15.90:0/3825822624 <== osd.0 v2:172.21.15.90:6800/1564469617 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f60a8016ec0 con 0x7f60a007e0b0 2024-09-10T23:19:05.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.974+0000 7f60b916b640 1 -- 172.21.15.90:0/3825822624 --> [v2:172.21.15.90:6800/1564469617,v1:172.21.15.90:6801/1564469617] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f60b41ea830 con 0x7f60a007e0b0 2024-09-10T23:19:05.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.974+0000 7f609b7fe640 1 -- 172.21.15.90:0/3825822624 <== osd.0 v2:172.21.15.90:6800/1564469617 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f60b41ea830 con 0x7f60a007e0b0 2024-09-10T23:19:05.976 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:19:05.976 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T23:19:05.976 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:19:05.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.975+0000 7f60b916b640 1 -- 172.21.15.90:0/3825822624 >> [v2:172.21.15.90:6800/1564469617,v1:172.21.15.90:6801/1564469617] conn(0x7f60a007e0b0 msgr2=0x7f60a00804d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.975+0000 7f60b916b640 1 --2- 172.21.15.90:0/3825822624 >> [v2:172.21.15.90:6800/1564469617,v1:172.21.15.90:6801/1564469617] conn(0x7f60a007e0b0 0x7f60a00804d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.975+0000 7f60b916b640 1 -- 172.21.15.90:0/3825822624 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f60a0077f70 msgr2=0x7f60a007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.975+0000 7f60b916b640 1 --2- 172.21.15.90:0/3825822624 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f60a0077f70 0x7f60a007a430 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f60a4033000 tx=0x7f60a4004730 comp rx=0 tx=0).stop 2024-09-10T23:19:05.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.975+0000 7f60b916b640 1 -- 172.21.15.90:0/3825822624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60b40b2f40 msgr2=0x7f60b41f8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.975+0000 7f60b916b640 1 --2- 172.21.15.90:0/3825822624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60b40b2f40 0x7f60b41f8bf0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f60a800c430 tx=0x7f60a800c8f0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.975+0000 7f60b359e640 1 -- 172.21.15.90:0/3825822624 reap_dead start 2024-09-10T23:19:05.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.975+0000 7f60b916b640 1 -- 172.21.15.90:0/3825822624 shutdown_connections 2024-09-10T23:19:05.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.975+0000 7f60b916b640 1 -- 172.21.15.90:0/3825822624 >> 172.21.15.90:0/3825822624 conn(0x7f60b40b3b40 msgr2=0x7f60b40aed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:05.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.975+0000 7f60b916b640 1 -- 172.21.15.90:0/3825822624 shutdown_connections 2024-09-10T23:19:05.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:05.975+0000 7f60b916b640 1 -- 172.21.15.90:0/3825822624 wait complete. 2024-09-10T23:19:05.986 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T23:19:06.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.090+0000 7fa09f9c2640 1 -- 172.21.15.90:0/1364943051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0980d4d00 msgr2=0x7fa0980d2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.090+0000 7fa09f9c2640 1 --2- 172.21.15.90:0/1364943051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0980d4d00 0x7fa0980d2790 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fa09808e6d0 tx=0x7fa08c02a4d0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.090+0000 7fa09f9c2640 1 -- 172.21.15.90:0/1364943051 shutdown_connections 2024-09-10T23:19:06.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.090+0000 7fa09f9c2640 1 --2- 172.21.15.90:0/1364943051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0980d4d00 0x7fa0980d2790 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.090+0000 7fa09f9c2640 1 --2- 172.21.15.90:0/1364943051 >> v2:172.21.15.171:3300/0 conn(0x7fa0981616c0 0x7fa0980d2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.090+0000 7fa09f9c2640 1 -- 172.21.15.90:0/1364943051 >> 172.21.15.90:0/1364943051 conn(0x7fa0980d41e0 msgr2=0x7fa0980d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:06.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.090+0000 7fa09f9c2640 1 -- 172.21.15.90:0/1364943051 shutdown_connections 2024-09-10T23:19:06.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.090+0000 7fa09f9c2640 1 -- 172.21.15.90:0/1364943051 wait complete. 2024-09-10T23:19:06.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.091+0000 7fa09f9c2640 1 Processor -- start 2024-09-10T23:19:06.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.091+0000 7fa09f9c2640 1 -- start start 2024-09-10T23:19:06.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.092+0000 7fa09f9c2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0980d4d00 0x7fa0980b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.092+0000 7fa09f9c2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0981616c0 0x7fa0981f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.092+0000 7fa09f9c2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa098161aa0 0x7fa0981f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.092+0000 7fa09f9c2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa09806e8f0 con 0x7fa0980d4d00 2024-09-10T23:19:06.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.092+0000 7fa09f9c2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa09806e770 con 0x7fa0981616c0 2024-09-10T23:19:06.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.092+0000 7fa09f9c2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa09806ea70 con 0x7fa098161aa0 2024-09-10T23:19:06.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.092+0000 7fa09d75e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0980d4d00 0x7fa0980b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.092+0000 7fa09d75e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0980d4d00 0x7fa0980b6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36342/0 (socket says 172.21.15.90:36342) 2024-09-10T23:19:06.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.092+0000 7fa09d75e640 1 -- 172.21.15.90:0/633711131 learned_addr learned my addr 172.21.15.90:0/633711131 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:06.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.092+0000 7fa09cf5d640 1 --2- 172.21.15.90:0/633711131 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0981616c0 0x7fa0981f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.092+0000 7fa09df5f640 1 --2- 172.21.15.90:0/633711131 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa098161aa0 0x7fa0981f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.093+0000 7fa09d75e640 1 -- 172.21.15.90:0/633711131 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa098161aa0 msgr2=0x7fa0981f4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.093+0000 7fa09d75e640 1 --2- 172.21.15.90:0/633711131 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa098161aa0 0x7fa0981f4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.093+0000 7fa09d75e640 1 -- 172.21.15.90:0/633711131 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0981616c0 msgr2=0x7fa0981f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.093+0000 7fa09d75e640 1 --2- 172.21.15.90:0/633711131 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0981616c0 0x7fa0981f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.093+0000 7fa09d75e640 1 -- 172.21.15.90:0/633711131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0981f5820 con 0x7fa0980d4d00 2024-09-10T23:19:06.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.093+0000 7fa09df5f640 1 --2- 172.21.15.90:0/633711131 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa098161aa0 0x7fa0981f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:06.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.093+0000 7fa09d75e640 1 --2- 172.21.15.90:0/633711131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0980d4d00 0x7fa0980b6440 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fa09400c920 tx=0x7fa09400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.093+0000 7fa089ffb640 1 -- 172.21.15.90:0/633711131 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa094007c70 con 0x7fa0980d4d00 2024-09-10T23:19:06.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.093+0000 7fa089ffb640 1 -- 172.21.15.90:0/633711131 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa09400f450 con 0x7fa0980d4d00 2024-09-10T23:19:06.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.093+0000 7fa09f9c2640 1 -- 172.21.15.90:0/633711131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0981f5b00 con 0x7fa0980d4d00 2024-09-10T23:19:06.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.093+0000 7fa089ffb640 1 -- 172.21.15.90:0/633711131 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09400f8a0 con 0x7fa0980d4d00 2024-09-10T23:19:06.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.093+0000 7fa09f9c2640 1 -- 172.21.15.90:0/633711131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0981f6420 con 0x7fa0980d4d00 2024-09-10T23:19:06.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.094+0000 7fa09f9c2640 1 -- 172.21.15.90:0/633711131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa098154fe0 con 0x7fa0980d4d00 2024-09-10T23:19:06.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.095+0000 7fa089ffb640 1 -- 172.21.15.90:0/633711131 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa09400fa40 con 0x7fa0980d4d00 2024-09-10T23:19:06.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.095+0000 7fa089ffb640 1 --2- 172.21.15.90:0/633711131 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa07c077f70 0x7fa07c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.095+0000 7fa089ffb640 1 -- 172.21.15.90:0/633711131 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7fa09409a440 con 0x7fa0980d4d00 2024-09-10T23:19:06.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.096+0000 7fa09cf5d640 1 --2- 172.21.15.90:0/633711131 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa07c077f70 0x7fa07c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.096+0000 7fa09cf5d640 1 --2- 172.21.15.90:0/633711131 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa07c077f70 0x7fa07c07a430 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa08c033000 tx=0x7fa08c004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.104+0000 7fa089ffb640 1 -- 172.21.15.90:0/633711131 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa094014030 con 0x7fa0980d4d00 2024-09-10T23:19:06.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.286+0000 7fa09f9c2640 1 -- 172.21.15.90:0/633711131 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fa09806d6d0 con 0x7fa07c077f70 2024-09-10T23:19:06.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.287+0000 7fa089ffb640 1 -- 172.21.15.90:0/633711131 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa09806d6d0 con 0x7fa07c077f70 2024-09-10T23:19:06.288 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T23:19:06.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.289+0000 7fa09f9c2640 1 -- 172.21.15.90:0/633711131 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa07c077f70 msgr2=0x7fa07c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.289+0000 7fa09f9c2640 1 --2- 172.21.15.90:0/633711131 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa07c077f70 0x7fa07c07a430 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa08c033000 tx=0x7fa08c004730 comp rx=0 tx=0).stop 2024-09-10T23:19:06.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.289+0000 7fa09f9c2640 1 -- 172.21.15.90:0/633711131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0980d4d00 msgr2=0x7fa0980b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.289+0000 7fa09f9c2640 1 --2- 172.21.15.90:0/633711131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0980d4d00 0x7fa0980b6440 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fa09400c920 tx=0x7fa09400cde0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.289+0000 7fa09f9c2640 1 -- 172.21.15.90:0/633711131 shutdown_connections 2024-09-10T23:19:06.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.289+0000 7fa09f9c2640 1 --2- 172.21.15.90:0/633711131 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa07c077f70 0x7fa07c07a430 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.289+0000 7fa09f9c2640 1 --2- 172.21.15.90:0/633711131 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0981616c0 0x7fa0981f25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.289+0000 7fa09f9c2640 1 --2- 172.21.15.90:0/633711131 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa098161aa0 0x7fa0981f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.289+0000 7fa09f9c2640 1 --2- 172.21.15.90:0/633711131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0980d4d00 0x7fa0980b6440 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.289+0000 7fa09f9c2640 1 -- 172.21.15.90:0/633711131 >> 172.21.15.90:0/633711131 conn(0x7fa0980d41e0 msgr2=0x7fa09815cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:06.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.289+0000 7fa09f9c2640 1 -- 172.21.15.90:0/633711131 shutdown_connections 2024-09-10T23:19:06.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.290+0000 7fa09f9c2640 1 -- 172.21.15.90:0/633711131 wait complete. 2024-09-10T23:19:06.301 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T23:19:06.301 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T23:19:06.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.409+0000 7f5643e16640 1 -- 172.21.15.90:0/1836802287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f563c0b5850 msgr2=0x7f563c0d27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.409+0000 7f5643e16640 1 --2- 172.21.15.90:0/1836802287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f563c0b5850 0x7f563c0d27d0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f563c0b6d20 tx=0x7f562c02a440 comp rx=0 tx=0).stop 2024-09-10T23:19:06.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.409+0000 7f5643e16640 1 -- 172.21.15.90:0/1836802287 shutdown_connections 2024-09-10T23:19:06.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.409+0000 7f5643e16640 1 --2- 172.21.15.90:0/1836802287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f563c0b5850 0x7f563c0d27d0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.409+0000 7f5643e16640 1 --2- 172.21.15.90:0/1836802287 >> v2:172.21.15.171:3300/0 conn(0x7f563c15e2e0 0x7f563c0b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.409+0000 7f5643e16640 1 -- 172.21.15.90:0/1836802287 >> 172.21.15.90:0/1836802287 conn(0x7f563c074c20 msgr2=0x7f563c09d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:06.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.409+0000 7f5643e16640 1 -- 172.21.15.90:0/1836802287 shutdown_connections 2024-09-10T23:19:06.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.409+0000 7f5643e16640 1 -- 172.21.15.90:0/1836802287 wait complete. 2024-09-10T23:19:06.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.410+0000 7f5643e16640 1 Processor -- start 2024-09-10T23:19:06.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.410+0000 7f5643e16640 1 -- start start 2024-09-10T23:19:06.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f5643e16640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f563c0b5850 0x7f563c15b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f5643e16640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f563c0d4090 0x7f563c15e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f5643e16640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f563c15e2e0 0x7f563c1f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f5643e16640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f563c0d4990 con 0x7f563c15e2e0 2024-09-10T23:19:06.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f5643e16640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f563c0d4810 con 0x7f563c0b5850 2024-09-10T23:19:06.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f5643e16640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f563c0d10e0 con 0x7f563c0d4090 2024-09-10T23:19:06.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f56423b3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f563c15e2e0 0x7f563c1f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f56423b3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f563c15e2e0 0x7f563c1f4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36364/0 (socket says 172.21.15.90:36364) 2024-09-10T23:19:06.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f56423b3640 1 -- 172.21.15.90:0/689676559 learned_addr learned my addr 172.21.15.90:0/689676559 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:06.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f56413b1640 1 --2- 172.21.15.90:0/689676559 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f563c0d4090 0x7f563c15e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f5641bb2640 1 --2- 172.21.15.90:0/689676559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f563c0b5850 0x7f563c15b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f56423b3640 1 -- 172.21.15.90:0/689676559 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f563c0d4090 msgr2=0x7f563c15e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f56423b3640 1 --2- 172.21.15.90:0/689676559 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f563c0d4090 0x7f563c15e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f56423b3640 1 -- 172.21.15.90:0/689676559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f563c0b5850 msgr2=0x7f563c15b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f56423b3640 1 --2- 172.21.15.90:0/689676559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f563c0b5850 0x7f563c15b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f56423b3640 1 -- 172.21.15.90:0/689676559 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563c15ecb0 con 0x7f563c15e2e0 2024-09-10T23:19:06.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f56423b3640 1 --2- 172.21.15.90:0/689676559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f563c15e2e0 0x7f563c1f4960 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f563400c780 tx=0x7f563400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f56327fc640 1 -- 172.21.15.90:0/689676559 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5634017070 con 0x7f563c15e2e0 2024-09-10T23:19:06.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f56327fc640 1 -- 172.21.15.90:0/689676559 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5634005070 con 0x7f563c15e2e0 2024-09-10T23:19:06.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f5643e16640 1 -- 172.21.15.90:0/689676559 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f563c1f5320 con 0x7f563c15e2e0 2024-09-10T23:19:06.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f56327fc640 1 -- 172.21.15.90:0/689676559 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56340054c0 con 0x7f563c15e2e0 2024-09-10T23:19:06.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.411+0000 7f5643e16640 1 -- 172.21.15.90:0/689676559 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f563c0cb460 con 0x7f563c15e2e0 2024-09-10T23:19:06.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.412+0000 7f5643e16640 1 -- 172.21.15.90:0/689676559 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f563c15bc40 con 0x7f563c15e2e0 2024-09-10T23:19:06.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.413+0000 7f56327fc640 1 -- 172.21.15.90:0/689676559 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5634005660 con 0x7f563c15e2e0 2024-09-10T23:19:06.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.413+0000 7f56327fc640 1 --2- 172.21.15.90:0/689676559 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5620077f70 0x7f562007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.414+0000 7f56327fc640 1 -- 172.21.15.90:0/689676559 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7f5634099c40 con 0x7f563c15e2e0 2024-09-10T23:19:06.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.414+0000 7f5641bb2640 1 --2- 172.21.15.90:0/689676559 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5620077f70 0x7f562007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.414+0000 7f56327fc640 1 --2- 172.21.15.90:0/689676559 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x7f562007e0b0 0x7f56200804d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.414+0000 7f56327fc640 1 -- 172.21.15.90:0/689676559 --> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5620080b80 con 0x7f562007e0b0 2024-09-10T23:19:06.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.414+0000 7f56327fc640 1 -- 172.21.15.90:0/689676559 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) ==== 24+0+0 (secure 0 0 0) 0x7f563409a0d0 con 0x7f563c15e2e0 2024-09-10T23:19:06.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.414+0000 7f56413b1640 1 --2- 172.21.15.90:0/689676559 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x7f562007e0b0 0x7f56200804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.414+0000 7f5641bb2640 1 --2- 172.21.15.90:0/689676559 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5620077f70 0x7f562007a430 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f563800b810 tx=0x7f5638008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.414+0000 7f56413b1640 1 --2- 172.21.15.90:0/689676559 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x7f562007e0b0 0x7f56200804d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.415+0000 7f56327fc640 1 -- 172.21.15.90:0/689676559 <== osd.1 v2:172.21.15.90:6824/165329743 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5620080b80 con 0x7f562007e0b0 2024-09-10T23:19:06.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.427+0000 7f5643e16640 1 -- 172.21.15.90:0/689676559 --> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f563c1f5840 con 0x7f562007e0b0 2024-09-10T23:19:06.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.427+0000 7f56327fc640 1 -- 172.21.15.90:0/689676559 <== osd.1 v2:172.21.15.90:6824/165329743 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f563c1f5840 con 0x7f562007e0b0 2024-09-10T23:19:06.429 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:19:06.429 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T23:19:06.429 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:19:06.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.428+0000 7f5643e16640 1 -- 172.21.15.90:0/689676559 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x7f562007e0b0 msgr2=0x7f56200804d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.428+0000 7f5643e16640 1 --2- 172.21.15.90:0/689676559 >> [v2:172.21.15.90:6824/165329743,v1:172.21.15.90:6825/165329743] conn(0x7f562007e0b0 0x7f56200804d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.428+0000 7f5643e16640 1 -- 172.21.15.90:0/689676559 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5620077f70 msgr2=0x7f562007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.428+0000 7f5643e16640 1 --2- 172.21.15.90:0/689676559 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5620077f70 0x7f562007a430 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f563800b810 tx=0x7f5638008040 comp rx=0 tx=0).stop 2024-09-10T23:19:06.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.428+0000 7f5643e16640 1 -- 172.21.15.90:0/689676559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f563c15e2e0 msgr2=0x7f563c1f4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.428+0000 7f5643e16640 1 --2- 172.21.15.90:0/689676559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f563c15e2e0 0x7f563c1f4960 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f563400c780 tx=0x7f563400cc40 comp rx=0 tx=0).stop 2024-09-10T23:19:06.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.428+0000 7f56423b3640 1 -- 172.21.15.90:0/689676559 reap_dead start 2024-09-10T23:19:06.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.428+0000 7f5643e16640 1 -- 172.21.15.90:0/689676559 shutdown_connections 2024-09-10T23:19:06.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.428+0000 7f5643e16640 1 -- 172.21.15.90:0/689676559 >> 172.21.15.90:0/689676559 conn(0x7f563c074c20 msgr2=0x7f563c06d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:06.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.428+0000 7f5643e16640 1 -- 172.21.15.90:0/689676559 shutdown_connections 2024-09-10T23:19:06.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.428+0000 7f5643e16640 1 -- 172.21.15.90:0/689676559 wait complete. 2024-09-10T23:19:06.439 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T23:19:06.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.544+0000 7fe3e619d640 1 -- 172.21.15.90:0/2569760839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3cc0051c0 msgr2=0x7fe3cc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.544+0000 7fe3e619d640 1 --2- 172.21.15.90:0/2569760839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3cc0051c0 0x7fe3cc00b9c0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8001e40 tx=0x7fe3cc005830 comp rx=0 tx=0).stop 2024-09-10T23:19:06.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.544+0000 7fe3e619d640 1 -- 172.21.15.90:0/2569760839 shutdown_connections 2024-09-10T23:19:06.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.544+0000 7fe3e619d640 1 --2- 172.21.15.90:0/2569760839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3cc0051c0 0x7fe3cc00b9c0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.544+0000 7fe3e619d640 1 -- 172.21.15.90:0/2569760839 >> 172.21.15.90:0/2569760839 conn(0x7fe3e009d230 msgr2=0x7fe3e00d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:06.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.544+0000 7fe3e619d640 1 -- 172.21.15.90:0/2569760839 shutdown_connections 2024-09-10T23:19:06.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.544+0000 7fe3e619d640 1 -- 172.21.15.90:0/2569760839 wait complete. 2024-09-10T23:19:06.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.545+0000 7fe3e619d640 1 Processor -- start 2024-09-10T23:19:06.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.545+0000 7fe3e619d640 1 -- start start 2024-09-10T23:19:06.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.546+0000 7fe3e619d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3cc0051c0 0x7fe3e00c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.546+0000 7fe3e619d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3e0158460 0x7fe3e01588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.546+0000 7fe3e619d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3e015c200 0x7fe3e015c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.546+0000 7fe3e619d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e015e3d0 con 0x7fe3e0158460 2024-09-10T23:19:06.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.546+0000 7fe3e619d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e015e250 con 0x7fe3e015c200 2024-09-10T23:19:06.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.546+0000 7fe3e619d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e00b2f90 con 0x7fe3cc0051c0 2024-09-10T23:19:06.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.546+0000 7fe3e499a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3e0158460 0x7fe3e01588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.546+0000 7fe3e499a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3e0158460 0x7fe3e01588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36380/0 (socket says 172.21.15.90:36380) 2024-09-10T23:19:06.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.546+0000 7fe3e499a640 1 -- 172.21.15.90:0/821829278 learned_addr learned my addr 172.21.15.90:0/821829278 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:06.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.546+0000 7fe3e519b640 1 --2- 172.21.15.90:0/821829278 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3cc0051c0 0x7fe3e00c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.546+0000 7fe3e599c640 1 --2- 172.21.15.90:0/821829278 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3e015c200 0x7fe3e015c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.546+0000 7fe3e499a640 1 -- 172.21.15.90:0/821829278 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3cc0051c0 msgr2=0x7fe3e00c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.546+0000 7fe3e499a640 1 --2- 172.21.15.90:0/821829278 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3cc0051c0 0x7fe3e00c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.546+0000 7fe3e499a640 1 -- 172.21.15.90:0/821829278 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3e015c200 msgr2=0x7fe3e015c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.546+0000 7fe3e499a640 1 --2- 172.21.15.90:0/821829278 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3e015c200 0x7fe3e015c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.546+0000 7fe3e499a640 1 -- 172.21.15.90:0/821829278 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e0158e20 con 0x7fe3e0158460 2024-09-10T23:19:06.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.547+0000 7fe3e499a640 1 --2- 172.21.15.90:0/821829278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3e0158460 0x7fe3e01588e0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0000fd0 tx=0x7fe3d000e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.547+0000 7fe3d5ffb640 1 -- 172.21.15.90:0/821829278 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0015070 con 0x7fe3e0158460 2024-09-10T23:19:06.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.547+0000 7fe3d5ffb640 1 -- 172.21.15.90:0/821829278 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3d00109c0 con 0x7fe3e0158460 2024-09-10T23:19:06.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.547+0000 7fe3e619d640 1 -- 172.21.15.90:0/821829278 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e015cf70 con 0x7fe3e0158460 2024-09-10T23:19:06.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.547+0000 7fe3d5ffb640 1 -- 172.21.15.90:0/821829278 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0010e10 con 0x7fe3e0158460 2024-09-10T23:19:06.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.547+0000 7fe3e619d640 1 -- 172.21.15.90:0/821829278 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e015d530 con 0x7fe3e0158460 2024-09-10T23:19:06.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.548+0000 7fe3e619d640 1 -- 172.21.15.90:0/821829278 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e00d2810 con 0x7fe3e0158460 2024-09-10T23:19:06.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.549+0000 7fe3d5ffb640 1 -- 172.21.15.90:0/821829278 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe3d0011460 con 0x7fe3e0158460 2024-09-10T23:19:06.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.549+0000 7fe3d5ffb640 1 --2- 172.21.15.90:0/821829278 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe3c4077fa0 0x7fe3c407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.549+0000 7fe3d5ffb640 1 -- 172.21.15.90:0/821829278 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7fe3d009a160 con 0x7fe3e0158460 2024-09-10T23:19:06.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.549+0000 7fe3e519b640 1 --2- 172.21.15.90:0/821829278 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe3c4077fa0 0x7fe3c407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.550+0000 7fe3e519b640 1 --2- 172.21.15.90:0/821829278 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe3c4077fa0 0x7fe3c407a460 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009b10 tx=0x7fe3dc005f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.553+0000 7fe3d5ffb640 1 -- 172.21.15.90:0/821829278 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe3e0158e20 con 0x7fe3e0158460 2024-09-10T23:19:06.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.733+0000 7fe3e619d640 1 -- 172.21.15.90:0/821829278 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fe3e0050fc0 con 0x7fe3c4077fa0 2024-09-10T23:19:06.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.734+0000 7fe3d5ffb640 1 -- 172.21.15.90:0/821829278 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe3e0050fc0 con 0x7fe3c4077fa0 2024-09-10T23:19:06.735 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T23:19:06.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.736+0000 7fe3e619d640 1 -- 172.21.15.90:0/821829278 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe3c4077fa0 msgr2=0x7fe3c407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.736+0000 7fe3e619d640 1 --2- 172.21.15.90:0/821829278 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe3c4077fa0 0x7fe3c407a460 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009b10 tx=0x7fe3dc005f90 comp rx=0 tx=0).stop 2024-09-10T23:19:06.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.736+0000 7fe3e619d640 1 -- 172.21.15.90:0/821829278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3e0158460 msgr2=0x7fe3e01588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.736+0000 7fe3e619d640 1 --2- 172.21.15.90:0/821829278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3e0158460 0x7fe3e01588e0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0000fd0 tx=0x7fe3d000e9a0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.736+0000 7fe3e619d640 1 -- 172.21.15.90:0/821829278 shutdown_connections 2024-09-10T23:19:06.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.736+0000 7fe3e619d640 1 --2- 172.21.15.90:0/821829278 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe3c4077fa0 0x7fe3c407a460 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.736+0000 7fe3e619d640 1 --2- 172.21.15.90:0/821829278 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3e015c200 0x7fe3e015c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.736+0000 7fe3e619d640 1 --2- 172.21.15.90:0/821829278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3e0158460 0x7fe3e01588e0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.736+0000 7fe3e619d640 1 --2- 172.21.15.90:0/821829278 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3cc0051c0 0x7fe3e00c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.736+0000 7fe3e619d640 1 -- 172.21.15.90:0/821829278 >> 172.21.15.90:0/821829278 conn(0x7fe3e009d230 msgr2=0x7fe3e006d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:06.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.736+0000 7fe3e619d640 1 -- 172.21.15.90:0/821829278 shutdown_connections 2024-09-10T23:19:06.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.736+0000 7fe3e619d640 1 -- 172.21.15.90:0/821829278 wait complete. 2024-09-10T23:19:06.748 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T23:19:06.748 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T23:19:06.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.854+0000 7effaa8b8640 1 -- 172.21.15.90:0/1343259321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa415e2e0 msgr2=0x7effa40b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.854+0000 7effaa8b8640 1 --2- 172.21.15.90:0/1343259321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa415e2e0 0x7effa40b36c0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7effa40ba280 tx=0x7eff9402a440 comp rx=0 tx=0).stop 2024-09-10T23:19:06.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.854+0000 7effaa8b8640 1 -- 172.21.15.90:0/1343259321 shutdown_connections 2024-09-10T23:19:06.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.854+0000 7effaa8b8640 1 --2- 172.21.15.90:0/1343259321 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effa40d4090 0x7effa40d4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.854+0000 7effaa8b8640 1 --2- 172.21.15.90:0/1343259321 >> v2:172.21.15.171:3300/0 conn(0x7effa40b5850 0x7effa40d27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.854+0000 7effaa8b8640 1 --2- 172.21.15.90:0/1343259321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa415e2e0 0x7effa40b36c0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.854+0000 7effaa8b8640 1 -- 172.21.15.90:0/1343259321 >> 172.21.15.90:0/1343259321 conn(0x7effa4074c20 msgr2=0x7effa409d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:06.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.854+0000 7effaa8b8640 1 -- 172.21.15.90:0/1343259321 shutdown_connections 2024-09-10T23:19:06.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.854+0000 7effaa8b8640 1 -- 172.21.15.90:0/1343259321 wait complete. 2024-09-10T23:19:06.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.855+0000 7effaa8b8640 1 Processor -- start 2024-09-10T23:19:06.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.856+0000 7effaa8b8640 1 -- start start 2024-09-10T23:19:06.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.856+0000 7effaa8b8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effa40b5850 0x7effa4156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.856+0000 7effaa8b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effa40d4090 0x7effa40cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.856+0000 7effaa8b8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa415e2e0 0x7effa40c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.856+0000 7effaa8b8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7effa40d0d60 con 0x7effa415e2e0 2024-09-10T23:19:06.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.856+0000 7effaa8b8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7effa40d0be0 con 0x7effa40b5850 2024-09-10T23:19:06.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.856+0000 7effaa8b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7effa40d0ee0 con 0x7effa40d4090 2024-09-10T23:19:06.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.856+0000 7effa8e55640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa415e2e0 0x7effa40c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.856+0000 7effa8e55640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa415e2e0 0x7effa40c9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36406/0 (socket says 172.21.15.90:36406) 2024-09-10T23:19:06.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.856+0000 7effa8e55640 1 -- 172.21.15.90:0/3129339058 learned_addr learned my addr 172.21.15.90:0/3129339058 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:06.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.856+0000 7effa3fff640 1 --2- 172.21.15.90:0/3129339058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effa40b5850 0x7effa4156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.856+0000 7effa37fe640 1 --2- 172.21.15.90:0/3129339058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effa40d4090 0x7effa40cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.857+0000 7effa8e55640 1 -- 172.21.15.90:0/3129339058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effa40d4090 msgr2=0x7effa40cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.857+0000 7effa8e55640 1 --2- 172.21.15.90:0/3129339058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effa40d4090 0x7effa40cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.857+0000 7effa8e55640 1 -- 172.21.15.90:0/3129339058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effa40b5850 msgr2=0x7effa4156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.857+0000 7effa8e55640 1 --2- 172.21.15.90:0/3129339058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effa40b5850 0x7effa4156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.857+0000 7effa8e55640 1 -- 172.21.15.90:0/3129339058 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa4156570 con 0x7effa415e2e0 2024-09-10T23:19:06.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.857+0000 7effa8e55640 1 --2- 172.21.15.90:0/3129339058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa415e2e0 0x7effa40c9c30 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00eaa0 tx=0x7eff9c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.857+0000 7effa0ff9640 1 -- 172.21.15.90:0/3129339058 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c00cdb0 con 0x7effa415e2e0 2024-09-10T23:19:06.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.857+0000 7effa0ff9640 1 -- 172.21.15.90:0/3129339058 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff9c004c10 con 0x7effa415e2e0 2024-09-10T23:19:06.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.857+0000 7effaa8b8640 1 -- 172.21.15.90:0/3129339058 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa40c89b0 con 0x7effa415e2e0 2024-09-10T23:19:06.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.857+0000 7effa0ff9640 1 -- 172.21.15.90:0/3129339058 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c005020 con 0x7effa415e2e0 2024-09-10T23:19:06.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.857+0000 7effaa8b8640 1 -- 172.21.15.90:0/3129339058 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa40c8f70 con 0x7effa415e2e0 2024-09-10T23:19:06.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.858+0000 7effaa8b8640 1 -- 172.21.15.90:0/3129339058 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7effa40b30c0 con 0x7effa415e2e0 2024-09-10T23:19:06.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.859+0000 7effa0ff9640 1 -- 172.21.15.90:0/3129339058 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7eff9c00f040 con 0x7effa415e2e0 2024-09-10T23:19:06.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.859+0000 7effa0ff9640 1 --2- 172.21.15.90:0/3129339058 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff84077f70 0x7eff8407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.859+0000 7effa0ff9640 1 -- 172.21.15.90:0/3129339058 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7eff9c09a5f0 con 0x7effa415e2e0 2024-09-10T23:19:06.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.860+0000 7effa0ff9640 1 --2- 172.21.15.90:0/3129339058 >> [v2:172.21.15.90:6816/2119406419,v1:172.21.15.90:6817/2119406419] conn(0x7eff8407e0b0 0x7eff840804d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.860+0000 7effa0ff9640 1 -- 172.21.15.90:0/3129339058 --> [v2:172.21.15.90:6816/2119406419,v1:172.21.15.90:6817/2119406419] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff9c024e50 con 0x7eff8407e0b0 2024-09-10T23:19:06.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.860+0000 7effa3fff640 1 --2- 172.21.15.90:0/3129339058 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff84077f70 0x7eff8407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.860+0000 7effa0ff9640 1 -- 172.21.15.90:0/3129339058 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) ==== 24+0+0 (secure 0 0 0) 0x7eff9c09aa80 con 0x7effa415e2e0 2024-09-10T23:19:06.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.860+0000 7effa37fe640 1 --2- 172.21.15.90:0/3129339058 >> [v2:172.21.15.90:6816/2119406419,v1:172.21.15.90:6817/2119406419] conn(0x7eff8407e0b0 0x7eff840804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.860+0000 7effa37fe640 1 --2- 172.21.15.90:0/3129339058 >> [v2:172.21.15.90:6816/2119406419,v1:172.21.15.90:6817/2119406419] conn(0x7eff8407e0b0 0x7eff840804d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.860+0000 7effa3fff640 1 --2- 172.21.15.90:0/3129339058 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff84077f70 0x7eff8407a430 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7eff94033000 tx=0x7eff94004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.861+0000 7effa0ff9640 1 -- 172.21.15.90:0/3129339058 <== osd.2 v2:172.21.15.90:6816/2119406419 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff9c024e50 con 0x7eff8407e0b0 2024-09-10T23:19:06.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.873+0000 7effaa8b8640 1 -- 172.21.15.90:0/3129339058 --> [v2:172.21.15.90:6816/2119406419,v1:172.21.15.90:6817/2119406419] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7effa40d4540 con 0x7eff8407e0b0 2024-09-10T23:19:06.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.873+0000 7effa0ff9640 1 -- 172.21.15.90:0/3129339058 <== osd.2 v2:172.21.15.90:6816/2119406419 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7effa40d4540 con 0x7eff8407e0b0 2024-09-10T23:19:06.874 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:19:06.874 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T23:19:06.874 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:19:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.873+0000 7effaa8b8640 1 -- 172.21.15.90:0/3129339058 >> [v2:172.21.15.90:6816/2119406419,v1:172.21.15.90:6817/2119406419] conn(0x7eff8407e0b0 msgr2=0x7eff840804d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.873+0000 7effaa8b8640 1 --2- 172.21.15.90:0/3129339058 >> [v2:172.21.15.90:6816/2119406419,v1:172.21.15.90:6817/2119406419] conn(0x7eff8407e0b0 0x7eff840804d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.873+0000 7effaa8b8640 1 -- 172.21.15.90:0/3129339058 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff84077f70 msgr2=0x7eff8407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.873+0000 7effaa8b8640 1 --2- 172.21.15.90:0/3129339058 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff84077f70 0x7eff8407a430 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7eff94033000 tx=0x7eff94004730 comp rx=0 tx=0).stop 2024-09-10T23:19:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.873+0000 7effaa8b8640 1 -- 172.21.15.90:0/3129339058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa415e2e0 msgr2=0x7effa40c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.873+0000 7effaa8b8640 1 --2- 172.21.15.90:0/3129339058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa415e2e0 0x7effa40c9c30 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00eaa0 tx=0x7eff9c00ef60 comp rx=0 tx=0).stop 2024-09-10T23:19:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.873+0000 7effa8e55640 1 -- 172.21.15.90:0/3129339058 reap_dead start 2024-09-10T23:19:06.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.874+0000 7effaa8b8640 1 -- 172.21.15.90:0/3129339058 shutdown_connections 2024-09-10T23:19:06.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.874+0000 7effaa8b8640 1 -- 172.21.15.90:0/3129339058 >> 172.21.15.90:0/3129339058 conn(0x7effa4074c20 msgr2=0x7effa40ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:06.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.874+0000 7effaa8b8640 1 -- 172.21.15.90:0/3129339058 shutdown_connections 2024-09-10T23:19:06.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.874+0000 7effaa8b8640 1 -- 172.21.15.90:0/3129339058 wait complete. 2024-09-10T23:19:06.885 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T23:19:06.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.987+0000 7f4415b3d640 1 -- 172.21.15.90:0/3261631829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44100d4d00 msgr2=0x7f44100d2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.987+0000 7f4415b3d640 1 --2- 172.21.15.90:0/3261631829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44100d4d00 0x7f44100d2790 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f441008e6d0 tx=0x7f43f802a4d0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.987+0000 7f4415b3d640 1 -- 172.21.15.90:0/3261631829 shutdown_connections 2024-09-10T23:19:06.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.987+0000 7f4415b3d640 1 --2- 172.21.15.90:0/3261631829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44100d4d00 0x7f44100d2790 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.987+0000 7f4415b3d640 1 --2- 172.21.15.90:0/3261631829 >> v2:172.21.15.171:3300/0 conn(0x7f44101616c0 0x7f44100d2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.987+0000 7f4415b3d640 1 -- 172.21.15.90:0/3261631829 >> 172.21.15.90:0/3261631829 conn(0x7f44100d41e0 msgr2=0x7f44100d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:06.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.987+0000 7f4415b3d640 1 -- 172.21.15.90:0/3261631829 shutdown_connections 2024-09-10T23:19:06.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.987+0000 7f4415b3d640 1 -- 172.21.15.90:0/3261631829 wait complete. 2024-09-10T23:19:06.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.988+0000 7f4415b3d640 1 Processor -- start 2024-09-10T23:19:06.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.989+0000 7f4415b3d640 1 -- start start 2024-09-10T23:19:06.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.989+0000 7f4415b3d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44100d4d00 0x7f44100d1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.989+0000 7f4415b3d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44101616c0 0x7f44100cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.989+0000 7f4415b3d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4410161aa0 0x7f44101f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.989+0000 7f4415b3d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f441006e8f0 con 0x7f4410161aa0 2024-09-10T23:19:06.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.989+0000 7f4415b3d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f441006e770 con 0x7f44100d4d00 2024-09-10T23:19:06.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.989+0000 7f4415b3d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f441006ea70 con 0x7f44101616c0 2024-09-10T23:19:06.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.989+0000 7f440ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4410161aa0 0x7f44101f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.989+0000 7f440ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4410161aa0 0x7f44101f40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36428/0 (socket says 172.21.15.90:36428) 2024-09-10T23:19:06.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.989+0000 7f440ffff640 1 -- 172.21.15.90:0/2122310730 learned_addr learned my addr 172.21.15.90:0/2122310730 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:06.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.989+0000 7f440f7fe640 1 --2- 172.21.15.90:0/2122310730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44100d4d00 0x7f44100d1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.989+0000 7f4406ffd640 1 --2- 172.21.15.90:0/2122310730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44101616c0 0x7f44100cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.990+0000 7f440ffff640 1 -- 172.21.15.90:0/2122310730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44101616c0 msgr2=0x7f44100cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.990+0000 7f440ffff640 1 --2- 172.21.15.90:0/2122310730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44101616c0 0x7f44100cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.990+0000 7f440ffff640 1 -- 172.21.15.90:0/2122310730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44100d4d00 msgr2=0x7f44100d1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.990+0000 7f440ffff640 1 --2- 172.21.15.90:0/2122310730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44100d4d00 0x7f44100d1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.990+0000 7f440ffff640 1 -- 172.21.15.90:0/2122310730 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44101f82d0 con 0x7f4410161aa0 2024-09-10T23:19:06.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.990+0000 7f440ffff640 1 --2- 172.21.15.90:0/2122310730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4410161aa0 0x7f44101f40b0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f440800b970 tx=0x7f440800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.990+0000 7f440cff9640 1 -- 172.21.15.90:0/2122310730 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4408019070 con 0x7f4410161aa0 2024-09-10T23:19:06.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.990+0000 7f440cff9640 1 -- 172.21.15.90:0/2122310730 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f440800cc30 con 0x7f4410161aa0 2024-09-10T23:19:06.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.990+0000 7f4415b3d640 1 -- 172.21.15.90:0/2122310730 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44101f85b0 con 0x7f4410161aa0 2024-09-10T23:19:06.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.990+0000 7f440cff9640 1 -- 172.21.15.90:0/2122310730 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44080146a0 con 0x7f4410161aa0 2024-09-10T23:19:06.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.990+0000 7f4415b3d640 1 -- 172.21.15.90:0/2122310730 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44100d19d0 con 0x7f4410161aa0 2024-09-10T23:19:06.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.991+0000 7f4415b3d640 1 -- 172.21.15.90:0/2122310730 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f441006d6d0 con 0x7f4410161aa0 2024-09-10T23:19:06.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.992+0000 7f440cff9640 1 -- 172.21.15.90:0/2122310730 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f440801e440 con 0x7f4410161aa0 2024-09-10T23:19:06.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.992+0000 7f440cff9640 1 --2- 172.21.15.90:0/2122310730 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f43f0077f70 0x7f43f007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.993+0000 7f440cff9640 1 -- 172.21.15.90:0/2122310730 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7f4408099a30 con 0x7f4410161aa0 2024-09-10T23:19:06.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.993+0000 7f440f7fe640 1 --2- 172.21.15.90:0/2122310730 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f43f0077f70 0x7f43f007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.993+0000 7f440f7fe640 1 --2- 172.21.15.90:0/2122310730 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f43f0077f70 0x7f43f007a430 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f44100d11d0 tx=0x7f440000b390 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:06.996+0000 7f440cff9640 1 -- 172.21.15.90:0/2122310730 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f44080620b0 con 0x7f4410161aa0 2024-09-10T23:19:07.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.180+0000 7f4415b3d640 1 -- 172.21.15.90:0/2122310730 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f4410074c20 con 0x7f43f0077f70 2024-09-10T23:19:07.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.181+0000 7f440cff9640 1 -- 172.21.15.90:0/2122310730 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4410074c20 con 0x7f43f0077f70 2024-09-10T23:19:07.182 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T23:19:07.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.183+0000 7f4415b3d640 1 -- 172.21.15.90:0/2122310730 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f43f0077f70 msgr2=0x7f43f007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.183+0000 7f4415b3d640 1 --2- 172.21.15.90:0/2122310730 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f43f0077f70 0x7f43f007a430 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f44100d11d0 tx=0x7f440000b390 comp rx=0 tx=0).stop 2024-09-10T23:19:07.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.183+0000 7f4415b3d640 1 -- 172.21.15.90:0/2122310730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4410161aa0 msgr2=0x7f44101f40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.183+0000 7f4415b3d640 1 --2- 172.21.15.90:0/2122310730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4410161aa0 0x7f44101f40b0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f440800b970 tx=0x7f440800be30 comp rx=0 tx=0).stop 2024-09-10T23:19:07.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.183+0000 7f4415b3d640 1 -- 172.21.15.90:0/2122310730 shutdown_connections 2024-09-10T23:19:07.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.183+0000 7f4415b3d640 1 --2- 172.21.15.90:0/2122310730 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f43f0077f70 0x7f43f007a430 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.183+0000 7f4415b3d640 1 --2- 172.21.15.90:0/2122310730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4410161aa0 0x7f44101f40b0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.183+0000 7f4415b3d640 1 --2- 172.21.15.90:0/2122310730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44101616c0 0x7f44100cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.183+0000 7f4415b3d640 1 --2- 172.21.15.90:0/2122310730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44100d4d00 0x7f44100d1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.183+0000 7f4415b3d640 1 -- 172.21.15.90:0/2122310730 >> 172.21.15.90:0/2122310730 conn(0x7f44100d41e0 msgr2=0x7f441015fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:07.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.183+0000 7f4415b3d640 1 -- 172.21.15.90:0/2122310730 shutdown_connections 2024-09-10T23:19:07.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.183+0000 7f4415b3d640 1 -- 172.21.15.90:0/2122310730 wait complete. 2024-09-10T23:19:07.195 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T23:19:07.195 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T23:19:07.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.299+0000 7f2978b10640 1 -- 172.21.15.90:0/1065989858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f297415a600 msgr2=0x7f29740cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.299+0000 7f2978b10640 1 --2- 172.21.15.90:0/1065989858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f297415a600 0x7f29740cf3e0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f296c005fd0 tx=0x7f296c02aa50 comp rx=0 tx=0).stop 2024-09-10T23:19:07.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.299+0000 7f2978b10640 1 -- 172.21.15.90:0/1065989858 shutdown_connections 2024-09-10T23:19:07.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.299+0000 7f2978b10640 1 --2- 172.21.15.90:0/1065989858 >> v2:172.21.15.171:3300/0 conn(0x7f29740af300 0x7f297406ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.299+0000 7f2978b10640 1 --2- 172.21.15.90:0/1065989858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f297415a600 0x7f29740cf3e0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.299+0000 7f2978b10640 1 -- 172.21.15.90:0/1065989858 >> 172.21.15.90:0/1065989858 conn(0x7f29740cfea0 msgr2=0x7f29740d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:07.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.299+0000 7f2978b10640 1 -- 172.21.15.90:0/1065989858 shutdown_connections 2024-09-10T23:19:07.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.299+0000 7f2978b10640 1 -- 172.21.15.90:0/1065989858 wait complete. 2024-09-10T23:19:07.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.301+0000 7f2978b10640 1 Processor -- start 2024-09-10T23:19:07.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.301+0000 7f2978b10640 1 -- start start 2024-09-10T23:19:07.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.301+0000 7f2978b10640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f297406fcc0 0x7f297414a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.301+0000 7f2978b10640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29740af300 0x7f297415bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f2978b10640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f297415a600 0x7f297415c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f2978b10640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f297406f740 con 0x7f297406fcc0 2024-09-10T23:19:07.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f2978b10640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f297406f5c0 con 0x7f297415a600 2024-09-10T23:19:07.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f2978b10640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f297415abd0 con 0x7f29740af300 2024-09-10T23:19:07.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f297259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f297406fcc0 0x7f297414a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f297259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f297406fcc0 0x7f297414a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36450/0 (socket says 172.21.15.90:36450) 2024-09-10T23:19:07.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f297259c640 1 -- 172.21.15.90:0/1287453115 learned_addr learned my addr 172.21.15.90:0/1287453115 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:07.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f2972d9d640 1 --2- 172.21.15.90:0/1287453115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f297415a600 0x7f297415c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f2971d9b640 1 --2- 172.21.15.90:0/1287453115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29740af300 0x7f297415bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f297259c640 1 -- 172.21.15.90:0/1287453115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29740af300 msgr2=0x7f297415bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f297259c640 1 --2- 172.21.15.90:0/1287453115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29740af300 0x7f297415bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f297259c640 1 -- 172.21.15.90:0/1287453115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f297415a600 msgr2=0x7f297415c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f297259c640 1 --2- 172.21.15.90:0/1287453115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f297415a600 0x7f297415c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f297259c640 1 -- 172.21.15.90:0/1287453115 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29741f3ed0 con 0x7f297406fcc0 2024-09-10T23:19:07.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f297259c640 1 --2- 172.21.15.90:0/1287453115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f297406fcc0 0x7f297414a250 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f296c006010 tx=0x7f296c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:07.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f296affd640 1 -- 172.21.15.90:0/1287453115 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296c033050 con 0x7f297406fcc0 2024-09-10T23:19:07.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f296affd640 1 -- 172.21.15.90:0/1287453115 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f296c004410 con 0x7f297406fcc0 2024-09-10T23:19:07.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f2978b10640 1 -- 172.21.15.90:0/1287453115 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f297415c8d0 con 0x7f297406fcc0 2024-09-10T23:19:07.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f296affd640 1 -- 172.21.15.90:0/1287453115 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296c004840 con 0x7f297406fcc0 2024-09-10T23:19:07.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.302+0000 7f2978b10640 1 -- 172.21.15.90:0/1287453115 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29740c8930 con 0x7f297406fcc0 2024-09-10T23:19:07.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.303+0000 7f2978b10640 1 -- 172.21.15.90:0/1287453115 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29740ad6c0 con 0x7f297406fcc0 2024-09-10T23:19:07.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.304+0000 7f296affd640 1 -- 172.21.15.90:0/1287453115 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f296c038450 con 0x7f297406fcc0 2024-09-10T23:19:07.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.304+0000 7f296affd640 1 --2- 172.21.15.90:0/1287453115 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2954077f70 0x7f295407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.304+0000 7f296affd640 1 -- 172.21.15.90:0/1287453115 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7f296c0bb5e0 con 0x7f297406fcc0 2024-09-10T23:19:07.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.304+0000 7f2971d9b640 1 --2- 172.21.15.90:0/1287453115 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2954077f70 0x7f295407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.304+0000 7f296affd640 1 --2- 172.21.15.90:0/1287453115 >> [v2:172.21.15.90:6808/2857408980,v1:172.21.15.90:6809/2857408980] conn(0x7f295407e0b0 0x7f29540804d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.305+0000 7f296affd640 1 -- 172.21.15.90:0/1287453115 --> [v2:172.21.15.90:6808/2857408980,v1:172.21.15.90:6809/2857408980] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f296c033e70 con 0x7f295407e0b0 2024-09-10T23:19:07.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.305+0000 7f296affd640 1 -- 172.21.15.90:0/1287453115 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) ==== 24+0+0 (secure 0 0 0) 0x7f296c0bba70 con 0x7f297406fcc0 2024-09-10T23:19:07.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.305+0000 7f2972d9d640 1 --2- 172.21.15.90:0/1287453115 >> [v2:172.21.15.90:6808/2857408980,v1:172.21.15.90:6809/2857408980] conn(0x7f295407e0b0 0x7f29540804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.305+0000 7f2972d9d640 1 --2- 172.21.15.90:0/1287453115 >> [v2:172.21.15.90:6808/2857408980,v1:172.21.15.90:6809/2857408980] conn(0x7f295407e0b0 0x7f29540804d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:07.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.305+0000 7f2971d9b640 1 --2- 172.21.15.90:0/1287453115 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2954077f70 0x7f295407a430 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f297415d9e0 tx=0x7f295c00a4c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:07.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.306+0000 7f296affd640 1 -- 172.21.15.90:0/1287453115 <== osd.3 v2:172.21.15.90:6808/2857408980 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f296c033e70 con 0x7f295407e0b0 2024-09-10T23:19:07.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.318+0000 7f2978b10640 1 -- 172.21.15.90:0/1287453115 --> [v2:172.21.15.90:6808/2857408980,v1:172.21.15.90:6809/2857408980] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f29740aeec0 con 0x7f295407e0b0 2024-09-10T23:19:07.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.318+0000 7f296affd640 1 -- 172.21.15.90:0/1287453115 <== osd.3 v2:172.21.15.90:6808/2857408980 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f29740aeec0 con 0x7f295407e0b0 2024-09-10T23:19:07.320 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:19:07.320 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T23:19:07.320 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:19:07.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.318+0000 7f2978b10640 1 -- 172.21.15.90:0/1287453115 >> [v2:172.21.15.90:6808/2857408980,v1:172.21.15.90:6809/2857408980] conn(0x7f295407e0b0 msgr2=0x7f29540804d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.318+0000 7f2978b10640 1 --2- 172.21.15.90:0/1287453115 >> [v2:172.21.15.90:6808/2857408980,v1:172.21.15.90:6809/2857408980] conn(0x7f295407e0b0 0x7f29540804d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.319+0000 7f2978b10640 1 -- 172.21.15.90:0/1287453115 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2954077f70 msgr2=0x7f295407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.319+0000 7f2978b10640 1 --2- 172.21.15.90:0/1287453115 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2954077f70 0x7f295407a430 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f297415d9e0 tx=0x7f295c00a4c0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.319+0000 7f2978b10640 1 -- 172.21.15.90:0/1287453115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f297406fcc0 msgr2=0x7f297414a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.319+0000 7f2978b10640 1 --2- 172.21.15.90:0/1287453115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f297406fcc0 0x7f297414a250 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f296c006010 tx=0x7f296c003f10 comp rx=0 tx=0).stop 2024-09-10T23:19:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.319+0000 7f2972d9d640 1 -- 172.21.15.90:0/1287453115 reap_dead start 2024-09-10T23:19:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.319+0000 7f2978b10640 1 -- 172.21.15.90:0/1287453115 shutdown_connections 2024-09-10T23:19:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.319+0000 7f2978b10640 1 -- 172.21.15.90:0/1287453115 >> 172.21.15.90:0/1287453115 conn(0x7f29740cfea0 msgr2=0x7f29740b4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.319+0000 7f2978b10640 1 -- 172.21.15.90:0/1287453115 shutdown_connections 2024-09-10T23:19:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.319+0000 7f2978b10640 1 -- 172.21.15.90:0/1287453115 wait complete. 2024-09-10T23:19:07.330 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T23:19:07.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.432+0000 7f20b9eb0640 1 -- 172.21.15.90:0/4248634466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20a0004800 msgr2=0x7f20a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.432+0000 7f20b9eb0640 1 --2- 172.21.15.90:0/4248634466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20a0004800 0x7f20a0004c80 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f209c0016c0 tx=0x7f20a0005830 comp rx=0 tx=0).stop 2024-09-10T23:19:07.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.432+0000 7f20b9eb0640 1 -- 172.21.15.90:0/4248634466 shutdown_connections 2024-09-10T23:19:07.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.432+0000 7f20b9eb0640 1 --2- 172.21.15.90:0/4248634466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20a0004800 0x7f20a0004c80 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.432+0000 7f20b9eb0640 1 -- 172.21.15.90:0/4248634466 >> 172.21.15.90:0/4248634466 conn(0x7f20b40d41e0 msgr2=0x7f20b40d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:07.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.432+0000 7f20b9eb0640 1 -- 172.21.15.90:0/4248634466 shutdown_connections 2024-09-10T23:19:07.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.432+0000 7f20b9eb0640 1 -- 172.21.15.90:0/4248634466 wait complete. 2024-09-10T23:19:07.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.433+0000 7f20b9eb0640 1 Processor -- start 2024-09-10T23:19:07.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.433+0000 7f20b9eb0640 1 -- start start 2024-09-10T23:19:07.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.434+0000 7f20b9eb0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20a0004800 0x7f20b415f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.434+0000 7f20b9eb0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20b40b6310 0x7f20b415f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.434+0000 7f20b9eb0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20b40ccea0 0x7f20b40b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.434+0000 7f20b9eb0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f20b406eb00 con 0x7f20b40b6310 2024-09-10T23:19:07.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.434+0000 7f20b9eb0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f20b406e980 con 0x7f20a0004800 2024-09-10T23:19:07.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.434+0000 7f20b9eb0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f20b4161d70 con 0x7f20b40ccea0 2024-09-10T23:19:07.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.434+0000 7f20abfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20b40b6310 0x7f20b415f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.434+0000 7f20abfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20b40b6310 0x7f20b415f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36470/0 (socket says 172.21.15.90:36470) 2024-09-10T23:19:07.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.434+0000 7f20abfff640 1 -- 172.21.15.90:0/2655950045 learned_addr learned my addr 172.21.15.90:0/2655950045 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:07.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.434+0000 7f20b37fe640 1 --2- 172.21.15.90:0/2655950045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20a0004800 0x7f20b415f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.434+0000 7f20b3fff640 1 --2- 172.21.15.90:0/2655950045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20b40ccea0 0x7f20b40b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.435+0000 7f20abfff640 1 -- 172.21.15.90:0/2655950045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20b40ccea0 msgr2=0x7f20b40b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.435+0000 7f20abfff640 1 --2- 172.21.15.90:0/2655950045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20b40ccea0 0x7f20b40b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.435+0000 7f20abfff640 1 -- 172.21.15.90:0/2655950045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20a0004800 msgr2=0x7f20b415f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.435+0000 7f20abfff640 1 --2- 172.21.15.90:0/2655950045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20a0004800 0x7f20b415f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.435+0000 7f20abfff640 1 -- 172.21.15.90:0/2655950045 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b40b6a60 con 0x7f20b40b6310 2024-09-10T23:19:07.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.435+0000 7f20abfff640 1 --2- 172.21.15.90:0/2655950045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20b40b6310 0x7f20b415f6c0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f209c0017e0 tx=0x7f209c0063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:07.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.435+0000 7f20b0ff9640 1 -- 172.21.15.90:0/2655950045 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c042070 con 0x7f20b40b6310 2024-09-10T23:19:07.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.435+0000 7f20b0ff9640 1 -- 172.21.15.90:0/2655950045 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f209c039070 con 0x7f20b40b6310 2024-09-10T23:19:07.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.435+0000 7f20b9eb0640 1 -- 172.21.15.90:0/2655950045 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b40cbe60 con 0x7f20b40b6310 2024-09-10T23:19:07.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.435+0000 7f20b0ff9640 1 -- 172.21.15.90:0/2655950045 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c003d70 con 0x7f20b40b6310 2024-09-10T23:19:07.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.435+0000 7f20b9eb0640 1 -- 172.21.15.90:0/2655950045 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b40cc3e0 con 0x7f20b40b6310 2024-09-10T23:19:07.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.436+0000 7f20b9eb0640 1 -- 172.21.15.90:0/2655950045 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20b40d25d0 con 0x7f20b40b6310 2024-09-10T23:19:07.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.437+0000 7f20b0ff9640 1 -- 172.21.15.90:0/2655950045 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f209c033420 con 0x7f20b40b6310 2024-09-10T23:19:07.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.437+0000 7f20b0ff9640 1 --2- 172.21.15.90:0/2655950045 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2094077fa0 0x7f209407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.437+0000 7f20b0ff9640 1 -- 172.21.15.90:0/2655950045 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7f209c0b91c0 con 0x7f20b40b6310 2024-09-10T23:19:07.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.437+0000 7f20b37fe640 1 --2- 172.21.15.90:0/2655950045 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2094077fa0 0x7f209407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.438+0000 7f20b37fe640 1 --2- 172.21.15.90:0/2655950045 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2094077fa0 0x7f209407a460 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f20a4006c10 tx=0x7f20a40067a0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:07.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.441+0000 7f20b0ff9640 1 -- 172.21.15.90:0/2655950045 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f209c0818a0 con 0x7f20b40b6310 2024-09-10T23:19:07.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.616+0000 7f20b9eb0640 1 -- 172.21.15.90:0/2655950045 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f20b4074c20 con 0x7f2094077fa0 2024-09-10T23:19:07.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.618+0000 7f20b0ff9640 1 -- 172.21.15.90:0/2655950045 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f20b4074c20 con 0x7f2094077fa0 2024-09-10T23:19:07.618 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T23:19:07.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.619+0000 7f20b9eb0640 1 -- 172.21.15.90:0/2655950045 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2094077fa0 msgr2=0x7f209407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.619+0000 7f20b9eb0640 1 --2- 172.21.15.90:0/2655950045 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2094077fa0 0x7f209407a460 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f20a4006c10 tx=0x7f20a40067a0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.619+0000 7f20b9eb0640 1 -- 172.21.15.90:0/2655950045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20b40b6310 msgr2=0x7f20b415f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.619+0000 7f20b9eb0640 1 --2- 172.21.15.90:0/2655950045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20b40b6310 0x7f20b415f6c0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f209c0017e0 tx=0x7f209c0063a0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.619+0000 7f20b9eb0640 1 -- 172.21.15.90:0/2655950045 shutdown_connections 2024-09-10T23:19:07.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.619+0000 7f20b9eb0640 1 --2- 172.21.15.90:0/2655950045 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f2094077fa0 0x7f209407a460 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.619+0000 7f20b9eb0640 1 --2- 172.21.15.90:0/2655950045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20b40ccea0 0x7f20b40b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.619+0000 7f20b9eb0640 1 --2- 172.21.15.90:0/2655950045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20b40b6310 0x7f20b415f6c0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.619+0000 7f20b9eb0640 1 --2- 172.21.15.90:0/2655950045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20a0004800 0x7f20b415f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.619+0000 7f20b9eb0640 1 -- 172.21.15.90:0/2655950045 >> 172.21.15.90:0/2655950045 conn(0x7f20b40d41e0 msgr2=0x7f20b40b87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:07.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.619+0000 7f20b9eb0640 1 -- 172.21.15.90:0/2655950045 shutdown_connections 2024-09-10T23:19:07.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.619+0000 7f20b9eb0640 1 -- 172.21.15.90:0/2655950045 wait complete. 2024-09-10T23:19:07.631 INFO:tasks.ceph:Scrubbing osd.4 2024-09-10T23:19:07.631 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-10T23:19:07.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.735+0000 7f4a1501f640 1 -- 172.21.15.90:0/2935059813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a1006f580 msgr2=0x7f4a100acd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.735+0000 7f4a1501f640 1 --2- 172.21.15.90:0/2935059813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a1006f580 0x7f4a100acd10 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f4a08005fd0 tx=0x7f4a0802aae0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.735+0000 7f4a1501f640 1 -- 172.21.15.90:0/2935059813 shutdown_connections 2024-09-10T23:19:07.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.735+0000 7f4a1501f640 1 --2- 172.21.15.90:0/2935059813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a1006f580 0x7f4a100acd10 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.735+0000 7f4a1501f640 1 --2- 172.21.15.90:0/2935059813 >> v2:172.21.15.171:3300/0 conn(0x7f4a1015a600 0x7f4a100cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.735+0000 7f4a1501f640 1 -- 172.21.15.90:0/2935059813 >> 172.21.15.90:0/2935059813 conn(0x7f4a100cfea0 msgr2=0x7f4a100d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:07.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.735+0000 7f4a1501f640 1 -- 172.21.15.90:0/2935059813 shutdown_connections 2024-09-10T23:19:07.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.735+0000 7f4a1501f640 1 -- 172.21.15.90:0/2935059813 wait complete. 2024-09-10T23:19:07.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.736+0000 7f4a1501f640 1 Processor -- start 2024-09-10T23:19:07.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.736+0000 7f4a1501f640 1 -- start start 2024-09-10T23:19:07.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a1501f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a1006f580 0x7f4a10153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a1501f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a100af300 0x7f4a1009cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a1501f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a1015a600 0x7f4a1009d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a1501f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1006e5e0 con 0x7f4a1015a600 2024-09-10T23:19:07.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a1501f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1006fed0 con 0x7f4a100af300 2024-09-10T23:19:07.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a1501f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4a1006e760 con 0x7f4a1006f580 2024-09-10T23:19:07.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a0f59e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a1015a600 0x7f4a1009d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a0f59e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a1015a600 0x7f4a1009d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36486/0 (socket says 172.21.15.90:36486) 2024-09-10T23:19:07.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a0f59e640 1 -- 172.21.15.90:0/2951333429 learned_addr learned my addr 172.21.15.90:0/2951333429 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:07.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a0ed9d640 1 --2- 172.21.15.90:0/2951333429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a1006f580 0x7f4a10153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a0659c640 1 --2- 172.21.15.90:0/2951333429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a100af300 0x7f4a1009cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a0f59e640 1 -- 172.21.15.90:0/2951333429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a1006f580 msgr2=0x7f4a10153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a0f59e640 1 --2- 172.21.15.90:0/2951333429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a1006f580 0x7f4a10153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a0f59e640 1 -- 172.21.15.90:0/2951333429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a100af300 msgr2=0x7f4a1009cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a0f59e640 1 --2- 172.21.15.90:0/2951333429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a100af300 0x7f4a1009cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a0f59e640 1 -- 172.21.15.90:0/2951333429 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a101f4d60 con 0x7f4a1015a600 2024-09-10T23:19:07.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a0659c640 1 --2- 172.21.15.90:0/2951333429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a100af300 0x7f4a1009cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:07.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.737+0000 7f4a0f59e640 1 --2- 172.21.15.90:0/2951333429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a1015a600 0x7f4a1009d490 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f4a08006010 tx=0x7f4a08003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:07.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.738+0000 7f4a07fff640 1 -- 172.21.15.90:0/2951333429 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a08046070 con 0x7f4a1015a600 2024-09-10T23:19:07.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.738+0000 7f4a07fff640 1 -- 172.21.15.90:0/2951333429 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a0802e800 con 0x7f4a1015a600 2024-09-10T23:19:07.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.738+0000 7f4a07fff640 1 -- 172.21.15.90:0/2951333429 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a080044b0 con 0x7f4a1015a600 2024-09-10T23:19:07.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.738+0000 7f4a1501f640 1 -- 172.21.15.90:0/2951333429 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a10154240 con 0x7f4a1015a600 2024-09-10T23:19:07.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.738+0000 7f4a1501f640 1 -- 172.21.15.90:0/2951333429 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a101f4fd0 con 0x7f4a1015a600 2024-09-10T23:19:07.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.739+0000 7f4a1501f640 1 -- 172.21.15.90:0/2951333429 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4a100cf3e0 con 0x7f4a1015a600 2024-09-10T23:19:07.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.739+0000 7f4a07fff640 1 -- 172.21.15.90:0/2951333429 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4a08004650 con 0x7f4a1015a600 2024-09-10T23:19:07.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.740+0000 7f4a07fff640 1 --2- 172.21.15.90:0/2951333429 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f49f0077fa0 0x7f49f007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.740+0000 7f4a07fff640 1 -- 172.21.15.90:0/2951333429 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7f4a080bac60 con 0x7f4a1015a600 2024-09-10T23:19:07.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.740+0000 7f4a07fff640 1 --2- 172.21.15.90:0/2951333429 >> [v2:172.21.15.171:6810/1503898082,v1:172.21.15.171:6811/1503898082] conn(0x7f49f007e0e0 0x7f49f0080500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.740+0000 7f4a07fff640 1 -- 172.21.15.90:0/2951333429 --> [v2:172.21.15.171:6810/1503898082,v1:172.21.15.171:6811/1503898082] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a080020b0 con 0x7f49f007e0e0 2024-09-10T23:19:07.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.740+0000 7f4a07fff640 1 -- 172.21.15.90:0/2951333429 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) ==== 24+0+0 (secure 0 0 0) 0x7f4a080bd300 con 0x7f4a1015a600 2024-09-10T23:19:07.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.740+0000 7f4a0ed9d640 1 --2- 172.21.15.90:0/2951333429 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f49f0077fa0 0x7f49f007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.740+0000 7f4a0659c640 1 --2- 172.21.15.90:0/2951333429 >> [v2:172.21.15.171:6810/1503898082,v1:172.21.15.171:6811/1503898082] conn(0x7f49f007e0e0 0x7f49f0080500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.740+0000 7f4a0ed9d640 1 --2- 172.21.15.90:0/2951333429 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f49f0077fa0 0x7f49f007a460 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4a1009abb0 tx=0x7f4a0000b3e0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:07.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.741+0000 7f4a0659c640 1 --2- 172.21.15.90:0/2951333429 >> [v2:172.21.15.171:6810/1503898082,v1:172.21.15.171:6811/1503898082] conn(0x7f49f007e0e0 0x7f49f0080500 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:07.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.741+0000 7f4a07fff640 1 -- 172.21.15.90:0/2951333429 <== osd.4 v2:172.21.15.171:6810/1503898082 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4a080020b0 con 0x7f49f007e0e0 2024-09-10T23:19:07.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.754+0000 7f4a1501f640 1 -- 172.21.15.90:0/2951333429 --> [v2:172.21.15.171:6810/1503898082,v1:172.21.15.171:6811/1503898082] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4a1015dfb0 con 0x7f49f007e0e0 2024-09-10T23:19:07.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.754+0000 7f4a07fff640 1 -- 172.21.15.90:0/2951333429 <== osd.4 v2:172.21.15.171:6810/1503898082 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4a1015dfb0 con 0x7f49f007e0e0 2024-09-10T23:19:07.755 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:19:07.755 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T23:19:07.755 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:19:07.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.755+0000 7f4a1501f640 1 -- 172.21.15.90:0/2951333429 >> [v2:172.21.15.171:6810/1503898082,v1:172.21.15.171:6811/1503898082] conn(0x7f49f007e0e0 msgr2=0x7f49f0080500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.755+0000 7f4a1501f640 1 --2- 172.21.15.90:0/2951333429 >> [v2:172.21.15.171:6810/1503898082,v1:172.21.15.171:6811/1503898082] conn(0x7f49f007e0e0 0x7f49f0080500 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.755+0000 7f4a1501f640 1 -- 172.21.15.90:0/2951333429 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f49f0077fa0 msgr2=0x7f49f007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.755+0000 7f4a1501f640 1 --2- 172.21.15.90:0/2951333429 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f49f0077fa0 0x7f49f007a460 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4a1009abb0 tx=0x7f4a0000b3e0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.755+0000 7f4a1501f640 1 -- 172.21.15.90:0/2951333429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a1015a600 msgr2=0x7f4a1009d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.755+0000 7f4a1501f640 1 --2- 172.21.15.90:0/2951333429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a1015a600 0x7f4a1009d490 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f4a08006010 tx=0x7f4a08003f10 comp rx=0 tx=0).stop 2024-09-10T23:19:07.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.755+0000 7f4a0f59e640 1 -- 172.21.15.90:0/2951333429 reap_dead start 2024-09-10T23:19:07.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.755+0000 7f4a1501f640 1 -- 172.21.15.90:0/2951333429 shutdown_connections 2024-09-10T23:19:07.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.755+0000 7f4a1501f640 1 -- 172.21.15.90:0/2951333429 >> 172.21.15.90:0/2951333429 conn(0x7f4a100cfea0 msgr2=0x7f4a10158240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:07.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.755+0000 7f4a1501f640 1 -- 172.21.15.90:0/2951333429 shutdown_connections 2024-09-10T23:19:07.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.755+0000 7f4a1501f640 1 -- 172.21.15.90:0/2951333429 wait complete. 2024-09-10T23:19:07.766 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-10T23:19:07.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.868+0000 7f5c0cedd640 1 -- 172.21.15.90:0/359480723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bf4004d40 msgr2=0x7f5bf40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.868+0000 7f5c0cedd640 1 --2- 172.21.15.90:0/359480723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bf4004d40 0x7f5bf40051c0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000c610 tx=0x7f5bf4005830 comp rx=0 tx=0).stop 2024-09-10T23:19:07.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.868+0000 7f5c06d9d640 1 -- 172.21.15.90:0/359480723 reap_dead start 2024-09-10T23:19:07.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.868+0000 7f5c0cedd640 1 -- 172.21.15.90:0/359480723 shutdown_connections 2024-09-10T23:19:07.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.868+0000 7f5c0cedd640 1 -- 172.21.15.90:0/359480723 >> 172.21.15.90:0/359480723 conn(0x7f5c0806d1a0 msgr2=0x7f5c080b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:07.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.868+0000 7f5c0cedd640 1 -- 172.21.15.90:0/359480723 shutdown_connections 2024-09-10T23:19:07.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.868+0000 7f5c0cedd640 1 -- 172.21.15.90:0/359480723 wait complete. 2024-09-10T23:19:07.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.869+0000 7f5c0cedd640 1 Processor -- start 2024-09-10T23:19:07.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.870+0000 7f5c0cedd640 1 -- start start 2024-09-10T23:19:07.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.870+0000 7f5c0cedd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bf4004d40 0x7f5c08153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.870+0000 7f5c0cedd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c08151ec0 0x7f5c0814b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.870+0000 7f5c0cedd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c0815c620 0x7f5c0815caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.870+0000 7f5c0cedd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5c080b22c0 con 0x7f5bf4004d40 2024-09-10T23:19:07.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.870+0000 7f5c0cedd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5c080b2140 con 0x7f5c08151ec0 2024-09-10T23:19:07.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.870+0000 7f5c0cedd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5c080b2440 con 0x7f5c0815c620 2024-09-10T23:19:07.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.870+0000 7f5c0659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bf4004d40 0x7f5c08153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.870+0000 7f5c0659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bf4004d40 0x7f5c08153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36500/0 (socket says 172.21.15.90:36500) 2024-09-10T23:19:07.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.870+0000 7f5c0659c640 1 -- 172.21.15.90:0/30296384 learned_addr learned my addr 172.21.15.90:0/30296384 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:07.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.871+0000 7f5c06d9d640 1 --2- 172.21.15.90:0/30296384 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c0815c620 0x7f5c0815caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.871+0000 7f5bfdd9b640 1 --2- 172.21.15.90:0/30296384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c08151ec0 0x7f5c0814b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.871+0000 7f5c0659c640 1 -- 172.21.15.90:0/30296384 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c0815c620 msgr2=0x7f5c0815caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.871+0000 7f5c0659c640 1 --2- 172.21.15.90:0/30296384 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c0815c620 0x7f5c0815caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.871+0000 7f5c0659c640 1 -- 172.21.15.90:0/30296384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c08151ec0 msgr2=0x7f5c0814b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.871+0000 7f5c0659c640 1 --2- 172.21.15.90:0/30296384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c08151ec0 0x7f5c0814b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.871+0000 7f5c0659c640 1 -- 172.21.15.90:0/30296384 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0814c130 con 0x7f5bf4004d40 2024-09-10T23:19:07.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.871+0000 7f5c06d9d640 1 --2- 172.21.15.90:0/30296384 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c0815c620 0x7f5c0815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:07.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.871+0000 7f5bfdd9b640 1 --2- 172.21.15.90:0/30296384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c08151ec0 0x7f5c0814b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:07.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.871+0000 7f5c0659c640 1 --2- 172.21.15.90:0/30296384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bf4004d40 0x7f5c08153c60 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800ea40 tx=0x7f5bf800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:07.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.871+0000 7f5bff7fe640 1 -- 172.21.15.90:0/30296384 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf800dd50 con 0x7f5bf4004d40 2024-09-10T23:19:07.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.871+0000 7f5bff7fe640 1 -- 172.21.15.90:0/30296384 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bf8004050 con 0x7f5bf4004d40 2024-09-10T23:19:07.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.871+0000 7f5c0cedd640 1 -- 172.21.15.90:0/30296384 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c08152340 con 0x7f5bf4004d40 2024-09-10T23:19:07.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.871+0000 7f5bff7fe640 1 -- 172.21.15.90:0/30296384 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8004480 con 0x7f5bf4004d40 2024-09-10T23:19:07.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.871+0000 7f5c0cedd640 1 -- 172.21.15.90:0/30296384 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c080ce040 con 0x7f5bf4004d40 2024-09-10T23:19:07.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.872+0000 7f5c0cedd640 1 -- 172.21.15.90:0/30296384 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c0806f120 con 0x7f5bf4004d40 2024-09-10T23:19:07.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.872+0000 7f5bff7fe640 1 -- 172.21.15.90:0/30296384 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5bf800b040 con 0x7f5bf4004d40 2024-09-10T23:19:07.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.873+0000 7f5bff7fe640 1 --2- 172.21.15.90:0/30296384 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5be8077fa0 0x7f5be807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:07.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.873+0000 7f5bff7fe640 1 -- 172.21.15.90:0/30296384 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7f5bf809a4a0 con 0x7f5bf4004d40 2024-09-10T23:19:07.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.873+0000 7f5bfdd9b640 1 --2- 172.21.15.90:0/30296384 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5be8077fa0 0x7f5be807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:07.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.874+0000 7f5bfdd9b640 1 --2- 172.21.15.90:0/30296384 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5be8077fa0 0x7f5be807a460 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5c080cdd80 tx=0x7f5bf0006be0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:07.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:07.877+0000 7f5bff7fe640 1 -- 172.21.15.90:0/30296384 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5c08152340 con 0x7f5bf4004d40 2024-09-10T23:19:08.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.051+0000 7f5c0cedd640 1 -- 172.21.15.90:0/30296384 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f5c080aee80 con 0x7f5be8077fa0 2024-09-10T23:19:08.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.051+0000 7f5bff7fe640 1 -- 172.21.15.90:0/30296384 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5c080aee80 con 0x7f5be8077fa0 2024-09-10T23:19:08.052 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 4 to deep-scrub 2024-09-10T23:19:08.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.053+0000 7f5c0cedd640 1 -- 172.21.15.90:0/30296384 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5be8077fa0 msgr2=0x7f5be807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.053+0000 7f5c0cedd640 1 --2- 172.21.15.90:0/30296384 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5be8077fa0 0x7f5be807a460 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5c080cdd80 tx=0x7f5bf0006be0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.053+0000 7f5c0cedd640 1 -- 172.21.15.90:0/30296384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bf4004d40 msgr2=0x7f5c08153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.053+0000 7f5c0cedd640 1 --2- 172.21.15.90:0/30296384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bf4004d40 0x7f5c08153c60 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800ea40 tx=0x7f5bf800ef00 comp rx=0 tx=0).stop 2024-09-10T23:19:08.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.053+0000 7f5c0cedd640 1 -- 172.21.15.90:0/30296384 shutdown_connections 2024-09-10T23:19:08.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.053+0000 7f5c0cedd640 1 --2- 172.21.15.90:0/30296384 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5be8077fa0 0x7f5be807a460 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.053+0000 7f5c0cedd640 1 --2- 172.21.15.90:0/30296384 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c08151ec0 0x7f5c0814b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.053+0000 7f5c0cedd640 1 --2- 172.21.15.90:0/30296384 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c0815c620 0x7f5c0815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.053+0000 7f5c0cedd640 1 --2- 172.21.15.90:0/30296384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bf4004d40 0x7f5c08153c60 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.053+0000 7f5c0cedd640 1 -- 172.21.15.90:0/30296384 >> 172.21.15.90:0/30296384 conn(0x7f5c0806d1a0 msgr2=0x7f5c0814fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:08.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.053+0000 7f5c0cedd640 1 -- 172.21.15.90:0/30296384 shutdown_connections 2024-09-10T23:19:08.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.054+0000 7f5c0cedd640 1 -- 172.21.15.90:0/30296384 wait complete. 2024-09-10T23:19:08.065 INFO:tasks.ceph:Scrubbing osd.5 2024-09-10T23:19:08.065 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-10T23:19:08.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.168+0000 7f8c851f8640 1 -- 172.21.15.90:0/1723679427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c800747f0 msgr2=0x7f8c800cb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.168+0000 7f8c851f8640 1 --2- 172.21.15.90:0/1723679427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c800747f0 0x7f8c800cb710 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009830 tx=0x7f8c7402a510 comp rx=0 tx=0).stop 2024-09-10T23:19:08.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.168+0000 7f8c851f8640 1 -- 172.21.15.90:0/1723679427 shutdown_connections 2024-09-10T23:19:08.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.168+0000 7f8c851f8640 1 --2- 172.21.15.90:0/1723679427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c800747f0 0x7f8c800cb710 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.168+0000 7f8c851f8640 1 -- 172.21.15.90:0/1723679427 >> 172.21.15.90:0/1723679427 conn(0x7f8c800cfea0 msgr2=0x7f8c800d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:08.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.168+0000 7f8c851f8640 1 -- 172.21.15.90:0/1723679427 shutdown_connections 2024-09-10T23:19:08.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.168+0000 7f8c851f8640 1 -- 172.21.15.90:0/1723679427 wait complete. 2024-09-10T23:19:08.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.170+0000 7f8c851f8640 1 Processor -- start 2024-09-10T23:19:08.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.170+0000 7f8c851f8640 1 -- start start 2024-09-10T23:19:08.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c851f8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c80072940 0x7f8c8009a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c851f8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c800747f0 0x7f8c800c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c851f8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c8015bd80 0x7f8c8009cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c851f8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8006e9a0 con 0x7f8c8015bd80 2024-09-10T23:19:08.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c851f8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8006e820 con 0x7f8c80072940 2024-09-10T23:19:08.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c851f8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8c801603d0 con 0x7f8c800747f0 2024-09-10T23:19:08.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c7f59e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c8015bd80 0x7f8c8009cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c7f59e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c8015bd80 0x7f8c8009cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42032/0 (socket says 172.21.15.90:42032) 2024-09-10T23:19:08.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c7f59e640 1 -- 172.21.15.90:0/2621671121 learned_addr learned my addr 172.21.15.90:0/2621671121 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:08.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c7ed9d640 1 --2- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c80072940 0x7f8c8009a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c7e59c640 1 --2- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c800747f0 0x7f8c800c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c7f59e640 1 -- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c800747f0 msgr2=0x7f8c800c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c7f59e640 1 --2- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c800747f0 0x7f8c800c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c7f59e640 1 -- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c80072940 msgr2=0x7f8c8009a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c7f59e640 1 --2- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c80072940 0x7f8c8009a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c7f59e640 1 -- 172.21.15.90:0/2621671121 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c800cdf70 con 0x7f8c8015bd80 2024-09-10T23:19:08.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c7ed9d640 1 --2- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c80072940 0x7f8c8009a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:08.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c7e59c640 1 --2- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c800747f0 0x7f8c800c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:08.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c7f59e640 1 --2- 172.21.15.90:0/2621671121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c8015bd80 0x7f8c8009cfd0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800c7a0 tx=0x7f8c7800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:08.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c677fe640 1 -- 172.21.15.90:0/2621671121 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c78003da0 con 0x7f8c8015bd80 2024-09-10T23:19:08.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c677fe640 1 -- 172.21.15.90:0/2621671121 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c78005070 con 0x7f8c8015bd80 2024-09-10T23:19:08.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.171+0000 7f8c851f8640 1 -- 172.21.15.90:0/2621671121 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c800ce250 con 0x7f8c8015bd80 2024-09-10T23:19:08.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.172+0000 7f8c677fe640 1 -- 172.21.15.90:0/2621671121 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c780054c0 con 0x7f8c8015bd80 2024-09-10T23:19:08.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.172+0000 7f8c851f8640 1 -- 172.21.15.90:0/2621671121 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c800ce810 con 0x7f8c8015bd80 2024-09-10T23:19:08.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.172+0000 7f8c851f8640 1 -- 172.21.15.90:0/2621671121 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c8015fcc0 con 0x7f8c8015bd80 2024-09-10T23:19:08.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.173+0000 7f8c677fe640 1 -- 172.21.15.90:0/2621671121 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8c78005660 con 0x7f8c8015bd80 2024-09-10T23:19:08.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.173+0000 7f8c677fe640 1 --2- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8c6c077f70 0x7f8c6c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.174+0000 7f8c677fe640 1 -- 172.21.15.90:0/2621671121 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7f8c78099a20 con 0x7f8c8015bd80 2024-09-10T23:19:08.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.174+0000 7f8c677fe640 1 --2- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:6818/2053754805,v1:172.21.15.171:6819/2053754805] conn(0x7f8c6c07e0b0 0x7f8c6c0804d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.174+0000 7f8c677fe640 1 -- 172.21.15.90:0/2621671121 --> [v2:172.21.15.171:6818/2053754805,v1:172.21.15.171:6819/2053754805] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c6c080b80 con 0x7f8c6c07e0b0 2024-09-10T23:19:08.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.174+0000 7f8c677fe640 1 -- 172.21.15.90:0/2621671121 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) ==== 24+0+0 (secure 0 0 0) 0x7f8c7809e2c0 con 0x7f8c8015bd80 2024-09-10T23:19:08.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.174+0000 7f8c7ed9d640 1 --2- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8c6c077f70 0x7f8c6c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.174+0000 7f8c7e59c640 1 --2- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:6818/2053754805,v1:172.21.15.171:6819/2053754805] conn(0x7f8c6c07e0b0 0x7f8c6c0804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.174+0000 7f8c7ed9d640 1 --2- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8c6c077f70 0x7f8c6c07a430 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8c80051100 tx=0x7f8c70008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:08.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.174+0000 7f8c7e59c640 1 --2- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:6818/2053754805,v1:172.21.15.171:6819/2053754805] conn(0x7f8c6c07e0b0 0x7f8c6c0804d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:08.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.175+0000 7f8c677fe640 1 -- 172.21.15.90:0/2621671121 <== osd.5 v2:172.21.15.171:6818/2053754805 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c6c080b80 con 0x7f8c6c07e0b0 2024-09-10T23:19:08.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.188+0000 7f8c851f8640 1 -- 172.21.15.90:0/2621671121 --> [v2:172.21.15.171:6818/2053754805,v1:172.21.15.171:6819/2053754805] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8c801608c0 con 0x7f8c6c07e0b0 2024-09-10T23:19:08.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.188+0000 7f8c677fe640 1 -- 172.21.15.90:0/2621671121 <== osd.5 v2:172.21.15.171:6818/2053754805 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8c801608c0 con 0x7f8c6c07e0b0 2024-09-10T23:19:08.189 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:19:08.189 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T23:19:08.189 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:19:08.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.188+0000 7f8c851f8640 1 -- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:6818/2053754805,v1:172.21.15.171:6819/2053754805] conn(0x7f8c6c07e0b0 msgr2=0x7f8c6c0804d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.188+0000 7f8c851f8640 1 --2- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:6818/2053754805,v1:172.21.15.171:6819/2053754805] conn(0x7f8c6c07e0b0 0x7f8c6c0804d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.188+0000 7f8c851f8640 1 -- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8c6c077f70 msgr2=0x7f8c6c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.188+0000 7f8c851f8640 1 --2- 172.21.15.90:0/2621671121 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f8c6c077f70 0x7f8c6c07a430 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8c80051100 tx=0x7f8c70008040 comp rx=0 tx=0).stop 2024-09-10T23:19:08.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.188+0000 7f8c851f8640 1 -- 172.21.15.90:0/2621671121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c8015bd80 msgr2=0x7f8c8009cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.188+0000 7f8c851f8640 1 --2- 172.21.15.90:0/2621671121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c8015bd80 0x7f8c8009cfd0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800c7a0 tx=0x7f8c7800cc60 comp rx=0 tx=0).stop 2024-09-10T23:19:08.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.188+0000 7f8c7f59e640 1 -- 172.21.15.90:0/2621671121 reap_dead start 2024-09-10T23:19:08.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.189+0000 7f8c851f8640 1 -- 172.21.15.90:0/2621671121 shutdown_connections 2024-09-10T23:19:08.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.189+0000 7f8c851f8640 1 -- 172.21.15.90:0/2621671121 >> 172.21.15.90:0/2621671121 conn(0x7f8c800cfea0 msgr2=0x7f8c800b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:08.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.189+0000 7f8c851f8640 1 -- 172.21.15.90:0/2621671121 shutdown_connections 2024-09-10T23:19:08.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.189+0000 7f8c851f8640 1 -- 172.21.15.90:0/2621671121 wait complete. 2024-09-10T23:19:08.199 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-10T23:19:08.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.301+0000 7fef18e2a640 1 -- 172.21.15.90:0/1992712385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef14154c70 msgr2=0x7fef14073ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.301+0000 7fef18e2a640 1 --2- 172.21.15.90:0/1992712385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef14154c70 0x7fef14073ea0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fef04009860 tx=0x7fef0402a530 comp rx=0 tx=0).stop 2024-09-10T23:19:08.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.301+0000 7fef18e2a640 1 -- 172.21.15.90:0/1992712385 shutdown_connections 2024-09-10T23:19:08.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.301+0000 7fef18e2a640 1 --2- 172.21.15.90:0/1992712385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef14154c70 0x7fef14073ea0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.301+0000 7fef18e2a640 1 -- 172.21.15.90:0/1992712385 >> 172.21.15.90:0/1992712385 conn(0x7fef1406d1a0 msgr2=0x7fef140b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:08.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.301+0000 7fef18e2a640 1 -- 172.21.15.90:0/1992712385 shutdown_connections 2024-09-10T23:19:08.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.301+0000 7fef18e2a640 1 -- 172.21.15.90:0/1992712385 wait complete. 2024-09-10T23:19:08.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.302+0000 7fef18e2a640 1 Processor -- start 2024-09-10T23:19:08.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.302+0000 7fef18e2a640 1 -- start start 2024-09-10T23:19:08.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.303+0000 7fef18e2a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef1406ed10 0x7fef141f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.303+0000 7fef18e2a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef140728a0 0x7fef141e3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.303+0000 7fef18e2a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef14154c70 0x7fef140ce930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.303+0000 7fef18e2a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fef140b27d0 con 0x7fef14154c70 2024-09-10T23:19:08.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.303+0000 7fef18e2a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fef140b2650 con 0x7fef140728a0 2024-09-10T23:19:08.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.303+0000 7fef18e2a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fef140b3200 con 0x7fef1406ed10 2024-09-10T23:19:08.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.303+0000 7fef12d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef14154c70 0x7fef140ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.303+0000 7fef12d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef14154c70 0x7fef140ce930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42040/0 (socket says 172.21.15.90:42040) 2024-09-10T23:19:08.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.303+0000 7fef12d9d640 1 -- 172.21.15.90:0/807192439 learned_addr learned my addr 172.21.15.90:0/807192439 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:08.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.303+0000 7fef1259c640 1 --2- 172.21.15.90:0/807192439 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef1406ed10 0x7fef141f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.303+0000 7fef0bfff640 1 --2- 172.21.15.90:0/807192439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef140728a0 0x7fef141e3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.303+0000 7fef12d9d640 1 -- 172.21.15.90:0/807192439 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef1406ed10 msgr2=0x7fef141f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.303+0000 7fef12d9d640 1 --2- 172.21.15.90:0/807192439 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef1406ed10 0x7fef141f3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.303+0000 7fef12d9d640 1 -- 172.21.15.90:0/807192439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef140728a0 msgr2=0x7fef141e3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.303+0000 7fef12d9d640 1 --2- 172.21.15.90:0/807192439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef140728a0 0x7fef141e3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.303+0000 7fef12d9d640 1 -- 172.21.15.90:0/807192439 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef141e4990 con 0x7fef14154c70 2024-09-10T23:19:08.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.303+0000 7fef12d9d640 1 --2- 172.21.15.90:0/807192439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef14154c70 0x7fef140ce930 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00c760 tx=0x7fef0c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:08.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.304+0000 7fef0affd640 1 -- 172.21.15.90:0/807192439 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c003b70 con 0x7fef14154c70 2024-09-10T23:19:08.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.304+0000 7fef0affd640 1 -- 172.21.15.90:0/807192439 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef0c003d30 con 0x7fef14154c70 2024-09-10T23:19:08.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.304+0000 7fef18e2a640 1 -- 172.21.15.90:0/807192439 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef141e4c70 con 0x7fef14154c70 2024-09-10T23:19:08.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.304+0000 7fef0affd640 1 -- 172.21.15.90:0/807192439 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c00aab0 con 0x7fef14154c70 2024-09-10T23:19:08.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.304+0000 7fef18e2a640 1 -- 172.21.15.90:0/807192439 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef141e5230 con 0x7fef14154c70 2024-09-10T23:19:08.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.305+0000 7fef18e2a640 1 -- 172.21.15.90:0/807192439 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef14073ea0 con 0x7fef14154c70 2024-09-10T23:19:08.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.305+0000 7fef0affd640 1 -- 172.21.15.90:0/807192439 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fef0c00ac50 con 0x7fef14154c70 2024-09-10T23:19:08.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.306+0000 7fef0affd640 1 --2- 172.21.15.90:0/807192439 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feef4077f70 0x7feef407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.306+0000 7fef0affd640 1 -- 172.21.15.90:0/807192439 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7fef0c099ad0 con 0x7fef14154c70 2024-09-10T23:19:08.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.306+0000 7fef1259c640 1 --2- 172.21.15.90:0/807192439 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feef4077f70 0x7feef407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.306+0000 7fef1259c640 1 --2- 172.21.15.90:0/807192439 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feef4077f70 0x7feef407a430 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fef04034000 tx=0x7fef04004730 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:08.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.310+0000 7fef0affd640 1 -- 172.21.15.90:0/807192439 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fef0c0626f0 con 0x7fef14154c70 2024-09-10T23:19:08.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.484+0000 7fef18e2a640 1 -- 172.21.15.90:0/807192439 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fef140b1dd0 con 0x7feef4077f70 2024-09-10T23:19:08.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.485+0000 7fef0affd640 1 -- 172.21.15.90:0/807192439 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fef140b1dd0 con 0x7feef4077f70 2024-09-10T23:19:08.486 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 5 to deep-scrub 2024-09-10T23:19:08.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.487+0000 7fef18e2a640 1 -- 172.21.15.90:0/807192439 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feef4077f70 msgr2=0x7feef407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.487+0000 7fef18e2a640 1 --2- 172.21.15.90:0/807192439 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feef4077f70 0x7feef407a430 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fef04034000 tx=0x7fef04004730 comp rx=0 tx=0).stop 2024-09-10T23:19:08.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.487+0000 7fef18e2a640 1 -- 172.21.15.90:0/807192439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef14154c70 msgr2=0x7fef140ce930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.487+0000 7fef18e2a640 1 --2- 172.21.15.90:0/807192439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef14154c70 0x7fef140ce930 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00c760 tx=0x7fef0c00cc20 comp rx=0 tx=0).stop 2024-09-10T23:19:08.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.487+0000 7fef18e2a640 1 -- 172.21.15.90:0/807192439 shutdown_connections 2024-09-10T23:19:08.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.487+0000 7fef18e2a640 1 --2- 172.21.15.90:0/807192439 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7feef4077f70 0x7feef407a430 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.487+0000 7fef18e2a640 1 --2- 172.21.15.90:0/807192439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef140728a0 0x7fef141e3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.487+0000 7fef18e2a640 1 --2- 172.21.15.90:0/807192439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef14154c70 0x7fef140ce930 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.487+0000 7fef18e2a640 1 --2- 172.21.15.90:0/807192439 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef1406ed10 0x7fef141f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.487+0000 7fef18e2a640 1 -- 172.21.15.90:0/807192439 >> 172.21.15.90:0/807192439 conn(0x7fef1406d1a0 msgr2=0x7fef1415cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:08.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.487+0000 7fef18e2a640 1 -- 172.21.15.90:0/807192439 shutdown_connections 2024-09-10T23:19:08.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.487+0000 7fef18e2a640 1 -- 172.21.15.90:0/807192439 wait complete. 2024-09-10T23:19:08.500 INFO:tasks.ceph:Scrubbing osd.6 2024-09-10T23:19:08.500 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-10T23:19:08.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.604+0000 7fa231b0e640 1 -- 172.21.15.90:0/3383419723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c0b5850 msgr2=0x7fa22c0d27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.604+0000 7fa231b0e640 1 --2- 172.21.15.90:0/3383419723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c0b5850 0x7fa22c0d27d0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fa220009830 tx=0x7fa22002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.604+0000 7fa231b0e640 1 -- 172.21.15.90:0/3383419723 shutdown_connections 2024-09-10T23:19:08.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.604+0000 7fa231b0e640 1 --2- 172.21.15.90:0/3383419723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c0b5850 0x7fa22c0d27d0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.604+0000 7fa231b0e640 1 --2- 172.21.15.90:0/3383419723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa22c15e2e0 0x7fa22c0b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.604+0000 7fa231b0e640 1 -- 172.21.15.90:0/3383419723 >> 172.21.15.90:0/3383419723 conn(0x7fa22c074c20 msgr2=0x7fa22c09d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:08.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.604+0000 7fa231b0e640 1 -- 172.21.15.90:0/3383419723 shutdown_connections 2024-09-10T23:19:08.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.604+0000 7fa231b0e640 1 -- 172.21.15.90:0/3383419723 wait complete. 2024-09-10T23:19:08.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.606+0000 7fa231b0e640 1 Processor -- start 2024-09-10T23:19:08.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.606+0000 7fa231b0e640 1 -- start start 2024-09-10T23:19:08.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.606+0000 7fa231b0e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22c0b5850 0x7fa22c152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.606+0000 7fa231b0e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c0d4090 0x7fa22c160780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.606+0000 7fa231b0e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa22c15e2e0 0x7fa22c160cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.606+0000 7fa231b0e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c0d4a10 con 0x7fa22c0d4090 2024-09-10T23:19:08.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.606+0000 7fa231b0e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c0d4890 con 0x7fa22c0b5850 2024-09-10T23:19:08.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.606+0000 7fa231b0e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa22c0d10e0 con 0x7fa22c15e2e0 2024-09-10T23:19:08.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.607+0000 7fa22affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c0d4090 0x7fa22c160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.607+0000 7fa22affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c0d4090 0x7fa22c160780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42058/0 (socket says 172.21.15.90:42058) 2024-09-10T23:19:08.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.607+0000 7fa22affd640 1 -- 172.21.15.90:0/3082390597 learned_addr learned my addr 172.21.15.90:0/3082390597 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:08.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.607+0000 7fa22bfff640 1 --2- 172.21.15.90:0/3082390597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa22c15e2e0 0x7fa22c160cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.607+0000 7fa22b7fe640 1 --2- 172.21.15.90:0/3082390597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22c0b5850 0x7fa22c152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.607+0000 7fa22affd640 1 -- 172.21.15.90:0/3082390597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa22c15e2e0 msgr2=0x7fa22c160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.607+0000 7fa22affd640 1 --2- 172.21.15.90:0/3082390597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa22c15e2e0 0x7fa22c160cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.607+0000 7fa22affd640 1 -- 172.21.15.90:0/3082390597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22c0b5850 msgr2=0x7fa22c152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.607+0000 7fa22affd640 1 --2- 172.21.15.90:0/3082390597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22c0b5850 0x7fa22c152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.607+0000 7fa22affd640 1 -- 172.21.15.90:0/3082390597 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22c0cb350 con 0x7fa22c0d4090 2024-09-10T23:19:08.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.607+0000 7fa22bfff640 1 --2- 172.21.15.90:0/3082390597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa22c15e2e0 0x7fa22c160cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:08.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.607+0000 7fa22affd640 1 --2- 172.21.15.90:0/3082390597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c0d4090 0x7fa22c160780 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fa220000c00 tx=0x7fa220032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:08.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.607+0000 7fa213fff640 1 -- 172.21.15.90:0/3082390597 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa220040070 con 0x7fa22c0d4090 2024-09-10T23:19:08.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.607+0000 7fa213fff640 1 -- 172.21.15.90:0/3082390597 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa220003af0 con 0x7fa22c0d4090 2024-09-10T23:19:08.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.607+0000 7fa231b0e640 1 -- 172.21.15.90:0/3082390597 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22c152b40 con 0x7fa22c0d4090 2024-09-10T23:19:08.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.607+0000 7fa213fff640 1 -- 172.21.15.90:0/3082390597 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa220045460 con 0x7fa22c0d4090 2024-09-10T23:19:08.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.607+0000 7fa231b0e640 1 -- 172.21.15.90:0/3082390597 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa22c0ce2b0 con 0x7fa22c0d4090 2024-09-10T23:19:08.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.608+0000 7fa231b0e640 1 -- 172.21.15.90:0/3082390597 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa22c0d15b0 con 0x7fa22c0d4090 2024-09-10T23:19:08.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.609+0000 7fa213fff640 1 -- 172.21.15.90:0/3082390597 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa22004d030 con 0x7fa22c0d4090 2024-09-10T23:19:08.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.609+0000 7fa213fff640 1 --2- 172.21.15.90:0/3082390597 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa218077f70 0x7fa21807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.609+0000 7fa213fff640 1 -- 172.21.15.90:0/3082390597 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7fa2200bb820 con 0x7fa22c0d4090 2024-09-10T23:19:08.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.609+0000 7fa213fff640 1 --2- 172.21.15.90:0/3082390597 >> [v2:172.21.15.171:6826/126573870,v1:172.21.15.171:6827/126573870] conn(0x7fa21807e0b0 0x7fa2180804d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.610+0000 7fa22b7fe640 1 --2- 172.21.15.90:0/3082390597 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa218077f70 0x7fa21807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.610+0000 7fa213fff640 1 -- 172.21.15.90:0/3082390597 --> [v2:172.21.15.171:6826/126573870,v1:172.21.15.171:6827/126573870] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa220001d30 con 0x7fa21807e0b0 2024-09-10T23:19:08.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.610+0000 7fa213fff640 1 -- 172.21.15.90:0/3082390597 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) ==== 24+0+0 (secure 0 0 0) 0x7fa2200bbcb0 con 0x7fa22c0d4090 2024-09-10T23:19:08.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.610+0000 7fa22bfff640 1 --2- 172.21.15.90:0/3082390597 >> [v2:172.21.15.171:6826/126573870,v1:172.21.15.171:6827/126573870] conn(0x7fa21807e0b0 0x7fa2180804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.610+0000 7fa22b7fe640 1 --2- 172.21.15.90:0/3082390597 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa218077f70 0x7fa21807a430 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa21c005fd0 tx=0x7fa21c005bc0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:08.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.610+0000 7fa22bfff640 1 --2- 172.21.15.90:0/3082390597 >> [v2:172.21.15.171:6826/126573870,v1:172.21.15.171:6827/126573870] conn(0x7fa21807e0b0 0x7fa2180804d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:08.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.611+0000 7fa213fff640 1 -- 172.21.15.90:0/3082390597 <== osd.6 v2:172.21.15.171:6826/126573870 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa220001d30 con 0x7fa21807e0b0 2024-09-10T23:19:08.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.623+0000 7fa231b0e640 1 -- 172.21.15.90:0/3082390597 --> [v2:172.21.15.171:6826/126573870,v1:172.21.15.171:6827/126573870] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa22c0cbab0 con 0x7fa21807e0b0 2024-09-10T23:19:08.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.624+0000 7fa213fff640 1 -- 172.21.15.90:0/3082390597 <== osd.6 v2:172.21.15.171:6826/126573870 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa22c0cbab0 con 0x7fa21807e0b0 2024-09-10T23:19:08.625 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:19:08.626 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T23:19:08.626 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:19:08.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.624+0000 7fa231b0e640 1 -- 172.21.15.90:0/3082390597 >> [v2:172.21.15.171:6826/126573870,v1:172.21.15.171:6827/126573870] conn(0x7fa21807e0b0 msgr2=0x7fa2180804d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.624+0000 7fa231b0e640 1 --2- 172.21.15.90:0/3082390597 >> [v2:172.21.15.171:6826/126573870,v1:172.21.15.171:6827/126573870] conn(0x7fa21807e0b0 0x7fa2180804d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.625+0000 7fa231b0e640 1 -- 172.21.15.90:0/3082390597 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa218077f70 msgr2=0x7fa21807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.625+0000 7fa231b0e640 1 --2- 172.21.15.90:0/3082390597 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fa218077f70 0x7fa21807a430 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa21c005fd0 tx=0x7fa21c005bc0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.625+0000 7fa231b0e640 1 -- 172.21.15.90:0/3082390597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c0d4090 msgr2=0x7fa22c160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.625+0000 7fa231b0e640 1 --2- 172.21.15.90:0/3082390597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa22c0d4090 0x7fa22c160780 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fa220000c00 tx=0x7fa220032d50 comp rx=0 tx=0).stop 2024-09-10T23:19:08.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.625+0000 7fa22bfff640 1 -- 172.21.15.90:0/3082390597 reap_dead start 2024-09-10T23:19:08.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.625+0000 7fa231b0e640 1 -- 172.21.15.90:0/3082390597 shutdown_connections 2024-09-10T23:19:08.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.625+0000 7fa231b0e640 1 -- 172.21.15.90:0/3082390597 >> 172.21.15.90:0/3082390597 conn(0x7fa22c074c20 msgr2=0x7fa22c0b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:08.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.625+0000 7fa231b0e640 1 -- 172.21.15.90:0/3082390597 shutdown_connections 2024-09-10T23:19:08.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.625+0000 7fa231b0e640 1 -- 172.21.15.90:0/3082390597 wait complete. 2024-09-10T23:19:08.636 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-10T23:19:08.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.737+0000 7fc307d52640 1 -- 172.21.15.90:0/2862684626 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc30006f660 msgr2=0x7fc3000739b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.737+0000 7fc307d52640 1 --2- 172.21.15.90:0/2862684626 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc30006f660 0x7fc3000739b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009830 tx=0x7fc2f002a510 comp rx=0 tx=0).stop 2024-09-10T23:19:08.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.737+0000 7fc307d52640 1 -- 172.21.15.90:0/2862684626 shutdown_connections 2024-09-10T23:19:08.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.737+0000 7fc307d52640 1 --2- 172.21.15.90:0/2862684626 >> v2:172.21.15.171:3300/0 conn(0x7fc300073ef0 0x7fc3000b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.737+0000 7fc307d52640 1 --2- 172.21.15.90:0/2862684626 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc30006f660 0x7fc3000739b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.737+0000 7fc307d52640 1 -- 172.21.15.90:0/2862684626 >> 172.21.15.90:0/2862684626 conn(0x7fc30006d1a0 msgr2=0x7fc3000b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:08.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.737+0000 7fc307d52640 1 -- 172.21.15.90:0/2862684626 shutdown_connections 2024-09-10T23:19:08.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.737+0000 7fc307d52640 1 -- 172.21.15.90:0/2862684626 wait complete. 2024-09-10T23:19:08.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.739+0000 7fc307d52640 1 Processor -- start 2024-09-10T23:19:08.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.739+0000 7fc307d52640 1 -- start start 2024-09-10T23:19:08.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.739+0000 7fc307d52640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc30006f660 0x7fc300146850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.739+0000 7fc307d52640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc300073ef0 0x7fc30014e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.739+0000 7fc307d52640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc30015ae70 0x7fc3001f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.739+0000 7fc307d52640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc3000b4050 con 0x7fc300073ef0 2024-09-10T23:19:08.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.739+0000 7fc307d52640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc3000b3ed0 con 0x7fc30006f660 2024-09-10T23:19:08.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.739+0000 7fc307d52640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc3000b41d0 con 0x7fc30015ae70 2024-09-10T23:19:08.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.739+0000 7fc3052ed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc300073ef0 0x7fc30014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.739+0000 7fc3052ed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc300073ef0 0x7fc30014e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42064/0 (socket says 172.21.15.90:42064) 2024-09-10T23:19:08.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.739+0000 7fc3052ed640 1 -- 172.21.15.90:0/1417956716 learned_addr learned my addr 172.21.15.90:0/1417956716 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:08.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.740+0000 7fc3062ef640 1 --2- 172.21.15.90:0/1417956716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc30015ae70 0x7fc3001f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.740+0000 7fc305aee640 1 --2- 172.21.15.90:0/1417956716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc30006f660 0x7fc300146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.740+0000 7fc3052ed640 1 -- 172.21.15.90:0/1417956716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc30015ae70 msgr2=0x7fc3001f4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.740+0000 7fc3052ed640 1 --2- 172.21.15.90:0/1417956716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc30015ae70 0x7fc3001f4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.740+0000 7fc3052ed640 1 -- 172.21.15.90:0/1417956716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc30006f660 msgr2=0x7fc300146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.740+0000 7fc3052ed640 1 --2- 172.21.15.90:0/1417956716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc30006f660 0x7fc300146850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.740+0000 7fc3052ed640 1 -- 172.21.15.90:0/1417956716 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3001f5920 con 0x7fc300073ef0 2024-09-10T23:19:08.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.740+0000 7fc3052ed640 1 --2- 172.21.15.90:0/1417956716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc300073ef0 0x7fc30014e660 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009950 tx=0x7fc2f0032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:08.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.740+0000 7fc2f67fc640 1 -- 172.21.15.90:0/1417956716 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0040070 con 0x7fc300073ef0 2024-09-10T23:19:08.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.740+0000 7fc2f67fc640 1 -- 172.21.15.90:0/1417956716 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2f0005310 con 0x7fc300073ef0 2024-09-10T23:19:08.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.740+0000 7fc307d52640 1 -- 172.21.15.90:0/1417956716 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3001f5c00 con 0x7fc300073ef0 2024-09-10T23:19:08.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.740+0000 7fc2f67fc640 1 -- 172.21.15.90:0/1417956716 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0005c90 con 0x7fc300073ef0 2024-09-10T23:19:08.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.740+0000 7fc307d52640 1 -- 172.21.15.90:0/1417956716 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc30014e140 con 0x7fc300073ef0 2024-09-10T23:19:08.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.741+0000 7fc307d52640 1 -- 172.21.15.90:0/1417956716 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3000b46f0 con 0x7fc300073ef0 2024-09-10T23:19:08.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.742+0000 7fc2f67fc640 1 -- 172.21.15.90:0/1417956716 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc2f004c030 con 0x7fc300073ef0 2024-09-10T23:19:08.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.743+0000 7fc2f67fc640 1 --2- 172.21.15.90:0/1417956716 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc2e4077f70 0x7fc2e407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:08.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.743+0000 7fc2f67fc640 1 -- 172.21.15.90:0/1417956716 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7fc2f00bac30 con 0x7fc300073ef0 2024-09-10T23:19:08.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.743+0000 7fc305aee640 1 --2- 172.21.15.90:0/1417956716 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc2e4077f70 0x7fc2e407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:08.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.743+0000 7fc305aee640 1 --2- 172.21.15.90:0/1417956716 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc2e4077f70 0x7fc2e407a430 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc007fd0 tx=0x7fc2fc001370 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:08.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.747+0000 7fc2f67fc640 1 -- 172.21.15.90:0/1417956716 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc2f00838d0 con 0x7fc300073ef0 2024-09-10T23:19:08.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.919+0000 7fc307d52640 1 -- 172.21.15.90:0/1417956716 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fc3001f5dd0 con 0x7fc2e4077f70 2024-09-10T23:19:08.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.920+0000 7fc2f67fc640 1 -- 172.21.15.90:0/1417956716 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc3001f5dd0 con 0x7fc2e4077f70 2024-09-10T23:19:08.921 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 6 to deep-scrub 2024-09-10T23:19:08.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.922+0000 7fc307d52640 1 -- 172.21.15.90:0/1417956716 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc2e4077f70 msgr2=0x7fc2e407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.922+0000 7fc307d52640 1 --2- 172.21.15.90:0/1417956716 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc2e4077f70 0x7fc2e407a430 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc007fd0 tx=0x7fc2fc001370 comp rx=0 tx=0).stop 2024-09-10T23:19:08.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.922+0000 7fc307d52640 1 -- 172.21.15.90:0/1417956716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc300073ef0 msgr2=0x7fc30014e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:08.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.922+0000 7fc307d52640 1 --2- 172.21.15.90:0/1417956716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc300073ef0 0x7fc30014e660 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009950 tx=0x7fc2f0032c10 comp rx=0 tx=0).stop 2024-09-10T23:19:08.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.922+0000 7fc307d52640 1 -- 172.21.15.90:0/1417956716 shutdown_connections 2024-09-10T23:19:08.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.922+0000 7fc307d52640 1 --2- 172.21.15.90:0/1417956716 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fc2e4077f70 0x7fc2e407a430 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.922+0000 7fc307d52640 1 --2- 172.21.15.90:0/1417956716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc30015ae70 0x7fc3001f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.922+0000 7fc307d52640 1 --2- 172.21.15.90:0/1417956716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc300073ef0 0x7fc30014e660 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.922+0000 7fc307d52640 1 --2- 172.21.15.90:0/1417956716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc30006f660 0x7fc300146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:08.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.922+0000 7fc307d52640 1 -- 172.21.15.90:0/1417956716 >> 172.21.15.90:0/1417956716 conn(0x7fc30006d1a0 msgr2=0x7fc3000b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:08.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.922+0000 7fc307d52640 1 -- 172.21.15.90:0/1417956716 shutdown_connections 2024-09-10T23:19:08.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:08.922+0000 7fc307d52640 1 -- 172.21.15.90:0/1417956716 wait complete. 2024-09-10T23:19:08.933 INFO:tasks.ceph:Scrubbing osd.7 2024-09-10T23:19:08.933 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-10T23:19:09.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.037+0000 7f14f16cd640 1 -- 172.21.15.90:0/2893635298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14d8003a00 msgr2=0x7f14d8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:09.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.038+0000 7f14f16cd640 1 --2- 172.21.15.90:0/2893635298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14d8003a00 0x7f14d8003e20 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f14dc005fd0 tx=0x7f14d8005830 comp rx=0 tx=0).stop 2024-09-10T23:19:09.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.038+0000 7f14eb7fe640 1 -- 172.21.15.90:0/2893635298 reap_dead start 2024-09-10T23:19:09.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.038+0000 7f14f16cd640 1 -- 172.21.15.90:0/2893635298 shutdown_connections 2024-09-10T23:19:09.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.038+0000 7f14f16cd640 1 -- 172.21.15.90:0/2893635298 >> 172.21.15.90:0/2893635298 conn(0x7f14ec074c20 msgr2=0x7f14ec09d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:09.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.038+0000 7f14f16cd640 1 -- 172.21.15.90:0/2893635298 shutdown_connections 2024-09-10T23:19:09.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.038+0000 7f14f16cd640 1 -- 172.21.15.90:0/2893635298 wait complete. 2024-09-10T23:19:09.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.039+0000 7f14f16cd640 1 Processor -- start 2024-09-10T23:19:09.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.039+0000 7f14f16cd640 1 -- start start 2024-09-10T23:19:09.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14f16cd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14d8003a00 0x7f14ec0b9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:09.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14f16cd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14ec1f8200 0x7f14ec1f8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:09.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14f16cd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14ec1f8bc0 0x7f14ec1f4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:09.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14f16cd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec0d4540 con 0x7f14d8003a00 2024-09-10T23:19:09.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14f16cd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec0b3b20 con 0x7f14ec1f8200 2024-09-10T23:19:09.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14f16cd640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f14ec0d46c0 con 0x7f14ec1f8bc0 2024-09-10T23:19:09.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14eaffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14d8003a00 0x7f14ec0b9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:09.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14eaffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14d8003a00 0x7f14ec0b9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42076/0 (socket says 172.21.15.90:42076) 2024-09-10T23:19:09.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14eaffd640 1 -- 172.21.15.90:0/2726280394 learned_addr learned my addr 172.21.15.90:0/2726280394 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:09.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14eaffd640 1 -- 172.21.15.90:0/2726280394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14ec1f8bc0 msgr2=0x7f14ec1f4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:09.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14eaffd640 1 --2- 172.21.15.90:0/2726280394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14ec1f8bc0 0x7f14ec1f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14eaffd640 1 -- 172.21.15.90:0/2726280394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14ec1f8200 msgr2=0x7f14ec1f8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:09.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14eaffd640 1 --2- 172.21.15.90:0/2726280394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14ec1f8200 0x7f14ec1f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14eaffd640 1 -- 172.21.15.90:0/2726280394 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14ec0cd980 con 0x7f14d8003a00 2024-09-10T23:19:09.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14eaffd640 1 --2- 172.21.15.90:0/2726280394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14d8003a00 0x7f14ec0b9ad0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f14dc009d70 tx=0x7f14dc0336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:09.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14e37fe640 1 -- 172.21.15.90:0/2726280394 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc038040 con 0x7f14d8003a00 2024-09-10T23:19:09.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14e37fe640 1 -- 172.21.15.90:0/2726280394 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14dc041070 con 0x7f14d8003a00 2024-09-10T23:19:09.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14f16cd640 1 -- 172.21.15.90:0/2726280394 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14ec0cdc60 con 0x7f14d8003a00 2024-09-10T23:19:09.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.040+0000 7f14e37fe640 1 -- 172.21.15.90:0/2726280394 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc033ac0 con 0x7f14d8003a00 2024-09-10T23:19:09.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.041+0000 7f14f16cd640 1 -- 172.21.15.90:0/2726280394 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ec0ce220 con 0x7f14d8003a00 2024-09-10T23:19:09.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.041+0000 7f14f16cd640 1 -- 172.21.15.90:0/2726280394 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f14ec1f9050 con 0x7f14d8003a00 2024-09-10T23:19:09.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.042+0000 7f14e37fe640 1 -- 172.21.15.90:0/2726280394 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f14dc03b070 con 0x7f14d8003a00 2024-09-10T23:19:09.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.043+0000 7f14e37fe640 1 --2- 172.21.15.90:0/2726280394 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14cc077fa0 0x7f14cc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:09.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.043+0000 7f14e37fe640 1 -- 172.21.15.90:0/2726280394 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7f14dc0baa70 con 0x7f14d8003a00 2024-09-10T23:19:09.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.043+0000 7f14e37fe640 1 --2- 172.21.15.90:0/2726280394 >> [v2:172.21.15.171:6802/3756038245,v1:172.21.15.171:6803/3756038245] conn(0x7f14cc07e0e0 0x7f14cc080500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:09.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.043+0000 7f14e37fe640 1 -- 172.21.15.90:0/2726280394 --> [v2:172.21.15.171:6802/3756038245,v1:172.21.15.171:6803/3756038245] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14dc02ce50 con 0x7f14cc07e0e0 2024-09-10T23:19:09.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.043+0000 7f14e37fe640 1 -- 172.21.15.90:0/2726280394 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) ==== 24+0+0 (secure 0 0 0) 0x7f14dc0baf00 con 0x7f14d8003a00 2024-09-10T23:19:09.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.043+0000 7f14ea7fc640 1 --2- 172.21.15.90:0/2726280394 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14cc077fa0 0x7f14cc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:09.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.043+0000 7f14eb7fe640 1 --2- 172.21.15.90:0/2726280394 >> [v2:172.21.15.171:6802/3756038245,v1:172.21.15.171:6803/3756038245] conn(0x7f14cc07e0e0 0x7f14cc080500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:09.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.043+0000 7f14ea7fc640 1 --2- 172.21.15.90:0/2726280394 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14cc077fa0 0x7f14cc07a460 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f14d4005bc0 tx=0x7f14d4005a70 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:09.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.044+0000 7f14eb7fe640 1 --2- 172.21.15.90:0/2726280394 >> [v2:172.21.15.171:6802/3756038245,v1:172.21.15.171:6803/3756038245] conn(0x7f14cc07e0e0 0x7f14cc080500 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:09.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.044+0000 7f14e37fe640 1 -- 172.21.15.90:0/2726280394 <== osd.7 v2:172.21.15.171:6802/3756038245 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14dc02ce50 con 0x7f14cc07e0e0 2024-09-10T23:19:09.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.057+0000 7f14f16cd640 1 -- 172.21.15.90:0/2726280394 --> [v2:172.21.15.171:6802/3756038245,v1:172.21.15.171:6803/3756038245] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f14ec0ce600 con 0x7f14cc07e0e0 2024-09-10T23:19:09.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.057+0000 7f14e37fe640 1 -- 172.21.15.90:0/2726280394 <== osd.7 v2:172.21.15.171:6802/3756038245 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f14ec0ce600 con 0x7f14cc07e0e0 2024-09-10T23:19:09.058 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-10T23:19:09.058 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T23:19:09.058 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-10T23:19:09.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.057+0000 7f14f16cd640 1 -- 172.21.15.90:0/2726280394 >> [v2:172.21.15.171:6802/3756038245,v1:172.21.15.171:6803/3756038245] conn(0x7f14cc07e0e0 msgr2=0x7f14cc080500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:09.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.057+0000 7f14f16cd640 1 --2- 172.21.15.90:0/2726280394 >> [v2:172.21.15.171:6802/3756038245,v1:172.21.15.171:6803/3756038245] conn(0x7f14cc07e0e0 0x7f14cc080500 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.058+0000 7f14f16cd640 1 -- 172.21.15.90:0/2726280394 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14cc077fa0 msgr2=0x7f14cc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:09.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.058+0000 7f14f16cd640 1 --2- 172.21.15.90:0/2726280394 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f14cc077fa0 0x7f14cc07a460 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f14d4005bc0 tx=0x7f14d4005a70 comp rx=0 tx=0).stop 2024-09-10T23:19:09.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.058+0000 7f14f16cd640 1 -- 172.21.15.90:0/2726280394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14d8003a00 msgr2=0x7f14ec0b9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:09.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.058+0000 7f14f16cd640 1 --2- 172.21.15.90:0/2726280394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14d8003a00 0x7f14ec0b9ad0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f14dc009d70 tx=0x7f14dc0336f0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.058+0000 7f14eb7fe640 1 -- 172.21.15.90:0/2726280394 reap_dead start 2024-09-10T23:19:09.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.058+0000 7f14f16cd640 1 -- 172.21.15.90:0/2726280394 shutdown_connections 2024-09-10T23:19:09.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.058+0000 7f14f16cd640 1 -- 172.21.15.90:0/2726280394 >> 172.21.15.90:0/2726280394 conn(0x7f14ec074c20 msgr2=0x7f14ec1e6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:09.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.058+0000 7f14f16cd640 1 -- 172.21.15.90:0/2726280394 shutdown_connections 2024-09-10T23:19:09.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.058+0000 7f14f16cd640 1 -- 172.21.15.90:0/2726280394 wait complete. 2024-09-10T23:19:09.068 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-10T23:19:09.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.169+0000 7f0c20f84640 1 -- 172.21.15.90:0/2577094032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c080051c0 msgr2=0x7f0c0800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:09.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.169+0000 7f0c20f84640 1 --2- 172.21.15.90:0/2577094032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c080051c0 0x7f0c0800b9c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009ed0 tx=0x7f0c08005830 comp rx=0 tx=0).stop 2024-09-10T23:19:09.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.169+0000 7f0c20f84640 1 -- 172.21.15.90:0/2577094032 shutdown_connections 2024-09-10T23:19:09.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.169+0000 7f0c20f84640 1 --2- 172.21.15.90:0/2577094032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c080051c0 0x7f0c0800b9c0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.169+0000 7f0c20f84640 1 -- 172.21.15.90:0/2577094032 >> 172.21.15.90:0/2577094032 conn(0x7f0c1c06d1a0 msgr2=0x7f0c1c0b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:09.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.169+0000 7f0c20f84640 1 -- 172.21.15.90:0/2577094032 shutdown_connections 2024-09-10T23:19:09.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.169+0000 7f0c20f84640 1 -- 172.21.15.90:0/2577094032 wait complete. 2024-09-10T23:19:09.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.171+0000 7f0c20f84640 1 Processor -- start 2024-09-10T23:19:09.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.171+0000 7f0c20f84640 1 -- start start 2024-09-10T23:19:09.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.171+0000 7f0c20f84640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c080051c0 0x7f0c1c14fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:09.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.171+0000 7f0c20f84640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c1c151500 0x7f0c1c1f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:09.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.171+0000 7f0c20f84640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c1c151980 0x7f0c1c1f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:09.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.171+0000 7f0c20f84640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1c0ae790 con 0x7f0c1c151500 2024-09-10T23:19:09.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.171+0000 7f0c20f84640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1c0ae910 con 0x7f0c080051c0 2024-09-10T23:19:09.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.171+0000 7f0c20f84640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0c1c0aea90 con 0x7f0c1c151980 2024-09-10T23:19:09.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.171+0000 7f0c11d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c1c151500 0x7f0c1c1f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:09.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.171+0000 7f0c11d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c1c151500 0x7f0c1c1f5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42092/0 (socket says 172.21.15.90:42092) 2024-09-10T23:19:09.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.171+0000 7f0c11d9b640 1 -- 172.21.15.90:0/4005157137 learned_addr learned my addr 172.21.15.90:0/4005157137 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:09.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.172+0000 7f0c1ad9d640 1 --2- 172.21.15.90:0/4005157137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c1c151980 0x7f0c1c1f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:09.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.172+0000 7f0c1a59c640 1 --2- 172.21.15.90:0/4005157137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c080051c0 0x7f0c1c14fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:09.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.172+0000 7f0c11d9b640 1 -- 172.21.15.90:0/4005157137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c1c151980 msgr2=0x7f0c1c1f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:09.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.172+0000 7f0c11d9b640 1 --2- 172.21.15.90:0/4005157137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c1c151980 0x7f0c1c1f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.172+0000 7f0c11d9b640 1 -- 172.21.15.90:0/4005157137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c080051c0 msgr2=0x7f0c1c14fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:09.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.172+0000 7f0c11d9b640 1 --2- 172.21.15.90:0/4005157137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c080051c0 0x7f0c1c14fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.172+0000 7f0c11d9b640 1 -- 172.21.15.90:0/4005157137 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c1c152510 con 0x7f0c1c151500 2024-09-10T23:19:09.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.172+0000 7f0c1a59c640 1 --2- 172.21.15.90:0/4005157137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c080051c0 0x7f0c1c14fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:09.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.172+0000 7f0c11d9b640 1 --2- 172.21.15.90:0/4005157137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c1c151500 0x7f0c1c1f5f60 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f0c04000fb0 tx=0x7f0c0400ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:09.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.172+0000 7f0c137fe640 1 -- 172.21.15.90:0/4005157137 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c04015070 con 0x7f0c1c151500 2024-09-10T23:19:09.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.172+0000 7f0c137fe640 1 -- 172.21.15.90:0/4005157137 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c04010980 con 0x7f0c1c151500 2024-09-10T23:19:09.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.172+0000 7f0c20f84640 1 -- 172.21.15.90:0/4005157137 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c1c155720 con 0x7f0c1c151500 2024-09-10T23:19:09.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.172+0000 7f0c137fe640 1 -- 172.21.15.90:0/4005157137 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c04010d50 con 0x7f0c1c151500 2024-09-10T23:19:09.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.172+0000 7f0c20f84640 1 -- 172.21.15.90:0/4005157137 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c1c152230 con 0x7f0c1c151500 2024-09-10T23:19:09.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.173+0000 7f0c20f84640 1 -- 172.21.15.90:0/4005157137 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c1c155510 con 0x7f0c1c151500 2024-09-10T23:19:09.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.174+0000 7f0c137fe640 1 -- 172.21.15.90:0/4005157137 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0c04011460 con 0x7f0c1c151500 2024-09-10T23:19:09.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.174+0000 7f0c137fe640 1 --2- 172.21.15.90:0/4005157137 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0bfc077fa0 0x7f0bfc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:09.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.174+0000 7f0c137fe640 1 -- 172.21.15.90:0/4005157137 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7f0c0409a0f0 con 0x7f0c1c151500 2024-09-10T23:19:09.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.174+0000 7f0c1a59c640 1 --2- 172.21.15.90:0/4005157137 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0bfc077fa0 0x7f0bfc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:09.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.175+0000 7f0c1a59c640 1 --2- 172.21.15.90:0/4005157137 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0bfc077fa0 0x7f0bfc07a460 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c000c00 tx=0x7f0c0c006b70 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:09.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.178+0000 7f0c137fe640 1 -- 172.21.15.90:0/4005157137 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0c04062e20 con 0x7f0c1c151500 2024-09-10T23:19:09.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.352+0000 7f0c20f84640 1 -- 172.21.15.90:0/4005157137 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f0c1c0aeff0 con 0x7f0bfc077fa0 2024-09-10T23:19:09.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.352+0000 7f0c137fe640 1 -- 172.21.15.90:0/4005157137 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0c1c0aeff0 con 0x7f0bfc077fa0 2024-09-10T23:19:09.353 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 7 to deep-scrub 2024-09-10T23:19:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.354+0000 7f0c20f84640 1 -- 172.21.15.90:0/4005157137 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0bfc077fa0 msgr2=0x7f0bfc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.354+0000 7f0c20f84640 1 --2- 172.21.15.90:0/4005157137 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0bfc077fa0 0x7f0bfc07a460 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c000c00 tx=0x7f0c0c006b70 comp rx=0 tx=0).stop 2024-09-10T23:19:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.354+0000 7f0c20f84640 1 -- 172.21.15.90:0/4005157137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c1c151500 msgr2=0x7f0c1c1f5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.354+0000 7f0c20f84640 1 --2- 172.21.15.90:0/4005157137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c1c151500 0x7f0c1c1f5f60 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f0c04000fb0 tx=0x7f0c0400ea20 comp rx=0 tx=0).stop 2024-09-10T23:19:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.354+0000 7f0c20f84640 1 -- 172.21.15.90:0/4005157137 shutdown_connections 2024-09-10T23:19:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.354+0000 7f0c20f84640 1 --2- 172.21.15.90:0/4005157137 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f0bfc077fa0 0x7f0bfc07a460 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.355+0000 7f0c20f84640 1 --2- 172.21.15.90:0/4005157137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c1c151980 0x7f0c1c1f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.355+0000 7f0c20f84640 1 --2- 172.21.15.90:0/4005157137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c1c151500 0x7f0c1c1f5f60 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.355+0000 7f0c20f84640 1 --2- 172.21.15.90:0/4005157137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c080051c0 0x7f0c1c14fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.355+0000 7f0c20f84640 1 -- 172.21.15.90:0/4005157137 >> 172.21.15.90:0/4005157137 conn(0x7f0c1c06d1a0 msgr2=0x7f0c1c15d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.355+0000 7f0c20f84640 1 -- 172.21.15.90:0/4005157137 shutdown_connections 2024-09-10T23:19:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.355+0000 7f0c20f84640 1 -- 172.21.15.90:0/4005157137 wait complete. 2024-09-10T23:19:09.366 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:19:09.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.465+0000 7eff8c0cf640 1 -- 172.21.15.90:0/2493677000 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff840d2960 msgr2=0x7eff840b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:09.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.465+0000 7eff8c0cf640 1 --2- 172.21.15.90:0/2493677000 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff840d2960 0x7eff840b0eb0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7eff840d3740 tx=0x7eff7802a4a0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.465+0000 7eff8c0cf640 1 -- 172.21.15.90:0/2493677000 shutdown_connections 2024-09-10T23:19:09.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.465+0000 7eff8c0cf640 1 --2- 172.21.15.90:0/2493677000 >> v2:172.21.15.171:3300/0 conn(0x7eff840d4d00 0x7eff840b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.465+0000 7eff8c0cf640 1 --2- 172.21.15.90:0/2493677000 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff840d2960 0x7eff840b0eb0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.465+0000 7eff8c0cf640 1 -- 172.21.15.90:0/2493677000 >> 172.21.15.90:0/2493677000 conn(0x7eff840d41e0 msgr2=0x7eff840d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:09.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.465+0000 7eff8c0cf640 1 -- 172.21.15.90:0/2493677000 shutdown_connections 2024-09-10T23:19:09.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.465+0000 7eff8c0cf640 1 -- 172.21.15.90:0/2493677000 wait complete. 2024-09-10T23:19:09.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.466+0000 7eff8c0cf640 1 Processor -- start 2024-09-10T23:19:09.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.466+0000 7eff8c0cf640 1 -- start start 2024-09-10T23:19:09.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.467+0000 7eff8c0cf640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff840d2960 0x7eff840d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:09.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.467+0000 7eff8c0cf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff840d4d00 0x7eff8414a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:09.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.467+0000 7eff8c0cf640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff841616c0 0x7eff8414a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:09.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.467+0000 7eff8c0cf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7eff8406e8f0 con 0x7eff840d4d00 2024-09-10T23:19:09.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.467+0000 7eff8c0cf640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7eff8406e770 con 0x7eff841616c0 2024-09-10T23:19:09.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.467+0000 7eff8c0cf640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7eff8406ea70 con 0x7eff840d2960 2024-09-10T23:19:09.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.467+0000 7eff8966a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff840d4d00 0x7eff8414a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:09.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.467+0000 7eff8966a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff840d4d00 0x7eff8414a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42106/0 (socket says 172.21.15.90:42106) 2024-09-10T23:19:09.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.467+0000 7eff8966a640 1 -- 172.21.15.90:0/2062858911 learned_addr learned my addr 172.21.15.90:0/2062858911 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:09.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.467+0000 7eff8a66c640 1 --2- 172.21.15.90:0/2062858911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff841616c0 0x7eff8414a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:09.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.467+0000 7eff89e6b640 1 --2- 172.21.15.90:0/2062858911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff840d2960 0x7eff840d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:09.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.468+0000 7eff8966a640 1 -- 172.21.15.90:0/2062858911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff840d2960 msgr2=0x7eff840d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:09.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.468+0000 7eff8966a640 1 --2- 172.21.15.90:0/2062858911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff840d2960 0x7eff840d0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.468+0000 7eff8966a640 1 -- 172.21.15.90:0/2062858911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff841616c0 msgr2=0x7eff8414a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:09.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.468+0000 7eff8966a640 1 --2- 172.21.15.90:0/2062858911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff841616c0 0x7eff8414a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.468+0000 7eff8966a640 1 -- 172.21.15.90:0/2062858911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff8414ac70 con 0x7eff840d4d00 2024-09-10T23:19:09.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.468+0000 7eff89e6b640 1 --2- 172.21.15.90:0/2062858911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff840d2960 0x7eff840d0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:09.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.468+0000 7eff8966a640 1 --2- 172.21.15.90:0/2062858911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff840d4d00 0x7eff8414a140 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7eff78009780 tx=0x7eff78032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:09.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.468+0000 7eff827fc640 1 -- 172.21.15.90:0/2062858911 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff78040070 con 0x7eff840d4d00 2024-09-10T23:19:09.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.468+0000 7eff827fc640 1 -- 172.21.15.90:0/2062858911 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff78005310 con 0x7eff840d4d00 2024-09-10T23:19:09.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.468+0000 7eff8c0cf640 1 -- 172.21.15.90:0/2062858911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff8414af50 con 0x7eff840d4d00 2024-09-10T23:19:09.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.468+0000 7eff827fc640 1 -- 172.21.15.90:0/2062858911 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff780047a0 con 0x7eff840d4d00 2024-09-10T23:19:09.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.468+0000 7eff8c0cf640 1 -- 172.21.15.90:0/2062858911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff84148610 con 0x7eff840d4d00 2024-09-10T23:19:09.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.469+0000 7eff8c0cf640 1 -- 172.21.15.90:0/2062858911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff8408bfc0 con 0x7eff840d4d00 2024-09-10T23:19:09.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.469+0000 7eff827fc640 1 -- 172.21.15.90:0/2062858911 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7eff7804c030 con 0x7eff840d4d00 2024-09-10T23:19:09.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.470+0000 7eff827fc640 1 --2- 172.21.15.90:0/2062858911 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff70077fa0 0x7eff7007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:09.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.470+0000 7eff827fc640 1 -- 172.21.15.90:0/2062858911 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7eff780bae50 con 0x7eff840d4d00 2024-09-10T23:19:09.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.470+0000 7eff89e6b640 1 --2- 172.21.15.90:0/2062858911 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff70077fa0 0x7eff7007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:09.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.471+0000 7eff89e6b640 1 --2- 172.21.15.90:0/2062858911 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff70077fa0 0x7eff7007a460 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7eff7c0016a0 tx=0x7eff7c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:09.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.474+0000 7eff827fc640 1 -- 172.21.15.90:0/2062858911 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7eff8408bfc0 con 0x7eff840d4d00 2024-09-10T23:19:09.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.643+0000 7eff8c0cf640 1 -- 172.21.15.90:0/2062858911 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff84074c20 con 0x7eff70077fa0 2024-09-10T23:19:09.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.644+0000 7eff827fc640 1 -- 172.21.15.90:0/2062858911 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13480 (secure 0 0 0) 0x7eff84074c20 con 0x7eff70077fa0 2024-09-10T23:19:09.645 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:09.645 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:19:09.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.646+0000 7eff8c0cf640 1 -- 172.21.15.90:0/2062858911 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff70077fa0 msgr2=0x7eff7007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:09.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.646+0000 7eff8c0cf640 1 --2- 172.21.15.90:0/2062858911 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff70077fa0 0x7eff7007a460 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7eff7c0016a0 tx=0x7eff7c009040 comp rx=0 tx=0).stop 2024-09-10T23:19:09.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.646+0000 7eff8c0cf640 1 -- 172.21.15.90:0/2062858911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff840d4d00 msgr2=0x7eff8414a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:09.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.646+0000 7eff8c0cf640 1 --2- 172.21.15.90:0/2062858911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff840d4d00 0x7eff8414a140 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7eff78009780 tx=0x7eff78032c10 comp rx=0 tx=0).stop 2024-09-10T23:19:09.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.646+0000 7eff8c0cf640 1 -- 172.21.15.90:0/2062858911 shutdown_connections 2024-09-10T23:19:09.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.646+0000 7eff8c0cf640 1 --2- 172.21.15.90:0/2062858911 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7eff70077fa0 0x7eff7007a460 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.646+0000 7eff8c0cf640 1 --2- 172.21.15.90:0/2062858911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff841616c0 0x7eff8414a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.646+0000 7eff8c0cf640 1 --2- 172.21.15.90:0/2062858911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff840d4d00 0x7eff8414a140 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.646+0000 7eff8c0cf640 1 --2- 172.21.15.90:0/2062858911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff840d2960 0x7eff840d0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:09.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.646+0000 7eff8c0cf640 1 -- 172.21.15.90:0/2062858911 >> 172.21.15.90:0/2062858911 conn(0x7eff840d41e0 msgr2=0x7eff8415f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:09.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.646+0000 7eff8c0cf640 1 -- 172.21.15.90:0/2062858911 shutdown_connections 2024-09-10T23:19:09.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:09.646+0000 7eff8c0cf640 1 -- 172.21.15.90:0/2062858911 wait complete. 2024-09-10T23:19:09.658 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":247,"stamp":"2024-09-10T23:19:08.499660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":24,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":261484,"kb_used_data":11944,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713236,"statfs":{"total":773094113280,"available":772826353664,"internally_reserved":0,"allocated":12230656,"data_stored":5897504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-24607,"num_objects":-41,"num_object_clones":0,"num_object_copies":-82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-41,"num_whiteouts":0,"num_read":-93,"num_read_kb":-87,"num_write":-159,"num_write_kb":-84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001712"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":271,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-10T23:19:02.121674+0000","last_change":"2024-09-10T23:14:28.157861+0000","last_active":"2024-09-10T23:19:02.121674+0000","last_peered":"2024-09-10T23:19:02.121674+0000","last_clean":"2024-09-10T23:19:02.121674+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:19:02.121674+0000","last_undegraded":"2024-09-10T23:19:02.121674+0000","last_fullsized":"2024-09-10T23:19:02.121674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:14:27.080162+0000","last_clean_scrub_stamp":"2024-09-10T23:14:27.080162+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:08.593092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509500,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33120,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338720,"statfs":{"total":96636764160,"available":96602849280,"internally_reserved":0,"allocated":1974272,"data_stored":1179964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32540,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1380352,"data_stored":589596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32540,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1380352,"data_stored":589596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32540,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1380352,"data_stored":589596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32544,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1380352,"data_stored":589596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32540,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1380352,"data_stored":589596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32540,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1380352,"data_stored":589596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33120,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338720,"statfs":{"total":96636764160,"available":96602849280,"internally_reserved":0,"allocated":1974272,"data_stored":1179964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:19:09.661 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T23:14:27.080162+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=23, tm_min=14, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=23, tm_min=19, tm_sec=4, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T23:19:09.661 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T23:19:25.458 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:19:25.461 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:19:29.662 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:19:29.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.776+0000 7fb57f2e4640 1 -- 172.21.15.90:0/4096025923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5780740c0 msgr2=0x7fb5780b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.776+0000 7fb57f2e4640 1 --2- 172.21.15.90:0/4096025923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5780740c0 0x7fb5780b3530 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fb570005fd0 tx=0x7fb57002aa00 comp rx=0 tx=0).stop 2024-09-10T23:19:29.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.776+0000 7fb57f2e4640 1 -- 172.21.15.90:0/4096025923 shutdown_connections 2024-09-10T23:19:29.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.776+0000 7fb57f2e4640 1 --2- 172.21.15.90:0/4096025923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5780740c0 0x7fb5780b3530 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.776+0000 7fb57f2e4640 1 --2- 172.21.15.90:0/4096025923 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb57815ae70 0x7fb5780ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.776+0000 7fb57f2e4640 1 -- 172.21.15.90:0/4096025923 >> 172.21.15.90:0/4096025923 conn(0x7fb57806d1a0 msgr2=0x7fb5780b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:29.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.776+0000 7fb57f2e4640 1 -- 172.21.15.90:0/4096025923 shutdown_connections 2024-09-10T23:19:29.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.776+0000 7fb57f2e4640 1 -- 172.21.15.90:0/4096025923 wait complete. 2024-09-10T23:19:29.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.777+0000 7fb57f2e4640 1 Processor -- start 2024-09-10T23:19:29.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.777+0000 7fb57f2e4640 1 -- start start 2024-09-10T23:19:29.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.778+0000 7fb57f2e4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb57806f660 0x7fb5781f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.778+0000 7fb57f2e4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5780740c0 0x7fb57815ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.778+0000 7fb57f2e4640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb57815ae70 0x7fb5781e6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.778+0000 7fb57f2e4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5780b4050 con 0x7fb57806f660 2024-09-10T23:19:29.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.778+0000 7fb57f2e4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb5780b3ed0 con 0x7fb5780740c0 2024-09-10T23:19:29.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.778+0000 7fb57f2e4640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb5780b41d0 con 0x7fb57815ae70 2024-09-10T23:19:29.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.778+0000 7fb57d080640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb57806f660 0x7fb5781f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.778+0000 7fb57d080640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb57806f660 0x7fb5781f2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:32896/0 (socket says 172.21.15.90:32896) 2024-09-10T23:19:29.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.778+0000 7fb57d080640 1 -- 172.21.15.90:0/2149217515 learned_addr learned my addr 172.21.15.90:0/2149217515 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:29.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.778+0000 7fb57d881640 1 --2- 172.21.15.90:0/2149217515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb57815ae70 0x7fb5781e6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.778+0000 7fb57c87f640 1 --2- 172.21.15.90:0/2149217515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5780740c0 0x7fb57815ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.778+0000 7fb57d080640 1 -- 172.21.15.90:0/2149217515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb57815ae70 msgr2=0x7fb5781e6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.778+0000 7fb57d080640 1 --2- 172.21.15.90:0/2149217515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb57815ae70 0x7fb5781e6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.778+0000 7fb57d080640 1 -- 172.21.15.90:0/2149217515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5780740c0 msgr2=0x7fb57815ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.778+0000 7fb57d080640 1 --2- 172.21.15.90:0/2149217515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5780740c0 0x7fb57815ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.778+0000 7fb57d080640 1 -- 172.21.15.90:0/2149217515 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb57815d8e0 con 0x7fb57806f660 2024-09-10T23:19:29.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.778+0000 7fb57c87f640 1 --2- 172.21.15.90:0/2149217515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5780740c0 0x7fb57815ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:29.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.779+0000 7fb57d080640 1 --2- 172.21.15.90:0/2149217515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb57806f660 0x7fb5781f2240 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fb57400b410 tx=0x7fb57400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:29.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.779+0000 7fb56dffb640 1 -- 172.21.15.90:0/2149217515 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb574015020 con 0x7fb57806f660 2024-09-10T23:19:29.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.779+0000 7fb56dffb640 1 -- 172.21.15.90:0/2149217515 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb574011940 con 0x7fb57806f660 2024-09-10T23:19:29.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.779+0000 7fb57f2e4640 1 -- 172.21.15.90:0/2149217515 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb57815dbc0 con 0x7fb57806f660 2024-09-10T23:19:29.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.779+0000 7fb56dffb640 1 -- 172.21.15.90:0/2149217515 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb574011d90 con 0x7fb57806f660 2024-09-10T23:19:29.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.779+0000 7fb57f2e4640 1 -- 172.21.15.90:0/2149217515 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5781f2780 con 0x7fb57806f660 2024-09-10T23:19:29.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.780+0000 7fb57f2e4640 1 -- 172.21.15.90:0/2149217515 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5780b4700 con 0x7fb57806f660 2024-09-10T23:19:29.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.781+0000 7fb56dffb640 1 -- 172.21.15.90:0/2149217515 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb57401a400 con 0x7fb57806f660 2024-09-10T23:19:29.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.781+0000 7fb56dffb640 1 --2- 172.21.15.90:0/2149217515 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb55c077fa0 0x7fb55c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.781+0000 7fb56dffb640 1 -- 172.21.15.90:0/2149217515 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7fb574099ea0 con 0x7fb57806f660 2024-09-10T23:19:29.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.781+0000 7fb57c87f640 1 --2- 172.21.15.90:0/2149217515 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb55c077fa0 0x7fb55c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.782+0000 7fb57c87f640 1 --2- 172.21.15.90:0/2149217515 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb55c077fa0 0x7fb55c07a460 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb568007fd0 tx=0x7fb568009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:29.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.785+0000 7fb56dffb640 1 -- 172.21.15.90:0/2149217515 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb57401f020 con 0x7fb57806f660 2024-09-10T23:19:29.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.958+0000 7fb57f2e4640 1 -- 172.21.15.90:0/2149217515 --> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5780b3540 con 0x7fb55c077fa0 2024-09-10T23:19:29.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.959+0000 7fb56dffb640 1 -- 172.21.15.90:0/2149217515 <== mgr.4123 v2:172.21.15.171:6800/1044758290 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13364 (secure 0 0 0) 0x7fb5780b3540 con 0x7fb55c077fa0 2024-09-10T23:19:29.960 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:29.960 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-09-10T23:19:29.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.961+0000 7fb57f2e4640 1 -- 172.21.15.90:0/2149217515 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb55c077fa0 msgr2=0x7fb55c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.961+0000 7fb57f2e4640 1 --2- 172.21.15.90:0/2149217515 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb55c077fa0 0x7fb55c07a460 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb568007fd0 tx=0x7fb568009040 comp rx=0 tx=0).stop 2024-09-10T23:19:29.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.961+0000 7fb57f2e4640 1 -- 172.21.15.90:0/2149217515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb57806f660 msgr2=0x7fb5781f2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.961+0000 7fb57f2e4640 1 --2- 172.21.15.90:0/2149217515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb57806f660 0x7fb5781f2240 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fb57400b410 tx=0x7fb57400b8d0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.961+0000 7fb57f2e4640 1 -- 172.21.15.90:0/2149217515 shutdown_connections 2024-09-10T23:19:29.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.961+0000 7fb57f2e4640 1 --2- 172.21.15.90:0/2149217515 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fb55c077fa0 0x7fb55c07a460 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.961+0000 7fb57f2e4640 1 --2- 172.21.15.90:0/2149217515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5780740c0 0x7fb57815ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.961+0000 7fb57f2e4640 1 --2- 172.21.15.90:0/2149217515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb57815ae70 0x7fb5781e6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.961+0000 7fb57f2e4640 1 --2- 172.21.15.90:0/2149217515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb57806f660 0x7fb5781f2240 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.961+0000 7fb57f2e4640 1 -- 172.21.15.90:0/2149217515 >> 172.21.15.90:0/2149217515 conn(0x7fb57806d1a0 msgr2=0x7fb57809c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:29.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.961+0000 7fb57f2e4640 1 -- 172.21.15.90:0/2149217515 shutdown_connections 2024-09-10T23:19:29.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:29.961+0000 7fb57f2e4640 1 -- 172.21.15.90:0/2149217515 wait complete. 2024-09-10T23:19:29.972 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2024-09-10T23:19:28.504401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":261468,"kb_used_data":11944,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713252,"statfs":{"total":773094113280,"available":772826370048,"internally_reserved":0,"allocated":12230656,"data_stored":5897504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002751"},"pg_stats":[{"pgid":"1.0","version":"111'74","reported_seq":281,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-10T23:19:10.301177+0000","last_change":"2024-09-10T23:19:10.301177+0000","last_active":"2024-09-10T23:19:10.301177+0000","last_peered":"2024-09-10T23:19:10.301177+0000","last_clean":"2024-09-10T23:19:10.301177+0000","last_became_active":"2024-09-10T23:14:28.156785+0000","last_became_peered":"2024-09-10T23:14:28.156785+0000","last_unstale":"2024-09-10T23:19:10.301177+0000","last_undegraded":"2024-09-10T23:19:10.301177+0000","last_fullsized":"2024-09-10T23:19:10.301177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'74","last_scrub_stamp":"2024-09-10T23:19:10.301074+0000","last_deep_scrub":"111'74","last_deep_scrub_stamp":"2024-09-10T23:19:10.301074+0000","last_clean_scrub_stamp":"2024-09-10T23:19:10.301074+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:47.267026+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509504,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33112,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":1974272,"data_stored":1179964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32540,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1380352,"data_stored":589596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32540,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1380352,"data_stored":589596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32540,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1380352,"data_stored":589596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32544,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1380352,"data_stored":589596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509504,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32540,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1380352,"data_stored":589596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32540,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1380352,"data_stored":589596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33112,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":1974272,"data_stored":1179964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:19:29.973 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T23:19:30.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.073+0000 7fe262fa1640 1 -- 172.21.15.90:0/641735321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe25c0ce4e0 msgr2=0x7fe25c0ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.073+0000 7fe262fa1640 1 --2- 172.21.15.90:0/641735321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe25c0ce4e0 0x7fe25c0ce920 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0698c0 tx=0x7fe25002a4d0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.073+0000 7fe262fa1640 1 -- 172.21.15.90:0/641735321 shutdown_connections 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.073+0000 7fe262fa1640 1 --2- 172.21.15.90:0/641735321 >> v2:172.21.15.171:3300/0 conn(0x7fe25c0d01a0 0x7fe25c0d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.073+0000 7fe262fa1640 1 --2- 172.21.15.90:0/641735321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe25c0ce4e0 0x7fe25c0ce920 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.073+0000 7fe262fa1640 1 --2- 172.21.15.90:0/641735321 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe25c15f230 0x7fe25c0b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.073+0000 7fe262fa1640 1 -- 172.21.15.90:0/641735321 >> 172.21.15.90:0/641735321 conn(0x7fe25c09a9e0 msgr2=0x7fe25c09adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.073+0000 7fe262fa1640 1 -- 172.21.15.90:0/641735321 shutdown_connections 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.073+0000 7fe262fa1640 1 -- 172.21.15.90:0/641735321 wait complete. 2024-09-10T23:19:30.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.074+0000 7fe262fa1640 1 Processor -- start 2024-09-10T23:19:30.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.074+0000 7fe262fa1640 1 -- start start 2024-09-10T23:19:30.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.075+0000 7fe262fa1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe25c0ce4e0 0x7fe25c1f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.075+0000 7fe262fa1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe25c0d01a0 0x7fe25c0c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.075+0000 7fe262fa1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe25c15f230 0x7fe25c0c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.075+0000 7fe262fa1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c0cc7b0 con 0x7fe25c0d01a0 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.075+0000 7fe262fa1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c0b2300 con 0x7fe25c0ce4e0 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.075+0000 7fe262fa1640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe25c0cc930 con 0x7fe25c15f230 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.075+0000 7fe26179e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe25c0d01a0 0x7fe25c0c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.075+0000 7fe26179e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe25c0d01a0 0x7fe25c0c9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:32914/0 (socket says 172.21.15.90:32914) 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.075+0000 7fe26179e640 1 -- 172.21.15.90:0/114776880 learned_addr learned my addr 172.21.15.90:0/114776880 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.075+0000 7fe26179e640 1 -- 172.21.15.90:0/114776880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe25c15f230 msgr2=0x7fe25c0c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.075+0000 7fe26179e640 1 --2- 172.21.15.90:0/114776880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe25c15f230 0x7fe25c0c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.075+0000 7fe26179e640 1 -- 172.21.15.90:0/114776880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe25c0ce4e0 msgr2=0x7fe25c1f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.075+0000 7fe26179e640 1 --2- 172.21.15.90:0/114776880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe25c0ce4e0 0x7fe25c1f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.075+0000 7fe26179e640 1 -- 172.21.15.90:0/114776880 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25c0cb9e0 con 0x7fe25c0d01a0 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.076+0000 7fe26179e640 1 --2- 172.21.15.90:0/114776880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe25c0d01a0 0x7fe25c0c9850 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fe2500099c0 tx=0x7fe2500039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.076+0000 7fe25a7fc640 1 -- 172.21.15.90:0/114776880 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25003f070 con 0x7fe25c0d01a0 2024-09-10T23:19:30.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.076+0000 7fe25a7fc640 1 -- 172.21.15.90:0/114776880 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2500048b0 con 0x7fe25c0d01a0 2024-09-10T23:19:30.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.076+0000 7fe262fa1640 1 -- 172.21.15.90:0/114776880 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe25c0c7bb0 con 0x7fe25c0d01a0 2024-09-10T23:19:30.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.076+0000 7fe25a7fc640 1 -- 172.21.15.90:0/114776880 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe250035030 con 0x7fe25c0d01a0 2024-09-10T23:19:30.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.076+0000 7fe262fa1640 1 -- 172.21.15.90:0/114776880 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe25c0c9050 con 0x7fe25c0d01a0 2024-09-10T23:19:30.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.077+0000 7fe262fa1640 1 -- 172.21.15.90:0/114776880 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe25c0d0650 con 0x7fe25c0d01a0 2024-09-10T23:19:30.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.077+0000 7fe25a7fc640 1 -- 172.21.15.90:0/114776880 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe250004d00 con 0x7fe25c0d01a0 2024-09-10T23:19:30.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.078+0000 7fe25a7fc640 1 --2- 172.21.15.90:0/114776880 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe248077f70 0x7fe24807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.078+0000 7fe25a7fc640 1 -- 172.21.15.90:0/114776880 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7fe2500bad30 con 0x7fe25c0d01a0 2024-09-10T23:19:30.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.078+0000 7fe261f9f640 1 --2- 172.21.15.90:0/114776880 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe248077f70 0x7fe24807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.079+0000 7fe261f9f640 1 --2- 172.21.15.90:0/114776880 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe248077f70 0x7fe24807a430 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00ab90 tx=0x7fe24c009250 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.082+0000 7fe25a7fc640 1 -- 172.21.15.90:0/114776880 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe250083a60 con 0x7fe25c0d01a0 2024-09-10T23:19:30.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.257+0000 7fe262fa1640 1 -- 172.21.15.90:0/114776880 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fe25c160010 con 0x7fe25c0d01a0 2024-09-10T23:19:30.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.260+0000 7fe25a7fc640 1 -- 172.21.15.90:0/114776880 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v45)=0 v45) ==== 123+0+0 (secure 0 0 0) 0x7fe250083360 con 0x7fe25c0d01a0 2024-09-10T23:19:30.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.262+0000 7fe25a7fc640 1 -- 172.21.15.90:0/114776880 <== mon.0 v2:172.21.15.90:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fe250082e70 con 0x7fe25c0d01a0 2024-09-10T23:19:30.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.263+0000 7fe262fa1640 1 -- 172.21.15.90:0/114776880 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe248077f70 msgr2=0x7fe24807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.263+0000 7fe262fa1640 1 --2- 172.21.15.90:0/114776880 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe248077f70 0x7fe24807a430 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00ab90 tx=0x7fe24c009250 comp rx=0 tx=0).stop 2024-09-10T23:19:30.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.263+0000 7fe262fa1640 1 -- 172.21.15.90:0/114776880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe25c0d01a0 msgr2=0x7fe25c0c9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.263+0000 7fe262fa1640 1 --2- 172.21.15.90:0/114776880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe25c0d01a0 0x7fe25c0c9850 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fe2500099c0 tx=0x7fe2500039e0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.263+0000 7fe262fa1640 1 -- 172.21.15.90:0/114776880 shutdown_connections 2024-09-10T23:19:30.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.263+0000 7fe262fa1640 1 --2- 172.21.15.90:0/114776880 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7fe248077f70 0x7fe24807a430 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.263+0000 7fe262fa1640 1 --2- 172.21.15.90:0/114776880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe25c15f230 0x7fe25c0c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.263+0000 7fe262fa1640 1 --2- 172.21.15.90:0/114776880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe25c0d01a0 0x7fe25c0c9850 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.263+0000 7fe262fa1640 1 --2- 172.21.15.90:0/114776880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe25c0ce4e0 0x7fe25c1f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.263+0000 7fe262fa1640 1 -- 172.21.15.90:0/114776880 >> 172.21.15.90:0/114776880 conn(0x7fe25c09a9e0 msgr2=0x7fe25c071aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.263+0000 7fe262fa1640 1 -- 172.21.15.90:0/114776880 shutdown_connections 2024-09-10T23:19:30.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.263+0000 7fe262fa1640 1 -- 172.21.15.90:0/114776880 wait complete. 2024-09-10T23:19:30.275 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:19:30.275 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:19:30.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.375+0000 7f59991f8640 1 -- 172.21.15.90:0/839508597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f597c004d40 msgr2=0x7f597c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.375+0000 7f59991f8640 1 --2- 172.21.15.90:0/839508597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f597c004d40 0x7f597c0051c0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f598c009f00 tx=0x7f597c005830 comp rx=0 tx=0).stop 2024-09-10T23:19:30.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.375+0000 7f599359e640 1 -- 172.21.15.90:0/839508597 reap_dead start 2024-09-10T23:19:30.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.375+0000 7f59991f8640 1 -- 172.21.15.90:0/839508597 shutdown_connections 2024-09-10T23:19:30.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.375+0000 7f59991f8640 1 -- 172.21.15.90:0/839508597 >> 172.21.15.90:0/839508597 conn(0x7f599406d1a0 msgr2=0x7f59940b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.375+0000 7f59991f8640 1 -- 172.21.15.90:0/839508597 shutdown_connections 2024-09-10T23:19:30.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.375+0000 7f59991f8640 1 -- 172.21.15.90:0/839508597 wait complete. 2024-09-10T23:19:30.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.377+0000 7f59991f8640 1 Processor -- start 2024-09-10T23:19:30.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.377+0000 7f59991f8640 1 -- start start 2024-09-10T23:19:30.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f59991f8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f597c004d40 0x7f59941447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f59991f8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f599415d4f0 0x7f599415d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f59991f8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59941f2d40 0x7f59941f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f59991f8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f59940b3ab0 con 0x7f599415d4f0 2024-09-10T23:19:30.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f59991f8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f59940b3930 con 0x7f597c004d40 2024-09-10T23:19:30.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f59991f8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f59940b3c30 con 0x7f59941f2d40 2024-09-10T23:19:30.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f599259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f599415d4f0 0x7f599415d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f599259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f599415d4f0 0x7f599415d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:32946/0 (socket says 172.21.15.90:32946) 2024-09-10T23:19:30.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f599259c640 1 -- 172.21.15.90:0/1406321208 learned_addr learned my addr 172.21.15.90:0/1406321208 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-10T23:19:30.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f5992d9d640 1 --2- 172.21.15.90:0/1406321208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f597c004d40 0x7f59941447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f599359e640 1 --2- 172.21.15.90:0/1406321208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59941f2d40 0x7f59941f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f599259c640 1 -- 172.21.15.90:0/1406321208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59941f2d40 msgr2=0x7f59941f31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f599259c640 1 --2- 172.21.15.90:0/1406321208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59941f2d40 0x7f59941f31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f599259c640 1 -- 172.21.15.90:0/1406321208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f597c004d40 msgr2=0x7f59941447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f599259c640 1 --2- 172.21.15.90:0/1406321208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f597c004d40 0x7f59941447c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f599259c640 1 -- 172.21.15.90:0/1406321208 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59941f3ce0 con 0x7f599415d4f0 2024-09-10T23:19:30.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f599259c640 1 --2- 172.21.15.90:0/1406321208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f599415d4f0 0x7f599415d970 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f5988011ab0 tx=0x7f5988011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f597b7fe640 1 -- 172.21.15.90:0/1406321208 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598800fe10 con 0x7f599415d4f0 2024-09-10T23:19:30.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f597b7fe640 1 -- 172.21.15.90:0/1406321208 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f5988016070 con 0x7f599415d4f0 2024-09-10T23:19:30.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f597b7fe640 1 -- 172.21.15.90:0/1406321208 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59880126b0 con 0x7f599415d4f0 2024-09-10T23:19:30.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f59991f8640 1 -- 172.21.15.90:0/1406321208 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5994144d00 con 0x7f599415d4f0 2024-09-10T23:19:30.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.378+0000 7f59991f8640 1 -- 172.21.15.90:0/1406321208 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5994154030 con 0x7f599415d4f0 2024-09-10T23:19:30.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.379+0000 7f59991f8640 1 -- 172.21.15.90:0/1406321208 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5994153e20 con 0x7f599415d4f0 2024-09-10T23:19:30.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.380+0000 7f597b7fe640 1 -- 172.21.15.90:0/1406321208 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5988012850 con 0x7f599415d4f0 2024-09-10T23:19:30.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.381+0000 7f597b7fe640 1 --2- 172.21.15.90:0/1406321208 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5980077f70 0x7f598007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.381+0000 7f597b7fe640 1 -- 172.21.15.90:0/1406321208 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5287+0+0 (secure 0 0 0) 0x7f598809a7d0 con 0x7f599415d4f0 2024-09-10T23:19:30.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.381+0000 7f5992d9d640 1 --2- 172.21.15.90:0/1406321208 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5980077f70 0x7f598007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.381+0000 7f5992d9d640 1 --2- 172.21.15.90:0/1406321208 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5980077f70 0x7f598007a430 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5984001880 tx=0x7f5984006040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.385+0000 7f597b7fe640 1 -- 172.21.15.90:0/1406321208 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5988062e20 con 0x7f599415d4f0 2024-09-10T23:19:30.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.594+0000 7f59991f8640 1 -- 172.21.15.90:0/1406321208 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59940b5230 con 0x7f599415d4f0 2024-09-10T23:19:30.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.594+0000 7f597b7fe640 1 -- 172.21.15.90:0/1406321208 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+3911 (secure 0 0 0) 0x7f5988067850 con 0x7f599415d4f0 2024-09-10T23:19:30.595 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-10T23:19:30.595 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":73,"btime":"2024-09-10T23:18:59:742123+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6083,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1271856183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1271856183},{"type":"v1","addr":"172.21.15.171:6835","nonce":1271856183}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6104,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/622220525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":622220525},{"type":"v1","addr":"172.21.15.171:6837","nonce":622220525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/2511070184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2511070184},{"type":"v1","addr":"172.21.15.90:6833","nonce":2511070184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/515715754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":515715754},{"type":"v1","addr":"172.21.15.90:6835","nonce":515715754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[]} 2024-09-10T23:19:30.596 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 73 2024-09-10T23:19:30.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.596+0000 7f59991f8640 1 -- 172.21.15.90:0/1406321208 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5980077f70 msgr2=0x7f598007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.596+0000 7f59991f8640 1 --2- 172.21.15.90:0/1406321208 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5980077f70 0x7f598007a430 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5984001880 tx=0x7f5984006040 comp rx=0 tx=0).stop 2024-09-10T23:19:30.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.596+0000 7f59991f8640 1 -- 172.21.15.90:0/1406321208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f599415d4f0 msgr2=0x7f599415d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.596+0000 7f59991f8640 1 --2- 172.21.15.90:0/1406321208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f599415d4f0 0x7f599415d970 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f5988011ab0 tx=0x7f5988011f70 comp rx=0 tx=0).stop 2024-09-10T23:19:30.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.596+0000 7f59991f8640 1 -- 172.21.15.90:0/1406321208 shutdown_connections 2024-09-10T23:19:30.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.596+0000 7f59991f8640 1 --2- 172.21.15.90:0/1406321208 >> [v2:172.21.15.171:6800/1044758290,v1:172.21.15.171:6801/1044758290] conn(0x7f5980077f70 0x7f598007a430 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.596+0000 7f59991f8640 1 --2- 172.21.15.90:0/1406321208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59941f2d40 0x7f59941f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.596+0000 7f59991f8640 1 --2- 172.21.15.90:0/1406321208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f599415d4f0 0x7f599415d970 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.596+0000 7f59991f8640 1 --2- 172.21.15.90:0/1406321208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f597c004d40 0x7f59941447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.596+0000 7f59991f8640 1 -- 172.21.15.90:0/1406321208 >> 172.21.15.90:0/1406321208 conn(0x7f599406d1a0 msgr2=0x7f59940b0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.596+0000 7f59991f8640 1 -- 172.21.15.90:0/1406321208 shutdown_connections 2024-09-10T23:19:30.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-10T23:19:30.596+0000 7f59991f8640 1 -- 172.21.15.90:0/1406321208 wait complete. 2024-09-10T23:19:30.608 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-10T23:19:30.608 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T23:19:30.608 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:19:30.608 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:30.617 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:19:30.617 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:19:30.617 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:30.666 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:19:30.667 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:19:30.667 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:30.679 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:19:30.679 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:19:30.679 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:30.730 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:19:30.731 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T23:19:30.731 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T23:19:30.731 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:30.756 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T23:19:30.756 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T23:19:30.756 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:30.827 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T23:19:30.827 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T23:19:30.827 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:30.894 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T23:19:30.894 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T23:19:30.894 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:30.965 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T23:19:30.965 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-10T23:19:30.966 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:30.999 INFO:tasks.ceph.osd.4:Stopped 2024-09-10T23:19:31.000 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-10T23:19:31.000 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:31.066 INFO:tasks.ceph.osd.5:Stopped 2024-09-10T23:19:31.066 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-10T23:19:31.066 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:31.133 INFO:tasks.ceph.osd.6:Stopped 2024-09-10T23:19:31.133 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-10T23:19:31.133 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:31.201 INFO:tasks.ceph.osd.7:Stopped 2024-09-10T23:19:31.202 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T23:19:31.202 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-10T23:19:31.202 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:31.229 INFO:tasks.ceph.mgr.y:Stopped 2024-09-10T23:19:31.230 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T23:19:31.230 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:31.273 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T23:19:31.273 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T23:19:31.274 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T23:19:31.274 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:31.286 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T23:19:31.286 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T23:19:31.286 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:31.326 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T23:19:31.327 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T23:19:31.327 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:31.378 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T23:19:31.379 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T23:19:31.379 DEBUG:teuthology.orchestra.run.smithi090:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'client session with non-allowable root' | head -n 1 2024-09-10T23:19:31.416 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:19:31.416 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T23:19:31.679 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:19:31.679 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T23:19:31.802 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:19:31.803 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T23:19:31.874 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:19:31.874 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T23:19:31.925 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:19:31.925 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-10T23:19:32.082 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:19:32.082 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-10T23:19:32.154 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:19:32.154 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-10T23:19:32.203 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:19:32.203 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-10T23:19:32.267 INFO:tasks.ceph:Archiving mon data... 2024-09-10T23:19:32.269 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899779/data/mon.a.tgz 2024-09-10T23:19:32.269 DEBUG:teuthology.orchestra.run.smithi090:> mktemp 2024-09-10T23:19:32.286 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.ag9NZF76iT 2024-09-10T23:19:32.286 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ag9NZF76iT 2024-09-10T23:19:32.468 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0666 /tmp/tmp.ag9NZF76iT 2024-09-10T23:19:32.551 DEBUG:teuthology.orchestra.remote:smithi090:/tmp/tmp.ag9NZF76iT is 530KB 2024-09-10T23:19:32.650 DEBUG:teuthology.orchestra.run.smithi090:> rm -fr /tmp/tmp.ag9NZF76iT 2024-09-10T23:19:32.665 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899779/data/mon.b.tgz 2024-09-10T23:19:32.666 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-09-10T23:19:32.683 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.qcWxHfl0Li 2024-09-10T23:19:32.684 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.qcWxHfl0Li 2024-09-10T23:19:32.904 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.qcWxHfl0Li 2024-09-10T23:19:32.987 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.qcWxHfl0Li is 681KB 2024-09-10T23:19:33.086 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.qcWxHfl0Li 2024-09-10T23:19:33.101 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899779/data/mon.c.tgz 2024-09-10T23:19:33.102 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-09-10T23:19:33.156 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.vV40HaBOBT 2024-09-10T23:19:33.157 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.vV40HaBOBT 2024-09-10T23:19:33.355 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.vV40HaBOBT 2024-09-10T23:19:33.438 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.vV40HaBOBT is 681KB 2024-09-10T23:19:33.539 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.vV40HaBOBT 2024-09-10T23:19:33.555 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T23:19:33.555 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T23:19:33.558 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T23:19:33.642 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T23:19:33.675 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T23:19:33.675 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T23:19:33.677 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899779/remote/smithi090/crash 2024-09-10T23:19:33.678 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T23:19:33.711 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899779/remote/smithi171/crash 2024-09-10T23:19:33.712 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T23:19:33.739 INFO:tasks.ceph:Shutting down logrotate 2024-09-10T23:19:33.740 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:19:33.757 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:19:33.832 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T23:19:33.859 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T23:19:33.884 INFO:tasks.ceph:Compressing logs... 2024-09-10T23:19:33.884 DEBUG:teuthology.orchestra.run.smithi090:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T23:19:33.902 DEBUG:teuthology.orchestra.run.smithi171:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T23:19:33.989 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47237.log 2024-09-10T23:19:33.989 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46230.log 2024-09-10T23:19:33.989 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47233.log 2024-09-10T23:19:33.989 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.47237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47237.log.gz 2024-09-10T23:19:33.989 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.46230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36343.log 2024-09-10T23:19:33.989 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.46230.log.gz 2024-09-10T23:19:33.990 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.47233.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-10T23:19:33.990 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47233.log.gz 2024-09-10T23:19:33.990 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.36343.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-10T23:19:33.990 INFO:teuthology.orchestra.run.smithi171.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36343.log.gz 2024-09-10T23:19:33.990 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45745.log 2024-09-10T23:19:33.990 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43179.log 2024-09-10T23:19:33.990 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.45745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45749.log 2024-09-10T23:19:33.990 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45745.log.gz 2024-09-10T23:19:33.990 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.3.43179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42779.log 2024-09-10T23:19:33.990 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43179.log.gz 2024-09-10T23:19:33.990 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.45749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45749.log.gz 2024-09-10T23:19:33.990 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36263.log 2024-09-10T23:19:33.990 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.42779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36303.log 2024-09-10T23:19:33.991 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42779.log.gz 2024-09-10T23:19:33.991 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.36263.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-10T23:19:33.991 INFO:teuthology.orchestra.run.smithi171.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36263.log.gz 2024-09-10T23:19:33.991 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.36303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44338.log 2024-09-10T23:19:33.991 INFO:teuthology.orchestra.run.smithi171.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36303.log.gz 2024-09-10T23:19:33.991 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T23:19:33.991 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46226.log 2024-09-10T23:19:33.991 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.44338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44338.log.gz 2024-09-10T23:19:33.991 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45200.log 2024-09-10T23:19:33.991 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.46226.log: 93.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-10T23:19:33.991 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44842.log 2024-09-10T23:19:33.991 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.46226.log.gz 2024-09-10T23:19:33.991 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.45200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47638.log 2024-09-10T23:19:33.991 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45200.log.gz 2024-09-10T23:19:33.992 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.44842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44842.log.gz 2024-09-10T23:19:33.992 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-10T23:19:33.992 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43764.log 2024-09-10T23:19:33.992 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.47638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47638.log.gz 2024-09-10T23:19:33.992 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36463.log 2024-09-10T23:19:33.992 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.43764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36222.log 2024-09-10T23:19:33.992 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43764.log.gz 2024-09-10T23:19:33.992 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.36463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44838.log 2024-09-10T23:19:33.992 INFO:teuthology.orchestra.run.smithi171.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36463.log.gz 2024-09-10T23:19:33.992 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.36222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46723.log 2024-09-10T23:19:33.992 INFO:teuthology.orchestra.run.smithi171.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36222.log.gz 2024-09-10T23:19:33.992 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.44838.log: 94.1%gzip -- replaced with /var/log/ceph/ceph.audit.log.gz -5 2024-09-10T23:19:33.992 INFO:teuthology.orchestra.run.smithi171.stderr: --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-10T23:19:33.993 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44838.log.gz 2024-09-10T23:19:33.993 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.46723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.46723.log.gz 2024-09-10T23:19:33.993 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36383.log 2024-09-10T23:19:33.993 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-10T23:19:33.993 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.36383.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T23:19:33.993 INFO:teuthology.orchestra.run.smithi171.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36383.log.gz 2024-09-10T23:19:33.993 INFO:teuthology.orchestra.run.smithi171.stderr:gzip/var/log/ceph/ceph-osd.5.log: -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-10T23:19:33.993 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T23:19:33.993 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36423.log 2024-09-10T23:19:33.993 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mgr.x.log: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T23:19:33.993 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36503.log 2024-09-10T23:19:33.993 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.36423.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36423.log.gz 2024-09-10T23:19:33.993 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42774.log 2024-09-10T23:19:33.993 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.36503.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36503.log.gz 2024-09-10T23:19:33.994 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43175.log 2024-09-10T23:19:33.994 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.42774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42774.log.gz 2024-09-10T23:19:33.994 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43768.log 2024-09-10T23:19:33.994 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.3.43175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43175.log.gz 2024-09-10T23:19:33.994 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-10T23:19:33.994 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.43768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43768.log.gz 2024-09-10T23:19:33.994 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44342.log 2024-09-10T23:19:33.994 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47634.log 2024-09-10T23:19:33.994 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.44342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44342.log.gz 2024-09-10T23:19:33.994 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46727.log 2024-09-10T23:19:33.994 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.47634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47634.log.gz 2024-09-10T23:19:34.008 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45196.log 2024-09-10T23:19:34.008 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.46727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.46727.log.gz 2024-09-10T23:19:34.021 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.45196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45196.log.gz 2024-09-10T23:19:34.028 INFO:teuthology.orchestra.run.smithi171.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-10T23:19:34.053 INFO:teuthology.orchestra.run.smithi171.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T23:19:34.116 INFO:teuthology.orchestra.run.smithi171.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-10T23:19:34.158 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T23:19:34.158 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51876.log 2024-09-10T23:19:34.158 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52128.log 2024-09-10T23:19:34.159 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60256.log 2024-09-10T23:19:34.159 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6%/var/log/ceph/ceph-client.admin.52128.log: -- replaced with /var/log/ceph/ceph-client.admin.51876.log.gz 2024-09-10T23:19:34.159 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61245.log 2024-09-10T23:19:34.159 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52128.log.gz 2024-09-10T23:19:34.159 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.60256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58142.log 2024-09-10T23:19:34.159 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60256.log.gz 2024-09-10T23:19:34.159 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57703.log 2024-09-10T23:19:34.159 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61245.log.gz 2024-09-10T23:19:34.159 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47827.log 2024-09-10T23:19:34.159 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.57703.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58142.log.gz 2024-09-10T23:19:34.159 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66880.log 2024-09-10T23:19:34.159 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57703.log.gz 2024-09-10T23:19:34.159 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56587.log 2024-09-10T23:19:34.159 INFO:teuthology.orchestra.run.smithi090.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.47827.log.gz 2024-09-10T23:19:34.159 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.66880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68342.log 2024-09-10T23:19:34.160 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66880.log.gz 2024-09-10T23:19:34.160 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57568.log 2024-09-10T23:19:34.160 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56587.log.gz 2024-09-10T23:19:34.160 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.68342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52906.log 2024-09-10T23:19:34.160 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.68342.log.gz 2024-09-10T23:19:34.160 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.57568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60382.log 2024-09-10T23:19:34.160 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57568.log.gz 2024-09-10T23:19:34.160 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57955.log 2024-09-10T23:19:34.160 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52906.log.gz 2024-09-10T23:19:34.160 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.60382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43302.log 2024-09-10T23:19:34.160 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60382.log.gz 2024-09-10T23:19:34.160 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.57955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44478.log 2024-09-10T23:19:34.160 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57955.log.gz 2024-09-10T23:19:34.161 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36326.log 2024-09-10T23:19:34.161 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43302.log.gz 2024-09-10T23:19:34.161 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47361.log 2024-09-10T23:19:34.161 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44478.log.gz 2024-09-10T23:19:34.161 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51498.log 2024-09-10T23:19:34.161 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36326.log.gz 2024-09-10T23:19:34.161 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47066.log 2024-09-10T23:19:34.161 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47361.log.gz 2024-09-10T23:19:34.161 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50410.log 2024-09-10T23:19:34.161 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51498.log.gz 2024-09-10T23:19:34.161 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56023.log 2024-09-10T23:19:34.161 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47066.log.gz 2024-09-10T23:19:34.161 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59400.log 2024-09-10T23:19:34.161 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50410.log.gz 2024-09-10T23:19:34.162 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46943.log 2024-09-10T23:19:34.162 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56023.log.gz 2024-09-10T23:19:34.162 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.59400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60424.log 2024-09-10T23:19:34.162 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46943.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59400.log.gz 2024-09-10T23:19:34.162 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58015.log 2024-09-10T23:19:34.162 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46943.log.gz 2024-09-10T23:19:34.162 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.60424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48668.log 2024-09-10T23:19:34.162 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60424.log.gz 2024-09-10T23:19:34.162 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51918.log 2024-09-10T23:19:34.162 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48668.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58015.log.gz 2024-09-10T23:19:34.162 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50198.log 2024-09-10T23:19:34.162 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48668.log.gz 2024-09-10T23:19:34.162 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36242.log 2024-09-10T23:19:34.162 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51918.log.gz 2024-09-10T23:19:34.163 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67431.log 2024-09-10T23:19:34.163 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50198.log.gz 2024-09-10T23:19:34.163 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55897.log 2024-09-10T23:19:34.163 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36242.log.gz 2024-09-10T23:19:34.163 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66754.log 2024-09-10T23:19:34.163 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.67431.log.gz 2024-09-10T23:19:34.163 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68199.log 2024-09-10T23:19:34.163 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.66754.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55897.log.gz 2024-09-10T23:19:34.163 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36522.log 2024-09-10T23:19:34.163 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66754.log.gz 2024-09-10T23:19:34.163 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.68199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46718.log 2024-09-10T23:19:34.163 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.68199.log.gz 2024-09-10T23:19:34.163 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43088.log 2024-09-10T23:19:34.163 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36522.log.gz 2024-09-10T23:19:34.163 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59358.log 2024-09-10T23:19:34.164 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46718.log.gz 2024-09-10T23:19:34.164 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44562.log 2024-09-10T23:19:34.164 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43088.log: /var/log/ceph/ceph-client.admin.59358.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.43088.log.gz 2024-09-10T23:19:34.164 INFO:teuthology.orchestra.run.smithi090.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59064.log 2024-09-10T23:19:34.164 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.59358.log.gz/var/log/ceph/ceph-client.admin.44562.log: 2024-09-10T23:19:34.164 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65110.log 2024-09-10T23:19:34.164 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44562.log.gz 2024-09-10T23:19:34.164 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.59064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68300.log 2024-09-10T23:19:34.164 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59064.log.gz 2024-09-10T23:19:34.164 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46676.log 2024-09-10T23:19:34.164 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.65110.log: /var/log/ceph/ceph-client.admin.68300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59936.log 2024-09-10T23:19:34.164 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65110.log.gz 2024-09-10T23:19:34.164 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.68300.log.gz 2024-09-10T23:19:34.165 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47995.log 2024-09-10T23:19:34.165 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46676.log.gz 2024-09-10T23:19:34.165 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.59936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52990.log 2024-09-10T23:19:34.165 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59936.log.gz 2024-09-10T23:19:34.165 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62957.log 2024-09-10T23:19:34.165 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47995.log.gz 2024-09-10T23:19:34.165 INFO:teuthology.orchestra.run.smithi090.stderr:gzip/var/log/ceph/ceph-client.admin.52990.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57787.log 2024-09-10T23:19:34.165 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.62957.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52990.log.gz 2024-09-10T23:19:34.165 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48902.log 2024-09-10T23:19:34.165 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6%/var/log/ceph/ceph-client.admin.57787.log: -- replaced with /var/log/ceph/ceph-client.admin.62957.log.gz 2024-09-10T23:19:34.165 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57095.log 2024-09-10T23:19:34.165 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57787.log.gz 2024-09-10T23:19:34.166 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.48902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42865.log 2024-09-10T23:19:34.166 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48902.log.gz 2024-09-10T23:19:34.166 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.57095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47659.log 2024-09-10T23:19:34.166 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4%/var/log/ceph/ceph-client.admin.42865.log: -- replaced with /var/log/ceph/ceph-client.admin.57095.log.gz 2024-09-10T23:19:34.166 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49687.log 2024-09-10T23:19:34.166 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42865.log.gz 2024-09-10T23:19:34.166 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62373.log 2024-09-10T23:19:34.166 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47659.log.gz 2024-09-10T23:19:34.166 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62747.log 2024-09-10T23:19:34.166 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.62373.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49687.log.gz 2024-09-10T23:19:34.166 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49519.log 2024-09-10T23:19:34.166 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62373.log.gz 2024-09-10T23:19:34.166 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.62747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66796.log 2024-09-10T23:19:34.166 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62747.log.gz 2024-09-10T23:19:34.167 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49267.log 2024-09-10T23:19:34.167 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49519.log.gz 2024-09-10T23:19:34.167 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.66796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42699.log 2024-09-10T23:19:34.167 INFO:teuthology.orchestra.run.smithi090.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66796.log.gz 2024-09-10T23:19:34.167 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42603.log 2024-09-10T23:19:34.167 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49267.log.gz 2024-09-10T23:19:34.167 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37077.log 2024-09-10T23:19:34.167 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42603.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42699.log.gz 2024-09-10T23:19:34.167 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43428.log 2024-09-10T23:19:34.167 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42603.log.gz 2024-09-10T23:19:34.167 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49813.log 2024-09-10T23:19:34.167 INFO:teuthology.orchestra.run.smithi090.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.37077.log.gz 2024-09-10T23:19:34.167 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67989.log 2024-09-10T23:19:34.168 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49813.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43428.log.gz 2024-09-10T23:19:34.168 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50154.log 2024-09-10T23:19:34.168 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49813.log.gz 2024-09-10T23:19:34.168 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36606.log 2024-09-10T23:19:34.168 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.67989.log.gz 2024-09-10T23:19:34.168 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65329.log 2024-09-10T23:19:34.168 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36606.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.50154.log.gz 2024-09-10T23:19:34.168 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.49729.log -- replaced with /var/log/ceph/ceph-client.admin.36606.log.gz 2024-09-10T23:19:34.168 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-10T23:19:34.168 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.65329.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T23:19:34.168 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65329.log.gz 2024-09-10T23:19:34.168 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55547.log 2024-09-10T23:19:34.168 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49729.log.gz 2024-09-10T23:19:34.168 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52044.log 2024-09-10T23:19:34.169 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56801.log 2024-09-10T23:19:34.169 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55547.log.gz 2024-09-10T23:19:34.169 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50788.log 2024-09-10T23:19:34.169 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52044.log.gz 2024-09-10T23:19:34.169 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67905.log 2024-09-10T23:19:34.169 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.56801.log.gz 2024-09-10T23:19:34.169 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55505.log 2024-09-10T23:19:34.169 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50788.log.gz 2024-09-10T23:19:34.169 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64515.log 2024-09-10T23:19:34.169 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.67905.log.gz 2024-09-10T23:19:34.169 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61376.log 2024-09-10T23:19:34.169 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55505.log.gz 2024-09-10T23:19:34.170 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55939.log 2024-09-10T23:19:34.170 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64515.log: /var/log/ceph/ceph-client.admin.61376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60779.log 2024-09-10T23:19:34.170 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61376.log.gz 2024-09-10T23:19:34.170 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60947.log 2024-09-10T23:19:34.170 INFO:teuthology.orchestra.run.smithi090.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.64515.log.gz 2024-09-10T23:19:34.170 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55939.log.gz 2024-09-10T23:19:34.170 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.60779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46550.log 2024-09-10T23:19:34.170 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60779.log.gz 2024-09-10T23:19:34.170 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.60947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47953.log 2024-09-10T23:19:34.170 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46550.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60947.log.gz 2024-09-10T23:19:34.170 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60905.log 2024-09-10T23:19:34.170 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46550.log.gz 2024-09-10T23:19:34.170 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59738.log 2024-09-10T23:19:34.170 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47953.log.gz 2024-09-10T23:19:34.170 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.60905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44139.log 2024-09-10T23:19:34.171 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60905.log.gz 2024-09-10T23:19:34.171 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.59738.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.0.59738.log.gz -5 2024-09-10T23:19:34.171 INFO:teuthology.orchestra.run.smithi090.stderr: --verbose -- /var/log/ceph/ceph-client.2.45569.log 2024-09-10T23:19:34.171 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42781.log 2024-09-10T23:19:34.171 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44139.log.gz 2024-09-10T23:19:34.171 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.2.45569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45569.log.gz 2024-09-10T23:19:34.171 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43638.log 2024-09-10T23:19:34.171 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66049.log 2024-09-10T23:19:34.171 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42781.log.gz 2024-09-10T23:19:34.171 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47151.log 2024-09-10T23:19:34.171 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43638.log.gz 2024-09-10T23:19:34.171 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.66049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50070.log 2024-09-10T23:19:34.171 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.66049.log.gz 2024-09-10T23:19:34.171 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60508.log 2024-09-10T23:19:34.172 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47151.log.gz 2024-09-10T23:19:34.172 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57137.log 2024-09-10T23:19:34.172 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50070.log.gz 2024-09-10T23:19:34.172 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.60508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62915.log 2024-09-10T23:19:34.172 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60508.log.gz 2024-09-10T23:19:34.172 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.57137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65795.log 2024-09-10T23:19:34.172 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.62915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51960.log 2024-09-10T23:19:34.172 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62915.log.gz 2024-09-10T23:19:34.172 INFO:teuthology.orchestra.run.smithi090.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57137.log.gz 2024-09-10T23:19:34.172 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.65795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53716.log 2024-09-10T23:19:34.172 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65795.log.gz 2024-09-10T23:19:34.172 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57203.log 2024-09-10T23:19:34.173 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51960.log.gz 2024-09-10T23:19:34.173 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52822.log 2024-09-10T23:19:34.173 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53716.log: /var/log/ceph/ceph-client.admin.57203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44152.log 2024-09-10T23:19:34.173 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53716.log.gz 2024-09-10T23:19:34.173 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57203.log.gz 2024-09-10T23:19:34.173 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56629.log 2024-09-10T23:19:34.173 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52822.log.gz 2024-09-10T23:19:34.173 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68260.log 2024-09-10T23:19:34.173 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44152.log.gz 2024-09-10T23:19:34.173 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50872.log 2024-09-10T23:19:34.173 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56629.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56629.log.gz 2024-09-10T23:19:34.173 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.68260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64431.log 2024-09-10T23:19:34.173 INFO:teuthology.orchestra.run.smithi090.stderr:gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68260.log.gz -5 2024-09-10T23:19:34.174 INFO:teuthology.orchestra.run.smithi090.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53578.log 2024-09-10T23:19:34.174 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50872.log: /var/log/ceph/ceph-client.admin.64431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62789.log 2024-09-10T23:19:34.174 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.64431.log.gz 2024-09-10T23:19:34.174 INFO:teuthology.orchestra.run.smithi090.stderr: 91.1%/var/log/ceph/ceph-client.admin.53578.log: -- replaced with /var/log/ceph/ceph-client.admin.50872.log.gz 2024-09-10T23:19:34.174 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57473.log 2024-09-10T23:19:34.174 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.62789.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53578.log.gz 2024-09-10T23:19:34.174 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65525.log 2024-09-10T23:19:34.174 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.57473.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62789.log.gz 2024-09-10T23:19:34.174 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66091.log 2024-09-10T23:19:34.174 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57473.log.gz 2024-09-10T23:19:34.174 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.65525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36150.log 2024-09-10T23:19:34.174 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65525.log.gz 2024-09-10T23:19:34.174 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63533.log 2024-09-10T23:19:34.174 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.66091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56675.log 2024-09-10T23:19:34.174 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36150.log.gz 2024-09-10T23:19:34.175 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36382.log 2024-09-10T23:19:34.175 INFO:teuthology.orchestra.run.smithi090.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.66091.log.gz 2024-09-10T23:19:34.175 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63533.log.gz 2024-09-10T23:19:34.175 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53116.log 2024-09-10T23:19:34.175 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56675.log.gz 2024-09-10T23:19:34.175 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48475.log 2024-09-10T23:19:34.175 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36382.log.gz 2024-09-10T23:19:34.175 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46770.log 2024-09-10T23:19:34.175 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53116.log.gz 2024-09-10T23:19:34.175 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56405.log 2024-09-10T23:19:34.175 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48475.log.gz 2024-09-10T23:19:34.175 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44436.log 2024-09-10T23:19:34.175 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46770.log: /var/log/ceph/ceph-client.admin.56405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64389.log 2024-09-10T23:19:34.175 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46770.log.gz 2024-09-10T23:19:34.176 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44436.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56405.log.gz 2024-09-10T23:19:34.176 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58569.log 2024-09-10T23:19:34.176 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44436.log.gz 2024-09-10T23:19:34.176 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44151.log 2024-09-10T23:19:34.176 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64389.log.gz 2024-09-10T23:19:34.176 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57391.log 2024-09-10T23:19:34.176 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58569.log: /var/log/ceph/ceph-client.admin.44151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44149.log 2024-09-10T23:19:34.176 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58569.log.gz 2024-09-10T23:19:34.176 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44151.log.gz 2024-09-10T23:19:34.176 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.57391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63354.log 2024-09-10T23:19:34.176 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57391.log.gz 2024-09-10T23:19:34.176 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67558.log 2024-09-10T23:19:34.176 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44149.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44149.log.gz 2024-09-10T23:19:34.177 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45984.log 2024-09-10T23:19:34.177 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63354.log.gz 2024-09-10T23:19:34.177 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67650.log 2024-09-10T23:19:34.177 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67558.log: /var/log/ceph/ceph-client.admin.45984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47533.log 2024-09-10T23:19:34.177 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67558.log.gz 2024-09-10T23:19:34.177 INFO:teuthology.orchestra.run.smithi090.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.45984.log.gz 2024-09-10T23:19:34.177 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46068.log 2024-09-10T23:19:34.177 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.67650.log.gz 2024-09-10T23:19:34.177 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58058.log 2024-09-10T23:19:34.177 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50620.log 2024-09-10T23:19:34.177 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46068.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47533.log.gz 2024-09-10T23:19:34.177 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58058.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46068.log.gz 2024-09-10T23:19:34.177 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47024.log 2024-09-10T23:19:34.178 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58058.log.gz 2024-09-10T23:19:34.178 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51708.log 2024-09-10T23:19:34.178 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50620.log: /var/log/ceph/ceph-client.admin.47024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45816.log 2024-09-10T23:19:34.178 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50620.log.gz 2024-09-10T23:19:34.178 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47024.log.gz 2024-09-10T23:19:34.178 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62295.log 2024-09-10T23:19:34.178 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51708.log.gz 2024-09-10T23:19:34.178 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47575.log 2024-09-10T23:19:34.178 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45816.log: /var/log/ceph/ceph-client.0.62295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45942.log 2024-09-10T23:19:34.178 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45816.log.gz 2024-09-10T23:19:34.178 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62295.log.gz 2024-09-10T23:19:34.178 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51130.log 2024-09-10T23:19:34.178 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45942.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47575.log.gz 2024-09-10T23:19:34.178 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36466.log 2024-09-10T23:19:34.178 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45942.log.gz 2024-09-10T23:19:34.178 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.51130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51130.log.gz 2024-09-10T23:19:34.179 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43004.log 2024-09-10T23:19:34.179 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51750.log 2024-09-10T23:19:34.179 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36466.log.gz 2024-09-10T23:19:34.179 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53266.log 2024-09-10T23:19:34.179 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43004.log.gz 2024-09-10T23:19:34.179 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58352.log 2024-09-10T23:19:34.179 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51750.log.gz 2024-09-10T23:19:34.179 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61203.log 2024-09-10T23:19:34.179 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53266.log.gz 2024-09-10T23:19:34.179 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45128.log 2024-09-10T23:19:34.179 INFO:teuthology.orchestra.run.smithi090.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58352.log.gz 2024-09-10T23:19:34.179 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46466.log 2024-09-10T23:19:34.179 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61203.log.gz 2024-09-10T23:19:34.179 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.45128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45128.log.gz 2024-09-10T23:19:34.180 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52468.log 2024-09-10T23:19:34.180 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61511.log 2024-09-10T23:19:34.180 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46466.log.gz 2024-09-10T23:19:34.180 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59274.log 2024-09-10T23:19:34.180 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52468.log.gz 2024-09-10T23:19:34.180 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56321.log 2024-09-10T23:19:34.180 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61511.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61511.log.gz 2024-09-10T23:19:34.180 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.59274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36410.log 2024-09-10T23:19:34.180 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55753.log 2024-09-10T23:19:34.180 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59274.log.gz 2024-09-10T23:19:34.180 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56321.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56321.log.gz 2024-09-10T23:19:34.180 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53536.log 2024-09-10T23:19:34.180 INFO:teuthology.orchestra.run.smithi090.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36410.log.gz 2024-09-10T23:19:34.180 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52557.log 2024-09-10T23:19:34.181 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55753.log: /var/log/ceph/ceph-client.admin.53536.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55753.log.gz 2024-09-10T23:19:34.181 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62566.log 2024-09-10T23:19:34.181 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53536.log.gz 2024-09-10T23:19:34.181 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67821.log 2024-09-10T23:19:34.181 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52557.log: /var/log/ceph/ceph-client.admin.62566.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52557.log.gz 2024-09-10T23:19:34.181 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54373.log 2024-09-10T23:19:34.181 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62566.log.gz 2024-09-10T23:19:34.181 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58268.log 2024-09-10T23:19:34.181 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67821.log: /var/log/ceph/ceph-client.admin.54373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65459.log 2024-09-10T23:19:34.181 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.67821.log.gz 2024-09-10T23:19:34.181 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54373.log.gz 2024-09-10T23:19:34.181 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65713.log 2024-09-10T23:19:34.181 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58268.log.gz 2024-09-10T23:19:34.181 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.65459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59820.log 2024-09-10T23:19:34.182 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.65713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65713.log.gz 2024-09-10T23:19:34.182 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51456.log 2024-09-10T23:19:34.182 INFO:teuthology.orchestra.run.smithi090.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.65459.log.gz 2024-09-10T23:19:34.182 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57395.log 2024-09-10T23:19:34.182 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.59820.log: /var/log/ceph/ceph-client.admin.51456.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59820.log.gz 2024-09-10T23:19:34.182 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54880.log 2024-09-10T23:19:34.182 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51456.log.gz 2024-09-10T23:19:34.182 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.57395.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.0.57395.log.gz 2024-09-10T23:19:34.182 INFO:teuthology.orchestra.run.smithi090.stderr: /var/log/ceph/ceph-client.admin.66514.log 2024-09-10T23:19:34.182 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66355.log 2024-09-10T23:19:34.182 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54880.log.gz 2024-09-10T23:19:34.182 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.66514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61911.log 2024-09-10T23:19:34.182 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63312.log 2024-09-10T23:19:34.182 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.66355.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.66514.log.gz 2024-09-10T23:19:34.182 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61911.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.66355.log.gz 2024-09-10T23:19:34.183 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60055.log 2024-09-10T23:19:34.183 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61911.log.gz 2024-09-10T23:19:34.183 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49309.log 2024-09-10T23:19:34.183 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63312.log: /var/log/ceph/ceph-client.admin.60055.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63312.log.gz 2024-09-10T23:19:34.183 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43596.log 2024-09-10T23:19:34.183 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60055.log.gz 2024-09-10T23:19:34.183 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57871.log 2024-09-10T23:19:34.183 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49309.log: /var/log/ceph/ceph-client.admin.43596.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T23:19:34.183 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49309.log.gz 2024-09-10T23:19:34.183 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43596.log.gz 2024-09-10T23:19:34.183 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.57871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59742.log 2024-09-10T23:19:34.183 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57871.log.gz 2024-09-10T23:19:34.183 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66958.log 2024-09-10T23:19:34.183 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.59742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50704.log 2024-09-10T23:19:34.184 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59742.log.gz 2024-09-10T23:19:34.184 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.66958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36438.log 2024-09-10T23:19:34.184 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66958.log.gz 2024-09-10T23:19:34.184 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52738.log 2024-09-10T23:19:34.184 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36438.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50704.log.gz 2024-09-10T23:19:34.184 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36438.log.gz 2024-09-10T23:19:34.184 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52948.log 2024-09-10T23:19:34.184 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52426.log 2024-09-10T23:19:34.184 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52738.log: /var/log/ceph/ceph-client.admin.52948.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52738.log.gz 2024-09-10T23:19:34.184 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63993.log 2024-09-10T23:19:34.184 INFO:teuthology.orchestra.run.smithi090.stderr: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T23:19:34.184 INFO:teuthology.orchestra.run.smithi090.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.52948.log.gz 2024-09-10T23:19:34.184 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53032.log 2024-09-10T23:19:34.184 INFO:teuthology.orchestra.run.smithi090.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52426.log.gz 2024-09-10T23:19:34.184 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60568.log 2024-09-10T23:19:34.185 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63993.log.gz 2024-09-10T23:19:34.185 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43176.log 2024-09-10T23:19:34.185 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53032.log.gz 2024-09-10T23:19:34.185 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.60568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44352.log 2024-09-10T23:19:34.185 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60568.log.gz 2024-09-10T23:19:34.185 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43554.log 2024-09-10T23:19:34.185 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43176.log: /var/log/ceph/ceph-client.admin.44352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44155.log 2024-09-10T23:19:34.185 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43176.log.gz 2024-09-10T23:19:34.185 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44352.log.gz 2024-09-10T23:19:34.185 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63144.log 2024-09-10T23:19:34.185 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43554.log.gz 2024-09-10T23:19:34.185 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59022.log 2024-09-10T23:19:34.185 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44155.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44155.log.gz 2024-09-10T23:19:34.186 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67114.log 2024-09-10T23:19:34.186 INFO:teuthology.orchestra.run.smithi090.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.63144.log.gz 2024-09-10T23:19:34.186 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67389.log 2024-09-10T23:19:34.186 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.59022.log: /var/log/ceph/ceph-client.admin.67114.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59022.log.gz 2024-09-10T23:19:34.186 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30060.log 2024-09-10T23:19:34.186 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67114.log.gz 2024-09-10T23:19:34.186 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42823.log 2024-09-10T23:19:34.186 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67389.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67389.log.gz 2024-09-10T23:19:34.186 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.tmp-client.admin.30060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46863.log 2024-09-10T23:19:34.186 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30060.log.gz 2024-09-10T23:19:34.186 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64119.log 2024-09-10T23:19:34.186 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42823.log.gz 2024-09-10T23:19:34.186 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36214.log 2024-09-10T23:19:34.186 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46863.log.gz 2024-09-10T23:19:34.187 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64077.log 2024-09-10T23:19:34.187 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64119.log: /var/log/ceph/ceph-client.admin.36214.log: 0.0% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36214.log.gz 2024-09-10T23:19:34.187 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64119.log.gz 2024-09-10T23:19:34.187 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49561.log 2024-09-10T23:19:34.187 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44784.log 2024-09-10T23:19:34.187 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64077.log.gz 2024-09-10T23:19:34.187 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67473.log 2024-09-10T23:19:34.187 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49561.log.gz 2024-09-10T23:19:34.187 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67608.log 2024-09-10T23:19:34.187 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44784.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44784.log.gz 2024-09-10T23:19:34.187 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49393.log 2024-09-10T23:19:34.187 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67473.log.gz 2024-09-10T23:19:34.187 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65371.log 2024-09-10T23:19:34.187 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67608.log: /var/log/ceph/ceph-client.admin.49393.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67608.log.gz 2024-09-10T23:19:34.188 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46257.log 2024-09-10T23:19:34.188 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49393.log.gz 2024-09-10T23:19:34.188 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36354.log 2024-09-10T23:19:34.188 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.65371.log: /var/log/ceph/ceph-client.admin.46257.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65371.log.gz 2024-09-10T23:19:34.188 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43260.log 2024-09-10T23:19:34.188 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46257.log.gz 2024-09-10T23:19:34.188 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64161.log 2024-09-10T23:19:34.188 INFO:teuthology.orchestra.run.smithi090.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36354.log.gz 2024-09-10T23:19:34.188 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46347.log 2024-09-10T23:19:34.188 INFO:teuthology.orchestra.run.smithi090.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43260.log.gz 2024-09-10T23:19:34.188 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51834.log 2024-09-10T23:19:34.188 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.64161.log.gz 2024-09-10T23:19:34.188 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61122.log 2024-09-10T23:19:34.188 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46347.log.gz 2024-09-10T23:19:34.189 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68031.log 2024-09-10T23:19:34.189 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51834.log.gz 2024-09-10T23:19:34.189 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60737.log 2024-09-10T23:19:34.189 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61122.log.gz 2024-09-10T23:19:34.189 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.68031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61659.log 2024-09-10T23:19:34.189 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68031.log.gz 2024-09-10T23:19:34.189 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.60737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60695.log 2024-09-10T23:19:34.189 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.60737.log.gz 2024-09-10T23:19:34.189 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56927.log 2024-09-10T23:19:34.189 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61659.log.gz 2024-09-10T23:19:34.189 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.60695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64851.log 2024-09-10T23:19:34.189 INFO:teuthology.orchestra.run.smithi090.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60695.log.gz 2024-09-10T23:19:34.189 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60821.log 2024-09-10T23:19:34.189 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56927.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56927.log.gz 2024-09-10T23:19:34.190 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48710.log 2024-09-10T23:19:34.190 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64851.log.gz 2024-09-10T23:19:34.190 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55279.log 2024-09-10T23:19:34.190 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.60821.log: /var/log/ceph/ceph-client.admin.48710.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.60821.log.gz 2024-09-10T23:19:34.190 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55202.log 2024-09-10T23:19:34.190 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48710.log.gz 2024-09-10T23:19:34.190 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67516.log 2024-09-10T23:19:34.190 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55279.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55279.log.gz 2024-09-10T23:19:34.190 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46821.log 2024-09-10T23:19:34.190 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55202.log.gz 2024-09-10T23:19:34.190 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56450.log 2024-09-10T23:19:34.190 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67516.log: /var/log/ceph/ceph-client.admin.46821.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67516.log.gz 2024-09-10T23:19:34.190 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43811.log 2024-09-10T23:19:34.191 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46821.log.gz 2024-09-10T23:19:34.191 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48079.log 2024-09-10T23:19:34.191 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56450.log.gz 2024-09-10T23:19:34.191 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54044.log 2024-09-10T23:19:34.191 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43811.log.gz 2024-09-10T23:19:34.191 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47701.log 2024-09-10T23:19:34.191 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49645.log 2024-09-10T23:19:34.191 INFO:teuthology.orchestra.run.smithi090.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54044.log.gz 2024-09-10T23:19:34.191 INFO:teuthology.orchestra.run.smithi090.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48079.log.gz 2024-09-10T23:19:34.191 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.47701.log: /var/log/ceph/ceph-client.admin.62873.log 2024-09-10T23:19:34.191 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49645.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47701.log.gz 2024-09-10T23:19:34.191 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47235.log 2024-09-10T23:19:34.191 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49645.log.gz 2024-09-10T23:19:34.191 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.62873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53158.log 2024-09-10T23:19:34.191 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.62873.log.gz 2024-09-10T23:19:34.192 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52086.log 2024-09-10T23:19:34.192 INFO:teuthology.orchestra.run.smithi090.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47235.log.gz 2024-09-10T23:19:34.192 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66670.log 2024-09-10T23:19:34.192 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53158.log.gz 2024-09-10T23:19:34.192 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53950.log 2024-09-10T23:19:34.192 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52086.log.gz 2024-09-10T23:19:34.192 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.66670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55711.log 2024-09-10T23:19:34.192 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.66670.log.gz 2024-09-10T23:19:34.192 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61785.log 2024-09-10T23:19:34.192 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53950.log.gz 2024-09-10T23:19:34.192 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58489.log 2024-09-10T23:19:34.192 INFO:teuthology.orchestra.run.smithi090.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.55711.log.gz 2024-09-10T23:19:34.192 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56843.log 2024-09-10T23:19:34.192 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61785.log.gz 2024-09-10T23:19:34.193 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58489.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-10T23:19:34.193 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58489.log.gz 2024-09-10T23:19:34.193 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57745.log 2024-09-10T23:19:34.193 INFO:teuthology.orchestra.run.smithi090.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.56843.log.gz 2024-09-10T23:19:34.193 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60013.log 2024-09-10T23:19:34.193 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.57745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58310.log 2024-09-10T23:19:34.193 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57745.log.gz 2024-09-10T23:19:34.193 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50368.log 2024-09-10T23:19:34.193 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.60013.log: /var/log/ceph/ceph-client.admin.58310.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60013.log.gz 2024-09-10T23:19:34.193 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49183.log 2024-09-10T23:19:34.193 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58310.log.gz 2024-09-10T23:19:34.193 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67347.log 2024-09-10T23:19:34.193 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50368.log.gz 2024-09-10T23:19:34.193 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61869.log 2024-09-10T23:19:34.194 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67347.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49183.log.gz 2024-09-10T23:19:34.194 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51321.log 2024-09-10T23:19:34.194 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.67347.log.gz 2024-09-10T23:19:34.194 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52864.log 2024-09-10T23:19:34.194 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61869.log.gz 2024-09-10T23:19:34.194 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64245.log 2024-09-10T23:19:34.194 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51321.log.gz 2024-09-10T23:19:34.194 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47405.log 2024-09-10T23:19:34.194 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52864.log.gz 2024-09-10T23:19:34.194 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58184.log 2024-09-10T23:19:34.194 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.64245.log.gz 2024-09-10T23:19:34.194 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55813.log 2024-09-10T23:19:34.194 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58184.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47405.log.gz 2024-09-10T23:19:34.194 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54331.log 2024-09-10T23:19:34.195 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.58184.log.gz 2024-09-10T23:19:34.195 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62291.log 2024-09-10T23:19:34.195 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55813.log.gz 2024-09-10T23:19:34.195 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50746.log 2024-09-10T23:19:34.195 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54331.log.gz/var/log/ceph/ceph-client.0.62291.log: 2024-09-10T23:19:34.195 INFO:teuthology.orchestra.run.smithi090.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.0.62291.log.gz 2024-09-10T23:19:34.195 INFO:teuthology.orchestra.run.smithi090.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68157.log 2024-09-10T23:19:34.195 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53620.log 2024-09-10T23:19:34.195 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50746.log.gz 2024-09-10T23:19:34.195 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.68157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50494.log 2024-09-10T23:19:34.195 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.68157.log.gz 2024-09-10T23:19:34.195 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61557.log 2024-09-10T23:19:34.195 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50494.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53620.log.gz 2024-09-10T23:19:34.195 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57011.log 2024-09-10T23:19:34.196 INFO:teuthology.orchestra.run.smithi090.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50494.log.gz 2024-09-10T23:19:34.196 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51126.log 2024-09-10T23:19:34.196 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61557.log.gz 2024-09-10T23:19:34.196 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.57011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43817.log 2024-09-10T23:19:34.196 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.51126.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57011.log.gz 2024-09-10T23:19:34.196 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55421.log 2024-09-10T23:19:34.196 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51126.log.gz 2024-09-10T23:19:34.196 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55981.log 2024-09-10T23:19:34.196 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43817.log.gz 2024-09-10T23:19:34.196 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55589.log 2024-09-10T23:19:34.196 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55981.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55421.log.gz 2024-09-10T23:19:34.196 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62608.log 2024-09-10T23:19:34.196 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55981.log.gz 2024-09-10T23:19:34.197 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64925.log 2024-09-10T23:19:34.197 INFO:teuthology.orchestra.run.smithi090.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.55589.log.gz 2024-09-10T23:19:34.197 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.62608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47617.log 2024-09-10T23:19:34.197 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61427.log 2024-09-10T23:19:34.197 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64925.log.gz 2024-09-10T23:19:34.197 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47617.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58651.log 2024-09-10T23:19:34.197 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62608.log.gz 2024-09-10T23:19:34.197 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47617.log.gz 2024-09-10T23:19:34.197 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47277.log 2024-09-10T23:19:34.197 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58651.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61427.log.gz 2024-09-10T23:19:34.197 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65112.log 2024-09-10T23:19:34.197 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58651.log.gz 2024-09-10T23:19:34.197 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52608.log 2024-09-10T23:19:34.197 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.65112.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47277.log.gz 2024-09-10T23:19:34.198 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47785.log 2024-09-10T23:19:34.198 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65112.log.gz 2024-09-10T23:19:34.198 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58797.log 2024-09-10T23:19:34.198 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52608.log.gz 2024-09-10T23:19:34.198 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63102.log 2024-09-10T23:19:34.198 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58797.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47785.log.gz 2024-09-10T23:19:34.198 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62999.log 2024-09-10T23:19:34.198 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58797.log.gz 2024-09-10T23:19:34.198 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51540.log 2024-09-10T23:19:34.198 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63102.log.gz 2024-09-10T23:19:34.198 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.62999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36578.log 2024-09-10T23:19:34.198 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62999.log.gz 2024-09-10T23:19:34.198 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68073.log 2024-09-10T23:19:34.198 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51540.log.gz 2024-09-10T23:19:34.198 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36578.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T23:19:34.198 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36578.log.gz 2024-09-10T23:19:34.199 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64287.log 2024-09-10T23:19:34.199 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.68073.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59442.log 2024-09-10T23:19:34.199 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.68073.log.gz 2024-09-10T23:19:34.199 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61469.log 2024-09-10T23:19:34.199 INFO:teuthology.orchestra.run.smithi090.stderr: 87.8%/var/log/ceph/ceph-client.admin.59442.log: -- replaced with /var/log/ceph/ceph-client.admin.64287.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47108.log 2024-09-10T23:19:34.199 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-10T23:19:34.199 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59442.log.gz 2024-09-10T23:19:34.199 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61617.log 2024-09-10T23:19:34.199 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61469.log.gz 2024-09-10T23:19:34.199 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65002.log 2024-09-10T23:19:34.199 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47108.log: /var/log/ceph/ceph-client.admin.61617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47491.log 2024-09-10T23:19:34.199 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47108.log.gz 86.9% -- replaced with /var/log/ceph/ceph-client.admin.61617.log.gz 2024-09-10T23:19:34.199 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-10T23:19:34.200 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.65002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43134.log 2024-09-10T23:19:34.200 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65002.log.gz 2024-09-10T23:19:34.200 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44604.log 2024-09-10T23:19:34.200 INFO:teuthology.orchestra.run.smithi090.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47491.log.gz 2024-09-10T23:19:34.200 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44646.log 2024-09-10T23:19:34.200 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43134.log.gz 2024-09-10T23:19:34.200 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50284.log 2024-09-10T23:19:34.200 INFO:teuthology.orchestra.run.smithi090.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44604.log.gz 2024-09-10T23:19:34.200 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62447.log 2024-09-10T23:19:34.200 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63228.log 2024-09-10T23:19:34.200 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50284.log.gz 2024-09-10T23:19:34.200 INFO:teuthology.orchestra.run.smithi090.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44646.log.gz 2024-09-10T23:19:34.200 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.62447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44394.log 2024-09-10T23:19:34.200 INFO:teuthology.orchestra.run.smithi090.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62447.log.gz 2024-09-10T23:19:34.201 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46508.log 2024-09-10T23:19:34.201 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63228.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63613.log 2024-09-10T23:19:34.201 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44394.log: 2024-09-10T23:19:34.201 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44394.log.gz 2024-09-10T23:19:34.201 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46508.log: --verbose -- /var/log/ceph/ceph-client.admin.44156.log 2024-09-10T23:19:34.201 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63613.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46508.log.gz 2024-09-10T23:19:34.201 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66451.log 2024-09-10T23:19:34.201 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63613.log.gz 2024-09-10T23:19:34.201 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62524.log 2024-09-10T23:19:34.201 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44156.log.gz 2024-09-10T23:19:34.201 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.66451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50578.log 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66451.log.gz 2024-09-10T23:19:34.201 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-10T23:19:34.201 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.62524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64203.log 2024-09-10T23:19:34.202 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62524.log.gz 2024-09-10T23:19:34.202 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46592.log 2024-09-10T23:19:34.202 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50578.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.64769.log 2024-09-10T23:19:34.202 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-10T23:19:34.202 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61827.log 2024-09-10T23:19:34.202 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.64203.log.gz 2024-09-10T23:19:34.202 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46592.log: /var/log/ceph/ceph-client.0.64769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55667.log 2024-09-10T23:19:34.202 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64769.log.gz 2024-09-10T23:19:34.202 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6%/var/log/ceph/ceph-client.admin.61827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56717.log 2024-09-10T23:19:34.202 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46592.log.gz 2024-09-10T23:19:34.202 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61827.log.gz 2024-09-10T23:19:34.202 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43512.log 2024-09-10T23:19:34.202 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55667.log.gz 2024-09-10T23:19:34.203 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43819.log 2024-09-10T23:19:34.203 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.56717.log.gz 2024-09-10T23:19:34.203 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48433.log 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43512.log.gz 2024-09-10T23:19:34.203 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-10T23:19:34.203 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55463.log 2024-09-10T23:19:34.203 INFO:teuthology.orchestra.run.smithi090.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43819.log.gz 2024-09-10T23:19:34.203 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48433.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T23:19:34.203 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48433.log.gz 2024-09-10T23:19:34.203 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57913.log 2024-09-10T23:19:34.203 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55463.log.gz 2024-09-10T23:19:34.203 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64773.log 2024-09-10T23:19:34.203 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.57913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36096.log 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57913.log.gz 2024-09-10T23:19:34.203 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-10T23:19:34.203 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.64773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64773.log.gz 2024-09-10T23:19:34.203 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60653.log 2024-09-10T23:19:34.204 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36096.log.gz 2024-09-10T23:19:34.204 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61042.log 2024-09-10T23:19:34.204 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.60653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49603.log 2024-09-10T23:19:34.204 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60653.log.gz 2024-09-10T23:19:34.204 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59190.log 87.5% 2024-09-10T23:19:34.204 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61042.log.gz 2024-09-10T23:19:34.204 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64581.log 2024-09-10T23:19:34.204 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49603.log.gz 2024-09-10T23:19:34.204 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50112.log 2024-09-10T23:19:34.204 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.59190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61701.log 87.3% 2024-09-10T23:19:34.204 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59190.log.gz 2024-09-10T23:19:34.204 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64581.log: /var/log/ceph/ceph-client.admin.50112.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64581.log.gz 2024-09-10T23:19:34.204 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50112.log.gz 2024-09-10T23:19:34.205 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65276.log 2024-09-10T23:19:34.205 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50242.log 2024-09-10T23:19:34.205 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3%/var/log/ceph/ceph-client.admin.65276.log: -- replaced with /var/log/ceph/ceph-client.admin.61701.log.gz 2024-09-10T23:19:34.205 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60340.log 2024-09-10T23:19:34.205 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65276.log.gz 2024-09-10T23:19:34.205 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58226.log 2024-09-10T23:19:34.205 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50242.log: /var/log/ceph/ceph-client.admin.60340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44520.log 2024-09-10T23:19:34.205 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58226.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50242.log.gz 87.7% 2024-09-10T23:19:34.205 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60340.log.gz 2024-09-10T23:19:34.205 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43344.log 2024-09-10T23:19:34.205 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58226.log.gz 2024-09-10T23:19:34.205 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58976.log 2024-09-10T23:19:34.205 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44520.log.gz 2024-09-10T23:19:34.206 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-10T23:19:34.206 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43344.log: /var/log/ceph/ceph-client.admin.58976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63779.log 2024-09-10T23:19:34.206 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43344.log.gz/var/log/ceph/ceph-mgr.y.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58976.log.gz 2024-09-10T23:19:34.206 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-10T23:19:34.206 INFO:teuthology.orchestra.run.smithi090.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-10T23:19:34.206 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67694.log 2024-09-10T23:19:34.206 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59106.log 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63779.log.gz 2024-09-10T23:19:34.206 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-10T23:19:34.206 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67863.log 2024-09-10T23:19:34.206 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67694.log.gz 2024-09-10T23:19:34.206 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.59106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51208.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59106.log.gz 2024-09-10T23:19:34.206 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-10T23:19:34.206 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46634.log 2024-09-10T23:19:34.206 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67863.log.gz 2024-09-10T23:19:34.207 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55855.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51208.log.gz 2024-09-10T23:19:34.207 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-10T23:19:34.207 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53458.log 2024-09-10T23:19:34.207 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58841.log 2024-09-10T23:19:34.207 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46634.log.gz 2024-09-10T23:19:34.207 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55855.log.gz 2024-09-10T23:19:34.207 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.53458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53458.log.gz 2024-09-10T23:19:34.207 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47911.log 2024-09-10T23:19:34.207 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.58841.log: -- /var/log/ceph/ceph-client.admin.49225.log 2024-09-10T23:19:34.207 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47911.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58841.log.gz 2024-09-10T23:19:34.207 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64329.log 2024-09-10T23:19:34.207 INFO:teuthology.orchestra.run.smithi090.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.47911.log.gz 2024-09-10T23:19:34.207 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60863.log 2024-09-10T23:19:34.207 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49225.log.gz 2024-09-10T23:19:34.208 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47319.log 2024-09-10T23:19:34.208 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64329.log: /var/log/ceph/ceph-client.admin.60863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62831.log 2024-09-10T23:19:34.208 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47319.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64329.log.gz 2024-09-10T23:19:34.208 INFO:teuthology.orchestra.run.smithi090.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.60863.log.gz 2024-09-10T23:19:34.208 INFO:teuthology.orchestra.run.smithi090.stderr:gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.47319.log.gz --verbose 2024-09-10T23:19:34.208 INFO:teuthology.orchestra.run.smithi090.stderr: -- /var/log/ceph/ceph.log 2024-09-10T23:19:34.208 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.62831.log: -- /var/log/ceph/ceph-client.admin.51624.log 2024-09-10T23:19:34.208 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62831.log.gz 2024-09-10T23:19:34.208 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60466.log 2024-09-10T23:19:34.208 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43218.log 2024-09-10T23:19:34.208 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51624.log: /var/log/ceph/ceph-client.admin.60466.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51624.log.gz 2024-09-10T23:19:34.208 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60466.log.gz 2024-09-10T23:19:34.208 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T23:19:34.209 INFO:teuthology.orchestra.run.smithi090.stderr: /var/log/ceph/ceph-client.admin.65953.log 2024-09-10T23:19:34.209 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66712.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43218.log.gz 2024-09-10T23:19:34.209 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-10T23:19:34.209 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.65953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49477.log 2024-09-10T23:19:34.209 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65953.log.gz 2024-09-10T23:19:34.209 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.66712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55379.log 2024-09-10T23:19:34.209 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66712.log.gz 2024-09-10T23:19:34.209 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49477.log: -- /var/log/ceph/ceph-client.admin.43386.log 2024-09-10T23:19:34.209 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55379.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49477.log.gz 2024-09-10T23:19:34.209 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57053.log 2024-09-10T23:19:34.209 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55379.log.gz 2024-09-10T23:19:34.209 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47869.log 2024-09-10T23:19:34.209 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43386.log: /var/log/ceph/ceph-client.admin.57053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52780.log 2024-09-10T23:19:34.210 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43386.log.gz 2024-09-10T23:19:34.210 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47869.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57053.log.gz 2024-09-10T23:19:34.210 INFO:teuthology.orchestra.run.smithi090.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64035.log 2024-09-10T23:19:34.210 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47869.log.gz 2024-09-10T23:19:34.210 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63396.log 2024-09-10T23:19:34.210 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52780.log.gz 2024-09-10T23:19:34.210 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63909.log 2024-09-10T23:19:34.210 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64035.log: /var/log/ceph/ceph-client.admin.63396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36550.log 2024-09-10T23:19:34.210 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6%/var/log/ceph/ceph-client.admin.63909.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63396.log.gz 2024-09-10T23:19:34.210 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64035.log.gz 2024-09-10T23:19:34.210 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63909.log.gz 2024-09-10T23:19:34.210 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52650.log 2024-09-10T23:19:34.210 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36550.log.gz 2024-09-10T23:19:34.210 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45858.log 2024-09-10T23:19:34.210 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62037.log 2024-09-10T23:19:34.211 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52650.log.gz 2024-09-10T23:19:34.211 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65858.log 2024-09-10T23:19:34.211 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45858.log.gz 2024-09-10T23:19:34.211 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60611.log 2024-09-10T23:19:34.211 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.62037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57645.log 2024-09-10T23:19:34.211 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.65858.log: /var/log/ceph/ceph-client.admin.60611.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.62037.log.gz 2024-09-10T23:19:34.211 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60611.log.gz 2024-09-10T23:19:34.211 INFO:teuthology.orchestra.run.smithi090.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.65858.log.gz 2024-09-10T23:19:34.211 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43816.log 2024-09-10T23:19:34.211 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.57645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46026.log 2024-09-10T23:19:34.211 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57645.log.gz 2024-09-10T23:19:34.211 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48037.log 87.2% 2024-09-10T23:19:34.211 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43816.log.gz 2024-09-10T23:19:34.211 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48549.log 2024-09-10T23:19:34.212 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46026.log.gz 2024-09-10T23:19:34.212 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63059.log 2024-09-10T23:19:34.212 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48037.log: /var/log/ceph/ceph-client.admin.48549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43810.log 2024-09-10T23:19:34.212 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48037.log.gz 2024-09-10T23:19:34.212 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48549.log.gz 2024-09-10T23:19:34.212 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63059.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63059.log.gz 2024-09-10T23:19:34.212 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67044.log 2024-09-10T23:19:34.212 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42953.log 2024-09-10T23:19:34.212 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43810.log.gz/var/log/ceph/ceph-client.admin.67044.log: 2024-09-10T23:19:34.212 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52223.log 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67044.log.gz 2024-09-10T23:19:34.212 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-10T23:19:34.212 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50326.log 2024-09-10T23:19:34.212 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42953.log.gz 2024-09-10T23:19:34.212 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63867.log 2024-09-10T23:19:34.213 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52223.log.gz 2024-09-10T23:19:34.213 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36494.log 2024-09-10T23:19:34.213 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50326.log.gz 2024-09-10T23:19:34.213 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57829.log 2024-09-10T23:19:34.213 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63867.log: /var/log/ceph/ceph-client.admin.36494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48145.log 2024-09-10T23:19:34.213 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36494.log.gz 2024-09-10T23:19:34.213 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.57829.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63867.log.gz 2024-09-10T23:19:34.213 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51582.log 87.1% 2024-09-10T23:19:34.213 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57829.log.gz 2024-09-10T23:19:34.213 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42276.log 2024-09-10T23:19:34.213 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48145.log.gz 2024-09-10T23:19:34.213 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67947.log 2024-09-10T23:19:34.213 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52513.log 2024-09-10T23:19:34.214 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51582.log.gz/var/log/ceph/ceph-client.admin.42276.log: 2024-09-10T23:19:34.214 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67947.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42276.log.gz 2024-09-10T23:19:34.214 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67947.log.gz 2024-09-10T23:19:34.214 INFO:teuthology.orchestra.run.smithi090.stderr: -- /var/log/ceph/ceph-client.admin.66838.log 2024-09-10T23:19:34.214 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52513.log: gzip -5 --verbose -- 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52513.log.gz 2024-09-10T23:19:34.214 INFO:teuthology.orchestra.run.smithi090.stderr: /var/log/ceph/ceph-client.admin.53758.log 2024-09-10T23:19:34.214 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.66838.log: gzip -5 --verbose 87.6% -- /var/log/ceph/ceph-client.admin.59316.log 2024-09-10T23:19:34.214 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66838.log.gz 2024-09-10T23:19:34.214 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36186.log 2024-09-10T23:19:34.214 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56160.log 2024-09-10T23:19:34.214 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.59316.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53758.log.gz 2024-09-10T23:19:34.214 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36186.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.59316.log.gz 2024-09-10T23:19:34.214 INFO:teuthology.orchestra.run.smithi090.stderr: 76.9% -- replaced with /var/log/ceph/ceph-client.admin.36186.log.gz 2024-09-10T23:19:34.214 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65717.log 2024-09-10T23:19:34.215 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43818.log 2024-09-10T23:19:34.215 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56160.log.gz/var/log/ceph/ceph-client.0.65717.log: 2024-09-10T23:19:34.215 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65717.log.gz 2024-09-10T23:19:34.215 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58100.log 2024-09-10T23:19:34.215 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.43818.log: -- /var/log/ceph/ceph-client.admin.53671.log 2024-09-10T23:19:34.215 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58100.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43818.log.gz 2024-09-10T23:19:34.215 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52384.log 2024-09-10T23:19:34.215 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58100.log.gz 2024-09-10T23:19:34.215 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56240.log 2024-09-10T23:19:34.215 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53671.log: /var/log/ceph/ceph-client.admin.52384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49141.log 2024-09-10T23:19:34.215 INFO:teuthology.orchestra.run.smithi090.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.53671.log.gz 2024-09-10T23:19:34.215 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56240.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52384.log.gz 2024-09-10T23:19:34.215 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56240.log.gz 2024-09-10T23:19:34.215 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53074.log 2024-09-10T23:19:34.216 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55337.log 2024-09-10T23:19:34.216 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49141.log.gz/var/log/ceph/ceph-client.admin.53074.log: 2024-09-10T23:19:34.216 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49988.log 2024-09-10T23:19:34.216 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.53074.log.gz 2024-09-10T23:19:34.216 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51398.log 2024-09-10T23:19:34.216 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55337.log: /var/log/ceph/ceph-client.admin.49988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44154.log 2024-09-10T23:19:34.216 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5%/var/log/ceph/ceph-client.admin.51398.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49988.log.gz 2024-09-10T23:19:34.216 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55337.log.gz 2024-09-10T23:19:34.216 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51398.log.gz 2024-09-10T23:19:34.216 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53200.log 2024-09-10T23:19:34.216 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47449.log 2024-09-10T23:19:34.216 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44154.log.gz 2024-09-10T23:19:34.216 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45565.log 2024-09-10T23:19:34.217 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43815.log 2024-09-10T23:19:34.217 INFO:teuthology.orchestra.run.smithi090.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53200.log.gz 2024-09-10T23:19:34.217 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47449.log: /var/log/ceph/ceph-client.2.45565.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.65417.log 2024-09-10T23:19:34.217 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47449.log.gz 2024-09-10T23:19:34.217 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.2.45565.log.gz 2024-09-10T23:19:34.217 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53824.log 2024-09-10T23:19:34.217 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43815.log: /var/log/ceph/ceph-client.admin.65417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67779.log 2024-09-10T23:19:34.217 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0%/var/log/ceph/ceph-client.admin.53824.log: -- replaced with /var/log/ceph/ceph-client.admin.43815.log.gz 2024-09-10T23:19:34.217 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65417.log.gz 2024-09-10T23:19:34.217 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61995.log 2024-09-10T23:19:34.217 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67779.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53824.log.gz 2024-09-10T23:19:34.217 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61287.log 2024-09-10T23:19:34.217 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.67779.log.gz 2024-09-10T23:19:34.217 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55068.log 2024-09-10T23:19:34.218 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61995.log: /var/log/ceph/ceph-client.admin.61287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58693.log 2024-09-10T23:19:34.218 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.55068.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61995.log.gz 2024-09-10T23:19:34.218 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61287.log.gz 2024-09-10T23:19:34.218 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55068.log.gz 2024-09-10T23:19:34.218 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37170.log 2024-09-10T23:19:34.218 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45774.log 2024-09-10T23:19:34.218 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5%/var/log/ceph/ceph-client.admin.37170.log: -- replaced with /var/log/ceph/ceph-client.admin.58693.log.gz 2024-09-10T23:19:34.218 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43046.log 2024-09-10T23:19:34.218 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37170.log.gz 2024-09-10T23:19:34.218 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60298.log 2024-09-10T23:19:34.218 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45774.log: /var/log/ceph/ceph-client.admin.43046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47193.log 2024-09-10T23:19:34.218 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.60298.log: 87.3% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43046.log.gz 2024-09-10T23:19:34.218 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45774.log.gz 2024-09-10T23:19:34.219 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60298.log.gz 2024-09-10T23:19:34.219 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36298.log 2024-09-10T23:19:34.219 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61332.log 87.6% 2024-09-10T23:19:34.219 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47193.log.gz 2024-09-10T23:19:34.219 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36298.log.gz 2024-09-10T23:19:34.219 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43470.log 2024-09-10T23:19:34.219 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5/var/log/ceph/ceph-client.admin.61332.log: --verbose -- /var/log/ceph/ceph-client.admin.49435.log 2024-09-10T23:19:34.219 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49011.log 2024-09-10T23:19:34.219 INFO:teuthology.orchestra.run.smithi090.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.61332.log.gz 2024-09-10T23:19:34.219 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.43470.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56759.log 2024-09-10T23:19:34.219 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-10T23:19:34.219 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49435.log: /var/log/ceph/ceph-client.admin.49011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64473.log 2024-09-10T23:19:34.219 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49435.log.gz 2024-09-10T23:19:34.219 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49011.log.gz 2024-09-10T23:19:34.219 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54802.log 2024-09-10T23:19:34.220 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65111.log 2024-09-10T23:19:34.220 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.56759.log.gz 2024-09-10T23:19:34.220 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54802.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.64473.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59550.log 2024-09-10T23:19:34.220 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-10T23:19:34.220 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54802.log.gz 2024-09-10T23:19:34.220 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63951.log 2024-09-10T23:19:34.220 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.65111.log: /var/log/ceph/ceph-client.admin.59550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48626.log 2024-09-10T23:19:34.220 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65111.log.gz 2024-09-10T23:19:34.220 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59550.log.gz 2024-09-10T23:19:34.220 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36876.log 2024-09-10T23:19:34.220 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48626.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63951.log.gz 2024-09-10T23:19:34.220 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63186.log 2024-09-10T23:19:34.220 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36876.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48626.log.gz 2024-09-10T23:19:34.220 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49771.log 2024-09-10T23:19:34.221 INFO:teuthology.orchestra.run.smithi090.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36876.log.gz 2024-09-10T23:19:34.221 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42909.log 2024-09-10T23:19:34.221 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63186.log: /var/log/ceph/ceph-client.admin.49771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66157.log 2024-09-10T23:19:34.221 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42909.log: 87.9% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49771.log.gz 2024-09-10T23:19:34.221 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63186.log.gz 2024-09-10T23:19:34.221 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42909.log.gz 2024-09-10T23:19:34.221 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66628.log 2024-09-10T23:19:34.221 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.66157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51666.log 2024-09-10T23:19:34.221 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.66628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59862.log 2024-09-10T23:19:34.221 INFO:teuthology.orchestra.run.smithi090.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.66157.log.gz 2024-09-10T23:19:34.221 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66628.log.gz 2024-09-10T23:19:34.221 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56065.log 2024-09-10T23:19:34.221 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.59862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50938.log 2024-09-10T23:19:34.221 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51666.log.gz 2024-09-10T23:19:34.222 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56065.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59862.log.gz 2024-09-10T23:19:34.222 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53454.log 2024-09-10T23:19:34.222 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56065.log.gz 2024-09-10T23:19:34.222 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.50938.log: -- /var/log/ceph/ceph-client.admin.45261.log 2024-09-10T23:19:34.222 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.53454.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50938.log.gz 2024-09-10T23:19:34.222 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53454.log.gz 2024-09-10T23:19:34.222 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68115.log 2024-09-10T23:19:34.222 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67156.log 2024-09-10T23:19:34.222 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.68115.log: /var/log/ceph/ceph-client.admin.45261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63695.log 2024-09-10T23:19:34.222 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45261.log.gz 2024-09-10T23:19:34.222 INFO:teuthology.orchestra.run.smithi090.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.68115.log.gz 2024-09-10T23:19:34.222 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.67156.log: -- /var/log/ceph/ceph-client.admin.47743.log 2024-09-10T23:19:34.222 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63695.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67156.log.gz 2024-09-10T23:19:34.222 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54254.log 2024-09-10T23:19:34.222 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63695.log.gz 2024-09-10T23:19:34.223 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45900.log 2024-09-10T23:19:34.223 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47743.log: /var/log/ceph/ceph-client.0.54254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63438.log 2024-09-10T23:19:34.223 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54254.log.gz 2024-09-10T23:19:34.223 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45900.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47743.log.gz 2024-09-10T23:19:34.223 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45900.log.gz 2024-09-10T23:19:34.223 INFO:teuthology.orchestra.run.smithi090.stderr: -- /var/log/ceph/ceph-client.admin.56885.log 2024-09-10T23:19:34.223 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63438.log: gzip -5 --verbose -- 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63438.log.gz 2024-09-10T23:19:34.223 INFO:teuthology.orchestra.run.smithi090.stderr: /var/log/ceph/ceph-client.0.48351.log 2024-09-10T23:19:34.223 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51792.log 2024-09-10T23:19:34.223 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.56885.log.gz 2024-09-10T23:19:34.223 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.48351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48351.log.gz 2024-09-10T23:19:34.223 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56969.log 2024-09-10T23:19:34.223 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52303.log 2024-09-10T23:19:34.223 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56363.log 2024-09-10T23:19:34.224 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51792.log.gz 2024-09-10T23:19:34.224 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56969.log: /var/log/ceph/ceph-client.admin.52303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52692.log 2024-09-10T23:19:34.224 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1%/var/log/ceph/ceph-client.admin.56363.log: -- replaced with /var/log/ceph/ceph-client.admin.56969.log.gz 2024-09-10T23:19:34.224 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52303.log.gz 2024-09-10T23:19:34.224 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56363.log.gz 2024-09-10T23:19:34.224 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67002.log 2024-09-10T23:19:34.224 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36270.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52692.log.gz 2024-09-10T23:19:34.224 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-10T23:19:34.224 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63823.log 2024-09-10T23:19:34.224 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.67002.log.gz 2024-09-10T23:19:34.224 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58753.log 2024-09-10T23:19:34.224 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59484.log 2024-09-10T23:19:34.224 INFO:teuthology.orchestra.run.smithi090.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36270.log.gz 2024-09-10T23:19:34.224 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63823.log: /var/log/ceph/ceph-client.admin.58753.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63823.log.gz 2024-09-10T23:19:34.225 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58753.log.gz 2024-09-10T23:19:34.225 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63270.log 2024-09-10T23:19:34.225 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.59484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63737.log 2024-09-10T23:19:34.225 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50830.log 2024-09-10T23:19:34.225 INFO:teuthology.orchestra.run.smithi090.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59484.log.gz 2024-09-10T23:19:34.225 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63270.log.gz 2024-09-10T23:19:34.225 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49351.log 2024-09-10T23:19:34.225 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62103.log 2024-09-10T23:19:34.225 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63737.log.gz 2024-09-10T23:19:34.225 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50830.log: /var/log/ceph/ceph-client.admin.49351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59232.log 2024-09-10T23:19:34.225 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49351.log.gz 2024-09-10T23:19:34.225 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.62103.log: -- replaced with /var/log/ceph/ceph-client.admin.50830.log.gz 2024-09-10T23:19:34.225 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62103.log.gz 2024-09-10T23:19:34.226 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43820.log 2024-09-10T23:19:34.226 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T23:19:34.226 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.59232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55072.log 2024-09-10T23:19:34.226 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3%/var/log/ceph/ceph-client.admin.43820.log: -- replaced with /var/log/ceph/ceph-client.admin.59232.log.gz 2024-09-10T23:19:34.226 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.3.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43820.log.gz 2024-09-10T23:19:34.226 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60117.log 2024-09-10T23:19:34.226 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.55072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55072.log.gz 2024-09-10T23:19:34.226 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56545.log 2024-09-10T23:19:34.226 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.60117.log: -- /var/log/ceph/ceph-client.admin.52002.log 2024-09-10T23:19:34.226 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56545.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.60117.log.gz 2024-09-10T23:19:34.226 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56545.log.gz 2024-09-10T23:19:34.226 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66004.log 2024-09-10T23:19:34.226 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52002.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-10T23:19:34.226 INFO:teuthology.orchestra.run.smithi090.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52002.log.gz 2024-09-10T23:19:34.226 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.66004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67736.log 2024-09-10T23:19:34.227 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mds.c.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66004.log.gz 2024-09-10T23:19:34.227 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50452.log 2024-09-10T23:19:34.227 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67736.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67736.log.gz 2024-09-10T23:19:34.227 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58394.log 2024-09-10T23:19:34.227 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50452.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50452.log.gz 2024-09-10T23:19:34.227 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48355.log 2024-09-10T23:19:34.227 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58394.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58394.log.gz 2024-09-10T23:19:34.227 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46179.log 2024-09-10T23:19:34.227 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.48355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48355.log.gz 2024-09-10T23:19:34.227 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45123.log 2024-09-10T23:19:34.227 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46179.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46179.log.gz 2024-09-10T23:19:34.227 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50662.log 2024-09-10T23:19:34.227 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.45123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45123.log.gz 2024-09-10T23:19:34.227 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58892.log 2024-09-10T23:19:34.228 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50662.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50662.log.gz 2024-09-10T23:19:34.228 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45703.log 2024-09-10T23:19:34.228 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58892.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58892.log.gz 2024-09-10T23:19:34.228 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56494.log 2024-09-10T23:19:34.228 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45703.log: 87.9% 92.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-10T23:19:34.228 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45703.log.gz 2024-09-10T23:19:34.228 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50536.log 2024-09-10T23:19:34.228 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48898.log 2024-09-10T23:19:34.228 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56494.log.gz 2024-09-10T23:19:34.228 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58934.log 2024-09-10T23:19:34.228 INFO:teuthology.orchestra.run.smithi090.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.50536.log.gz 2024-09-10T23:19:34.228 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.48898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48898.log.gz 2024-09-10T23:19:34.228 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49908.log 2024-09-10T23:19:34.228 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54250.log 2024-09-10T23:19:34.229 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58934.log.gz 2024-09-10T23:19:34.229 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59148.log 2024-09-10T23:19:34.229 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49908.log.gz 2024-09-10T23:19:34.229 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.54250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54250.log.gz 2024-09-10T23:19:34.229 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61953.log 2024-09-10T23:19:34.229 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.59148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46424.log 2024-09-10T23:19:34.229 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.59148.log.gz 2024-09-10T23:19:34.229 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44153.log 2024-09-10T23:19:34.229 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46424.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61953.log.gz 2024-09-10T23:19:34.229 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46424.log.gz 2024-09-10T23:19:34.229 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61743.log 2024-09-10T23:19:34.229 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44153.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44153.log.gz 2024-09-10T23:19:34.229 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61743.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61743.log.gz 2024-09-10T23:19:34.230 INFO:teuthology.orchestra.run.smithi171.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-10T23:19:34.241 INFO:teuthology.orchestra.run.smithi090.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-10T23:19:34.330 INFO:teuthology.orchestra.run.smithi090.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T23:19:34.341 INFO:teuthology.orchestra.run.smithi171.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-10T23:19:34.366 INFO:teuthology.orchestra.run.smithi171.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-10T23:19:34.379 INFO:teuthology.orchestra.run.smithi171.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-10T23:19:34.409 INFO:teuthology.orchestra.run.smithi090.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T23:19:34.429 INFO:teuthology.orchestra.run.smithi171.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-10T23:19:34.431 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-09-10T23:19:34.431 INFO:teuthology.orchestra.run.smithi171.stderr:real 0m0.488s 2024-09-10T23:19:34.431 INFO:teuthology.orchestra.run.smithi171.stderr:user 0m2.134s 2024-09-10T23:19:34.431 INFO:teuthology.orchestra.run.smithi171.stderr:sys 0m0.108s 2024-09-10T23:19:34.456 INFO:teuthology.orchestra.run.smithi090.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T23:19:34.505 INFO:teuthology.orchestra.run.smithi090.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T23:19:34.579 INFO:teuthology.orchestra.run.smithi090.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T23:19:34.581 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-10T23:19:34.581 INFO:teuthology.orchestra.run.smithi090.stderr:real 0m0.666s 2024-09-10T23:19:34.581 INFO:teuthology.orchestra.run.smithi090.stderr:user 0m2.646s 2024-09-10T23:19:34.582 INFO:teuthology.orchestra.run.smithi090.stderr:sys 0m0.392s 2024-09-10T23:19:34.582 INFO:tasks.ceph:Archiving logs... 2024-09-10T23:19:34.582 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899779/remote/smithi090/log 2024-09-10T23:19:34.583 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T23:19:35.347 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899779/remote/smithi171/log 2024-09-10T23:19:35.348 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T23:19:35.668 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T23:19:35.678 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T23:19:35.678 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T23:19:35.681 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T23:19:35.789 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T23:19:35.798 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T23:19:35.798 DEBUG:teuthology.orchestra.run.smithi090:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:19:35.801 DEBUG:teuthology.orchestra.run.smithi171:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:19:35.815 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:19:35.817 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:19:35.820 INFO:teuthology.orchestra.run.smithi090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:19:35.820 INFO:teuthology.orchestra.run.smithi090.stdout:=============================================================================== 2024-09-10T23:19:35.820 INFO:teuthology.orchestra.run.smithi090.stdout:^* hv01.front.sepia.ceph.com 3 6 377 34 -136us[ -135us] +/- 44ms 2024-09-10T23:19:35.821 INFO:teuthology.orchestra.run.smithi090.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 33 +598us[ +598us] +/- 59ms 2024-09-10T23:19:35.821 INFO:teuthology.orchestra.run.smithi090.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 -606us[ -606us] +/- 86ms 2024-09-10T23:19:35.821 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:19:35.822 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:19:35.822 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-09-10T23:19:35.822 INFO:teuthology.orchestra.run.smithi171.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 -127us[ -94us] +/- 44ms 2024-09-10T23:19:35.822 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 33 +618us[ +618us] +/- 58ms 2024-09-10T23:19:35.823 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 -596us[ -596us] +/- 86ms 2024-09-10T23:19:35.823 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:19:35.823 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T23:19:35.831 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T23:19:35.832 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T23:19:35.840 DEBUG:teuthology.orchestra.run.smithi090:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T23:19:35.944 DEBUG:teuthology.orchestra.run.smithi171:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T23:19:36.016 DEBUG:teuthology.orchestra.run.smithi090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T23:19:36.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:19:36.047 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T23:19:36.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:19:36.078 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T23:19:36.088 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T23:19:36.098 INFO:teuthology.task.internal:Duration was 720.370747 seconds 2024-09-10T23:19:36.098 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T23:19:36.107 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T23:19:36.107 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T23:19:36.110 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T23:19:36.147 INFO:teuthology.orchestra.run.smithi090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:19:36.158 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:19:36.563 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T23:19:36.564 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi090.front.sepia.ceph.com 2024-09-10T23:19:36.564 DEBUG:teuthology.orchestra.run.smithi090:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T23:19:36.625 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi171.front.sepia.ceph.com 2024-09-10T23:19:36.625 DEBUG:teuthology.orchestra.run.smithi171:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T23:19:36.652 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T23:19:36.653 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T23:19:36.667 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T23:19:36.719 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T23:19:36.719 DEBUG:teuthology.orchestra.run.smithi090:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T23:19:36.735 DEBUG:teuthology.orchestra.run.smithi171:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T23:19:36.869 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T23:19:36.880 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T23:19:36.881 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T23:19:36.906 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T23:19:36.931 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T23:19:36.940 DEBUG:teuthology.orchestra.run.smithi090:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:19:36.949 DEBUG:teuthology.orchestra.run.smithi171:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:19:36.969 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = core 2024-09-10T23:19:36.994 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = core 2024-09-10T23:19:37.008 DEBUG:teuthology.orchestra.run.smithi090:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:19:37.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:19:37.037 DEBUG:teuthology.orchestra.run.smithi171:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:19:37.063 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:19:37.063 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T23:19:37.073 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T23:19:37.074 DEBUG:teuthology.misc:Transferring archived files from smithi090:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899779/remote/smithi090 2024-09-10T23:19:37.074 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T23:19:37.112 DEBUG:teuthology.misc:Transferring archived files from smithi171:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899779/remote/smithi171 2024-09-10T23:19:37.112 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T23:19:37.147 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T23:19:37.147 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T23:19:37.150 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T23:19:37.197 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T23:19:37.209 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T23:19:37.209 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T23:19:37.220 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T23:19:37.220 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T23:19:37.223 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T23:19:37.235 INFO:teuthology.orchestra.run.smithi090.stdout: 265818 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 23:19 /home/ubuntu/cephtest 2024-09-10T23:19:37.252 INFO:teuthology.orchestra.run.smithi171.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 23:19 /home/ubuntu/cephtest 2024-09-10T23:19:37.253 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T23:19:37.263 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T23:19:37.285 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/sessionmap} duration: 720.3707473278046 flavor: default owner: scheduled_hyelloji@teuthology success: true 2024-09-10T23:19:37.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T23:19:37.412 INFO:teuthology.run:pass